I have read some post about this on the forum from awhile ago.
Mainly for optimizing purposes in the portfolio backtester, it would be nice to speed up this process. I have a high end pc and it takes some time to test my strategies (mostly around 20 hours)
I came across this website: http://www.xoreax.com/
It is about grid computing and sharing workload to other pc's in your network. Anyone has experience with grid computing and multicharts with the mentioned company in the link or in general?
Multicharts and grid computing
-
- Posts: 310
- Joined: 02 Nov 2010
- Has thanked: 26 times
- Been thanked: 23 times
Re: Multicharts and grid computing
Hi I connect lan pc to
http://www.digipede.net/
in mc calculation and it works.
I request many time to improve a grid solution.
For example to connect mc to amazon cloud services and other, or to improve win2008 server grid possibility in mc.
There are also many open source software to improve this features.
Another different solution is to enable the CUDA on graphic card, and in my opinion it's more powerfull and easy to single user.
If any user find a solution to grid cmputing please tell us.
Metaquotes improved a cloud solution directly into MT, I use it a lot.
http://www.digipede.net/
in mc calculation and it works.
I request many time to improve a grid solution.
For example to connect mc to amazon cloud services and other, or to improve win2008 server grid possibility in mc.
There are also many open source software to improve this features.
Another different solution is to enable the CUDA on graphic card, and in my opinion it's more powerfull and easy to single user.
If any user find a solution to grid cmputing please tell us.
Metaquotes improved a cloud solution directly into MT, I use it a lot.
-
- Posts: 401
- Joined: 19 Jan 2011
- Location: Netherlands
- Has thanked: 85 times
- Been thanked: 125 times
Re: Multicharts and grid computing
Hi bomberone1,
Can you tell me a bit more about how good the digipede solutions works. I have 3 identical pc's. One is the server (windows7 ultimate) and 2 are workstations (windows7 professional).
The server is located at a different location than the 2 workstations. Connected by cable internet.
If I can grid these 3 pc's, can I expect to decline the optimizing (20 hours) to say 7 hours. or is the impact of the grid not that big.
And the use of the software. Is it plug and play or do you need to program scripts to let it work with MC? And do you need to have a copy off MC on each pc?
Can you tell me a bit more about how good the digipede solutions works. I have 3 identical pc's. One is the server (windows7 ultimate) and 2 are workstations (windows7 professional).
The server is located at a different location than the 2 workstations. Connected by cable internet.
If I can grid these 3 pc's, can I expect to decline the optimizing (20 hours) to say 7 hours. or is the impact of the grid not that big.
And the use of the software. Is it plug and play or do you need to program scripts to let it work with MC? And do you need to have a copy off MC on each pc?
Re: Multicharts and grid computing
Hi,
With Multicharts.NET, as it is in a visual Studio environnement, I think it may possible to use multicharts in a Grid environment, or on a GPU.
http://www.xoreax.com and other are compatible .NET
Emmanuel
With Multicharts.NET, as it is in a visual Studio environnement, I think it may possible to use multicharts in a Grid environment, or on a GPU.
http://www.xoreax.com and other are compatible .NET
Emmanuel
- TJ
- Posts: 7744
- Joined: 29 Aug 2006
- Location: Global Citizen
- Has thanked: 1033 times
- Been thanked: 2223 times
Re: Multicharts and grid computing
Grid computing is only useful if you can distribute the tasks.Hi,
With Multicharts.NET, as it is in a visual Studio environnement, I think it may possible to use multicharts in a Grid environment, or on a GPU.
http://www.xoreax.com and other are compatible .NET
Emmanuel
eg. A movie library where a hundred users want to access a hundred movies. Each grid node can be used to serve one movie viewer.
In a trading environment, I am not so sure if distributed computing can help. We are dealing with sequential events (Analyze, Buy, hold, analyze again, then sell). We cannot have one grid node handle the buy, another node handle the hold, and the third node handle the sell... because they are sequential events, the nodes must wait for one event to complete before another node can takeover. It defeats the purpose of the distributed concept.
- furytrader
- Posts: 354
- Joined: 30 Jul 2010
- Location: Chicago, IL
- Has thanked: 155 times
- Been thanked: 217 times
Re: Multicharts and grid computing
If you're running a back test, I imagine you could have different computers running different trials, and then have the source computer retrieve and compile the results ...
-
- Posts: 401
- Joined: 19 Jan 2011
- Location: Netherlands
- Has thanked: 85 times
- Been thanked: 125 times
Re: Multicharts and grid computing
The purpose of grid computing for me, is to speed up the optimizing part of the backtesting. I think MC is fast enough for trade purposes. But just like any other trading software, the backtesting (and particulary the optimizing) is slow.
This is not because of MC but because of the many calculations there needs to be done. In the link I mentioned , they state it can speed up certain task to almost 30x. Now we are talking. But it must work with MC.
I also requested info at the mentioned company. No response yet. If I hear from them, I will give an update.
If anyone has already got a solution running, I am happy to hear how that works.
This is not because of MC but because of the many calculations there needs to be done. In the link I mentioned , they state it can speed up certain task to almost 30x. Now we are talking. But it must work with MC.
I also requested info at the mentioned company. No response yet. If I hear from them, I will give an update.
If anyone has already got a solution running, I am happy to hear how that works.
- TJ
- Posts: 7744
- Joined: 29 Aug 2006
- Location: Global Citizen
- Has thanked: 1033 times
- Been thanked: 2223 times
Re: Multicharts and grid computing
can optimization be distributed?The purpose of grid computing for me, is to speed up the optimizing part of the backtesting. I think MC is fast enough for trade purposes. But just like any other trading software, the backtesting (and particulary the optimizing) is slow.
This is not because of MC but because of the many calculations there needs to be done. In the link I mentioned , they state it can speed up certain task to almost 30x. Now we are talking. But it must work with MC.
I also requested info at the mentioned company. No response yet. If I hear from them, I will give an update.
If anyone has already got a solution running, I am happy to hear how that works.
probably there are places that can be utilized.
But before we go that far, have you look at your optimization method and strategy?
Have you reviewed your 3D chart?
It can tell you a lot on which direction you can go, and whether certain strategy can or cannot (or should not) be optimized.
Brute force can only take you so far.
-
- Posts: 401
- Joined: 19 Jan 2011
- Location: Netherlands
- Has thanked: 85 times
- Been thanked: 125 times
Re: Multicharts and grid computing
Hi Tj
In the quest to THE strategy, you change the code and the inputs a lot and need to test it on a lot of different symbols. So the first thing in mind came up. "wouldn't it be great if, the optimizing took only 2 hours for a strategy instead of 20 hours" I could do a lot more in the same time. There is no significant improvement to gain from changing/upgrading my hardware within normal amount of money spend. I have more pc's so if possible to combine the calculating power, it would be the most cost and time efficient way to go. Beside ofcourse from preventing unnecessary optimizing.
I don't know, that is my question also, does it work with software like MC?can optimization be distributed?
I don't use brute force, but Genetic. Probably my strategy could be coded better but I use around 10 to 15 inputs. The first time I used the optimizing function and included all the inputs, it came up with 300 million different possibilities. This would take about 8 years to finish. So the next time I excluded some inputs and change the amount of steps. I got a more acceptable way of optimizing. But still about 20 hours per symbol.But before we go that far, have you look at your optimization method and strategy?
I did, but I know I have to learn more about the 3D chart to get the most out of it. I will certainly take a better look at this to avoid unnecessary optimizing.Have you reviewed your 3D chart?
In the quest to THE strategy, you change the code and the inputs a lot and need to test it on a lot of different symbols. So the first thing in mind came up. "wouldn't it be great if, the optimizing took only 2 hours for a strategy instead of 20 hours" I could do a lot more in the same time. There is no significant improvement to gain from changing/upgrading my hardware within normal amount of money spend. I have more pc's so if possible to combine the calculating power, it would be the most cost and time efficient way to go. Beside ofcourse from preventing unnecessary optimizing.
-
- Posts: 401
- Joined: 19 Jan 2011
- Location: Netherlands
- Has thanked: 85 times
- Been thanked: 125 times
Re: Multicharts and grid computing
Hi,
Got confirmation from MC that sharing pc calculation power to increase optimization speed is not possible with Multicharts. (doesn't matter what grid computing software).
Hopefully it will be implemented someday.
Got confirmation from MC that sharing pc calculation power to increase optimization speed is not possible with Multicharts. (doesn't matter what grid computing software).
Hopefully it will be implemented someday.
Re: Multicharts and grid computing
evdl: You may take a look at this:I don't use brute force, but Genetic.
http://www.adaptrade.com/Builder/index.htm
"Can I install the program on multiple computers?
Yes. Builder is licensed per-user, not per-computer. Provided it's for your own use only, you can install the program on multiple computers. The single-user license comes with three activations by default. More can be added upon request."
http://www.adaptrade.com/Builder/Builderfaq.htm#Q32
Regards
P.S. Sorry, i found earlier posts mentioning this software. But having about 3 or more licences with buying just once makes it at least possible to compute a task with multiple computers for multiple markets.
-
- Posts: 310
- Joined: 02 Nov 2010
- Has thanked: 26 times
- Been thanked: 23 times
Re: Multicharts and grid computing
Hi evdl,Hi bomberone1,
Can you tell me a bit more about how good the digipede solutions works. I have 3 identical pc's. One is the server (windows7 ultimate) and 2 are workstations (windows7 professional).
The server is located at a different location than the 2 workstations. Connected by cable internet.
If I can grid these 3 pc's, can I expect to decline the optimizing (20 hours) to say 7 hours. or is the impact of the grid not that big.
And the use of the software. Is it plug and play or do you need to program scripts to let it work with MC? And do you need to have a copy off MC on each pc?
I request the support of digiped to install and setup all stuff, I don't know what exactly the did.
I am a trader and focused on trading and improve different trading style, no in it enviroment.