Hello,
MC is a great software that I use everyday but I am a bit frustrated by MC's memory limitations, and I would like to now what other users think of the following suggestions:
1. Increase the maximum tsstorage.gdb file size, which is currently 4 Gb, to unlimited, as the NTFS file system supports files as large as the volume they are written on.
2. Uncap the maximum number of bars per chart and allow the user to decide how many bars should be on the charts, maybe with a warning message if the number of bar dangerously exceeds the amount of RAM available.
3. Increase the amount of RAM supported by each module (charting, backtesting etc.), to at least 32 Gb (might be coming with MC 64-bit).
Many thanks,
Memory Limitations
-
- Posts: 176
- Joined: 02 Feb 2008
- Location: Lausanne, Switzerland
- Has thanked: 9 times
- Been thanked: 5 times
Re: Memory Limitations
My feedback per topic:
1) Although I haven't faced the tsstorage.gdb limitation yet, anyone using tick data over several years with multiple instruments will easily reach 4 Gb. Now, MC using the firebird DB for storage, the firebird project has the following limitations:
NTFS has a 4GB file size limit (Windows NT)
NTFS has a 16EiB file size limit (Windows NT5 / 2000 and newer)
So, moving to 64 bit should be associated to naturally getting rid of the current limitation.
2) The number of max bars back can be changed through registry modification. Having done that, I no longer face any issue on this matter, as my amount of ram allows for the extension.
3) The amount of ram currently supported is 32 bits related, moving to 64 bits will suppress the issue.
To my opinion, the move to 64 bits will solve everything....when it is there and works.
Thierry
1) Although I haven't faced the tsstorage.gdb limitation yet, anyone using tick data over several years with multiple instruments will easily reach 4 Gb. Now, MC using the firebird DB for storage, the firebird project has the following limitations:
NTFS has a 4GB file size limit (Windows NT)
NTFS has a 16EiB file size limit (Windows NT5 / 2000 and newer)
So, moving to 64 bit should be associated to naturally getting rid of the current limitation.
2) The number of max bars back can be changed through registry modification. Having done that, I no longer face any issue on this matter, as my amount of ram allows for the extension.
3) The amount of ram currently supported is 32 bits related, moving to 64 bits will suppress the issue.
To my opinion, the move to 64 bits will solve everything....when it is there and works.
Thierry
Re: Memory Limitations
Tcat, Lara,
Thank you for your replies.
It seems that the 64-bit version will remove many limitations, and this is excellent news.
Will MC64 be able to plot more than 5,000,000 bars, and hopefully as many as the memory allows?
Many thanks,
Thank you for your replies.
It seems that the 64-bit version will remove many limitations, and this is excellent news.
Will MC64 be able to plot more than 5,000,000 bars, and hopefully as many as the memory allows?
Many thanks,
-
- Posts: 176
- Joined: 02 Feb 2008
- Location: Lausanne, Switzerland
- Has thanked: 9 times
- Been thanked: 5 times
Re: Memory Limitations
This thread might answer one of your question:
viewtopic.php?f=1&t=7756
I changed the registry key a while ago, as I was also running into bar count slimitations. As I am running several charts with multiple data series, I do get a lot of memory warning and a very, very long boot time. But it makes the job.
Thierry
viewtopic.php?f=1&t=7756
I changed the registry key a while ago, as I was also running into bar count slimitations. As I am running several charts with multiple data series, I do get a lot of memory warning and a very, very long boot time. But it makes the job.
Thierry
Re: Memory Limitations
Hi Thierry,
Thank you for your reply.
I am already using this registry modification.
Hopefully, the maximum number of bars will be increased with MC64.
Many thanks,
Thank you for your reply.
I am already using this registry modification.
Hopefully, the maximum number of bars will be increased with MC64.
Many thanks,
Re: Memory Limitations
It is an old thread, but good questions. I know answer for 2. is that MC64 does not have 5 million bar limitation on a chart.Hello,
MC is a great software that I use everyday but I am a bit frustrated by MC's memory limitations, and I would like to now what other users think of the following suggestions:
1. Increase the maximum tsstorage.gdb file size, which is currently 4 Gb, to unlimited, as the NTFS file system supports files as large as the volume they are written on.
2. Uncap the maximum number of bars per chart and allow the user to decide how many bars should be on the charts, maybe with a warning message if the number of bar dangerously exceeds the amount of RAM available.
3. Increase the amount of RAM supported by each module (charting, backtesting etc.), to at least 32 Gb (might be coming with MC 64-bit).
Many thanks,
I would like to know answer for 1. and 3. Thanks a lot.
- Henry MultiСharts
- Posts: 9165
- Joined: 25 Aug 2011
- Has thanked: 1264 times
- Been thanked: 2957 times
Re: Memory Limitations
Databases files are no longer limited to 4gb size.1. Increase the maximum tsstorage.gdb file size, which is currently 4 Gb, to unlimited, as the NTFS file system supports files as large as the volume they are written on.
MultiCharts 32 bit is limited to 5 mln bars per chart.2. Uncap the maximum number of bars per chart and allow the user to decide how many bars should be on the charts, maybe with a warning message if the number of bar dangerously exceeds the amount of RAM available.
MultiCharts 64 bit is limited to 100 mln bars per chart.
MultiCharts 32 bit has a Windows limitation of 2 GB of virtual memory per process (like each other 32 bit application does).3. Increase the amount of RAM supported by each module (charting, backtesting etc.), to at least 32 Gb (might be coming with MC 64-bit).
MultiCharts 64 bit has no such limitation and can utilize all of the available RAM.
- TJ
- Posts: 7743
- Joined: 29 Aug 2006
- Location: Global Citizen
- Has thanked: 1033 times
- Been thanked: 2222 times
Re: Memory Limitations
Please note that while MultiCharts64 can address more memory space,
Microsoft has imposed limitation on its various Windows operating system. Please ensure you obtain the correct version of Windows for your task.
Memory Limits for Windows and Windows Server Releases
http://msdn.microsoft.com/en-ca/library ... s.85).aspx
Microsoft has imposed limitation on its various Windows operating system. Please ensure you obtain the correct version of Windows for your task.
Memory Limits for Windows and Windows Server Releases
http://msdn.microsoft.com/en-ca/library ... s.85).aspx
Re: Memory Limitations
Fantastic!Databases files are no longer limited to 4gb size.
I am thinking of getting an IQFEED connection and saving tick data for 1800 stocks in the MC database. Collecting tick data for 1800 US stocks, will start to quickly fill DB.
Question: What is the impact on performance if db size gets very large. With a 20 GB or a 40 GB database size, how will MC64 perform for backtesting/live trading etc, compared to now when my db is of 2 GB size?
If a chart has 5 data series viz. data1, data2, data3, data4 and data5, then whether upper limit is 20 million bars per chart for each data series? Or each data series can have 100 million bars, so whole chart can have 500 million bars in MC64?MultiCharts 32 bit is limited to 5 mln bars per chart.
MultiCharts 64 bit is limited to 100 mln bars per chart.
- Henry MultiСharts
- Posts: 9165
- Joined: 25 Aug 2011
- Has thanked: 1264 times
- Been thanked: 2957 times
Re: Memory Limitations
The size of the database has no impact on the performance. The amount of the data loaded on a chart can impact it.Question: What is the impact on performance if db size gets very large. With a 20 GB or a 40 GB database size, how will MC64 perform for backtesting/live trading etc, compared to now when my db is of 2 GB size?
The limitation is per data series. Each data series can have 100 mln bars in MultiCharts 64 bit.If a chart has 5 data series viz. data1, data2, data3, data4 and data5, then whether upper limit is 20 million bars per chart for each data series? Or each data series can have 100 million bars, so whole chart can have 500 million bars in MC64?
- arnie
- Posts: 1594
- Joined: 11 Feb 2009
- Location: Portugal
- Has thanked: 481 times
- Been thanked: 514 times
Re: Memory Limitations
Careful when "playing" with tick data.
It you load too much data on a chart it will make any chart platform to choke and even become unresponsive specially if dealing with the ES contract
It you load too much data on a chart it will make any chart platform to choke and even become unresponsive specially if dealing with the ES contract