ASCII Import - data missing problem

Questions about MultiCharts and user contributed studies.
Flatstrap
Posts: 9
Joined: 15 Feb 2014
Has thanked: 2 times
Been thanked: 1 time

ASCII Import - data missing problem

Postby Flatstrap » 15 Feb 2014

Hi,
I'm trying to import some ASCII forex data:
1 minute timeframe from 1 Jan 2005 to 1 Jan 2007 as per the screen shot. (about 1,050,000 records)

The quote manager will import the data and says it's all good to go, this takes about 30 seconds. How ever when I re-interrogate the data it only has the last 50000 records spanning from 28/11/2006 -> 1/1/2007. The charts are also truncated to these dates.

The database file (TSSTORAGE.GDB) is currently pushing 200mb (199840kb) is this a problem?

I initially tried importing the ASCII data into one of the realtime symbols that I have set up through IB however when that didn't work I created brand a new one with no data in it...this has not worked...I also tried changing the "Data Source" from Free Quotes to ASCII Mapping and obviously before that on the realtime symbol it was IB, so I don't think thats a problem.

Here are the screen shots of how I load the ASCII data, in sequence.

Any help would be appreciated.
Regards
Flatstrap

https://skydrive.live.com/redir?resid=8 ... oto%2c.jpg

https://skydrive.live.com/redir?resid=8 ... oto%2c.jpg

https://skydrive.live.com/redir?resid=8 ... oto%2c.jpg

https://skydrive.live.com/redir?resid=8 ... oto%2c.jpg

https://skydrive.live.com/redir?resid=8 ... oto%2c.jpg

ps...if the images don't show up 'right click' and open in a new tab :)

User avatar
TJ
Posts: 7742
Joined: 29 Aug 2006
Location: Global Citizen
Has thanked: 1033 times
Been thanked: 2222 times

Re: ASCII Import - data missing problem

Postby TJ » 16 Feb 2014

Hi,
I'm trying to import some ASCII forex data:
::
The database file (TSSTORAGE.GDB) is currently pushing 200mb (199840kb) is this a problem?
::
That should not be a problem. Mine is more than twice of yours.

Flatstrap
Posts: 9
Joined: 15 Feb 2014
Has thanked: 2 times
Been thanked: 1 time

Re: ASCII Import - data missing problem

Postby Flatstrap » 16 Feb 2014

Thanks for the feedback TJ.
I was thinking about moving the original files and seeing if MC would create a new database, maybe it's corrupt?
But then I'd need to move all the data over and that's a huge task!

Regards
Flatstrap

User avatar
JoshM
Posts: 2195
Joined: 20 May 2011
Location: The Netherlands
Has thanked: 1544 times
Been thanked: 1565 times
Contact:

Re: ASCII Import - data missing problem

Postby JoshM » 17 Feb 2014

The database file (TSSTORAGE.GDB) is currently pushing 200mb (199840kb) is this a problem?
Not at all; mine is approaching 16Gb and there are no problems of performance issues to be found.
The quote manager will import the data and says it's all good to go, this takes about 30 seconds. How ever when I re-interrogate the data it only has the last 50000 records spanning from 28/11/2006 -> 1/1/2007. The charts are also truncated to these dates.

I initially tried importing the ASCII data into one of the realtime symbols that I have set up through IB however when that didn't work I created brand a new one with no data in it...this has not worked...I also tried changing the "Data Source" from Free Quotes to ASCII Mapping and obviously before that on the realtime symbol it was IB, so I don't think thats a problem.
That's odd, since it clearly should import all data. The only think I can think of, besides visiting the Live Chat, is to clear the QuoteManager cache (see here) and see if that affects the problem.

Actually, a second thing you could try is remove the ASCII imported data and reduce the database size (see here) as to, in a sense, clean the database and remove the redundant information. And then import the data again.

But.. backup your database first before trying anything. :)

Flatstrap
Posts: 9
Joined: 15 Feb 2014
Has thanked: 2 times
Been thanked: 1 time

Re: ASCII Import - data missing problem

Postby Flatstrap » 18 Feb 2014

Thanks Josh,
I tried reducing the db size. While the reducing size worked fine it didn't solve my issue so I contacted support and they are looking at it.

Cheers
Flatstrap

User avatar
Henry MultiСharts
Posts: 9165
Joined: 25 Aug 2011
Has thanked: 1264 times
Been thanked: 2957 times

Re: ASCII Import - data missing problem

Postby Henry MultiСharts » 18 Feb 2014

This case has been replicated on our end and forwarded to our developers for further analysis.

As a workaround that is possible to do ASCII mapping of this file.
I.e. read the data directly from the file, without importing it into MC database.
The file must be modified first. Date and time must be separated by a comma.
Then follow these instructions: https://www.multicharts.com/trading-sof ... ping_ASCII

User avatar
Henry MultiСharts
Posts: 9165
Joined: 25 Aug 2011
Has thanked: 1264 times
Been thanked: 2957 times

Re: ASCII Import - data missing problem

Postby Henry MultiСharts » 05 Mar 2014

Hello Flatstrap, this issue has been resolved.
Download the file corresponding to your version of MultiCharts:
32 bit: https://dl.dropboxusercontent.com/u/279 ... r2_x32.zip
64 bit: https://dl.dropboxusercontent.com/u/279 ... r2_x64.zip

Please unzip the file and follow the installation guide:
https://www.multicharts.com/trading-sof ... an_Updater

Flatstrap
Posts: 9
Joined: 15 Feb 2014
Has thanked: 2 times
Been thanked: 1 time

Re: ASCII Import - data missing problem

Postby Flatstrap » 06 Mar 2014

Hi Henry,
Downloaded and applied the patch. The problem has now been moved to a different date!

There were no errors with the patch, log below.
+++++++LOG+++++++++++++
Product: MultiCharts64
Path: C:\Program Files\TS Support\MultiCharts64\
Image: C:\Program Files\TS Support\MultiCharts64\multicharts64.exe
Version: 8.8.8363.400

Action: 8.8 Release update
File: ASCIIConverter.dll, Copy: yes, Reg: no, RegAsm: no, Run: no, OSArch: X64
copy to: C:\Program Files\TS Support\MultiCharts64\
File: dam.dll, Copy: yes, Reg: no, RegAsm: no, Run: no, OSArch: X64
copy to: C:\Program Files\TS Support\MultiCharts64\
File: CQGDLLDataFeed.dll, Copy: yes, Reg: no, RegAsm: no, Run: no, OSArch: X64
copy to: C:\Program Files\TS Support\MultiCharts64\
File: DLLDataFeed.dll, Copy: yes, Reg: no, RegAsm: no, Run: no, OSArch: X64
copy to: C:\Program Files\TS Support\MultiCharts64\
File: DLLDataFeedPrivate.dll, Copy: yes, Reg: no, RegAsm: no, Run: no, OSArch: X64
copy to: C:\Program Files\TS Support\MultiCharts64\
File: Scanner.dll, Copy: yes, Reg: no, RegAsm: no, Run: no, OSArch: X64
copy to: C:\Program Files\TS Support\MultiCharts64\
File: Shaper.dll, Copy: yes, Reg: no, RegAsm: no, Run: no, OSArch: X64
copy to: C:\Program Files\TS Support\MultiCharts64\
File: ATCenterCommon.dll, Copy: yes, Reg: no, RegAsm: no, Run: no, OSArch: X64
copy to: C:\Program Files\TS Support\MultiCharts64\
File: TradingServer.exe, Copy: yes, Reg: no, RegAsm: no, Run: no, OSArch: X64
copy to: C:\Program Files\TS Support\MultiCharts64\
File: PLEditor.exe, Copy: yes, Reg: no, RegAsm: no, Run: no, OSArch: X64
copy to: C:\Program Files\TS Support\MultiCharts64\
File: qmAscImport.dll, Copy: yes, Reg: no, RegAsm: no, Run: no, OSArch: X64
copy to: C:\Program Files\TS Support\MultiCharts64\
DONE
++++++++++++++++

I've uploaded the file that has the new date problem....
https://onedrive.live.com/redir?resid=8 ... ile%2c.zip
it's the exact same format from 1/1/2007 -> 1/1/2009.
When I import the data I'm only able to read back from 14/12/2007 -> 1/1/2009

Can you see if you are having the same problem.

Regards
FlatStrap

User avatar
Henry MultiСharts
Posts: 9165
Joined: 25 Aug 2011
Has thanked: 1264 times
Been thanked: 2957 times

Re: ASCII Import - data missing problem

Postby Henry MultiСharts » 06 Mar 2014

Flatstrap, this behavior has been replicated and forwarded to our engineers for further analysis.
I will keep you updated.

User avatar
Henry MultiСharts
Posts: 9165
Joined: 25 Aug 2011
Has thanked: 1264 times
Been thanked: 2957 times

Re: ASCII Import - data missing problem

Postby Henry MultiСharts » 07 Mar 2014



Return to “MultiCharts”