Hi,
In my MC.NET setup I had historical data for the ES instrument I've been collecting and saving since Jan 2019 with no interruptions (@ES#C from IQFeed). Today I logged in and I noticed a discrepancy on my tick chart.
Between 04/02/2020 and 18/02/2020 a data-gap has occurred. This was not there before, I had all this data in this period but somehow it has disappeared. I have attached a picture of my 5000 tick chart to demonstrate the issue. I checked in QuoteManager and a gap is apparent there also. Minute/Hourly/daily data is fine for this period.
What causes this? I have tried reloading all data but that does not work (probably because IQFeed only provide last 180 days of tick data). This was a crucial period in the market and it is horrendous to lose it - is it possible the data is still in the database somewhere and can be restored?
MultiCharts historical data missing from database.
MultiCharts historical data missing from database.
- Attachments
-
- QuoteManager.png
- (381.02 KiB) Not downloaded yet
-
- 5ktickGap.png
- (413.05 KiB) Not downloaded yet
Re: MultiCharts historical data missing from database.
Update on this - done some more digging and checked the IQFeed T&S app to see if tick data appears (technically 19 July - 180 calendar days = 21 Jan 2020 so I should be able to load this data). Sure enough, the IQFeed app still returns this data (screen shot attached).
So this looks increasingly like some kind of glitch in MC.NET - so in addition to wondering 1. Why did this data disappear in the first place? My 2nd query is 2. Why is this data not loading even though its in IQFeed?
So this looks increasingly like some kind of glitch in MC.NET - so in addition to wondering 1. Why did this data disappear in the first place? My 2nd query is 2. Why is this data not loading even though its in IQFeed?
- Attachments
-
- IQFeedT_S.png
- (1.2 MiB) Not downloaded yet
- dataheck
- Posts: 30
- Joined: 19 Nov 2019
- Location: Amherst, Nova Scotia
- Been thanked: 5 times
- Contact:
Re: MultiCharts historical data missing from database.
This doesn't directly address what you're talking about, but I raised an issue in the project management dashboard regarding QuoteManager data gaps: https://www.multicharts.com/pm/public/m ... es/MC-2627
The more you come to rely on a large QuoteManager database, the more worried you'll get about gaps - especially the ones that you don't know are there. How can we know if our data is of good quality today? You'd have to export it and manually check! I've got an 8 GB TSSTORAGE database and I don't how how continuous the set is
The more you come to rely on a large QuoteManager database, the more worried you'll get about gaps - especially the ones that you don't know are there. How can we know if our data is of good quality today? You'd have to export it and manually check! I've got an 8 GB TSSTORAGE database and I don't how how continuous the set is
Re: MultiCharts historical data missing from database.
You're right, the integrity and consistency of the QuoteManager database is not assured in my view. MC support are not even responding to this post so that says something. Personally, I think they know there are data glitches in the system but are yet to acknowledge them.
I would think before any new features something as critical as this is investigated and addressed.
I would think before any new features something as critical as this is investigated and addressed.