Data all screwed up

MKlein · Postby **MKlein** » 06 Mar 2008

If you notice any missing data or bad ticks, please let us know right away.

There was a data outage this morning at about 0800GMT until 0805GMT. Data for this period now seems to be missing from all pairs in all time scales from tick to hourly. Because the outage occurred at the change of the hour, this leaves a gap on many of the hourly charts.

Also, when the data feed is disrupted, the file FXServer.exe begins to consume all available processor resources and has to be terminated manually. Obviously, this is another problem that needs to be fixed.

M Klein

Andrew Kirillov · Postby **Andrew Kirillov** » 06 Mar 2008

If you notice any missing data or bad ticks, please let us know right away.
There was a data outage this morning at about 0800GMT until 0805GMT. Data for this period now seems to be missing from all pairs in all time scales from tick to hourly. Because the outage occurred at the change of the hour, this leaves a gap on many of the hourly charts.

Also, when the data feed is disrupted, the file FXServer.exe begins to consume all available processor resources and has to be terminated manually. Obviously, this is another problem that needs to be fixed.

M Klein

Thank you for the bug report. It was FXCM price data feed problem since we had reconnect on two independent dedicated servers with 100Mb reliable internet bandwidth. I assume FXCM server simply disconnected us for some reason. Since reconnect requires significant time our server didn’t provide data for 5 minutes.
Now the gaps are filled. We will contact FXCM to find out what happened. Fortunately this problem is quite rare.

We will try to emulate FXServer.exe problem and if it is reproducible we fix it.

MKlein · Postby **MKlein** » 06 Mar 2008

Thank you for the bug report.

[snip]

Now the gaps are filled.

Thank you for the rapid fix.

M Klein

Andrew Kirillov · Postby **Andrew Kirillov** » 06 Mar 2008

You are welcome!

MKlein · Postby **MKlein** » 06 Mar 2008

Another one just now - the same situation. 1357GMT to 1403GMT. I'm sure you've spotted it already.

Andrew Kirillov · Postby **Andrew Kirillov** » 06 Mar 2008

Yes, we are backfilling the hole. It will be completed in a few minutes.
We've just called FXCM and their representative confirmed that live price feed was down two times today. Each down time was about 3-4 minutes.
They say that it happens from time to time, but it is pretty rare.
So we think it is unlucky day today:)

MKlein · Postby **MKlein** » 06 Mar 2008

Thanks.

One more thing. Since the new beta became available, I've noticed that the option "show empty periods" (Format Window / X - Time Scale / Show Empty Periods) doesn't work. The option exists, but ticking the box has no effect. Could this be reinstated?

MKlein · Postby **MKlein** » 07 Mar 2008

Yes, we are backfilling the hole. It will be completed in a few minutes.

The data is still missing at time of writing. Could this be fixed as a matter of priority? Because of the time it occurred it affects some of the medium term charts (four and eight hour) and thus will continue to affect indicators in those time scales for several days.

M Klein

Andrew Kirillov · Postby **Andrew Kirillov** » 07 Mar 2008

Unfortunately we must admit that we can't backfill the holes so far.
If we request the data FXCM returns 0 for 5 minute holes. However if we request data for other periods it returns quotes without problems. So we think it is something wrong on their side.
At the same time you can say that the data in available in FX Trading Station II. Yes it is true, but we have no explanation yet.
We will call FXCM today.

Andrew Kirillov · Postby **Andrew Kirillov** » 07 Mar 2008

Thanks.

One more thing. Since the new beta became available, I've noticed that the option "show empty periods" (Format Window / X - Time Scale / Show Empty Periods) doesn't work. The option exists, but ticking the box has no effect. Could this be reinstated?

It will be re-enabled later.

MKlein · Postby **MKlein** » 10 Mar 2008

Another one just now - the same situation. 1357GMT to 1403GMT. I'm sure you've spotted it already.

And again. 0844GMT to 0900GMT in all pairs.

Andrew Kirillov · Postby **Andrew Kirillov** » 10 Mar 2008

Fixed!

MKlein · Postby **MKlein** » 10 Mar 2008

Fixed!

Thanks!