Higher/lower timescales not lining up in charts or backtests  [SOLVED]

Questions about MultiCharts .NET and user contributed studies.
robbob
Posts: 46
Joined: 26 Jan 2013
Has thanked: 2 times
Been thanked: 3 times

Higher/lower timescales not lining up in charts or backtests

Postby robbob » 12 Mar 2013

I'm attempt to both 15-minute and 1 day bars for CL in a strategy I'm testing. It appears that the daily bars have a timestamp of 22:59, and so are lining up with the 15-minute bars at 22:59. However the CL electronic market closes at 17:15, and the daily bars should line up with this time instead. I attempted to adjust the session hours in the Instrument properties, but this had no effect.

I've printed output from the calcBar() in the method from my strategy which contains the following output method calls.

Code: Select all

Output.WriteLine( "Minute Bars time: " + BarsOfData(1).Time.Value + " Close: " + BarsOfData(1).CloseValue );
Output.WriteLine( "Day Bars2 time: " + BarsOfData(2).Time.Value + " Close: " + BarsOfData(2).CloseValue );
A snippet from the output.

Code: Select all

Minute Bars time: 2/18/2013 11:59:00 PM Close: 95.97
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 12:15:00 AM Close: 95.98
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 12:30:00 AM Close: 96.03
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 12:45:00 AM Close: 96
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 1:00:00 AM Close: 95.99
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 1:15:00 AM Close: 95.91
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 1:30:00 AM Close: 95.91
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 1:45:00 AM Close: 95.87
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 2:00:00 AM Close: 95.87
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 2:15:00 AM Close: 95.88
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 2:30:00 AM Close: 95.92
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 2:45:00 AM Close: 95.85
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 3:00:00 AM Close: 95.86
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 3:15:00 AM Close: 95.9
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 3:30:00 AM Close: 95.95
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 3:45:00 AM Close: 95.84
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 4:00:00 AM Close: 95.85
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 4:15:00 AM Close: 95.86
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 4:30:00 AM Close: 95.92
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 4:45:00 AM Close: 95.96
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 5:00:00 AM Close: 95.96
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 5:15:00 AM Close: 96
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 5:30:00 AM Close: 95.98
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 5:45:00 AM Close: 95.94
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 6:00:00 AM Close: 95.92
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 6:15:00 AM Close: 95.89
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 6:30:00 AM Close: 95.93
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 6:45:00 AM Close: 95.94
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 7:00:00 AM Close: 95.9
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 7:15:00 AM Close: 95.91
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 7:30:00 AM Close: 96.08
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 7:45:00 AM Close: 96.18
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 8:00:00 AM Close: 96.1
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 8:15:00 AM Close: 96.33
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 8:30:00 AM Close: 96.43
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 8:45:00 AM Close: 96.52
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 9:00:00 AM Close: 96.36
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 9:15:00 AM Close: 96.25
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 9:30:00 AM Close: 96.26
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 9:45:00 AM Close: 96.37
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 10:00:00 AM Close: 96.3
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 10:15:00 AM Close: 96.23
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 10:30:00 AM Close: 96.06
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 10:45:00 AM Close: 96.18
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 11:00:00 AM Close: 96.14
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 11:15:00 AM Close: 96.14
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 11:30:00 AM Close: 96.29
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 11:45:00 AM Close: 96.27
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 12:00:00 PM Close: 96.3
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 12:15:00 PM Close: 96.16
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 12:30:00 PM Close: 96.23
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 12:45:00 PM Close: 96.25
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 1:00:00 PM Close: 96.39
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 1:15:00 PM Close: 96.5
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 1:30:00 PM Close: 96.45
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 1:45:00 PM Close: 96.46
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 2:00:00 PM Close: 96.44
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 2:15:00 PM Close: 96.61
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 2:30:00 PM Close: 97.11
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 2:45:00 PM Close: 96.93
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 3:00:00 PM Close: 96.86
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 3:15:00 PM Close: 96.97
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 3:30:00 PM Close: 97.09
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 3:45:00 PM Close: 97.13
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 4:00:00 PM Close: 97.11
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 4:15:00 PM Close: 97.14
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 4:30:00 PM Close: 97.14
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 4:45:00 PM Close: 97.1
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 5:00:00 PM Close: 97.11
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 5:15:00 PM Close: 97.1
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 6:15:00 PM Close: 97.14
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 6:30:00 PM Close: 97.13
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 6:45:00 PM Close: 97.13
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 7:00:00 PM Close: 97.07
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 7:15:00 PM Close: 97.12
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 7:30:00 PM Close: 97.14
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 7:45:00 PM Close: 97.13
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 8:00:00 PM Close: 97.13
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 8:15:00 PM Close: 97.18
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 8:30:00 PM Close: 97.2
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 8:45:00 PM Close: 97.22
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 9:00:00 PM Close: 97.18
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 9:15:00 PM Close: 97.14
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 9:30:00 PM Close: 97.14
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 9:45:00 PM Close: 97.07
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 10:00:00 PM Close: 97.08
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 10:15:00 PM Close: 97.11
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 10:30:00 PM Close: 97.14
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 10:45:00 PM Close: 97.13
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 11:00:00 PM Close: 97.11
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 11:15:00 PM Close: 97.1
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 11:30:00 PM Close: 97.11
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 11:45:00 PM Close: 97.04
Day Bars2 time: 2/15/2013 11:59:00 PM Close: 96.41
Minute Bars time: 2/19/2013 11:59:00 PM Close: 97.01
Day Bars2 time: 2/19/2013 11:59:00 PM Close: 97.1
As can be seen, the daily bar doesn't change until midnight,even though the close price on the daily bar matches the close price of the 17:15 15-minute bar.

Any help would be appreciated.

Thanks,
-Rob

User avatar
Henry MultiСharts
Posts: 9165
Joined: 25 Aug 2011
Has thanked: 1264 times
Been thanked: 2957 times

Re: Higher/lower timescales not lining up in charts or backt  [SOLVED]

Postby Henry MultiСharts » 14 Mar 2013

I attempted to adjust the session hours in the Instrument properties, but this had no effect.
Hello Rob,

The bars were already written to the database with the session setting specified at the moment the data was requested from the data provider. After changing the session settings all historical bars remain the same, all new bars are affected by the changes. In order to apply the new session settings for historical bars you need to plot them on the chart and reload the chart.

robbob
Posts: 46
Joined: 26 Jan 2013
Has thanked: 2 times
Been thanked: 3 times

Re: Higher/lower timescales not lining up in charts or backt

Postby robbob » 15 Mar 2013

Hi Henry,

so I refreshed the chart, and the time on the bars is now correct, however the price is not lining up between the 15-minute and 1 day bars. I would expect to see the close price of the last 15-minute bar of the day to match the close price of the daily bar, but this is not the case. I using symbol QCL# (IQFeed), and I have set the Session time to CME Commodity Futures (Globex), I've tried NYMEX Energy (Electronic), and default as well. With the Globex session I see the following differences between the close of the last 15-minute bar of the day and the daily bar close.

3/14/13 - Difference $0.05
3/13/13 - Difference $0.25
3/12/13 - Difference $0.04
3/11/13 - Difference $0.18

Thanks,
-Rob

User avatar
Henry MultiСharts
Posts: 9165
Joined: 25 Aug 2011
Has thanked: 1264 times
Been thanked: 2957 times

Re: Higher/lower timescales not lining up in charts or backt

Postby Henry MultiСharts » 15 Mar 2013

Hello Rob,

The data is provided by IQFeed "as is". The difference between daily bar and intra-day data is expected You can come to our live chat and we will help you to check the historical data provided by IQfeed.

You can get a daily bar with customized sessions if you create N minute chart with your own session template. IQfeed also provides ability to build minute and daily bars out of tick data:
Quote manager->Tools->Data sources->IQFeed->Settings->"build minute and daily bars from tick data". To make this setting come into effect you need to restart MultiCharts and all of its applications.

Please keep in mind that IQFeed has a limitation for amount of provided historical data:
Tick data- 8 calendar days within session hours, 120 days in non-session hours,
Minute data– up to 6 years (@ES# ~4.5 year)- only TRADE data,
Daily data – since 1901 (@ES# ~13 years), (INDU.X since 1928 year)

That means if you select building all resolutions from ticks then you will have less historical data, compared to using minute and day resolutions.

davewolfs
Posts: 89
Joined: 06 Feb 2013
Has thanked: 2 times
Been thanked: 11 times

Re: Higher/lower timescales not lining up in charts or backt

Postby davewolfs » 15 Mar 2013

Another case of this issue.

Please vote here on this.

https://www.multicharts.com/pm/viewissu ... _no=MC-856

davewolfs
Posts: 89
Joined: 06 Feb 2013
Has thanked: 2 times
Been thanked: 11 times

Re: Higher/lower timescales not lining up in charts or backt

Postby davewolfs » 15 Mar 2013

Hello Rob,

The data is provided by IQFeed "as is". The difference between daily bar and intra-day data is expected You can come to our live chat and we will help you to check the historical data provided by IQfeed.

You can get a daily bar with customized sessions if you create N minute chart with your own session template. IQfeed also provides ability to build minute and daily bars out of tick data:
Quote manager->Tools->Data sources->IQFeed->Settings->"build minute and daily bars from tick data". To make this setting come into effect you need to restart MultiCharts and all of its applications.

Please keep in mind that IQFeed has a limitation for amount of provided historical data:
Tick data- 8 calendar days within session hours, 120 days in non-session hours,
Minute data– up to 6 years (@ES# ~4.5 year)- only TRADE data,
Daily data – since 1901 (@ES# ~13 years), (INDU.X since 1928 year)

That means if you select building all resolutions from ticks then you will have less historical data, compared to using minute and day resolutions.
Build daily + Minute bars from tick data is not a suitable solution for me. It is a limitation of the data provider since only 120 days are available. There should be an option "Build Daily Bars from Minute Data". Those daily bars that are built should be associated with a session since there are obviously different ways to build a daily bar depending on what session was in use when the bars were loaded.

robbob
Posts: 46
Joined: 26 Jan 2013
Has thanked: 2 times
Been thanked: 3 times

Re: Higher/lower timescales not lining up in charts or backt

Postby robbob » 16 Mar 2013

Agreed that building by tick isn't a viable alternative due to the 120 day limitation. As far as I can tell, the close on the daily bars are accurate as I have compared the IQFeed data to CSI data and also Interactive Brokers, so I'm not sure why such a huge difference in the 15-minute bars (and even 30-minute) bars. I'll take a look at the 30-minute bar historical data from Interactive Brokers and compare to IQFeed and see what I find.

From what I see though, I don't think I would want to build daily bars from 15 or 30 minute bars due to the inaccuracy of the intraday bar close prices.

davewolfs
Posts: 89
Joined: 06 Feb 2013
Has thanked: 2 times
Been thanked: 11 times

Re: Higher/lower timescales not lining up in charts or backt

Postby davewolfs » 16 Mar 2013

Agreed that building by tick isn't a viable alternative due to the 120 day limitation. As far as I can tell, the close on the daily bars are accurate as I have compared the IQFeed data to CSI data and also Interactive Brokers, so I'm not sure why such a huge difference in the 15-minute bars (and even 30-minute) bars. I'll take a look at the 30-minute bar historical data from Interactive Brokers and compare to IQFeed and see what I find.

From what I see though, I don't think I would want to build daily bars from 15 or 30 minute bars due to the inaccuracy of the intraday bar close prices.
The reason for the non matching of the daily bars to the intraday bar closes is likely because the daily bar uses the settlement price that has been released by the exchange after close while the intraday bar uses the actual close.

In my opinion the intraday bar is more accurate. I've never used settlement prices.

robbob
Posts: 46
Joined: 26 Jan 2013
Has thanked: 2 times
Been thanked: 3 times

Re: Higher/lower timescales not lining up in charts or backt

Postby robbob » 17 Mar 2013

Good point Dave, it makes sense that they are using the settlement price provided by the exchange. Since the close price for the daily bar isn't really accurate then, the daily bar's Open price should still match the open price of the first 15-minute bar of the session, which I hadn't checked up to this point, and it is in fact pretty close (within 0-2 cents for CL).


Return to “MultiCharts .NET”