+1 888 340 6572
MultiCharts Project Management
previous_open_issue.png
Go to the previous open issue
previous_issue.png
Go to the previous issue (open or closed)
star_stroke.svg
Please log in to bookmark issues
feature_request_small.png
Open Feature request MC-1026

Walk-Forward Logic is Flawed
minus.svg
Please log in to vote
16
Votes
 pluse.svg
Please log in to vote
next_issue.png
Go to the next issue (open or closed)
next_open_issue.png
Go to the next open issue
Description

I don't believe Multichart's walk-forward logic is correct. As has been confirmed, Multicharts is using the best optimization inputs for each test. This, in itself, is not acceptable since it would include the most outliers with the most curve fitting, leading to poor results. It is critical that the Multicharts development team either writes an algorithm to automatically find clusters of similar inputs or allows the user to select which inputs to use for each test (possibly with the aid of 3D visualization). Tradestation offers a similar feature, however it is completely useless since TS does not use "extended" backtesting. I think this is a VERY important issue that needs to be addressed and corrected ASAP.

Steps to reproduce this issue

Logic issue, not a bug, per se.

Comments (4)
settings.svg
#0
user-offline.png JoshM
Jun 27, 2012 - 03:19

+1; totally agree.

#0
user-offline.png MeiHua1
Dec 14, 2012 - 11:59

The way that the optimizer works, as well as the out put is totally un usable. I have been doing research on why it only outputs the best result and how it generated it. Its basically worthless. I have to use completely other software because of this. Actually this is a reason I want to switch from multicharts. You can not develop trading systems with out this. Which is what multicharts is for. If this is not changed quickly then I will be leaving.

#1
user-offline.png Zheka
Apr 06, 2017 - 13:26

A great solution would be to extend the "custom fitness function" functionality to WFO, exposing all performance variables available in MC (incl. e.g. maxposprofit). And if it were possible to have such functions accept input parameters and make those optimizable - that would be a "dream-come-true"!

#2
user-offline.png MultiCharts Support
Jan 31, 2018 - 10:22
Hello Z-Man,

Please provide a detailed description of the functionality you are looking for. What exactly is incorrect in MultiCharts and TradeStation WFO? How exactly do you want to determine/define the proper inputs for WFO? Have you tried using the Custom optimization criterion in MultiCharts to find the desired inputs? Are you referring to cluster analysis in TS? If yes - what do you want to see in 3d visualization? Which parameters do you want to change/switch?
History
arrow_left.svg arrow_right.svg
Issue basics
  • Type of issue
    Feature request
  • Category
    Usability
  • Targeted for
    Not determined
  • Status
    Need Details
User pain
  • Type of bug
    Not triaged
  • Likelihood
    Not triaged
  • Effect
    Not triaged
Affected by this issue (3)
People involved
  • Posted by
    user-offline.png Z-Man
  • Owned by
    Not owned by anyone
  • Assigned to
    Not assigned to anyone
  • Subscribers
    6 subscriber(s)
    Click here to show the list of subscribers
Times and dates
  • Posted at
  • Last updated
Issue details
  • Resolution
    Not determined
  • Severity
    Critical
Commits (0)
There are no code checkins for this issue
×

Sign up and get MultiCharts free

Use its powerful simulation mode with data included out of the box. Just fill out the form and start honing your trading skills with a few clicks.