Slower and slower genetic optmizations

Questions about MultiCharts and user contributed studies.
shane1800
Posts: 84
Joined: 28 Feb 2014
Has thanked: 5 times
Been thanked: 5 times

Slower and slower genetic optmizations

Postby shane1800 » 15 Oct 2018

Hi,

I'm using the current version of MC, not sure if this was an issue with older versions but last year it was not for me. I was able to optimize for 21 days straight 100% CPU used with accurate remaining time shown.

When I run a genetic optimization it says it takes 12 hours to complete, 12 hours later it says it takes 24 hours to complete, 24 hours later it says it takes 2.5 days to complete etc.

Windows 10 most updated version. All 12 cores are being used but only at 25-30% even from the beginning. CPU temps 42C water cooled. Using high performance energy setting in Windows. Lots of free memory still. I reset BIOS to no change.

Progress numbers on MC popup increment at slower and slower rates.

User avatar
TJ
Posts: 7740
Joined: 29 Aug 2006
Location: Global Citizen
Has thanked: 1033 times
Been thanked: 2221 times

Re: Slower and slower genetic optmizations

Postby TJ » 15 Oct 2018

What is the CPU?
Are you using virtual threads? ie. logical cores, Hyperthread, Threadripper, etc.,

shane1800
Posts: 84
Joined: 28 Feb 2014
Has thanked: 5 times
Been thanked: 5 times

Re: Slower and slower genetic optmizations

Postby shane1800 » 15 Oct 2018

Hi there. Intel i7-6800K. Not sure about virtual threads will research that.

User avatar
TJ
Posts: 7740
Joined: 29 Aug 2006
Location: Global Citizen
Has thanked: 1033 times
Been thanked: 2221 times

Re: Slower and slower genetic optmizations

Postby TJ » 15 Oct 2018

Hi there. Intel i7-6800K. Not sure about virtual threads will research that.
You are using virtual threads.

Your CPU has 6-cores, and you are seeing 12-cores.

See post #13
viewtopic.php?t=10811

hughesfleming
Posts: 275
Joined: 22 Apr 2014
Has thanked: 70 times
Been thanked: 72 times

Re: Slower and slower genetic optmizations

Postby hughesfleming » 15 Oct 2018

Trying seeing if the Windows Resource Monitor tells you the same thing. I noticed on the latest version of Windows when I did my last optimization that the Task manager gave me between 20-30% CPU utilization but the Resource Monitor was showing 100% across all cores. I don't know if the latest windows update changed something but 10 days ago, that was the case.

Here is another mention of the problem fresh out of a quick google search.

https://www.bleepingcomputer.com/news/m ... 18-update/

shane1800
Posts: 84
Joined: 28 Feb 2014
Has thanked: 5 times
Been thanked: 5 times

Re: Slower and slower genetic optmizations

Postby shane1800 » 15 Oct 2018

Found the issue. My strategy was writing to a CSV log file and it got bigger and bigger, 10GB!

Commenting that out computer runs at 95% CPU and test will be 1 hour.

Thanks for everyones comments.

shane1800
Posts: 84
Joined: 28 Feb 2014
Has thanked: 5 times
Been thanked: 5 times

Re: Slower and slower genetic optmizations

Postby shane1800 » 21 Oct 2018

Sorry say but my issue still exists. If anyone else has seen this please let me know.

After about 3 hours CPU goes down from 95% to 20%, optimization times increase by 3 times or so. What happens is that it goes from using 6 active core to 1 core for no apparent reason. Pausing the test and resuming does not help, only stopping the test completely, losing the results and starting again.

The hard drive space is the same as the test is going on so there are no large file issues.

I've left the monitor on, no screensaver, uninstalled antivirus, no energy saving, bios reset, not overlocked or anything special.

Intel Turbo Boost Tech 3.0 is installed but disabled, uninstalling has it reinstall on reboot.

sptrader
Posts: 742
Joined: 09 Apr 2010
Location: Texas
Has thanked: 483 times
Been thanked: 274 times
Contact:

Re: Slower and slower genetic optmizations

Postby sptrader » 21 Oct 2018

Sorry say but my issue still exists. If anyone else has seen this please let me know.

After about 3 hours CPU goes down from 95% to 20%, optimization times increase by 3 times or so. What happens is that it goes from using 6 active core to 1 core for no apparent reason. Pausing the test and resuming does not help, only stopping the test completely, losing the results and starting again.

The hard drive space is the same as the test is going on so there are no large file issues.

I've left the monitor on, no screensaver, uninstalled antivirus, no energy saving, bios reset, not overlocked or anything special.

Intel Turbo Boost Tech 3.0 is installed but disabled, uninstalling has it reinstall on reboot.
Try it with Windows firewall disabled. Something probably external to MC and running in the background could be slowing it down. Even Win10 updates-downloads could do it.
Also, MC BugSlayer could be slowing it down too, you'll have to search for "BugSlayer" and the registry key to shut it down.

User avatar
Henry MultiСharts
Posts: 9165
Joined: 25 Aug 2011
Has thanked: 1264 times
Been thanked: 2957 times

Re: Slower and slower genetic optmizations

Postby Henry MultiСharts » 22 Oct 2018

Hello shane1800,

Are you able to replicate the same behavior using the prebuilt signals?
Is your own code using any external DLLs?

shane1800
Posts: 84
Joined: 28 Feb 2014
Has thanked: 5 times
Been thanked: 5 times

Re: Slower and slower genetic optmizations

Postby shane1800 » 22 Oct 2018

Thanks Sptrader but no luck. Updates off, Internet connection off, firewall off, couldn't figure out the bugslayer part though.

Henry will try that now.

shane1800
Posts: 84
Joined: 28 Feb 2014
Has thanked: 5 times
Been thanked: 5 times

Re: Slower and slower genetic optmizations

Postby shane1800 » 23 Oct 2018

So I tried default strategies and got the same result, after a few hours the CPU use goes down to 10%, only 1 core being used rather than 6.

MovAvg3Line Cross LE
MovAvg3Line Cross SE
_Percent Exit Pair

One thing I notice in the optimization report is that there are over a million rows, is that okay? That seems to be a lot for a genetic test.
Screen Shot 2018-10-22 at 9.30.21 PM.png
(50.54 KiB) Downloaded 933 times
Screen Shot 2018-10-23 at 10.48.28 AM.png
(24.83 KiB) Downloaded 933 times
Screen Shot 2018-10-23 at 10.48.16 AM.png
(140.24 KiB) Downloaded 933 times

User avatar
TJ
Posts: 7740
Joined: 29 Aug 2006
Location: Global Citizen
Has thanked: 1033 times
Been thanked: 2221 times

Re: Slower and slower genetic optmizations

Postby TJ » 23 Oct 2018

So I tried default strategies and got the same result, after a few hours the CPU use goes down to 10%, only 1 core being used rather than 6.

MovAvg3Line Cross LE
MovAvg3Line Cross SE
_Percent Exit Pair

One thing I notice in the optimization report is that there are over a million rows, is that okay? That seems to be a lot for a genetic test.

Maybe someone can do the same optimization on a different machine and/or different MC version and compare their result to yours.

You need to tell people the symbol, resolution, start/end date.

User avatar
Henry MultiСharts
Posts: 9165
Joined: 25 Aug 2011
Has thanked: 1264 times
Been thanked: 2957 times

Re: Slower and slower genetic optmizations

Postby Henry MultiСharts » 24 Oct 2018

shane1800,

We were unable to replicate this behavior on our end. Please save the workspace with your optimization settings, close all other workspaces and send us the following information for analysis:
Go to Help tab->Feedback (or Windows Start menu->All programs->MultiCharts64->Feedback).
Select these options:
- Attach log files to help us understand what happened;
- Include Backup of Logs from previous session;
- Snapshot of current setup:
- Open workspaces;
- Data from active instruments;
- Include tick data;
- Active indicators;
- Active signals;
- Upload collected data to Help Desk.

shane1800
Posts: 84
Joined: 28 Feb 2014
Has thanked: 5 times
Been thanked: 5 times

Re: Slower and slower genetic optmizations

Postby shane1800 » 24 Oct 2018

Will work on getting that.


Return to “MultiCharts”