Updates to the QMML app

Message boards : Multicore CPUs : Updates to the QMML app
Message board moderation

To post messages, you must log in.

Previous · 1 · 2

AuthorMessage
mmonnin

Send message
Joined: 2 Jul 16
Posts: 339
Credit: 8,281,341,558
RAC: 2,803
Level
Tyr
Scientific publications
watwatwatwatwat
Message 48890 - Posted: 9 Feb 2018, 21:58:26 UTC - in response to Message 48889.  
Last modified: 9 Feb 2018, 22:03:54 UTC

Or just set max_concurrent to 1 and avoid the issue entirely until the applications and software for the problem gets resolved.


Until the BM queue fills up with just QC tasks and all other cores go idle. Better to just avoid the entire application in the 1st place. If it's not worth the admins time to fix known issues that cause errors 100% of the time in known situations then its not worth the time for donors to run.
ID: 48890 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keith Myers
Avatar

Send message
Joined: 13 Dec 17
Posts: 1424
Credit: 9,189,946,190
RAC: 0
Level
Tyr
Scientific publications
watwatwatwatwat
Message 48891 - Posted: 9 Feb 2018, 22:44:25 UTC - in response to Message 48890.  

Every donor is different. I don't have GPUGrid as my sole project so the crunchers never go idle, there is always work being done for someone.

As with most projects, there is always a shortage of manpower, money or time for keeping applications current and working.
ID: 48891 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dayle Diamond

Send message
Joined: 5 Dec 12
Posts: 84
Credit: 1,663,883,415
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48925 - Posted: 13 Feb 2018, 3:27:21 UTC

I'll be watching for updates, but for now I'm also turning off CPU tasks.

Scheduler is telling batches to activate all at once. Rows of errors. I acknowledge that user fixes have been recommended but I don't want to program a solution that's beyond my capacity to correct once circumstances change.

Hope to be back soon!

ID: 48925 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
biodoc

Send message
Joined: 26 Aug 08
Posts: 183
Credit: 10,085,929,375
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48939 - Posted: 14 Feb 2018, 15:48:12 UTC

I set up the quantum chem app on a second computer. I started with the following app_config.xml file:

<app_config>
<app>
<name>QC</name>
<max_concurrent>1</max_concurrent>
</app>
<app_version>
<app_name>QC</app_name>
<plan_class>mt</plan_class>
<avg_ncpus>4</avg_ncpus>
<cmdline>--nthreads 4</cmdline>
</app_version>
</app_config>


Once the Work Units downloaded and 1 WU started w/4 threads, I edited the app_config.xml to change <max_concurrent>1</max_concurrent> to <max_concurrent>2</max_concurrent>. Then I restarted the boinc client and now I have 2 work units running simultaneously with 4 threads each. So far so good.
ID: 48939 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keith Myers
Avatar

Send message
Joined: 13 Dec 17
Posts: 1424
Credit: 9,189,946,190
RAC: 0
Level
Tyr
Scientific publications
watwatwatwatwat
Message 48948 - Posted: 14 Feb 2018, 21:53:11 UTC

But there is still the issue that whenever your QC tasks finish and more than 2 tasks are downloaded, that your system can try to start both tasks at the same time and then both will fail. There is no guaranteed method to stagger starting of multiple QC tasks in an unattended system on auto.

The only way to get around this situation is to do exactly what you posted. But requires your intervention at each new task startup.

Or just set max_concurrent to 1 and be done with it.
ID: 48948 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Conan

Send message
Joined: 25 Mar 09
Posts: 25
Credit: 582,385
RAC: 0
Level
Gly
Scientific publications
wat
Message 48950 - Posted: 14 Feb 2018, 23:10:33 UTC
Last modified: 14 Feb 2018, 23:12:52 UTC

I am not seeing this situation at all.
My AMD Linux Fedora systems download more than one at a time but only ever try to run one at a time.
Even on my 8 core (+ 8 HT) only one starts and other projects keep running.

I am also running other applications but on a 4 core computer when GPU Grid starts it is the only thing that runs and only one at a time.

Not trying to control how things are run.

So I don't know what could be causing problems on your computers.

BOINC versions are 7.4.25 and 7.6.22

Conan
ID: 48950 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dayle Diamond

Send message
Joined: 5 Dec 12
Posts: 84
Credit: 1,663,883,415
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48954 - Posted: 15 Feb 2018, 1:19:37 UTC

Quick update: I checked my logs and this thread again to see if I could resume tasks. To my surprise, tasks were resumed while I had still opted out.

ACEMD short runs (2-3 hours on fastest card): yes
ACEMD long runs (8-12 hours on fastest GPU): yes
ACEMD Beta: yes
Quantum Chemistry (Linux, CPU): no
Python Runtime : yes

I don't know what's broken but it's not cool.
ID: 48954 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keith Myers
Avatar

Send message
Joined: 13 Dec 17
Posts: 1424
Credit: 9,189,946,190
RAC: 0
Level
Tyr
Scientific publications
watwatwatwatwat
Message 48955 - Posted: 15 Feb 2018, 2:55:35 UTC - in response to Message 48950.  

I am not seeing this situation at all.
My AMD Linux Fedora systems download more than one at a time but only ever try to run one at a time.
Even on my 8 core (+ 8 HT) only one starts and other projects keep running.

I am also running other applications but on a 4 core computer when GPU Grid starts it is the only thing that runs and only one at a time.

Not trying to control how things are run.

So I don't know what could be causing problems on your computers.

BOINC versions are 7.4.25 and 7.6.22

Conan

Several posters have reported the problem of starting two QC tasks at the same time or within 5 seconds of each other causes the first task to error out.

See Message 48589
ID: 48955 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
captainjack

Send message
Joined: 9 May 13
Posts: 171
Credit: 4,739,796,466
RAC: 1,182
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48956 - Posted: 15 Feb 2018, 3:20:37 UTC

Dayle Diamond said:

Quick update: I checked my logs and this thread again to see if I could resume tasks. To my surprise, tasks were resumed while I had still opted out.


Dayle, do you perchance have the preference box checked for
If no work for selected applications is available, accept work from other applications?


ID: 48956 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mmonnin

Send message
Joined: 2 Jul 16
Posts: 339
Credit: 8,281,341,558
RAC: 2,803
Level
Tyr
Scientific publications
watwatwatwatwat
Message 48959 - Posted: 15 Feb 2018, 3:50:20 UTC

If one has more than 4 cores and running max concurrent = 1, there is still the chance that boinc manager will flood your queue with all QC tasks and nothing from the other project. Esp when just starting up that setup before BM gets a better handle of the resource share it is a long term resource share.

I've personally had this happen using max concurrent on another project. 4 threads working, 28 idle. It's far from a perfect solution.
ID: 48959 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dayle Diamond

Send message
Joined: 5 Dec 12
Posts: 84
Credit: 1,663,883,415
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48982 - Posted: 18 Feb 2018, 20:19:20 UTC - in response to Message 48956.  

Dayle, do you perchance have the preference box checked for
If no work for selected applications is available, accept work from other applications?


Oops. Thank you ><.

Happy Crunching, I'll be back with these tasks once things have stabilized.
ID: 48982 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
biodoc

Send message
Joined: 26 Aug 08
Posts: 183
Credit: 10,085,929,375
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48993 - Posted: 19 Feb 2018, 12:45:44 UTC - in response to Message 48939.  

I set up the quantum chem app on a second computer. I started with the following app_config.xml file:

<app_config>
<app>
<name>QC</name>
<max_concurrent>1</max_concurrent>
</app>
<app_version>
<app_name>QC</app_name>
<plan_class>mt</plan_class>
<avg_ncpus>4</avg_ncpus>
<cmdline>--nthreads 4</cmdline>
</app_version>
</app_config>


Once the Work Units downloaded and 1 WU started w/4 threads, I edited the app_config.xml to change <max_concurrent>1</max_concurrent> to <max_concurrent>2</max_concurrent>. Then I restarted the boinc client and now I have 2 work units running simultaneously with 4 threads each. So far so good.


This approach, although a bit cumbersome, works. I've completed 189 Work Units with no errors.

I think special badges for Quantum Chemistry contribution would be a draw for more users.
ID: 48993 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
NUCCpod_NAPTIMELABS_01

Send message
Joined: 18 Aug 17
Posts: 6
Credit: 174,440,173
RAC: 0
Level
Ile
Scientific publications
watwat
Message 49065 - Posted: 22 Feb 2018, 2:23:34 UTC

So, forgive me if this has been answered.

Is this planned to be fixed at some point?
ID: 49065 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keith Myers
Avatar

Send message
Joined: 13 Dec 17
Posts: 1424
Credit: 9,189,946,190
RAC: 0
Level
Tyr
Scientific publications
watwatwatwatwat
Message 49066 - Posted: 22 Feb 2018, 2:41:29 UTC - in response to Message 49065.  

No it hasn't been answered. Or even addressed by the developer as far as I can tell. Seems the resources lately have been in deploying and debugging the WSL QC app.
ID: 49066 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2

Message boards : Multicore CPUs : Updates to the QMML app

©2026 Universitat Pompeu Fabra