CPU jobs on Linux

Message boards : News : CPU jobs on Linux
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 . . . 9 · Next

AuthorMessage
klepel

Send message
Joined: 23 Dec 09
Posts: 189
Credit: 4,798,881,008
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49215 - Posted: 27 Mar 2018, 17:58:25 UTC - in response to Message 49179.  

The linux QM app runs fine but it requires some packages to be installed. People should expect infinite number of workunits...

We will run this for ever.

I still think, the main obstacle to gain a wider LINUX contributor base is to solve the start-up error when two WUs start at the same time. In my view, this hinders the implementation of the app on newer computers with more than 4 threads/cores, as the other available computer threads/cores are not loaded by other BOINC projects.
ID: 49215 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
kain

Send message
Joined: 3 Sep 14
Posts: 152
Credit: 918,557,369
RAC: 23
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 49216 - Posted: 27 Mar 2018, 18:36:09 UTC - in response to Message 49215.  

The linux QM app runs fine but it requires some packages to be installed. People should expect infinite number of workunits...

We will run this for ever.

I still think, the main obstacle to gain a wider LINUX contributor base is to solve the start-up error when two WUs start at the same time. In my view, this hinders the implementation of the app on newer computers with more than 4 threads/cores, as the other available computer threads/cores are not loaded by other BOINC projects.


True. I'm using only 2c/4t and 4c CPUs because of that. Ryzen 8c/16t is crunching WCG.
ID: 49216 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49217 - Posted: 27 Mar 2018, 21:02:46 UTC
Last modified: 27 Mar 2018, 21:45:43 UTC

You can sort of learn to live with its idiosyncrasies after a while. They are more an annoyance at first. But I wonder if a non multi-core version would fix the start-up problems? It would be worth looking into.
ID: 49217 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
3de64piB5uZAS6SUNt1GFDU9dRhY
Avatar

Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49270 - Posted: 15 Apr 2018, 9:16:06 UTC
Last modified: 15 Apr 2018, 9:19:17 UTC

May I touch upon this matter again after 2,5-3 weeks... at the risk of being a pain in the neck... is there any progress regarding concurrent QC tasks? I would really like to use a 8-16 core CPU (instead of my i3) and run several jobs at the same time. Hope that the admins can take some time to follow up, in view of the many jobs we still have to crunch.

Thanks.
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.
ID: 49270 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Logan Carr

Send message
Joined: 12 Aug 15
Posts: 240
Credit: 64,069,811
RAC: 0
Level
Thr
Scientific publications
watwatwatwat
Message 49298 - Posted: 17 Apr 2018, 14:10:21 UTC - in response to Message 48820.  

Hey,

What are the recommended PC specs you recommend for these Linux job units? (minimal CPU and ram?) Thanks
Cruncher/Learner in progress.
ID: 49298 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49305 - Posted: 17 Apr 2018, 21:41:46 UTC - in response to Message 49298.  

I have five QC running at the moment on two machines, and they are taking from 230 MB to 260 MB. I would plan on at least 300 MB to be safe.
ID: 49305 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49308 - Posted: 18 Apr 2018, 8:26:36 UTC - in response to Message 49298.  

I now have one running at 1016 MB for a few minutes, but now down to 932 MB. It looks like the upper limit is a bit elastic.
ID: 49308 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PappaLitto

Send message
Joined: 21 Mar 16
Posts: 513
Credit: 4,673,458,277
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49309 - Posted: 18 Apr 2018, 11:11:00 UTC - in response to Message 49308.  

I now have one running at 1016 MB for a few minutes, but now down to 932 MB. It looks like the upper limit is a bit elastic.

Just to confirm, that's 1GB per work unit?
ID: 49309 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
3de64piB5uZAS6SUNt1GFDU9dRhY
Avatar

Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49310 - Posted: 18 Apr 2018, 11:18:15 UTC - in response to Message 49305.  
Last modified: 18 Apr 2018, 11:20:10 UTC

I have five QC running at the moment on two machines, and they are taking from 230 MB to 260 MB. I would plan on at least 300 MB to be safe.


pardon me for jumping in, does that mean it is possible now to run several QC tasks at the same time? For example, 4 Jobs on the Ryzen 1700?
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.
ID: 49310 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 49311 - Posted: 18 Apr 2018, 11:32:10 UTC - in response to Message 49310.  
Last modified: 18 Apr 2018, 11:33:45 UTC

It is possible to run as many as you want concurrently. A bug unfortunately prevents simultaneous starts. I am investigating possible workarounds but no timeline yet, sorry. Requirements are in some other thread; they are rather mild (only thing you need to have the gcc package installed).
ID: 49311 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mmonnin

Send message
Joined: 2 Jul 16
Posts: 338
Credit: 7,987,341,558
RAC: 213
Level
Tyr
Scientific publications
watwatwatwatwat
Message 49312 - Posted: 18 Apr 2018, 11:44:27 UTC - in response to Message 49310.  

I have five QC running at the moment on two machines, and they are taking from 230 MB to 260 MB. I would plan on at least 300 MB to be safe.


pardon me for jumping in, does that mean it is possible now to run several QC tasks at the same time? For example, 4 Jobs on the Ryzen 1700?


Best to just run 1 per computer via app_config or you'll eventually get two starting at once. They'll crash at once, and end up in this loop.
ID: 49312 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49313 - Posted: 18 Apr 2018, 13:46:14 UTC - in response to Message 49309.  

I now have one running at 1016 MB for a few minutes, but now down to 932 MB. It looks like the upper limit is a bit elastic.

Just to confirm, that's 1GB per work unit?

Yes, but now I see 1466 MB for a single work unit, the most I have seen.

Note however that I use an app_config to limit them to only one CPU core per work unit, but I do not limit the number of work units that can run at a time. It would undoubtedly be more efficient use of memory to allow the default value of four cores to run on a single work unit. It probably would not use much more memory than a single core, but what the maximum is I don't really know. I have 32 GB, so I have never really paid much attention to it. I use BOINCTasks to measure the memory use by the way.
ID: 49313 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
3de64piB5uZAS6SUNt1GFDU9dRhY
Avatar

Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49314 - Posted: 18 Apr 2018, 16:00:00 UTC - in response to Message 49311.  

It is possible to run as many as you want concurrently. A bug unfortunately prevents simultaneous starts.


Okay, thank you :)
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.
ID: 49314 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Logan Carr

Send message
Joined: 12 Aug 15
Posts: 240
Credit: 64,069,811
RAC: 0
Level
Thr
Scientific publications
watwatwatwat
Message 49316 - Posted: 18 Apr 2018, 21:12:02 UTC - in response to Message 49311.  
Last modified: 18 Apr 2018, 21:13:14 UTC

Requirements are in some other thread; they are rather mild (only thing you need to have the gcc package installed).


I have looked around and cannot find any requirements for this specific project. The only CPU requirements I see are here
http://www.gpugrid.net/join.php

But that looks like general use to me.

I will make my question a little more simple... would a core i3 work fine with this project, and if so, would a gen 1 be fine, gen 2, or newer? My budget for another PC dedicated to cpu work is about 100 USD. I do not mind for a small desktop either without a big gpu slot. Thank you.
Cruncher/Learner in progress.
ID: 49316 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
NUCCpod_NAPTIMELABS_01

Send message
Joined: 18 Aug 17
Posts: 6
Credit: 174,440,173
RAC: 0
Level
Ile
Scientific publications
watwat
Message 49317 - Posted: 18 Apr 2018, 22:26:57 UTC - in response to Message 49316.  


I will make my question a little more simple... would a core i3 work fine with this project, and if so, would a gen 1 be fine, gen 2, or newer? My budget for another PC dedicated to cpu work is about 100 USD. I do not mind for a small desktop either without a big gpu slot. Thank you.


For questions like this, wuprop is a fantastic resource. Check the link and you can see things like time to complete for various CPUs and other requirements like memory. In this case looks like you may need 776.5 MB of RAM and an i3 should do just fine.
ID: 49317 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Logan Carr

Send message
Joined: 12 Aug 15
Posts: 240
Credit: 64,069,811
RAC: 0
Level
Thr
Scientific publications
watwatwatwat
Message 49318 - Posted: 18 Apr 2018, 23:13:18 UTC - in response to Message 49317.  


I will make my question a little more simple... would a core i3 work fine with this project, and if so, would a gen 1 be fine, gen 2, or newer? My budget for another PC dedicated to cpu work is about 100 USD. I do not mind for a small desktop either without a big gpu slot. Thank you.


For questions like this, wuprop is a fantastic resource. Check the link and you can see things like time to complete for various CPUs and other requirements like memory. In this case looks like you may need 776.5 MB of RAM and an i3 should do just fine.



Thank you very much.
Cruncher/Learner in progress.
ID: 49318 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
3de64piB5uZAS6SUNt1GFDU9dRhY
Avatar

Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49372 - Posted: 29 Apr 2018, 8:43:29 UTC - in response to Message 49311.  
Last modified: 29 Apr 2018, 8:44:03 UTC

It is possible to run as many as you want concurrently. A bug unfortunately prevents simultaneous starts. I am investigating possible workarounds but no timeline yet, sorry.


One simple solution would be creating a TEMP file in the application directory. The first thing a job does is trying to create this file. In case the create command fails (because the file is already there or a multiple create/write conflict occurred) the job must back off for a while. If successful, this job is allowed to start and the others will try again in a couple of seconds. The now starting job shall delete the TEMP file in a timely manner, so that the others can also get started. So the TEMP file actually works like a (do-not-start) flag. You may also stop all tasks sometime and delete the TEMP at regular intervals, to make sure there is no failing or cancelled task leaving the file in place forever.

Frankly there are also other and more professional things like semaphores available in the OS, but the above is possibly the fastest solution.
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.
ID: 49372 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
3de64piB5uZAS6SUNt1GFDU9dRhY
Avatar

Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49373 - Posted: 29 Apr 2018, 17:12:07 UTC
Last modified: 29 Apr 2018, 17:13:52 UTC

...You may also stop all tasks


Edit: I mean to pause the tasks, not to cancel them of course. By the way, does the error show up also when multiple tasks are paused and then re-started/continued at the same time?
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.
ID: 49373 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PappaLitto

Send message
Joined: 21 Mar 16
Posts: 513
Credit: 4,673,458,277
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49376 - Posted: 30 Apr 2018, 12:28:51 UTC

I am having a lot of CPU Quantum Chemistry WUs error out as soon as they start on my Ubuntu machine. Some work but most error out. Is this inherent with the CPU app or is it my machine?

Below are the machine's tasks:
http://www.gpugrid.net/results.php?hostid=424454
ID: 49376 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ChristianVirtual

Send message
Joined: 16 Aug 14
Posts: 17
Credit: 378,346,925
RAC: 0
Level
Asp
Scientific publications
watwatwatwatwat
Message 49379 - Posted: 2 May 2018, 12:08:20 UTC

Me too:

http://www.gpugrid.net/result.php?resultid=17510462

ID: 49379 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 . . . 9 · Next

Message boards : News : CPU jobs on Linux

©2025 Universitat Pompeu Fabra