CPU jobs on Linux

Message boards : News : CPU jobs on Linux
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 . . . 9 · Next

AuthorMessage
Profile GDF
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist

Send message
Joined: 14 Mar 07
Posts: 1958
Credit: 629,356
RAC: 0
Level
Gly
Scientific publications
watwatwatwatwat
Message 48820 - Posted: 5 Feb 2018, 19:30:28 UTC

Hi, we need more CPUs on Linux to run QM simulations. Anybody can help?
ID: 48820 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keith Myers

Send message
Joined: 13 Dec 17
Posts: 1400
Credit: 8,616,046,190
RAC: 8,556,950
Level
Tyr
Scientific publications
watwatwatwatwat
Message 48821 - Posted: 5 Feb 2018, 20:05:56 UTC

Do you want to make them more appealing to crunch?? Take the QMML tasks OFF the Boinc CreditNew credit award mechanism and assign them fixed values like you do for the gpu tasks.
ID: 48821 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
biodoc

Send message
Joined: 26 Aug 08
Posts: 183
Credit: 10,085,929,375
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48823 - Posted: 5 Feb 2018, 20:47:06 UTC

Sure, I can help.
ID: 48823 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Matt Kowal
Avatar

Send message
Joined: 27 May 14
Posts: 9
Credit: 92,568,568
RAC: 0
Level
Thr
Scientific publications
watwat
Message 48824 - Posted: 5 Feb 2018, 21:18:15 UTC
Last modified: 5 Feb 2018, 21:23:18 UTC

This forum news post was syndicated to your Twitter account, however, the link is broken.

Relevant post: https://twitter.com/gpugrid/status/960604705171808256

The link resolves to https://www.gpugrid.net/extra_arg_utm_source.html

I have reposted your call to the BOINC subreddit
ID: 48824 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
klepel

Send message
Joined: 23 Dec 09
Posts: 189
Credit: 4,792,731,008
RAC: 124,733
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48825 - Posted: 5 Feb 2018, 21:45:30 UTC - in response to Message 48821.  
Last modified: 5 Feb 2018, 21:47:43 UTC

Do you want to make them more appealing to crunch?? Take the QMML tasks OFF the Boinc CreditNew credit award mechanism and assign them fixed values like you do for the gpu tasks.

+1

PS Unfortunatelly, they crash my computer with my strongest GPU frequently, so I will not run them on this computer.
ID: 48825 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
John C MacAlister

Send message
Joined: 17 Feb 13
Posts: 181
Credit: 144,871,276
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwat
Message 48826 - Posted: 5 Feb 2018, 22:51:50 UTC - in response to Message 48820.  

Unfortunately, I gave up on Linux and run Win 10.


Hi, we need more CPUs on Linux to run QM simulations. Anybody can help?


John
ID: 48826 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile GDF
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist

Send message
Joined: 14 Mar 07
Posts: 1958
Credit: 629,356
RAC: 0
Level
Gly
Scientific publications
watwatwatwatwat
Message 48827 - Posted: 5 Feb 2018, 23:23:41 UTC - in response to Message 48821.  

Do you want to make them more appealing to crunch?? Take the QMML tasks OFF the Boinc CreditNew credit award mechanism and assign them fixed values like you do for the gpu tasks.



We are testing this.
ID: 48827 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keith Myers

Send message
Joined: 13 Dec 17
Posts: 1400
Credit: 8,616,046,190
RAC: 8,556,950
Level
Tyr
Scientific publications
watwatwatwatwat
Message 48828 - Posted: 6 Feb 2018, 0:22:33 UTC - in response to Message 48826.  

I've had good luck with the Linux apps up until the recent gpu application errors that started this month. The cpu tasks ran fine.

I and others have voiced our displeasure with the credit awarded for the flops used for the QM tasks in this thread.
New Student and QMML Project
ID: 48828 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile GDF
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist

Send message
Joined: 14 Mar 07
Posts: 1958
Credit: 629,356
RAC: 0
Level
Gly
Scientific publications
watwatwatwatwat
Message 48833 - Posted: 6 Feb 2018, 9:02:58 UTC - in response to Message 48828.  

we are testing different credit systems now.
ID: 48833 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 48834 - Posted: 6 Feb 2018, 10:45:39 UTC - in response to Message 48833.  
Last modified: 6 Feb 2018, 10:46:23 UTC

We don't use CreditNew but the previous credit system. In any case, two changes were made yesterday:

* CPU threads are limited to 4 (you should still be able to crunch multiple WUs at once, please check)
* Credits should be in line with other projects'

Let us know.
ID: 48834 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bikermatt

Send message
Joined: 8 Apr 10
Posts: 37
Credit: 4,369,357,619
RAC: 1,959,118
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48836 - Posted: 6 Feb 2018, 12:54:52 UTC - in response to Message 48834.  


* CPU threads are limited to 4 (you should still be able to crunch multiple WUs at once, please check)

Let us know.


Boinc is still assigning all of my 32 threads to one task even though it is only using 4.
ID: 48836 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48837 - Posted: 6 Feb 2018, 13:29:06 UTC - in response to Message 48820.  

Hi, we need more CPUs on Linux to run QM simulations. Anybody can help?

I have three machines on it, but I can run only one work unit at a time on average. That is because when any more start up at once, they error out, as has been discussed before. And I run two cores per work unit for efficiency. But if you could solve the start-up problem, I could run more.
ID: 48837 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48838 - Posted: 6 Feb 2018, 13:55:26 UTC

I don't see that you have made an announcement on the BOINC forum yet. The Projects section would probably be best.
http://boinc.berkeley.edu/dev/forum_forum.php?id=11
ID: 48838 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
biodoc

Send message
Joined: 26 Aug 08
Posts: 183
Credit: 10,085,929,375
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48839 - Posted: 6 Feb 2018, 14:24:00 UTC

I have an Intel 2600K with 8 logical cores. I wanted to reserved 2 cores for feeding 2 GPUs that are running Folding@home. I set the computing preference in boinc to use, at most, 80% of processors (6 cores).

Data on 19 WUs before GPUGrid changes (processor usage varied but 5-6 cores on average I think)

Average run time (sec): 3,129.23
Average CPU time (sec): 16,122.19
Average credit per WU: 228.7
Average WU per day: 27.6
PPD: 6314.8

Data on 15 WUs after GPUGrid changes. Processor usage was 4 cores even though set at 6)

Average run time (sec): 3,566.32
Average CPU time (sec): 14,114.28
Average credit per WU: 819.284
Average WU per day: 24.2
PPD: 19848.5

Summary: Processor usage seems to be maxed out at 4. Run time has increased, CPU time has decreased, WU completed per day has decreased and PPD has increased significantly.

ID: 48839 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 48840 - Posted: 6 Feb 2018, 14:57:09 UTC - in response to Message 48836.  
Last modified: 6 Feb 2018, 15:09:56 UTC



Boinc is still assigning all of my 32 threads to one task even though it is only using 4.


Ouch. This should not happen. May be fixed now.
ID: 48840 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mmonnin

Send message
Joined: 2 Jul 16
Posts: 338
Credit: 7,904,541,558
RAC: 376,887
Level
Tyr
Scientific publications
watwatwatwatwat
Message 48842 - Posted: 6 Feb 2018, 15:50:39 UTC - in response to Message 48837.  

Hi, we need more CPUs on Linux to run QM simulations. Anybody can help?

I have three machines on it, but I can run only one work unit at a time on average. That is because when any more start up at once, they error out, as has been discussed before. And I run two cores per work unit for efficiency. But if you could solve the start-up problem, I could run more.


I agree. There were too many issues that had not been resolved. On top of that the credit much worse than even CreditNew. I see the credit has been changed just saying there are reasons for the lack of CPU time.
ID: 48842 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keith Myers

Send message
Joined: 13 Dec 17
Posts: 1400
Credit: 8,616,046,190
RAC: 8,556,950
Level
Tyr
Scientific publications
watwatwatwatwat
Message 48845 - Posted: 6 Feb 2018, 17:48:28 UTC - in response to Message 48834.  

Are you sure that you are using an "older" credit mechanism? From the response in the "New Student and QMML" thread from Richard Haselgrove who corrected me in my assumption you might be using an "older" mechanism.

Be careful of your terms. 'CreditNew' has been the default BOINC mechanism since 2010. I suspect this is what GPUGrid is using for these tasks: the support mechanisms for 'even older credit' have been removed from the codebase.

I wonder where you found the older codebase that has been removed that contained the "older" credit award algorithm. If you do in fact have such, I would like access to it. Or have it reinstituted into the BOINC Github codebase.

It would be helpful in persuading the BOINC maintainers that there is in fact a way to return to the older credit algorithm. One of their stated reasons why they said they would not change from CreditNew is that they said they no longer have the original code and can't replicate it.

That said, it looks like the award for QC cpu tasks is much more appealing now.
ID: 48845 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keith Myers

Send message
Joined: 13 Dec 17
Posts: 1400
Credit: 8,616,046,190
RAC: 8,556,950
Level
Tyr
Scientific publications
watwatwatwatwat
Message 48847 - Posted: 6 Feb 2018, 19:21:26 UTC - in response to Message 48839.  

Hmmm ... I just ran a new QC task with the supposed new credit. Not seeing any difference.

Run time 3,292.22
CPU time 12,925.47
Validate state Valid
Credit 110.63

I used 4 cores to generate 110 credits for 54 minutes of compute time.

I can use one core to generate 108 credits for 60 minutes of compute time for SETI CPU tasks.

No reason to run these tasks still for me.
ID: 48847 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
STARBASEn
Avatar

Send message
Joined: 17 Feb 09
Posts: 91
Credit: 1,603,303,394
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwat
Message 48850 - Posted: 6 Feb 2018, 23:50:37 UTC

Since just after mid day yesterday (UTC) I have noticed an increase in credit awarded for the QC WU's. Doing some quick calcs, it appears the increase is about 4.5x of what we were getting. It also appears they are more fixed in value proportional to the size of the WU. My faster machines are getting over 500 credits/hr (4 cores) compute time whereas the slower machines are getting proportionately less/hr and still getting equivalent credit but over a longer period of time than the faster ones.

Well, at least my avg credit per day will not be taking as much of a hit per day as it has been without Linux GPU WU's :).

So far, I have 5 machines with 4 cores each running the QC project and will add one more when I install the memory upgrade on one of the headless systems.
ID: 48850 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keith Myers

Send message
Joined: 13 Dec 17
Posts: 1400
Credit: 8,616,046,190
RAC: 8,556,950
Level
Tyr
Scientific publications
watwatwatwatwat
Message 48851 - Posted: 7 Feb 2018, 0:28:50 UTC - in response to Message 48850.  

I'm not sure the higher credit is not due to the larger molecule size in the latest tasks that Dominik explained to me here.
ID: 48851 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · 3 · 4 . . . 9 · Next

Message boards : News : CPU jobs on Linux

©2025 Universitat Pompeu Fabra