Python Runtime (GPU, beta)

Message boards : News : Python Runtime (GPU, beta)
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 3 · 4 · 5 · 6

AuthorMessage
Ian&Steve C.

Send message
Joined: 21 Feb 20
Posts: 1114
Credit: 40,838,348,595
RAC: 4,765,598
Level
Trp
Scientific publications
wat
Message 58110 - Posted: 15 Dec 2021, 15:20:14 UTC - in response to Message 58109.  

a trivial question garners a trivial response :)

does it solve your problem?
ID: 58110 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 11 Jul 09
Posts: 1639
Credit: 10,159,968,649
RAC: 295,172
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 58111 - Posted: 15 Dec 2021, 15:24:48 UTC - in response to Message 58109.  

re: CPU use for the task, this is easily configured client-side with an app config file, and it will force 1:1 no matter what the project defines. I'd recommend that.

I wasn't asking you for a trivial response. I'm asking the people that create these work units why they don't specify 1 instead of 0.963.

Because the GPUGrid staff don't set that figure. There's an algorithm in the (Berkeley written) BOINC server code which generates the figure to use from a range of outdated, stupid, data.

I discussed this at some length almost three years ago, in https://github.com/BOINC/boinc/issues/2949 - with examples drawn from GPUGrid, among other projects. I think that this was about the point that Berkeley stopped reading a single word of what I write. Someone else can get to grips with it this time.
ID: 58111 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ian&Steve C.

Send message
Joined: 21 Feb 20
Posts: 1114
Credit: 40,838,348,595
RAC: 4,765,598
Level
Trp
Scientific publications
wat
Message 58113 - Posted: 15 Dec 2021, 15:38:56 UTC - in response to Message 58111.  

thanks Richard, I had a thought that it was likely the output of some automated function within BOINC since nearly all projects end up with something like this by default if they don't manually set the figures.
ID: 58113 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 21 Nov 16
Posts: 36
Credit: 164,429,114
RAC: 12,554
Level
Ile
Scientific publications
wat
Message 58121 - Posted: 16 Dec 2021, 2:56:58 UTC - in response to Message 58113.  

Too bad they never worked to implement all or part of Richard's suggestion / GitHub issue. While I don't claim to be able to see the bigger picture in BOINC it sounds like a good path for automated adjustments when new GPU hardware is released.

Bill F

In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 58121 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
bormolino

Send message
Joined: 16 May 13
Posts: 41
Credit: 145,731,947
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwat
Message 58205 - Posted: 24 Dec 2021, 15:20:12 UTC

I got one WU today (e1a10-ABOU_rnd_ppod_13-0-1-RND2740_2).

Is it normal behaviour that the WU uses more than 7GB of RAM?
ID: 58205 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ian&Steve C.

Send message
Joined: 21 Feb 20
Posts: 1114
Credit: 40,838,348,595
RAC: 4,765,598
Level
Trp
Scientific publications
wat
Message 58206 - Posted: 24 Dec 2021, 15:38:40 UTC - in response to Message 58205.  

I got one WU today (e1a10-ABOU_rnd_ppod_13-0-1-RND2740_2).

Is it normal behaviour that the WU uses more than 7GB of RAM?


Yes.
ID: 58206 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
bormolino

Send message
Joined: 16 May 13
Posts: 41
Credit: 145,731,947
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwat
Message 58207 - Posted: 24 Dec 2021, 15:40:09 UTC - in response to Message 58206.  

I got one WU today (e1a10-ABOU_rnd_ppod_13-0-1-RND2740_2).

Is it normal behaviour that the WU uses more than 7GB of RAM?


Yes.


Thanks for answering.
ID: 58207 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Greg _BE

Send message
Joined: 30 Jun 14
Posts: 153
Credit: 129,654,684
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwat
Message 58699 - Posted: 22 Apr 2022, 15:39:17 UTC
Last modified: 22 Apr 2022, 15:40:29 UTC

What is typical run time for these tasks? I am at 1 day and x hours processing and only 34% of the way done. I have 2 days left before deadline. I am running a GTX 1080 plain, not TI that is OC'd a bit.
ID: 58699 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 21 Nov 16
Posts: 36
Credit: 164,429,114
RAC: 12,554
Level
Ile
Scientific publications
wat
Message 58712 - Posted: 25 Apr 2022, 14:05:30 UTC - in response to Message 58699.  

What is typical run time for these tasks? I am at 1 day and x hours processing and only 34% of the way done. I have 2 days left before deadline. I am running a GTX 1080 plain, not TI that is OC'd a bit.


Your times may be about right. I have a GTX 1060 with 6GB and my times were similar.
ID: 58712 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile robertmiles

Send message
Joined: 16 Apr 09
Posts: 503
Credit: 769,991,668
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 58948 - Posted: 19 Jun 2022, 18:44:06 UTC

This task is giving wild results for its estimated time remaining.

This morning, it was saying over 400 days remaining.

Application Python apps for GPU hosts 4.03 (cuda1131)
Name e23a16-ABOU_rnd_ppod_demo_sharing_large-0-1-RND7660
State Running
Received 6/19/2022 6:33:56 AM
Report deadline 6/24/2022 6:34:02 AM
Resources 0.949 CPUs + 1 NVIDIA GPU
Estimated computation size 1,000,000,000 GFLOPs
CPU time 23:13:06
CPU time since checkpoint 00:02:47
Elapsed time 06:42:45
Estimated time remaining 357d 12:44:26
Fraction done 22.580%
Virtual memory size 5.81 GB
Working set size 1.05 GB
Directory slots/10
Process ID 6376
Progress rate 3.240% per hour
Executable wrapper_6.1_windows_x86_64.exe

I've seen other tasks start out claiming over 300 days remaining, and then finish in between 5 and 6 days.

Is there something wrong in the data sent as task input, or is it the wild first ten tasks for a new application version?
ID: 58948 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mmonnin

Send message
Joined: 2 Jul 16
Posts: 338
Credit: 7,987,341,558
RAC: 178,897
Level
Tyr
Scientific publications
watwatwatwatwat
Message 58950 - Posted: 20 Jun 2022, 18:38:06 UTC
Last modified: 20 Jun 2022, 18:38:52 UTC

Yup, non beta task but I've seen over 3k day ETAs recently.


Name e23a60-ABOU_rnd_ppod_demo_sharing_large-0-1-RND1212_1

Application Python apps for GPU hosts 4.03 (cuda1131)
Workunit name e23a60-ABOU_rnd_ppod_demo_sharing_large-0-1-RND1212
State Running High P.
Received 6/20/2022 12:17:53 PM
Report deadline 6/25/2022 12:17:53 PM
Estimated app speed 311.15 GFLOPs/sec
Estimated task size 1,000,000,000 GFLOPs
Resources 0.99 CPUs + 1 NVIDIA GPU
CPU time at last checkpoint 05:44:17
CPU time 05:47:46
Elapsed time 02:17:30
Estimated time remaining 2764d,01:55:33
Fraction done 11.890%
Virtual memory size 18,693.93 MB
Working set size 3,824.01 MB
ID: 58950 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keith Myers
Avatar

Send message
Joined: 13 Dec 17
Posts: 1416
Credit: 9,119,446,190
RAC: 614,515
Level
Tyr
Scientific publications
watwatwatwatwat
Message 58951 - Posted: 20 Jun 2022, 20:50:03 UTC

Just ignore the ETA estimates. Garbage data.
The tasks finish fine and well within their deadlines.
ID: 58951 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile robertmiles

Send message
Joined: 16 Apr 09
Posts: 503
Credit: 769,991,668
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 58952 - Posted: 21 Jun 2022, 0:45:31 UTC
Last modified: 21 Jun 2022, 0:47:44 UTC

Were the very long ETA estimates intended to make GPUGRID Python GPU work run before any GPU work from other BOINC projects? They seem to be very good at doing that.

Note there seems to be no thread for discussing non-beta Python tasks.
ID: 58952 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keith Myers
Avatar

Send message
Joined: 13 Dec 17
Posts: 1416
Credit: 9,119,446,190
RAC: 614,515
Level
Tyr
Scientific publications
watwatwatwatwat
Message 58953 - Posted: 21 Jun 2022, 2:53:45 UTC - in response to Message 58952.  

Were the very long ETA estimates intended to make GPUGRID Python GPU work run before any GPU work from other BOINC projects? They seem to be very good at doing that.

Note there seems to be no thread for discussing non-beta Python tasks.

No not at all. BOINC just has no mechanism for dealing with hybrid cpu-gpu tasks.

The Python on GPU tasks are the first of their kind.

It will take the BOINC devs a lot of time to accommodate them correctly.

If they are getting in the way of your other work, I suggest stopping them or limiting them to only a single task at any time by changing your cache size to absolute minimal values.
ID: 58953 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keith Myers
Avatar

Send message
Joined: 13 Dec 17
Posts: 1416
Credit: 9,119,446,190
RAC: 614,515
Level
Tyr
Scientific publications
watwatwatwatwat
Message 58956 - Posted: 21 Jun 2022, 17:31:43 UTC - in response to Message 58952.  

Were the very long ETA estimates intended to make GPUGRID Python GPU work run before any GPU work from other BOINC projects? They seem to be very good at doing that.

Note there seems to be no thread for discussing non-beta Python tasks.

The other threads are here:
https://www.gpugrid.net/forum_thread.php?id=5323

https://www.gpugrid.net/forum_thread.php?id=5319
ID: 58956 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keith Myers
Avatar

Send message
Joined: 13 Dec 17
Posts: 1416
Credit: 9,119,446,190
RAC: 614,515
Level
Tyr
Scientific publications
watwatwatwatwat
Message 58957 - Posted: 21 Jun 2022, 18:29:22 UTC
Last modified: 21 Jun 2022, 18:29:32 UTC

FYI, the Python on GPU tasks are the same as the beta Python tasks currently.

Both tasks are using the latest application code.

The devs said they would still keep the beta plan class available, just not in use, for whenever a new application might be developed.

So everyone is getting the standard Python work even if they have beta selected.
ID: 58957 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Drago

Send message
Joined: 3 May 20
Posts: 19
Credit: 1,043,759,208
RAC: 27,005
Level
Met
Scientific publications
wat
Message 59715 - Posted: 12 Jan 2023, 15:51:14 UTC

Does anybody know how many cpu threads would be ideal to run them efficiently? I gave them 12 threads exclusively but still the task is run primarily on the cpu with my 3070ti kicking in only sporadically for a second or two.
ID: 59715 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ian&Steve C.

Send message
Joined: 21 Feb 20
Posts: 1114
Credit: 40,838,348,595
RAC: 4,765,598
Level
Trp
Scientific publications
wat
Message 59716 - Posted: 12 Jan 2023, 16:09:32 UTC - in response to Message 59715.  
Last modified: 12 Jan 2023, 16:10:32 UTC

giving it more cores wont necessarily make it run faster. as few as 4 cores per task works fine on my EPYC system. but if you are running other projects on the CPU it will slow them down as the processes compete with each other for CPU time.

by default the program will use however many cores you have and you really can't change this with any BOINC settings.

also I would recommend putting Linux on that system instead of Windows. Linux runs much faster
ID: 59716 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Drago

Send message
Joined: 3 May 20
Posts: 19
Credit: 1,043,759,208
RAC: 27,005
Level
Met
Scientific publications
wat
Message 59719 - Posted: 13 Jan 2023, 10:59:48 UTC - in response to Message 59716.  

Gotcha! My Linux Laptop finishes them in 10 hours, my much faster Windows PC needs 18! Thanks again Ian & Steve
ID: 59719 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 . . . 3 · 4 · 5 · 6

Message boards : News : Python Runtime (GPU, beta)

©2025 Universitat Pompeu Fabra