Message boards :
Graphics cards (GPUs) :
How many Pythons does it need to run???
Message board moderation
| Author | Message |
|---|---|
|
Send message Joined: 26 Oct 09 Posts: 13 Credit: 32,914,359 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
I have 40 Python programs running at the same time and my GPUs are not doing a thing. A 1080 Ti and a 980 running GPU driver v512.59 with CUDA 11.6. BOINC is showing it's running 2. One for each GPU. Both projects show it would take a day to finish. One took an hour and never ran any of my GPUs. Never went past 2%. I check my logs and have 17 with "Error while computing". |
|
Send message Joined: 11 Jul 09 Posts: 1639 Credit: 10,159,968,649 RAC: 428 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
When you drill down into the failure reports, the salient line seems to be RuntimeError: [enforce fail at C:\cb\pytorch_1000000000000\work\c10\core\impl\alloc_cpu.cpp:81] data. DefaultCPUAllocator: not enough memory: you tried to allocate 3612672 bytes. Your cards have too little memory (4095 MB) to run these tasks. Deselect the Python applications in your account settings - ACEMD 3 or 4 tasks should still run OK. |
|
Send message Joined: 21 Feb 20 Posts: 1116 Credit: 40,839,470,595 RAC: 6,423 Level ![]() Scientific publications
|
a 1080Ti has 11GB of VRAM. that is enough. but the 4GB on the 980 might not be enough. further, his error is about CPU memory allocation and not related to the GPU memory.
|
|
Send message Joined: 26 Oct 09 Posts: 13 Credit: 32,914,359 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
If 4GB is not enough then I should have not got it in the first place. I have a 11GB GPU and it won't run on it as well. Also, I shouldn't be running 40 Python programs at once. Only 2. One per GPU. Plus, I have 32GB of RAM. |
|
Send message Joined: 13 Dec 17 Posts: 1419 Credit: 9,119,446,190 RAC: 891 Level ![]() Scientific publications ![]() ![]() ![]() ![]()
|
The Python tasks spawn more than two processes. Usually 32 or more. This is normal and typical of reinforced learning. Windows has issues with the Python gpu tasks. It has no issues with the acemd3 and acemd4 tasks. Suggest you try those and deselect Python on Gpu tasks. |
|
Send message Joined: 26 Oct 09 Posts: 13 Credit: 32,914,359 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
The Python tasks spawn more than two processes. Usually 32 or more. Really!? 32 or more? Hum. At least the problem is known. Thank you for that. Python affects Edge to the point where you can't brows from it while Python is running and curser hangs a little at times. |
|
Send message Joined: 21 Feb 20 Posts: 1116 Credit: 40,839,470,595 RAC: 6,423 Level ![]() Scientific publications
|
to clarify, it's not running 32 GPU processes. it runs 1 GPU process with 32 CPU processes, per task. all BOINC GPU projects will use resources from both the GPU and CPU but in most cases you only have a single CPU thread (or less) supporting the GPU process. the GPUGRID Python tasks stand out as they are essentially a multi-threaded (mt) CPU app combined with GPU work. part of the problem is that BOINC isn't coded (currently) to handle this combination. so if you are running any other projects, particularly CPU projects, BOINC thinks you have more free resources than you really do, and generally causing problems. if you don't want to run python tasks, just go into your project preferences and uncheck the python tasks.
|
Retvari ZoltanSend message Joined: 20 Jan 09 Posts: 2380 Credit: 16,897,957,044 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
This is not a bug. This is a feature.The Python tasks spawn more than two processes. Usually 32 or more. |
|
Send message Joined: 26 Oct 09 Posts: 13 Credit: 32,914,359 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
This is not a bug. This is a feature.The Python tasks spawn more than two processes. Usually 32 or more. Not the 32 Pythons running. The 15 errors I'm getting is the problem. |
©2025 Universitat Pompeu Fabra