Message boards :
Graphics cards (GPUs) :
Python apps for GPU hosts needs [a whole lot] more disk space.
Message board moderation
| Author | Message |
|---|---|
|
Send message Joined: 1 Dec 21 Posts: 1 Credit: 11,546,345 RAC: 0 Level ![]() Scientific publications
|
I've gotten this notice a few times over the last few months... Python apps for GPU hosts needs 27668.09MB more disk space. You currently have 5710.52 MB available and it needs 33378.60 MB. A little over 30Gig? That seems like an awful lot of disk to be using. I know "disk is cheap" and whatnot, but are the datasets truly that big? Anyone know why it needs so much space? |
|
Send message Joined: 13 Dec 17 Posts: 1419 Credit: 9,119,446,190 RAC: 891 Level ![]() Scientific publications ![]() ![]() ![]() ![]()
|
I've gotten this notice a few times over the last few months... Because it DOES need that much space. The tasks do reinforcement learning using Pytorch and that framework infrastructure needs that much disk space for the examples. |
|
Send message Joined: 28 Jul 12 Posts: 819 Credit: 1,591,285,971 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
On Ubuntu 20.04.4, my www.gpugrid.net project directory is 3.7GB, and the slot it is running in shows 9.1GB. So that is certainly less than 30GB. But my SSD is 250GB, and I have 170GB remaining, so I have not hit the minimum space requirements yet. (I don't know what the maximum it needs is; it could be a lot more.) |
|
Send message Joined: 26 Dec 13 Posts: 86 Credit: 1,292,358,731 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
and the slot it is running in shows 9.1GB. So that is certainly less than 30GB. Probably WUs may vary in their volume and/or occupied volume may grow during the execution of the task. My current WU consumes almost 16 GiB(slot). Although of course it was interesting to know exactly how the values of the required space are calculated. Based on the fact that different values appear in such messages, this is some kind of automated algorithm, and not manually set values for WUs. |
|
Send message Joined: 7 May 20 Posts: 2 Credit: 507,838,725 RAC: 4 Level ![]() Scientific publications
|
deleted my post - sorry wrong thread! :) |
©2025 Universitat Pompeu Fabra