Need more space. Again
Message boards :
Number crunching :
Need more space. Again
Message board moderation
| Author | Message |
|---|---|
|
Send message Joined: 10 Sep 10 Posts: 164 Credit: 388,132 RAC: 0 Level  Scientific publications 
|
I've crunched quietly on my Linux Vm until today. Now, suddenly, this message: Quantum Chemistry needs 13195.37MB more disk space. You currently have 15414.86 MB available and it needs 28610.23 MB. 30 gb for a wu?? Are you kidding? |
|
Send message Joined: 21 Mar 16 Posts: 513 Credit: 4,673,458,277 RAC: 0 Level  Scientific publications    
|
In a previous message from Stefan he mentions these new WUs are much larger simulations that require much larger data-sets. It's just the nature of the beast. |
|
Send message Joined: 10 Sep 10 Posts: 164 Credit: 388,132 RAC: 0 Level Scientific publications
|
Ok, i changed the vm disk, now i have 40gb free. But wus stuck at 10%: "Waiting to run" |
|
Send message Joined: 21 Mar 16 Posts: 513 Credit: 4,673,458,277 RAC: 0 Level Scientific publications
|
Ok, i changed the vm disk, now i have 40gb free. These WUs use an extremely large amount of memory, most likely it has completely filled your ram and is taking from swap (hard drive) so it cannot run at full speed. I suggest everyone simply wait as unless you have more ram, there is no way to speed this up. |
|
Send message Joined: 8 May 18 Posts: 190 Credit: 104,426,808 RAC: 0 Level  Scientific publications
|
I have aborted one which seemed to go on forever. Now I have another running and one waiting to run. Let's hope they complete. Tullio |
|
Send message Joined: 10 Sep 10 Posts: 164 Credit: 388,132 RAC: 0 Level Scientific publications
|
These WUs use an extremely large amount of memory, most likely it has completely filled your ram and is taking from swap (hard drive) so it cannot run at full speed. 6gb of ram is not enough for a single wu? I think they have to work on the app code... |
|
Send message Joined: 8 May 18 Posts: 190 Credit: 104,426,808 RAC: 0 Level Scientific publications
|
I have 8 GB RAM also on the laptop. Two tasks have completed so far, another is running. I have aborted one which was going on endlessly. Tullio |
|
Send message Joined: 2 Jul 16 Posts: 338 Credit: 7,987,341,558 RAC: 259 Level  Scientific publications 
|
These are needing 30gb of disk space and 6gb of memory? Wow. |
|
Send message Joined: 21 Mar 16 Posts: 513 Credit: 4,673,458,277 RAC: 0 Level Scientific publications
|
So my Ryzen r7 1700 system runs 4 of these WUs at once. I had 8gb of RAM and ran the old WUs no problem, 100% CPU usage and ~6GB of RAM usage. With these new WUs I was getting extremely low CPU usage with 4 running and maxed out my RAM. So I switched to 16GB of RAM. It now uses ~13gb of RAM but I still have very low CPU usage? Why is this? It's not maxing out RAM, is it taking from the SSD constantly? Swap is completely empty as well. I would assume the application would put all the vital info in the RAM until it couldn't anymore. |
|
Send message Joined: 8 May 18 Posts: 190 Credit: 104,426,808 RAC: 0 Level Scientific publications
|
I get 197% CPU usage if no other task is running,173% if a GPU task is running alongside. I have only two cores CPU,both on the Linux laptop and the Linux SUN workstation. The Windows 10 PC has 4 cores but all GPU tasks overheat its GTX 1050 Ti, not overclocked. Einstein@home GPU tasks run fine on it. Tullio |
|
Send message Joined: 10 Sep 10 Posts: 164 Credit: 388,132 RAC: 0 Level Scientific publications
|
Ok. I passed from 6 to 8 gb on Vm. Now the wu doesn't "pause", but still remain at 10% until the end of the remaining time. When time is 0, the wu passes immediatly to 100% and continue to crunch.....and cpu use is 0%. |
|
Send message Joined: 8 May 18 Posts: 190 Credit: 104,426,808 RAC: 0 Level Scientific publications
|
Toni in a News post has explained why the task progress remains at 10%. But my tasks end and report when they finish. Tullio |
|
Send message Joined: 10 Sep 10 Posts: 164 Credit: 388,132 RAC: 0 Level Scientific publications
|
Toni in a News post has explained why the task progress remains at 10%. But my tasks end and report when they finish. Ok, i've read the post. And i leave the wu crunching But i have this error: 09:28:46 (2923): wrapper (7.7.26016): starting |
|
Send message Joined: 28 Jul 12 Posts: 819 Credit: 1,591,285,971 RAC: 0 Level  Scientific publications
|
</stderr_txt> They have already been notified. http://www.gpugrid.net/forum_thread.php?id=4785&nowrap=true#50349 |
|
Send message Joined: 10 Sep 10 Posts: 164 Credit: 388,132 RAC: 0 Level Scientific publications
|
They have already been notified. And no answer.... |
 Send message Joined: 26 Feb 14 Posts: 211 Credit: 4,496,324,562 RAC: 0 Level Scientific publications
|
So I just discovered something interesting. I'm running 4 GPUs along with 2 CPU work units. 64 GB in the machine. Virtual memory for the GPU tasks are 32 GB each....... Not sure how much virtual memory the CPU are using but even if it's the say...45 GB. I can see why I'm running out of space on my SSD 4 x 32 = 128 GB. The SSD is only 120GB total. So yeah, think it's time to upgrade the SSD.....  
|
|
Send message Joined: 8 May 18 Posts: 190 Credit: 104,426,808 RAC: 0 Level Scientific publications
|
Virtual memory size is 4.15 GB on my 8 GB RAM on a Linux box. But more than 700 GB are available to BOINC of a 1 TB disk. I had SSDs on my HP laptop and they all failed. I installed a hybrid disk on it with 8 MB SSD out of 1 TB and it works. Tullio |
|
Send message Joined: 26 Feb 14 Posts: 211 Credit: 4,496,324,562 RAC: 0 Level Scientific publications
|
Virtual memory size is 4.15 GB on my 8 GB RAM on a Linux box. But more than 700 GB are available to BOINC of a 1 TB disk. I had SSDs on my HP laptop and they all failed. I installed a hybrid disk on it with 8 MB SSD out of 1 TB and it works. I'm getting old..haha... My memory is faulty. Turns out that I had already upgraded that SSD to a 500GB. So that leaves the question of why it's running out of space. I turned off 1 QC work unit, leaving only 1 running along with the 4 GPUs. Better for the temps on the CPU, they were spiking to 100C, now they are back down to 60C-70C
|
|
Send message Joined: 5 Mar 13 Posts: 348 Credit: 0 RAC: 0 Level Scientific publications |
A single WU will only use 4GB RAM. If it uses significantly more than that (i.e. 6GB) report to me because it might be a bug in the software. Other than that yes I mentioned that some of the WUs I submitted now might use up to 50GB of scratch space on the disk. There is not much I can do about it other than simply not simulating them. |
|
Send message Joined: 10 Sep 10 Posts: 164 Credit: 388,132 RAC: 0 Level Scientific publications
|
Turns out that I had already upgraded that SSD to a 500GB. So that leaves the question of why it's running out of space. New beta wus on my linux VM <
©2025 Universitat Pompeu Fabra