Server is out of disk space

Message boards : Number crunching : Server is out of disk space
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · Next

AuthorMessage
Bedrich Hajek

Send message
Joined: 28 Mar 09
Posts: 490
Credit: 11,731,645,728
RAC: 69
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 61548 - Posted: 20 Jun 2024, 21:56:05 UTC

Thu 20 Jun 2024 05:49:06 PM EDT | GPUGRID | [error] Error reported by file upload server: Server is out of disk space
ID: 61548 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mrchips

Send message
Joined: 9 May 21
Posts: 16
Credit: 1,435,881,404
RAC: 0
Level
Met
Scientific publications
wat
Message 61550 - Posted: 21 Jun 2024, 0:23:57 UTC

still out of space
ID: 61550 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Bedrich Hajek

Send message
Joined: 28 Mar 09
Posts: 490
Credit: 11,731,645,728
RAC: 69
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 61554 - Posted: 21 Jun 2024, 22:41:23 UTC

It's full again.

Fri 21 Jun 2024 06:40:41 PM EDT | GPUGRID | [error] Error reported by file upload server: Server is out of disk space
ID: 61554 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
pututu

Send message
Joined: 8 Oct 16
Posts: 27
Credit: 4,153,801,869
RAC: 0
Level
Arg
Scientific publications
watwatwatwat
Message 61719 - Posted: 25 Aug 2024, 17:00:25 UTC
Last modified: 25 Aug 2024, 17:25:46 UTC

Currently, I'm seeing disk full error message.

Edit1: seems to be clearing slowly now.

Edit2: uploading seems to be intermittent...
ID: 61719 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Bedrich Hajek

Send message
Joined: 28 Mar 09
Posts: 490
Credit: 11,731,645,728
RAC: 69
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 61720 - Posted: 25 Aug 2024, 18:43:54 UTC

Confirmed. Server is out of disk space.

ID: 61720 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
pututu

Send message
Joined: 8 Oct 16
Posts: 27
Credit: 4,153,801,869
RAC: 0
Level
Arg
Scientific publications
watwatwatwat
Message 61722 - Posted: 25 Aug 2024, 21:07:26 UTC
Last modified: 25 Aug 2024, 21:09:12 UTC

Seems like it is intermittent, meaning need to perform network transfer retry occasionally to upload the completed tasks. Best to run with a script.

Fingers crossed that the server disk hasn't completely crashed yet as of this posting...
ID: 61722 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Freewill

Send message
Joined: 18 Mar 10
Posts: 28
Credit: 41,810,583,419
RAC: 13,276
Level
Trp
Scientific publications
watwatwatwatwat
Message 61728 - Posted: 26 Aug 2024, 4:55:44 UTC

Still getting this error as of 26 Aug almost 7:00 AM Madrid time.
ID: 61728 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 11 Jul 09
Posts: 1639
Credit: 10,159,968,649
RAC: 428
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 61731 - Posted: 26 Aug 2024, 8:00:37 UTC

26/08/2024 08:58:40 | GPUGRID | [error] Error reported by file upload server: Maintenance underway: file uploads are temporarily disabled.
ID: 61731 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Steve
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist

Send message
Joined: 21 Dec 23
Posts: 51
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 61734 - Posted: 26 Aug 2024, 9:13:22 UTC - in response to Message 61731.  

Thank you for reporting. It is now back and with more space.
ID: 61734 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Bedrich Hajek

Send message
Joined: 28 Mar 09
Posts: 490
Credit: 11,731,645,728
RAC: 69
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 61779 - Posted: 8 Sep 2024, 21:07:19 UTC

Server is out of disc space again.


Sun 08 Sep 2024 05:05:46 PM EDT | GPUGRID | Started upload of p38_A31_A28_r0_4-QUICO_ATM_AF_04_Benchmark-16-20-RND3498_1_0
Sun 08 Sep 2024 05:05:47 PM EDT | GPUGRID | [error] Error reported by file upload server: Server is out of disk space
Sun 08 Sep 2024 05:05:47 PM EDT | GPUGRID | Temporarily failed upload of p38_A31_A28_r0_4-QUICO_ATM_AF_04_Benchmark-16-20-RND3498_1_0: transient upload error
Sun 08 Sep 2024 05:05:47 PM EDT | GPUGRID | Backing off 00:24:33 on upload of p38_A31_A28_r0_4-QUICO_ATM_AF_04_Benchmark-16-20-RND3498_1_0



ID: 61779 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stacie

Send message
Joined: 29 Mar 20
Posts: 22
Credit: 934,891,468
RAC: 155
Level
Glu
Scientific publications
wat
Message 61780 - Posted: 9 Sep 2024, 0:27:54 UTC - in response to Message 61779.  

Is this why finished workunits are failing to upload? They are starting to pile up in my que.
ID: 61780 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stacie

Send message
Joined: 29 Mar 20
Posts: 22
Credit: 934,891,468
RAC: 155
Level
Glu
Scientific publications
wat
Message 61781 - Posted: 9 Sep 2024, 1:51:46 UTC

...do we lose bonus turnaround credit because the upload server is locked up?
ID: 61781 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Erich56

Send message
Joined: 1 Jan 15
Posts: 1166
Credit: 12,260,898,501
RAC: 1
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwat
Message 61782 - Posted: 9 Sep 2024, 2:31:47 UTC - in response to Message 61781.  

...do we lose bonus turnaround credit because the upload server is locked up?

yes, at least in the past this has happened. I doubt this has changed now.
ID: 61782 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Erich56

Send message
Joined: 1 Jan 15
Posts: 1166
Credit: 12,260,898,501
RAC: 1
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwat
Message 61784 - Posted: 9 Sep 2024, 7:50:29 UTC - in response to Message 61734.  

On August 26 Steve wrote:
Thank you for reporting. It is now back and with more space.

Steve, now again no finished tasks can be uploaded since last night :-(

How come that this happens that often? Is there not any kind of automated reporting early enough (say, once the disk is 80% full), or other measures that prevent this problem to happen every few weeks ? This shouldn't be that difficult to implement.
ID: 61784 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
WPrion

Send message
Joined: 30 Apr 13
Posts: 106
Credit: 3,805,237,860
RAC: 65
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 61785 - Posted: 9 Sep 2024, 10:40:25 UTC - in response to Message 61784.  
Last modified: 9 Sep 2024, 10:41:04 UTC


How come that this happens that often? Is there not any kind of automated reporting early enough (say, once the disk is 80% full), or other measures that prevent this problem to happen every few weeks ? This shouldn't be that difficult to implement.


Kinda ironic. They are super anxious to get this project completed so they award 10X the points the tasks deserve, therefore attract an army of crunchers, but then don't keep their hardware up to speed to support the effort.
ID: 61785 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Steve Dodd

Send message
Joined: 26 Dec 08
Posts: 18
Credit: 4,614,833,506
RAC: 161
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 62014 - Posted: 13 Dec 2024, 21:33:34 UTC
Last modified: 13 Dec 2024, 21:34:11 UTC

Oopsie. Just got this message:

12/13/2024 1:29:04 PM | GPUGRID | [error] Error reported by file upload server: Server is out of disk space
ID: 62014 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Bedrich Hajek

Send message
Joined: 28 Mar 09
Posts: 490
Credit: 11,731,645,728
RAC: 69
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 62015 - Posted: 13 Dec 2024, 23:41:52 UTC - in response to Message 62014.  

I got the same message:

Fri 13 Dec 2024 06:38:59 PM EST | GPUGRID | [error] Error reported by file upload server: Server is out of disk space




ID: 62015 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Erich56

Send message
Joined: 1 Jan 15
Posts: 1166
Credit: 12,260,898,501
RAC: 1
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwat
Message 62016 - Posted: 14 Dec 2024, 5:38:04 UTC - in response to Message 62015.  

totally ununderstandable how this can happen so often.
Do they still have no precautions to prevent something like this? Should be easy enough
ID: 62016 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile dskagcommunity
Avatar

Send message
Joined: 28 Apr 11
Posts: 463
Credit: 958,266,958
RAC: 41
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 62017 - Posted: 14 Dec 2024, 11:50:37 UTC

After a long time im crunching a bit again and no Uploads since yesterday possible -.- Still the same problems like years before O.o
DSKAG Austria Research Team: http://www.research.dskag.at



ID: 62017 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
TheFiend

Send message
Joined: 26 Aug 11
Posts: 100
Credit: 2,863,609,686
RAC: 356
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 62018 - Posted: 14 Dec 2024, 14:19:38 UTC - in response to Message 62017.  

After a long time im crunching a bit again and no Uploads since yesterday possible -.- Still the same problems like years before O.o


I'm another one that has just restarted crunching GPUGRID again after upgrading GPU's.... It's not the only project that encounters this problem...
ID: 62018 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · 3 · Next

Message boards : Number crunching : Server is out of disk space

©2025 Universitat Pompeu Fabra