Advanced search

Message boards : Server and website : Very slow uploads

Author Message
BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41636 - Posted: 9 Aug 2015 | 7:22:35 UTC

For the second time in the past few days, I'm encountering a work unit upload that is glacially slow. These are the 90M files taking hours to upload (and requiring a bit of hand holding to complete).

This second time is on a different workstation -- and I have not (yet) seen these '1400 baud rate' uploads on any other workstations.

I'm wondering if anyone else has seen this of late.

tomba
Send message
Joined: 21 Feb 09
Posts: 497
Credit: 700,690,702
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41644 - Posted: 10 Aug 2015 | 14:47:44 UTC - in response to Message 41636.

I have this problem regularly but, for me, it's always about my ADSL service.

I live 2.9 kms from the telephone exchange. The best upload speed I ever get is 16 KBps - 90 meg uploads take about two hours.

When everyone in the village is Netflix-ing it can take 10 hours to upload a 90 meg WU. :(

My fav speed tester is here. I just ran it:



It's enough to make a grown man cry !!

Profile Retvari Zoltan
Avatar
Send message
Joined: 20 Jan 09
Posts: 2343
Credit: 16,201,255,749
RAC: 6,169
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41645 - Posted: 10 Aug 2015 | 19:49:20 UTC - in response to Message 41644.
Last modified: 10 Aug 2015 | 19:49:59 UTC


Both speeds are very slow, but if you can download at 1.73Mbps surely your provider could give you more than 0.07Mbps upload bandwith.
Have you tried to ask them to change the ratio of your up&downstream?

tomba
Send message
Joined: 21 Feb 09
Posts: 497
Credit: 700,690,702
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41657 - Posted: 12 Aug 2015 | 15:26:15 UTC - in response to Message 41645.

Thanks for the response, Zoltan.

My provider is free.fr. They are dependent upon the good services of the copper owner: orange.fr.

I have asked Free to ask Orange to check my connection, given this:

• Numéro support : xxxxxxxxx
• NRA (commutateur local) : LA GARDE FREINET
• Distance vous séparant du central : 1940 m
• Débit ADSL (estimation) : 6 Mbps

• État de la ligne : Inconnue
• Code NRA : UBGO7
• Taux d'atténuation : 20,0 dB
• Débit ADSL2+ (estimation) : 13 Mbps

I have little confidence of any change in the short term...

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41687 - Posted: 21 Aug 2015 | 6:49:57 UTC

For me, the ping is 14 ms
Download speed is 10.3 Mbs
Upload speed is 1.01 Mbs

Which is what suggests to be there might be a periodic bottleneck at the other end.

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41745 - Posted: 5 Sep 2015 | 21:43:59 UTC
Last modified: 5 Sep 2015 | 22:40:02 UTC

Server upload problems resurfacing it seems

9/5/2015 2:45:19 PM | GPUGRID | Temporarily failed upload of e3s20_e2s12p1f108-GERARD_FXCXCL12_LIG_7249261-0-1-RND5350_1_9: transient HTTP error
9/5/2015 2:45:19 PM | GPUGRID | Backing off 05:16:08 on upload of e3s20_e2s12p1f108-GERARD_FXCXCL12_LIG_7249261-0-1-RND5350_1_9
9/5/2015 2:45:25 PM | GPUGRID | Started upload of e3s20_e2s12p1f108-GERARD_FXCXCL12_LIG_7249261-0-1-RND5350_1_9


What I am doing at this point is shifting the workstation to a project where uploads and downloads are processing.

This particular upload as been in process now for 6 hours.

I suspect that as encounter other GPUGrid 300 baud modem upload speeds on other workstations, I'll shift them over to functioning sites as well.

I notice this problem seems to surface on weekend....

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41746 - Posted: 5 Sep 2015 | 22:57:46 UTC - in response to Message 41636.
Last modified: 5 Sep 2015 | 22:59:59 UTC

OK-- Ihave now encountered a second pathetically slow upload unit on a different workstation. I suspect I will see this cascade over the weekend until the good folks back at GPUGRID and give the upload servers a proper scolding.

I'll simplt suspend processing as I encounter each virtually stalled upload and shift to a functioning project pending things being figured out back at the project.

Oh -- they are transient upload issues -- likely they are out of disk space -- sort of makes sense with the hyper large uploads each work unit requires

Profile Retvari Zoltan
Avatar
Send message
Joined: 20 Jan 09
Posts: 2343
Credit: 16,201,255,749
RAC: 6,169
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41747 - Posted: 5 Sep 2015 | 23:09:02 UTC
Last modified: 5 Sep 2015 | 23:21:48 UTC

One of my host is uploading a finished task right now, it doesn't have any upload issues, so your issue is not the GPUGrid server's fault, and it's definitely have not run out of space. Probably the connection between you and the project's servers is congested.
EDIT: http://www.gpugrid.net/result.php?resultid=14511514
EDIT2: You can try to set the BOINC manager to log the transfer and the http events by selecting options->Event log options (CTRL+Shift+F) in the BOINC manager (check the file_xfer_debug and http_xfer_debug checkboxes). Perhaps there will be some explanation of your upload errors.

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41748 - Posted: 5 Sep 2015 | 23:21:27 UTC - in response to Message 41747.

Interesting -- I wonder if GPGrid has multiple servers.

I'm not seeing the issues uploading from the same workstations to other projects.

Profile Retvari Zoltan
Avatar
Send message
Joined: 20 Jan 09
Posts: 2343
Credit: 16,201,255,749
RAC: 6,169
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41749 - Posted: 5 Sep 2015 | 23:24:23 UTC - in response to Message 41748.
Last modified: 5 Sep 2015 | 23:33:13 UTC

You can also try to open an elevated (administrative) command line, and type

PING www.gpugrid.org

or
TRACERT www.gpugrid.org

to see if there's some routing problems.

Edit: my ping time is 89ms.
Pinging www.gpugrid.net [193.146.190.61] with 32 bytes of data: Reply from 193.146.190.61: bytes=32 time=88ms TTL=50 Reply from 193.146.190.61: bytes=32 time=88ms TTL=50 Reply from 193.146.190.61: bytes=32 time=89ms TTL=50 Reply from 193.146.190.61: bytes=32 time=88ms TTL=50 Ping statistics for 193.146.190.61: Packets: Sent = 4, Received = 4, Lost = 0 (0% loss), Approximate round trip times in milli-seconds: Minimum = 88ms, Maximum = 89ms, Average = 88ms


I don't think GPUGrid has multiple servers, at least not for the task uploads from different regions.

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41757 - Posted: 7 Sep 2015 | 7:06:53 UTC - in response to Message 41749.

My ping results run times between 190ms and 400ms

So that is a piece of the slow upload issue. That, plus the huge upload files of 90Mb.


Typically the uploads *eventually* manage to complete -- after multiple automatic or manual retries over a 12 hour period.

That seems really slow.

I suppose now that the folks are going to change the '24 hour bonus' to 36 hours in part to compensate for the extermely slow upload cycles, it isn't all that bad.

One of the reasons that many other projects are not troubled by upload performance issues of course is that they don't have 100MB per result of uploads to handle.

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41758 - Posted: 7 Sep 2015 | 7:08:38 UTC - in response to Message 41757.

I'd note that some days appear more problematic than others -- this weekend it seems to be something of a plague though.

Betting Slip
Send message
Joined: 5 Jan 09
Posts: 670
Credit: 2,498,095,550
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41759 - Posted: 7 Sep 2015 | 9:22:55 UTC - in response to Message 41757.



I suppose now that the folks are going to change the '24 hour bonus' to 36 hours in part to compensate for the extermely slow upload cycles, it isn't all that bad.





Where did you hear/see that?

What type of internet connection have you got? Seems most of your computers upload at about 37 to 40 KB/s which is normal for an ADSL connection with an upload speed of 1Mb/s

Have you considered that 2 or more of your computers are uploading at the same time and saturating your upload bandwidth?

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41774 - Posted: 7 Sep 2015 | 17:17:34 UTC - in response to Message 41759.

Connection is cable modem -- in theory significantly faster than ADSL -- and it is with other upload targets (I'm running a batch of computers).

I suspect there might be something in the way of congestion when multiple uploads to GPU grid are going on at the same time -- though I'd note when that is happening it doesn't *appear* to affect other upload / download activity both within and outside of the 'BOINC universe'.

Then again, as I noted before, the size of the GPU Grid uploads is likely a major factor -- that, I suspect is pretty much a design issue, as I know of no other projects that go >10M for their upload files (there may be some out there).

As to the 36 hour versus 24 hour -- nope I've not heard anything about that -- just starting a rumor. <smile>

What IS rather curious is that the upload cycle frequently, not always, can take 20% to 30% of the processing cycle for 750ti systems. In its way, that is a disincentive to move to faster GPU's as the upload cycle would appear to be a fixed component and thus a larger proportion of the 'front to back' cycle for faster GPU's.

With 750ti's -- which often take just around 24 hours to process, the upload times push them out of the 24 hour 'bonus' often enough.

Richard Haselgrove
Send message
Joined: 11 Jul 09
Posts: 1576
Credit: 5,605,611,851
RAC: 8,696,535
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41792 - Posted: 9 Sep 2015 | 10:09:13 UTC - in response to Message 41774.

The last task I uploaded took under 4 minutes from start to finish:

09-Sep-2015 00:46:10 [GPUGRID] Computation for task e5s8_e1s11p1f89-GERARD_FXCXCL12_LIG_6152591-0-1-RND1800_2 finished
09-Sep-2015 00:46:13 [GPUGRID] Started upload of e5s8_e1s11p1f89-GERARD_FXCXCL12_LIG_6152591-0-1-RND1800_2_0
09-Sep-2015 00:46:20 [GPUGRID] Started upload of e5s8_e1s11p1f89-GERARD_FXCXCL12_LIG_6152591-0-1-RND1800_2_9
09-Sep-2015 00:50:03 [GPUGRID] Finished upload of e5s8_e1s11p1f89-GERARD_FXCXCL12_LIG_6152591-0-1-RND1800_2_9

I'm on a 'fibre to the cabinet' ADSL line with an upload speed of around 10 Mbit/sec, or very roughly 1 MB a second. The 70 MB _9 upload file took longer than 70 seconds, but was still accepted at a respectable speed: whatever's holding up your transfers doesn't seem to be the project server.

Killersocke
Send message
Joined: 18 Oct 13
Posts: 53
Credit: 406,647,419
RAC: 0
Level
Gln
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41793 - Posted: 9 Sep 2015 | 11:21:15 UTC - in response to Message 41792.

from germany i can also confirm to see that are no problems with up/down speed:

Ping wird ausgefuehrt fuer www.gpugrid.org [193.146.190.61] mit 32 Bytes Daten:
Antwort von 193.146.190.61: Bytes=32 Zeit=78ms TTL=48
Antwort von 193.146.190.61: Bytes=32 Zeit=95ms TTL=48
Antwort von 193.146.190.61: Bytes=32 Zeit=83ms TTL=48
Antwort von 193.146.190.61: Bytes=32 Zeit=81ms TTL=48

--------------

Routenverfolgung zu www.gpugrid.org [193.146.190.61]
ber maximal 30 Hops:

1 <1 ms <1 ms <1 ms fritz.box [192.168.178.1]
2 10 ms 9 ms 9 ms 83-169-169-118-isp.superkabel.de [83.169.169.118]
3 11 ms 15 ms 11 ms ip5886dcee.dynamic.kabel-deutschland.de [88.134.220.238]
4 20 ms 23 ms 22 ms ip5886caea.dynamic.kabel-deutschland.de [88.134.202.234]
5 28 ms 31 ms 28 ms ip5886ca0a.dynamic.kabel-deutschland.de [88.134.202.10]
6 35 ms 32 ms 28 ms ip5886caa3.dynamic.kabel-deutschland.de [88.134.202.163]
7 27 ms 29 ms 31 ms nl-sar.nordu.net [80.249.209.203]
8 34 ms 31 ms 31 ms uk-hex.nordu.net [109.105.102.97]
9 46 ms 39 ms 39 ms ndn-gw.mx1.lon.uk.geant.net [109.105.102.98]
10 46 ms 44 ms 45 ms ae0.mx1.par.fr.geant.net [62.40.98.77]
11 47 ms 51 ms 47 ms ae2.mx1.gen.ch.geant.net [62.40.98.153]
12 67 ms 65 ms 69 ms rediris-gw.mx1.gen.ch.geant.net [62.40.124.193]
13 69 ms 69 ms 69 ms TELMAD.AE4.uv.rt1.val.red.rediris.es [130.206.245.89]
14 85 ms 77 ms 80 ms anella-val2-router.red.rediris.es [130.206.211.74]
15 83 ms 83 ms 80 ms upf-imim-anella.cesca.cat [84.88.16.6]
16 83 ms 77 ms 79 ms 193.146.190.61

Ablaufverfolgung beendet.

Regards

tomba
Send message
Joined: 21 Feb 09
Posts: 497
Credit: 700,690,702
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41794 - Posted: 9 Sep 2015 | 14:55:08 UTC - in response to Message 41645.


Both speeds are very slow, but if you can download at 1.73Mbps surely your provider could give you more than 0.07Mbps upload bandwith.
Have you tried to ask them to change the ratio of your up&downstream?

I found my ISP's unadvertised latest and greatest! Signed up. Now downloads are 8 megs and uploads 1 meg. 90 meg GERARDs upload in about 12 minutes so I get full bonus on my 750Ti WUs.

I'm a happy bunny!

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41912 - Posted: 27 Sep 2015 | 19:33:04 UTC - in response to Message 41794.

I've now pretty much isolated the REALLY slow uploads to a single workstation in my collection.

I tried using a different port on the switch (as other workstations did not have this problem). No help there.

Then I tried using a USB / NIC adapter --- no help there either.

Next steps -- install a separate (rather than motherboard) NIC using a different chip set (I've some spare Intel PCI cards I can use). Further, I am considering replacing the existing 24 port switch with a new one I will have on hand this coming week. Perhaps this will solve the problem of uploads that often take (with time outs) 12 to 18 hours.

tomba
Send message
Joined: 21 Feb 09
Posts: 497
Credit: 700,690,702
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41915 - Posted: 28 Sep 2015 | 15:01:55 UTC - in response to Message 41645.


Both speeds are very slow, but if you can download at 1.73Mbps surely your provider could give you more than 0.07Mbps upload bandwith.
Have you tried to ask them to change the ratio of your up&downstream?

I did ask my ISP and they came up with an unadvertised service. I subscribed. Now I'm getting 8 Mbps download and up to 1 Mbps upload. The 90 meg Gerards now take 15 minutes to upload, which gives me full credit bonus on my 750Ti.

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41920 - Posted: 2 Oct 2015 | 0:26:01 UTC - in response to Message 41912.

So I seem to have resolved the very slow uploads.

Part of it was a balky switch. The other part was the embedded NIC on a motherboard. It was only one port on the switch (thankfully -- its a decent 24 port switch with two or three spare ports -- replacing it is a bit of an effort).

In a separate area, it was also a case of a poor switch (an 8 port cheapie). Replacing that switch with a good 16 port switch solved things there. I first swapped out to a low cost 16 port switch and the slow uploads remained.

I suspect the deal is decent jumbo packet support at the switch and the NIC.

Post to thread

Message boards : Server and website : Very slow uploads

//