Message boards :
Server and website :
Why are Downloads So Slow
Message board moderation
Previous · 1 · 2 · 3 · 4 · Next
| Author | Message |
|---|---|
Retvari ZoltanSend message Joined: 20 Jan 09 Posts: 2380 Credit: 16,897,957,044 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
The server status page is still loads halfway, then stops for a while, then completes. |
|
Send message Joined: 9 Dec 08 Posts: 1006 Credit: 5,068,599 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() |
We tweaked some web and db parameters, let's see if anything improves. |
BeyondSend message Joined: 23 Nov 08 Posts: 1112 Credit: 6,162,416,256 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
The server status page is still loads halfway, then stops for a while, then completes. Toni (re: Zoltan's post), the tweaks didn't help (sadly). Also, downloading WUs is the worst it's ever been. |
|
Send message Joined: 9 Dec 08 Posts: 1006 Credit: 5,068,599 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() |
Yes, those download speeds are hard to explain. It has become a long thread in the news. I am inclined to think that they are suffering from the same problem as before, probably not related to the server itself, now aggravated by the increased traffic due to 1 day of stop. T |
|
Send message Joined: 1 Jan 15 Posts: 1171 Credit: 12,662,148,501 RAC: 1,014,572 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
The server status page is still loads halfway, then stops for a while, then completes. any solution for this to be expected soon? |
|
Send message Joined: 30 Apr 13 Posts: 109 Credit: 3,977,737,860 RAC: 575,436 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
I've read many posts on this issue but I'm sure I've missed a lot, so my apologies in advance if this is a dumb or repeat question. Is the slow download issue experienced from within the GPUGRID local area network? I mean, don't the GPUGRID folks have some PCs/Workstations running BOINC/GPUGRID to crunch WUs? Are any of these PCs/Workstations connected directly to the same local area network of GPUGRID servers? If so, what do they experience re: download hangs?? Win |
|
Send message Joined: 28 Jul 12 Posts: 819 Credit: 1,591,285,971 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
Is the slow download issue experienced from within the GPUGRID local area network? The problem is not seen within Spain, but appears to be with their connections to the outside world, as Richard Haselgrove reports see #45570). http://www.gpugrid.net/forum_thread.php?id=4442&nowrap=true#45570 |
|
Send message Joined: 23 Dec 09 Posts: 189 Credit: 4,813,881,008 RAC: 42,053 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
Just like to inform, the problem with stalled downloads still exists for me after the server up-grade. |
skgivenSend message Joined: 23 Apr 09 Posts: 3968 Credit: 1,995,359,260 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Yes, those download speeds are hard to explain. It has become a long thread in the news. I am inclined to think that they are suffering from the same problem as before, probably not related to the server itself, now aggravated by the increased traffic due to 1 day of stop. Toni, did you upgrade the NAS storage as well, or just the server? FAQ's HOW TO: - Opt out of Beta Tests - Ask for Help |
BeyondSend message Joined: 23 Nov 08 Posts: 1112 Credit: 6,162,416,256 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
Yes, those download speeds are hard to explain. It has become a long thread in the news. I am inclined to think that they are suffering from the same problem as before, probably not related to the server itself, now aggravated by the increased traffic due to 1 day of stop. Now there's hardly any work moving up or down and the DL stalling is worse than its ever been. |
|
Send message Joined: 27 Nov 14 Posts: 1 Credit: 859,512,671 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
I haven't had any problems uploading the results to the server but downloads are the worst I have ever seen. Almost everyone is stalling, like the packet has been lost and it sits there waiting to time out. Most of the time it takes 3 or more retries before completing it. While trying to disable and then re-enable the network communications it took over a dozen times before one file was downloaded. Then the next file the same thing. I understand not having work units to process but the downloading problem, well that is another story. |
caffeineyellow5Send message Joined: 30 Jul 14 Posts: 225 Credit: 2,658,976,345 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
I think there is value looking into the "inside Spain vs outside Spain" angle. Many of these traceroutes have an increase in ping time starting when the connection gets from some ISP or backbone to the Spanish ISP or backbone. Also the user who reports no issues at all is the one inside Spain. I would be interested in seeing if the internal network computers running alpha, beta, regular, or testing units are seeing any issues like we are seeing. I would also be interested in seeing if any of the students or members of staff (etc) have PCs at home in Spain that could test the "inside Spain" theory for us outside of the local network. And perhaps it is the ISP within Spain that is just not good at the handoff to other ISPs through the backbones or some filtering method being used on the Spanish ISP networks for packet capture and analyzation. I would think that would more prevalent in places like Turkey, China, and Pakistan where it is a known issue that the government is tracking all the traffic in and out of the country to censor it, but maybe Spain has something in place that does something for some reason having this effect on our connections to the project??? I also do see different sounding reports from users within the same country, but on different ISPs or areas of that country. Some Comcast users in remote areas seeing increased issues than Comcast users in populated ares, but still reporting the issues are only with this project. I would wonder if some of those with the worst download and upload issues are also getting a greater number of failed tasks due to files that had dropped packets and seemed complete, but had some issue that caused the failures. I will try the traceroute and downloading that file in both Firefox and BitCommet to see if there is any difference, failures, or interruptive delays. One added thing I will add as an observation though is the increased reports of tasks that are listed for machines that do not have those tasks. I have one that has a delivery date of today on it to a computer that does not have that task on it. http://www.gpugrid.net/workunit.php?wuid=12186647 I wonder if this and the connection issue is also related, as a "tried to send" issue that one side (server) thinks it was sent and received while the other side (client) knows it got no such WU? 1 Corinthians 9:16 "For though I preach the gospel, I have nothing to glory of: for necessity is laid upon me; yea, woe is unto me, if I preach not the gospel!" Ephesians 6:18-20, please ;-) http://tbc-pa.org |
|
Send message Joined: 11 Nov 09 Posts: 27 Credit: 4,925,174 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]()
|
Everyone is saying it's the speed, but it's not my case in the US. I download fairly quickly....maybe 300KBps, then it totally stops after a few seconds. It's so bad that I can't even keep the work going. The downloads get exponentially longer retries then project backoff. Another question... Why can I connect to a speed test website in Barcelona to check my speed and download several Megs? Hmmm |
|
Send message Joined: 11 Nov 09 Posts: 27 Credit: 4,925,174 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]()
|
I think there is value looking into the "inside Spain vs outside Spain" angle. Many of these traceroutes have an increase in ping time starting when the connection gets from some ISP or backbone to the Spanish ISP or backbone. Also the user who reports no issues at all is the one inside Spain. I would be interested in seeing if the internal network computers running alpha, beta, regular, or testing units are seeing any issues like we are seeing. I would also be interested in seeing if any of the students or members of staff (etc) have PCs at home in Spain that could test the "inside Spain" theory for us outside of the local network. And perhaps it is the ISP within Spain that is just not good at the handoff to other ISPs through the backbones or some filtering method being used on the Spanish ISP networks for packet capture and analyzation. I would think that would more prevalent in places like Turkey, China, and Pakistan where it is a known issue that the government is tracking all the traffic in and out of the country to censor it, but maybe Spain has something in place that does something for some reason having this effect on our connections to the project??? Why is it that I can connect to the Speedtest.net server in Barcelona, a few of them, and get 8.7Mbps that takes several seconds to measure, so it must be a larger file than most I would get from the project server. My ping is 222ms. The test seems to go well without interruption. Is this testing anything relevant? |
BeyondSend message Joined: 23 Nov 08 Posts: 1112 Credit: 6,162,416,256 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
Everyone is saying it's the speed, but it's not my case in the US. I download fairly quickly....maybe 300KBps, then it totally stops after a few seconds. It's so bad that I can't even keep the work going. The downloads get exponentially longer retries then project backoff. Not sure who everyone is, but if they're saying that it's the speed they're wrong. It's not the speed. Personally I think the server is misconfigured. It's interesting that the stalling got much worse when the new server was installed. Hint, hint... The 3rd post in this thread has some tips that will help a little by reducing the timeout between retries and the transfer timeout: https://www.gpugrid.net/forum_thread.php?id=4373&nowrap=true#44374 Also, for those who have been saying it's due to high traffic volume. It's not. Even when there's hardly any work available (so barely any UL/DL going on) the stalling is just as bad when we do happen to receive a WU. And again: uploads are not affected, only downloads. |
|
Send message Joined: 30 Apr 13 Posts: 109 Credit: 3,977,737,860 RAC: 575,436 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
Jeebus! I have a download that is as of this writing stuck for 4.5 hours - and still clocking!! That's a record for me. Usually the stuck downloads clear out in not more than 1.5-2 hours. Win |
caffeineyellow5Send message Joined: 30 Jul 14 Posts: 225 Credit: 2,658,976,345 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
I have a download that is as of this writing stuck for 4.5 hours - and still clocking!! That's a record for me. Usually the stuck downloads clear out in not more than 1.5-2 hours. In the line <http_transfer_timeout></http_transfer_timeout>inside the cc_config.xml file which is located (on a Win7/8/10 machine) in the C:\ProgramData\BOINC folder, change the value to 60. That will decrease the amount of time before it determines a timeout, then will try a new connection continuing from the same point in the file. That SHOULD help some of the time length you are seeing there. 1 Corinthians 9:16 "For though I preach the gospel, I have nothing to glory of: for necessity is laid upon me; yea, woe is unto me, if I preach not the gospel!" Ephesians 6:18-20, please ;-) http://tbc-pa.org |
|
Send message Joined: 30 Apr 13 Posts: 109 Credit: 3,977,737,860 RAC: 575,436 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
I already have that parameter and it is set to 45. Would 60 be an improvement? While the first hang was in progress, a second WU came in and downloaded "normally", around an hour or so. The slow WU finished downloading after about 5 hours. OBTW - I now have something I haven't seen in a while - two long runs running concurrently ;-) Yaaaa!! Thanks |
caffeineyellow5Send message Joined: 30 Jul 14 Posts: 225 Credit: 2,658,976,345 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
I already have that parameter and it is set to 45. Would 60 be an improvement? From what I have read here, yes, it would be. Apparently anything under 60 has results that are rather unpredictable to counter-productive. 60 seconds is apparently the lowest amount you can enter that will actually be consistently accurate at its set amount. a second WU came in and downloaded "normally", around an hour or so. I am not sure I am reading that correctly. Are you saying that to download a WU it normally takes you an hour just to download it? My downloads are usually less than 5 minutes for a WU and that is with a 60 second hang or two on a file or two. Sometimes it can be as long as 7-10 minutes to download if there are several 60 second hangs. Uploads can take at most 20 minutes, but are usually around 10-12 minutes. If a download of a single WU took an hour for me, I would think there was something severely wrong with something. When the download is actually moving, what speed registers? I get between 300 and 1000 KBps. I find that the faster it registers, the more likely it is to hang. I once did an experiment by self regulating the speed at which BOINC can download to 250 KBps and it didn't hang on any WU downloads at all for that whole week. For the larger files, it was better to have them not hang, but for the smaller files, it ended up taking longer overall for the whole WU. But for an hour to download, that is quite over the top excessive according to my results in good and in bad connection times. So I hope I am reading it incorrectly and you are just saying that after an hour of the other one hanging excessively, this new one downloaded fast. Let us know. You may have other issues yet to be dealt with or maybe you are just on a dial up modem and we are expecting broadband results from everyone in this day and age. ??? |
|
Send message Joined: 30 Apr 13 Posts: 109 Credit: 3,977,737,860 RAC: 575,436 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
Sometimes they download as you described. Sometimes one file downloads continuously but very slowly - a few bytes at a time - for around an hour. Yesterday's 5 hour dl was a one-off. |
©2026 Universitat Pompeu Fabra