Advanced search

Message boards : Server and website : Oops - Long Queue is Empty

Author Message
tomba
Send message
Joined: 21 Feb 09
Posts: 497
Credit: 700,690,702
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 39242 - Posted: 21 Dec 2014 | 15:33:30 UTC

'nough said.

tomba
Send message
Joined: 21 Feb 09
Posts: 497
Credit: 700,690,702
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 39243 - Posted: 21 Dec 2014 | 15:38:10 UTC

Now the short queue died!!

tomba
Send message
Joined: 21 Feb 09
Posts: 497
Credit: 700,690,702
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 39244 - Posted: 21 Dec 2014 | 15:54:00 UTC

I see "Tasks ready to send 1,993".

Can someone please send 'em??

kain
Send message
Joined: 3 Sep 14
Posts: 152
Credit: 641,182,245
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 39245 - Posted: 21 Dec 2014 | 16:01:37 UTC - in response to Message 39244.

"Test application for CPU MD"

tomba
Send message
Joined: 21 Feb 09
Posts: 497
Credit: 700,690,702
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 39246 - Posted: 21 Dec 2014 | 16:16:03 UTC - in response to Message 39245.

"Test application for CPU MD"

Been doing that for months, but it does not usefully employ my expensive GPUs!

kain
Send message
Joined: 3 Sep 14
Posts: 152
Credit: 641,182,245
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 39247 - Posted: 21 Dec 2014 | 16:28:37 UTC - in response to Message 39246.

Exactly my point. There are no GPU work units ready to sent, only CPU ones.

Profile skgiven
Volunteer moderator
Volunteer tester
Avatar
Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,995,359,260
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 39281 - Posted: 23 Dec 2014 | 15:44:47 UTC - in response to Message 39247.
Last modified: 23 Dec 2014 | 15:46:00 UTC

Gerard - "We have fed GPUGRID with some new WU to keep you guys busy this Christmas".

GPU queue Unsent In Progress Short 497 264 Long 507 3,063


http://www.gpugrid.net/forum_thread.php?id=3956&nowrap=true#39279
____________
FAQ's

HOW TO:
- Opt out of Beta Tests
- Ask for Help

Profile Retvari Zoltan
Avatar
Send message
Joined: 20 Jan 09
Posts: 2343
Credit: 16,201,255,749
RAC: 573
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41600 - Posted: 1 Aug 2015 | 20:24:09 UTC
Last modified: 1 Aug 2015 | 20:29:38 UTC

My beasts are starving.
I had to feed them with short runs, but it's not to their taste.

Profile skgiven
Volunteer moderator
Volunteer tester
Avatar
Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,995,359,260
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41601 - Posted: 1 Aug 2015 | 21:48:36 UTC - in response to Message 41600.
Last modified: 1 Aug 2015 | 21:49:12 UTC

Thanks Zoltan,
I've emailed Gianni...
____________
FAQ's

HOW TO:
- Opt out of Beta Tests
- Ask for Help

Gerard
Send message
Joined: 26 Mar 14
Posts: 101
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 41608 - Posted: 2 Aug 2015 | 20:20:06 UTC

New WU should be available now!

John C MacAlister
Send message
Joined: 17 Feb 13
Posts: 181
Credit: 144,871,276
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwat
Message 41610 - Posted: 2 Aug 2015 | 22:02:51 UTC
Last modified: 2 Aug 2015 | 22:03:06 UTC

Good. Two shorts will finish soon........

[CSF] Thomas H.V. DUPONT
Send message
Joined: 20 Jul 14
Posts: 732
Credit: 105,130,366
RAC: 313,297
Level
Cys
Scientific publications
watwatwatwatwatwatwatwat
Message 41613 - Posted: 3 Aug 2015 | 8:11:40 UTC - in response to Message 41608.

New WU should be available now!

Thanks Gerard ! :)
____________
[CSF] Thomas H.V. Dupont
Founder of the team CRUNCHERS SANS FRONTIERES 2.0
www.crunchersansfrontieres

Profile ritterm
Avatar
Send message
Joined: 31 Jul 09
Posts: 88
Credit: 244,413,897
RAC: 0
Level
Leu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41853 - Posted: 20 Sep 2015 | 18:38:09 UTC

And, again... :-( (Short queue, too.)
____________

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41855 - Posted: 21 Sep 2015 | 5:48:31 UTC - in response to Message 41853.

This seems to happen on weekends.

Typically resolved on Monday's.

Not a big deal for folks with slower GPU's -- say 750ti and slower. But folks with much faster GPU's are likely in work unit starvation <smile>

Gerard
Send message
Joined: 26 Mar 14
Posts: 101
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 41856 - Posted: 21 Sep 2015 | 7:51:12 UTC - in response to Message 41853.

Reading this kind of "complaints" reminds me of what a wonderful community we built here.

I'm sending some new WU (WUID: PTCL_PLA2*, PTCL_LFE*). This time they are simulations of two proteins, lactoferrin and Phospholipase A2, and two well-known market drugs: ibuprofen and aspirin. Hopefully we'll be able to validate our method by correctly predicting binding affinities.

PTCL_LFE* is quite a big system and "harder" to crunch. I hope this satisfy your hunger ;)

Betting Slip
Send message
Joined: 5 Jan 09
Posts: 670
Credit: 2,498,095,550
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41857 - Posted: 21 Sep 2015 | 9:59:46 UTC - in response to Message 41856.

Reading this kind of "complaints" reminds me of what a wonderful community we built here.

I'm sending some new WU (WUID: PTCL_PLA2*, PTCL_LFE*). This time they are simulations of two proteins, lactoferrin and Phospholipase A2, and two well-known market drugs: ibuprofen and aspirin. Hopefully we'll be able to validate our method by correctly predicting binding affinities.

PTCL_LFE* is quite a big system and "harder" to crunch. I hope this satisfy your hunger ;)


Warning with PTCL WU.

You may find you get "system unstable" messages with OC's that work with other WU's so maybe a good idea to reduce OC if you get this in your output file.

Gerard
Send message
Joined: 26 Mar 14
Posts: 101
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 41858 - Posted: 21 Sep 2015 | 10:16:04 UTC - in response to Message 41857.

Let us know if you have any other problem or if with OC reduction you can fix stability. As always, new WU batches need a testing period.

sis651
Send message
Joined: 25 Nov 13
Posts: 66
Credit: 193,925,538
RAC: 0
Level
Ile
Scientific publications
watwatwatwatwatwatwatwatwat
Message 41865 - Posted: 21 Sep 2015 | 16:08:30 UTC

Please add some short runs into the queue too.

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41872 - Posted: 22 Sep 2015 | 18:05:38 UTC - in response to Message 41865.

I appears that the queue is empty again. This is rather unusual for midweek, especially on the heels of a weekend event of no work available.

Perhaps some explanation and forecast would be of value.

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41873 - Posted: 22 Sep 2015 | 18:50:05 UTC - in response to Message 41872.

The approach I use is pretty much this.


When there are no new units available, and I have been able to acquire a second unit behind my active work unit, I setup a secondary GPU project and them, with a short 'suspend' of GPUGrid, pull down about 12 to 24 hours of my secondary project.

U then pull the suspend off of GPUGrid so that it can return to processing and place the secondary GPU project into no new work.

Ideally GPUGrid is able to generate work within a day or so and take over as the primary project.

The other condition that drives me away (temporarily) from GPUGrid as a primary project is the problem with VERY SLOW uploads that seems to affect a couple of my workstations (all on the same network) intermittently. In those situations, I find it can take 10 to 18 hours simply to upload a result. That too drives those workstations into secondary GPU processing land.

For this second problem, I suspect there are some infrastructure issues at might site, (noisty switch for example), but the problem is amplified by the HUGE upload files that GPUGrid generates.

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41874 - Posted: 22 Sep 2015 | 18:50:07 UTC - in response to Message 41872.

The approach I use is pretty much this.


When there are no new units available, and I have been able to acquire a second unit behind my active work unit, I setup a secondary GPU project and them, with a short 'suspend' of GPUGrid, pull down about 12 to 24 hours of my secondary project.

U then pull the suspend off of GPUGrid so that it can return to processing and place the secondary GPU project into no new work.

Ideally GPUGrid is able to generate work within a day or so and take over as the primary project.

The other condition that drives me away (temporarily) from GPUGrid as a primary project is the problem with VERY SLOW uploads that seems to affect a couple of my workstations (all on the same network) intermittently. In those situations, I find it can take 10 to 18 hours simply to upload a result. That too drives those workstations into secondary GPU processing land.

For this second problem, I suspect there are some infrastructure issues at might site, (noisty switch for example), but the problem is amplified by the HUGE upload files that GPUGrid generates.

Profile Retvari Zoltan
Avatar
Send message
Joined: 20 Jan 09
Posts: 2343
Credit: 16,201,255,749
RAC: 573
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41875 - Posted: 22 Sep 2015 | 19:19:42 UTC - in response to Message 41874.

When there are no new units available, and I have been able to acquire a second unit behind my active work unit, I setup a secondary GPU project and them, with a short 'suspend' of GPUGrid, pull down about 12 to 24 hours of my secondary project.

U then pull the suspend off of GPUGrid so that it can return to processing and place the secondary GPU project into no new work.

I did the same in the past, but it's much easier to set the backup project's resource share to 0. In this case it would pull down work only when there's no work from any project which have resource share above 0.
My backup projects are Einstein@home, and seti@home.

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41877 - Posted: 22 Sep 2015 | 21:10:41 UTC - in response to Message 41875.

Yup -- similar approaches -- mine's a bit more hands on. My secondary project it MooWrap mosty. Could be Collatz -- that project has periodic issues of its own.

I resolved on of my upload lag issues by replacing a switch -- apparently a single port of that switch was 'noisy' and creating problems.

Gerard
Send message
Joined: 26 Mar 14
Posts: 101
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 41891 - Posted: 23 Sep 2015 | 8:20:20 UTC - in response to Message 41872.

I'm preparing a new batch of short WU, equilibrations should be ready to send by today. On the other hand, yesterday I sent new long WU but seems not to be enough to satiate the beast. Perfect! I'll prepare some new ones!

PD: remember that from each completed task a new task is regenerated and sent.

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41899 - Posted: 25 Sep 2015 | 5:58:33 UTC - in response to Message 41891.

Looks like the queues are empty again -- and it's only Thursday night....

Gerard
Send message
Joined: 26 Mar 14
Posts: 101
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 41901 - Posted: 25 Sep 2015 | 9:52:32 UTC - in response to Message 41899.

They are periodically getting refilled. Please be patient.

Long runs (8-12 hours on fastest card) 35 2,273 4.50 (1.06 - 17.87) 603

BarryAZ
Send message
Joined: 16 Apr 09
Posts: 163
Credit: 920,275,294
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 41908 - Posted: 26 Sep 2015 | 3:51:40 UTC - in response to Message 41901.

No problem -- I am patient <smile>

Hoping the queue gets refilled again.....

Gerard
Send message
Joined: 26 Mar 14
Posts: 101
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 41914 - Posted: 28 Sep 2015 | 12:47:48 UTC - in response to Message 41908.

Short queue refilled!

Post to thread

Message boards : Server and website : Oops - Long Queue is Empty

//