WU: OPM simulations

Message boards : News : WU: OPM simulations
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 . . . 10 · Next

AuthorMessage
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 43305 - Posted: 3 May 2016, 15:08:28 UTC
Last modified: 3 May 2016, 15:54:17 UTC

Hi everyone.
Once again after a few years I have decided to simulate ;)

This is for a new project where I try to automatically build and simulate hundreds of membrane proteins from the OPM database http://opm.phar.umich.edu/ as a proof of concept.
But I will also keep an eye out to see if something fancy happens in those simulations which I am quite sure it will.

Membrane proteins are very interesting in general as they are involved in many diseases and are simulated quite often. So building a protocol to simplify this process would help lots of biologists.

For the moment I sent out just 100 simulations as a quick test, but in the next few days I will send out around 3000 equilibrations.

Beware! The simulations are very very different, so there is no point in comparing them to each other. I have some systems which run on the short queue in an hour and some monstrous ones which run on long for 10 hours. The credits are scaled accordingly to simulation complexity so no one will be cheated of his hard earned credits :)

Also keep in mind that the first batch will be minimization/equilibration simulations, which start the minimization by using the CPU for maybe 1 minute and then should switch to GPU for the equilibration.

I might post here some pictures of the systems as well because some of these proteins are just gorgeous!

Edit: I made some gifs for you here ;)
http://imgur.com/a/YbjOd
ID: 43305 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Erich56

Send message
Joined: 1 Jan 15
Posts: 1166
Credit: 12,260,898,501
RAC: 960
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwat
Message 43307 - Posted: 3 May 2016, 16:51:47 UTC - in response to Message 43305.  


For the moment I sent out just 100 simulations as a quick test

ha, I was lucky to get 2 of them for crunching
ID: 43307 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Trotador

Send message
Joined: 25 Mar 12
Posts: 103
Credit: 14,948,929,771
RAC: 12,866
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 43308 - Posted: 3 May 2016, 18:43:54 UTC

Nice, impressive structures to simulate.

What specific aspects of the proteins will the simulation address?
ID: 43308 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 43311 - Posted: 4 May 2016, 8:59:47 UTC - in response to Message 43308.  

For the moment we are just looking if the automatical preparation can produce working simulations. Once the simulations are completed I will check for any big changes that happened (changes in protein structure, detachment from the membrane) and try to determine what caused those changes if possible.
ID: 43311 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 11 Jul 09
Posts: 1639
Credit: 10,159,968,649
RAC: 326,008
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 43319 - Posted: 6 May 2016, 10:15:03 UTC

I see tasks ready to send on the server status page :-)
ID: 43319 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 43328 - Posted: 9 May 2016, 8:36:44 UTC

I am sending them now. Please report any serious issues here.
I had to double the runtime of the simulations due to their tricky nature so now we have some which are quite long (up to 24 hours).

What we decided is that runs which are under 6 hours go to short with normal credits. Simulations with from 6-18 hours runtime get 2x normal credits. Simulations with 18-24 hours runtime get 4x normal credits since you will likely miss the day-return bonus.
ID: 43328 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Betting Slip

Send message
Joined: 5 Jan 09
Posts: 670
Credit: 2,498,095,550
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 43329 - Posted: 9 May 2016, 8:57:56 UTC - in response to Message 43328.  
Last modified: 9 May 2016, 9:15:46 UTC

OPM996 is classed as a Short Run but using 980ti seems it will take around 7 hours

Yet I have it on 2 other machines as a Long Run

Only completed 6% in 30 minutes at 61% GPU utilization
ID: 43329 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
frederikhk

Send message
Joined: 14 Apr 14
Posts: 8
Credit: 57,034,536
RAC: 0
Level
Thr
Scientific publications
watwatwatwatwatwat
Message 43330 - Posted: 9 May 2016, 9:19:32 UTC

Server Status calls it Short Run but in BOINC under Application it's Long Run. Got 2 already running fine.
ID: 43330 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Betting Slip

Send message
Joined: 5 Jan 09
Posts: 670
Credit: 2,498,095,550
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 43331 - Posted: 9 May 2016, 9:22:25 UTC - in response to Message 43330.  

On my 980ti it is running as short run and will take over 7 hours or longer to complete at current rate
ID: 43331 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 43332 - Posted: 9 May 2016, 9:54:06 UTC

The runs were tested on 780s. Simulations that run under 6 hours on a 780 are labeled as short.

Are you sure you are not running maybe two simulations on the 980s?
ID: 43332 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 43333 - Posted: 9 May 2016, 9:55:13 UTC
Last modified: 9 May 2016, 9:56:31 UTC

I am sending both short and long runs in this project as I mentioned. They are split accordingly depending on runtime.

OPM996 is the project code. If you want to ask me about a specific job please refer to the job name like 2id4R1 then I can tell you specifics about this protein simulation
ID: 43333 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Betting Slip

Send message
Joined: 5 Jan 09
Posts: 670
Credit: 2,498,095,550
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 43334 - Posted: 9 May 2016, 9:58:28 UTC - in response to Message 43332.  
Last modified: 9 May 2016, 10:00:04 UTC

No I am only running one at a time and it has only completed 15.57% after 1hr 11min on a 980ti utilization 60%

Projected time is increasing and it is running under short run app

2K1aR7
2K1aR5
ID: 43334 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 43336 - Posted: 9 May 2016, 10:09:42 UTC - in response to Message 43334.  

You got one of the edge cases apparently. 2k1a has exactly 6.0 hours projected runtime on my 780 so it got put in the short queue since my condition was >6 hours goes to long.
These simulations have a short (1 minute maybe) CPU minimization at the beginning so maybe this is throwing off the estimated completion time?
I am not totally sure.
ID: 43336 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Betting Slip

Send message
Joined: 5 Jan 09
Posts: 670
Credit: 2,498,095,550
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 43337 - Posted: 9 May 2016, 10:15:08 UTC - in response to Message 43336.  

Not working from what BOINC estimates but from real time and it will take betwen 7 to 8hrs

But never mind HeyHo
ID: 43337 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile skgiven
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,995,359,260
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 43338 - Posted: 9 May 2016, 17:24:29 UTC - in response to Message 43337.  
Last modified: 10 May 2016, 7:28:03 UTC

Boinc will estimate completion time based on the GFlops you put against the task, but if previous GFlops were not accurate the estimate will not be accurate.
You have 5M GFlops against these tasks.

I have 2 WU's running, one on each of my GTX970's.
My estimated run time is 32h based on 9% completion and almost 3h of runtime.

Most clocks are reasonable but the power is questionable on one card:
GPU0:
10% Power, 1291MHz/1304MHz, 7GHz GDDR5, MCU 40% (slightly high), Power 71% (P2 state), 1.131V, Temp 69C. CPU (i7-3770K) at ~75% usage.
GPU1:
59% GPU Power (MSI Afterburner), 69C, GPU Usage 75%, 1075MHz.

GPU memory usage is 1.287GB and 1.458GB (Quite big).
MY RAM and page file are quite big too (might be other apps though).

Don't see how the 1min of initial CPU usage would drastically effect the estimated runtime.

Will drop the CPU usage to ~60% and give it a spring clean before starting up to see if that improves things.
- update - that allowed the cards to run at slightly higher clocks (and normally) but it's now only looking like 31.5h. That might yet drop a few hours but these are still extra long tasks.
- update - still looking like about 31.5h (55% after 17h and 51% after ~16h).

2b5fR8-SDOERR_opm996-0-1-RND0199_0
2b5fR3-SDOERR_opm996-0-1-RND0810_0
FAQ's

HOW TO:
- Opt out of Beta Tests
- Ask for Help
ID: 43338 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Erich56

Send message
Joined: 1 Jan 15
Posts: 1166
Credit: 12,260,898,501
RAC: 960
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwat
Message 43341 - Posted: 9 May 2016, 20:10:05 UTC

On my GTX980Ti's, the former long runs were running about 20.000 seconds, yielding 255.000 points.

Today's 2dmgR0-SDOERR_opm996-0-1-RND3256_0 was running 39.000 seconds, yielding 247.050 points.

How come?
ID: 43341 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Bedrich Hajek

Send message
Joined: 28 Mar 09
Posts: 490
Credit: 11,731,645,728
RAC: 52,725
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 43342 - Posted: 9 May 2016, 21:39:49 UTC - in response to Message 43341.  

On my GTX980Ti's, the former long runs were running about 20.000 seconds, yielding 255.000 points.

Today's 2dmgR0-SDOERR_opm996-0-1-RND3256_0 was running 39.000 seconds, yielding 247.050 points.

How come?


This is what got:

2jp3R4-SDOERR_opm996-0-1-RND2694_0 11593350 9 May 2016 | 9:19:35 UTC 9 May 2016 | 21:02:28 UTC Completed and validated 40,147.05 39,779.98 205,350.00 Long runs (8-12 hours on fastest card) v8.48 (cuda65)

1cbrR7-SDOERR_opm996-0-1-RND5441_0 11593203 9 May 2016 | 9:19:35 UTC 9 May 2016 | 21:32:36 UTC Completed and validated 41,906.29 41,465.53 232,200.00 Long runs (8-12 hours on fastest card) v8.48 (cuda65)




ID: 43342 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Skyler Baker

Send message
Joined: 19 Feb 16
Posts: 19
Credit: 140,656,383
RAC: 0
Level
Cys
Scientific publications
wat
Message 43344 - Posted: 9 May 2016, 23:46:45 UTC

Yeah, they're pretty long, my 980ti is looking like it'll take about 20 hours at 70-75% usage. Don't mind the long run, I'm glad to have work to crunch, though I do hope the credit is equivalently good.
ID: 43344 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Erich56

Send message
Joined: 1 Jan 15
Posts: 1166
Credit: 12,260,898,501
RAC: 960
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwat
Message 43345 - Posted: 10 May 2016, 3:10:38 UTC - in response to Message 43344.  

... I'm glad to have work to crunch

me too :-)
ID: 43345 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
zioriga

Send message
Joined: 30 Oct 08
Posts: 47
Credit: 669,991,028
RAC: 157,210
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 43347 - Posted: 10 May 2016, 9:26:02 UTC

I crunched a WU lasting 18.1 hours for 203.850 credits on my GTX970.

This credit ratio is lower then previous "Long run" WUs

Previously I completed "Long run WUs" in 12 hours for 255.000 credits
ID: 43347 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · 3 · 4 . . . 10 · Next

Message boards : News : WU: OPM simulations

©2025 Universitat Pompeu Fabra