New QC app

Message boards : Multicore CPUs : New QC app
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · Next

AuthorMessage
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51203 - Posted: 7 Jan 2019, 9:57:51 UTC - in response to Message 51200.  

I everything goes smooth I ought to have the last workunits out by tomorrow, or latest the day after.

No problem. We are ready when you are. But the term "the last" is ominous. Is it the end of the road for QC, or just for this experiment?
ID: 51203 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 51204 - Posted: 7 Jan 2019, 11:19:17 UTC - in response to Message 51203.  
Last modified: 7 Jan 2019, 11:19:26 UTC

No, I think there will be more in the future. But we will have to consider well what to run since the large molecules were a bit of a pain. Some molecule fragmentation might solve the issue. But there might be some downtime on QM jobs, hard to tell.
ID: 51204 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51209 - Posted: 7 Jan 2019, 17:51:58 UTC - in response to Message 51204.  

That is perfectly OK. It is much better for projects to tell us what is going on than to leave us hanging. You never know if they are dead or alive. At least you are alive.
ID: 51209 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 51214 - Posted: 8 Jan 2019, 12:55:02 UTC

So, seems like it will take 2 more days or so since other people are running stuff on the machine that calculates the workunits. It's a bit of a massive amount of data so bear with it a few more days
ID: 51214 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
3de64piB5uZAS6SUNt1GFDU9dRhY
Avatar

Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 51215 - Posted: 8 Jan 2019, 19:38:42 UTC - in response to Message 51214.  

which machine do you use for calculating the WU? Just in case some of us are willing to donate some money for hardware upgrades at your institute.
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.
ID: 51215 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 51219 - Posted: 9 Jan 2019, 7:42:20 UTC - in response to Message 51215.  

Although I love the support, I feel like it's an exercise in futility. Eventually all machines we have become overrun by one or more of our lab members. No machine is safe :D Even if I had one dedicated to myself I might use it for something else while not calculating WUs (would be a shame to have it idle) and then when we run out of WUs I would need to deal with the same issue. I guess we'll just have to wait one or two more days. It's roughly 80% done. Worst case if it's still not done in two days I'll talk with the lab member currently squeezing the living juices out of it to stop his jobs for a moment if possible.
ID: 51219 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jul 17
Posts: 404
Credit: 17,412,649,587
RAC: 32
Level
Trp
Scientific publications
watwatwat
Message 51220 - Posted: 9 Jan 2019, 17:26:02 UTC

Does QC still have a problem when multiple WUs start at the same time???

I loaded Rosetta jobs and watched them in System Monitor. They appeared to load one by one. The first CPU ramped up to 100% and then a minute or so later the second ramped up... I wonder if they have a solution they'd share.

I'm thinking of a script that could replicate that behavior.
QC WUs DL. The app_config.xml file could be iteratively modified:
<app>
    <name>QC</name>
    <max_concurrent>1</max_concurrent>
</app>

Wait a minute and change 1 to 2 and tell BOINC to Read Config files.
<app>
    <name>QC</name>
    <max_concurrent>2</max_concurrent>
</app>

Wait a minute and change 2 to 3 and tell BOINC to Read Config files.
Repeat until max desired WUs is reached.
Reset N to 1 in case of a reboot you restart one at a time.

E.g., I have a Xeon E5-2699 v4 with 22c/44t. I could conceivably run ten 4-CPU WUs and leave 4 threads for the GPUs.

When the next batch of QC WUs posts I'm going to babysit a computer and do this manually. I've never written a script so I'm reading book learning it now. If someone knows how to code this I'd be glad to test drive their script for them.
ID: 51220 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
captainjack

Send message
Joined: 9 May 13
Posts: 171
Credit: 4,739,796,466
RAC: 1,182
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51228 - Posted: 9 Jan 2019, 22:32:55 UTC

Aurum asked:

Does QC still have a problem when multiple WUs start at the same time???

Short answer is No. This was fixed several weeks ago.
ID: 51228 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jul 17
Posts: 404
Credit: 17,412,649,587
RAC: 32
Level
Trp
Scientific publications
watwatwat
Message 51229 - Posted: 9 Jan 2019, 23:39:06 UTC

Great. How much RAM do I need per QC WU???
Rosetta needs between 750 MB to 1 GB.
ID: 51229 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jul 17
Posts: 404
Credit: 17,412,649,587
RAC: 32
Level
Trp
Scientific publications
watwatwat
Message 51231 - Posted: 10 Jan 2019, 6:09:53 UTC

Is there an L3 Cache requirement for QC WUs???

E.g. at WCG the MIP project require 4-5s MB per WU. It runs with less but speed drops fast if overloaded.
ID: 51231 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 51232 - Posted: 10 Jan 2019, 7:38:08 UTC

Today I'll upload a new batch. I have no real clue on the technical requirements though. It will be try-and-see because these are some last large molecules I need to run. After these large ones I'll send some last small and fast ones again.
ID: 51232 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jul 17
Posts: 404
Credit: 17,412,649,587
RAC: 32
Level
Trp
Scientific publications
watwatwat
Message 51234 - Posted: 10 Jan 2019, 12:45:49 UTC
Last modified: 10 Jan 2019, 12:53:48 UTC

Wow! This is a major RAM hog. I just watched while 6 4C WUs consumed 16 GB and crashed a computer. Then another had 3 4C WUs running and it stopped one them as Suspended:Wating for memory, then a second one and third is still using 12 of 16 GB. Then they all 3 come back on and use all the memory. Then start failing for computation error.

We may need to reserve 3 GB per C, i.e. run only one 4C WU per 16 GB RAM.
So I'm adding this to my app_config:
<app>
    <name>QC_beta</name>
    <max_concurrent>1</max_concurrent>
</app>
<app_version>
    <app_name>QC_beta</app_name>
    <plan_class>mt</plan_class>
    <avg_ncpus>4</avg_ncpus>
    <cmdline>--fetch_minimal_work</cmdline>
</app_version>
ID: 51234 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51235 - Posted: 10 Jan 2019, 13:23:19 UTC - in response to Message 51232.  
Last modified: 10 Jan 2019, 13:23:56 UTC

I got two of them. One took 2.5 GB, and the other 3.5 GB. Send more. I need to use the 32 GB of memory on my i7-4770.
And longer ones are OK; these took only 12.75 minutes. I have no idea about disk usage though.
ID: 51235 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 51236 - Posted: 10 Jan 2019, 13:36:30 UTC - in response to Message 51235.  

Still beta WU for now. Disk usage may be large (and we can't tune it). Memory should be <4 GB per WU. Threads, up to 4, controlled by boinc. There will be more. Thanks!
ID: 51236 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PappaLitto

Send message
Joined: 21 Mar 16
Posts: 513
Credit: 4,673,458,277
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51237 - Posted: 10 Jan 2019, 13:56:14 UTC

I have some TONI WUs that have very low CPU usage and very low RAM usage.
ID: 51237 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PappaLitto

Send message
Joined: 21 Mar 16
Posts: 513
Credit: 4,673,458,277
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51238 - Posted: 10 Jan 2019, 15:11:19 UTC
Last modified: 10 Jan 2019, 15:15:01 UTC

Another thing I noticed is my GPU usage, normally at 100% running GPUGrid is now 5-15% and the CPU is not anywhere near 100% usage.

Update:

I just suspended and resumed the GPU WU and now it's back at 100% usage
ID: 51238 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51239 - Posted: 10 Jan 2019, 15:49:44 UTC - in response to Message 51232.  

Today I'll upload a new batch. I have no real clue on the technical requirements though. It will be try-and-see because these are some last large molecules I need to run. After these large ones I'll send some last small and fast ones again.


No joy with my computers in getting any work. Since they are remote I can't access them to request new work units. Shouldn't be an issue with 1 machine as it has 64GB ram and 4 TB hard drive. The other has 32 GB but also a 4 TB HDD. Just waiting to see if they get any work units to crunch.
ID: 51239 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51242 - Posted: 10 Jan 2019, 16:20:57 UTC - in response to Message 51239.  

No joy with my computers in getting any work.

Do you have "Run test applications?" selected in your preferences? I am getting them fairly regularly now.
ID: 51242 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jul 17
Posts: 404
Credit: 17,412,649,587
RAC: 32
Level
Trp
Scientific publications
watwatwat
Message 51243 - Posted: 10 Jan 2019, 16:49:12 UTC

Can you set it so that each Host gets one beta before a single Host gets 87 ???
ID: 51243 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51246 - Posted: 10 Jan 2019, 17:30:38 UTC - in response to Message 51242.  
Last modified: 10 Jan 2019, 17:31:01 UTC

No joy with my computers in getting any work.

Do you have "Run test applications?" selected in your preferences? I am getting them fairly regularly now.



Had the beta but not the "Run test applications" selected. Thanks for that. Made the change, will see if that works.
ID: 51246 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · Next

Message boards : Multicore CPUs : New QC app

©2026 Universitat Pompeu Fabra