"This computer has finished a daily quota of 32 tasks"

Message boards : Multicore CPUs : "This computer has finished a daily quota of 32 tasks"
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · Next

AuthorMessage
tullio

Send message
Joined: 8 May 18
Posts: 190
Credit: 104,426,808
RAC: 0
Level
Cys
Scientific publications
wat
Message 50711 - Posted: 18 Oct 2018, 13:11:31 UTC - in response to Message 50709.  

It seems also they give a correct progress figure, not the usual 10%.
Tullio
ID: 50711 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 50712 - Posted: 18 Oct 2018, 13:58:48 UTC - in response to Message 50711.  

It seems also they give a correct progress figure, not the usual 10%.
Tullio


Indeed progress is computed on the fraction of conformations computed.
ID: 50712 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
STARBASEn
Avatar

Send message
Joined: 17 Feb 09
Posts: 91
Credit: 1,603,303,394
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwat
Message 50713 - Posted: 18 Oct 2018, 17:54:43 UTC

Since I restarted QC, the QMML50 are running great. No memory or disk limits reached or exceeded. So far 32 in progress and 6 of 6 successful completions. They seem to do the 10% + 1.8% X 50 = 100%. Times so far are ranging a little less than 40 min to nearly two hours per WU with the longer completions on slower two thread at 2 GHz machines and the others running 4 threads at 4 GHz.
ID: 50713 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 50715 - Posted: 19 Oct 2018, 8:41:59 UTC
Last modified: 19 Oct 2018, 8:43:08 UTC

I mean, the larger problematic ones are obviously of more interest but I believe we should rethink the design of those large molecules and maybe try to break them down into their constituent components so that they don't take half a hard-drive to compute. It's not trivial but it seems like it's necessary if we want to keep running them on GPUGRID.
Thank you all in any case for hanging on through all the troubles of the large WUs.
ID: 50715 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 50716 - Posted: 19 Oct 2018, 13:59:14 UTC - in response to Message 50715.  

Thank you all in any case for hanging on through all the troubles of the large WUs.

As long as we know you are working on it, we will work on it.

A few people could do the large ones; SSDs are cheap these days, though if you need 1000 crunchers on them, then I think you are right you will need to break them down.
ID: 50716 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
3de64piB5uZAS6SUNt1GFDU9dRhY
Avatar

Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 50717 - Posted: 19 Oct 2018, 18:11:37 UTC - in response to Message 50715.  

I mean, the larger problematic ones are obviously of more interest but I believe we should rethink the design of those large molecules and maybe try to break them down into their constituent components


In case the larger ones are of more interest for you.. and therefore more valuable for science... I would be interested in them even so and upgrade my machines accordingly.

Maybe you could split QC into long and short runs like the GPU jobs? That would make it possible to choose.
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.
ID: 50717 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PappaLitto

Send message
Joined: 21 Mar 16
Posts: 513
Credit: 4,673,458,277
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 50718 - Posted: 19 Oct 2018, 19:26:03 UTC - in response to Message 50717.  

Maybe you could split QC into long and short runs like the GPU jobs? That would make it possible to choose.


+1
ID: 50718 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 50719 - Posted: 20 Oct 2018, 13:43:44 UTC - in response to Message 50715.  

I mean, the larger problematic ones are obviously of more interest but I believe we should rethink the design of those large molecules and maybe try to break them down into their constituent components so that they don't take half a hard-drive to compute. It's not trivial but it seems like it's necessary if we want to keep running them on GPUGRID.
Thank you all in any case for hanging on through all the troubles of the large WUs.


Yes I would also be interested in helping with the larger ones. How large of an SSDs are we talking about? 1, 2, 4 Terabytes?
ID: 50719 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 50720 - Posted: 20 Oct 2018, 13:57:17 UTC - in response to Message 50719.  

Yes I would also be interested in helping with the larger ones. How large of an SSDs are we talking about? 1, 2, 4 Terabytes?

I like people who think big.
ID: 50720 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 50722 - Posted: 20 Oct 2018, 16:14:51 UTC - in response to Message 50720.  

Well, not really SSD. HDD would be just fine. Right now scratch files are kept wherever BOINC's "slot" directory is (as expected from a well-behaved application).
ID: 50722 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
3de64piB5uZAS6SUNt1GFDU9dRhY
Avatar

Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 50723 - Posted: 20 Oct 2018, 16:53:53 UTC - in response to Message 50720.  
Last modified: 20 Oct 2018, 16:54:07 UTC

Yes I would also be interested in helping with the larger ones. How large of an SSDs are we talking about? 1, 2, 4 Terabytes?


+1

Would a 2TB HDD be enough?
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.
ID: 50723 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 50724 - Posted: 20 Oct 2018, 17:44:50 UTC - in response to Message 50722.  

Well, not really SSD. HDD would be just fine. Right now scratch files are kept wherever BOINC's "slot" directory is (as expected from a well-behaved application).


HDD cool. See amazon has a sale on WD Red 4TB NAS Hard Drive. Time to add onto the machine.
ID: 50724 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
AuxRx

Send message
Joined: 3 Jul 18
Posts: 22
Credit: 2,758,801
RAC: 0
Level
Ala
Scientific publications
wat
Message 50725 - Posted: 20 Oct 2018, 18:39:29 UTC - in response to Message 50723.  

Any SSD won't cut it. You'd need the expensive stuff with larger faster write buffers. Or use several HDDs (each on another connection, with several BOINC instances to spread the slots around). But really you should look into Optane, but it will cost a fortune.
ID: 50725 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
AuxRx

Send message
Joined: 3 Jul 18
Posts: 22
Credit: 2,758,801
RAC: 0
Level
Ala
Scientific publications
wat
Message 50726 - Posted: 20 Oct 2018, 18:58:23 UTC - in response to Message 50715.  

The argument that QMML has little value is disturbing to me. Either there is scientific justification or not. And please stick with a plan. All these abrupt changes make me question the research goal. I like to feel involved too, but the community shouldn't get to change course.

Further I fear splitting the project will just further complicate things for everyone.

And please always communicate upfront how your tasks will impact the volunteer's systems (with TBW, conda requests and so on). Volunteers should not have to find out themselves.
ID: 50726 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 50727 - Posted: 20 Oct 2018, 20:05:49 UTC - in response to Message 50725.  

Any SSD won't cut it. You'd need the expensive stuff with larger faster write buffers.

If you are referring to lifetime, I run three QC work units at a time (4 cores per WU) on an i7-8700. According to iostat, they are writing about 50 GB/day. That is not excessive; the SSD should last a normal lifetime.

As a matter of practice, I also use a write cache (12 GB size, 2 hour latency), though that is not really necessary to protect the SSD. But since I have 32 GB main memory, I like to use it.
ID: 50727 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
captainjack

Send message
Joined: 9 May 13
Posts: 171
Credit: 4,739,796,466
RAC: 1,182
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 50728 - Posted: 20 Oct 2018, 22:34:51 UTC

On Oct. 17, Stephan wrote:
"The new ones won't really require any disk space because they are smaller molecules."

BTW, the requirement for having 57,220.46 MB of disk space for the CPU tasks is still in effect. Does it need to be?
ID: 50728 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
tullio

Send message
Joined: 8 May 18
Posts: 190
Credit: 104,426,808
RAC: 0
Level
Cys
Scientific publications
wat
Message 50729 - Posted: 21 Oct 2018, 4:30:49 UTC

We are up to 74 Linux users. But recent QC tasks run well on my two Linux boxen. The one with a GTX 750 Ti GPU board is also running a GPU task alongside a CPU task. All this on an Opteron 1210 of 2008 vintage. But this SUN workstation is still my main host.
Tullio
ID: 50729 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 50731 - Posted: 21 Oct 2018, 18:15:32 UTC - in response to Message 50729.  
Last modified: 21 Oct 2018, 18:35:36 UTC

The one with a GTX 750 Ti GPU board is also running a GPU task alongside a CPU task.

I find that I can run a GTX 750 Ti without having to reserve a core for it on my i7-8700 without any noticeable affect on the QCs running on all 12 cores. It is the efficiency of CUDA, and the card shows only about 8 to 16% CPU core usage (or about 1% for the whole CPU).

It also works well for the i7-4770 machine when I use that, with somewhat higher CPU percentages. But it makes a great combination. And the 750 Ti gets all the work done in under 24 hours, while not expending much power.
ID: 50731 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 50737 - Posted: 25 Oct 2018, 18:32:37 UTC

So I have successfully installed and tested the new WD Red 4T NAS HDD into 2 of my computers. They are up are running again. So however the project decides to proceed with the larger molecules, I hope to be prepared.
ID: 50737 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Erich56

Send message
Joined: 1 Jan 15
Posts: 1171
Credit: 12,662,148,501
RAC: 3,588
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwat
Message 50738 - Posted: 26 Oct 2018, 5:25:49 UTC - in response to Message 50737.  

the project decides to proceed with the larger molecules, I hope to be prepared.

my hope is that some day, there will be a Windows version for the QC CPU tasks.
ID: 50738 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · Next

Message boards : Multicore CPUs : "This computer has finished a daily quota of 32 tasks"

©2026 Universitat Pompeu Fabra