CPU jobs on Linux

Message boards : News : CPU jobs on Linux
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next

AuthorMessage
mmonnin

Send message
Joined: 2 Jul 16
Posts: 338
Credit: 7,987,341,558
RAC: 178,897
Level
Tyr
Scientific publications
watwatwatwatwat
Message 49504 - Posted: 19 May 2018, 3:07:28 UTC - in response to Message 49408.  

We are losing CPU Volunteers, can anyone help?


If admins want CPU support they'll make an app w/o bugs. No effort by them, no effort from us. They get paid, we pay for the PCs and we'd rather not have it aimlessly wasted.
ID: 49504 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 10 Sep 10
Posts: 163
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49514 - Posted: 21 May 2018, 12:17:04 UTC - in response to Message 49504.  

We are losing CPU Volunteers, can anyone help?


If admins want CPU support they'll make an app w/o bugs. No effort by them, no effort from us.


+1
ID: 49514 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49515 - Posted: 21 May 2018, 13:57:21 UTC - in response to Message 49504.  

I would put up with the bugs if I could. But I get only crashes on QC now, so I am out of business.

I hope they make a big announcement when it is fixed, since I won't know about it otherwise. Maybe they are spending their time on the Windows version?
ID: 49515 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
tullio

Send message
Joined: 8 May 18
Posts: 190
Credit: 104,426,808
RAC: 0
Level
Cys
Scientific publications
wat
Message 49516 - Posted: 21 May 2018, 14:03:43 UTC

Maybe they are more interested to the results of the CRUNCHATHLON competition. You can not compete with a dead horse.
Tullio
ID: 49516 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49517 - Posted: 21 May 2018, 14:10:03 UTC - in response to Message 49516.  

You can not compete with a dead horse.
Tullio

Not at the Palio either.
ID: 49517 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 49521 - Posted: 22 May 2018, 14:21:27 UTC - in response to Message 49517.  

Please see the Number Crunching forum.
ID: 49521 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ken_g6

Send message
Joined: 6 Aug 11
Posts: 8
Credit: 76,046,994
RAC: 0
Level
Thr
Scientific publications
watwatwatwatwatwat
Message 49578 - Posted: 1 Jun 2018, 0:37:05 UTC

Well, I gave QM a try, but I really didn't like it, for a few reasons.

First, the setup doesn't work when running more than one WU at a time. You need a "lock file" to ensure only one thread does the setup. If that thread gets aborted you might have problems, but it's better than the current situation.

Second, you know what I hate? I hate BOINC apps that download more data themselves. (Such as LHC@Home Atlas.) All necessary data should be coming from your BOINC server. At least your app only seems to do that downloading once.

Third, you know what else I hate? Bloated apps. Your "miniconda" includes such things as TK (not needed unless there's a screen saver?) and man pages. Maybe if you streamlined it you could fit whatever extra data it downloads in the initial download, and then you wouldn't need the networking libraries either.

But, I finally did get QM working. What made me give up on it was the credit. It started around 600 credits/WU, but it seemed to get cut in half every few sets of WUs. It was down around 50 when I gave up.
ID: 49578 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49579 - Posted: 1 Jun 2018, 0:43:40 UTC - in response to Message 49578.  

But, I finally did get QM working. What made me give up on it was the credit. It started around 600 credits/WU, but it seemed to get cut in half every few sets of WUs. It was down around 50 when I gave up.

I don't care about credits themselves, but I do wonder about the science that is being accomplished. If it is the same per work unit, that is OK, but if it is being cut in half periodically also, then that is a problem. I wonder what causes it?
ID: 49579 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PappaLitto

Send message
Joined: 21 Mar 16
Posts: 513
Credit: 4,673,458,277
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49580 - Posted: 1 Jun 2018, 11:27:36 UTC - in response to Message 49578.  
Last modified: 1 Jun 2018, 11:37:39 UTC

But, I finally did get QM working. What made me give up on it was the credit. It started around 600 credits/WU, but it seemed to get cut in half every few sets of WUs. It was down around 50 when I gave up.

The credits are down to around 50 right now because the Work Units are extremely short due to testing.

I'm not sure what everyone's fantasy is with credit. I personally couldn't care less as long as what I am doing is benefiting science. The credit itself is worth nothing so I'm not sure I get the point. I guess some people just need something more.
ID: 49580 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 49581 - Posted: 1 Jun 2018, 14:11:22 UTC
Last modified: 1 Jun 2018, 14:44:33 UTC

Indeed as papalito said these WUs are muuuuuch shorter than the 600 credits ones. They scale by computation time automatically. I miscalculated a bit yesterday how fast they are so we ran out but I'm going to submit more in an hour or so.

The downloading stuff I understand but we depend unfortunately on external software (psi4) so we cannot control everything. As you said it only downloads once. But yes conda is bloated in general but we kept it down to the bare minimum packages.

@Jim the WUs that I send contain varying molecules of different number of atoms. The ones I sent yesterday had very few atoms so they completed super fast. But "every molecule is sacred" as per Monty Python. I guess I could mix all molecules together but it would become an organizational chaos for me to keep track of what I have already calculated, so for now I will continue submitting them with increasing molecule size.
ID: 49581 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
klepel

Send message
Joined: 23 Dec 09
Posts: 189
Credit: 4,798,881,008
RAC: 311
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49582 - Posted: 1 Jun 2018, 14:55:59 UTC

Stefan, Can you reduce free disk-space requirement of 4768.37 MB to something like 4000MB or less? Your QM WUs do not fit on my USB 16 GB Stick anymore! (After Lubuntu Up-Grade from 17.10 to 18.04)
ID: 49582 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 49583 - Posted: 1 Jun 2018, 15:13:14 UTC - in response to Message 49582.  

Sorry klepel, I don't think I can :( Most of it is taken up by miniconda and the required software, not the workunits themselves.
ID: 49583 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49584 - Posted: 1 Jun 2018, 23:22:09 UTC - in response to Message 49581.  

@Jim the WUs that I send contain varying molecules of different number of atoms. The ones I sent yesterday had very few atoms so they completed super fast. But "every molecule is sacred" as per Monty Python. I guess I could mix all molecules together but it would become an organizational chaos for me to keep track of what I have already calculated, so for now I will continue submitting them with increasing molecule size.

No problem at all. Keep doing what you have to do.
ID: 49584 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PappaLitto

Send message
Joined: 21 Mar 16
Posts: 513
Credit: 4,673,458,277
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49585 - Posted: 3 Jun 2018, 1:24:25 UTC

@Stefan can you quickly describe for us what the Quantum Chemistry Work Units are doing and what you are learning from these work units?
ID: 49585 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 10 Sep 10
Posts: 163
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49587 - Posted: 3 Jun 2018, 9:30:46 UTC - in response to Message 49193.  


When can we expect some info about scientific results created with this app?


Months away, we have just started.



Some months have gone.
We are crunching for....? Cancer research? Any preliminary result?
Do you plan, togheter with windows app, also a gpu version?
ID: 49587 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 10 Sep 10
Posts: 163
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49588 - Posted: 3 Jun 2018, 9:31:53 UTC - in response to Message 49585.  

@Stefan can you quickly describe for us what the Quantum Chemistry Work Units are doing and what you are learning from these work units?


+1
ID: 49588 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
STARBASEn
Avatar

Send message
Joined: 17 Feb 09
Posts: 91
Credit: 1,603,303,394
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwat
Message 49589 - Posted: 3 Jun 2018, 17:41:19 UTC - in response to Message 49588.  

+ another 1. I have 7+7+3 cores 100% dedicated to QC and 4+4+4 cores 50% dedicated to QC and WCG, all 24/7. Along with 3 GTX 1060's, makes for a very warm office, especially now in summer. Would be interesting to find out what the project goals are :).
ID: 49589 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Retvari Zoltan
Avatar

Send message
Joined: 20 Jan 09
Posts: 2380
Credit: 16,897,957,044
RAC: 1
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49590 - Posted: 3 Jun 2018, 21:11:31 UTC - in response to Message 49585.  

@Stefan can you quickly describe for us what the Quantum Chemistry Work Units are doing and what you are learning from these work units?

See the "New Student and QMML Project" thread for a clue.
ID: 49590 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 10 Sep 10
Posts: 163
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49594 - Posted: 4 Jun 2018, 7:50:57 UTC - in response to Message 49590.  

@Stefan can you quickly describe for us what the Quantum Chemistry Work Units are doing and what you are learning from these work units?

See the "New Student and QMML Project" thread for a clue.


Really a "clue".
"We are simulating molecules". Ok, very precise :-P
ID: 49594 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 49595 - Posted: 4 Jun 2018, 13:11:08 UTC
Last modified: 4 Jun 2018, 13:23:27 UTC

Yeah sorry. I've developed a partially healthy paranoia over the last years due to some researchers being unhealthily competitive. In this case I'm trying to steer away from what others do to avoid problems but I'll be a bit vague anyway just to be safe.

Practically we are trying to teach a neural network to calculate molecular energies and forces. QM calculations are horribly slow and scale quadratically to the number of atoms. But a network trained on QM data is orders of magnitude faster, scales linearly with the numbers of atoms and achieves decently good accuracy. We believe these networks are the future for molecular simulations so we try to work with them and see what problems we can apply them to. At the moment they are still slower than usual MD simulations which we used to do but they should be much more accurate given enough training data. This training data is what is critical and what we are trying to produce currently.

Currently there are already three or so groups working on such networks and they have shown great results so we try to mostly collaborate with them to avoid duplication of effort and clash of research topics.
If you want to read up on some great projects that inspired us, check out ANI1 https://arxiv.org/abs/1610.08935 TensorMol https://arxiv.org/abs/1711.06385 DeepMD https://arxiv.org/abs/1712.03641

On applications to more biological research and implications to disease related research you will have to wait for my publication :)
ID: 49595 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next

Message boards : News : CPU jobs on Linux

©2025 Universitat Pompeu Fabra