More CPU jobs

Message boards : News : More CPU jobs
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 . . . 7 · Next

AuthorMessage
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49795 - Posted: 6 Jul 2018, 10:51:26 UTC - in response to Message 49792.  

They are much larger molecules so they were crashing on the QM queue cause they ran out of scratch space. I have seen them use up to 18GB scratch space so at the moment I don't know yet how to run these on GPUGRID as it seems to be an issue with many users.

The most recent Betas have worked OK for me. But I have 32 GB memory, which may help.
http://www.gpugrid.net/results.php?hostid=334241&offset=0&show_names=0&state=0&appid=35

You could set up a special sub-project for the large molecules if you want to.

ID: 49795 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 49796 - Posted: 6 Jul 2018, 11:38:18 UTC - in response to Message 49795.  
Last modified: 6 Jul 2018, 11:40:14 UTC

We are using QC beta to test large molcules and how much disk space they take. I think they can (temporarily of course) go up to 20 GB of space (!). I am not sure about RAM - they should be < 4 GB.

We'll need to think whether to split the app in large and small.

Regarding conda: it's an "internal" installation. So no, you can't update, and you shouldn't. That message is unfortunate.

Best
ID: 49796 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
kain

Send message
Joined: 3 Sep 14
Posts: 152
Credit: 918,557,369
RAC: 23
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 49797 - Posted: 6 Jul 2018, 11:47:00 UTC - in response to Message 49796.  

We are using QC beta to test large molcules and how much disk space they take. I think they can (temporarily of course) go up to 20 GB of space (!). I am not sure about RAM - they should be < 4 GB.

We'll need to think whether to split the app in large and small.

Regarding conda: it's an "internal" installation. So no, you can't update, and you shouldn't. That message is unfortunate.

Best


Well... So my Threadripper could need up to 160GB of space?! It has just 32GB...
ID: 49797 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 49798 - Posted: 6 Jul 2018, 12:15:16 UTC - in response to Message 49797.  
Last modified: 6 Jul 2018, 12:16:05 UTC


Well... So my Threadripper could need up to 160GB of space?! It has just 32GB...


We are talking about DISK space. Only a few WUs will be that big - unless we make a "big" queue.

T
[/quote]
ID: 49798 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 10 Sep 10
Posts: 164
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49799 - Posted: 6 Jul 2018, 12:26:41 UTC - in response to Message 49784.  

As far as I know virtualization is almost native speed these days, especially for computing.


Yes, if you are using "hard" virtualization like Esx and Hyper-v.
"Soft" virtualization like VirtualBox or VmPlayer may suffer bottlenecks
ID: 49799 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
3de64piB5uZAS6SUNt1GFDU9dRhY
Avatar

Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49800 - Posted: 6 Jul 2018, 12:26:59 UTC - in response to Message 49796.  
Last modified: 6 Jul 2018, 12:27:24 UTC

We are using QC beta to test large molcules and how much disk space they take.


Toni, if I may ask you, what molecule size are we (roughly) talking about? As you know, because of my son I have personal interest in HCF1 research, and I would like to get a feel how far science is still away from handling that large molecules. Thanks in advance and my apologies for coming up with my personal issues once in a while.
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.
ID: 49800 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
tullio

Send message
Joined: 8 May 18
Posts: 190
Credit: 104,426,808
RAC: 0
Level
Cys
Scientific publications
wat
Message 49801 - Posted: 6 Jul 2018, 12:54:37 UTC

I have a degree in Theoretical physics obtained in 1967, but that was related to elementary particle physics. Then in the Nineties, while at Trieste Area Science Park as manager of a UNIX BULL Laboratory I attended a few lectures in the UN Center for Genetic Engineering and Biotechnology on the Density Functional Theory. Since retirement, I have run a few BOINC projects including one on Monte Carlo Method applied to Quantum Chemistry but it no longer exists. This is the first time I am running a project which uses Neural Networks.
Tullio
ID: 49801 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
kain

Send message
Joined: 3 Sep 14
Posts: 152
Credit: 918,557,369
RAC: 23
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 49802 - Posted: 6 Jul 2018, 13:35:39 UTC - in response to Message 49798.  


Well... So my Threadripper could need up to 160GB of space?! It has just 32GB...


We are talking about DISK space. Only a few WUs will be that big - unless we make a "big" queue.

T
[/quote]

I'm also talking about disk space. I'm using 32GB Optane module as boot drive. It's time to change it for something bigger.
ID: 49802 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 49804 - Posted: 6 Jul 2018, 15:25:04 UTC - in response to Message 49802.  

@kain: the disk space is used in the directory BOINC is running. Usually (if you use the distribution installers) it is the in the disk used at the root of the file system, indeed.
ID: 49804 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
STARBASEn
Avatar

Send message
Joined: 17 Feb 09
Posts: 91
Credit: 1,603,303,394
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwat
Message 49805 - Posted: 6 Jul 2018, 16:08:38 UTC

I had to enlarge the root partition to accommodate the QC beta 3.31 since boinc from the Fedora distro by default installs in /var/lib/boinc and runs as a daemon under systemctl. After that, the WU's seemed to run fine but they sure ate up a lot of RAM. Both my 8 core's have 16 GB RAM and I was running them 2 concurrent with 4 cores each. I think only two errored out and the rest completed and validated. Guess I'll have to max my 8 core machines with 32 GB RAM to run the bigger molecules.

Crunching since Feb 2003 (United Devices, Find-a-Drug)
ID: 49805 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 49806 - Posted: 6 Jul 2018, 18:35:16 UTC - in response to Message 49805.  

Are you able to set the disk limit in the boinc preferences to prevent too many WUs from running?
ID: 49806 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 11 Jul 09
Posts: 1639
Credit: 10,159,968,649
RAC: 351
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49807 - Posted: 6 Jul 2018, 18:39:35 UTC - in response to Message 49806.  

Easier and more precise simply to set max_concurrent in app_config.xml
ID: 49807 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 49808 - Posted: 6 Jul 2018, 18:52:39 UTC - in response to Message 49807.  
Last modified: 6 Jul 2018, 18:56:07 UTC

Great to know, thanks. Actually I was also wondering if boinc respects the disk limits .
ID: 49808 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 11 Jul 09
Posts: 1639
Credit: 10,159,968,649
RAC: 351
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49809 - Posted: 6 Jul 2018, 19:08:30 UTC - in response to Message 49808.  

Worth it to perform the experiment, certainly. Possibly depends whether it respects the declared space needed (<rsc_disk_bound>), or the actual space used. If the latter, there might be a problem if the actual usage increases gradually during the run - BOINC might only check it when deciding whether to start a(nother) new task. Lots of fun to be had with those possibilities...
ID: 49809 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
STARBASEn
Avatar

Send message
Joined: 17 Feb 09
Posts: 91
Credit: 1,603,303,394
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwat
Message 49810 - Posted: 6 Jul 2018, 19:41:46 UTC

@Toni, Yes boinc does appear to respect the client disk settings as it lets one know if disk space is too low to run certain projects in the event log. I usually set a high arbitrary GB size but the client appears to react to the real amount available in the execution partition and uses the percentage limits to notify user when disk space is too low. I had to readjust the percent limits higher (in the client settings) a few days ago to run the 3.30 app on one of my machines. Probably due to the project directory getting too full. I hate to reset the project and loose WU's but I suppose I will have to eventually.
ID: 49810 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
3de64piB5uZAS6SUNt1GFDU9dRhY
Avatar

Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49811 - Posted: 6 Jul 2018, 19:45:40 UTC - in response to Message 49800.  

We are using QC beta to test large molcules and how much disk space they take.


Toni, if I may ask you, what molecule size are we (roughly) talking about? As you know, because of my son I have personal interest in HCF1 research, and I would like to get a feel how far science is still away from handling that large molecules. Thanks in advance and my apologies for coming up with my personal issues once in a while.


I get it. Thank you so much for your help.
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.
ID: 49811 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 49812 - Posted: 6 Jul 2018, 22:09:26 UTC - in response to Message 49800.  
Last modified: 6 Jul 2018, 22:12:00 UTC


Toni, if I may ask you, what molecule size are we (roughly) talking about?


The molecules for QM are max 50 atoms or so. The size is however not very indicative. This is a specific "chemistry-oriented" type of calculations.
ID: 49812 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
3de64piB5uZAS6SUNt1GFDU9dRhY
Avatar

Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49813 - Posted: 6 Jul 2018, 22:49:31 UTC - in response to Message 49812.  


Toni, if I may ask you, what molecule size are we (roughly) talking about?


The molecules for QM are max 50 atoms or so. The size is however not very indicative. This is a specific "chemistry-oriented" type of calculations.


Thank you VERY much for that line, I really appreciate that. I was already afraid of being a constant bother. Of course I understand that we are still years or even decades away from handling huge proteins like HCF1 and I don't want to be obtrusive. Having said that, I would like to keep sight of those long term targets.

Thanks again... if I may, I will get back to you with this question in a couple of years. But I am glad that Gpugrid and its team is more than just being "exclusively academic". There actually is a vision of the future we can believe in.
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.
ID: 49813 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
tullio

Send message
Joined: 8 May 18
Posts: 190
Credit: 104,426,808
RAC: 0
Level
Cys
Scientific publications
wat
Message 49814 - Posted: 6 Jul 2018, 23:18:18 UTC

On an EDX online course on quantum computers which I followed recently there was a professor at Dartmouth University who uses a quantum computer to do quantum chemistry calculations.
Tullio
ID: 49814 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 49820 - Posted: 9 Jul 2018, 7:47:14 UTC - in response to Message 49813.  

Hey JoergF, while we are not doing proteins with QM yet, (some other groups are trying to do that with networks), what we are calculating is directly related to drug design so I think it is very relevant.
To do whole proteins at QM level accuracy I think will take quite a few more years.
ID: 49820 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 . . . 7 · Next

Message boards : News : More CPU jobs

©2025 Universitat Pompeu Fabra