New QC app

Message boards : Multicore CPUs : New QC app
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · Next

AuthorMessage
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51247 - Posted: 10 Jan 2019, 18:23:22 UTC
Last modified: 10 Jan 2019, 18:25:44 UTC

Each BOINC slot with a QC job is about 29 GB, so plan accordingly. I am running two now, which uses all eight cores and still leaves 29 GB free, so I think I am safe for now.
ID: 51247 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 51249 - Posted: 10 Jan 2019, 18:40:24 UTC - in response to Message 51247.  

Current test WUs are limited to 30GB, but many are failing because the limit is hit. I will need to raise the limit (the production QC app is 60 GB).
ID: 51249 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51251 - Posted: 10 Jan 2019, 19:09:13 UTC - in response to Message 51249.  

I will need to raise the limit (the production QC app is 60 GB).

I will put in a 256 GB SSD, but I have a 500 GB sitting on the shelf too. Let us know what you need.
ID: 51251 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ola

Send message
Joined: 8 Apr 18
Posts: 21
Credit: 1,309,700
RAC: 0
Level
Ala
Scientific publications
wat
Message 51252 - Posted: 10 Jan 2019, 19:14:02 UTC

Two tasks have "restarted" themself and started run from th beginning when they achieved about 40%. Just before it my CPU has heated suddenly to over 80 Celsius degrees, fortunately only for a moment.
ID: 51252 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jul 17
Posts: 404
Credit: 17,412,649,587
RAC: 32
Level
Trp
Scientific publications
watwatwat
Message 51254 - Posted: 10 Jan 2019, 21:26:37 UTC
Last modified: 10 Jan 2019, 21:36:53 UTC

The default BOINC settings for disk memory are far too low for your experiment. The RAM requirements are all over the map. You're sending these jobs to Xeons with 24 to 44 logical CPUs that can only run one or two at a time.

Why don't these WUs respect the client's resources??? E.g., if I have 16 GB RAM you'll start 5 or 6 WUs and consume all RAM and the computer freezes. If I have an app_config.xml set limiting QC or QC_beta to one WU (4C needs 16 GB RAM) then you want 60 GB of disk memory which is fine if I've set BOINC high enough.

Did you think this through before you launched this mayhem??? You should be able to tell us what these requirements are before launching. 4 GB per CPU thread per WU = 16 GB RAM is 4 times higher than Rosetta and by far the highest I've seen.

This is the first time in 5 hours I've been able to access this website.
ID: 51254 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51255 - Posted: 10 Jan 2019, 21:34:43 UTC - in response to Message 51254.  
Last modified: 10 Jan 2019, 21:39:01 UTC

The default BOINC settings for disk memory are far too low for your experiment.

Good point. I don't remember what the defaults are, but I always increase them anyway. They should probably create a sticky on how to set up BOINC for this project. Also, a sample app_config.xml file on how to limit the number of work units operating at a time would be helpful.

Some projects allow you to limit the number of work units downloaded at at time (and even the number of cores to be used per work unit) on their preferences page. That would be even easier.

I have trouble connecting here too. It seems to be a problem for everyone outside of Spain, but especially in the U.S.
ID: 51255 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PappaLitto

Send message
Joined: 21 Mar 16
Posts: 513
Credit: 4,673,458,277
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51256 - Posted: 10 Jan 2019, 21:39:44 UTC

My windows machine is doing QC WUs, is this supposed to happen?
ID: 51256 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
captainjack

Send message
Joined: 9 May 13
Posts: 171
Credit: 4,739,796,466
RAC: 1,182
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51258 - Posted: 10 Jan 2019, 22:47:08 UTC

PappaLito said:

My windows machine is doing QC WUs, is this supposed to happen?

Could be, I also have 2 running on a Windows machine.
ID: 51258 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51261 - Posted: 11 Jan 2019, 0:02:24 UTC

So about half are failing the other half are finishing. They are using all of the threads on my CPUs. I had a max concurrent in my app_config but I think these are a different name so that limitation is being ignored. I should have tried a <project_max_concurrent> but didn't have time to play with it to see if it would restrict the number running. Guess that will have to wait until Saturday when I can re-access those machines.
ID: 51261 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51263 - Posted: 11 Jan 2019, 1:46:23 UTC - in response to Message 51261.  
Last modified: 11 Jan 2019, 2:23:54 UTC

So about half are failing the other half are finishing. They are using all of the threads on my CPUs.

Even with a limit on the number of work units running, some of them will fail anyway with a "196 (0xc4) EXIT_DISK_LIMIT_EXCEEDED" error. They need more disk memory than they are allowed at the moment, as Toni mentioned below.
ID: 51263 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 51272 - Posted: 11 Jan 2019, 7:35:38 UTC
Last modified: 11 Jan 2019, 7:35:59 UTC

Sorry to hijack again this thread. I might make a new one but since I made here the original post: the current WUs I sent to the QC app (not the beta) should run fine. They are the same molecules as before. I changed my mind about submitting the other monsters, I'll try to run them on our local cluster first.
ID: 51272 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51273 - Posted: 11 Jan 2019, 9:48:32 UTC - in response to Message 51272.  

I changed my mind about submitting the other monsters, I'll try to run them on our local cluster first.

Well I was just about to put in a 500 GB SSD, but I will wait until you give us the heads up.
ID: 51273 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 10 Sep 10
Posts: 164
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 51278 - Posted: 11 Jan 2019, 14:26:06 UTC

After some times i restart my linux box and.... 226 mb of upload of a "Toni" quantum chemistry wu!!
Ouch
ID: 51278 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jul 17
Posts: 404
Credit: 17,412,649,587
RAC: 32
Level
Trp
Scientific publications
watwatwat
Message 51279 - Posted: 11 Jan 2019, 14:31:00 UTC

The QC per core RAM load has dropped. What's today's requirement???
ID: 51279 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
STE\/E

Send message
Joined: 18 Sep 08
Posts: 368
Credit: 4,174,624,885
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 51287 - Posted: 12 Jan 2019, 9:32:19 UTC
Last modified: 12 Jan 2019, 9:38:32 UTC

What are the requirements to receive Regular Non BETA QC Wu's ??? I have never received 1 even though I have been calling for them all along. I can get the BETA QC Wu's so one would think I should be able get the Regular QC Wu's. Running Windows 10 Pro with 64gb's Memory on a Intel i7 7770k CPU.

When my Box calls for Wu's I get this:

PBOYZTOYNP9873 13027 GPUGRID 1/12/2019 4:35:13 AM No tasks are available for Quantum Chemistry


Server Status shows Quantum Chemistry 125,158 Unsent ... Thanks
STE\/E
ID: 51287 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jul 17
Posts: 404
Credit: 17,412,649,587
RAC: 32
Level
Trp
Scientific publications
watwatwat
Message 51292 - Posted: 12 Jan 2019, 14:25:33 UTC

STEVE, Have you gone to BOINCmgr/Options/Computing Preferences/Disk and Memory??? The combination of those 3 checkboxes under Disk must yield over 60 GB of free disk space. May be 60 GB per QC WU.

In my case I was getting QCs but they seem to have stopped over night. No idea why.

How many months will it take to clear 125,000 WUs???
ID: 51292 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51293 - Posted: 12 Jan 2019, 14:44:26 UTC - in response to Message 51292.  
Last modified: 12 Jan 2019, 14:47:07 UTC

The combination of those 3 checkboxes under Disk must yield over 60 GB of free disk space. May be 60 GB per QC WU.

As I read Stefan's post, they have backed off from the large ones, and have gone back to the earlier ones.
So 30 GB (per work unit) should do; that is what I have been getting.
http://www.gpugrid.net/forum_thread.php?id=4785&nowrap=true#51272

It is entirely possible that they will go to the big ones (or even bigger) in the future, unless they can figure out how to break up the work into smaller pieces.
ID: 51293 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
STE\/E

Send message
Joined: 18 Sep 08
Posts: 368
Credit: 4,174,624,885
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 51294 - Posted: 12 Jan 2019, 15:00:59 UTC - in response to Message 51292.  
Last modified: 12 Jan 2019, 15:06:56 UTC

STEVE, Have you gone to BOINCmgr/Options/Computing Preferences/Disk and Memory??? The combination of those 3 checkboxes under Disk must yield over 60 GB of free disk space. May be 60 GB per QC WU.

In my case I was getting QCs but they seem to have stopped over night. No idea why.

How many months will it take to clear 125,000 WUs???


I have a 1 Terabyte HD that I run Boinc on, there is 878gb of free space on it, there should be more than enough space to run the Wu's.

Disk: use at most 750 GB
Disk: leave free at least 1 GB
Values smaller than 0.001 are ignored GB
Disk: use at most 100 % of total
Tasks checkpoint to disk at most every 60 seconds
Swap space: use at most 95% of total
Memory: when computer is in use, use at most 95% of total
Memory: when computer is not in use, use at most 98% of total
STE\/E
ID: 51294 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
captainjack

Send message
Joined: 9 May 13
Posts: 171
Credit: 4,739,796,466
RAC: 1,182
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51296 - Posted: 12 Jan 2019, 15:52:39 UTC

STEVE asked,

What are the requirements to receive Regular Non BETA QC Wu's ???

As far as I know, regular non BETA QC WU's are still Linux only. I am getting plenty on my Linux box, none on a Windows box.
ID: 51296 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
STE\/E

Send message
Joined: 18 Sep 08
Posts: 368
Credit: 4,174,624,885
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 51297 - Posted: 12 Jan 2019, 16:05:06 UTC - in response to Message 51296.  

STEVE asked,

What are the requirements to receive Regular Non BETA QC Wu's ???

As far as I know, regular non BETA QC WU's are still Linux only. I am getting plenty on my Linux box, none on a Windows box.


Yeah that's what I was afraid of, guess they don't need the Wu's run very fast if it's Linux only. Why would they test the BETA Wu's on Windows Machines but not run the Regular Wu's on them, weird ...

STE\/E
ID: 51297 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · Next

Message boards : Multicore CPUs : New QC app

©2026 Universitat Pompeu Fabra