New QC app

Message boards : Multicore CPUs : New QC app
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · Next

AuthorMessage
captainjack

Send message
Joined: 9 May 13
Posts: 171
Credit: 4,739,796,466
RAC: 1,182
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51298 - Posted: 12 Jan 2019, 16:44:13 UTC

STEVE,

I prefer this line of thinking, general business users usually run Windows, graphics artist and publishers usually run Macs, and scientists usually run Linux. Almost all of the top 500 super-computers in the world run on Linux. I'm guessing that most of the scientific research applications natively run on Linux. It was easier for the GPUGRID scientist to get the QC CPU app running on Linux PC's so that was the initial release.

They tried to get the QC CPU to run on Windows a few months ago using the Windows Subsystem for Linux (WSL) but ran into problems with inconsistency between Windows releases. This is their next attempt to get the QC app to run on Windows. Looks like this one might work when they get the parameters set up for the size of tasks involved.
ID: 51298 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51301 - Posted: 12 Jan 2019, 22:10:05 UTC

Well I tried to install a <project_max_concurrent> into the app_config but the beta work units just ignore that restriction. They were utilizing all 20 threads on the computer and starving the GPUs for resources. So I've stopped the beta for now on the machines. I have to rebuild a computer anyway this week so I think I will strip out the GPUs and leave the 16 thread CPU and install a 4 TB HDD. That should be enough I think for the beta work units and I will leave that machine only for those work units.
ID: 51301 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51302 - Posted: 12 Jan 2019, 22:45:39 UTC - in response to Message 51301.  

Well I tried to install a <project_max_concurrent> into the app_config but the beta work units just ignore that restriction.

You could try:
<app_config>
<app>
  <name>QC_beta</name>
  <max_concurrent>4</max_concurrent>
</app>
</app_config>


That has worked for me in the past.
ID: 51302 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[CSF] Aleksey Belkov

Send message
Joined: 26 Dec 13
Posts: 87
Credit: 1,292,358,731
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51303 - Posted: 12 Jan 2019, 23:07:37 UTC - in response to Message 51302.  

Jim1348 wrote:
That has worked for me in the past.

I tested yesterday Quantum Chemistry Beta for Windows and QC_beta app name works for limiting concurrent computing WUs.
ID: 51303 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jul 17
Posts: 404
Credit: 17,412,649,587
RAC: 32
Level
Trp
Scientific publications
watwatwat
Message 51306 - Posted: 13 Jan 2019, 13:20:42 UTC

Using <project_max_concurrent> is a problem since it counts all GG WUs. Also, they ran out of GPU WUs yesterday. The control of CPU & GPU projects should be completely separate.
<app_config>
<app>
    <name>acemdlong</name>
    <gpu_versions>
        <cpu_usage>1.0</cpu_usage>
        <gpu_usage>1.0</gpu_usage>
    </gpu_versions>
    <fraction_done_exact>1</fraction_done_exact>
</app>
<app>
    <name>acemdshort</name>
    <gpu_versions>
        <cpu_usage>1.0</cpu_usage>
        <gpu_usage>1.0</gpu_usage>
    </gpu_versions>
    <fraction_done_exact>1</fraction_done_exact>
</app>
<app>
    <name>QC</name>
    <max_concurrent>8</max_concurrent>
    <fraction_done_exact>1</fraction_done_exact>
</app>
<app_version>
    <app_name>QC</app_name>
    <plan_class>mt</plan_class>
    <avg_ncpus>4</avg_ncpus>
</app_version>
<app>
    <name>QC_beta</name>
    <max_concurrent>1</max_concurrent>
    <fraction_done_exact>1</fraction_done_exact>
</app>
<app_version>
    <app_name>QC_beta</app_name>
    <plan_class>mt</plan_class>
    <avg_ncpus>4</avg_ncpus>
</app_version>
</app_config>
ID: 51306 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51309 - Posted: 13 Jan 2019, 14:32:39 UTC - in response to Message 51302.  

Well I tried to install a <project_max_concurrent> into the app_config but the beta work units just ignore that restriction.

You could try:
<app_config>
<app>
  <name>QC_beta</name>
  <max_concurrent>4</max_concurrent>
</app>
</app_config>


That has worked for me in the past.


Thanks Jim, I'll give that a shot later this week when I get back to those computers. Since there doesn't appear to be any more beta at the moment. I"ll put that in the app_config for when and if those betas return.
ID: 51309 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ola

Send message
Joined: 8 Apr 18
Posts: 21
Credit: 1,309,700
RAC: 0
Level
Ala
Scientific publications
wat
Message 51312 - Posted: 13 Jan 2019, 22:16:34 UTC

Two tasks have been frozen at 1,098% despite they ahievied it very quickly. I dont't think the app is good, yet...
ID: 51312 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
STE\/E

Send message
Joined: 18 Sep 08
Posts: 368
Credit: 4,174,624,885
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 51316 - Posted: 14 Jan 2019, 9:58:27 UTC - in response to Message 51312.  

Two tasks have been frozen at 1,098% despite they ahievied it very quickly. I dont't think the app is good, yet...


None of the BETA Wu's freeze up on my Box but it's 50/50 whether they get a computation error or not, They all seem to run 30 Min's even if they get the computation error, some finish okay but show up as Invalid here at the site ...

STE\/E
ID: 51316 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 10 Sep 10
Posts: 164
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 51324 - Posted: 15 Jan 2019, 15:40:08 UTC - in response to Message 51312.  

Two tasks have been frozen at 1,098% despite they ahievied it very quickly. I dont't think the app is good, yet...


My "_TONI_" wus for linux stuck at 10% and time remaining continue to grow up
ID: 51324 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51382 - Posted: 27 Jan 2019, 2:39:20 UTC

Off to a rough start but think I got the kinks worked out. Got my 16 thread i7 on an Alphacool 360mm Radiator. 3 work units at a time with 4 threads, holding around 61-62C. Will see how it runs over the next 24 hours.
ID: 51382 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51464 - Posted: 11 Feb 2019, 16:26:57 UTC - in response to Message 51382.  

So this is the biggest one that I've crunched so far.


ID: 51464 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51481 - Posted: 13 Feb 2019, 16:28:51 UTC - in response to Message 51464.  
Last modified: 13 Feb 2019, 16:29:51 UTC

Starting to see lot of big ones lately but still none of those Giant one that we had a few months ago.

20239542 15931887 13 Feb 2019 | 4:52:27 UTC 13 Feb 2019 | 10:28:09 UTC

Completed and validated 5,123.56 19,627.41 1,235.32 Quantum Chemistry v3.31 (mt)
ID: 51481 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51482 - Posted: 13 Feb 2019, 17:08:41 UTC - in response to Message 51481.  

Starting to see lot of big ones lately but still none of those Giant one that we had a few months ago.

It is not as much fun working on the small ones. Maybe when they get the Windows app developed, they will have enough users that they can offer "small" and "large" work units, as defined by disk requirements (or even main memory).
ID: 51482 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
rbpeake

Send message
Joined: 30 Jul 08
Posts: 17
Credit: 80,343,188
RAC: 0
Level
Thr
Scientific publications
watwatwatwatwat
Message 51483 - Posted: 13 Feb 2019, 20:40:10 UTC - in response to Message 51482.  

Starting to see lot of big ones lately but still none of those Giant one that we had a few months ago.

It is not as much fun working on the small ones. Maybe when they get the Windows app developed, they will have enough users that they can offer "small" and "large" work units, as defined by disk requirements (or even main memory).


Are they working on a Windows app?

Thanks!
ID: 51483 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51484 - Posted: 13 Feb 2019, 23:01:28 UTC - in response to Message 51483.  

Are they working on a Windows app?

Very much so. I think they are making progress.
http://www.gpugrid.net/forum_thread.php?id=4790
ID: 51484 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Beyond
Avatar

Send message
Joined: 23 Nov 08
Posts: 1112
Credit: 6,162,416,256
RAC: 0
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51489 - Posted: 14 Feb 2019, 15:49:18 UTC - in response to Message 51249.  

Current test WUs are limited to 30GB, but many are failing because the limit is hit. I will need to raise the limit (the production QC app is 60 GB).

Wow, these things are going to be rough on SSD drive life. How large are the uploads and downloads?
ID: 51489 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51492 - Posted: 14 Feb 2019, 17:05:40 UTC - in response to Message 51489.  

Wow, these things are going to be rough on SSD drive life. How large are the uploads and downloads?

They have gone back to small ones. Running 11 of them on my i7-8770 (single core), my project folder is only 2.1 GB. It is no fun at all.
ID: 51492 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51493 - Posted: 14 Feb 2019, 17:51:12 UTC - in response to Message 51489.  

Current test WUs are limited to 30GB, but many are failing because the limit is hit. I will need to raise the limit (the production QC app is 60 GB).

Wow, these things are going to be rough on SSD drive life. How large are the uploads and downloads?



You could do like I did and install HDD. Those are fairly reasonable in price.Still have OS on the SSD but have BOINC installed on the HDD. Or if it's a new system, just install a HDD. I think I got 4 TB HDD for like $110 USD
ID: 51493 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
biodoc

Send message
Joined: 26 Aug 08
Posts: 183
Credit: 10,085,929,375
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51495 - Posted: 15 Feb 2019, 18:23:54 UTC

I've had a few "error while computing" for QC tasks on linux recently. I had 4 on Feb 14th and 3 on Feb 13th but none today yet.

<core_client_version>7.9.3</core_client_version>
<![CDATA[
<message>
process exited with code 195 (0xc3, -61)</message>
<stderr_txt>
17:04:03 (7591): wrapper (7.7.26016): starting
17:04:03 (7591): wrapper (7.7.26016): starting
17:04:03 (7591): wrapper: running /usr/bin/flock (/var/lib/boinc-client/projects/www.gpugrid.net/miniconda.lock -c "/bin/bash ./miniconda-installer.sh -b -u -p /var/lib/boinc-client/projects/www.gpugrid.net/miniconda &&
                      /var/lib/boinc-client/projects/www.gpugrid.net/miniconda/bin/conda install -m -y -p qmml3 --override-channels -c defaults  -c gpugrid  --file requirements.txt ")
Python 3.6.5 :: Anaconda, Inc.

# >>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<

`$ /var/lib/boinc-client/projects/www.gpugrid.net/miniconda/bin/conda install -m -y -p qmml3 --override-channels -c defaults -c gpugrid --file requirements.txt`

  environment variables:
                 CIO_TEST=<not set>
               CONDA_ROOT=/var/lib/boinc-client/projects/www.gpugrid.net/miniconda
                     PATH=/usr/bin:/bin
       REQUESTS_CA_BUNDLE=<not set>
            SSL_CERT_FILE=<not set>

     active environment : None
       user config file : /var/lib/boinc-client/.condarc
 populated config files : 
          conda version : 4.5.4
    conda-build version : not installed
         python version : 3.6.5.final.0
       base environment : /var/lib/boinc-client/projects/www.gpugrid.net/miniconda  (writable)
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/free/linux-64
                          https://repo.anaconda.com/pkgs/free/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
                          https://repo.anaconda.com/pkgs/pro/linux-64
                          https://repo.anaconda.com/pkgs/pro/noarch
                          https://conda.anaconda.org/gpugrid/linux-64
                          https://conda.anaconda.org/gpugrid/noarch
          package cache : /var/lib/boinc-client/projects/www.gpugrid.net/miniconda/pkgs
                          /var/lib/boinc-client/.conda/pkgs
       envs directories : /var/lib/boinc-client/projects/www.gpugrid.net/miniconda/envs
                          /var/lib/boinc-client/.conda/envs
               platform : linux-64
             user-agent : conda/4.5.4 requests/2.18.4 CPython/3.6.5 Linux/4.15.0-45-generic linuxmint/19.1 glibc/2.27
                UID:GID : 122:129
             netrc file : None
           offline mode : False


V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V

CondaHTTPError: HTTP 504 GATEWAY_TIMEOUT for url <https://conda.anaconda.org/gpugrid/linux-64/repodata.json>
Elapsed: 00:59.680897
CF-RAY: 4a92d5abb8af46f2-EWR

A remote server error occurred when trying to retrieve this URL.

A 500-type error (e.g. 500, 501, 502, 503, etc.) indicates the server failed to
fulfill a valid request.  The problem may be spurious, and will resolve itself if you
try your request again.  If the problem persists, consider notifying the maintainer
of the remote server.

A reportable application error has occurred. Conda has prepared the above report.
Upload successful.
17:06:11 (7591): /usr/bin/flock exited; CPU time 14.574405
17:06:11 (7591): app exit status: 0x1
17:06:11 (7591): called boinc_finish(195)

</stderr_txt>
]]>
ID: 51495 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51497 - Posted: 15 Feb 2019, 21:41:43 UTC - in response to Message 51495.  

Yeah I got a bunch of those as well. I think it's having an issue either downloading or connecting to get the required data. Doesn't happen often but when does, it usually results in numerous errors.
ID: 51497 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · Next

Message boards : Multicore CPUs : New QC app

©2026 Universitat Pompeu Fabra