QC tests for windows

Message boards : Multicore CPUs : QC tests for windows
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · Next

AuthorMessage
[VENETO] boboviz

Send message
Joined: 10 Sep 10
Posts: 164
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 51395 - Posted: 28 Jan 2019, 17:22:11 UTC - in response to Message 51386.  

thanks for the thorough information, this helps us to understand what's going on.


+1. I didn't know the QC development situation.
Another solution is to open the QC code (if it is possible) to community.
TN-Grid, for example, had a lot of help from two volunteers that helped the team to introduce the sse/avx extensions
ID: 51395 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51396 - Posted: 28 Jan 2019, 18:13:28 UTC - in response to Message 51395.  

TN-Grid, for example, had a lot of help from two volunteers that helped the team to introduce the sse/avx extensions

I think on every project where I have seen sse/avx, etc. it has been the volunteers that do it. It takes special expertise. Also, there has been at least one project (POEM, if you remember it) where a volunteer did an outstanding job with an OpenCl app for GPUs, though I don't have his name at the moment. And a very capable developer has done both CUDA and OpenCl apps for XANSONS for COD.

If you ever visit Rosetta, you will quickly find out that rjs5 knows a whole lot about extensions and parallelism; I have seen him at Einstein too.
If you put out a call, they will come.
ID: 51396 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 10 Sep 10
Posts: 164
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 51401 - Posted: 29 Jan 2019, 7:40:24 UTC - in response to Message 51396.  

If you ever visit Rosetta, you will quickly find out that rjs5 knows a whole lot about extensions and parallelism;

I know Rjs5 (i chatted privately with him time ago).
He have a deep knowledge about c, c++ and optimizations.

If you put out a call, they will come.

I don't know. For example, in Rosetta, the developers seems to be not interested in optimizations. (and, also, they have restrictions on open the code).

ID: 51401 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 51402 - Posted: 29 Jan 2019, 11:38:21 UTC - in response to Message 51401.  

Actually the current beta QC version should not be too different from the final one. One common reason for failure is that the computations need huge temporary files. We can't make them need less space, but the disk limit will be raised (this occurred for the linux app too).

ID: 51402 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Erich56

Send message
Joined: 1 Jan 15
Posts: 1171
Credit: 12,662,148,501
RAC: 4,374
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwat
Message 51404 - Posted: 29 Jan 2019, 14:12:46 UTC - in response to Message 51402.  

I just got another test WU - and again, it failed with the
"196 (0xc4) EXIT_DISK_LIMIT_EXCEEDED" error:
http://gpugrid.net/result.php?resultid=20424952

So, obviously the disk limit was not raised enough :-(
ID: 51404 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51405 - Posted: 29 Jan 2019, 14:25:28 UTC - in response to Message 51402.  

Actually the current beta QC version should not be too different from the final one. One common reason for failure is that the computations need huge temporary files. We can't make them need less space, but the disk limit will be raised (this occurred for the linux app too).



Will these be released again for Linux? What was the limit raised to?

I installed 4TB HDD into 3 machines in anticipation of these tasks. Would like to see how they run.
ID: 51405 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51406 - Posted: 29 Jan 2019, 16:58:59 UTC - in response to Message 51405.  

I installed 4TB HDD into 3 machines in anticipation of these tasks. Would like to see how they run.

Me too. I am putting 500 GB on all my new machines (and some old ones too). If that isn't enough, I can do more.
ID: 51406 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Erich56

Send message
Joined: 1 Jan 15
Posts: 1171
Credit: 12,662,148,501
RAC: 4,374
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwat
Message 51407 - Posted: 29 Jan 2019, 17:44:11 UTC

How much disk space do the QC tasks actually need, on the average?
ID: 51407 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 51409 - Posted: 29 Jan 2019, 20:42:56 UTC - in response to Message 51395.  
Last modified: 29 Jan 2019, 20:43:09 UTC

@[VENETO] boboviz: The code is open source https://github.com/psi4/psi4/
ID: 51409 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
biodoc

Send message
Joined: 26 Aug 08
Posts: 183
Credit: 10,085,929,375
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51410 - Posted: 29 Jan 2019, 21:15:07 UTC - in response to Message 51407.  
Last modified: 29 Jan 2019, 21:18:43 UTC

I've got 2 linux machines running QC tasks.

My 40 thread machine is running 10 tasks at once with 4 threads per task. According to boinc, GPUGrid is using 18.8 GB of disk space.

My other machine is running 4 tasks simultaneously at 4 threads per task and that one is taking 9.19 GB of disk space.

The linux app (3.31) is running very smoothly these days. Kudos to Toni et al for fixing the bugs of the earlier versions.
ID: 51410 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 10 Sep 10
Posts: 164
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 51411 - Posted: 30 Jan 2019, 8:01:11 UTC - in response to Message 51409.  

@[VENETO] boboviz: The code is open source https://github.com/psi4/psi4/



Great!!!
ID: 51411 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Erich56

Send message
Joined: 1 Jan 15
Posts: 1171
Credit: 12,662,148,501
RAC: 4,374
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwat
Message 51572 - Posted: 25 Feb 2019, 11:51:20 UTC - in response to Message 51381.  

About a month ago, Stefan wrote:

We have stated this in the past but I'll explain it here again. GPUGRID is related to the lab. In the lab we don't have a C++ developer, they are all chemists, biologists and statisticians. Best bet would be me as a computer scientist but I've been busy with many other things recently. So the development of the Windows app has fallen on Raimondas who is very nice to do this as he works in a company (Acellera) which obviously has clients to take care of and does not have an immediate gain from making this work on GPUGRID and Toni who tests it out of personal interest. The current paper we are working on takes priority so once it is finished which is supposed to be this week Raimondas and Toni might finish up the app. According to their latest news the app works mostly fine now except lacking some optimization so it should not be too far off.
Patience please, we will make it.


My posting now is not to push or pester, just asking for information on the current status of the project.
Many thanks in advance -
ID: 51572 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PappaLitto

Send message
Joined: 21 Mar 16
Posts: 513
Credit: 4,673,458,277
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51573 - Posted: 25 Feb 2019, 11:56:09 UTC - in response to Message 51572.  

I highly doubt anything has changed as they still don't have a C++ developer. I would just lay low and let it happen when it happens.
ID: 51573 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 10 Sep 10
Posts: 164
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 51578 - Posted: 27 Feb 2019, 15:27:14 UTC - in response to Message 51573.  

I highly doubt anything has changed as they still don't have a C++ developer.


There is no student/graduate student/Phd/etc in University able to develop in C++?
I'll wait for windows app, in meantime i crunch with my linux vm
ID: 51578 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
captainjack

Send message
Joined: 9 May 13
Posts: 171
Credit: 4,739,796,466
RAC: 1,441
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51653 - Posted: 28 Mar 2019, 13:04:30 UTC

Got this error message on the current batch of QC test for Windows:

3/28/2019 7:47:29 AM | GPUGRID | Aborting task 1445r30-TONI_TST11-0-1-RND5643_0: exceeded disk limit: 44800.51MB > 28610.23MB
ID: 51653 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
captainjack

Send message
Joined: 9 May 13
Posts: 171
Credit: 4,739,796,466
RAC: 1,441
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51658 - Posted: 28 Mar 2019, 14:26:44 UTC

And another:

3/28/2019 9:07:38 AM | GPUGRID | Aborting task 1445r7-TONI_TST11-0-1-RND1466_0: exceeded disk limit: 44800.51MB > 28610.23MB

Please let us know when this is fixed and I will start up some more test tasks.
ID: 51658 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 51659 - Posted: 28 Mar 2019, 14:33:09 UTC - in response to Message 51658.  

For now it does not seem a widespread problem. Can you reset the project?
ID: 51659 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
captainjack

Send message
Joined: 9 May 13
Posts: 171
Credit: 4,739,796,466
RAC: 1,441
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51661 - Posted: 28 Mar 2019, 16:02:46 UTC

Did a project reset and started three more tasks. Two task finished successfully and the other aborted with:

3/28/2019 10:37:48 AM | GPUGRID | Aborting task 170r5-TONI_TST11-0-1-RND6393_2: exceeded disk limit: 34955.30MB > 28610.23MB


As a separate test, I tried the tasks on a different Windows PC number 489422. All four tasks aborted with the following message:

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 195 (0xc3)</message>
<stderr_txt>
10:28:17 (15156): wrapper (7.9.26016): starting
10:28:17 (15156): wrapper: running install_miniconda.bat ()
10:28:18 (15156): install_miniconda.bat exited; CPU time 0.000000
10:28:18 (15156): app exit status: 0x1
10:28:18 (15156): called boinc_finish(195)


I did a project reset and got the same result. Am I missing something?

ID: 51661 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 10 Sep 10
Posts: 164
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 51662 - Posted: 28 Mar 2019, 16:54:51 UTC - in response to Message 51659.  

Can you reset the project?


I try on a new machine (Intel Xeon and Windows 7)
All errors:
17:51:36 (6372): install_miniconda.bat exited; CPU time 40.357459
17:51:36 (6372): wrapper: running .\qmml3\python.exe (run.py)
Traceback (most recent call last):
File "C:\ProgramData\BOINC\slots\0\qmml3\lib\site-packages\psi4\__init__.py", line 55, in <module>
from . import core
ImportError: DLL load failed with error code -1073741795

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "run.py", line 14, in <module>
import psi4
File "C:\ProgramData\BOINC\slots\0\qmml3\lib\site-packages\psi4\__init__.py", line 60, in <module>
raise ImportError("{0}".format(err))
ImportError: DLL load failed with error code -1073741795
17:51:37 (6372): .\qmml3\python.exe exited; CPU time 0.000000
17:51:37 (6372): app exit status: 0x1
17:51:37 (6372): called boinc_finish(195)
ID: 51662 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 10 Sep 10
Posts: 164
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 51665 - Posted: 28 Mar 2019, 20:12:12 UTC - in response to Message 51662.  

I try on a new machine (Intel Xeon and Windows 7)
All errors:



That's strange. No errors on my other machine (other Xeon) with Win10 (1809 version) 64 bit.
ID: 51665 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · Next

Message boards : Multicore CPUs : QC tests for windows

©2026 Universitat Pompeu Fabra