New QC app

Message boards : Multicore CPUs : New QC app
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 7 · Next

AuthorMessage
STARBASEn
Avatar

Send message
Joined: 17 Feb 09
Posts: 91
Credit: 1,603,303,394
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwat
Message 50490 - Posted: 13 Sep 2018, 15:19:34 UTC - in response to Message 50485.  

Very good. I did sudo swapoff -a, and now swap shows as zero. We will see how it goes.


Remember when you reboot, you will have to use the command again unless you write a script and set it up to auto run at boot.

I have a GPU task and a CPU task running on my two cores Opteron 1210, 8 GB DDR2 RAM, GTX 750 Ti at 1202 MHz clock, 61 C. OS is SuSE Leap 42.3.Swap space is used at 37% of 2 GB. My HP Linux laptop, also running SuSE Leap 15.0 has a 7 GB swap space, not used.


How is your user latency (I define as delay between user requests and computer response)? One of my FX computers has been running QC jobs about 20 hours since a fresh reboot and already swap usage is at 4% (333 of 8047 MiB) and I am only using 3 threads of 8 available. I open boincmgr and it is taking up to 10 seconds to communicate to localhost. I am really suspecting this newer QC app is leaving some small percentage of dirty ram pages behind after completing the calc's and they add up over time to swap usage and user latency.
ID: 50490 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
tullio

Send message
Joined: 8 May 18
Posts: 190
Credit: 104,426,808
RAC: 0
Level
Cys
Scientific publications
wat
Message 50491 - Posted: 13 Sep 2018, 16:03:35 UTC - in response to Message 50490.  
Last modified: 13 Sep 2018, 16:24:42 UTC

I am using this computer to read my mail, to navigate the WWW, read the newspapers including the NYTimes which leaves me ten free articles/month and I feel no delay. I have a 30 Mbit/s mixed fiber/copper connection by Telecom Italy, which means the the fiber reaches a cabinet that is not far from my home, then I have a copper connection. My router is also connected by WiFi to a Windows 10 PC, a printer and a decoder which gives me SKY TV on the TV set which is also the monitor of the Windows PC. I just had a Microsoft update on the Windows 10 PC and it restarted with its two Einstein@home tasks.
Tullio
I have also a smartphone running Android 7.1.1 on its 8 cores 64ARM CPU, connected by WiFi to the router. It is running SETI@HOMe and Einstein@home CPU tsks.
ID: 50491 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 50492 - Posted: 13 Sep 2018, 17:24:36 UTC - in response to Message 50491.  

Concerning returning the memory when the WU is over: that's sure. The OS enforces that.

Concerning swapoff : I don't recommend that. A small amount of swap use is normal. If you remove this "safety valve", the only thing that will happen is that processes will just fail (often in confusing ways).

My suggestion is that you pay attention to your system's performance during heavy boinc use. If it becomes sluggish/irritating/unusable, swap use is probably going up -- you'll have to run fewer tasks simultaneously. Removing the swap will make the system kill them.

This said, QC tasks come in various sizes, so you may hit an "unfortunate" combination of large ones.

T[/quote]
ID: 50492 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 50493 - Posted: 13 Sep 2018, 17:43:26 UTC

Doesn't happen alot but i still am getting these occasionally that cause errors.


</stderr_txt>
<message>
finish file present too long
</message>
]]>
ID: 50493 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 50494 - Posted: 13 Sep 2018, 17:45:07 UTC - in response to Message 50493.  

General question to windows users: do you see "black windows" like a command prompt coming up when running QC apps?
ID: 50494 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keith Myers
Avatar

Send message
Joined: 13 Dec 17
Posts: 1424
Credit: 9,189,946,190
RAC: 0
Level
Tyr
Scientific publications
watwatwatwatwat
Message 50500 - Posted: 13 Sep 2018, 21:32:53 UTC - in response to Message 50493.  

Doesn't happen alot but i still am getting these occasionally that cause errors.


</stderr_txt>
<message>
finish file present too long
</message>
]]>

Those are my bane too. Nothing can be done about them. Normal feedback is to don't quit BOINC just as a task is finishing up. But it happens even when you never quit BOINC. It can happen for whatever reason that one task finishes up just as another project's task starts and BOINC takes too long to report the task. So the error.
ID: 50500 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
captainjack

Send message
Joined: 9 May 13
Posts: 171
Credit: 4,739,796,466
RAC: 1,182
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 50502 - Posted: 13 Sep 2018, 23:26:43 UTC
Last modified: 13 Sep 2018, 23:31:24 UTC

Toni asked:

General question to windows users: do you see "black windows" like a command prompt coming up when running QC apps?


Just started my first QC app on windows. About 1 minute after the task started, a "black window" flashed up on the display then immediately disappeared.


About 15 minutes after the task started, there is a "python" app listed in windows task manager that I assume is the QC app. It is using all available threads on a 16 thread system. In BOINC Manager, the task shows that it should be using "4 CPU's".


Let me know if you need more info.
ID: 50502 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 50505 - Posted: 14 Sep 2018, 10:42:17 UTC - in response to Message 50502.  
Last modified: 14 Sep 2018, 10:43:18 UTC

Toni asked:

General question to windows users: do you see "black windows" like a command prompt coming up when running QC apps?


Just started my first QC app on windows. About 1 minute after the task started, a "black window" flashed up on the display then immediately disappeared.


About 15 minutes after the task started, there is a "python" app listed in windows task manager that I assume is the QC app. It is using all available threads on a 16 thread system. In BOINC Manager, the task shows that it should be using "4 CPU's".


Let me know if you need more info.


Ok thanks. If the flashing is not annoying, I'd leave it as it is.

Regarding threads - the python app is indeed QC. Are you running multiple WUs simultaneously, or just one WU occupied all 16 threads?

Thanks a lot
ID: 50505 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
captainjack

Send message
Joined: 9 May 13
Posts: 171
Credit: 4,739,796,466
RAC: 1,182
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 50508 - Posted: 14 Sep 2018, 12:48:36 UTC

Toni asked:

Regarding threads - the python app is indeed QC. Are you running multiple WUs simultaneously, or just one WU occupied all 16 threads?

I was running 1 task that took all threads. I will try to get another task and run it when one becomes available.
ID: 50508 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
captainjack

Send message
Joined: 9 May 13
Posts: 171
Credit: 4,739,796,466
RAC: 1,182
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 50588 - Posted: 21 Sep 2018, 15:49:54 UTC

Just had 8 tasks error out with the following error code.

SafetyError: The package for hdf5 located at /var/lib/boinc-client/projects/www.gpugrid.net/miniconda/pkgs/hdf5-1.10.2-hba1933b_1
appears to be corrupted. The path 'lib/libhdf5.so.101.1.0'
has a sha256 mismatch.
reported sha256: d8628337423317dafe2d7f1f5029bfbb5cd22428fbf97e81678cc0db0e93c2c2
actual sha256: 6ef2e91ed97113943149adc62ad53c6d831db045c015176b13d3f7fd8f9e1c0f



I tried a reset on the project but that computer is now locked out for the rest of the day. Anything else I need to do?
ID: 50588 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51019 - Posted: 10 Dec 2018, 14:23:29 UTC

Looks like we have made headway on these work units. Just over a thousand left. Will be interesting to see if they bring back the other set.
ID: 51019 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51020 - Posted: 10 Dec 2018, 16:05:34 UTC - in response to Message 51019.  

Will be interesting to see if they bring back the other set.

I could use some longer ones, as long as the disc space problem is solved.
(I have 170 GB free, so it should not be a problem, though that remains to be seen.)
ID: 51020 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 51021 - Posted: 11 Dec 2018, 9:20:21 UTC

Sorry for running out. Give me some time. I'm at a conference so it's not super easy to spawn new work units right now but I'll give it a try.
ID: 51021 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 51022 - Posted: 11 Dec 2018, 11:36:17 UTC

Actually I think I will let them run out to not resubmit the same workunits again. I will send new ones out tomorrow or the day after.
ID: 51022 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51023 - Posted: 11 Dec 2018, 16:51:43 UTC - in response to Message 51022.  

No worries, it was more of a comment than a compliant. Enjoy your conference, we aren't going anyplace hahaha...
ID: 51023 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
kain

Send message
Joined: 3 Sep 14
Posts: 152
Credit: 927,557,369
RAC: 108
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 51024 - Posted: 11 Dec 2018, 18:08:20 UTC

Are you give us any comment about results of this batch? Was it usefull?
ID: 51024 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 51040 - Posted: 14 Dec 2018, 14:00:23 UTC

@kain The easy answer is "yes". This is a machine learning project so the more data you throw at it the better the predictor becomes. If you want to know if we solved the problem we set out to solve then the answer is "not totally yet" although we will publish something on it very soon.
ID: 51040 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 51170 - Posted: 1 Jan 2019, 10:51:03 UTC

I'm going to let the workunits run out again to make sure I don't recalculate them. In a few days I'll send out new ones.
ID: 51170 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Zalster
Avatar

Send message
Joined: 26 Feb 14
Posts: 211
Credit: 4,496,324,562
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 51171 - Posted: 1 Jan 2019, 14:58:07 UTC - in response to Message 51170.  

Ok, Thanks Stefan. Happy New Years
ID: 51171 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Stefan
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 51200 - Posted: 7 Jan 2019, 7:58:38 UTC

I everything goes smooth I ought to have the last workunits out by tomorrow, or latest the day after.
ID: 51200 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 7 · Next

Message boards : Multicore CPUs : New QC app

©2026 Universitat Pompeu Fabra