Advanced search

Message boards : Graphics cards (GPUs) : 6.3.15 out

Author Message
JKuehl2
Send message
Joined: 18 Jul 08
Posts: 33
Credit: 3,233,174
RAC: 0
Level
Ala
Scientific publications
watwatwatwatwat
Message 3174 - Posted: 20 Oct 2008 | 18:23:03 UTC

Downloading and testing it right now. Anyone got the release change-notes?

Profile Krunchin-Keith [USA]
Avatar
Send message
Joined: 17 May 07
Posts: 512
Credit: 111,288,061
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 3175 - Posted: 20 Oct 2008 | 19:23:09 UTC - in response to Message 3174.

Downloading and testing it right now. Anyone got the release change-notes?

There are no release notes, because at this time it is not intended as a public release, it was for a private test of scheduler issues.

It has not been tested yet.

*** Use at your own risk ***

Profile The Gas Giant
Avatar
Send message
Joined: 20 Sep 08
Posts: 54
Credit: 607,157
RAC: 0
Level
Gly
Scientific publications
watwatwatwat
Message 3176 - Posted: 20 Oct 2008 | 19:33:59 UTC

I see it hasn't even been (officially) released to the alpha test group for testing.

Profile Krunchin-Keith [USA]
Avatar
Send message
Joined: 17 May 07
Posts: 512
Credit: 111,288,061
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 3180 - Posted: 20 Oct 2008 | 23:09:17 UTC

Checking my email when I got home, Here is part of the quote I got from the release manager about the 6.3.15 build.


I've posted 6.3.15 to ....
Please note, the hard drive on my computer is failing. I haven’t been able to test the build to know if it will even work.

You're lucky when blindly trying it that flames didn't come out of your system. You should wait for official word before trying versions that just show up on the download page, without release notes you have no idea why they are there.

I have begun testing and will be putting the scheduler through some testing over the next couple of days.

Again, at this time, try at your own risk.

Profile Kokomiko
Avatar
Send message
Joined: 18 Jul 08
Posts: 190
Credit: 24,093,690
RAC: 0
Level
Pro
Scientific publications
watwatwatwatwatwatwatwatwatwat
Message 3188 - Posted: 21 Oct 2008 | 7:03:35 UTC - in response to Message 3180.

... without release notes you have no idea why they are there.

... Again, at this time, try at your own risk.


Yes, we do at our own risk ;), and we found some information about the changes here at the end of the page:

http://boinc.berkeley.edu/svn/trunk/boinc/checkin_notes

____________

Profile Wassertropfen
Avatar
Send message
Joined: 14 Aug 08
Posts: 15
Credit: 13,774,919
RAC: 0
Level
Pro
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 3196 - Posted: 21 Oct 2008 | 15:26:46 UTC

new between 6.3.14 and 6.3.15

- MGR: To reduce flicker, redraw only changed cells in List Control
- client: new config flags
<network_test_url>: where to go to see if network is up
<client_version_check_url>: where to get list of client versions
<client_download_url>: where to direct user to get new version
- manager: some different text for WCG version
- Taskbar icon on crash gefixed
____________
Constant dripping wears away the stone. :)

Profile Stefan Ledwina
Avatar
Send message
Joined: 16 Jul 07
Posts: 464
Credit: 288,617,006
RAC: 1,969,263
Level
Asn
Scientific publications
watwatwatwatwatwatwatwat
Message 3197 - Posted: 21 Oct 2008 | 17:06:47 UTC
Last modified: 21 Oct 2008 | 17:08:58 UTC

I just tried 6.3.15, but the scheduler is still buggy...
After an hour or so, I had only 2 CPU tasks and one GPUGRID task running on my Vista64 Quad. So I'm back to 6.3.14 which works better than .10 on my PC.

When I reinstalled 6.3.14 I got an error message after the installation -

Internal error 2753. boincmgr.exe

A reboot fixed that...
____________

pixelicious.at - my little photoblog

Profile Krunchin-Keith [USA]
Avatar
Send message
Joined: 17 May 07
Posts: 512
Credit: 111,288,061
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 3200 - Posted: 21 Oct 2008 | 17:41:07 UTC - in response to Message 3197.

I just tried 6.3.15, but the scheduler is still buggy...
After an hour or so, I had only 2 CPU tasks and one GPUGRID task running on my Vista64 Quad.

Thats odd.

Do you have any cpu limit set in preferences or were you using debug option ncpus+1 ?

It may have to do with resource shares, but certainly you should have ended up with four CPU tasks, not two. I'm not real clear on how resource shares affect current clients for GPU work, but I'm under the impression CUDA tasks should always run as 'high priority' outside of resource shares to always keep GPU busy, that is if work is avaialble. Can you reproduce with debug information, that would be useful to Anderson ?

I have had no problems, but then again I have no quad core, only HT's. Scheduler has performed well (99.99%) in all my tests, including running both types of GPU work from both projects, public and alpha test. It always runs the correct number of other tasks and keeps the GPU busy as well as CPUs.

I'll try later tonight to simulate a quad core and see what happens for me.

Rabinovitch
Avatar
Send message
Joined: 25 Aug 08
Posts: 143
Credit: 64,937,578
RAC: 0
Level
Thr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwat
Message 3201 - Posted: 21 Oct 2008 | 17:45:41 UTC

So, it's working... It's honestly says, that my PS3GRID's WU is working using "1.00 CPUs, 1 CUDA". But I still waiting for BOINC Manager version which will allow me to run 2 CPU tasks and 1 GPU task.....

ExtraTerrestrial Apes
Volunteer moderator
Volunteer tester
Avatar
Send message
Joined: 17 Aug 08
Posts: 2705
Credit: 1,311,122,549
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 3203 - Posted: 21 Oct 2008 | 17:56:18 UTC - in response to Message 3201.

So, it's working... It's honestly says, that my PS3GRID's WU is working using "1.00 CPUs, 1 CUDA". But I still waiting for BOINC Manager version which will allow me to run 2 CPU tasks and 1 GPU task.....


This information was introduced in 6.3.14

And currently you'd loose much more performance / credits if you went for 2 CPU + 1 GPU instead of 1 + 1, especially with your GTX 260 and an X2 5200. It's an issue of the windows scheduler, which makes it really hard to fix.

MrS
____________
Scanning for our furry friends since Jan 2002

Sherman H.
Send message
Joined: 28 Sep 08
Posts: 27
Credit: 6,201,632,872
RAC: 0
Level
Tyr
Scientific publications
watwatwatwat
Message 3204 - Posted: 21 Oct 2008 | 17:58:47 UTC - in response to Message 3200.

...but I'm under the impression CUDA tasks should always run as 'high priority' outside of resource shares to always keep GPU busy, that is if work is avaialble.


On my 6.3.14 client this is certainly not true. I have seen CUDA tasks stopped in favour of CPU tasks (I run ncpus+1), on both quad and dual core machines when I had GPUGrid's resource share at a level that corresponds to 1 CPU core. As well, when I don't have excess amount of work from other projects cached, CUDA tasks run at "normal priority" within BOINC.

ExtraTerrestrial Apes
Volunteer moderator
Volunteer tester
Avatar
Send message
Joined: 17 Aug 08
Posts: 2705
Credit: 1,311,122,549
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 3205 - Posted: 21 Oct 2008 | 18:18:37 UTC - in response to Message 3204.

I think Keith is talking about a different high-priority mode than the deadline-realted one which BOINC tells you about. The BOINC scheduler should keep all co-processors busy before it starts to populate the CPUs with regular jobs.

MrS
____________
Scanning for our furry friends since Jan 2002

Profile Stefan Ledwina
Avatar
Send message
Joined: 16 Jul 07
Posts: 464
Credit: 288,617,006
RAC: 1,969,263
Level
Asn
Scientific publications
watwatwatwatwatwatwatwat
Message 3206 - Posted: 21 Oct 2008 | 18:54:14 UTC - in response to Message 3200.

I just tried 6.3.15, but the scheduler is still buggy...
After an hour or so, I had only 2 CPU tasks and one GPUGRID task running on my Vista64 Quad.

Thats odd.

Do you have any cpu limit set in preferences or were you using debug option ncpus+1 ?

It may have to do with resource shares, but certainly you should have ended up with four CPU tasks, not two. I'm not real clear on how resource shares affect current clients for GPU work, but I'm under the impression CUDA tasks should always run as 'high priority' outside of resource shares to always keep GPU busy, that is if work is avaialble. Can you reproduce with debug information, that would be useful to Anderson ?

I have had no problems, but then again I have no quad core, only HT's. Scheduler has performed well (99.99%) in all my tests, including running both types of GPU work from both projects, public and alpha test. It always runs the correct number of other tasks and keeps the GPU busy as well as CPUs.

I'll try later tonight to simulate a quad core and see what happens for me.


Nope... I haven't set a CPU limit, and I don't use ncpus+1 on the Vista machine.
Actually I don't think it has something to do with resource shares, because like you said, I should always have at least four tasks running. At the moment I have as active projects:

PS3GRID with resource share 1000
Cosmo with 500
Einstein with 400
and Rosetta with 250

active but without work are:

LHC with resource share 800
and SIMAP with 600

Which debug flags do you suggest to get usefull infos?
Are <coproc_debug>, <task> and <cpu_sched> enough?

I'll give 6.3.15 another try tomorrow evening if I have enough time...
____________

pixelicious.at - my little photoblog

Profile Krunchin-Keith [USA]
Avatar
Send message
Joined: 17 May 07
Posts: 512
Credit: 111,288,061
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 3207 - Posted: 21 Oct 2008 | 19:23:10 UTC - in response to Message 3201.

So, it's working... It's honestly says, that my PS3GRID's WU is working using "1.00 CPUs, 1 CUDA". But I still waiting for BOINC Manager version which will allow me to run 2 CPU tasks and 1 GPU task.....

That is this version. This is what we have been working towards the whole time. What is required is a change by the project in the work units to allow for less CPU usage, then this version will do as you want. I've tested it with the alpha test project OK so far. What you will see is "0.90 CPU, 1 CUIDA" and end up with that running and 2 other tasks on a dual core and four on a quad. At that time, users will have to remove any ncpus setting from thier config file, or else they will end up with 1 more extra cpu task.

Profile Krunchin-Keith [USA]
Avatar
Send message
Joined: 17 May 07
Posts: 512
Credit: 111,288,061
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 3208 - Posted: 21 Oct 2008 | 19:29:25 UTC - in response to Message 3206.

I just tried 6.3.15, but the scheduler is still buggy...
After an hour or so, I had only 2 CPU tasks and one GPUGRID task running on my Vista64 Quad.

Thats odd.

Do you have any cpu limit set in preferences or were you using debug option ncpus+1 ?

It may have to do with resource shares, but certainly you should have ended up with four CPU tasks, not two. I'm not real clear on how resource shares affect current clients for GPU work, but I'm under the impression CUDA tasks should always run as 'high priority' outside of resource shares to always keep GPU busy, that is if work is avaialble. Can you reproduce with debug information, that would be useful to Anderson ?

I have had no problems, but then again I have no quad core, only HT's. Scheduler has performed well (99.99%) in all my tests, including running both types of GPU work from both projects, public and alpha test. It always runs the correct number of other tasks and keeps the GPU busy as well as CPUs.

I'll try later tonight to simulate a quad core and see what happens for me.


Nope... I haven't set a CPU limit, and I don't use ncpus+1 on the Vista machine.
Actually I don't think it has something to do with resource shares, because like you said, I should always have at least four tasks running. At the moment I have as active projects:

PS3GRID with resource share 1000
Cosmo with 500
Einstein with 400
and Rosetta with 250

active but without work are:

LHC with resource share 800
and SIMAP with 600

Which debug flags do you suggest to get usefull infos?
Are <coproc_debug>, <task> and <cpu_sched> enough?

I'll give 6.3.15 another try tomorrow evening if I have enough time...


I've tried to simulate a quad core. I got 3 running CPU and 1 running CUDa/CPU=1. After 1 hour 3 minutes, one of the CPU tasks went to waiting to run, and another CPU task for another project started running, which is what it is suppsoe to do. Still running, no problemo.

I would think these four debug flags would do, it will prioduce a lot of output though.
<checkpoint_debug>1</checkpoint_debug> <!-- Show when applications checkpoint. New in 5.10 -->
<coproc_debug>1</coproc_debug> <!-- Show details of coprocessor (GPU) scheduling. New in 6.3.14 -->
<cpu_sched>1</cpu_sched> <!-- CPU scheduler actions (preemption and resumption). -->
<cpu_sched_debug>1</cpu_sched_debug> <!-- Explain CPU scheduler decisions. -->
You can cut-n-paste above into your file, the comments won't hurt anything. I have a super cc_config.xml file will all the options, when I need one I jsut edit and change a zero to one, with the comments I know what they should do and I don't have to keep looking them up in the wiki.

Profile Krunchin-Keith [USA]
Avatar
Send message
Joined: 17 May 07
Posts: 512
Credit: 111,288,061
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 3209 - Posted: 21 Oct 2008 | 19:33:34 UTC - in response to Message 3204.
Last modified: 21 Oct 2008 | 19:58:35 UTC

...but I'm under the impression CUDA tasks should always run as 'high priority' outside of resource shares to always keep GPU busy, that is if work is avaialble.


On my 6.3.14 client this is certainly not true. I have seen CUDA tasks stopped in favour of CPU tasks (I run ncpus+1), on both quad and dual core machines when I had GPUGrid's resource share at a level that corresponds to 1 CPU core. As well, when I don't have excess amount of work from other projects cached, CUDA tasks run at "normal priority" within BOINC.

6.3.14 is buggy, what it does is irrelavant now as the scheduler operation was changed for 6.3.15, I'm refereing to how 6.3.15 works.
Anderson wrote:

The current scheduler will always run a GPU job if the host has one.
So these jobs are always high priority regardless of their deadline.

Rabinovitch
Avatar
Send message
Joined: 25 Aug 08
Posts: 143
Credit: 64,937,578
RAC: 0
Level
Thr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwat
Message 3212 - Posted: 22 Oct 2008 | 1:11:49 UTC

You just take a look! Without any magic from my side I have 3 tasks running! CPU resources distribution is as follows:

50% - Rosetta WU
30-40% - Rosetta WU
10-20% - PS3GRID WU.

So while 6.48 application is using so much of 1 core, I'm loosing some performance for CPU-related WUs, but it's already better then earlier "versions" of BOINC.

Profile Krunchin-Keith [USA]
Avatar
Send message
Joined: 17 May 07
Posts: 512
Credit: 111,288,061
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 3218 - Posted: 22 Oct 2008 | 12:57:55 UTC

I have had no major defects show up. To me the scheduler preforms as intended.

I am giving my approval for this version to proceed into alpha testing.

Gianni will be waiting for the release of the linux version so he may test himself. After that the change should be made here on the project to go to CPU<1. He will announce when this happens.

@Stefan, below might be what you experienced. I tried for three hours yesterday, and could not duplicate your problem. The whole time I always had 4 tasks total running, this included several ending on thier own, and boinc correctly started a new one in its place.

I did find a minor defect,Today when I opened boinc manager I saw only had 1 CUDA/CPU task showing as 'Running...', but looking closely a CPU task was also running, clock ticking and it had already made 38% progress, yet the status showed as 'Ready to start'. It completed and reported and then another started and showed as Running. There seems to be a minor flaw in screen refresh.

Profile X-Files 27
Avatar
Send message
Joined: 11 Oct 08
Posts: 95
Credit: 68,023,693
RAC: 0
Level
Thr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 3220 - Posted: 22 Oct 2008 | 15:15:29 UTC - in response to Message 3218.

Yes there is a minor flaw in screen refresh.

Also if project is in panic mode, It will run an extra workunit.
eg.
Quad core + GPU
Normal = 1 GPU and 3 CPU
Panic mode = 1 GPU and 4 CPU

Profile Stefan Ledwina
Avatar
Send message
Joined: 16 Jul 07
Posts: 464
Credit: 288,617,006
RAC: 1,969,263
Level
Asn
Scientific publications
watwatwatwatwatwatwatwat
Message 3223 - Posted: 22 Oct 2008 | 17:37:08 UTC - in response to Message 3218.

Ok, maybe that is what happened.
I don't have much time until tomorrow evening or Friday, but I'll try it again and will report it to David if I find something else...
____________

pixelicious.at - my little photoblog

Profile Krunchin-Keith [USA]
Avatar
Send message
Joined: 17 May 07
Posts: 512
Credit: 111,288,061
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 3224 - Posted: 22 Oct 2008 | 18:28:42 UTC - in response to Message 3220.
Last modified: 22 Oct 2008 | 18:32:50 UTC

Yes there is a minor flaw in screen refresh.

Also if project is in panic mode, It will run an extra workunit.
eg.
Quad core + GPU
Normal = 1 GPU and 3 CPU
Panic mode = 1 GPU and 4 CPU

I've reported the screen redraw problem, others have seen it too. It has to do with the new way manager and client communicate which was a change in the last few clients.

As for running extra tasks, this is by design, See:
http://boinc.berkeley.edu/trac/wiki/GpuSched
Every one should get familiar with the new rules boinc operates under with co-processors.

What's happening is that the CPU jobs have earlier deadlines than the GPU job,
so BOINC runs them.
Then it gets to the GPU job and, because the GPU is idle, it runs it too.

I can duplicate this quite easily and it does on my (two CPUs and 1 GPU) run two CPU tasks in 'High Priority' mode and 1 CUDA=1/CPU task. I've got it doing that now. This is normal.

Post to thread

Message boards : Graphics cards (GPUs) : 6.3.15 out

//