Why am I getting TOO MANY WU's?

Message boards : Number crunching : Why am I getting TOO MANY WU's?
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Rick A. Sponholz
Avatar

Send message
Joined: 20 Jan 09
Posts: 52
Credit: 2,518,707,115
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32828 - Posted: 8 Sep 2013, 15:29:43 UTC

I can't seem to get GPUGRID to follow my BOINC Local Preferences. I've got the Minimum Work Buffer set to .02 days, and Max Additional Work Buffer set to .15 days, and I still get seven WU's for my 4 GPU core machines, even when there is 5-9 hours left on the 4 wu's that are running. The resource share is only 62.14%. and my app_config is set to run no more than 4 wu's at a time. Am I missing something? Hope someone can help. Thanks in advance, Rick
ID: 32828 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile skgiven
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,995,359,260
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32830 - Posted: 8 Sep 2013, 16:01:12 UTC - in response to Message 32828.  
Last modified: 8 Sep 2013, 16:12:50 UTC

The estimated remaining runtime could well be incorrect (due to the recent short and long test work units all being described as 5M Gflops server side).

Any Network Usage restrictions in place?

I cant see your app_config or settings.
So, is your i7-4770's Intel HD4600 GPU being seen by Boinc (it would say in the first page of your Boinc Log file)?

If so then you can exclude the intel_GPU from being 'used' by GPUGrid (you maybe already did this).

If the intel_GPU is being seen by Boinc and you have not excluded it from the GPUGrid project, your buffer settings will mean you cache up to 4h of work, for 5 GPU's.

This might help you work out what's going on,
http://www.gpugrid.net/host_app_versions.php?hostid=157727

You can see what your different app performances are listed as for that system.
Should be going by 'Average turnaround time 0.66 days'
FAQ's

HOW TO:
- Opt out of Beta Tests
- Ask for Help
ID: 32830 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jacob Klein

Send message
Joined: 11 Oct 08
Posts: 1127
Credit: 1,901,927,545
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32832 - Posted: 8 Sep 2013, 16:10:16 UTC - in response to Message 32830.  
Last modified: 8 Sep 2013, 16:12:45 UTC

I thought Intel GPUs are listed a resource type that is different than NVIDIA, and so they are naturally not included within any work fetch requests to GPUGrid.

Another possibility as to the problem might be that the server-side speed estimations aren't yet calculated. It takes 10 completed task for a given host (e.g. Computer X) on a given app's (e.g. Long-Run) given plan class (e.g. Cuda 5.5) before the server knows just how fast the host can do the tasks for that host/app/planclass combination.

Until that happens, estimations of speeds are.... often wrong.

PS: <max_concurrent> in app_config.xml currently limits the number of tasks of that app that can be running at a time, but it does NOT have any effect on how much work is requested. The best way to limit the amount of tasks queued up, is to limit your work fetch buffers.

Mine are set to:
Minimum 0.05 days
Max Additional: 0.15 days
ID: 32832 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile skgiven
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,995,359,260
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32835 - Posted: 8 Sep 2013, 16:24:58 UTC - in response to Message 32832.  
Last modified: 8 Sep 2013, 16:37:17 UTC

Maybe development versions of Boinc handle the Intel GPU's differently, but I have an exclude_gpu setting for my intel_gpu for GPUGrid in my cc_config file:
    <options>
    <exclude_gpu>
    <url>http://www.gpugrid.net/</url>
    <type>intel_gpu</type>
    </exclude_gpu>
    </options>


It's been there for a while, so I guess I thought I needed it at some stage (maybe I didn't actually need it though and just read in some forum that I needed it).


FAQ's

HOW TO:
- Opt out of Beta Tests
- Ask for Help
ID: 32835 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jacob Klein

Send message
Joined: 11 Oct 08
Posts: 1127
Credit: 1,901,927,545
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32836 - Posted: 8 Sep 2013, 16:29:50 UTC - in response to Message 32835.  

I'd be curious what happens when you take that out, and restart BOINC. If it doesn't behave correctly, maybe we can look at it further to see if a bug existed/exists.
ID: 32836 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rick A. Sponholz
Avatar

Send message
Joined: 20 Jan 09
Posts: 52
Credit: 2,518,707,115
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32837 - Posted: 8 Sep 2013, 16:41:44 UTC - in response to Message 32830.  
Last modified: 8 Sep 2013, 16:52:11 UTC

The estimated remaining runtime could well be incorrect (due to the recent short and long test work units all being described as 5M Gflops server side).

Any Network Usage restrictions in place?

I cant see your app_config or settings.
So, is your i7-4770's Intel HD4600 GPU being seen by Boinc (it would say in the first page of your Boinc Log file)?

If so then you can exclude the intel_GPU from being 'used' by GPUGrid (you maybe already did this).

If the intel_GPU is being seen by Boinc and you have not excluded it from the GPUGrid project, your buffer settings will mean you cache up to 4h of work, for 5 GPU's.

This might help you work out what's going on,
http://www.gpugrid.net/host_app_versions.php?hostid=157727

You can see what your different app performances are listed as for that system.
Should be going by 'Average turnaround time 0.66 days'


Thanks for the feedback, Jacob, & skgiven.
BOINC is only showing recognition of my 4 nvidia processors, NOT the intel (btw, I didn't even know mt computer had an intel GPU. Is there a way to use that one too?)

I do not have any network restrictions. My wireless network is connected full time to a cable modem, with backup to a second wireless network connected to my backup DSL modem.

I'll try to answer any additional questions posted. Thanks, Rick
ID: 32837 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile skgiven
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,995,359,260
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32838 - Posted: 8 Sep 2013, 16:44:34 UTC - in response to Message 32836.  
Last modified: 8 Sep 2013, 16:49:29 UTC

Just after deleting my exclude intel_gpu, and immediately got,
GPUGRID - Requesting new tasks for intel_gpu

- Obviously I wouldn’t get Intel work, but I thought it might change the scheduler causing it to cache up more work, some wonky way. Unfortunately I can't test for this because the 2 WU's I have running are 3h and 6h into a run and Boinc thinks they will take another 60h and 70h (due to the estimates).

Rick, you can download the Intel drivers and use it at Einstein.
FAQ's

HOW TO:
- Opt out of Beta Tests
- Ask for Help
ID: 32838 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jacob Klein

Send message
Joined: 11 Oct 08
Posts: 1127
Credit: 1,901,927,545
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32839 - Posted: 8 Sep 2013, 16:47:57 UTC - in response to Message 32838.  
Last modified: 8 Sep 2013, 16:58:47 UTC

Right skgiven, you have a resource "intel_gpu" that GPUGrid doesn't explicitly say that it doesn't support (in sched_reply_www.gpugrid.net.xml), and so BOINC asks for work for it.

When it doesn't get any work for it, it should create an incrementing resource backoff, up to a 1-day backoff. You can see that backoff in both the Project properties, as well as the work_fetch_debug log statements (if you have that flag set in cc_config.xml)

For CPU, GPUGrid explicitly says "we don't do that resource" (<no_cpu_apps>1</no_cpu_apps> in sched_reply_www.gpugrid.net.xml), and so BOINC never asks GPUGrid for CPU work. That's why the project properties can say "Project has no apps for CPU". But GPUGrid doesn't yet do that for the intel_gpu resource type.

You can keep the GPU Exclusion in place if you'd like.
But I believe BOINC is doing its job of
- periodically asking GPUGrid for work for intel_gpu (since the project may start having tasks for it, since it doesn't explicitly say that it doesn't have apps for it!)
- creating an incrementing resource backoff when it gets no work (since the project may be temporarily out of work for that resource type).

If GPUGrid wanted to save a bit of RPC bandwidth for its users that have intel_gpu resources, I think they could add a line in the sched_reply_www.gpugrid.net.xml file to do so.

Does that make sense hopefully?

PS: You can fix your estimates by closing BOINC, opening client_state.xml, finding the GPUGrid duration correction factor, and setting it to something reasonable like 1.6
ID: 32839 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rick A. Sponholz
Avatar

Send message
Joined: 20 Jan 09
Posts: 52
Credit: 2,518,707,115
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32841 - Posted: 8 Sep 2013, 16:55:36 UTC - in response to Message 32838.  

Just after deleting my exclude intel_gpu, and immediately got,
GPUGRID - Requesting new tasks for intel_gpu

- Obviously I wouldn’t get Intel work, but I thought it might change the scheduler causing it to cache up more work, some wonky way. Unfortunately I can't test for this because the 2 WU's I have running are 3h and 6h into a run and Boinc thinks they will take another 60h and 70h (due to the estimates).

Rick, you can download the Intel drivers and use it at Einstein.


Jacob,
Where can I get the Intel drivers? I'd love to get more out of my machines. Thanks in advance, Rick
ID: 32841 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jacob Klein

Send message
Joined: 11 Oct 08
Posts: 1127
Credit: 1,901,927,545
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32842 - Posted: 8 Sep 2013, 16:56:35 UTC - in response to Message 32841.  
Last modified: 8 Sep 2013, 16:57:49 UTC

I think skgiven would have to answer that one.
I'd wager, though, that you go to the Intel website, and look for graphics drivers there.
ID: 32842 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile skgiven
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,995,359,260
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32843 - Posted: 8 Sep 2013, 16:57:02 UTC - in response to Message 32839.  

Makes sense.

Maybe I thought I needed it in place when I was also using app_config (which is an anonymous platform), didn't want my logs saturated, or was just being overcautious. I certainly put some exclusions in due to POEM's needs.
FAQ's

HOW TO:
- Opt out of Beta Tests
- Ask for Help
ID: 32843 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile skgiven
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,995,359,260
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32844 - Posted: 8 Sep 2013, 17:00:27 UTC - in response to Message 32841.  

ID: 32844 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rick A. Sponholz
Avatar

Send message
Joined: 20 Jan 09
Posts: 52
Credit: 2,518,707,115
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32863 - Posted: 9 Sep 2013, 20:02:55 UTC - in response to Message 32844.  

Rick, see the following thread in Einstein,
http://einstein.phys.uwm.edu/forum_thread.php?id=10215&nowrap=true#125627


Thanks for pointing me in the right direction, skgiven. Unfortunately, I guess you can't run the Intel HD processor if you already have two dual processor video cards in your box. It cost me $60 and an 80 mile trip to the computer store to find that out. But thanks for trying to help. Regards, Rick
ID: 32863 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile skgiven
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,995,359,260
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32870 - Posted: 10 Sep 2013, 14:26:21 UTC - in response to Message 32863.  
Last modified: 10 Sep 2013, 14:34:15 UTC

Unfortunately, I guess you can't run the Intel HD processor if you already have two dual processor video cards in your box. It cost me $60 and an 80 mile trip to the computer store to find that out. But thanks for trying to help. Regards, Rick

Don't see why that would be the situation. Did they mention why, or just charge you $60 and say it can't be done?
Have you tried to use the IHD4600 to support your primary monitor?
While I don't have two dual GPU's in any system, I do have 3 discrete GPU's in one system and I can use my iHD4000 GPU to run Einstein.
FAQ's

HOW TO:
- Opt out of Beta Tests
- Ask for Help
ID: 32870 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rick A. Sponholz
Avatar

Send message
Joined: 20 Jan 09
Posts: 52
Credit: 2,518,707,115
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32871 - Posted: 10 Sep 2013, 14:38:07 UTC - in response to Message 32870.  

Unfortunately, I guess you can't run the Intel HD processor if you already have two dual processor video cards in your box. It cost me $60 and an 80 mile trip to the computer store to find that out. But thanks for trying to help. Regards, Rick

Don't see why that would be the situation. Did they mention why?
Have you tried to use the IHD4600 to support your primary monitor?
While I don't have two dual GPU's in any system, I do have 3 discrete GPU's in one system and I can use my iHD4000 GPU to run Einstein.


The techs just told me they could only get two of the three to work at one time (I think they spent most of their time un-doing the mess I made trying to do it myself). I only have an HDMI output for the IHD4600, and don't know how to connect it to my KVM switch. I use to be knowlageble about these things in the 1960's & 70's , when you had to rewire computers to get them to complete a task. Now technology is moving faster than this old man can keep up with, but I'll keep on trying. Thanks for the nuggets of info. I'll keep following the trail, until I figure this out. Regards, Rick
ID: 32871 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rick A. Sponholz
Avatar

Send message
Joined: 20 Jan 09
Posts: 52
Credit: 2,518,707,115
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32878 - Posted: 11 Sep 2013, 2:12:17 UTC - in response to Message 32870.  

Unfortunately, I guess you can't run the Intel HD processor if you already have two dual processor video cards in your box. It cost me $60 and an 80 mile trip to the computer store to find that out. But thanks for trying to help. Regards, Rick

Don't see why that would be the situation. Did they mention why, or just charge you $60 and say it can't be done?
Have you tried to use the IHD4600 to support your primary monitor?
While I don't have two dual GPU's in any system, I do have 3 discrete GPU's in one system and I can use my iHD4000 GPU to run Einstein.


Skgiven,
I can't thank you enough for the help getting my IHD to work. Your suggestion to use the IHD as my primary monitor did the trick, and I'm now crunching Einstein@home om it! Now more NVIDIA GPU time for your GPUGRID. Now on to my other two I7 machine and try to getr them to work too. Thanks again, Rick
ID: 32878 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
MarkJ
Volunteer moderator
Volunteer tester

Send message
Joined: 24 Dec 08
Posts: 738
Credit: 200,909,904
RAC: 0
Level
Leu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32881 - Posted: 11 Sep 2013, 6:27:08 UTC

I believe you need a load on the intel VGA (or DVI) port. One way is to plug a monitor in. Another way would be to use a dummy vga plug. The way most bios's are set up is if they don't detect a device on the iGPU and you have another graphics card they simply disable the iGPU

Also if you get the intel GPU driver through windows update its not usable for crunching. You need to get the 'full' package from the intel download centre.

Probably a bit late but maybe it will help someone else.
BOINC blog
ID: 32881 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rick A. Sponholz
Avatar

Send message
Joined: 20 Jan 09
Posts: 52
Credit: 2,518,707,115
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32962 - Posted: 15 Sep 2013, 0:29:24 UTC - in response to Message 32881.  

I believe you need a load on the intel VGA (or DVI) port. One way is to plug a monitor in. Another way would be to use a dummy vga plug. The way most bios's are set up is if they don't detect a device on the iGPU and you have another graphics card they simply disable the iGPU

Also if you get the intel GPU driver through windows update its not usable for crunching. You need to get the 'full' package from the intel download centre.

Probably a bit late but maybe it will help someone else.


Thanks for the input MarkJ. Luckly, I installed the correct (full) driver directly from Intel's site. I was using the Intel port for my monitor (that was the only way I could get the Intel GPU to work), but maybe I need the dummy plug for drive 0 on my GTX690? I've ordered 3 VGA Dummy Pluggs (1 for eacj of my i7 machines), and hope to receive them by next weekend. It would be great, if that's all that's needed. Thanks again, Rick
ID: 32962 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
werdwerdus

Send message
Joined: 15 Apr 10
Posts: 123
Credit: 1,004,473,861
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32984 - Posted: 16 Sep 2013, 1:51:43 UTC

i have 4 machines running with no monitors and no dummy plugs, 3 of the machine have 2 nvidia each and 1 has 1 amd card. they all work fine. i think only the integrated gpu (intel) needs dummy plug.
XtremeSystems.org - #1 Team in GPUGrid
ID: 32984 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile skgiven
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,995,359,260
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 32991 - Posted: 16 Sep 2013, 10:50:29 UTC - in response to Message 32984.  

I have my monitor on the iHD4000, and don't use a dummy plug for the 3 discrete GPU's in the same system (660Ti, 660, HD5850). I can still use the iHD4000 at Einstein and the 3 discrete cards to crunch. The only issue is that I cannot launch the NVidia control panel (but I don't really need to anyway - things are working well enough as is).
FAQ's

HOW TO:
- Opt out of Beta Tests
- Ask for Help
ID: 32991 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Why am I getting TOO MANY WU's?

©2025 Universitat Pompeu Fabra