Python Runtime (GPU, beta)
Message boards :
News :
Python Runtime (GPU, beta)
Message board moderation
| Author | Message |
|---|---|
|
Send message Joined: 9 Dec 08 Posts: 1006 Credit: 5,068,599 RAC: 0 Level  Scientific publications    |
If anybody wants to help debug a new application, please enable the above mentioned app. |
|
Send message Joined: 11 Jul 09 Posts: 1639 Credit: 10,159,968,649 RAC: 295,172 Level  Scientific publications    
|
I don't see anything new on https://www.gpugrid.net/apps.php yet? |
|
Send message Joined: 7 Jan 17 Posts: 34 Credit: 1,371,429,518 RAC: 0 Level  Scientific publications
|
GPUGRID 10/26/2021 2:01:26 PM No tasks are available for Python apps for GPU hosts |
|
Send message Joined: 21 Feb 20 Posts: 1114 Credit: 40,838,348,595 RAC: 4,765,598 Level Scientific publications
|
One system queued up and waiting. 
|
|
Send message Joined: 7 Jan 17 Posts: 34 Credit: 1,371,429,518 RAC: 0 Level Scientific publications
|
Got a 2080 Ti and two 2070 Supers ready to roll. |
|
Send message Joined: 21 Feb 20 Posts: 1114 Credit: 40,838,348,595 RAC: 4,765,598 Level Scientific publications
|
I don't see anything new on https://www.gpugrid.net/apps.php yet? OT, but I've always found it weird that this link is not linked from anywhere on the main GPUGRID site. can only find it via a google search or previous bookmark. if you're just browsing through the GPUGRID site it doesn't exist.
|
 mg13 [HWU] Send message Joined: 18 Nov 09 Posts: 7 Credit: 107,006 RAC: 0 Level  Scientific publications 
|
I don't see anything new on https://www.gpugrid.net/apps.php yet? Yes, there is the link, just go to the home page and click on "Join us" and on the page that opens in the "Configuring your participation" section in point 2 click on "apps" and you will find it. |
|
Send message Joined: 21 Feb 20 Posts: 1114 Credit: 40,838,348,595 RAC: 4,765,598 Level Scientific publications
|
Thanks. You’re right it’s there. But I’ll follow up that it’s a very odd place for it. Nearly all other BOINC project puts a link near/with credit statistics, directly on the main page, or as a link on the bottom of every page.
|
Bill F Send message Joined: 21 Nov 16 Posts: 36 Credit: 164,429,114 RAC: 12,554 Level  Scientific publications
|
Well I am checked and enabled including "run Test Apps" we will see of I get a task assigned. Thanks Bill F |
|
Send message Joined: 26 Aug 21 Posts: 1 Credit: 499,105,253 RAC: 5,815 Level  Scientific publications
|
This application is enabled in my preferences, and I accept test applications, but I am not getting any python task : mer. 27 oct. 2021 15:51:04 | GPUGRID | Scheduler request completed: got 0 new tasks Server status shows 10 tasks waiting to be sent. |
|
Send message Joined: 22 May 20 Posts: 110 Credit: 115,525,136 RAC: 345 Level  Scientific publications
|
Why are you not running more test tasks for the new app? Almost all of the tasks ended on one of Ian’s hosts … or is that enough feedback for now? Anyway, credit calculation looks almost random to me. At least for these tasks. Any chance you will fix that before this gets into production? (Comparison: 700sec runtime awarded ~100k vs. admittedly lower end card 110k sec runtime getting 565k credit. Seems out of scope. |
|
Send message Joined: 21 Feb 20 Posts: 1114 Credit: 40,838,348,595 RAC: 4,765,598 Level Scientific publications
|
wow, I didnt even notice, I was out all day. I just set the system (7x GPU) to check for work every 100s or so and only checking for beta GPU work, so it doesn't surprise me that it got so many. it would ask for 7 at once, and I guess it got lucky that it asked for some work before anyone else. beta tasks have always paid a lot of credit here for some reason. but as with previous beta tasks, I see no indication that these tasks actually did anything on the GPU. my guess is that they ran some stuff on the CPU then finished. I've asked before what their intentions are with these tasks, and it's clear they are doing some type or machine learning kind of thing, but they dont appear to be even using the GPU at all, which is very strange when they are labelled as a cuda app.
|
|
Send message Joined: 11 Jul 09 Posts: 1639 Credit: 10,159,968,649 RAC: 295,172 Level Scientific publications
|
The apps finally appeared on the application page yesterday afternoon. So far, they are for Linux only (not mentioned in the original announcement), and with the same cuda101 / cuda 1121 variants as the current acemd runs. |
|
Send message Joined: 21 Feb 20 Posts: 1114 Credit: 40,838,348,595 RAC: 4,765,598 Level Scientific publications
|
The apps finally appeared on the application page yesterday afternoon. So far, they are for Linux only (not mentioned in the original announcement), and with the same cuda101 / cuda 1121 variants as the current acemd runs. cuda100* but yeah, looks to be the same app as listed in the Anaconda Python 3 category, same versioning.
|
|
Send message Joined: 7 Jan 17 Posts: 34 Credit: 1,371,429,518 RAC: 0 Level Scientific publications
|
So, uh, that was it? |
|
Send message Joined: 11 Jul 09 Posts: 1639 Credit: 10,159,968,649 RAC: 295,172 Level Scientific publications
|
Not quite, but... Got a new Python task. It failed: 14:05:29 (821885): wrapper: running ./gpugridpy/bin/python (run.py) Running command git clone -q https://github.com/Unity-Technologies/obstacle-tower-env.git /tmp/pip-req-build-i6sgww_u ERROR: Error [Errno 2] No such file or directory: 'git' while executing command git clone -q https://github.com/Unity-Technologies/obstacle-tower-env.git /tmp/pip-req-build-i6sgww_u ERROR: Cannot find command 'git' - do you have 'git' installed and in your PATH? Not yet, but I'll install it before the replacement task I got on report has a chance to start. We shouldn't need to do that. (and now my second Linux machine has got one too) |
|
Send message Joined: 11 Jul 09 Posts: 1639 Credit: 10,159,968,649 RAC: 295,172 Level Scientific publications
|
That looks better - I'd say the GPU is running:  But what's [ObstacleTower (as boinc)]? It's appeared on my task bar, and opens to a tiny, all black, window? |
|
Send message Joined: 11 Jul 09 Posts: 1639 Credit: 10,159,968,649 RAC: 295,172 Level Scientific publications
|
Second machine has acquired an ObstacleTower, too. Interesting snip from stderr in running (repeated many times): [2m[33m(raylet)[0m ModuleNotFoundError: No module named 'aiohttp.signals' |
|
Send message Joined: 9 Dec 08 Posts: 1006 Credit: 5,068,599 RAC: 0 Level Scientific publications |
This is being solved server-side, no need to install software of course. Not quite, but... |
|
Send message Joined: 31 May 21 Posts: 200 Credit: 0 RAC: 0 Level Scientific publications
|
The Obstacle Tower environment is a simulated environment for machine learning (Reinforcement Learning) research. Note that in order to research how to train and deploy embodied agents in the real word it is common to research in 3D world simulations like this on. This is the github page of the project: https://github.com/Unity-Technologies/obstacle-tower-env We use it as a testbench within our efforts to train populations of interacting artificial intelligent agents able to develop complex behaviours and solve complex tasks. The environment runs on GPU, and the Deep Learning models learning how to solve the simulation too. Most of the bugs we are trying to solve are related to the environment. It is installed via git, but the git-related issues is being solved from the server side as mentioned. The reported stderr message "ModuleNotFoundError: No module named 'aiohttp.signals'" should be solved now. The small black screen is also related to the environment. |
©2025 Universitat Pompeu Fabra