Message boards :
Number crunching :
Not Getting GPU Tasks
Message board moderation
Previous · 1 · 2
| Author | Message |
|---|---|
|
Send message Joined: 8 May 18 Posts: 190 Credit: 104,426,808 RAC: 0 Level ![]() Scientific publications
|
Where can I find Stefan's post? Tullio |
|
Send message Joined: 1 Jan 15 Posts: 1166 Credit: 12,260,898,501 RAC: 1 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
Where can I find Stefan's post? I think this is the one: http://www.gpugrid.net/forum_thread.php?id=4707&nowrap=true#49595 |
|
Send message Joined: 8 May 18 Posts: 190 Credit: 104,426,808 RAC: 0 Level ![]() Scientific publications
|
Thanks Erich56. Let me see if I have understood. We calculate the energy level of some molecules using Quantum Mechanical methods such as Density Functional Theory, then our results are fed to some neural networks which will perform the same calculations much faster. Is this right? Tullio |
|
Send message Joined: 28 Jul 12 Posts: 819 Credit: 1,591,285,971 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
We calculate the energy level of some molecules using Quantum Mechanical methods such as Density Functional Theory, then our results are fed to some neural networks which will perform the same calculations much faster. Is this right? That seems to be the case. Interestingly, it appears that Cosmology (a VirtualBox project) also uses BOINC CPUs to train their neural network. I don't know if they perform their final calculations on GPUs or not, but they go much faster as a result of the training. https://en.wikipedia.org/wiki/Cosmology@Home |
|
Send message Joined: 8 May 18 Posts: 190 Credit: 104,426,808 RAC: 0 Level ![]() Scientific publications
|
Recently the scientists at Berkeley SETI Research but also at SETI Institute,two different institutions, have used neural networks to analyze data from the Green Bank radio telescope, financed by Breakthrough Listen, to search for Fast Radio Bursts in the data (400 TB) accumulated at Green Bank and found many emission from a repeating source, the only repeated Fast Radio Burst source discovered so far.They had not been found by traditional methods. The origin of the FRB is still a mystery. Tullio |
|
Send message Joined: 28 Jul 12 Posts: 819 Credit: 1,591,285,971 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
Recently the scientists at Berkeley SETI Research but also at SETI Institute,two different institutions, have used neural networks to analyze data from the Green Bank radio telescope, financed by Breakthrough Listen, to search for Fast Radio Bursts in the data (400 TB) accumulated at Green Bank and found many emission from a repeating source, the only repeated Fast Radio Burst source discovered so far.They had not been found by traditional methods. The origin of the FRB is still a mystery. That is VERY interesting. I have been hoping for some time that all the software expertise and radio time accumulated by SETI could be used for some more useful scientific purpose than LGMs. (Not that they don't exist, but not likely to be found with the hardware we presently have I think.) |
|
Send message Joined: 8 May 18 Posts: 190 Credit: 104,426,808 RAC: 0 Level ![]() Scientific publications
|
I am running SETI@home because there are many users who know a lot about computers and GPU boards. Some have put eight of them in a home made supercomputer, contrarily to the SETI original idea which was to exploit "unused cycles". Some of them are also my friends. Tullio |
|
Send message Joined: 1 Jan 15 Posts: 1166 Credit: 12,260,898,501 RAC: 1 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
... Some have put eight of them in a home made supercomputer ... I did not exactly assemble a "supercomputer", but I use altogether 8 PCs and notebooks for crunching BOINC projects (normally 24/7). |
|
Send message Joined: 1 Jan 15 Posts: 1166 Credit: 12,260,898,501 RAC: 1 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
GPU tasks queue drying out again :-( On the other hand, almost 170.000 CPU tasks for not more than 60 users. |
|
Send message Joined: 7 Apr 15 Posts: 33 Credit: 1,201,157,375 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
Whole weekend again without WU's while an overload of CPU tasks are waiting to be crunched by a only a small packet of people. We/I continuously bump into breaks where no WU's are available on GPU while an abundance of Quantum Chemistry CPU WU's are endlessly queuing. As Erich66 pointed out already a number of times, I do not see any statement from the GPUGrid team. To our disappointment. Can anyone have the courtesy and take 5 minutes of time to respond please ? Will QC CPU based WU's overtake GPU WU's in importance over time ? Is it the purpose to abandon GPU based WU's ? What is the strategy ? Many thanks in advance for a prompt reply. |
Retvari ZoltanSend message Joined: 20 Jan 09 Posts: 2380 Credit: 16,897,957,044 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
We/I continuously bump into breaks where no WU's are available on GPU while an abundance of Quantum Chemistry CPU WU's are endlessly queuing.This project was running like that for years, even before the QC CPU tasks. I think it will be the same for a couple of years. Will QC CPU based WU's overtake GPU WU's in importance over time ?No. (That was answered by the staff before) |
|
Send message Joined: 2 Jul 16 Posts: 338 Credit: 7,987,341,558 RAC: 259 Level ![]() Scientific publications ![]() ![]() ![]() ![]()
|
I'm just glad there is pretty steady work during the week. There were times when GPUs could not be kept busy. Even if GPUGrid is not your main project it's good practice to have a backup project at 0% resource share. |
|
Send message Joined: 7 Apr 15 Posts: 33 Credit: 1,201,157,375 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
Hi Zoltan, Thanks for the reply, but I was hoping to rather get a statement from the GPUGrid team itself. It may have been like that for years, agreed (and I confirm), but it doensn't mean that it should be like that :-) Maybe it would be possbile to create big enough batches with maybe a little longer deadlines as to have sufficient WU's to also cover weekends and/or holiday periods. There are some algorithms which enable you to predict future workload (I'm working in the contact centre industry and workforce load predictability is a big topic there). And yes, I have Einstein and MilkyWay as backup projects, but it's a shame that I have to spend time on other projects while there are still uncountable protein interactions to be calculated. So happy to have the CPU/GPU question solved, but still on my hunger about the WU scheduling approach. Cheers & have a nice weekend ! |
|
Send message Joined: 7 Apr 15 Posts: 33 Credit: 1,201,157,375 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
It seems like we're again hitting a low in supply on GPU based WU's. End of december and january (apart from the last week and a half) were horrendous for GPU based WU's. As we discussed and pointed out earlier in this post, there is an abundance of QC WU's which is only being crunched by 1000 at a time while GPU is crunched by 3000 simultaneously and hitting continuously a state of depletion of GPU WU's. Can some resources working on the QC WU's be redirected to GPU WU's please so there are ample available and we can keep crunching without interruption ? Current server statistics : 0 short runs, 0 long runs, 0 ACEMD, 148428 QC Current crunching Wu's in progress : 730 short runs, 3035 long runs, 1250 QC. Meaning that GPU based crunching has 4 times as many WU's being crunched compared to QC, while QC has 148428 WU's in queue and GPU WU's totally empty. This has been the case for a while now (over half a year). Where is the logic in this ? Please reconsider your strategy and put more focus on GPU WU's... And no, it's not my/our purpose to start crunching backup projects (although I do) and I have my personal reasons for that. We would greatly appreciate to take our question into consideration :-) Cheers, BE. |
|
Send message Joined: 7 Apr 15 Posts: 33 Credit: 1,201,157,375 RAC: 0 Level ![]() Scientific publications ![]() ![]() ![]() ![]() ![]() ![]() ![]()
|
Or even better : develop QC WU's for GPU ;-) |
©2025 Universitat Pompeu Fabra