Author |
Message |
GDFVolunteer moderator Project administrator Project developer Project tester Volunteer developer Volunteer tester Project scientist Send message
Joined: 14 Mar 07 Posts: 1957 Credit: 629,356 RAC: 0 Level
Scientific publications
|
Hi,
so an update is due with titans and gtx780s.
The current gpugrid application is not supporting it and we have not updated it for a reason.
At the moment Titans and GTX780s do NOT work. After a short time the application crashes. Nvidia has now recognized the problem and it is working on a fix for Titans which should be out in a month or so. It could be a new driver or a bios update.
For GTX780, the fix would be either together with the titan fix or it would not come for sometime or ever.
Best for crunching at the moment are GTX770.
gdf |
|
|
|
Is it CUDA 4.2 related problem? Or is it general? I have problem with my cuda app, which stuck when syncing with cpu on linux.
Thanks
Zdenek |
|
|
5potSend message
Joined: 8 Mar 12 Posts: 411 Credit: 2,083,882,218 RAC: 0 Level
Scientific publications
|
Why wouldn't (possibly) the fix for the titan not fix the 780?
Edit: HA: its gotta be a problem with CUDA 4.5, because mine crunches fine on Einstein and is returning valid results. It does encounter a hiccup on occassion though, maybe once a week. |
|
|
|
I have problems with my titan on linux with cuda 5.0 also. No problem with 5xx and 6xx cards. I try to figure out where is problem? driver, card or an app. (or motherboard and pci maybe) |
|
|
w6msuSend message
Joined: 30 Nov 10 Posts: 4 Credit: 278,484,571 RAC: 0 Level
Scientific publications
|
back to the gtx-670... |
|
|
OperatorSend message
Joined: 15 May 11 Posts: 108 Credit: 297,176,099 RAC: 0 Level
Scientific publications
|
Nvidia has now recognized the problem and it is working on a fix for Titans which should be out in a month or so. It could be a new driver or a bios update.
Can you provide any more info on this?
Was there some sort of report published or correspondence you can refer to?
How long have you known that there was a problem and that your group intentionally decided not to update your app to run on Titans? Was this decision taken recently?
I have had a trouble ticket in with Nvidia for months now that they have not updated and obviously chosen to ignore.
They initially seemed interested in the Titan's inability to crunch on GPUGrid and then suddenly went to 'radio silence'.
Einstein, Folding@Home, etc. have all benefited in the meantime.
Obviously I'm disappointed and expected to be able to support this project with components I purchased because I believe that what you are doing is worthwhile.
It's now the middle of July and still no fix.
Operator
____________
|
|
|
5potSend message
Joined: 8 Mar 12 Posts: 411 Credit: 2,083,882,218 RAC: 0 Level
Scientific publications
|
It's not the fact there's no fix that bothers me. It's that they didn't say anything about thia topic the entire time. In the meanwhile, people, including myself are purchasing parts. Because why not, we haven't been told there was any serious issues.
We were told the dev was away. Serious breakdown in communication, and is making me think about switching projects.
Cheers. |
|
|
|
Hmm i dont know.i dont want to sound rude...but buying hardware thats not supported is not the fault from the projectadmin i would presume O.o
But i would think more positive now and hope that the update will work for both titans and 780.
____________
DSKAG Austria Research Team: http://www.research.dskag.at
|
|
|
5potSend message
Joined: 8 Mar 12 Posts: 411 Credit: 2,083,882,218 RAC: 0 Level
Scientific publications
|
That I understand. What I don't like was the complete lack of communication in regards to the topic. If they knew it wasn't functioning, was able to contact NVIDIA, and get a response. That's a lot of time we were all left in the dark. Not a word was spoken. |
|
|
StefanProject administrator Project developer Project tester Project scientist Send message
Joined: 5 Mar 13 Posts: 348 Credit: 0 RAC: 0 Level
Scientific publications
|
It's not the fact there's no fix that bothers me. It's that they didn't say anything about thia topic the entire time. In the meanwhile, people, including myself are purchasing parts. Because why not, we haven't been told there was any serious issues.
We were told the dev was away. Serious breakdown in communication, and is making me think about switching projects.
Cheers.
Well, the dev was away. Also the last months there have been lots of posts here about Titans not working yet, so there was decent warning for users. In any case I think that the problem was a combination of the app and the drivers and now that the app actually works as seen by the few WU's that were crunched correctly we have to wait for the NVIDIA fix from what I understand.
So I personally don't see a communication breakdown. These things happen, but hopefully it will be soon resolved so that the investment of the users is not being lost. |
|
|
5potSend message
Joined: 8 Mar 12 Posts: 411 Credit: 2,083,882,218 RAC: 0 Level
Scientific publications
|
Thank you for responding. What I'm attempting to get at is simply WUs failing does not bother me. That isn't a sign the cards could *never* work.
I haven't lost an investment either :) Ive been wanting to build a new rig for awhile, since the next one won't be to Maxwell comes out, and I can hopefully pair them with an 8 core has well-e
I'm looking forward to hearing back from you guys in regards to what NVIDIA does. Just remember, all we saw was very few actually completed, most failed. But some did complete. There was no reason for us to expect this updated thread today.
Again, I enjoy crunching here. I just wish there was more communication at times. |
|
|
5potSend message
Joined: 8 Mar 12 Posts: 411 Credit: 2,083,882,218 RAC: 0 Level
Scientific publications
|
Just to point out, these are the relevant dev responses, and why I'm bringing this up:
1) Update on Titan app:
First of all, Titans should only work on the Beta queue right now. Once we are sure it works we will extend it to the other queues. But we need to do some final testing which I think I am going to organize later today, since there is noone else actively working on it.
What we have: Supposedly the app works fine for Linux and Titans
What we lack: Even a single occurrence where a Windows Titan crunched a Beta app successfully.
So, later today I am going to tell someone in the lab to send some stable simulations to the Beta queue and if there are any successes from Titan users especially from Windows (Linux users can report too) we would have some very helpful results.
Also, MJH tells me that if you are using Titans and the WU's run for a while and then always crash before completion, then you might need to downgrade to driver 310.44 or later in the 310 series as it is supposed to help a bit in our experience.
I will keep you updated.
2) Hm didn't know that. Then maybe MJH meant that it worked locally on our Linux Titans? Sorry for the confusion. Well in any case, it's Windows we want to test right now.
3) @Zarck Yes I was watching your machine. Actually right now all the beta WUs seem to fail which would rather point to a general problem in the new app and not just the Titans. Once this batch is done I will pass on the information.
Thanks for the testing and info though!
4) Unfortunately our developer for the TITANs (and their kind) comes back in July so we will have to wait a bit more. But it is quite high on our priorities to fix the problem with the new GPU's considering that eventually everyone will switch to the new generation (and they provide great performance boost).
-------
No where here does it even hint that there is a problem near the magnitude as currently described to us. All that's really said is, Linux seems to work on ours, it appears to be a problem with our app (fixable on your end), and we need to do some final testing (final testing tends to be good).
This is all I'm getting at. There was nothing about, "At the moment Titans and GTX780s do NOT work. After a short time the application crashes". Meaning, NOTHING is working correctly, this could take some time. Best hold off on getting these parts, because we don't know what's going on or why :)
Hope my point finally get's across. Again, best of luck with NVIDIA. Hope they clear everything up in a short time frame. |
|
|
GDFVolunteer moderator Project administrator Project developer Project tester Volunteer developer Volunteer tester Project scientist Send message
Joined: 14 Mar 07 Posts: 1957 Credit: 629,356 RAC: 0 Level
Scientific publications
|
This is the history of the process.
First, we did not have titans. When we had some, we immediately noticed that one card seemed faulty.
This is strange as usually all cards from good manufacturers are fine.
We ordered another 4 which took a long time to arrive as there was no availability. Again one card had problems.
It started to be dubious that two cards over 8 could have problems.
We run long enough tests, and more cards seem to eventually have crashing problems.
At this point, we still believed that there was some sort of incompatibility with the application which could be worked around.
We have then sent a reproducer to nvidia. In the meanwhile, other similar applications worldwide started to see the problem. We are a couple of weeks from now.
We bought 780s, same problem.
This week, we receive information from nvidia that they have isolated the problem and they are working on a fix. However, they claim that the fix will come first for titans in weeks and only later for 780s.
I don't see why there should be any difference for the two, but this is what they say.
Sorry, we could not inform you earlier, but we had sure information from nvidia only few days ago.
The way that the problem occurs is that if you are crunching for 12h or so, some cards will never complete, some others will. Some will crash quickly, some later. Some might even for work for very long.
I'll keep you updated on when we receive the fix for titan to test. It should be in a couple of weeks. We will also test it on gtx780.
Again, this is not a specific problem of gpugrid, but as our workunits are so long, we prefer to put an application out that it is 100% stable. It is a unique situation shich we have never encountered so far.
PEOPLE with titans and 780s.
At the moment you cannot crunch in gpugrid, however the solution seems to be reasonably close now.
For titans, a few weeks.
For 780s, I would like to think that the first fix would also work for 780s. Wait a few weeks and we will tell.
gdf |
|
|
|
GDF: Out of curiosity is it technically possible to break the WU into smaller units? Thanks |
|
|
GDFVolunteer moderator Project administrator Project developer Project tester Volunteer developer Volunteer tester Project scientist Send message
Joined: 14 Mar 07 Posts: 1957 Credit: 629,356 RAC: 0 Level
Scientific publications
|
technically it is, although inconvenient for the science, but I have tested on my linux machine yesterday and the crash hanged the machine.
We have to wait for nvidia to deliver the fix.
gdf |
|
|
ZarckSend message
Joined: 16 Aug 08 Posts: 145 Credit: 328,473,995 RAC: 0 Level
Scientific publications
|
I do not know where the problem is.
I have a Titan is a number of Boinc projects run smoothly with my Titan and any version of Boinc and nVidia driver, for example,
Moo!, DistrRTgen, PrimGrid, WCG HCC, Einstein, Seti.
Is it really a problem of nVidia driver and Boinc?
GPUGRID use functions that other projects do not use? so that GPUGRID does not work with my Titan?
Folding @ Home also runs smoothly.
I calculated what units BitCoin GPU in Utopia, it makes many units without problem, and occasionally I have a blue screen, and windows restarts.
The manager of BitCoin Utopia project asked me to send him the "Windows event log", you need this file?
@ +
*_*
Je ne sais pas ou est le problème.
J'ai une Titan est un certain nombre de projets Boinc tournent sans problème avec ma Titan et n'importe quelle version de Boinc et du pilote nVidia, comme par exemple,
Moo!, DistrRTgen, PrimGrid, WCG HCC, Einstein, Seti.
Est ce vraiment un problème du pilote nVidia et de Boinc ?
GpuGrid utillise des fonctions que d'autres projets n'utilise pas ? ce qui fait que GpuGrid ne fonctionne pas avec ma Titan ?
Folding@Home tourne aussi sans problème.
J'ai calculé quelles unités GPU sous BitCoin Utopia, il enchaine de nombreuses unités sans problème, et de temps en temps, j'ai un écran bleu, et windows redémarre.
Le gestionnaire du projet BitCoin Utopia; ma demandé de lui envoyé le "Windows event log", avez-vous besoin de ce fichier ?
@+
*_*
____________
|
|
|
GDFVolunteer moderator Project administrator Project developer Project tester Volunteer developer Volunteer tester Project scientist Send message
Joined: 14 Mar 07 Posts: 1957 Credit: 629,356 RAC: 0 Level
Scientific publications
|
Good if they work at least on other applications.
For us and other MD codes do not work, so at least is not specific of our application. I am surprised that they work at folding at home though.
gdf |
|
|
5potSend message
Joined: 8 Mar 12 Posts: 411 Credit: 2,083,882,218 RAC: 0 Level
Scientific publications
|
Folding@home WUs did work, but were fairly slow. Their new beta tasks however were blazing fast.
Again, I am curious as to why the fix wouldn't be for both, I know you don't know the answer, nor understand yourself, just curious is all. :)
Best of luck to Titan owners in the coming weeks. Their recent drivers have been buggy as hell with these gpus, so I'm actually wondering why these are so different compared to other cards, since its the same architecture. |
|
|
|
I have a Titan is a number of Boinc projects run smoothly with my Titan and any version of Boinc and nVidia driver, for example,
Moo!, DistrRTgen, PrimGrid, WCG HCC, Einstein, Seti.
Is it really a problem of nVidia driver and Boinc?
GPUGRID use functions that other projects do not use? so that GPUGRID does not work with my Titan?
As both one of the software developers and one of the administrators of the PrimeGrid project, I can assure you that PrimeGrid uses GPUs in ways that other projects do not, and run into problems that never occur with other projects. (We're very confident it's a hardware problem with the GPUs and not a software problem because increasing cooling to the GPUs, e.g. by increasing the fan speed, can fix the problem.)
Having gone through similar problems at PrimeGrid, it doesn't seem at all unusual to me that GPUGrid is having problems with some Nvidia cards that other projects don't.
GPUs are made for playing games, where a few errors won't be noticed. That's not the case with GPGPU computing, and errors will show up here that don't elsewhere. Different projects use the GPUs in different ways, and it's unfortunately not unusual for some programs to have problems on some (or even all) GPU models. |
|
|
MJHProject administrator Project developer Project scientist Send message
Joined: 12 Nov 07 Posts: 696 Credit: 27,266,655 RAC: 0 Level
Scientific publications
|
As Gianni said, there is a problem that affects both Titan and GTX780 cards which causes ACEMD, the GPUGrid application, to crash. There is no way that we can work around this problem successfully in our software; we need a driver fix from Nvidia. Nvidia is taking it seriously, as the problem also affects other high-profile scientific codes. The latest news that we have is that a fix is being developed and will be public in "several weeks".
Until that happy day, if you have a Titan or 780 the configuration that will give you the most chance of successfully completing GPUGRID WUs is to use Linux and driver 310.44. Empirically, this config seems to make the 780s stable, and slightly increases the mtbf of Titans.
MJH
|
|
|
|
I have a Titan is a number of Boinc projects run smoothly with my Titan and any version of Boinc and nVidia driver, for example,
Moo!, DistrRTgen, PrimGrid, WCG HCC, Einstein, Seti.
Is it really a problem of nVidia driver and Boinc?
This do not mean anything. Distrrtgen is very simple. Also other ones. Genefer is also very specific. Acemd is much complex and requires cpu-gpu as I think. From point of developer I can talk about distrrtgen only and this is very straitforward short app which runs on gpu only. |
|
|
ZarckSend message
Joined: 16 Aug 08 Posts: 145 Credit: 328,473,995 RAC: 0 Level
Scientific publications
|
Folding is now optimized for GeForce Titan, and performance are now multiplied by 2. Future nVidia driver will support the compilation just in time "JIT" and still allow new significant performance gains.
http://folding.typepad.com/news/2013/06/welcome-to-fahcore-17.html
"Welcome to FahCore 17!
We are proud to announce that our latest GPU core, FahCore 17, was recently moved from beta to advanced testing, the last quality assurance step before a full release. As we previously mentioned, this core is a significant step for us. FahCore 17 is a complete overhaul from our previous GPU cores. It brings a cleaner and more streamlined codebase, new serialization mechanisms that allow us to set up diverse simulations, and improved stability. Its use of OpenCL has united our development, allowing the single core to run on both Nvidia and AMD cards, and theoretically any OpenCL-capable device. It is also our first GPU core to run natively in Linux, although we are only supporting Nvidia GPUs there for the time being as we wait for AMD's Linux drivers to mature a bit more. Overall, this core sets a strong foundation for the future of GPU core development.
On AMD cards, FahCore 17 is about 10 times faster than the old GPU cores, and on Nvidia it's about twice as fast. This is mainly due to its OpenMM 5.1 base, which contains many optimizations which deliver a significant speedup. One optimization in particular that we are waiting for is CUDA JIT, a just-in-time compiler that Nvidia may be introducing into its drivers in the coming future. Not only will this technology allow us to offer support for the CUDA platform with FahCore 17, but the JIT compiler is likely to deliver a massive speedup. For the time being, we continue to work at finding additional optimizations on our end. We have also successfully tested FahCore 17 with extremely large proteins (500,000+ atoms), which are on par with the ones used by "bigadv" CPU projects.
To run FahCore 17, you need a Fermi GPU or better and Windows or Linux, or a AMD HD5000 or better and Windows. It also currently requires proprietary drivers from these vendors. You can test FahCore 17 by adding the "client-type = advanced" setting into the extra core options in the V7 client, as in the Configuration FAQ. Another excellent resource is the GPU FAQ which describes why GPUs are so helpful to us.
We'd like to thank all the alpha testers on FreeNode's #fah IRC channel, as well as the beta testers on foldingforum.org, who have all helped us bring the core to this point!"
____________
|
|
|
|
You mention Titans working at Primegrid...it's true that they work, but not at all as expected. I've done some PG testing of my own with my Titan on GFN and some PSA apps, which require FP64, something the Titan is supposed to excel at. It does not. Turning the FP64 ability on and of in the Control Panel adds 4-5% speed increase at best, when it should be closer to 650% (taking into account the clock speed reduction when enabling FP64). So although it "works", it does not work properly.
I also did some testing at Albert@home. Again, the Titan "works", but not properly. WUs take 2x longer to complete on the Titan than on a GTX 560. I haven't tested if the results are the same for Einstein, but you might assume they are.
There is something seriously wrong somewhere, and hopefully Nvidia finally gets it right sooner rather than later, especially since i spent the extra cash and got the EVGA Hydro Copper version. It never runs above 39C at full load, so temps have nothing to do with these issues.
Edit: Also i've had no luck at Poem either. Instant crashes everytime, same as with GPUgrid. |
|
|
5potSend message
Joined: 8 Mar 12 Posts: 411 Credit: 2,083,882,218 RAC: 0 Level
Scientific publications
|
Einstein does not use FP64. So, that is a non issue there. The gk110s do work there, and that is where mine are currently at. However, due to a bug that it would appear NVIDIA is unwilling to fix, they cannot move forward optimizing their CUDA app. AMD excels there on their latest tasks because of it. It's not that they don't perform well, they do, just not as well. |
|
|
skgivenVolunteer moderator Volunteer tester
Send message
Joined: 23 Apr 09 Posts: 3968 Credit: 1,995,359,260 RAC: 0 Level
Scientific publications
|
If you are going to use a Titan at Einstein I think it's best to run several WU's concurrently. IIRC running 7 Einstein WU's takes as long as running 1, but you get 7 times the credits. It's probably the same situation at Albert too.
____________
FAQ's
HOW TO:
- Opt out of Beta Tests
- Ask for Help |
|
|
5potSend message
Joined: 8 Mar 12 Posts: 411 Credit: 2,083,882,218 RAC: 0 Level
Scientific publications
|
Einstein is running new WUs, and for whatever reason, I'm having scaling issues on my 780. They don't scale at a 50% increase in time anymore. In fact, mine were pretty much double.
Again, I can only assume this has something to do with the new WUs, and the bug NVIDIA seems unwilling to fix for them. They're stuck on CUDA 3 or something like that. |
|
|
|
If you are going to use a Titan at Einstein I think it's best to run several WU's consecutively. IIRC running 7 Einstein WU's takes as long as running 1, but you get 7 times the credits. It's probably the same situation at Albert too.
I think you mean concurrently (all at the same time). Consecutively means one after another, the way BOINC normally does things. |
|
|
|
Einstein is running new WUs, and for whatever reason, I'm having scaling issues on my 780. They don't scale at a 50% increase in time anymore. In fact, mine were pretty much double.
Again, I can only assume this has something to do with the new WUs, and the bug NVIDIA seems unwilling to fix for them. They're stuck on CUDA 3 or something like that.
Have a look at http://einstein.phys.uwm.edu/forum_thread.php?id=10028&nowrap=true#125738, posted a week ago in Einstein's "technical news".
This seems to be finally fixed in the current release candidate of CUDA 5.5. We'll see how it comes out when they actually release it.
BM
(the context - the post Bernd was replying to - confirms that 'this' was the problem which has kept them locked down to cuda 3.2) |
|
|
ZarckSend message
Joined: 16 Aug 08 Posts: 145 Credit: 328,473,995 RAC: 0 Level
Scientific publications
|
New driver for nVidia, 326.29
OPENGL 4.4 DRIVER RELEASE NOTES
The Desktop Version for Windows 7 and Windows 8 also supports.
https://developer.nvidia.com/opengl-driver
@+
*_*
____________
|
|
|
|
POEM is working fine on my GTX 780:
http://imgur.com/hGjEn51 |
|
|
|
POEM is working fine on my GTX 780:
http://imgur.com/hGjEn51
Hello: I have seen his work in POEM and it seems that there are variations in the execution of several simultaneous, suppose that various tests.
If I take as a reference the past that seem to be three tasks simultaneously, it has underperformed my GTX770 that even in Ubuntu, I see much difference, I am surprised. |
|
|
QagwaaiSend message
Joined: 12 Aug 09 Posts: 2 Credit: 375,402,248 RAC: 0 Level
Scientific publications
|
just upgraded to 326.19 and tried on my titan. it has cuda 5.5.1 with file version 8.17.13.2619. the NATHAN_KIDKIX wu failed the same way as the 320 version of the driver - immediately upon start. thanks for all the discussion and support - please keep the info streaming. |
|
|
|
just upgraded to 326.19 and tried on my titan. it has cuda 5.5.1 with file version 8.17.13.2619. the NATHAN_KIDKIX wu failed the same way as the 320 version of the driver - immediately upon start. thanks for all the discussion and support - please keep the info streaming.
If You are trying official app, there is no support yet. Beta tasks are not in queue for now. |
|
|
GDFVolunteer moderator Project administrator Project developer Project tester Volunteer developer Volunteer tester Project scientist Send message
Joined: 14 Mar 07 Posts: 1957 Credit: 629,356 RAC: 0 Level
Scientific publications
|
We have tried the latest driver and still the same situation.
No news yet of the specific patch from nvidia.
gdf |
|
|
GDFVolunteer moderator Project administrator Project developer Project tester Volunteer developer Volunteer tester Project scientist Send message
Joined: 14 Mar 07 Posts: 1957 Credit: 629,356 RAC: 0 Level
Scientific publications
|
We have received today the indication of a driver that fixes the problem for both GTX780 and Titan.
We are testing now. Stay tuned.
gdf |
|
|
GDFVolunteer moderator Project administrator Project developer Project tester Volunteer developer Volunteer tester Project scientist Send message
Joined: 14 Mar 07 Posts: 1957 Credit: 629,356 RAC: 0 Level
Scientific publications
|
Good news.
http://www.nvidia.com/object/linux-display-amd64-325.15-driver.html
This driver works for titan and gtx780 in the sense that simulation is now stable.
We will be getting out a new application asap.
gdf
|
|
|
|
Good news.
http://www.nvidia.com/object/linux-display-amd64-325.15-driver.html
This driver works for titan and gtx780 in the sense that simulation is now stable.
We will be getting out a new application asap.
gdf
Have you had any luck with the Windows v326.41 driver, released in Beta a week ago? |
|
|
GDFVolunteer moderator Project administrator Project developer Project tester Volunteer developer Volunteer tester Project scientist Send message
Joined: 14 Mar 07 Posts: 1957 Credit: 629,356 RAC: 0 Level
Scientific publications
|
I have asked which one is the windows version.
gdf |
|
|
5potSend message
Joined: 8 Mar 12 Posts: 411 Credit: 2,083,882,218 RAC: 0 Level
Scientific publications
|
Well thats one down. Fingers crosser windows is released and stable. |
|
|
GDFVolunteer moderator Project administrator Project developer Project tester Volunteer developer Volunteer tester Project scientist Send message
Joined: 14 Mar 07 Posts: 1957 Credit: 629,356 RAC: 0 Level
Scientific publications
|
This is the one:
http://www.nvidia.com/object/win8-win7-winvista-64bit-326.41-beta-driver.html
gdf |
|
|
|
This is the one:
http://www.nvidia.com/object/win8-win7-winvista-64bit-326.41-beta-driver.html
gdf
Yes, that's the one I was asking about. Have you been able to confirm that the Titan fix is present? I don't run a Titan or 780 myself, but I'd like to pass on the news to developers for other projects. |
|
|
5potSend message
Joined: 8 Mar 12 Posts: 411 Credit: 2,083,882,218 RAC: 0 Level
Scientific publications
|
My guess is yes, thats the one. But if youre asking for einstein, they're their own app, but I do hope these fix their issue as well.
release the betas!!
:) |
|
|
OperatorSend message
Joined: 15 May 11 Posts: 108 Credit: 297,176,099 RAC: 0 Level
Scientific publications
|
My guess is yes, thats the one. But if youre asking for einstein, they're their own app, but I do hope these fix their issue as well.
release the betas!!
:)
I'm running Einstein on two Titans using the 326.41 beta and have been since it came out without issues.
Actually I didn't experience any issues running Einstein on previous driver versions (dating back to the release driver) either, so.... the fact that Einstein runs on Titans using the latest beta isn't much of a change for those of us who have that configuration.
Einstein has received the benefit of my Titans while waiting for this project to get sorted.
Operator
____________
|
|
|
5potSend message
Joined: 8 Mar 12 Posts: 411 Credit: 2,083,882,218 RAC: 0 Level
Scientific publications
|
You misunderstand. Einstein is running on CUDA 3, thx to a bug that apparently may be fixed in 5.5. It runs, but is very poorly optimized for 600+ nvidia gpus |
|
|
OperatorSend message
Joined: 15 May 11 Posts: 108 Credit: 297,176,099 RAC: 0 Level
Scientific publications
|
You misunderstand. Einstein is running on CUDA 3, thx to a bug that apparently may be fixed in 5.5. It runs, but is very poorly optimized for 600+ nvidia gpus
Okay, got it.
I guess I shouldn't have splashed out on cards that were this advanced. So much for "future-proofing".
Thanks,
Operator
____________
|
|
|
5potSend message
Joined: 8 Mar 12 Posts: 411 Credit: 2,083,882,218 RAC: 0 Level
Scientific publications
|
Splash away my friend. I've bought 2 780s. Same deal happened to me when the 680s were released. Had to wait several+ weeks in order to get GPUgrid to get their app functioning. Used them over at Einstein@home in the meantime.
Always takes awhile. Sometimes longer than others. I'm expecting Maxwell to take them awhile to release a functioning app when those GPUs come out as well. The anticipated jump in computing performance is so large that I just can't fathom everything working smoothly.
Play some games, d/l 3d mark and try to get a high score. Enjoy your hardware til the devs get their end straightened out. Personally, I've been debating on purchasing crysis 3 and running it at 1440p just to see how far I can push everything.
It's fun. |
|
|
|
Good news.
http://www.nvidia.com/object/linux-display-amd64-325.15-driver.html
This driver works for titan and gtx780 in the sense that simulation is now stable.
We will be getting out a new application asap.
gdf
Thanks for pointing on this driver. This solves CUDA application hang I have experienced. My titans is looking forward to gpugrid. |
|
|
GDFVolunteer moderator Project administrator Project developer Project tester Volunteer developer Volunteer tester Project scientist Send message
Joined: 14 Mar 07 Posts: 1957 Credit: 629,356 RAC: 0 Level
Scientific publications
|
hi,
can you attach the titan to the beta application?
gdf |
|
|
|
I've only seen Zarcks Titan complete a beta. Well three actually but only a 2.6% success rate. Using 326.41 driver, Windows8, Boinc 7.2.1 |
|
|
5potSend message
Joined: 8 Mar 12 Posts: 411 Credit: 2,083,882,218 RAC: 0 Level
Scientific publications
|
I get off work in 4 hours. I can download the new driver and attach my 780s then. Dont know if the fix is only for titans though. |
|
|
|
hi,
can you attach the titan to the beta application?
gdf
My titan is on linux box now. The beta queue has only win app. |
|
|
skgivenVolunteer moderator Volunteer tester
Send message
Joined: 23 Apr 09 Posts: 3968 Credit: 1,995,359,260 RAC: 0 Level
Scientific publications
|
I can download the new driver and attach my 780s then. Dont know if the fix is only for titans though.
It was suggested that the fix would work for both Titan's and GTX780's.
My titan is on linux box now. The beta queue has only win app.
I managed to run Test WU's this evening on Linux (just not on a Titan/780),
7136684 4659550 12 Aug 2013 | 19:20:47 UTC 12 Aug 2013 | 19:23:43 UTC Completed and validated 91.41 89.02 150.00 ACEMD beta version v6.49 (cuda42)
____________
FAQ's
HOW TO:
- Opt out of Beta Tests
- Ask for Help |
|
|
|
6.49 is old beta app. I think. |
|
|
GDFVolunteer moderator Project administrator Project developer Project tester Volunteer developer Volunteer tester Project scientist Send message
Joined: 14 Mar 07 Posts: 1957 Credit: 629,356 RAC: 0 Level
Scientific publications
|
We are testing only Windows for now.
gdf |
|
|
skgivenVolunteer moderator Volunteer tester
Send message
Joined: 23 Apr 09 Posts: 3968 Credit: 1,995,359,260 RAC: 0 Level
Scientific publications
|
So, what are the 6.49 WU's for? |
|
|
5potSend message
Joined: 8 Mar 12 Posts: 411 Credit: 2,083,882,218 RAC: 0 Level
Scientific publications
|
All WUs are crashing instantly.
Not sure if I have show others enabled (or how to) but here ya go http://www.gpugrid.net/result.php?resultid=7138686 |
|
|
|
I have opted out of betas in my preferences but I'm still getting them. What's up with that? |
|
|
|
I have opted out of betas in my preferences but I'm still getting them. What's up with that?
http://www.gpugrid.net/forum_thread.php?id=3272#28337
____________
XtremeSystems.org - #1 Team in GPUGrid |
|
|
ZarckSend message
Joined: 16 Aug 08 Posts: 145 Credit: 328,473,995 RAC: 0 Level
Scientific publications
|
New driver for nVidia, 326.58
OPENGL 4.4 DRIVER RELEASE NOTES
The Desktop Version for Windows 7 and Windows 8 also supports.
https://developer.nvidia.com/opengl-driver
@+
*_*
____________
|
|
|
OperatorSend message
Joined: 15 May 11 Posts: 108 Credit: 297,176,099 RAC: 0 Level
Scientific publications
|
Currently using 326.41 on two Titans.
Downloaded two WU:
2x18-SANTI_RAP74wt-15-34-RND2514_0
and
14x17-SANTI_RAP74wt-8-34-RND4310_0
Both errored out within 1 second.
....back to Einstein...
Operator
____________
|
|
|
ZarckSend message
Joined: 16 Aug 08 Posts: 145 Credit: 328,473,995 RAC: 0 Level
Scientific publications
|
For my Titan, back to BitCoin utopia, and Rosetta for my Cpu.
http://boinc.bakerlab.org/rosetta/
http://www.bitcoinutopia.com
"Lots of changes
I made three new projects:
Project #1: Donating $1000 for Mars One
Project #2: Donating $1000 for SETI@home
Project #3: Donating $399 for Hydroponics Research Stage 1
I also changed the bitcoin pool. The old was 50BTC. The new is BitMinter. It also generates some namecoins when mining bitcoins for BitMinter. I also tested p2pool.org (the one I used for mining a good amount of terracoins), but I cancelled most of those workunits yesterday. Not only namecoins, but Bitminter also allows to use Java application to mine for Bitminter pool. I'll add that to the project website soon.
Henri."
____________
|
|
|
StefanProject administrator Project developer Project tester Project scientist Send message
Joined: 5 Mar 13 Posts: 348 Credit: 0 RAC: 0 Level
Scientific publications
|
Operator: At this point only the Beta queue is supposed to work for Titans. So we are testing them there. If we see that they work in the Beta we will put it to the other queues too. So it's pretty clear that it would crash on the short (or is Santi long?) |
|
|
OperatorSend message
Joined: 15 May 11 Posts: 108 Credit: 297,176,099 RAC: 0 Level
Scientific publications
|
Operator: At this point only the Beta queue is supposed to work for Titans. So we are testing them there. If we see that they work in the Beta we will put it to the other queues too. So it's pretty clear that it would crash on the short (or is Santi long?)
Okay, my bad. I didn't realize I had shifted my preferences to allow all WUs instead of just the beta queue chunks.
Will try it again with 'beta only' preferences to see what happens.
Operator.
____________
|
|
|
OperatorSend message
Joined: 15 May 11 Posts: 108 Credit: 297,176,099 RAC: 0 Level
Scientific publications
|
Will try it again with 'beta only' preferences to see what happens.
Operator.
Nope, still no joy.
____________
|
|
|
Husu*Send message
Joined: 25 Mar 09 Posts: 8 Credit: 100,005,181 RAC: 0 Level
Scientific publications
|
Just FYI.
I've had weird sporadic crashes with Titan on all CUDA applications so haven't been able to try any science applications properly, mainly Primegrid Genefer & Genefer WR though. Crashes happened even when downclocking the Titan all the way down and even now on totally new platform (Haswell).
Been following different projects which would have Titan support, but it seems it really was the driver which have been faulty.
The new Nvidia Beta driver 326.41 seems to have fixed this, at least my Primegrid Genefer runs have been all successful with no crashes on Cuda and OpenCL after updating to that driver version.
Before that using any driver and downclocking the GPU did not help. Now it runs happily with double precision enabled on default clocks of the card, with driver 326.41. No crashes and no errors.
I might be able to test GPUGrid beta run later on to see if it works for your application also. Will try to set up everything later on the evening. |
|
|
w6msuSend message
Joined: 30 Nov 10 Posts: 4 Credit: 278,484,571 RAC: 0 Level
Scientific publications
|
Hello!,
Any reports on beta 326.80?
Thanks. |
|
|
ZarckSend message
Joined: 16 Aug 08 Posts: 145 Credit: 328,473,995 RAC: 0 Level
Scientific publications
|
GeForce Driver 326.84, Ok for me with my TITAN.
https://developer.nvidia.com/opengl-driver
____________
|
|
|
QagwaaiSend message
Joined: 12 Aug 09 Posts: 2 Credit: 375,402,248 RAC: 0 Level
Scientific publications
|
GeForce Driver 326.84 - works for me for *-NATHAN_ based work units. woot!
____________
|
|
|
OperatorSend message
Joined: 15 May 11 Posts: 108 Credit: 297,176,099 RAC: 0 Level
Scientific publications
|
Running 326.84 on two Titans and for the most part completing Nathan and Harvey Betas without a problem.
http://www.gpugrid.net/results.php?hostid=152263
Thanks for all your efforts and I look forward to shifting this box out of the 'beta only' mode and back to the mainstream just as soon as I get the word from you folks that we are production ready.
Thanks,
Operator
____________
|
|
|
MJHProject administrator Project developer Project scientist Send message
Joined: 12 Nov 07 Posts: 696 Credit: 27,266,655 RAC: 0 Level
Scientific publications
|
Thanks for all your efforts and I look forward to shifting this box out of the 'beta only' mode and back to the mainstream just as soon as I get the word from you folks that we are production ready.
It's live on ACEMD-Short now. Long in a week or so.
MJH |
|
|