Maxwell now

Message boards : Graphics cards (GPUs) : Maxwell now
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 . . . 14 · Next

AuthorMessage
Profile robertmiles

Send message
Joined: 16 Apr 09
Posts: 503
Credit: 769,991,668
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38058 - Posted: 24 Sep 2014, 19:56:15 UTC

Something I'm having trouble finding: How well do the new cards using PCIE3 work if the motherboard has only PCIE2 sockets?
ID: 38058 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 11 Jul 09
Posts: 1639
Credit: 10,159,968,649
RAC: 261
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38059 - Posted: 24 Sep 2014, 20:45:42 UTC - in response to Message 38058.  

Something I'm having trouble finding: How well do the new cards using PCIE3 work if the motherboard has only PCIE2 sockets?

Physically, the sockets are the same. Electrically, they're compatible.
ID: 38059 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Retvari Zoltan
Avatar

Send message
Joined: 20 Jan 09
Posts: 2380
Credit: 16,897,957,044
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38060 - Posted: 24 Sep 2014, 22:18:25 UTC - in response to Message 38058.  

Something I'm having trouble finding: How well do the new cards using PCIE3 work if the motherboard has only PCIE2 sockets?

We'll find out when there will be a working GPUGrid app, as I will move my GTX 980 to another host wich has PCIe3.
ID: 38060 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Retvari Zoltan
Avatar

Send message
Joined: 20 Jan 09
Posts: 2380
Credit: 16,897,957,044
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38061 - Posted: 24 Sep 2014, 22:55:59 UTC - in response to Message 38055.  

And while we're at it: what about memory controller load?

Folding@home: 23%
Einstein@home 2 tasks: 62-69% (Perseus arm survey/BRP5 & Arecibo, GPU/BRP4G)
Einstein@home 1 task : 46-48% (Perseus arm survey/BRP5)
Einstein@home 1 task : 58-64% (Arecibo, GPU/BRP4G)
ID: 38061 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
biodoc

Send message
Joined: 26 Aug 08
Posts: 183
Credit: 10,085,929,375
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38062 - Posted: 25 Sep 2014, 0:21:49 UTC

I've got my GTX980 running on linux.

I'm also unable to get any beta work on GPUGrid.


ID: 38062 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile @tonymmorley

Send message
Joined: 10 Mar 14
Posts: 24
Credit: 1,215,128,812
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwat
Message 38066 - Posted: 25 Sep 2014, 7:54:38 UTC

Just got two GTX 980's, will install tomorrow. Should be interesting to see how we go!
ID: 38066 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
biodoc

Send message
Joined: 26 Aug 08
Posts: 183
Credit: 10,085,929,375
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38067 - Posted: 25 Sep 2014, 8:47:13 UTC - in response to Message 38048.  

What does Boinc say, about amount of (peak) FLOPS in event log for GTX980? Near 5TeraFLOPS? Over at Mersenne trial-factoring--- a GTX980 is listed @ 1,126GHz and 4,710 GFLOPS.

Could somebody running a Maxwell-aware version of BOINC check and report this, please, and do a sanity-check of whether BOINC's figure is correct from what you know of the card's SM count, cores per SM, shader clock, flops_per_clock etc. etc? We got the figures for the 'baby Maxwell' 750/Ti into BOINC on 24 February (3edb124ab4b16492d58ce5a6f6e40c2244c97ed6), but I think that was just too late to catch v7.2.42

We're in a similar position this time, with v7.4.22 at release-candidate stage - I'd say that one was safe to test with, if nobody here has upgraded yet. TIA.


Here's what boinc 7.4.22 (64bit-linux version) is reporting:

Starting BOINC client version 7.4.22 for x86_64-pc-linux-gnu
CUDA: NVIDIA GPU 0: GeForce GTX 980 (driver version 343.22, CUDA version 6.5, compute capability 5.2, 4096MB, 3557MB available, 4979 GFLOPS peak)
OpenCL: NVIDIA GPU 0: GeForce GTX 980 (driver version 343.22, device version OpenCL 1.1 CUDA, 4096MB, 3557MB available, 4979 GFLOPS peak)
ID: 38067 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
eXaPower

Send message
Joined: 25 Sep 13
Posts: 293
Credit: 1,897,601,978
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 38068 - Posted: 25 Sep 2014, 10:17:13 UTC - in response to Message 38067.  

What does Boinc say, about amount of (peak) FLOPS in event log for GTX980? Near 5TeraFLOPS? Over at Mersenne trial-factoring--- a GTX980 is listed @ 1,126GHz and 4,710 GFLOPS.

Could somebody running a Maxwell-aware version of BOINC check and report this, please, and do a sanity-check of whether BOINC's figure is correct from what you know of the card's SM count, cores per SM, shader clock, flops_per_clock etc. etc? We got the figures for the 'baby Maxwell' 750/Ti into BOINC on 24 February (3edb124ab4b16492d58ce5a6f6e40c2244c97ed6), but I think that was just too late to catch v7.2.42

We're in a similar position this time, with v7.4.22 at release-candidate stage - I'd say that one was safe to test with, if nobody here has upgraded yet. TIA.


Here's what boinc 7.4.22 (64bit-linux version) is reporting:

Starting BOINC client version 7.4.22 for x86_64-pc-linux-gnu
CUDA: NVIDIA GPU 0: GeForce GTX 980 (driver version 343.22, CUDA version 6.5, compute capability 5.2, 4096MB, 3557MB available, 4979 GFLOPS peak)
OpenCL: NVIDIA GPU 0: GeForce GTX 980 (driver version 343.22, device version OpenCL 1.1 CUDA, 4096MB, 3557MB available, 4979 GFLOPS peak)


OpenCl 1.1 ! Spec from 2010 (Fermi)
2.0 OpenCL spec been released for almost a year. This is Nvidia telling Intel and AMD, they don't give a hoot about OpenCL, because of CUDA.

ID: 38068 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
localizer

Send message
Joined: 17 Apr 08
Posts: 113
Credit: 1,656,514,857
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38069 - Posted: 25 Sep 2014, 10:43:59 UTC

............. Any more thoughts on when we might see a revised app for the 980 - mine looks very nice, but I'd like to put it to work!!

Thanks,
P.
ID: 38069 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Retvari Zoltan
Avatar

Send message
Joined: 20 Jan 09
Posts: 2380
Credit: 16,897,957,044
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38070 - Posted: 25 Sep 2014, 12:21:07 UTC - in response to Message 38066.  
Last modified: 25 Sep 2014, 12:21:27 UTC

Just got two GTX 980's, will install tomorrow. Should be interesting to see how we go!

We're waiting for a working app, so prepare a spare project for awhile.
ID: 38070 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
biodoc

Send message
Joined: 26 Aug 08
Posts: 183
Credit: 10,085,929,375
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38071 - Posted: 25 Sep 2014, 13:49:27 UTC - in response to Message 38051.  

There's now a linux build on acemdbeta. You'll definitely be needing to use a Linux client that reports the right driver version.


I've got the latest boinc client for linux but am still getting no tasks for my GTX 980.

Thu 25 Sep 2014 07:29:53 AM EDT |  | Starting BOINC client version 7.4.22 for x86_64-pc-linux-gnu
Thu 25 Sep 2014 07:29:53 AM EDT |  | log flags: file_xfer, sched_ops, task
Thu 25 Sep 2014 07:29:53 AM EDT |  | Libraries: libcurl/7.35.0 OpenSSL/1.0.1f zlib/1.2.8 libidn/1.28 librtmp/2.3
Thu 25 Sep 2014 07:29:53 AM EDT |  | Data directory: /home/mark/BOINC
Thu 25 Sep 2014 07:29:53 AM EDT |  | CUDA: NVIDIA GPU 0: GeForce GTX 980 (driver version 343.22, CUDA version 6.5, compute capability 5.2, 4096MB, 3566MB available, 4979 GFLOPS peak)
Thu 25 Sep 2014 07:29:53 AM EDT |  | OpenCL: NVIDIA GPU 0: GeForce GTX 980 (driver version 343.22, device version OpenCL 1.1 CUDA, 4096MB, 3566MB available, 4979 GFLOPS peak)
Thu 25 Sep 2014 09:48:27 AM EDT | GPUGRID | Sending scheduler request: Requested by user.
Thu 25 Sep 2014 09:48:27 AM EDT | GPUGRID | Requesting new tasks for NVIDIA GPU
Thu 25 Sep 2014 09:48:29 AM EDT | GPUGRID | Scheduler request completed: got 0 new tasks
Thu 25 Sep 2014 09:48:29 AM EDT | GPUGRID | No tasks sent
Thu 25 Sep 2014 09:48:29 AM EDT | GPUGRID | No tasks are available for ACEMD beta version
Thu 25 Sep 2014 09:48:29 AM EDT | GPUGRID | No tasks are available for the applications you have selected.

ID: 38071 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Retvari Zoltan
Avatar

Send message
Joined: 20 Jan 09
Posts: 2380
Credit: 16,897,957,044
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38073 - Posted: 25 Sep 2014, 18:43:47 UTC
Last modified: 25 Sep 2014, 18:48:29 UTC

Regarding the power consumption of the new BigMaxwell:
I had a different GPU workunit from folding@home (project 7621) on my GTX980, and it had different readouts:
GPU usage: 99-100% (this WU had a much lower CPU thread utilization ~1%)
GPU power 87-88% (~150W increase measured at the wall outlet)
GPU temperature: 63°C (ambient: 24°C)
GPU memory controller load: 26%
GPU memory used: 441MB
GPU voltage: 1.218V
GPU core clock: 1240MHz
ID: 38073 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
biodoc

Send message
Joined: 26 Aug 08
Posts: 183
Credit: 10,085,929,375
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38074 - Posted: 25 Sep 2014, 19:45:29 UTC - in response to Message 38073.  

Regarding the power consumption of the new BigMaxwell:
I had a different GPU workunit from folding@home (project 7621) on my GTX980, and it had different readouts:
GPU usage: 99-100% (this WU had a much lower CPU thread utilization ~1%)
GPU power 87-88% (~150W increase measured at the wall outlet)
GPU temperature: 63°C (ambient: 24°C)
GPU memory controller load: 26%
GPU memory used: 441MB
GPU voltage: 1.218V
GPU core clock: 1240MHz


Project 7621 uses the GPU "core 15" (Fahcore:0x15) version which is the oldest GPU client and runs exclusively on Windows machines. Those Wus generally run hot and use very little CPU as you've noticed. They are fixed credit WUs so PPD is low.

Core 17 WUs are more efficient since they use a more recent version of openMM and are distributed to both windows and linux via an OpenCL app. They generally use 100% of a core on machines with an Nvidia card. These WUs offer a quick return bonus (QRB) and are very popular because the faster the card the higher the bonus.

My GTX980 has finished several 9201 project (core17) WUs and is averaging 330,000 ppd. Amazing.

Linux users have an advantage in that only core 17 WUs are delivered to linux machines.

There are core 18 WUs now available to windows users. I don't know anything about them yet.
ID: 38074 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Retvari Zoltan
Avatar

Send message
Joined: 20 Jan 09
Posts: 2380
Credit: 16,897,957,044
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38075 - Posted: 26 Sep 2014, 0:18:05 UTC - in response to Message 38050.  

The acemd.841-65.exe file is 3.969.024 bytes long, but the acemd.842-65.exe is only 1.112.576 bytes long, so something went wrong with the latter.

no, that's deliberate. It's a Maxwell-only build

I've made my BOINC manager to start this acemd.842-65.exe as an acemd.841-60.exe by overwriting the latter and setting <dont_check_file_sizes> in the cc_config.xml, and I've modified the client_state.xml to copy the cudart32_65.dll and the cufft32_65.dll to the slot with the app, but I've got the same result as before with the 841-65 client.
#SWAN: FATAL: cannot find image for module [.nonbonded.cu.] for device version 520

http://www.gpugrid.net/result.php?resultid=13130843
http://www.gpugrid.net/result.php?resultid=13132835
http://www.gpugrid.net/result.php?resultid=13135543
ID: 38075 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
biodoc

Send message
Joined: 26 Aug 08
Posts: 183
Credit: 10,085,929,375
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38079 - Posted: 26 Sep 2014, 8:46:35 UTC

I have data comparing my 780Ti with the 980 at Folding@home.

hardware:
780Ti (only gpu in system) in 2600K, PCIE2 slot, 64-bit linux mint 17 LTS, nvidia driver 343.22
980 (only gpu in system) in 3930K, PCIE2 slot, 64-bit linux mint 17 LTS, nvidia driver 343.22

Project 9201 (core 17)
780Ti@1106MHz (+100MHz OC): TPF=117 seconds, PPD=255,750
980@1352MHz (+100MHz OC): TPF=93 seconds, PPD=360,510

Looks like a 20.5% reduction in TPF. Seems to correlate with difference in clock speed (22%)?

It's not a perfect comparison but it's the best I can do.
ID: 38079 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile MJH

Send message
Joined: 12 Nov 07
Posts: 696
Credit: 27,266,655
RAC: 0
Level
Val
Scientific publications
watwat
Message 38080 - Posted: 26 Sep 2014, 9:46:19 UTC - in response to Message 38075.  

Well, I've not fixed the scheduler, but would you like to try that trick again with the new version 844?

Matt
ID: 38080 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Retvari Zoltan
Avatar

Send message
Joined: 20 Jan 09
Posts: 2380
Credit: 16,897,957,044
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38081 - Posted: 26 Sep 2014, 10:39:07 UTC - in response to Message 38080.  

Well, I've not fixed the scheduler, but would you like to try that trick again with the new version 844?

Matt

At once, sire. :)
ID: 38081 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Retvari Zoltan
Avatar

Send message
Joined: 20 Jan 09
Posts: 2380
Credit: 16,897,957,044
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38082 - Posted: 26 Sep 2014, 10:48:33 UTC - in response to Message 38080.  
Last modified: 26 Sep 2014, 10:56:35 UTC

Well, I've not fixed the scheduler, but would you like to try that trick again with the new version 844?

Matt

...aaaaand we have a lift-off!
It's crunching.
# GPU [GeForce GTX 980] Platform [Windows] Rev [3212] VERSION [65]
# SWAN Device 0	:
#	Name		: GeForce GTX 980
#	ECC		: Disabled
#	Global mem	: 4095MB
#	Capability	: 5.2
#	PCI ID		: 0000:03:00.0
#	Device clock	: 1215MHz
#	Memory clock	: 3505MHz
#	Memory width	: 256bit
#	Driver version	: r343_98 : 34411
# GPU 0 : 41C
# GPU 0 : 43C
# GPU 0 : 44C
# GPU 0 : 46C
# GPU 0 : 47C
# GPU 0 : 49C
# GPU 0 : 50C
# GPU 0 : 52C
# GPU 0 : 53C
# GPU 0 : 54C
# GPU 0 : 55C
# GPU 0 : 56C
# GPU 0 : 57C
# GPU 0 : 58C
# GPU 0 : 59C
# GPU 0 : 60C
# GPU 0 : 61C
# GPU 0 : 62C
# GPU 0 : 63C


709-NOELIA_20MGWT-1-5-RND4766_0
GPU usage: 93-97% (CPU 100%, PCIe2.0x16)
GPU power 93% (~160W increase measured at the wall outlet)
GPU temperature: 64°C (ambient: 24°C)
GPU memory controller load: 50%
GPU memory used: 825MB
GPU voltage: 1.218V
GPU core clock: 1240MHz

I estimate it will take 19.200 sec to finish this workunit (5h20m), which is more than it takes on a GTX780Ti (16.712), so I really should move this card to another host with PCIe3.0.
ID: 38082 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
biodoc

Send message
Joined: 26 Aug 08
Posts: 183
Credit: 10,085,929,375
RAC: 0
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 38083 - Posted: 26 Sep 2014, 11:34:32 UTC

Good news that the app is working but disappointing performance.

Time to move the windows and (linux?) app to "non-beta"?
ID: 38083 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
eXaPower

Send message
Joined: 25 Sep 13
Posts: 293
Credit: 1,897,601,978
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 38084 - Posted: 26 Sep 2014, 12:09:02 UTC - in response to Message 38083.  
Last modified: 26 Sep 2014, 12:17:33 UTC

Good news that the app is working but disappointing performance.

Time to move the windows and (linux?) app to "non-beta"?


Disappointing compared to GK110? Or GK104 boards? GTX980 (64DP cores/4DPperSMM/1DPper32coreblock) is replacement for GTX680 (64DP/8DPperSMX), NOT 96DPcore GTX780 or 120DPcore GTX780ti. Titan(Black)250TDP have 896/960 DP cores (64DPperSMX)
Compared to GTX680, I'd say GTX980 is an excellent performer, other than Double Float.
ID: 38084 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 . . . 14 · Next

Message boards : Graphics cards (GPUs) : Maxwell now

©2025 Universitat Pompeu Fabra