Slashdot Mirror


Nvidia Announces 'Nvidia Titan V' Video Card: GV100 for $3000 (anandtech.com)

Nvidia has announced the Titan V, the "world's most powerful PC GPU." It's based on Nvidia's Volta, the same architecture as the Nvidia Tesla V100 GPUs behind Amazon Web Service's recently launched top-end P3 instances, which are dedicated to artificial-intelligence applications. From a report: A mere 7 months after Volta was announced with the Tesla V100 accelerator and the GV100 GPU inside it, Nvidia continues its breakneck pace by releasing the GV100-powered Titan V, available for sale today. Aimed at a decidedly more compute-oriented market than ever before, the 815 mm2 behemoth die that is GV100 is now available to the broader public. [...] The Titan V, by extension, sees the Titan lineup finally switch loyalties and start using Nvidia's high-end compute-focused GPUs, in this case the Volta architecture based V100. The end result is that rather than being Nvidia's top prosumer card, the Titan V is decidedly more focused on compute, particularly due to the combination of the price tag and the unique feature set that comes from using the GV100 GPU. Which isn't to say that you can't do graphics on the card -- this is still very much a video card, outputs and all -- but Nvidia is first and foremost promoting it as a workstation-level AI compute card, and by extension focusing on the GV100 GPU's unique tensor cores and the massive neural networking performance advantages they offer over earlier Nvidia cards.

51 comments

  1. Why even call this a video card? by Anonymous Coward · · Score: 1

    It's like a number crunching daughtercard that can maybe do video too as a secondary feature.

  2. But can it pay for itself mining Coin? by bobbied · · Score: 2

    Somehow, I seriously doubt it.

    --
    "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
    1. Re:But can it pay for itself mining Coin? by Anonymous Coward · · Score: 0

      Sounds like it's more focused on ML for the cloud, rather than cryptocurrency in the colo center.

    2. Re:But can it pay for itself mining Coin? by NicknameUnavailable · · Score: 2

      It might be more useful in the realm of folding. Folding is a much more complex operation and tends to need more RAM, more cores being useful as well, and fast throughput on the bus. The big issue with mining cards when applied to folding is that you can't get a motherboard supporting more than 4, maybe 6 PCIe 8x-16x bus lines then you need a CPU core for each card on top of it. If you can pack 2 GPUs worth of power into a single card suddenly you have double the capacity (or rather, nearly on part with the 12 GPUs you can pack into a mining machine with PCIe 1x buses.)

    3. Re:But can it pay for itself mining Coin? by DontBeAMoran · · Score: 1

      Look up the numbers for mining Monero.

      --
      #DeleteFacebook
    4. Re:But can it pay for itself mining Coin? by afidel · · Score: 1

      EPYC has 128 PCIe lanes so it can support 16 8x cards and it has 2 cores for each of those cards. I doubt there are any motherboards that support that many lanes but one could be built (most I've seen is 8 full length slots).

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    5. Re:But can it pay for itself mining Coin? by Anonymous Coward · · Score: 0

      This is a workstation card, or card for a workstation. The cooling solution reveals its nature.

    6. Re:But can it pay for itself mining Coin? by NicknameUnavailable · · Score: 1

      What the name of the motherboard with 8 PCIe 8x or higher slots?

    7. Re:But can it pay for itself mining Coin? by Anonymous Coward · · Score: 1

      Here's one from Supermicro with 8 PCI-E 3.0 x16: https://www.supermicro.com/products/system/4U/4028/SYS-4028GR-TRT.cfm

    8. Re:But can it pay for itself mining Coin? by NicknameUnavailable · · Score: 1

      Thanks.

    9. Re:But can it pay for itself mining Coin? by Anonymous Coward · · Score: 0

      eh? why do you need an 8x or 16x lane for mining? 1x works fine. that's what miners do - they break out the lanes as much as possible to amortize the cost of CPU/motherboard.

    10. Re:But can it pay for itself mining Coin? by Shinobi · · Score: 1

      It still comes down to how the PCI-E root complex is setup. There are situations where communicating over Infiniband to a different GPU in the same machine is faster than going through the root complex.

    11. Re:But can it pay for itself mining Coin? by arth1 · · Score: 1

      This is a workstation card, or card for a workstation.

      Is it? As far as I know, all nVidia's workstation cards are named Quadro and have the ability to run certified drivers tweaked for workstation applications, like CAD/CAM and rendering apps.
      I expect that there will be a corresponding workstation card, which will cost far more for similar hardware, but this is to my knowledge not one.

    12. Re:But can it pay for itself mining Coin? by Anonymous Coward · · Score: 0

      That's why the "card for a workstation" (non-rack PC for doing also work besides gaming ;)) just like the previous Titans. This thing uses the normal GeForce drivers so it's not a Quadro card. I wouldn't expect NVidia going AMD route yet with their Radeo Pro drivers for non-Firepro cards.

  3. Too bad it's Windows only. by Anonymous Coward · · Score: 0

    Microsoft will use your $3000 GPU for high-end AI telemetry.

    1. Re:Too bad it's Windows only. by Anonymous Coward · · Score: 0

      It's the new minimum spec for an upcoming Windows update, everyone will need the new gfx card.

    2. Re: Too bad it's Windows only. by Anonymous Coward · · Score: 0

      Source?

  4. But will the drivers work? by Anonymous Coward · · Score: 1

    It's funny because I used to think AMD's drivers were crap, but since switching from an AMD A-10 to an NVidia GTX, and updated drivers, all kinds of bugs and errors manifest. What good is a $3000 video board if the drivers are acting up?

    1. Re:But will the drivers work? by bobbied · · Score: 2

      Lots of drivers are crap these days...

      Why? Which one of you can write C or C++ anymore?

      I have a Linksys router that has crappy wireless drivers with memory leaks. Paid a pile of money for it. It locks up about twice a week and requires a full factory reset to fix it. Linksys got the wireless drivers from the chip maker (or so they say) as a blob so they claim to be at their mercy. Who over there at the WiFi chip manufacturer doesn't know how to track down and fix memory leaks? I can see the first revision of the driver sneaking out with bugs because you simply have to meet the delivery deadlines, but we are on the third release now and STILL the problem persists....

      I'm beginning to think nobody does quality drivers anymore. Just reboot every few days to fix it.... Now get off my lawn and learn to code in a language that doesn't have garbage collection...

      --
      "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
    2. Re:But will the drivers work? by 110010001000 · · Score: 1

      All the software on your Linksys is made in Asia now.

    3. Re:But will the drivers work? by NicknameUnavailable · · Score: 1

      Which one of you can write C or C++ anymore?

      I do, but I choose to work on legacy VB6 instead. Also, driver optimizations should be done with assembly.

    4. Re:But will the drivers work? by Kjella · · Score: 1

      Lots of drivers are crap these days... Why? Which one of you can write C or C++ anymore?

      Lots of people can. They're just busy doing more important things than writing drivers for consumer trinkets.

      --
      Live today, because you never know what tomorrow brings
    5. Re:But will the drivers work? by Anonymous Coward · · Score: 0

      If you work on legacy VB6, then you actually *can't* write C or C++ anymore.

      I'm just letting you know.

    6. Re:But will the drivers work? by bobbied · · Score: 1

      Maybe the chipset stuff is, but under the covers the routers I have from Linksys run OpenWRT with their own UI glued on. I run OpenWRT/LUCI on them myself, once the warranty period is over. In fact, I don't buy residential routers that OpenWRT won't run on anymore...

      --
      "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
  5. I'll wait by Oswald+McWeany · · Score: 1

    I'll wait until I can purchase it for $100.

    --
    "That's the way to do it" - Punch
    1. Re:I'll wait by Anonymous Coward · · Score: 0

      by then it will be worth $100

    2. Re:I'll wait by Oswald+McWeany · · Score: 1

      That's fine... that's my non-shifting price point for a video card. You can always get a "good enough" video card for $100... that logic has held true for 20 years.

      --
      "That's the way to do it" - Punch
    3. Re:I'll wait by Anonymous Coward · · Score: 0

      Well there is the TITAN Xp Star Wars Edition. But it's a much lower spec card than TITAN V and more like $1200 retail instead of $5000.

      obviously you should run both the dark side and the light side in the same machine to have a proper Star Wars experience.

    4. Re:I'll wait by Tough+Love · · Score: 1

      Actually, $100 always gets you a "too slow to play the latest games on high settings" video card, while $200 (nearly) always gets you a more than satisfactory experience. That said, I put a $50 fanless GPU in my primary workstation just for the blessed silence. The gaming machine beside it has a $140 GPU (RX 460) that will easily meet my needs until AMD's next process shrink arrives. What I want in my next card: 3X throughput bump, but fans completely stopped when not cranking 3D. Reasonable to expect given that the 460 already runs nearly silent at idle.

      --
      When all you have is a hammer, every problem starts to look like a thumb.
  6. Imagine a Beowulf cluster of these by Anonymous Coward · · Score: 3, Funny

    Imagine a Beowulf cluster of these

    1. Re:Imagine a Beowulf cluster of these by DontBeAMoran · · Score: 1

      Do you want to heat your house?
      Because that's how you heat your house.

      --
      #DeleteFacebook
  7. Built for number crunching by UnknownSoldier · · Score: 4, Informative

    Before we get the deluge of "What's this used for?" we need to take a look at the specs.

    Float64 performance is only 1/2 of float32 -- WOW! This thing is built for number crunching! (The original Titan has 1/3 float64 performance. Gamers screamed bloody murder when it sold at $1,000 but they weren't the target audience.)

    Bandwidth has been neutered at only 653 GB/sec due to the 3,072 bit Memory Bus Width compared to 900 GB/sec of the Tesla V100.

    Compared to spending to $10,000 at $3,000 this is basically the "poor man's" Tesla V100 specifically designed for AI. I see the full 640 Tensor Cores.

    TL:DR; If you are doing number crunching (C's "double"), or AI / ML (machine learning) this might be a bargain GPU. Otherwise, it has almost zero practical value from a Gamer's POV.

    1. Re:Built for number crunching by afidel · · Score: 2, Interesting

      What's interesting is the difference between the NVidia approach and Google's TensorFlow approach. NVidia is beefing up FLOAT64 performance while Google focused on 8bit and 16bit performance (OPS/W) which is why Googles newest gaming challenge used a single TPU running at 40W to run the AI (after training on 5,000 TPUs and thousands of cores).

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    2. Re:Built for number crunching by UnknownSoldier · · Score: 1

      I caught that too. nVidia, in traditional fashion, is "going narrow and deep", while Google is "going wide but shallow".

      You bring up an excellent point. Things are about to get REAL interesting in the ML space. It will be very exciting to see what/where each respective card excels at (pardon the pun) along with the benchmarks.

    3. Re:Built for number crunching by Guybrush_T · · Score: 2

      Quite the opposite. The focus seems to be on fp16 with tensor cores massively increasing the throughput at that precision. But fp64 is good as well, which could be good for other professional applications.

    4. Re:Built for number crunching by enjar · · Score: 2

      Exactly. We had it in the plans to acquire some V100 servers as part of an upgrade this year, as well as update some of our Dev/QE desktops to the very dearly priced GP100. Management had seen the numbers for that and were kind of holding their noses while saying "yes" because 1) they had real-live business reasons for us to do it and 2) those business reasons are considered a high priority but 3) the plan was expensive, no two ways about it. Now that this is an option, the numbers look considerably better. I wonder if nVidia wasn't getting a lot of traction on the V100 cards. Compared to the prices that P100, K40/80/20, C* and the original Tesla cards debuted at, the V100 seemed like quite the step-function, especially when you have the GTX equivalents that are doing fantastic single performance stuff at price scales set for the consumer market. Our management understands there's a "server markup", but when "markup" starts to sound more like "gouging", smart people figure out ways around the problem.

  8. Re:Nvidia is infecting the world with systemd by Anonymous Coward · · Score: 0

    Now systemd will drive our graphics stack! Why can't we program our games in init scripts?

    What? With this Up Start? Naw!

  9. I'll wait by Anonymous Coward · · Score: 0

    Until they release the 5000 buck Collector's edition with Nvidia Titan dancing badge.

  10. Nice, But... by Anonymous Coward · · Score: 0

    Can it run Crysis?

  11. Sure, by rsilvergun · · Score: 1

    But can it run Crysis?

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
    1. Re:Sure, by Anonymous Coward · · Score: 0

      Everything can run Crysis nowadays, but still, this is definitely not an ideal card for gaming.
      They sacrificed speed for concurrency and a huge scale and focused on number crunching + ML features rather than vortex and shader processing.

      If you're looking for a gaming card, this is way overpriced and will give you disappointingly low bang for your buck.

    2. Re:Sure, by Anonymous Coward · · Score: 0

      http://knowyourmeme.com/memes/but-can-it-run-crysis

    3. Re:Sure, by Anonymous Coward · · Score: 0

      i beg to differ https://www.youtube.com/watch?v=bOEvpFEjRNs 30-40 fps at 4k

  12. CUDA ? by DrYak · · Score: 1

    Normally, this kind of graphic cards are supported by the proprietary closed-source drivers for Linux, and corresponding CUDA SDK.

    It wouldn't make much sense for Nvidia to NOT release Linux support for it, as an GPU-based AI-accelerator, they would be missing on the big Linux HPC market segment (common is there any super computer still rellevant nowadays that doesn't run any unix ?)
    Though they would definitely be supporting Windows too (not to miss on the lucrative "extreme gamer enthousiast" market, and people working in graphics)

    The whole point of Nvidia's proprietary Linux driver is that they can share code base with their Windows drivers.

    (And it doesn't matter if this driver doesn't properly mode set onlinux : on Linux Titan V are most likely to end-up on headless compute nodes on some cluster)
    (Neither does it matter if this driver can't properly resume after a suspend : on Linux Titan Vs aren't going to be used in laptops. Ever).

    --
    "Sufficiently advanced satire is indistinguishable from reality." - [Tips: 1DrYakQDKCQ6y52z6QbnkxHXAocMZJE61o ]
    1. Re:CUDA ? by Anonymous Coward · · Score: 0

      Do you not put your computer to sleep when not using it? May as well be mining bitcoin with that wasted power

    2. Re: CUDA ? by Anonymous Coward · · Score: 0

      Standby uses what, 500mW? You arenâ(TM)t missing out on many hashes with that sort of power budget.

    3. Re:CUDA ? by Anonymous Coward · · Score: 0

      Don't mine for coins, mine for keys...

      https://lbc.cryptoguru.org/about

  13. Drivers.... by DrYak · · Score: 1

    What good is a $3000 video board if the drivers are acting up?

    The main target segment for this card is scientific computation.
    Most of the Titan Vs sold are going to end-up on Linux compute nodes in some universities or other.
    Their output connectors are almost not likely to get plugged into anything ever.
    Not a problem if their Direct X drivers are acting up a bit.
    CUDA SDK is the thing that they most definitely need to get working right.

    In terms of volume sold, the few hardcore extreme enthusiast gamers who are going to stuff them into Windows workstations are only icing on the cake.

    It's funny because I used to think AMD's drivers were crap, but since switching from an AMD A-10 to an NVidia GTX, and updated drivers, all kinds of bugs and errors manifest.

    AMD drivers crap ?
    On windows, maybe. (Haven't tested since long time ago)
    On Linux, since AMD finished transitioning to the opensource stack (well except for the ROCm/OpenCL bits and the current opensource source Vulkan still not being the official AMD one), their drivers are among the best.

    --
    "Sufficiently advanced satire is indistinguishable from reality." - [Tips: 1DrYakQDKCQ6y52z6QbnkxHXAocMZJE61o ]
  14. Sounds great by Anonymous Coward · · Score: 0

    How fast will it scroll text in my terminal?

  15. Oblig by Anonymous Coward · · Score: 0

    Yeah how does it handle Crysis on max?