Slashdot Mirror


AMD Details High Bandwidth Memory (HBM) DRAM, Pushes Over 100GB/s Per Stack

MojoKid writes: Recently, a few details of AMD's next-generation Radeon 300-series graphics cards have trickled out. Today, AMD has publicly disclosed new info regarding their High Bandwidth Memory (HBM) technology that will be used on some Radeon 300-series and APU products. Currently, a relatively large number of GDDR5 chips are necessary to offer sufficient capacity and bandwidth for modern GPUs, which means significant PCB real estate is consumed. On-chip integration is not ideal for DRAM because it is not size or cost effective with a logic-optimized GPU or CPU manufacturing process. HBM, however, brings the DRAM as close to possible to the logic die (GPU) as possible. AMD partnered with Hynix and a number of companies to help define the HBM specification and design a new type of memory chip with low power consumption and an ultra-wide bus width, which was eventually adopted by JEDEC 2013. They also develop a DRAM interconnect called an "interposer," along with ASE, Amkor, and UMC. The interposer allows DRAM to be brought into close proximity with the GPU and simplifies communication and clocking. HBM DRAM chips are stacked vertically, and "through-silicon vias" (TSVs) and "bumps" are used to connect one DRAM chip to the next, and then to a logic interface die, and ultimately the interposer. The end result is a single package on which the GPU/SoC and High Bandwidth Memory both reside. 1GB of GDDR5 memory (four 256MB chips), requires roughly 672mm2. Because HBM is vertically stacked, that same 1GB requires only about 35mm2. The bus width on an HBM chip is 1024-bits wide, versus 32-bits on a GDDR5 chip. As a result, the High Bandwidth Memory interface can be clocked much lower but still offer more than 100GB/s for HBM versus 25GB/s with GDDR5. HBM also requires significantly less voltage, which equates to lower power consumption.

15 of 98 comments (clear)

  1. Re:Repeated links? by Hognoxious · · Score: 2, Informative

    Because he gets a referral fee in both cases? All MojoKid's submissions are clickbait.

    --
    Confucius say, "Find worm in apple - bad. Find half a worm - worse."
  2. All of you should buy AMD whenever possible by Andrio · · Score: 2, Funny

    They're a substantially less evil force than either Intel or NVIDIA.

    --
    The Internet King? I wonder if he could provide faster nudity.
    1. Re:All of you should buy AMD whenever possible by maugle · · Score: 2

      Is that still true in Nvidia's case? I originally bought an Nvidia card because of the supposed Linux-friendliness, but it's been giving me trouble. Meanwhile, I'm hearing about how AMD has opened up a lot more and is making good strides with its Linux drivers.

    2. Re:All of you should buy AMD whenever possible by Adriax · · Score: 2, Insightful

      I buy AMD because it's cheaper. I have yet to notice a real performance difference.
      The fact my money doesn't go towards bribing benchmark/review sites and prebuilt manufactures to lock competition out of the market is just a bonus.

      --
      I don't suffer from insanity, I enjoy every minute of it!
    3. Re:All of you should buy AMD whenever possible by arbiter1 · · Score: 2, Interesting

      AMD's linux driver is still pretty far behind even though they claim to make some strides. when a r9 290x gets beat by a gtx750ti you know its pretty bad.

    4. Re:All of you should buy AMD whenever possible by drinkypoo · · Score: 4, Insightful

      Typical zealot. I use whatever tool is best for the job, be it AMD or Intel.

      History has shown that, like Microsoft, if you give Intel money they will use it for evil. Specifically, it will fund illegal anticompetitive behavior that retards progress in computing.

      If you're happy with that, keep giving Intel money. But keep in mind that yes, it really does make you an asshole when you give known assholes money on purpose.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  3. Power savings by asliarun · · Score: 5, Interesting

    One has to give it to AMD. Despite their stock and sales taking a battering, they have consistently refused to let go of cutting edge innovation. If anything, their CPU team should learn something from their GPU team.

    On the topic of HBM, the most exciting thing is the power saving. This would potentially shave off 10-15W from the DRAM chip and possibly more from the overall implementation itself - simply because this is a far simpler and more efficient way for the GPU to address memory.

    To quote:
    "Macri did say that GDDR5 consumes roughly one watt per 10 GB/s of bandwidth. That would work out to about 32W on a Radeon R9 290X. If HBM delivers on AMD's claims of more than 35 GB/s per watt, then Fiji's 512 GB/s subsystem ought to consume under 15W at peak. A rough savings of 15-17W in memory power is a fine thing, I suppose, but it's still only about five percent of a high-end graphics cards's total power budget. Then again, the power-efficiency numbers Macri provided only include the power used by the DRAMs themselves. The power savings on the GPU from the simpler PHYs and such may be considerable."

    http://techreport.com/review/2...

    For high end desktop GPUs, this may not be much, but this provides exciting possibilities for gaming laptop GPUs, small formfactor / console formfactor gaming machines (Steam Machine.. sigh), etc. This kind of power savings combined with increased bandwidth cna be a potential game changer. You can finally have a lightweight thin gaming laptop that can still do 1080p resolution at high detail levels for modern games.

    I know Razer etc already have some options, but a power efficient laptop GPU from the AMD stable will be a very compelling option for laptop designers. And really, AMD needed something like Fiji - they really have to dig themselves out of their hole.

    1. Re:Power savings by Kjella · · Score: 2

      One has to give it to AMD. Despite their stock and sales taking a battering, they have consistently refused to let go of cutting edge innovation. If anything, their CPU team should learn something from their GPU team.

      Well unlike their CPU division the GPU division hasn't been the one bleeding massive amounts of cash, at least not until the GTX 970/980 generation from nVidia. Though with the R300 OEM series being a R200 rebrand they seem to be running out of steam, one limited quantity HBM card won't fix their lineup.

      This kind of power savings combined with increased bandwidth cna be a potential game changer. You can finally have a lightweight thin gaming laptop that can still do 1080p resolution at high detail levels for modern games.

      You still need power for shaders that is about 80-90% of a GPU's power consumption. In fact, AMDs problem is that even if they could swap out the GDDR5 for HBM today they still lose on performance/watt to nVidia's Maxwell 2. And the interposer is basically a giant semi-processed silicon die, it might be good for performance but it's probably not good for cost.

      Anyway, the slides are kinda impressive just like with their Zen processor and whatnot. But AMD has a rather poor track record of delivering products on schedule that live up to their hype. It's now been eight months since nVidia launched the GTX970/980 and we're still waiting for something new from AMD. You can't win if you don't get your tech into products and ship them.

      --
      Live today, because you never know what tomorrow brings
  4. Re:HotHardware Spam by drinkypoo · · Score: 2, Funny

    Do we really need to see an article from MojoKid every day to drive traffic to his site?

    The answer depends on how that question is interpreted. No, we don't need to see such an article. Yes, such an article is necessary to drive traffic to said site, if that's your goal anyway.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  5. I think my next card is going to be AMD by davydagger · · Score: 3, Interesting

    nVidia fanboy since switching to Linux. A combination of them releasing their new unified driver, the latest nvidia chips being notoriously hard for nouveau, and now this, I think my next card is going to come from AMD

  6. Re:Repeated links? by ArcadeMan · · Score: 3, Funny

    I hate people who do that...

    And please don't forget to register via the links below to get free Bitcoins and Dogecoins so I can get more referrals!

  7. Uneven height and cooling by valinor89 · · Score: 2

    All the graphics I have seen represent the HVM memory being much higher or thick that the GPU core part. Is that how it will be? And if so how are they going to make the lid make good contact with the hot parts when they are "recessed"?

  8. I take two things from this. by edxwelch · · Score: 2

    The good: next year AMD start making APUs with HBM. The only thing that was holding back the iGPU was memory bandwidth. So, now they can put a 1024 shader GPU on the die and not have it starved by bandwidth. That will have interesting applications: powerful gaming laptops much cheaper than those with a discreet GPU and HPC (especially considering HSA applications)
    The bad: this year AMD is only releasing one new GPU, Fiji. The rest are rebadges. And there is no new architecture. Even Fiji is making do with GCN 1.2

  9. Re:DRAM Latency Still Sucks. by 0123456 · · Score: 2

    GPUs tend to be more bandwidth-constrained than latency-constrained, as they typically have long pipelines that can hide much of the latency. Though I'm sure you could make them really latency-constrained if you wrote shaders badly.

  10. Re:easier solution by matfud · · Score: 3, Informative

    No. To drive an external bus requires a lot of silicon space to handle the capacitance resistance and distance. This also requires a lot of power.

    Stacked chips required far smaller drivers. The distance is in the mm rather than decimeters. The insulators are far better (as the current and voltage can be far smaller). Capacitance is also far lower. And you do not need to have 1024 bit data paths + address + signaling on the motherboard which makes motherboards far simpler and cheaper to make. Not counting the problems with signal propagation along different length paths on a motherboard (designed into the chip in this case) or having interactions from the multilayer PCB traces.

    So yes there are very good reasons to do this.