Slashdot Mirror

← Back to Stories (view on slashdot.org)

Intel Unveils One-Petabyte Storage Servers For Data Centers (theinquirer.net)

Posted by EditorDavid on from the Intel's-insides dept.

Slashdot reader #9,219 Guy Smiley shared this report on a new breed of high-density flash storage. The Inquirer reports: Intel has unveiled a brand new form factor for solid state disc drives (SSDs)... Intel Optane's new "ruler" format will allow up to a petabyte of storage on a single 1U server rack... By using 3D-NAND, the ruler crams in even more data and will provide more stability with less chance of catastrophic failure with data loss. The company has promised that the Ruler will have more bandwidth, input/output operations per second and lower latency than SAS... As part of the announcement, Intel also announced a range of "hard drive replacement" SSDs -- the S4500 and S4600 0 which are said to have the highest density 32-layer 3D NAND on the market, and are specifically aimed at data centres that want to move to solid state simply and if necessary, in stages.

58 comments

  1. Finally by Anonymous Coward · · Score: 0

    I can store my porn collection in 'the cloud'!

    1. Re:Finally by Anonymous Coward · · Score: 1

      I can store my porn collection in 'the cloud'!

      Where will you store it, in petafiles?

  2. Layers? by DontBeAMoran · · Score: 1

    32-layer 3D NAND

    What do you mean? Like the T-800 or onions/parfaits?

    --
    #DeleteFacebook
    1. Re: Layers? by Anonymous Coward · · Score: 0

      It's kinda like cocks per butthole

    2. Re: Layers? by DontBeAMoran · · Score: 1

      I think you're being a little too anal about this.

      --
      #DeleteFacebook
    3. Re: Layers? by LifesABeach · · Score: 1

      Intel finally understands storage requirements for my Porn collection. But one question lingers, Intel has a "Rack"? I'm into Racks; does anyone have an image of them?

    4. Re:Layers? by unixisc · · Score: 2

      Yeah, what exactly does 'layer' mean here? Are they trying to say 5 voltage levels, that would give 32 variables? Or do they actually mean 32 levels, which would be hairy to maintain? Somehow, I've never had much confidence in multi-level cell flash, where one needs more than 2 voltage levels to increase the 'bits/cell' and thereby the density. Spansion had an interesting idea in ORNAND, where they had reversible source-drains to store 2 bits in a cell, but from what I recall, that had performance issues due to lack of a real ground.

      So how has the reliability story been on this, when compared to the first SSDs that we saw enter the market?

    5. Re:Layers? by mlyle · · Score: 2

      It means 32 layers of cells in the chip, which themselves are probably TLC. 3D-NAND/VNAND are not new, and there's products with up to 64 layers in the market.

    6. Re:Layers? by ChumpusRex2003 · · Score: 2

      It means layers of transistors on each chip.

      Traditionally, silicon ICs consist of a single layer of transistors, with several layers of metal wire interconnects placed on top. In other words, the transistors are arranged in a 2D array over the surface of the die.

      The major breakthrough in flash memory a few years ago, was the development of "stacked transistors". In other words, multiple independent transistors could be stacked one on top of the other. This now typically goes by the name "3D", with current products now being 32 or 64 layers stacked. The net result is that larger lithography can be used for the individual flash memory cells (leakage due to quantum tunnelling becomes unacceptable once flash cells become too small) improving SNR/endurance, while simultaneously increasing areal density.

  3. will they use SAS/SATA or pci-e or some intel only by Joe_Dragon · · Score: 2

    will they use SAS/SATA or pci-e or some intel only thing??

    But I may need to get an AMD EPYC system to get the PCI-e lanes to make the most of it unless you can get 4 cpus into an 1U box.

  4. Wow, that's amazing! by Anonymous Coward · · Score: 0

    And the Boeing 747 first flew in 1969 and it still flies the same speed today! But this computer totally means we're colonizing the universe!

    Prepare your comic books! Let's live on Mars!

    1. Re: Wow, that's amazing! by Anonymous Coward · · Score: 0

      Why colonize the Universe when you can simulate it in your 1U box ?

  5. Old Hat by Anonymous Coward · · Score: 0

    IBM has been selling petabyte-size storage for years. Intel still does not support a PB of RAM.

    1. Re: Old Hat by crow · · Score: 1

      No. This is in 1U of rack space. That's incredible density.

    2. Re:Old Hat by MiliusXP · · Score: 1

      In 1U form factor ?

    3. Re:Old Hat by Nutria · · Score: 1

      I shudder to think of the cost of a PB of flash RAM...

      --
      "I don't know, therefore Aliens" Wafflebox1
    4. Re: Old Hat by Anonymous Coward · · Score: 0

      Indeed, that is quite the feat imho. Cumulative storage capacity of a datacenter has now the potential to grow enormously. I wonder how much it will cost though.

    5. Re:Old Hat by Jason1729 · · Score: 1

      Around 50 cents/gigabyte. So $500,000ish.

    6. Re: Old Hat by Jason1729 · · Score: 4, Interesting

      At 50 cents per gig, the flash is worth about $500,000 for this PB. Spinning platters are under 5 cents per gig. $50,000 for this PB.

      For most datacenter storage purposes, the spinning platters are not a bottleneck. The new product is cool and will be very useful in a few specific applications, but it is not going to change much for datacenters. The flash SSD will also save power as well as space, but not enough to justify 10x the upfront cost. Maybe next generation.

    7. Re: Old Hat by darkain · · Score: 1

      This isn't about the "A or B" situation, it is about having a hybrid of both. Use magnetic storage for bulk data like photos and videos, and use this new SSD for database itself. This has pretty much always been the case of SSD vs HDD in the datacenter. Now we can grow databases exponentially larger.

    8. Re: Old Hat by Jason1729 · · Score: 1

      Read the post I was replying to to understand the context of what I said.

      This is *not* going to lead to "Cumulative storage capacity of a datacenter has now the potential to grow enormously", which is the entire meaning of my previous post. There certainly will be uses for this product, but the higher density is not going to lead to higher capacity datacenters.

    9. Re: Old Hat by Anonymous Coward · · Score: 0

      If your application is Rainbow Tables (or similar) then it's totally worth it.

    10. Re: Old Hat by bill_mcgonigle · · Score: 1

      Maybe the petabyte of xpoint flash is just the cache drive for your real data store.

      Heck, you'd probably need eight of these just to cache an exabyte of backend.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
    11. Re: Old Hat by Anonymous Coward · · Score: 0

      Great so SharePoint will succeed forever. Yeay.

    12. Re: Old Hat by Billly+Gates · · Score: 1

      If your application is Rainbow Tables (or similar) then it's totally worth it.

      Or the new minimum requirement for Java 9 JRE

      --
      http://saveie6.com/
    13. Re: Old Hat by DontBeAMoran · · Score: 1

      The flash SSD will also save power as well as space, but not enough to justify 10x the upfront cost. Maybe next generation.

      And if not the next generation, then maybe deep space nine, voyager or enterprise.

      --
      #DeleteFacebook
    14. Re: Old Hat by Neuronwelder · · Score: 1

      Thank you Jason!!

    15. Re: Old Hat by Anonymous Coward · · Score: 0

      At 50 cents per gig, the flash is worth about $500,000 for this PB. Spinning platters are under 5 cents per gig. $50,000 for this PB.
      *SNIP*
      The flash SSD will also save power as well as space,

      Which is funny, for a project I've been working on I needed a sata controller type storage device in a limited power setup.

      I didn't have any USB flash drives handy that were of a capacity to really work, so looked at my sata-to-usb adaptor and grabbed an SSD off the shelf.
      5vdc at 1 amp (5 watt). That seems like a lot, but at least it's better than a drive with a motor in it I figured.

      Until I looked at this WD 2.5" sata laptop drive, which only needed 0.7 amps at 5v (3.5 watt).
      Then a seagate 2.5" HD that only needed 0.45 amp at 5v (2.25 watt)

      Since you quoted price per GB specifically on slow home use sata drives for your comparison, at least for one specific large class of spinning disk storage is still much more power efficient in total compared to SSDs

      Of course these are basically laptop HDs at slow 5400 and 7200 rpm speeds, and normal sata 2 IO.
      Absolutely nothing like what a datacenter uses. I have no doubt 3.5 sas drives do draw quite a lot more power compared to SSDs.
      However SAS drives are closer to 25-30 cents per GB too, seem to last longer than SSDs, and with the right controller and RAID configuration can be just as fast as SSD so far as the IO bottleneck goes.

    16. Re:Old Hat by mikael · · Score: 1

      Yes, there's a picture. It's 1U in height (1.752 inches, 44.5 millimeters). The SSD drive is like a thick white school ruler. Then these can be jammed in together 42 vertically and possibly the same horizontally.

      https://en.wikipedia.org/wiki/...

      --
      Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
  6. Re:will they use SAS/SATA or pci-e or some intel o by Anonymous Coward · · Score: 0

    It's using the SFF-TA-1002 connector currently carrying PCIe 3.1 4x or 8x. It's forward-compatible up to PCIe 4.0 and 5.0.

  7. Competition? by crow · · Score: 1

    So is Intel also selling the raw components? In the past, they've been a neutral vendor. With this move, they could be making a huge jump into the storage industry, competing directly with HPE, Hitachi, and DellEMC.

    1. Re:Competition? by Anonymous Coward · · Score: 0

      Since SSDs became popular Intel has been selling them both in the consumer and server markets. It's mostly based on their partnership with Micron. Their performance might not be the best but they offer some of the highest durability flash (excluding mind-boggling prices some vendors have on ultra-durables).

    2. Re:Competition? by Anonymous Coward · · Score: 0

      or they'll patent and license. new form factor, new controller, new connection.

    3. Re:Competition? by unixisc · · Score: 2

      It would make sense only if Intel has problems filling fab capacity, but I fail to see that happening. If they (re-)enter that market, they'll drive down the market prices of flash, making it a loss for everyone! They were in both the NOR flash business as well as the NAND flash business years ago as Numonyx, which they then sold to Micron, and then they formed a partnership w/ Micron on this.

      If they do that, I'd conclude that things are really bad at Intel

  8. Re:OTOH, failue modes and rate? by Anonymous Coward · · Score: 0

    ...because enterprise flash is just like a USB flash drive.

  9. Re:will they use SAS/SATA or pci-e or some intel o by Anonymous Coward · · Score: 0

    It's as follows

    single Intel CPU : 48 lanes
    dual Intel CPU : 96 lanes
    single Epyc CPU : 128 lanes
    dual Epyc CPU : 128 lanes

    I had a check, as indeed Xeon is 48 lanes (and 6 ddr channels) instead of 44 lanes on Core i9 (and 4 ddr channels) even if it might be the same chip at its heart.

    Maybe not a big deal to have only 96 lanes, because if you cram in twenty PCIe 4x drives in there then a couple of servers will cost like a large house or a creimer's flat in Silicon Valley.

  10. Daisy Daisy.... by lobiusmoop · · Score: 1

    This image of the new drives loaded in a rack makes me think of this scene from 2001.

    --
    "I bless every day that I continue to live, for every day is pure profit."
    1. Re: Daisy Daisy.... by Anonymous Coward · · Score: 0

      Isolinear chips from Star Trek are what the current m.2 NVMe look like. This is just scaled up.

  11. Re:OTOH, failue modes and rate? by Anonymous Coward · · Score: 0

    That's too bad, but a USB drive is about the cheapest thing.

    Me I'm thinking of adding a 2.5" hard disk drive to my mid tower PC as I perceive them as reliable, quiet, won't mind much when I kick the tower or when I slap it on the top when the PSU fan is occasionally whirring.

    Have an old one (SATA 1) already for the OS drive.

  12. Ramming storage into a 42U rack is fine but... by wwalker · · Score: 1

    single 1U server rack.

    That's a really small rack. Why would anyone create a server rack with just a single 1U capacity? /s

    1. Re:Ramming storage into a 42U rack is fine but... by Anonymous Coward · · Score: 0

      Why have 1U when you can have 42 1U?

  13. Test123 by Anonymous Coward · · Score: 0

    Test123

  14. Still not reliable yet for server use by Billly+Gates · · Score: 1, Informative

    Many industrial controls with SSDs seem to always fail and one of the projects I worked on was replacing the SSDs that come with them with a hard disk as they never seem to have problems like the SSDs do.

    I have seen other slashdotters on here who work in the enterprise who have loads of failed ssds on their desks, but their hard drives while slower are always less in quantity in comparison. It doesn't matter the brand. They all fail and when they do they go hard.

    --
    http://saveie6.com/
    1. Re:Still not reliable yet for server use by Anonymous Coward · · Score: 2, Interesting

      AC here due to NDA, I am long time Data Center fellow (15+ years,) I do hardware engineering for the Data Center space for a big company you all hate and love. One of my biggest projects was designing a cabinet that had the highest storage capacity in the world.

      One thing I can speak for is SSDs. They are reliable, but they do have issues. Often times when you think an SSD has died it hasn't really died, usually it is due to a firmware bug. Last year I was going through a thousand SSD's from three manufactures that had been determined had failed by software or hardware troubleshooting by techs. In 60% of the failures, we were able to recover them back to regular use, the end causes being two fold, a firmware glitch that could be corrected, the other problem being the SMART data was not being read properly or improperly reported by the SSD.

      We were able to implement a software solution that detected the problems that were found in the investigation and provide corrective action. This resulted in a huge drop in failures. Further interface with manufacturers has caused them to correct the various issues, which eventually rolls out to other enterprises.

    2. Re:Still not reliable yet for server use by thegarbz · · Score: 1

      Pointless anecdote. Extraordinary high failures rates in SSDs point towards problems in your power supply or heating more than anything else. The fact you can't keep them running in industrial applications especially is a sign of this as solid state electronics don't magically degrade outside of the known read/write failure mechanism.

      My own anecdote goes the opposite way. We have fun playing frisbie with the left over drive platters from the endless string of failures, and I'm sure every enterprise does as well given that HDD failure is just a given and everyone treats them like a normal part of the business maintenance.

      I'll put my name to saying this doesn't just include SSDs, but some 90% of the hardware failures I've seen in industrial systems are due to external problems. 20 year old UPSes, noisy as shit power, overheated power-supplies, earthing designed by the spaghetti monster himself, lack of surge protection, inadequate ventilation, poor dust control, the list just goes on and on. SSDs are sensitive to power issues, that is know and given. Design accordingly and you won't have an issue.

  15. Re:OTOH, failue modes and rate? by stabiesoft · · Score: 2

    For me, I have had a usb drive plugged into a small atom box I used as a mail server/web server/ftp server. It ran literally for years as the /home mount which serviced some log files, the ftp and www files. I've since moved the servers, but the little box keeps on humming. So I'm not claiming reliable or unreliable, just YMMV!

  16. Re:OTOH, failue modes and rate? by HiThere · · Score: 0

    You have a tiny point, but isn't it essentially the same technology? And if it is, wouldn't a small current surge potentially wipe a huge amount of storage? And because it *was* so huge, you might well not notice until long after any possibility of recovery.

    Yeah, this is "enterprise grade". It's also being done with highly miniaturized capacitors, etc. Which may well be much more subject to leakage, shorts (with overvoltage), etc.

    OTOH, perhaps I'm wrong. Perhaps this is just repackaging of stuff that's been on the market and being used for awhile. But it took disks multiple decades to get most of the bugs out, and some of the bugs are still around.

    --

    I think we've pushed this "anyone can grow up to be president" thing too far.
  17. LOC? by Anonymous Coward · · Score: 0

    So how many libraries of congress is that?

  18. Re:OTOH, failue modes and rate? by Gondola · · Score: 1

    Enterprises use backup power and power conditioning.

  19. Hot-pluggable NVRAM - yeah! by illtud · · Score: 1

    OK, it costs a fortune at the moment, but can I just give a cheer for a hot-pluggable format for NVRAM? I've used the Samsung 960 pro M2 2TB, and it's blinding fast, but my Ops guys won't touch it for production as it means downtime on a failure (and it looks like we've got a failure after 4 months - thank goodness for warranties)

    I'm looking forward to 1PB in 1U, but my prediction for that being realistic is 2022 @ $120k.

  20. Re:OTOH, failue modes and rate? by wolrahnaes · · Score: 2

    High-end SSDs these days, including anything deserving of the description "enterprise grade", have supercapacitors for the specific purpose of allowing writes to complete in the event of power loss.

    USB drives generally don't have something like that. I'm sure some might, but most don't.

    --
    I used to get high on life, but I developed a tolerance. Now I need something stronger.
  21. Re:OTOH, failue modes and rate? by drinkypoo · · Score: 1

    Brand and model? I have had varying luck with different stuff. My OCZ ATV died and they replaced it with a RALLY2 which has been solid for years now. Out of a half dozen Sandisk SD cards I've got only one is bad, but out of three Sandisk USB drives, three are bad.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  22. Re:Release your solution as FOSS, you TWAT. by Anonymous Coward · · Score: 0

    It's likely just a shell script specific to their site, software and data you dumb nut.

  23. Re:OTOH, failue modes and rate? by HiThere · · Score: 1

    OK, thanks. That finally sounds like a valid answer.

    --

    I think we've pushed this "anyone can grow up to be president" thing too far.
  24. Networking? by Anonymous Coward · · Score: 0

    Is there even a network connection that can handle that much traffic? Will you need some special PCI card with a crazy 1000gb connection to the servers?