Slashdot Mirror


Consumer-Grade SSDs Survive Two Petabytes of Writes

crookedvulture writes The SSD Endurance Experiment previously covered on Slashdot has reached another big milestone: two freaking petabytes of writes. That's an astounding total for consumer-grade drives rated to survive no more than a few hundred terabytes. Only two of the initial six subjects made it to 2PB. The Kingston HyperX 3K, Intel 335 Series, and Samsung 840 Series expired on the road to 1PB, while the Corsair Neutron GTX faltered at 1.2PB. The Samsung 840 Pro continues despite logging thousands of reallocated sectors. It has remained completely error-free throughout the experiment, unlike a second HyperX, which has suffered a couple of uncorrectable errors. The second HyperX is mostly intact otherwise, though its built-in compression tech has reduced the 2PB of host writes to just 1.4PB of flash writes. Even accounting for compression, the flash in the second HyperX has proven to be far more robust than in the first. That difference highlights the impact normal manufacturing variances can have on flash wear. It also illustrates why the experiment's sample size is too small to draw definitive conclusions about the durability of specific models. However, the fact that all the drives far exceeded their endurance specifications bodes well for the endurance of consumer-grade SSDs in general.

32 of 125 comments (clear)

  1. HDD endurance? by Anonymous Coward · · Score: 3, Interesting

    Just out of curiosity, how well do traditional HDD fare in comparison?

    1. Re:HDD endurance? by PlusFiveTroll · · Score: 4, Informative

      In average desktop use, and even non video media workstation it's rare to see a drive that's written 10TB. Most people will never wear out a SSD due to straight out media wear.

    2. Re:HDD endurance? by Anonymous Coward · · Score: 4, Funny

      Just out of curiosity, how well do traditional HDD fare in comparison?

      They cave in big time after around 150 win98 shutdown restarts ..

    3. Re:HDD endurance? by Luckyo · · Score: 3, Informative

      Impossible to test in the same way due to time constraints. Filling the entire hard drive takes a very long time, unlike a much smaller and much faster SSD.

    4. Re:HDD endurance? by jedidiah · · Score: 2

      A PVR drive could easily see 17TB of writes during a year and that's just a very conservative estimate based on a small number of tuners and broadcast content.

      --
      A Pirate and a Puritan look the same on a balance sheet.
    5. Re:HDD endurance? by PlusFiveTroll · · Score: 5, Insightful

      Of course video writing is the perfect application for hard drives. A constant datastream at a fixed rate and large amounts of data over time, with few random IO and only bulk delete. If you are trying to stick a SSD in a PVR you are doing it wrong.

    6. Re:HDD endurance? by Firethorn · · Score: 2

      A constant datastream at a fixed rate

      Not completely fixed(depends on channel being recorded at the time), I would think, but yeah, a fixed rate that's substantially below a HD's write speed.

      Remember that SSDs are relatively slow at writing compared to reading. HDs are generally equally fast in either direction, so given a sufficiently sequential write process I can see them actually being able to write faster than the SSD.

      --
      I don't read AC A human right
    7. Re:HDD endurance? by Hamsterdan · · Score: 3, Informative

      Recording TV is not a typical scenario. Besides, at around 8GB/hour (HD), that's around 2000 hours a year, which is little more than what my BeyondTV machine does, and its 3TB WD green is still alive and kicking. You just have to disable the insanely aggressive head parking on those drives otherwise they might die...

      http://www.storagereview.com/h...

      --
      I've got better things to do tonight than die.
    8. Re:HDD endurance? by magarity · · Score: 2

      It's been a while since you shopped for an SSD? The larger capacity ones have nearly equal read and write speeds except for the most extreme budget brands.

    9. Re:HDD endurance? by Frnknstn · · Score: 2

      He said:

      Remember that SSDs are relatively slow at writing compared to reading

      You said:

      Relatively slow compared to what, it's own read speeds?

      So... yes?

      --
      If it's in you sig, it's in your post.
    10. Re:HDD endurance? by Bengie · · Score: 4, Informative

      The controller is just as likely to fair on a regular HD. Overall, SSDs have 1/2 of the warranty claim rate of mechanical HDs. Samsung is so sure of their SSDs, they have a 10 year warranty on their new ones, or 150TB written, which is a lot of writes for a 128GB drive. Show me a mechanical drive with a 10 year warranty for under $150

    11. Re:HDD endurance? by unrtst · · Score: 2

      Let's do some math here, shall we? At 200 MB/s, you can overwrite a 1 TB drive in an hour. 1 PB you can reach in a month. The hard drives are a few times larger than the SSDs, so you'd need ~ 10 TB instead of 2, which means 10 months.

      Include all the actual variables, and you might get a usable answer. Just blowing data on the disk isn't the only thing this is doing (AFAIK). You've gotta detect errors, so you've gotta read back the data and validate it. This page goes through their full testing methodology (hint: they're using Anvil, a static file collection that includes a copy of a windows install, some applications, some movies, and some incompressible data, among other things, and every file has its md5sum checked after writing): http://techreport.com/review/2...

      An easier calculation would be to scale their timelines to the HDD stats. For example:
      Samsung 840 Pro sequential read/write: 540MB/s / 520MB/s (390MB/s for 128GB)
      WD Caviar Black: about 180MB/s read/write (ex. http://www.storagereview.com/w...)
      Rough math: 520 / 180 = 2.89 = it'll take 2.89 times as long to do the test on the same size drive.

      Samsung 840 Pro size in the article: 256GB
      Assuming you use WD Caviar Black 1TB = 4x's the size.
      2.89 * 4 = 11.55 = that many times as long to do the same operations they've done thus far.

      Their test has been running for over a year. So it'd take (roughly) over 11.5 years to do the same on the WD Caviar Black. I understand that's a very very rough estimate, but I think it's MUCH closer to the ballpark than 10 months!

      My bet: the WD will be dead long before that time. I've had drives last longer than that, but they got VERY VERY little use and were simply powered on all the time. I've had some that lasted longer than that and got a fair bit of use (ex. db servers), but they were never filled to capacity, they were enterprise drives, and some of their neighbors did die (RAID).

    12. Re:HDD endurance? by Mashiki · · Score: 2

      Well before the market crash on HDD prices you could see the rare one with a 10yr warranty for $150. The Fujitsu drives I used to use were consumer grade, and had a 10yr warranty. Of course then we went to 5yr, then 3yr, and I think some are even 1yr now. It's just like the market crash back in the late 90's early 00's. Give it a few years, and the warranties will start coming back up...that is if they survived SSD's becoming the mainstream choice for storage.

      --
      Om, nomnomnom...
    13. Re:HDD endurance? by Luckyo · · Score: 2

      Seriously, you're a third person on slashdot who hasn't even read the OP.

      The SSD test has been going on for over a year now. Consider the fact that best case scenario for HDD means it's several times slower as well as several times larger. Understand that you're looking at many years, possibly over a decade of test time.

    14. Re:HDD endurance? by Neil+Boekend · · Score: 2

      Since every time I tried that it caused weird issues every week or so I would hazard a guess that next to nobody does that, yeah. At least not on Windows.
      But even if you do SSDs can handle that load. 1 PB /3TB = 300 years (or 100 if you count 16GB of non-hibernate writes per day). Thus the cell wear is not your most likely problem.

      --
      Well, I might have a way, but it only works on a semi spherical planet in a vacuum.
    15. Re:HDD endurance? by AmiMoJo · · Score: 2

      Japanese PVRs need multiple HDDs because a single one can't keep up. A few years ago they started to record everything... All over-the-air channels simultaneously, 24/7, allowing you to watch anything that was broadcast at any time in the last week. No need to set up recording for anything, just grab it any time up to a week after broadcast.

      Once SSDs get up to capacity they would ideal for that application. Until they they use multiple HDDs and a fair size RAM cache.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
  2. They're leaving money on the table... by RealGene · · Score: 3, Insightful

    However, the fact that all the drives far exceeded their endurance specifications bodes well for the endurance of consumer-grade SSDs in general.

    No, I think it means that the first ones were over-engineered, and the next generation will meet their stated MTBF number to within 1 standard deviation.

    --
    Mission: To provide products that consume time and energy as entertainingly as permitted by the laws of thermodynamics.
    1. Re:They're leaving money on the table... by RealGene · · Score: 2

      The acronym will be re-jiggered to "Max Transferred Before Failure"

      --
      Mission: To provide products that consume time and energy as entertainingly as permitted by the laws of thermodynamics.
  3. Most people write far less. by PlusFiveTroll · · Score: 4, Insightful

    Most hard drive I see in consumer and business use write far less than that over their lifetimes. I have a customers hard drive I am copying data from currently. Has 15,147 power on hours, it has only written 1.3TB of data. It's very uncommon to see drives with over 6TB of data written (in the 500GB to 1TB drive range).

    The other client SSD in my computer is a Samsung 830 256GB SSD that I just migrated to a 1TB SSD for a customer. Was used for about a year and a half before they needed a bigger drive. They used Outlook, a number of Autocad applications, lots of project files, a good sized collection of work related photos. The drive has 995GB of writes and is showing no SMART issues.

    Average computer users have nothing to worry about when it comes to wearing a SSD out. Power users might have a problem depending on the nature of their work, but they also get the most benefit from high write speeds and IOPS. Servers, depending on their usage patters could have a problem, I certainly recommend the enterprise style drives that reserve a much larger amount of space.

    1. Re:Most people write far less. by jeffmeden · · Score: 3

      However my company found that in testing, the more number of writes to a flash device, the shorter time before the data is leaked out. So after 10,000 writes to the same location, I can read the data a month later with no errors, but at 50,000 writes I start getting errors after about 2 hours. It seems like flash storage is like a bucket of water, each erase pokes a tiny hole in the bucket. After awhile those tiny holes add up and the bucket leaks pretty fast. So long term storage is not as safe as a conventional hard drive.

      Wear leveling will prevent any cell from getting even close to that. The article is in reference to the wonder of SSDs getting over 2,000,000GB of writes across 240GB of flash. That's 8,300 erase cycles in what is certainly considered an "Extreme" scenario. In consumer desktop usage almost no one will pass the 1,000 mark, and most will stay below the 500 mark before they scrap their PC for a new one.

    2. Re:Most people write far less. by Bengie · · Score: 2

      With modern SSD wear leveling, sequential reads aren't sequential. They remap LBA sectors around to free logical blocks within an erase block. Even if you constantly wrote 1 4KB block of data to the exact same LBA constantly until the drive wore out, it would be fairly uniformly wear leveled, even if the rest of the harddrive is filled with data.

  4. Random failures by MobyDisk · · Score: 3, Interesting

    Great, so now we just need to fix the sudden random failures where the drive completely fails but it is 6 months old and showed no signs of degradation. A coworker of mine just had that happen with a Crucial SSD.

    1. Re:Random failures by bill_mcgonigle · · Score: 3, Informative

      Great, so now we just need to fix the sudden random failures where the drive completely fails but it is 6 months old and showed no signs of degradation.

      Just counted - the stack on my workbench of completely dead SSD's is 13. I think I've seen one hard drive ever go completely dead. I literally don't understand how the vendors think they can get away with such junk on SSD controllers. I know flash will fail, but that's no reason to hang dead on the SATA bus and not talk to anybody. Admit defeat by SMART and move on.

      I don't always use SSD's for journals, but when I do they're in a RAID configuration. Stay speedy, my friends.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
  5. Drives obsolete by the time the test completes by Anonymous Coward · · Score: 3, Interesting

    Unfortunately these tests don't say much about the drives you can buy NOW, and write endurance in consumer drives is probably getting worse as geometry shrinks and relentless price pressure causes corners to be cut. It's good that the Samsung 840 Pro is holding up so well (its predecessor the 830 was also ridiculously durable) but it's now replaced by the 850 Pro which uses radical new technology (stacked chips). The Intel 320 was also very durable so the failure of the 335 doesn't bode very well for the idea that newer models should hold up better than older ones.

    Write wear isn't everything anyway. Another thing to test is whether the drive can brick if the power fails while the drive is writing. Better drives have capacitors to deal with this event. Consumer drives lack them and can lose data or fail unrecoverably.

    1. Re:Drives obsolete by the time the test completes by nabsltd · · Score: 2

      It's good that the Samsung 840 Pro is holding up so well (its predecessor the 830 was also ridiculously durable) but it's now replaced by the 850 Pro which uses radical new technology (stacked chips).

      I suspect the 10 year warranty for the 850 Pro is a good indicator of how long Samsung expects it to last compared to the 840 Pro (which has a 5 year warranty).

  6. Even power users don't have much to worry about by Sycraft-fu · · Score: 2

    I write a lot more to my SSDs than most do because of lost of application installs, playing with audio, etc, etc. 6TB to date, drive was purchased about 20 months ago. Ok well assuming I maintain that rate of writing (3.6TB/year) it would be 13 years before I'd hit 50 TB of writes, on a 512GB drive which can probably take 1PB or more.

    Even if you hit it harder than the norm, you still don't hit it that hard. It really has to be used for something like database access or a file server or the like before endurance becomes an issue.

    1. Re:Even power users don't have much to worry about by nabsltd · · Score: 2

      It really has to be used for something like database access or a file server or the like before endurance becomes an issue.

      Even that isn't enough, because the drives in the test are being written essentially 24/7 (with just a little time off for the retention tests), and the drives remaining have been at it for 15 months.

      You have to have an insanely busy database or file server to never have any time off from writes.

  7. Re:Any criticism? by Kardos · · Score: 3, Insightful

    The only weakness is that it needs to be repeated on newer ssds as they hit the market. The results of this test are relevant for drives released back when the experiment started in 2013, less so for drives released now and even less so for future drives. As the manufacturers realise that the drives are lasting much longer than they are specified to, they'll decide they are overengineered and rework them to wear out quicker. Aside from the obvious cost cutting benefit, it also keeps the market segmented in various grades between "low end consumer ssds" and "high end enterprise ssds".

  8. from experience, SSD failures not from wear by BLToday · · Score: 3, Interesting

    From my experiences, most of SSD failures come from dead controllers and not wear. Or bad firmware, I'm looking at you Crucial and your 5000 hour bug. Also your weird incompatibles on your MX100 series.

  9. Re:Do you mean which MODEL?? by Qzukk · · Score: 2

    It's crucial that we find out!

    --
    If I have been able to see further than others, it is because I bought a pair of binoculars.
  10. Re:how many? by jones_supa · · Score: 2

    It wasn't even meant to be a scientifically correct study but just a fun MythBusters-type experiment.

  11. Flash endurance by Art+Deco · · Score: 2

    A few years back I ran my own test. I had an unused 16 MB Canon SD card that came with one of my digital cameras (I bought a much larger one with the camera). Since it was unused I decided to see how long it would last. I wrote a script that repeatedly overwrote the entire card with one of several files of random data then checked it against the original. Each time overwriting, reading, and verifying the card took about 17 seconds. I had my first error after 120K writes. After that I got errors every 20K to 60K writes. Someone suggested I reformat the card and afterword it came out 114K smaller so I guess it marked some cells as bad. After this it went the longest stretch without an error, from write 1.9M to 2.5M without a single error. From this test one might conclude that there are a small number of frail cells that fail early on and the rest more robust that just keep going.