Slashdot Mirror


220TB Tapes Show Tape Storage Still Has a Long Future

alphadogg writes: IBM and Fujifilm have figured out how to fit 220TB of data on a standard-size tape that fits in your hand, flexing the technology's strengths as a long-term storage medium. The prototype Fujifilm tape and accompanying drive technology from IBM labs packs 88 times as much data onto a tape as industry-standard LTO-6 systems using the same size cartridge, IBM says. LTO6 tape can hold 2.5TB, uncompressed, on a cartridge about 4 by 4 inches across and 2 centimeters thick. The new technologies won't come out in products for several years.

229 comments

  1. LHC Too by Njorthbiatr · · Score: 4, Interesting

    They use tapes to store all that data they get from smashing tiny bits together. Totally forget how much one of their tapes hold, but at the time I remember thinking it was a lot.

    1. Re:LHC Too by Anonymous Coward · · Score: 1

      CERN has a lot of tape, but the data is also distributed over LHCOPN to many different storage sites with different storage backends, many of which are tape.

    2. Re:LHC Too by PPH · · Score: 5, Funny

      LHCs tape archive is stored in the closet next to the superconducting magnet.

      --
      Have gnu, will travel.
    3. Re:LHC Too by americanpossum · · Score: 3, Interesting

      From http://cerncourier.com/cws/art...

      The current candidates for the tape drives that will record LHC experimental data are the enterprise-class drives from IBM and Sun StorageTek. These are the IBM 3592 EO5, which has a native data rate of 100 MB/s; and the Sun StorageTek T10000, which has a native data rate of 120 MB/s. Both of these drives use a 500 GB capacity cartridge.

      The interesting thing is that the LHC can generate up to 6GB of data per second, which means that even a 500GB tape will only last for 83 seconds. It's good that they've got all of those robots handling these tapes.

    4. Re:LHC Too by hitmark · · Score: 1

      Is that before or after first sorting?

      --
      comment first, facts later. http://chem.tufts.edu/AnswersInScience/RelativityofWrong.htm
    5. Re:LHC Too by Thor+Ablestar · · Score: 1

      In superconducting closet?

    6. Re:LHC Too by Anonymous Coward · · Score: 0

      From http://cerncourier.com/cws/art...

      The current candidates for the tape drives that will record LHC experimental data are the enterprise-class drives from IBM and Sun StorageTek. These are the IBM 3592 EO5, which has a native data rate of 100 MB/s; and the Sun StorageTek T10000, which has a native data rate of 120 MB/s. Both of these drives use a 500 GB capacity cartridge.

      The interesting thing is that the LHC can generate up to 6GB of data per second, which means that even a 500GB tape will only last for 83 seconds. It's good that they've got all of those robots handling these tapes.

      The T1000D drives can write at 250 MB/s (2 Gb/s) and have an uncompressed capacity of 8.5 TB. The article you site is for 2006, so things have changed in the intervening (e.g., it's no longer "Sun StorageTek" but "Oracle StorageTek" now).

    7. Re:LHC Too by guruevi · · Score: 2

      They have 1PB worth of disk cache in front of their tape storage... so yeah, quite a bit of PB. Tape isn't dead, but it's not worth it for small quantities (100TB) and many companies don't even have 100TB worth of centralized storage. Most companies can get away with storing stuff on the 'cloud' which is very expensive per GB/TB compared to either local or colocated disk storage or tape.

      --
      Custom electronics and digital signage for your business: www.evcircuits.com
    8. Re:LHC Too by davester666 · · Score: 1

      Yes, it hasn't publicly come out of the closet, even though most people working there already know.

      --
      Sleep your way to a whiter smile...date a dentist!
    9. Re:LHC Too by rahvin112 · · Score: 2

      People that quote the data rate/sec ignore that the data generated is only generated for a few seconds at the most, the bulk of the data is in the first few milliseconds after the collision. It simply doesn't take long for the remains of the destroyed protons to disintegrate within the bubble chamber.

    10. Re:LHC Too by confused+one · · Score: 1

      I'm not familiar with CERN; but, in U.S. installations these systems were typically built with robotic tape silos and a big disk cache. Something like 6 to 10 tape drives and thousands of tapes per silo.

    11. Re:LHC Too by RockDoctor · · Score: 1
      Does the LHC still use bubble chambers? Not at ATLAS, according to http://www.atlas.ch/detector.h... , nor at CMS. Nor in LHCb. Nor in ALICE (A Large Ion Collider Experiment). The TOTEM experiment uses something called a Roman Pot. and I've now got bored.

      From the other end of the telescope - would what is essentially an imaging detector like a bubble chamber be suited to a high-data rate situation like the LHC?

      --
      Birds are not dinosaur descendants;birds are dinosaurs, for all useful meanings of "birds", "are" and "dinosaurs"
  2. more interesting question by Anonymous Coward · · Score: 1

    What is the write speed of this technology ?
    If it is too slow you will have to resort to more complex backup strategies, which is never a good thing.
    Although it would still be acceptable for archiving I presume.

    1. Re:more interesting question by Paradise+Pete · · Score: 3, Interesting

      What is the write speed of this technology ?

      Back in the early 80's I had a job working at night watching the network of the then-new ATMs, and restarting them when they crashed (often). It was a time-sharing place with big mainframes and giant spools of tape. The write speed on those was horrible, partly because first you had to wake up the invariably dozing tape hanger, who would then stumble over, find the proper tape, and put it on the spool.

    2. Re:more interesting question by qpqp · · Score: 1

      Oh don't worry. It's fast. Around 1TB/hour.

    3. Re:more interesting question by Anonymous Coward · · Score: 2, Informative

      Existing tape technology (LTO 6 and newer) is no slouch. I can saturate an 8 GB FC link with an eight drive silo and Solaris or AIX driving it (with TSM or Networker as a backup infrastructure.)

  3. 4 by 4 inches... by Anonymous Coward · · Score: 0

    4 inches by 4 inches by 2 cm weighs 2 troy ounces and gets 40 rods to the hogshead.

  4. Never consumer ready by BenJeremy · · Score: 3, Interesting

    Wake me when tape is reliable AND costs 10% of the $/GB of hard drive storage.

    Worthwhile for enterprise... maybe. I haven't even looked at a tape backup in decades, but I do not relish paying more for a single tape than an entire 2TB HDD... as a consumer, or even as an enthusiast. It's cheaper and possibly more reliable to do backups to BD-R at this point, or simply use redundant HDDs as backup devices.

    1. Re:Never consumer ready by LinuxIsGarbage · · Score: 4, Insightful

      Tape backups have been an enterprise only product for years. And they are backing up enterprise (server-grade) hard drives that cost substantially more than consumer SATA drives.

    2. Re:Never consumer ready by Anonymous Coward · · Score: 2, Insightful

      You can pretty much wake up now. Tape outperforms hard drives every single day but of course it depends on how much data we're talking about, the type of data and how you want to access it. For a typical enterprise backup scenario, you will not be able to replace a modern tape robot with a 2000+ tapes with hard drives. It's just not going to scale.

    3. Re:Never consumer ready by SuricouRaven · · Score: 4, Interesting

      Even enterprises are using a lot of SATA drives now. The super-fast-and-reliable niche that used to belong to enterprise drives has gone to flash. It's usually cheaper to use consumer drives and some better software to manage the inevitable failure than to use enterprise drives.

    4. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Even if reliability wasn't great, at that kind of storage density I would write dozens of copies per file, and on two or more tapes per file if necessary.

      But the price for a single tape drive is beyond insane. I can't figure out if it's because of gold inlay on the circuits or some kind of rare virgin tears the PCBs been dipped in.

    5. Re:Never consumer ready by Anonymous Coward · · Score: 1

      > but I do not relish paying more for a single tape than an entire 2TB HD

      ??? LTO-6 tapes are about half the price of a 2TB hard drive (£30 / £60 at http://www.ebuyer.com).

      Now, the cost of the tape drive to put it in is the problem. That each disk has a built in controller that works with any machine you have to hand is the winner.

      But you'll break even at 100TB - which is only 3 generations of 33TB, so if you've got a fair amount of data to keep backed up then it's not too bad a deal.

    6. Re: Never consumer ready by Anonymous Coward · · Score: 1

      You wouldn't think that tears from virgins would be that rate of a commodity in this industry.

    7. Re:Never consumer ready by americanpossum · · Score: 3, Insightful

      If you don't need to store tremendous amounts of data or to keep this data in more than a dozen different places, spinning hard drives will do just fine.

      If you need to store petabytes of data in redundant locations, tape robots are your friend. ;-)

    8. Re:Never consumer ready by Dutch+Gun · · Score: 4, Insightful

      As far as I can recall, tape backup systems have never been a consumer product. At least, I don't recall tape systems ever being marketed that way.

      I think the big difference nowadays though, is that tape backup used to be the only real viable option for small business' computers and servers. Nowadays, it seems like cloud-based backups like Amazon Glacier are a much more sensible for smaller systems.

      BTW, redundant HDDs as a backup system is a really bad idea unless you:

      a) take them offline, and
      b) store them offsite.

      --
      Irony: Agile development has too much intertia to be abandoned now.
    9. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Not even just enterprise - the time savings is huge if you are a small business. 25 hours to write 2.5TB on BDR vs 4 hours on LTO6 ? 170 full rewrites per tape vs 1x use per disc? Storage space ? Electricity costs ?

      And how is it more reliable to use BDR ?

    10. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Kids now days. Get off my lawn!

    11. Re:Never consumer ready by umdesch4 · · Score: 1

      I had one of these, so there's at least one example of marketing tape drives for home use. I had a few of the 2GB tapes, and used them for backing up data from my audio projects, during the short span before CD-ROM burning was a thing. But generally speaking, you're right. Tapes for home use have never been a marketable "thing"... http://en.wikipedia.org/wiki/D...

    12. Re:Never consumer ready by Anonymous Coward · · Score: 1

      BD-R are way overpriced, slow, write-once, small (require *lots* of disc swapping), require uncommon drives and what not. Meanwhile, conveniently large 4TB drives are under $150, fast, rewriteable, and only require a USB port. Optical storage is becoming obsolete real fast.

    13. Re:Never consumer ready by ShanghaiBill · · Score: 5, Interesting

      It's usually cheaper to use consumer drives and some better software to manage the inevitable failure than to use enterprise drives.

      There is NO difference in reliability between "consumer" and "enterprise" drives. The only reason to buy enterprise drives is because you have excess money that you are too stupid to keep. All the big storage companies use consumer grade drives, and several of them, including Google and Backblaze, have published data that clearly show there is no reliability or performance reason to buy "enterprise" drives. They are a scam.

    14. Re:Never consumer ready by ShanghaiBill · · Score: 2

      As far as I can recall, tape backup systems have never been a consumer product.

      You never used an audio cassette tape to backup your TRS-80?

    15. Re:Never consumer ready by Anonymous Coward · · Score: 0

      > but I do not relish paying more for a single tape than an entire 2TB HD

      ??? LTO-6 tapes are about half the price of a 2TB hard drive (£30 / £60 at http://www.ebuyer.com).

      Now, the cost of the tape drive to put it in is the problem. That each disk has a built in controller that works with any machine you have to hand is the winner.

      But you'll break even at 100TB - which is only 3 generations of 33TB, so if you've got a fair amount of data to keep backed up then it's not too bad a deal.

      You left out the electricity needed to power whatever the disk drives are in, the disk drives themselves (even if they're not spinning they need some power), the power to spin the disks when they are being used (if they spin down when not in use), and the power to remove the heat generated by all that equipment.

    16. Re:Never consumer ready by wonkey_monkey · · Score: 1

      Never consumer ready

      Never really meant to be.

      Wake me when tape is reliable AND costs 10% of the $/GB of hard drive storage.

      Yeah? Well, wake me up when they cost five precent of the $/GB of HDDs!

      Arbitrary criteria FTW!

      --
      systemd is Roko's Basilisk.
    17. Re:Never consumer ready by Anonymous Coward · · Score: 0

      I remember the old QIC tapes being aimed at home users back in the Amiga days. Only knew one person that had one though.

    18. Re:Never consumer ready by Lehk228 · · Score: 1

      Amazon Glacier

      why would you name your backup service after something associated with being very slow?

      --
      Snowden and Manning are heroes.
    19. Re:Never consumer ready by AthanasiusKircher · · Score: 1

      As far as I can recall, tape backup systems have never been a consumer product. At least, I don't recall tape systems ever being marketed that way.

      Sure they were, but perhaps not in this millennium. The last tape drive I bought was in 1995 or 1996, and it was definitely advertised in a run-of-the-mill computer magazine or consumer product guide, which would also advertise games and such. Back when floppy disks were your only other reasonable option for backup, tape drives were a reasonable consumer option for home users with more than a few dozen worth of floppies of data to store.

      But then zip disks became a thing for a while, and by the late 90s, CD burners became common enough and cheap enough that home users could take advantage of them.

    20. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Wake me when tape is reliable AND costs 10% of the $/GB of hard drive storage.

      Tape is reliable:

      Jason Hick, Storage Systems Group Lead at NERSC, uses a wonderful analogy to put this level of reliability into perspective: NERSC's data migration (from June 2009 to March 2010) involved reading 14,805,823 meters of tape, which is the distance between San Francisco and Perth; unreadable data resided in at least one block of 14 files. Those 14 files representing 108 meters of tape, approximately the length of the Boeing 777 one might use to fly between those two cities!

      http://www.oracle.com/us/corporate/analystreports/corporate/esg-nersc-case-study-202702.pdf

      An Oracle StorageTek T10000D drive currently holds 8500 GB of data (uncompressed), and the T2 cartridge costs about US$ 250. It can write at 250 MB/s (bytes/s, which is 2 GB/s), again uncompressed. IBM has capacities that aren't that large, but are comparable. LTO is actually lagging a bit (though it's less proprietary, which is plus for many people).

      The tradeoff is that you have the initial purchase price of a library and tape drives, versus the power used to keep the drive spinning and cooled.

      With tape it's generally been go big or go home, and for personal use and small businesses, that initial cost is not worth it. But once you get to a certain size, and want to keep around backups for longer than (say) six months or a year, it's hard to go wrong with tape. Especially if you want an off-site component: the cloud is nice for small data sets, but if you have to restore several terabytes of backups, it's going to take a long time to transmit it over the ISP.

    21. Re:Never consumer ready by CODiNE · · Score: 2

      RED drives are specifically designed for RAID enclosures to prevent early failure due to vibration and constant sleep/wake cycles. They even avoid synchronizing their vibrations with other disks in the array.

      Sure in some situations you can get by with regular consumer gear, but in other situations it's asking for trouble.

      --
      Cwm, fjord-bank glyphs vext quiz
    22. Re:Never consumer ready by Anonymous Coward · · Score: 2, Interesting

      having worked for a storage vendor for many years, i have data that says you're wrong.

      in the early days, we allowed customers to buy their own drives. many of them got
      consumer drives and suffered for it. one customer bought 16 consumer grade drives
      from either wd or segate (i forget), and every one failed within two years.
      in my own personal array, i caught samsung 750gb drives lying to me about having
      written data after a power outage. (reading returned all 0s after having flushed the
      cache.)

      as we got more sophisticated, we found there were two reasons we found for this. enterprise
      hard drives are built differently, and they run different software with different settings.
      because of the better hardware, the mtbf is quite a bit better, and because of the better
      software, a failure is more likely to be obvious. there's nothing better at trashing data
      than a silently failed drive.

      i'm not saying there are smoke and mirrors features. sas seems worthless to me,
      except it is often tied to better hardware....

    23. Re:Never consumer ready by hey! · · Score: 1

      Wake me when tape is reliable AND costs 10% of the $/GB of hard drive storage.

      No, you have to get up before that so you can shlep 22 10 TB hard drives to the backup site.

      The truth is that there is no simple solution for backup -- not if you consider preparing for future contingencies. Backup to hard drives? Your backup data is an asset that needs constant maintenance less bit-rot set in.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
    24. Re:Never consumer ready by ShanghaiBill · · Score: 1

      having worked for a storage vendor for many years, i have data that says you're wrong.

      Golly, who should I believe? Numerous companies that have published actual data on hundreds of thousands of drives, or some random anonymous guy on the Internet with an anecdote. Decisions, decisions ....

    25. Re:Never consumer ready by Anonymous Coward · · Score: 0

      It only takes 200 BD-R's to backup a single 5TB drive ;) Finally a way to occupy entire weekends worth of free time!

    26. Re:Never consumer ready by MichaelMacDonald · · Score: 1

      Tape isn't a fair option for a home system. I have a 21tb RAID6 that's growing quickly. I need something like this now, and cheap. Right now, my best option seems to be the 8tb archive drives Seagate is selling, I don't know. Honestly, there is no good solution. Even RAID6 I'm nervous, and it's good to be able to backup, wipe, and rebuild my raid if I want to fix or change something about it. I'm on Ubuntu mdadm/ext4 64 bit right now, and I wouldn't mind trying out some of the Freebsd/zfs options. I don't know. No matter what, it would be nice to have some flexibility and another level of safety.

    27. Re:Never consumer ready by alen · · Score: 1

      if one of my HP drives fails i call it in and get a new one in less than 24 hours with a pre-paid label to ship the old one back. consumer drives you won't get an answer for days

    28. Re:Never consumer ready by ShanghaiBill · · Score: 5, Insightful

      RED drives are specifically designed for RAID enclosures to prevent early failure due to vibration and constant sleep/wake cycles.

      Baloney. If this were true, it would show up in reliability data. It does not.

      Sure in some situations you can get by with regular consumer gear, but in other situations it's asking for trouble.

      Thanks for the advice. But I prefer to listen to people that know what they are talking about, and have data to back it up.

      Btw, I have some super premium gold plated SATA cables that will DOUBLE the reliability of your enterprise drives!!! Please post your credit card number and address.

    29. Re:Never consumer ready by silas_moeckel · · Score: 1

      You do realize that for either of those two use cases they are not in typical enterprise settings. No hardware raid controllers (or at least being used a jbod) means no need for TER. They are not buying anybody solution the tech is a core business function. You average enterprise cares about somebody to call to fix it more than we saved 50% on hardware.

      For my own company you better beleive we use consumer grade drives internally. Things like ZFS mean all the hot data is on SSD anyways (and while you can use a consumer ssd for write cache a lot of research is needed).

      --
      No sir I dont like it.
    30. Re:Never consumer ready by silas_moeckel · · Score: 1

      How long in archive do you think that consumer grade USB drive will last?

      --
      No sir I dont like it.
    31. Re:Never consumer ready by MichaelMacDonald · · Score: 1

      Red drives aren't enterprise level drives. I've started switching to them over Seagate, I have had too many failures in 3tb Seagate drives.

    32. Re:Never consumer ready by Dutch+Gun · · Score: 2

      It IS slow, intentionally so, at least for retrieval of your data. That's fine for a backup system - and Glacier is specifically marketed for this. You want reliability and economy for backups, not speed. They've reduced the cost of the storage by sacrificing retrieval speed. "Glacier" is also evocative of "cold storage"

      --
      Irony: Agile development has too much intertia to be abandoned now.
    33. Re:Never consumer ready by Guspaz · · Score: 1

      Enterprises still use lots of tape backups. It's still much cheaper and more durable when it comes to backup up servers and physically shipping the data to IronMountain or the like. Iron Mountain's advertising trumpets that 94% of Fortune 1000 companies use their service, so that's a pretty clear indication that tape is alive and well.

    34. Re:Never consumer ready by MichaelMacDonald · · Score: 1

      Tape backup drives were most definitely a part of higher end home systems for a while. QIC was directed towards small business and home use from the beginning. High end home computer users and small business owners tend to have similar needs in any case. Right now small business doesn't have acceptable backup options either.

    35. Re:Never consumer ready by Guspaz · · Score: 2

      If one of your consumer drives fail, you've got a new one in seconds without any physical activity, because the massive cost savings allows you to keep lots of spare drives on-site as hot or cold spares. Any company that has zero spare drives and must wait for an RMA to get their RAID array back in operation is doing it wrong.

    36. Re:Never consumer ready by Guspaz · · Score: 2

      Because it's marketed as being very slow, with response times measured in hours? It's a very cheap offline storage solution that uses BD-R discs and robots.

    37. Re:Never consumer ready by Guspaz · · Score: 1

      Unless you buy them in massive bulk, like Amazon did, and then they become cheaper than all other alternatives. And swapping isn't a problem when you're massively automated.

    38. Re:Never consumer ready by Guspaz · · Score: 1

      Depends on what type of disc you're using. A 5TB drive would require as few as ~39 discs.

    39. Re:Never consumer ready by hudsucker · · Score: 1

      As far as I can recall, tape backup systems have never been a consumer product. At least, I don't recall tape systems ever being marketed that way

      QIC, Travan, Iomega Ditto, and DDS (DAT) tape drives were all marketed as consumer products in the 1990's.

      In 2000 a DDS-2 tape cost $4.47, with a capacity of 8 GB (compressed): 56 cents per gigabyte. A 9.1 GB SCSI hard drive cost $385: $4.23 per gigabyte. Reusable optical media was not cost effective, and there wasn't anything else (that I can remember) with both high capacity and low cost.

      (QIC and Travan drives were cheap, but the tapes were expensive; around $30 per tape IIRC. DDS tapes were cheap, but the drives were expensive; $700 for a DDS-2 drive in 1997.)

    40. Re:Never consumer ready by Anonymous Coward · · Score: 0

      I'm pretty sure the cost is because it requires teams of people and only a few industries actually purchase / use the technology. Cost to market is high and size of market is low.

      That is just an assumption though, but seems reasonable.

    41. Re:Never consumer ready by Anonymous Coward · · Score: 0

      When a 4GB tape was about the same size as your HD and sat on the same SCSI bus you already had, tape was a consumer product. In 1999.

    42. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Enterprise drives are NOT supported by RMA. HP, Dell, etc all have replacement plans for their gear (including drives) which guarantees replacement within a certain time frame. Also, you're not going to find 15K rpm SAS drives in consumer gear, because most consumer gear doesn't have to maintain heavy-use DBs or other massive enterprise business.
      All those things cost money.
      Those red drives are like Cadillac Escalades; fancy, but no real performance or utility besides prestige.

    43. Re:Never consumer ready by Anonymous Coward · · Score: 0

      The only reason to buy enterprise drives is because you have excess money that you are too stupid to keep Or you have an organization that has decided vendor lock in is easier to deal with than adding yet another vendor.

      For example I need to buy particular memory modules. I can get said modules for ~450-550. But the *only* vendor I can buy from has them at 950 a module. Nearly 2x the cost. I literally can not buy them cheaper because my company has decided to only buy from one vendor. Its not even knock off modules it is the exact same part for 2x the cost.

      The only reason to buy 'enterprise' is the warranty and even that is marginal in its benefit.

    44. Re:Never consumer ready by sjames · · Score: 1

      QIC 80 was very much marketed to consumers and the tapes held more data than a typical HD of the day. They were quite common on high end PCs.

      Now get off my lawn!

    45. Re:Never consumer ready by ShanghaiBill · · Score: 1

      if one of my HP drives fails i call it in and get a new one in less than 24 hours with a pre-paid label to ship the old one back.

      So you pay $300 for a $100 drive because there is a 10% chance you will get another $100 drive? You are either really bad at math, or you are spending someone else's money.

    46. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Yes. You don't type in 7 pages of BASIC from a magazine just to have the game go away when you turn off your TRS-80!

    47. Re:Never consumer ready by guruevi · · Score: 1

      They are actually cheaper per TB if you need to consume at least a 4U tape robot worth of tape (20-30k, several PB). Otherwise disk storage is the way to go. Most enterprises don't need tape though, they have it grandfathered in from 'mainframe' systems and 90's Sun systems and a 'we don't know any better' mentality.

      --
      Custom electronics and digital signage for your business: www.evcircuits.com
    48. Re:Never consumer ready by sjames · · Score: 1

      DDS drives were somewhat expensive, but nothing like the cost of LTO today. Using your figures, the break even on cost was 2 tapes worth of data and that amount of data was well withing the amount a 'power user' might want to safely store.

    49. Re:Never consumer ready by sjames · · Score: 1

      Not at all arbitrary. DDS2 tapes and drive came in at about 10% the cost of drives.

    50. Re:Never consumer ready by Anonymous Coward · · Score: 0

      That's not what those studies say. They say that for their business mode (e.g. turn over rate, sensitivity to failure etc) the desktops are much better once cost is factored in. Besides to the best of my knowledge Google never released their numbers and Backblaze never even tested the 4TB WD Enterprise drives.

      Does that mean enterprise is better, nope. But the studies you reference don't claim desktops are as reliable either. At best they showed that for one vendor there was no difference but for that particular vendor (looking at you Seagate) their 3TB disks were crap no matter what.

    51. Re:Never consumer ready by houghi · · Score: 1

      Youmust use the correct gold plated cables. That way there IS a difference. I clearly can hear the difference in sound if an MP3 is played from a consumer or an enterprise drive.

      --
      Don't fight for your country, if your country does not fight for you.
    52. Re:Never consumer ready by Anonymous Coward · · Score: 0

      For your collection of movies and photos, there is no cost to you for downtime. This is not true in enterprise. If one of our nodes goes offline for 3 days due to a failed drive, the cost in lost time is thousands of dollars, if not higher if something mission critical takes longer. Think of it this way: if it takes one employee 3 hours longer to do something because he had to wait for another node to become available, that's more than $200 just paying him to sit around. Now extrapolate that over all the other employees who had to share the reduced resources and the cost is far more than $200 for a new drive.

      $200 is nothing to a business.

    53. Re:Never consumer ready by bheading · · Score: 1

      Google and Backblaze are not typical enterprise deployments. Each company has built what is effectively an entirely in-house proprietary SAN with a large dedicated team to maintain it. Regular enterprises, ie people who are not in the storage business, cannot do this.

      FYI 15000RPM SAS drives will provide significantly more IOPs per disk than 7200RPM SATA drives. Depending on the application, that may be important. The firmware on SAS drives also tends to be tuned for heavily random workloads, and for operation within a RAID array. Cheaper SATA drives come with a shorter warranty and conditions on how frequently they are in active use. Outside of these, yes the drives are essentially the same.

      I suspect SSDs will eliminate most of the remaining business case for deploying SAS drives in the near future as the cost per gigabyte continues to fall.

    54. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Backblaze's blog posts are highly specific to particular drive models and not scientific.

    55. Re:Never consumer ready by Anonymous Coward · · Score: 0

      My trusty Colorado Jumbo would disagree with you, sir, were this 1993 and 250mb mattered. Those things were the life blood of the Warez scene back when 14.4k baud was the limit.

    56. Re:Never consumer ready by Anonymous Coward · · Score: 0

      For your collection of movies and photos, there is no cost to you for downtime. This is not true in enterprise. If one of our nodes goes offline for 3 days due to a failed drive, the cost in lost time is thousands of dollars, if not higher if something mission critical takes longer. Think of it this way: if it takes one employee 3 hours longer to do something because he had to wait for another node to become available, that's more than $200 just paying him to sit around. Now extrapolate that over all the other employees who had to share the reduced resources and the cost is far more than $200 for a new drive.

      $200 is nothing to a business.

      Which is why you spend half that "nothing" on a spare drive, cutting downtime to three minutes vs three hours, as per your example.

    57. Re:Never consumer ready by jthill · · Score: 1

      If one of our nodes goes offline for 3 days due to a failed drive

      So, the phrase "hot spare" is new to you, then. That speaks . . . volumes.

      --
      As always, all IMO. Insert "I think" everywhere grammatically possible.
    58. Re:Never consumer ready by Anonymous Coward · · Score: 0

      If I'm not mistaken, the difference between WD's blue/green/black/red is the acoustic management. They got sued or something over a patent and can only use varying levels of it in their drives. Green being the quietest, red or black (can't remember which) being the loudest.

    59. Re:Never consumer ready by Anonymous Coward · · Score: 0

      sorry i didn't steal data from my employer to satisfy you.
      (by the way, ShanghaiBill, you don't appear to be very nonomous yourself.)

    60. Re:Never consumer ready by guacamole · · Score: 1

      For consumer yes, but who is talking about consumers anywhere in the article?

    61. Re:Never consumer ready by Anonymous Coward · · Score: 0

      and, where's *you're* data. you are the one making the blanket claims.

    62. Re:Never consumer ready by Anonymous Coward · · Score: 0

      I was assuming that the drives are taken out and stored in a cupboard like tapes would be.

      Handy you can hook them up to anything, but a real faff to have to pulg/unplug drives all the time.

    63. Re:Never consumer ready by Pinky's+Brain · · Score: 1

      The high RPM SAS drive business is just kept running to supply a few left over suckers ...

    64. Re:Never consumer ready by ILongForDarkness · · Score: 1

      Not only that: HDDs spindles seeze up after a while if not spinning from what I've heard (lubricant drying out in the barings?). Tape: designed to sit idle for 99.99% of their life.

      The cost of the tape drive is the killer. You need to have enough data that you can amortize the cost over many tapes, but given the fairly limited drive slots available on very expensive disk arrays + the cost of the FC ports on the network switches etc etc life becomes much easier quickly having a robot and 4 tape drives attached to the file server vs 2000 disks in say 100 disk arrays (meaning probably 4 network switches, 200 gbics at about $100-500 a pop etc).

    65. Re:Never consumer ready by WinstonWolfIT · · Score: 1

      I haven't been in a server room in an embarrassingly long time, but I understood enterprise drives to mean hot pluggable with online redundancy. For a not large business, knowing a drive failure would result in no downtime and never having to roll back to tape was worth virtually any premium. In this scenario, tape only came into play when wanting to retrieve deleted data.

    66. Re:Never consumer ready by WinstonWolfIT · · Score: 1

      By that measure, how credible are you exactly?

    67. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Sure, it's "only" 50 discs 4 layer BD-R XL at ~$45 each! That's just a bit pricier than *fifteen* 5TB hard drives too... Even backing up on USB flash drives or SSDs would be a better option! Blu-Ray failed to deliver, very badly! Expensive drives which almost nobody has, discs that were FAR too expensive, and WAY too small by the time they got anywhere near affordable... Optical storage is pinning for the fjords. Even as a medium for movie, it's still outsold by DVDs by a very large margin today...

    68. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Amazon Glacier

      why would you name your backup service after something associated with being very slow?

      Because it sounds cool. And slick.

    69. Re:Never consumer ready by SuricouRaven · · Score: 1

      Remember that the directional arrow needs to point towards the storage controller for most applications. You only point it towards the drive for a predominantly write-only application, like a backup store.

    70. Re:Never consumer ready by Anonymous Coward · · Score: 0

      You aren't going back far enough. Tape drives were the standard backup tool in the late 1980s when hard drives were just reaching 100 MB. (Ever backed up a 100 MB HD onto 5 1/4" 360KB floppies?) Tape drives were cheaper than hard drives, and in a world where cassette tapes were still the standard for audio, tape drives for computer backup were well accepted by the public.

    71. Re:Never consumer ready by Billly+Gates · · Score: 1

      The cost of the drive is not the hardware.

      It is how much will an outage cost? A few hundred more is pocket change. A piece of mind too. You claim you hqve data? I have data too. Go google Seagate RMA? Shitty defective drives. Even western digital has bad drive batches. The poster above says seagate and consumer drives failed within his own eyes. Sure if you got a good batch you are good I guess?? Would you bet your job on it?

      Firmware for enterprise drives have logging and more advanced features anyway. Same arguments pop up over consumer vs professional cards in flamewars. One is slightly slower and 4x as much. why? It's drivers and firmware are certified to not have visual distortions when making a commercial or bsod on a project. It is worth the cost.

      The price difference is not worth it anyway

      But the conversation is obsolete as intel and Samsung are introducing enterprise ssds

    72. Re:Never consumer ready by SuricouRaven · · Score: 1

      Used to, years ago. But not since the transition to SATA. All SATA drives are hot-pluggable, though most consumer controllers don't support it easily. In a modern system, the drives are basically dumb stores: All the intelligence is in the controller or software.

      The difference between regular drives and 'enterprise' drives is a lot less than it used to be. Enterprise drives have a higher claimed MTBF, a better warranty cover (So you'll believe the MTBF) and usually come in smaller capacities (The cost of reliability). They may also use SAS rather than SATA as the interface, which has a few advantages - like being able to connect a huge number of drives (2^16 - 2, IIRC) up to a single controller channel, very nice when you want a 48-drive rackmount unit that you can interface without having twelve data cables plugged into the back. Single drive reliability really mattered back in the day when RAID5 was considered sophisticated, but modern storage management is a lot better able to deal with single- and multi-drive failures - which means you can easily achieve the same end result at a considerably lower cost by using plain consumer drives. They are very nearly as reliable as enterpise drives, and the difference is too small to justify the extra cost.

    73. Re:Never consumer ready by Anonymous Coward · · Score: 0

      The so called "RED" drives are actually designed to fail quickly, instead of endlessly trying to remap bad blocks (slowing down other replicas of the data). It's a firmware thing, not a hardware thing (not sure why there's a premium for something that actually does *less* work than a "consumer" drive).

    74. Re:Never consumer ready by Ichijo · · Score: 1

      That's one theory. Here is another.

      --
      Any sufficiently unpopular but cohesive argument is indistinguishable from trolling.
    75. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Not true at all. When you buy a hard drive in a store, how long has it been laying around? How often do you plug in your external hard drive, which also has a standard internal drive inside.

    76. Re:Never consumer ready by Grishnakh · · Score: 1

      But the price for a single tape drive is beyond insane.

      That's pretty easy; it's because of the volume it's sold in. All your consumer electronic gear would cost similar amounts if it sold in similar quantities. There's 1-3 orders of magnitude fewer tape drives sold than, say, laptop optical drives, so of course it's going to cost a lot more.

      You might not remember this, but all this consumer computing gear used to cost a fortune too. I remember paying around $600-700 for a 14" monitor once, and $350 for an 80MB hard drive; this was around 1990, when a dollar was worth quite a bit more than it is now. Back then, a laptop cost probably a couple thousand dollars or more. These days, you can get a decent laptop for $500-1000, and a nice used laptop for $100-200.

    77. Re:Never consumer ready by Grishnakh · · Score: 1

      Not with a $30 dock it isn't.

    78. Re:Never consumer ready by Grishnakh · · Score: 1

      As far as I can recall, tape backup systems have never been a consumer product. At least, I don't recall tape systems ever being marketed that way.

      You must be young. Back in the 90s, we had "floppy tapes": QIC systems connected to the floppy connector on the motherboard, and with the correct software let you store 20MB or 40MB per tape (more with compression turned on). These were marketed to small businesses and high-end consumers. One of these tape drives didn't cost any more than a typical hard drive of the day.

    79. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Red Drives have an unrecoverable read error rate of 10^14th making them really unsuitable for large parity raid.
      They do have proper TLER (Time limited error recovery) settings for use in RAID (Consumer drives don't and will cause issues).

      RED drives are not the same as enterprise drives in terms of URE's (10^15th standard in enterprise drives).

      A URE isn't a drive failure. Its a failure to read a single bit, which durring a parity rebuild makes a drive as good as useless.

    80. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Unlikely. You can also buy storage tape in massive amounts and save tons of money. That's even easier to automate. It's also more reliable and more compact .

    81. Re:Never consumer ready by Guspaz · · Score: 1

      Amazon buys them by the truckload and ends up paying a tiny fraction of that. It turns out that when you order BDXL discs in bulk quantities, the costs go way down.

    82. Re:Never consumer ready by Chandon+Seldon · · Score: 1

      Why have an outage?

      With the cost difference you replace one RAID-5 array with a RAID-61 array with 8 hot spares.

      --
      -- The act of censorship is always worse than whatever is being censored. Always.
    83. Re:Never consumer ready by Dutch+Gun · · Score: 1

      Holy crap, I give! I give!

      Ok, obviously there were some tape drives offered on consumer models. I'd imagine that the *vast* majority of consumer PCs didn't have tape drive hardware on them, but yes, they certainly were available.

      --
      Irony: Agile development has too much intertia to be abandoned now.
    84. Re:Never consumer ready by jedidiah · · Score: 2

      It doesn't matter. If you are waiting for a storage vendor to send you replacement gear then you're irresponsible and putting your company at unecessary risk. Even a good SLA that's actually successfully executed is still too much exposure.

      --
      A Pirate and a Puritan look the same on a balance sheet.
    85. Re:Never consumer ready by ILongForDarkness · · Score: 1

      external drive: permanently attached. It is where my "acquired" media lives. Store shelf: it is a matter of magnitude. Likely HDD at store is turned over at least once a year. Typical retail you need to turn your inventory over 3-4 times a year at least. But long term archival storage for enterprise: 10yr +. With that long of a duration you need something like LTO that really, really tries for backwards compatibility. Try to get an IDE (or earlier) connection on your new server.

    86. Re:Never consumer ready by Anonymous Coward · · Score: 0

      I'm not going to discredit either parent post nor the companies that were running these tests. However I question how things have changed over time, when testing was done, and the differences in sources for the drives.

      I was working in a computer store when we started getting the Seagate ES "Enterprise Storage" drives. The ES cost $10 extra. They were rated with longer MTBF. I bought some, didn't have troubles. If their consumer drives were lowering in quality, $10 is not much for keeping reliability, and if they were better quality drives that last longer than standard, $10 extra wasn't that bad.

      We still saw drives of both come back - less of the ES, however I would lean more on that we sold less ES drives than CS anyway. However, this was nothing compared to our experience with Western Digital.

      It seemed every time we bought a reasonable batch of WD drives we would have at least one drive that would fail in 6 months. When you sell things to people you want them to work - if you want a car analogy, I don't want to sell someone a car, that has been fully tested, sealed and delivered by the manufacturer, to then have a massive invisible production flaws that cause an accident 6 months after I sold it to them.
      We wanted to carry a range, so we would try some now and then. WD came out with "Green series" - and we had increased failures again. Really, every time we tried to trust WD we got shot in the foot.

      Maybe this could be dependent on our suppliers, or even our importers. I expect companies that buy large amounts of drives probebly get better pick of the crop as well as getting lower prices. It doesn't matter if you just want to sell people good, working items, and althought you cannot fully believe what major publications say, its a good starting point. You just need to find out what is good in your local market.

      We sold Seagate because they worked best, in our experience. WD failed worse, more often, and newly-released series had higher failure rates than Seagate, in my experience. However when the top company starts selling products where the declared deviding factor is reliability, if there is not a quality difference yet, they will make one.
      If they do not, why are they not charged for false advertising?

    87. Re:Never consumer ready by dbIII · · Score: 1

      Wake me when tape is reliable

      I had some reels of tape from the 1970s transcibed last year and it worked with zero problems. I've had others done previously, same result.

      costs 10% of the $/GB of hard drive storage

      How arbitrary. Tape is for offline storage and hard drives have known problems with spinning up after a few years idle.

    88. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Yes, same as the other technologies which also get more affordable! Funny that, eh?

    89. Re:Never consumer ready by dbIII · · Score: 1

      If the antivaxxers are to be taken as an example then some random anonymous guy on the Internet with an anecdote that is emotive enough wins far more often than expected.

    90. Re:Never consumer ready by dbIII · · Score: 1

      They were also CRAP. A 4mm tape is just too delicate for what they were trying to do with them so they had a very high failure rate. That's why we use wide stuff like LTO that is strong enough to be wound and unwound.

    91. Re:Never consumer ready by sjames · · Score: 1

      I have never lost data due to a DDS tape failure.

      LTO is more durable to be sure, but it's also priced out of the consumer market and mostly out of the small business market.

    92. Re:Never consumer ready by Agripa · · Score: 1

      not sure why there's a premium for something that actually does *less* work than a "consumer" drive

      Market segmentation and price discrimination.

    93. Re:Never consumer ready by dbIII · · Score: 1

      Maybe it was just a crap drive or people using it were handling it poorly, but I ended up with a lot of tape breakages and sending the thing off for repair frequently. The person who chose it did it solely on the basis of price so it was the cheapest DDS available while everything else in the company was exabyte 8mm and IBM 3490 (including a Fuji clone). The DDS saw very little volume in comparison but always seemed to be failing.
      So yes, anecdote not statistic, whether DDS was crap or not in general it certainly was for me.

    94. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Tape is archival grade and guaranteed for life. No HDD made other than enterprise grade is warranted for more than a year now.

      This is the problem, which is going to screw people where the sun don't shine. People use HDDs as backups... but RAID is not backup. All it takes is some malware to destroy the drives, and all that data is gone. Plug in a backup drive? The malware will zero this out.

      We saw this back in the MS-DOS days with viruses that would just hang around and randomly corrupt files on all drives attached. That backup drive? Not immune.

      What tapes brings is an offline capability and a physical read only switch:

      1: Malware really can't access stuff on a tape drive, other than trying to nail a LTFS partition. If one uses even something as brain dead as tar, the tape tends to be protected.

      2: Flip the read write switch, and that tape isn't going to be erased, period.

      3: Tapes can be WORM. This way, stuff that needs to be tamper resistant is protected.

      There are way too many idiots who think their SAN or NAS installations are backups... but they don't realize that a single "rm -rf" or an isi command... and all backups are gone. Tape is a must.

      As for data loss, it is only a matter of time before some company gets hacked, data erased, then people go to jail because using HDDs for backups breaks Sarbanes-Oxley, FERPA, and other regulations for data retention and archival.

      It would be nice if Sony or someone can make tape drives at a reasonable price. In these days of ransomware, they are the only way to securely store data. Optical would work, but BD-R just doesn't cut it.

    95. Re:Never consumer ready by sjames · · Score: 1

      It could be a quality issue. I always used Sun drives. Very heavy construction made alignment issues unlikely. I also made sure to retension the tapes.

    96. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Part of this is the law. Getting hit by an e-Discovery request right after a malicious hack destroyed the pair of Avamars that were holding data can get people tossed into prison.

      The thing about tape is that it is a lot more reliable. I have used tens of thousands of tapes over a good portion of a decade at one job. I have had five tapes total have either soft read errors or hard write errors... but not a single cartridge had a hard read. LTO tapes are not your shit-tastic 8mm tapes of yore which die if you breathe on them. In fact, if you drop a LTO tape, you pick it up, dust it off, and if it isn't too mangled, it will be fine. Drop a hard drive, and you might be able to get data off... but maybe not. In any case, the drive is not trustworthy.

      Tapes are boring... and the SAN guys are always saying how useless they are, but I've had cases where a firmware upgrade on a small SAN caused a glitch that caused it to write garbage on the entire array... and the damn thing replicated the damage to the second array, including overwriting the snapshots. If the tapes are sitting in a safe, malware, bad firmware, or other stuff are not going to affect them.

    97. Re:Never consumer ready by Guspaz · · Score: 1

      The downside of tape backup is that it's often not practical to restore from. Whenever we've had an incident where somebody messed up, it was decided that it would be less effort to spend multiple person-days rebuilding the data than it would be to restore from backup.

      Yeah, it'll help in a catastrophic failure scenario, but sometimes I wish the IT guys would just turn on shadow copies or something, because tapes aren't helping with the "Oh shit, somebody accidentally deleted half the QA server, and it'd take a week to get the tape back from the archive facility, but we can rebuild it by hand in two or three days."

      Meanwhile, if we'd had some sort of snapshot-based backup, it would have taken a few minutes at most.

    98. Re:Never consumer ready by Pentium100 · · Score: 1

      Its a failure to read a single bit, which durring a parity rebuild makes a drive as good as useless.

      No, it doesn't for two reasons:
      1) Nobody should use RAID5 (or equivalent) with drives over 2TB, RAID6 has two drives for parity. Greatly reducing the risk of failure.
      2) A single read error during a RAID5 rebuild results in a single bad stripe in the array (if the controller works properly). Sure, you lost some data, but no all of it and you can pull the damaged files from backups (or maybe you get lucky and the bad stripe is in empty space).

    99. Re:Never consumer ready by Pentium100 · · Score: 1

      But if the enterprise drive costs twice as much as a RED or some other lower grade drive, wouldn't I be better off buying two cheaper drives and putting them in a mirror?

    100. Re:Never consumer ready by philipcummins · · Score: 2
      Having a look LTO-6 tapes are now about $40 US per cartridge vs about $80 for a 2 TB hard drive. However, with tape you get the advantages that should be considered along with the disadvantages. LTO tapes are rated for at least 20 years in a stable shelf environment - if you're buying cheap hard drives you generally don't want to trust them as archival media particularly when you're only able to get max 5 year warranty on them. LTO tapes generally are very reliable when being shipped around regularly (i.e. for offsite archiving) compared to hard drives. You can also get relatively cheap autoloaders that can queue up 8+ tapes at at time for long backup & archive jobs that you can cycle tapes in/out of without interrupting things compared to a RAID system. They also clock 160 MiB/sec write speeds which is fairly acceptable with the use of an autoloader and D2D2T backup. They are also easier to make write-only, and the ability to mess up a tape is much harder from a file system corruption point of view unless you use LTFS.

      The downsides are that LTO drives are expensive compared to buying bare drives (or USB drives). Once you step up to a disk based RAID array it gets comparable however. You also obviously don't get random access to your data when you want it like a nice RAID unit. They also almost exclusively use SAS or FC connections which most people don't have (a few have USB 3.0 or Thunderbolt now, like mLogic or IBM) which means you can't fit to a basic computer easily without some work.

      I personally use tape for my archival backup now having invested in a system to do it (and I'm what I consider a consumer). RAID systems are nice but they don't cover mistakes, file system corruption or hardware failures which could happen and wipe out terabytes of data. With offline tape I can simply restore it if/when I require it.

      The issue is that when you buy storage you should consider the backup requirements at the same time. I see a lot of people getting RAIDs or Drobos considering the hardware failure angle but not the malicious/filesystem corruption angle (i.e. someone using sudo rm -rf /*) and unless they have them online a lot you never know when your backup drive has failed as well (or failed when you really need it). For small business I'd say RDX cartridges get the equivalent lifespan of tape however in a more convenient format ($150 for a chassis + cartridge costs) so this would be a viable solution for small businesses for archiving legally required data for 7+ years.

    101. Re:Never consumer ready by Pentium100 · · Score: 1

      I use ZFS on debian at home and the company I work for uses ZFS on Linux for backups and storage arrays (like for video surveillance). It works nice.

      My home storage server array is smaller, however, a tape autochanger is on my wish list (I have a couple of tape drives and I used tapes more in the past, but I want automatic backups and that means I won't be there to swap tapes).

      I like the fact that tapes can sit on a shelf for years with no problems and buying another server for backups would be more expensive and less convenient (unless I started swapping drives like tapes). Also, if a hacker wants to destroy the data that is on my tapes, he will have to come to my home to do that.

    102. Re:Never consumer ready by Pentium100 · · Score: 1

      3: Tapes can be WORM. This way, stuff that needs to be tamper resistant is protected.

      I wonder how really tamper resistant are those WORM tapes. I mean, unlike a CD-R or PROM chip where recording of data irreversibly changes the medium, WORM tape is still magnetic tape, right? Is it only the drive firmware that protects it from being overwritten or something more? If someone has access to a modified tape drive, can they change the data on the WORM tape and leave no evidence?

    103. Re:Never consumer ready by Anonymous Coward · · Score: 0

      because as soon as you see a bad block, if you use a data striping recovery system that allows one drive to fail, you want to throw it out and replace it.

      but if it's the hard drive in your laptop, you want it to keep remapping that bad block while informing you that there is a bad block, so you can do backups and plan for replacement.

      obviously.

      do i have to chew your food for you too?

    104. Re:Never consumer ready by Anonymous Coward · · Score: 0

      That is irrelevant. It is the credibility of the data provided by Google and Backblaze that he referred to that is relevant.

    105. Re:Never consumer ready by Anonymous Coward · · Score: 0

      Well, WD Red drives certainly have lower power consumption than the equivalent standard-consumer WD Green drives. See this test. The power use when idle is 3.9W for the WD30EFRX (the Red drive) and 6.1W for the WD30EZRX (the equivalent Green drive), and there's a similar difference when they're operating under different sorts of task loads. Keeping the heat down is important when you're building a RAID, so this should improve the reliability.

      Other claims I've heard for Red drives are that (a) as the GP said, they're more vibration-resistant, or produce less vibration, and (b) they report a possible failure immediately as a failure so that a RAID controller can drop them from the array, whereas a standard consumer drive will keep trying to recover the data, since it's probably not in a RAID. I don't know how practical (a) is, but (b) seems like a sensible change to the firmware in this application.

      So, I would expect the Red drives to be more reliable, in a large-scale RAID setup, than the Green drives. Do you actually have any test or reliability data that contradicts this?

    106. Re:Never consumer ready by confused+one · · Score: 1

      There was a time... back in the 80's and 90's when I used tape backup. QIC comes to mind. Iomega had some other solution as well. If you cared about your data you backed it up to something. Period.

    107. Re:Never consumer ready by Anonymous Coward · · Score: 0

      As far as I can recall, tape backup systems have never been a consumer product.

      You never used an audio cassette tape to backup your TRS-80?

      No, but I did use audio cassette tapes to back up my Commodore PET from around the same time. Actually, the cassettes were used as program storage, as the PET could not handle more than 4kB of data (some models, which I never got hold of, could handle up to 8kB).

    108. Re:Never consumer ready by Anonymous Coward · · Score: 0

      RED drives are specifically designed for RAID enclosures to prevent early failure due to vibration

      I had a netapp in the 90s fail 5-6 drives in a week due to synchronized vibration. Once they figured it out, firmware upgrades prevented any more failures.

    109. Re:Never consumer ready by Blaskowicz · · Score: 1

      Perhaps the original drive is writing encrypted checksums. Even if the data itself is unencrypted and you use a modified tape drive you might not be able to write the correct checksums. You would want to steal the drive that wrote the tape at the least.
      How another drive can detect the data was tampered with, I don't know.

    110. Re:Never consumer ready by Billly+Gates · · Score: 1

      I just went on Amazon. The red is $50 more than the black with the same capacity??!

      All I know is the red are certified to be a good batch. The consumer?? You do not know if it is good or bad as Google had a team to know. You do not.

      With SAS drives you have 2 data paths written and other enterprise level features in case a chip in the NAS goes out and a backup kicks in that the drive can keep going. Its firmware supports more protocols.

      Sorry but the cost argument doesn't fly. To me it is not worth the risk and a $40 premium is a very small price to pay to know that when an outage hits the firmware doesn't lie about whether the data was written or not. Too much risk.

    111. Re:Never consumer ready by machine321 · · Score: 1

      There is NO difference in reliability between "consumer" and "enterprise" drives.

      That's not quite true... vendors continue fixing bugs in "enterprise" drive firmware when they almost never fix bugs in retail drives.

      With that said, we've had terrible luck with a particular brand of 2TB SATA enterprise drives (think of the opposite of Eastern Analog) where we have to keep a shelf of hot spares so RAID 6 can rebuild in time for the next failure. I think we've had a >50% failure rate, but I'm not in that department any more so I'm not sure.

    112. Re:Never consumer ready by machine321 · · Score: 1

      That's not the drive vendor, that's HP. Try getting an RMA for enterprise drives direct from a drive vendor sometime. They'll do everything they can to not honor the warranty. They only want to deal with vendors and VARs.

    113. Re:Never consumer ready by machine321 · · Score: 1

      FYI 15000RPM SAS drives will provide significantly more IOPs per disk than 7200RPM SATA drives

      It's almost exactly double. As a rule of thumb, if you have a 10-drive 15k array, you can get the same performance out of a 20-drive 7.2k array. The problem comes in when people buy for capacity, not performance.

    114. Re:Never consumer ready by bhiestand · · Score: 1

      But if the enterprise drive costs twice as much as a RED or some other lower grade drive, wouldn't I be better off buying two cheaper drives and putting them in a mirror?

      Not if:
      * an increased risk of data loss
      * an increased risk of data unavailability
      * a cost of $150/hr to get a tech on-site to replace drives
      * you need to buy a larger/more expensive chassis
      * you need to spend more on the controller to be able to compensate

      This is really a moot point. If you're not clustering or otherwise building in tons of redundancy, you'll have higher availability and lower TCO buying from Dell/HP/whomever, and they'll bundle the right drives from the start.

      If you are building a cluster, you're not going to take random advice from posters on Slashdot. Build out whatever you want, just know that SuperMicro has terrible support and warranties. Expect bad lots and don't forget to pay attention to firmware and settings.

      --
      SWM seeks new sig for a brief fling
    115. Re:Never consumer ready by Anonymous Coward · · Score: 0

      At least as long as most CD-Rs last in real life (they're rated for a very long time but never live up to those claims). Hard drives will make re-copying to "fresh" media very fast and easy. Good luck copying over a thousand optical discs by hand!

    116. Re: Never consumer ready by cthulhu11 · · Score: 1

      The cost of the chassis / drive bay is so often omitted from these discussions, which seem to be dominated by amateurs running a half dozen drives in a desk-side beige box tower. In commercial usage, the cost of a drive bay, including the chassis, power, cooling, and RU is easily more than the disk itself, and getting hands in to swap out failed units costs a couple hundred $. My storage clusters alone have 660+ spinners.

    117. Re:Never consumer ready by cryogenix · · Score: 1

      Many years ago, I had a backup that was 20 LTO-2 tapes a week for a full backup. Restoring a file from that did not take long at all. I'd say 30 minutes pretty much every time. I could have restored the entire array in a the time frames you are talking about. Not sure why you are taking days to get a file, unless your backup was far more massive than that?

    118. Re:Never consumer ready by TheRaven64 · · Score: 1

      I'm a bit surprised about the idle power difference, but perhaps that's not in the deepest idle state. One of the differences between the red and green firmware is that the green disks are a lot more aggressive about spinning down. This is good for power consumption in desktop, but can kill performance (and drive lifetime) in typical consumer NAS workloads.

      --
      I am TheRaven on Soylent News
    119. Re:Never consumer ready by TheRaven64 · · Score: 1

      If you buy drives from NetApp, they're insanely expensive compared to just buying the drives. One of the things you get for that is a guarantee that you don't have two drives from the same batch in the same array. Just buying two drives does not double the reliability: if they're from the same batch and subject to the same stresses then there's a good chance that they'll fail at the same time. When a drive fails in a RAID set, you want to have a long to resilver before the next one dies.

      --
      I am TheRaven on Soylent News
    120. Re:Never consumer ready by TheRaven64 · · Score: 1

      The problem is that tapes are going in the wrong direction. I remember tape drives costing about the same as a hard disk of a similar capacity and the tapes costing 10-20% the cost of the drive. That made it feasible to stick tape drives in high-end desktop computers so that people who cared about their data had a good backup system. The tape drive added 10-20% to the total cost of the machine (less if it included a decent monitor). Now, a tape drive with the same capacity as a hard drive costs around ten times as much as the disk and more than doubles the cost of the computer it goes in. It really doesn't make sense to buy tape drives: if you have enough data for tapes to be useful then you're going to be buying big tape robots. Tapes left consumer pricing a long time ago and have now left small business pricing too. That's the trajectory for a technology on its way to obsolescence.

      --
      I am TheRaven on Soylent News
    121. Re:Never consumer ready by TheRaven64 · · Score: 1

      Everyone who understands the economics of tech. Show me one technology that has gone from being cheap enough to include in high-end consumer desktops to being out of the price range of small to medium businesses and then become a big commercial success.

      --
      I am TheRaven on Soylent News
    122. Re:Never consumer ready by Grishnakh · · Score: 1

      I remember tape drives costing about the same as a hard disk of a similar capacity and the tapes costing 10-20% the cost of the drive. That made it feasible to stick tape drives in high-end desktop computers so that people who cared about their data had a good backup system.

      It sounds like you're remembering QIC tapes. I had one of those too. I think those were an anomaly; high-end computers have always had tape drives (remember the giant reel-to-reel tapes that mainframes had), and they've probably always been expensive. They didn't really have them for early home computers (they had cassette drives, but they weren't for backup, they actually used them for primary storage for people too cheap to get the disk drives), they just popped up for a while for the "prosumer" market and then fizzled. Tapes are still around, but again only at the high end; companies spending large amounts on IT are not going to blink at a $2k tape drive.

      It really doesn't make sense to buy tape drives: if you have enough data for tapes to be useful then you're going to be buying big tape robots.

      Exactly; companies that are serious about backup can afford this stuff.

      You're right, there is a hole in the market there for prosumer and small business needs, but it seems that no one really cares to fill it. Maybe it simply can't be filled economically by anything besides hard drives: the number of people willing to buy these things just isn't enough to push tape drive prices down, whereas everyone needs hard drives, so we get today's situation where using hard drives (whether bare or in a USB-attached enclosure) for backup is the standard. That's exactly how I back up my data.

      It is too bad they can't make optical discs with enough capacity to be useful for backup. But there's likely difficulties there in making them accurate enough to work. In a hard drive, the big advantage is that the media and the read/write mechanism are enclosed within the same unit, and free of dust, worry about mechanical alignment issues between different drives, etc.

    123. Re:Never consumer ready by Guspaz · · Score: 1

      Because the tapes are held off-site.

    124. Re:Never consumer ready by TheRaven64 · · Score: 1

      The problem is that every other attempt to focus on the high-end of the computing market has failed. You either let economies of scale work for you, or you let them work for a competing technology. Tape used to be the backup medium for SMEs. If you were backing up 5-10 computers worth of data on a regular basis then you wanted tape. Now, the point at which tape makes sense is 1PB, or around 1,000 workstations.

      The problem with this is that tape doesn't make sense for people building their own datacentres, so you're trapped in the market where your customers are very big companies, that are investing a lot in IT infrastructure, but aren't the likes of Google or Amazon (who would help you build the economies of scale). The size of company where it makes sense to start using tape is growing, but the size where it stops is shrinking. As the market shrinks, the prices go up, and that shrinks the size even faster. Eventually no one who has a need for tape will be able to afford it. And, by eventually, I mean really soon.

      --
      I am TheRaven on Soylent News
    125. Re:Never consumer ready by Neil+Boekend · · Score: 1

      High RPM drives are quite quickly being replaced by SSDs.

      --
      Well, I might have a way, but it only works on a semi spherical planet in a vacuum.
    126. Re:Never consumer ready by Grishnakh · · Score: 1

      Tape seems to be a healthy market, otherwise there wouldn't be multiple companies making them and selling them. Just because you can't afford one for your home computer doesn't mean anything; there's tons of larger companies out there who have no trouble dropping $2k on a tape drive. It's not just large ones; even smaller ones can afford that easily. $2k is nothing. How much does a consumer spend on a digital camera these days anyway? I see boxes of them going for $1k+ at Costco. I used to work at a company with only 50-100 people in the office and they had tape drives. You're looking at everything through the lens of your own home budget.

    127. Re:Never consumer ready by cryogenix · · Score: 1

      That would do it :)

    128. Re:Never consumer ready by ejasons · · Score: 1

      You never used an audio cassette tape to backup your TRS-80?

      I don't know of anyone who ever used cassette for backup (other than to save to another cassette).

    129. Re: Never consumer ready by Anonymous Coward · · Score: 0

      This doesn't answer the question.

    130. Re: Never consumer ready by Anonymous Coward · · Score: 0

      What risk?

      SAS so not give you more enterprise security or a second data path. It's just another protocol over the same hardware.

    131. Re:Never consumer ready by TheRaven64 · · Score: 1

      $2K may be nothing in absolute terms, but the question is what that's compared to. $2K will buy you a file server off-site somewhere with snapshots. $2K only buys you a tape drive, not any kind of tape robot, so also factor in the cost of someone's time inserting the tapes and putting them in secure storage. By the time that's added together, you can easily buy two machines in off-site data centres for off-site backups to hard disks with snapshots and easy recovery (or, if you're not a tech-focussed company, you buy an off-the-shelf solution for remote backups that's cheaper than managing your own tapes). And that $2K was $1K for the previous generation of tapes. If you're serious about tape backups, you need at least $20-30K of tape robot and that's a much bigger investment than most small companies want.

      Tape hasn't gone away, but (as I said in the last two posts), the set companies in the middle for whom it makes sense is gradually shrinking. It's far more expensive than the alternatives unless you're in the sweet spot (around 200TB-10PB), but that sweet spot is shrinking from both ends.

      --
      I am TheRaven on Soylent News
    132. Re:Never consumer ready by Grishnakh · · Score: 1

      The off-site storage option is high-risk. How long will that company be around? How do you know they're backing up your data? How do you know they're not selling your data to someone? And that's a lot of bandwidth too.

    133. Re:Never consumer ready by TheRaven64 · · Score: 1

      The off-site storage option is high-risk

      On-site backup is not backup, it's just wishful thinking for a business.

      How do you know they're backing up your data?

      They are the backup.

      How do you know they're not selling your data to someone?

      Because you encrypt it first. And because, if you're a business, you solve this in the same way that you solve the other issues: a contract with steep penalty clauses.

      And that's a lot of bandwidth too.

      There's a reason that business broadband exists and provides 1+Gb/s speeds...

      --
      I am TheRaven on Soylent News
    134. Re:Never consumer ready by Grishnakh · · Score: 1

      On-site backup is not backup, it's just wishful thinking for a business.

      There's nothing preventing them from driving the tapes to a safety-deposit box every week.

      They are the backup.

      And you trust them why?

      Because you encrypt it first. And because, if you're a business, you solve this in the same way that you solve the other issues: a contract with steep penalty clauses.

      Unless this is some sizable company, that doesn't mean anything. As soon as things go south, they just disappear.

      There's a reason that business broadband exists and provides 1+Gb/s speeds...

      And how much does that cost compared to a tape drive? Even gigabit ethernet isn't that fast to a single random internet site, and is pretty slow compared to the speed a tape drive operates at. Seriously, how is some little company with 20 employees supposed to afford this? $2k for a tape drive and some flunky IT employee to run backups every week is not a big cost for a small business.

    135. Re:Never consumer ready by TheRaven64 · · Score: 1

      There's nothing preventing them from driving the tapes to a safety-deposit box every week.

      And that adds to the cost of tape.

      And you trust them why?

      Because you're giving them money and because it's not that hard to arrange a second source. Try building a business that doesn't rely on at least one other company for some core part of its infrastructure.

      And how much does that cost compared to a tape drive? Even gigabit ethernet isn't that fast to a single random internet site, and is pretty slow compared to the speed a tape drive operates at. Seriously, how is some little company with 20 employees supposed to afford this? $2k for a tape drive and some flunky IT employee to run backups every week is not a big cost for a small business.

      For 20 employees, a central file server that backs up to a rotating set of external hard disks that the managing director takes home in the evening is much cheaper than tape and provides off-site backup. That's the kind of arrangement I've seen in such companies. Tape just isn't economical for them because, outside of a few industries, they're not producing enough data to justify more than a couple of hard disks worth of backups. Oh, and you really think 20-employee businesses have dedicated IT people? They'll occasionally hire a consultant to set things up, but most of the time IT will be done by the boss's son or someone else who seems to know a bit about computers. Cheap off-the-shelf backup programs (including the built-in Windows backup utility) can do nightly backups to an external disk and then it's just a matter of rotating them.

      That $2K tape drive isn't economical for anyone. The companies that are still buying tape are not buying $2K drives for backup, they're buying them so that they can restore from accidental deletions without interrupting a backup - they're buying $20-30K tape robots for real backup. If you're a company that can afford a $30K tape robot (and to keep it fed with tape), then you're not far off wanting to have, if not your own datacentre, a rack or two in a colo, and at that point tape stops being interesting.

      --
      I am TheRaven on Soylent News
    136. Re:Never consumer ready by rdnetto · · Score: 1

      It's usually cheaper to use consumer drives and some better software to manage the inevitable failure than to use enterprise drives.

      There is NO difference in reliability between "consumer" and "enterprise" drives. The only reason to buy enterprise drives is because you have excess money that you are too stupid to keep. All the big storage companies use consumer grade drives, and several of them, including Google and Backblaze, have published data that clearly show there is no reliability or performance reason to buy "enterprise" drives. They are a scam.

      IIRC, there is one difference: how they respond to read errors. Consumer drives will keep trying to maximise the likelihood of a successful read, while the enterprise ones will just fail immediately since they're expected to be RAID, so there's another copy of the data and taking longer to reply just kills the throughput.

      --
      Most human behaviour can be explained in terms of identity.
  5. WORN by Anonymous Coward · · Score: 5, Funny

    Write Once Read Never

    1. Re:WORN by Anonymous Coward · · Score: 0

      Just like my to-do lists.

    2. Re:WORN by AnalogDiehard · · Score: 1

      aka WOM (Write Only Memory)

      --
      Eternity: will that be smoking, or non-smoking? I Corinthians 6:9-10
    3. Re:WORN by jtgd · · Score: 1

      Are you referring to Amazon Glacier?

      --
      J
  6. Glacier by Anonymous Coward · · Score: 0

    That's how AWS Glacier rolls

  7. Imperial measurements by Elledan · · Score: 1

    [..] on a cartridge about 4 by 4 inches across and 2 centimeters thick.

    And much like tape, it seems like the random mixing of imperial and metric measurements won't ever go away, either :)

    --
    Site & blog: http://www.mayaposch.com
    1. Re:Imperial measurements by ShanghaiBill · · Score: 2

      And much like tape, it seems like the random mixing of imperial and metric measurements won't ever go away, either :)

      When I was in the military, we always measured distance along the ground in kilometers (or "clicks" in mil-lingo), but altitude was always in feet (or "angels" = 1000 feet). So at least we were metric for 2/3rds of the dimensions. With this tape, only one dimension is metric, so we are going backwards.

    2. Re: Imperial measurements by corychristison · · Score: 2

      Here in Saskatchewan, Canada, we measure distance in time.

      For example:
      Person 1: "How far is Calgary from Regina?"
      Person 2: "Oh about 7 hours."

      I'm not sure why we do this, but this is the honest truth. My wife used to work at a service station, and had people ask how far X was. They would look at her like she was an alien if they weren't from around here.

    3. Re: Imperial measurements by mjwx · · Score: 1

      Here in Saskatchewan, Canada, we measure distance in time.

      For example:
      Person 1: "How far is Calgary from Regina?"
      Person 2: "Oh about 7 hours."

      I'm not sure why we do this, but this is the honest truth. My wife used to work at a service station, and had people ask how far X was. They would look at her like she was an alien if they weren't from around here.

      We do the same here in Australia because distance never takes traffic into account. Fremantle to Perth is 30 minutes on a Saturday arvo, but 50 minutes on Monday morning.

      --
      Calling someone a "hater" only means you can not rationally rebut their argument.
  8. People still use tape? by Anonymous Coward · · Score: 1

    what decade is this? 2000? wouldn't it be easier to use a 3 TB external USB drive that has random access? Suppose I need to access one file in the middle of the tape. The tape drive would need to roll the tape from the beginning to the middle.

    1. Re:People still use tape? by Anonymous Coward · · Score: 0

      You obviously are not gonna use tape if you need constant random access capabilities.

    2. Re:People still use tape? by Anonymous Coward · · Score: 0

      what decade is this? 2000? wouldn't it be easier to use a 3 TB external USB drive that has random access? Suppose I need to access one file in the middle of the tape. The tape drive would need to roll the tape from the beginning to the middle.

      Yeah, those where 3 TB is a few hours of data that needs to be archived and accessed for years.

      You know, those not playing with toys.

      Who the hell modded you up?

    3. Re:People still use tape? by Anonymous Coward · · Score: 0

      wouldn't it be easier to use a 3 TB external USB drive that has random access?

      No.

      Just imagine if you did that, and see how it goes. Morning 1: you plug in the external USB drive. 5pm: you leave, knowing it'll back up tonight. Maybe it has already started.

      So far, so good. But watch carefully. Morning 2: you unplug that USB drive and plug in backup drive #2. You put drive #1 in your coat pocket. 5pm: you look over at drive #2 knowing that it'll back up. You go to the bar. Have a few. Drop the drive. "oh, I should treat these better."

      Day 3, 5pm: you put drive #3 in the hot sun-baked car before you go to the bar. Morning 4: you take drive #3 out of the frozen car.

      ...

      Day 271: "I need some data from drive #7. I'll just take it off the shelf and plug it in, here..." And it doesn't work because -- oh, right, now I remember -- drives are expensive and incredibly fragile compared to tape cartridges.

    4. Re:People still use tape? by alen · · Score: 1

      takes about a minute or two for LTO-4 tape

    5. Re:People still use tape? by guacamole · · Score: 1

      People who use tape, often have a lot more to backup that what fits on a 3TB USB drive. They probably use tape libraries connected to a storage area network, with tapes shipped to an off-site storage location.

    6. Re:People still use tape? by Anonymous Coward · · Score: 0

      Do the same with a Tape, and it is also dead.

      Since a single tape is only 50% the cost of disk. I would take the reliability of disk above tape anytime. Just treat disks as you would treat tapes.

  9. cheap? by hitmark · · Score: 1

    Sure, the tapes themselves may be cheap. But the drives are quite expensive.

    --
    comment first, facts later. http://chem.tufts.edu/AnswersInScience/RelativityofWrong.htm
    1. Re:cheap? by Anne+Thwacks · · Score: 2
      If your data is worthless, dont bother to back it up.

      As for keeping H/Ss powered down - a good percentage will never spin up again, or mysteriously lose their servo tracks or something. How long have we had SATA? How much longer will we have it?

      Tapes can be read after 30 years (I know, I have done this myself). Over 30 years, the drive technology may change a bit, so you probably need to keep your old drives, and SCSI is more than 30 years old. One drive will write a lot of tapes. Perhaps a few thousand before the heads wear out, and then its down to Ebay for a replacement because it is a previous generation (3 tapes a day for 3 years - 1,000).

      If you were the compliance officer, where would you put the transactional data from your bank? On a USB stick under the bed is NOT the right answer. If your data is worth keeping. LTO is the way to go. Three copies, on 3 different tapes, in each of three different states.

      Has anyone ever managed to READ a terabyte of paper tape? With CRC checks?

      --
      Sent from my ASR33 using ASCII
    2. Re:cheap? by AmiMoJo · · Score: 1

      As for keeping H/Ss powered down - a good percentage will never spin up again, or mysteriously lose their servo tracks or something. How long have we had SATA? How much longer will we have it?

      Tapes can be read after 30 years (I know, I have done this myself). Over 30 years, the drive technology may change a bit, so you probably need to keep your old drives, and SCSI is more than 30 years old.

      Did you know that you can attach SATA drives to SAS controllers? If you think SCSI is going to be around for the long haul, then you think SATA is as well since they are compatible in that direction.

      Older tapes might be readable after 30 years, but what about modern ones? They say they will, but we won't know for sure until about 2045. If you really care about archiving data, you need to use more than one medium.

      Archival BluRay is a pretty good format. Not as high capacity as tape but cheap and the drives will probably be around forever. A modern BluRay drive can still read the original CDs pressed back in the early 80s, so similar lifespan to SCSI. The discs themselves are fairly robust and use a common, well supported standard (including the filesystem) that you can be fairly certain will be readable in decades to come. Tape formats... Maybe. Also, readback doesn't involved any physical contact with the disc, so no wear.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    3. Re:cheap? by Kjella · · Score: 1

      If you were the compliance officer, where would you put the transactional data from your bank?

      On a WORM tape, that's the only right answer to this particular question.

      If your data is worth keeping. LTO is the way to go. Three copies, on 3 different tapes, in each of three different states.

      For ordinary backup of systems I'd consider just having enough copies on HDDs, because it tends to be fairly obvious when they fail. If the system is reasonably intelligent I should be able to plug in any drive and it'll seamlessly add it to the backup cloud downloading what it needs from other nodes, I'm not sure it's the most cost effective way but it's not really the price/TB that drives backup costs, often it's a total disaster to lose 10GB of important business documents, source code etc.

      Manually swapping tapes without a tape robot is a massive pain and prone to human failure. If you have a single tape robot in a single location, that's a huge single point of failure. And if you have a redundant array of very expensive tape robots, well you're in the 0,1% of businesses I know. You'll find many companies with <100 employees total with maybe 50 at a main office and 10-20 at a couple branch offices. You can make a good geographically redundant backup system from that, as long as we're not talking huge (but important!) amounts of data.

      --
      Live today, because you never know what tomorrow brings
    4. Re:cheap? by lgw · · Score: 1

      On a WORM tape, that's the only right answer to this particular question.

      Not true. As compliance officer, you job is not to store data such that it can be recovered later, your job is to store data such that you pass auditing requirements, and actually being able to restore the data is a negative. This is why WORM disk sells well at 100x the cost of normal drives (really) - passes all the auditing requirements, much more likely to fail mysteriously.

      But I'd seriously go with something cloud-based for this. Does Iron Mountain still have their service? Or did that get spun off to Autonomy/HP? At least at one point they had cloud-based storage that passed auditing requirements for archiving (thanks to good lobbying), with the added bonus that not only might the disks fail, the company might just end the service, saving on that pesky "restore" nonsense that can only hurt you in a lawsuit.

      --
      Socialism: a lie told by totalitarians and believed by fools.
    5. Re:cheap? by guacamole · · Score: 1

      This is like saying "sure the SATA drives are cheap, but a RAID boxes are quite expensive"

      No one buys a tape drive or library for work with just one tape.

  10. Virtualization and Instant Restore by Anonymous Coward · · Score: 0

    Most enterprises are likely using some form of virtualization and backup facilities using disk snapshots/etc (Veeam is awesome BTW). The need for near real-time restore kills tape backup for anything other than long term archival from my perspective.

    1. Re:Virtualization and Instant Restore by Anonymous Coward · · Score: 0

      Enterprise and Veeam is the same sentence. Go home.

  11. Lifespan by ArchieBunker · · Score: 2

    Properly stored tape has a lifetime of decades. See if your hard drive will spin up after sitting for one decade.

    --
    Only the State obtains its revenue by coercion. - Murray Rothbard
    1. Re:Lifespan by Anonymous Coward · · Score: 0

      I've got a couple of SCSI hard drives from the early 90's that still spin up and work just fine.

      "Properly stored" always winds up being a no-true Scotsman situation anyway. If it doesn't work, people just claim it wasn't properly stored, no matter how you stored it.

    2. Re:Lifespan by Osgeld · · Score: 1

      yea and I have one from 1992 spin up and instantly toss a bearing in the actuator arm, they are fidgety metal mechanical objects, your mileage may vary

    3. Re:Lifespan by Anonymous Coward · · Score: 0

      Except tape will actually become brittle.

      Ask any of the engineers in the tv/film/audio business who used tape for video or audio. Tapes die within a couple of years and you'd be lucky to get 90% of the data from it. Analogue recorded tape is 'readable' for longer because the recorded format is more robust.

      As a last ditch effort audio engineers have been heating up tape in an oven, to backup the audio to disk. This destroys the tape.

      My corporate experience with different tape formats for data backup has been bad. I tested restore often, but within a few months the tape driver would fail and not even notice it was writing badly to tape.

    4. Re:Lifespan by Pentium100 · · Score: 1

      As a last ditch effort audio engineers have been heating up tape in an oven, to backup the audio to disk. This destroys the tape.

      That is necessary only for some tapes. Other tapes, even older (I have one from 1951, the tape itself is paper, not acetate or polyester) work fine. The problem is that some companies used an unstable binder to glue the oxide (and the back coating) to the tape. That binder over time absorbs moisture and becomes sticky goo. It takes about 10 years for this to happen, that's why the problem was not noticed earlier. Still, after the problem was notices, the manufacturers changed the binder to another chemical that remains stable.

      Baking dries out the binder so the tape works properly for some time, then becomes sticky again.

    5. Re:Lifespan by Anonymous Coward · · Score: 0

      Had.

      Had a lifetime of decades. And even that is getting lower and lower. Tape for a long time profited from simply having enormous bit sizes, giving them stability. Even high end modern LTO is much much less reliable than they used to be. And this future upgrade will be even worse.

      You got smaller and smaller bits on thinner and thinner magnetic tape. Making the tape thinner will increase the wear due to bending, and make the situation worse when it is rolled up and you got cross-polution between the magnetic fields of different layers.

  12. flexing by Anonymous Coward · · Score: 0

    You said "flexing". Hehe. Hehehe.

  13. Capacity isn't the problem. by geekmux · · Score: 4, Interesting

    "...The new technologies won't come out in products for several years."

    Er, several years?

    For a minute there, I thought they were referring to the restore time for a full cartridge.

    Capacity isn't really the problem with tape media. It's sitting around waiting for ages if you ever have to actually execute a full restore of that much data from tape.

    Not quite sure why it remains a viable solution for that reason alone, especially in this era of the InstaTwitterVine level of instant gratification. Spinning rust in the cloud might be a bit more volatile, but it will likely always be a hell of a lot faster.

    1. Re:Capacity isn't the problem. by TheGavster · · Score: 3, Insightful

      These guys http://hardware.slashdot.org/s... probably would have preferred to be able to come back up after some number of days, rather than ever. That said, not all losses of data are total, so it might make sense to have a tape system for catastrophes and some other system for correcting a smaller mistake.

      --
      "Because Science" is one step from "Because old book". Try "Because of my experiment testing my falsifiable assertion".
    2. Re:Capacity isn't the problem. by Anonymous Coward · · Score: 0

      Not quite sure why it remains a viable solution for that reason alone, especially in this era of the InstaTwitterVine level of instant gratification. Spinning rust in the cloud might be a bit more volatile, but it will likely always be a hell of a lot faster.

      Oracle's T1000D drives can write at 250 MB/s (2 Gb/s) uncompressed.

      Mainstream SATA interfaces have been 3 Gb/s, with 6 and 16 Gb/s being ratified. But that's streaming: any kind of seeking of the heads (and we're probably talking about spinning rust for bulk storage, not SSDs), and that will nose dive.

      Here's the other thing, where you say: "Spinning rust in the cloud might be a bit more volatile, but it will likely always be a hell of a lot faster."

      And how do you get it from "the cloud" to another location? How fast is your Internet connection (and the bandwidth between your ISP and your "cloud provider")? Is it 2 Gb/s (or do you have Google Fibre at "only" 1 Gb/s)?

      A local tape infrastructure may be expensive, but if you value recovery time (and you're losing money by the day/hour in a disaster situation), then sending gigabytes or terabytes down your ISP's pipe is going to cost you money.

    3. Re:Capacity isn't the problem. by guruevi · · Score: 1

      You can also ship tape a lot easier than a hard drive. No need for shock sensors. Latency may be bad but a box of tapes can give you more bandwidth/s than even the fastest Internet connection.

      --
      Custom electronics and digital signage for your business: www.evcircuits.com
    4. Re:Capacity isn't the problem. by guacamole · · Score: 2

      Modern tape drives can be really fast, with transfer rates of above 100MB/s. The real bottleneck when restoring large amounts of data is often not the tape drive speed but the write performance of the storage array, specially if you're restoring lots of small files, or the networking, etc. Anyone who has moved things like user home directories between machines knows that. Remember than when you're backing up many machines, you don't always have the luxury of having the tape drive connected to each machine directly.

    5. Re:Capacity isn't the problem. by Anonymous Coward · · Score: 0

      Not really, the bottleneck is that unless you are doing a compete restore, partial restores where the tape heads have to go back and forth over and over to restore all those itty bitty files from different incremental backups. Finding 'files' on tape - especially long, long tape - can be very time consuming. Then assuming that you haven't been streaming those backups to multiple tape drivers (no really uses a single tape drive for the size of data these tapes are designed for) you spend a significant amount of time loading, winding, rewinding, unloading, loading etc. To get those few thousand files back from that last month's backup.

    6. Re:Capacity isn't the problem. by mjwx · · Score: 1

      Not quite sure why it remains a viable solution for that reason alone,

      You're confused because you're doing it wrong.

      Tape is for long term storage. If you're restoring a large volume of data from tape either your backup systems were badly designed or you've had a serious failure that's made your nearline backups unavailable... As in you're server room burned down in which case you've accepted it will take some time to recover data.

      --
      Calling someone a "hater" only means you can not rationally rebut their argument.
  14. Good for archive... by Anonymous Coward · · Score: 0

    Bad for everything else. It also slows down any work considerable if you suddenly need access to a file in the middle of the tape.

  15. "Long future"? by Locke2005 · · Score: 2

    How long does the tape media last until it deteriorates to the point where it becomes unreadable?

    --
    I've abandoned my search for truth; now I'm just looking for some useful delusions.
    1. Re:"Long future"? by scsirob · · Score: 1

      Properly stored, 30 years or so. Getting a system and a tapedrive from 30 years ago to read it is a different story. I still have 8mm tape drives from the early 90's and they still work. Getting them hooked up to a modern SCSI bus is a bit of a challenge though.

      --
      To Terminate, or not to Terminate, that's the question - SCSIROB
    2. Re:"Long future"? by guacamole · · Score: 1

      We're talking about back ups, not making archives. The reliability doesn't seem that relevant for backup purposes. A typical organization probably wouldn't want to keep backups older than say a year.

    3. Re:"Long future"? by Anonymous Coward · · Score: 0

      From the article

      Tape is already the least expensive storage medium per bit, easily beating spinning hard disks or solid-state drives. The trade-off is slower retrieval time—about a minute—but this makes tape perfect for archiving large amounts of infrequently used data, Lantz said. IBM thinks it’s perfect for cloud storage and is working on other advances toward that end, such as an object-storage interface. The interface could make tape systems work with cloud object storage systems such as OpenStack Swift, IBM says.

    4. Re:"Long future"? by Anonymous Coward · · Score: 0

      Except when you live in a country where you're legally forced to keep 5+ years of some kinds of data.

    5. Re:"Long future"? by dbIII · · Score: 1

      I've had some tapes from the early 1970s transcribed, and they hadn't been stored very well for at least part of that time (hot and humid conditions). I believe some preparation was involved before they went into a drive but they were all readable. I expect that if I'd had a few more there would have been a few failures showing up. I should point out that the file format on the tapes could tolerate missing bits here and there so long as they were not in the headers, so there may have been a full digit percentage of data missing.
      The cheap 4mm stuff of the 1990s on the other hand had a reputation for breaking and the drives themselves had reliability problems.

    6. Re:"Long future"? by Anonymous Coward · · Score: 0

      On my last Seagate tape drive, the (brand new) tapes were unreadable after 1 week.

      I backed up before loading a new operating system, ended up wiping the drive confident that I had everything, and lost a month's worth of work.

      Fortunately I had an older (hard drive based) backup.

      Seagate tech support was useless.

    7. Re:"Long future"? by Anonymous Coward · · Score: 0

      Financial services companies, banks, investment banks and hedge funds? 7 years usually, but some things need to last longer, sometimes quite a lot longer.

      Medical data? 20 years in some cases...

  16. tape expensive by Crass+Spektakel · · Score: 1

    Last time I looked tape was as expensive as hard disks per GB and also a lot slower too and needed a seperate and quite expensive drive.

    All in all, I do not care about tapes anymore.

    --
    "Life is short and in most cases it ends with death." Sir Sinclair
    1. Re:tape expensive by Anonymous Coward · · Score: 0

      The places where tape is interesting today is primarily in large scale environments where you have one or often multiple tape robots, each with thousands of tape slots.

    2. Re:tape expensive by Anonymous Coward · · Score: 0

      You don't care about Tapes because you don't have a large amount of Data to be stored. This isn't for Joe Facebook user, you are not the center of the Computing World.

  17. Tape media lasts as long as all other media ... by davidwr · · Score: 2

    ... as long as you need it to minus one second.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  18. High Density Punch Cards by ZipK · · Score: 2

    Why isn't anyone reporting on IBM's advances in punch card microscopy? By reducing the size of the punch hole and using modern encoding systems, they've greatly increased the amount of data that can fit on a standard Hollerith card. Those who can't wire the plugboard of an IBM 407 are going to be left behind.

    1. Re:High Density Punch Cards by AtrN · · Score: 1

      It happened a while ago, you missed it... http://www.zurich.ibm.com/news/05/millipede.html

  19. Units? by Anonymous Coward · · Score: 0

    > on a cartridge about 4 by 4 inches across and 2 centimeters thick

    10 x 10 x 2 cm

    4 x 4 x 0.8 inches /sigh

  20. Cloud storage is not happening by Anonymous Coward · · Score: 0

    Just read HP is bowing out of cloud storage for the most part. Other then supplying in house cloud servers for large customers. I think its clear consumers are reluctant to embrace cloud storage in any meaningful way. Perception of privacy issues, lost information, access limitations because not everyone in America has great internet service. These all lead to people not trusting cloud storage for mundane file storage. Even companies are re thinking the cloud and how much risk it involves vs having internal solutions. Really, when you think about it, many people do not have that much to store, and basic storage is all they need. I myself use very minimal storage in the cloud and most businesses I know of still use a local storage option. Any comments I have read about cloud storage always involves some sort of compatibility issues, files missing, or files lost, even corrupted files on occasion. Many people still do not even bother with any kind of backup. Local or otherwise. The other problem is that unless storage is free, many don't buy anything extra. This has to weigh on any company supplying storage on how they pay for the infrastructure?

    1. Re:Cloud storage is not happening by Anonymous Coward · · Score: 0

      This was really my first thought was I saw this. Can the tech bubble burst already

  21. only one reliable method by Anonymous Coward · · Score: 0

    (micro)etching on gold. unless we can find a way to lay down diamond or corundum layers and etch onto them. scientology is on to this.

  22. IRS by sycodon · · Score: 1

    Someone should send a shitload of these to the IRS.

    --
    When Fascism comes to America, it will call itself Anti-Fascism, and tell you to give up your guns.
  23. Queue the Parochial Comments by Anonymous Coward · · Score: 4, Insightful

    "I don't understand why anyone would use tape. After all I've never used it/not for years/etc."

    If you feel the urge to say words like this, just stop after the first 3 words. You don't understand. That's enough right there.

    Some people have volumes of data that you cannot fathom. Some organizations have use cases that you haven't encountered. Maybe even some organizations make decisions that' could be handled another way, and maybe that different way might be better too. But's that's speculative based upon NO information.

    The continuing demand for tape pretty well speaks for itself though.

    1. Re:Queue the Parochial Comments by Anonymous Coward · · Score: 0

      Exactly. There are some businesses that produce so much data, so fast, that you can't actually use disk to store it. It has to go (more or less) straight to tape. It is the only medium that you can change over fast enough. Several tape drives running and tapes being switched out every few minutes in a cycle.

      Picture a data collection unit (mobile) recording so much data that it will occupy hundreds of these tapes by the end of the mission. This data will be analyzed later using the odd supercomputer to crunch it.

      Try doing that with disks. How fast can you switch them out? How reliable would be your interconnects.

  24. The consumer will never be ready by Richard+Kirk · · Score: 1

    Tapes have never gone out of use for large databases. The tape storage is cheap per bit compared to other formats. We know the life of a bit on tape is finite, and we know the random access time of tape is horrible. However, suppose you are providing a reliable backup service. You will have at least three copies of every record at any time, with probably a fourth archive kept separate for legal reasons. Ideally, the three copies will be in different geographical and economic zones, so you can survive the total loss of one. You will be checking these copies against each other and re-writing the data onto fresh media at regular intervals. You know the archive is good because you have a scheme for checking it and re-writing it at regular intervals. If you compare a tape in an actively maintained archive against a hard disc you keep on a shelf and never read, then the tape archive will probably be the safer of the two.

    Tape is not really a consumer product, even if the tapes and tape readers are affordable . I doubt if many consumers have the discipline to maintain their own archives to this standard. I know of several good-sized companies that have kept tape archives that turned out to be no use when they had to be read. I long for the day when crystalline molecular memories will give us moles of stable bits in a few tens of grammes of material. But until then, tape seems to work.

    1. Re:The consumer will never be ready by dbIII · · Score: 1

      We know the life of a bit on tape is finite

      While it's stupid to not format shift tape from the 1970s a few times between then and now, and while it's stupid to store it in a cardboard box in hot and humid environment for 40 years I've still been lucky with about twenty reels of tape like that.

      I know of several good-sized companies that have kept tape archives

      The usual mode of failure seems to be people cleaning out storerooms. Hence me those tapes I mentioned above that were only made to transport data from the client to my workplace and the clients lost their originals over the years.

    2. Re:The consumer will never be ready by Neil+Boekend · · Score: 1

      Just don't take the tapes to long term storage with an elevator with motors that erase all tapes before they get to storage.

      --
      Well, I might have a way, but it only works on a semi spherical planet in a vacuum.
  25. Re:Trade off tape vs HD by DanielRavenNest · · Score: 1

    > Tape isn't dead, but it's not worth it for small quantities

    The cheapest LTO-6 drive on NewEgg is $1500, and Sony has the tapes for $18/TB. External hard drives are running about $35/TB. So you need ~90 TB for cost crossover on sheer data volume, not considering usability and reliability. So I would agree, with those kind of prices, you might want to *start* thinking about tape when you get to 100 TB, because 1 drive isn't very reliable. It might work for backup storage, since you can get by with a broken tape drive for however long your backup cycle is.

  26. The article used primary metric measurements by Flexagon · · Score: 2

    Actually, the article gave all metric primary measurements, and English in parentheses for enough of them for the metric-impaired to understand the scale.

    "...about 10 by 10 centimeters (4 by 4 inches) across and 2 centimeters thick"

    So apparently, it was the OP who took the queue from NASA.

  27. RAID is not backup by dbIII · · Score: 1

    Funny how a discussion on tape has devolved into one about types of RAID.
    The most "enterprisy" array can still be toast due to an electrical event, deliberate corruption, accidental corruption, fire or theft. That's when you want the option to restore to new hardware from tape.
    Also if you have many TB of data that you never want to lose but nobody is likely to look at this year.

    1. Re: RAID is not backup by Anonymous Coward · · Score: 0

      All of that can happen to tapes to. Do you have evidence that a RaId is less stable than a tape?

  28. current highest capacity is 8.5 TB by Anonymous Coward · · Score: 1

    The current highest capacity is 8.5 TB native in StorageTek (From Oracle) T10000D. The highest capacity from IBM is 2.5 TB. Needless to say, IBM needs some publicity with imaginary product to fight against real product. Here is one year old article on the same topic. The imaginary capacity has gone up from 185 TB to 220 TB.

  29. IBM's Tape Capacities Are Largest Available by BBCWatcher · · Score: 1

    I think you're out of date by several months. IBM TS1150 holds 10TB uncompressed per tape cartridge, not 8.5TB (or 8.0TB -- to get up to 8.5TB is a little "weird"). Sustained data rate is 360MB/s, not 252MB/s. Yes, LTO state-of-the-art is well behind both IBM TS1150 and Oracle STK T10000D.

  30. Medical imaging data needs backup by niks42 · · Score: 1

    I am the technical architect for the Diagnostic Imaging solution for a number of National Health Service Trusts in the south of England. Currently, to provide the imaging for CT, MRI, a bit of cardio and a whole lot of plain xray and ultrasound, we have an archive of about 300TB of data. Replicated, and with local caching that is about 1PB of deployed storage. I am paying heavily for a second site replication, old school kind of solution, and it really doesn't scale well. Now I am looking at adding Digital Pathology to the shared imaging solution, and I really don't think that having two data centres growing to keep an online second copy of all of that data is viable; not least due to the cost of electricity of keeping a second copy spinning.

    So, alternatives to this are:
    Keep a second copy in the 'Cloud'. No clue on what my RTO would be.
    Tape: Defined RTO, RPO, mostly passive means I don't have to worry too much about power consumption. I can keep multiple generations of data on tape if so required. My existing applications support Information Lifecycle Management and Online/Nearline/Offline storage heirarchies

    Why would I NOT want a high density tape store as part of my solution?

  31. Re:Trade off tape vs HD by tbuskey · · Score: 2

    > Tape isn't dead, but it's not worth it for small quantities

    The cheapest LTO-6 drive on NewEgg is $1500, and Sony has the tapes for $18/TB. External hard drives are running about $35/TB. So you need ~90 TB for cost crossover on sheer data volume, not considering usability and reliability.

    People who quote that hard drives are cheaper than tape always leave out the cost of electricity and reliability. If I'm going to tape, that is one of the reasons whether it's backup or archiving. I can take that tape out and store it w/o power for years and reliably read it back.

    How long can you reliably do that with a hard drive? The mfg don't design drives for that, they design for always powered up drives. If I need that, I probably need to test for it and that can change with models and firmware settings. So you might have those costs for a powered off drive. If it doesn't last as long, you have medium exchange.

    HDs are more delicate. I can reliably ship a tape cross country and read it on the other side. USB hard drives, not so much. I can put tapes in a vast array that a robot retrieves from so human hands don't damage them transferring them. I can't do that with HDs.

    I put ~ 20 GB on 4mm DATs in the 90s (1.3 GB/ea) and read them back 10 years later. Drive was ~ $1k, tapes $10 so the cost was ~ $1200. Disk was $100/GB (probably more, 4GB drives came out ~ 97) so I would've need $2000 of them. If I needed to keep them spun up how much was 10 years of electricity + the SCSI interfaces ($200 * 2?) to keep them running + the enclosure to put them in (20+ drives? ).

    Costs for the drives *today* would be much lower, but the electricity over 10 years is still there.

  32. Re:Trade off tape vs HD by guruevi · · Score: 1

    A good backup strategy involves reading the tapes back on a fairly frequent basis to make sure your tapes are still readable. Regardless of it's reliability, tapes do drop bits at a similar rate to hard drives at rest. You're very lucky that you have read 100% of the DAT tape without any issue (or maybe you didn't notice it, bit errors are hard to notice until you need that particular bit). Also, most companies really don't care about their data from 10 years ago (and if they do it's because they want it GONE in case of discovery).

    Back then, tape WAS the cheaper option. Today, hard drive storage is on par as far as investment cost. Most tape strategies involve a large(r) tape robot and multiple heads which is where the expense comes in (also energy costs). With hard drives that is less of an issue and hard drives can also be spun down. Hard drives are also better at random access which is generally what you'll need when restoring day-to-day backups. Massive failures are usually not the problem, backup restoration usually boils down to that user wanting to get a version of that Word document from a year ago but they forgot what it was called back then. Reading through a tape for that kind of stuff is SLOW to the point of being infeasible.

    Tape backup is still a good solution but it's being outgrown because hard drives are faster and for most people what it can provide is 'good enough'. Tape is great if you have so much data that you need it because of the density (a rack can hold 100's of PB worth of tape but only ~5PB worth of hard drives).

    --
    Custom electronics and digital signage for your business: www.evcircuits.com
  33. An MRI machine maybe, but maybe not by dbIII · · Score: 1

    Yep, they may also have lightning strike them from a toaster or freeze solid if I walk them past a fridge. How do you survive in the modern world with such a misconception?
    You think that above poster would have worked something out about field strength by the way the magnetic stripes in their credit cards don't get wiped by trips in an elevator. A bulk eraser exposes tapes to a couple of orders of magnitude more of a field than if the tape was resting directly upon the casing of the elevator motor, let alone inside the elevator which is only going to be near the motor at the top of the shaft.

  34. Is it enough? by Anonymous Coward · · Score: 0

    There are 10 TB hard drive right now and 10 TB SSD:s coming in 2016. It's not hard to see a race between these manufacturers resulting in large discs. With tape manufacturers dragging their feet there could be 220 TB or larger drives on the market before the tapes hit production.