Slashdot Mirror


220TB Tapes Show Tape Storage Still Has a Long Future

alphadogg writes: IBM and Fujifilm have figured out how to fit 220TB of data on a standard-size tape that fits in your hand, flexing the technology's strengths as a long-term storage medium. The prototype Fujifilm tape and accompanying drive technology from IBM labs packs 88 times as much data onto a tape as industry-standard LTO-6 systems using the same size cartridge, IBM says. LTO6 tape can hold 2.5TB, uncompressed, on a cartridge about 4 by 4 inches across and 2 centimeters thick. The new technologies won't come out in products for several years.

37 of 229 comments (clear)

  1. LHC Too by Njorthbiatr · · Score: 4, Interesting

    They use tapes to store all that data they get from smashing tiny bits together. Totally forget how much one of their tapes hold, but at the time I remember thinking it was a lot.

    1. Re:LHC Too by PPH · · Score: 5, Funny

      LHCs tape archive is stored in the closet next to the superconducting magnet.

      --
      Have gnu, will travel.
    2. Re:LHC Too by americanpossum · · Score: 3, Interesting

      From http://cerncourier.com/cws/art...

      The current candidates for the tape drives that will record LHC experimental data are the enterprise-class drives from IBM and Sun StorageTek. These are the IBM 3592 EO5, which has a native data rate of 100 MB/s; and the Sun StorageTek T10000, which has a native data rate of 120 MB/s. Both of these drives use a 500 GB capacity cartridge.

      The interesting thing is that the LHC can generate up to 6GB of data per second, which means that even a 500GB tape will only last for 83 seconds. It's good that they've got all of those robots handling these tapes.

    3. Re:LHC Too by guruevi · · Score: 2

      They have 1PB worth of disk cache in front of their tape storage... so yeah, quite a bit of PB. Tape isn't dead, but it's not worth it for small quantities (100TB) and many companies don't even have 100TB worth of centralized storage. Most companies can get away with storing stuff on the 'cloud' which is very expensive per GB/TB compared to either local or colocated disk storage or tape.

      --
      Custom electronics and digital signage for your business: www.evcircuits.com
    4. Re:LHC Too by rahvin112 · · Score: 2

      People that quote the data rate/sec ignore that the data generated is only generated for a few seconds at the most, the bulk of the data is in the first few milliseconds after the collision. It simply doesn't take long for the remains of the destroyed protons to disintegrate within the bubble chamber.

  2. Never consumer ready by BenJeremy · · Score: 3, Interesting

    Wake me when tape is reliable AND costs 10% of the $/GB of hard drive storage.

    Worthwhile for enterprise... maybe. I haven't even looked at a tape backup in decades, but I do not relish paying more for a single tape than an entire 2TB HDD... as a consumer, or even as an enthusiast. It's cheaper and possibly more reliable to do backups to BD-R at this point, or simply use redundant HDDs as backup devices.

    1. Re:Never consumer ready by LinuxIsGarbage · · Score: 4, Insightful

      Tape backups have been an enterprise only product for years. And they are backing up enterprise (server-grade) hard drives that cost substantially more than consumer SATA drives.

    2. Re:Never consumer ready by Anonymous Coward · · Score: 2, Insightful

      You can pretty much wake up now. Tape outperforms hard drives every single day but of course it depends on how much data we're talking about, the type of data and how you want to access it. For a typical enterprise backup scenario, you will not be able to replace a modern tape robot with a 2000+ tapes with hard drives. It's just not going to scale.

    3. Re:Never consumer ready by SuricouRaven · · Score: 4, Interesting

      Even enterprises are using a lot of SATA drives now. The super-fast-and-reliable niche that used to belong to enterprise drives has gone to flash. It's usually cheaper to use consumer drives and some better software to manage the inevitable failure than to use enterprise drives.

    4. Re:Never consumer ready by americanpossum · · Score: 3, Insightful

      If you don't need to store tremendous amounts of data or to keep this data in more than a dozen different places, spinning hard drives will do just fine.

      If you need to store petabytes of data in redundant locations, tape robots are your friend. ;-)

    5. Re:Never consumer ready by Dutch+Gun · · Score: 4, Insightful

      As far as I can recall, tape backup systems have never been a consumer product. At least, I don't recall tape systems ever being marketed that way.

      I think the big difference nowadays though, is that tape backup used to be the only real viable option for small business' computers and servers. Nowadays, it seems like cloud-based backups like Amazon Glacier are a much more sensible for smaller systems.

      BTW, redundant HDDs as a backup system is a really bad idea unless you:

      a) take them offline, and
      b) store them offsite.

      --
      Irony: Agile development has too much intertia to be abandoned now.
    6. Re:Never consumer ready by ShanghaiBill · · Score: 5, Interesting

      It's usually cheaper to use consumer drives and some better software to manage the inevitable failure than to use enterprise drives.

      There is NO difference in reliability between "consumer" and "enterprise" drives. The only reason to buy enterprise drives is because you have excess money that you are too stupid to keep. All the big storage companies use consumer grade drives, and several of them, including Google and Backblaze, have published data that clearly show there is no reliability or performance reason to buy "enterprise" drives. They are a scam.

    7. Re:Never consumer ready by ShanghaiBill · · Score: 2

      As far as I can recall, tape backup systems have never been a consumer product.

      You never used an audio cassette tape to backup your TRS-80?

    8. Re:Never consumer ready by CODiNE · · Score: 2

      RED drives are specifically designed for RAID enclosures to prevent early failure due to vibration and constant sleep/wake cycles. They even avoid synchronizing their vibrations with other disks in the array.

      Sure in some situations you can get by with regular consumer gear, but in other situations it's asking for trouble.

      --
      Cwm, fjord-bank glyphs vext quiz
    9. Re:Never consumer ready by Anonymous Coward · · Score: 2, Interesting

      having worked for a storage vendor for many years, i have data that says you're wrong.

      in the early days, we allowed customers to buy their own drives. many of them got
      consumer drives and suffered for it. one customer bought 16 consumer grade drives
      from either wd or segate (i forget), and every one failed within two years.
      in my own personal array, i caught samsung 750gb drives lying to me about having
      written data after a power outage. (reading returned all 0s after having flushed the
      cache.)

      as we got more sophisticated, we found there were two reasons we found for this. enterprise
      hard drives are built differently, and they run different software with different settings.
      because of the better hardware, the mtbf is quite a bit better, and because of the better
      software, a failure is more likely to be obvious. there's nothing better at trashing data
      than a silently failed drive.

      i'm not saying there are smoke and mirrors features. sas seems worthless to me,
      except it is often tied to better hardware....

    10. Re:Never consumer ready by ShanghaiBill · · Score: 5, Insightful

      RED drives are specifically designed for RAID enclosures to prevent early failure due to vibration and constant sleep/wake cycles.

      Baloney. If this were true, it would show up in reliability data. It does not.

      Sure in some situations you can get by with regular consumer gear, but in other situations it's asking for trouble.

      Thanks for the advice. But I prefer to listen to people that know what they are talking about, and have data to back it up.

      Btw, I have some super premium gold plated SATA cables that will DOUBLE the reliability of your enterprise drives!!! Please post your credit card number and address.

    11. Re:Never consumer ready by Dutch+Gun · · Score: 2

      It IS slow, intentionally so, at least for retrieval of your data. That's fine for a backup system - and Glacier is specifically marketed for this. You want reliability and economy for backups, not speed. They've reduced the cost of the storage by sacrificing retrieval speed. "Glacier" is also evocative of "cold storage"

      --
      Irony: Agile development has too much intertia to be abandoned now.
    12. Re:Never consumer ready by Guspaz · · Score: 2

      If one of your consumer drives fail, you've got a new one in seconds without any physical activity, because the massive cost savings allows you to keep lots of spare drives on-site as hot or cold spares. Any company that has zero spare drives and must wait for an RMA to get their RAID array back in operation is doing it wrong.

    13. Re:Never consumer ready by Guspaz · · Score: 2

      Because it's marketed as being very slow, with response times measured in hours? It's a very cheap offline storage solution that uses BD-R discs and robots.

    14. Re:Never consumer ready by jedidiah · · Score: 2

      It doesn't matter. If you are waiting for a storage vendor to send you replacement gear then you're irresponsible and putting your company at unecessary risk. Even a good SLA that's actually successfully executed is still too much exposure.

      --
      A Pirate and a Puritan look the same on a balance sheet.
    15. Re:Never consumer ready by philipcummins · · Score: 2
      Having a look LTO-6 tapes are now about $40 US per cartridge vs about $80 for a 2 TB hard drive. However, with tape you get the advantages that should be considered along with the disadvantages. LTO tapes are rated for at least 20 years in a stable shelf environment - if you're buying cheap hard drives you generally don't want to trust them as archival media particularly when you're only able to get max 5 year warranty on them. LTO tapes generally are very reliable when being shipped around regularly (i.e. for offsite archiving) compared to hard drives. You can also get relatively cheap autoloaders that can queue up 8+ tapes at at time for long backup & archive jobs that you can cycle tapes in/out of without interrupting things compared to a RAID system. They also clock 160 MiB/sec write speeds which is fairly acceptable with the use of an autoloader and D2D2T backup. They are also easier to make write-only, and the ability to mess up a tape is much harder from a file system corruption point of view unless you use LTFS.

      The downsides are that LTO drives are expensive compared to buying bare drives (or USB drives). Once you step up to a disk based RAID array it gets comparable however. You also obviously don't get random access to your data when you want it like a nice RAID unit. They also almost exclusively use SAS or FC connections which most people don't have (a few have USB 3.0 or Thunderbolt now, like mLogic or IBM) which means you can't fit to a basic computer easily without some work.

      I personally use tape for my archival backup now having invested in a system to do it (and I'm what I consider a consumer). RAID systems are nice but they don't cover mistakes, file system corruption or hardware failures which could happen and wipe out terabytes of data. With offline tape I can simply restore it if/when I require it.

      The issue is that when you buy storage you should consider the backup requirements at the same time. I see a lot of people getting RAIDs or Drobos considering the hardware failure angle but not the malicious/filesystem corruption angle (i.e. someone using sudo rm -rf /*) and unless they have them online a lot you never know when your backup drive has failed as well (or failed when you really need it). For small business I'd say RDX cartridges get the equivalent lifespan of tape however in a more convenient format ($150 for a chassis + cartridge costs) so this would be a viable solution for small businesses for archiving legally required data for 7+ years.

  3. WORN by Anonymous Coward · · Score: 5, Funny

    Write Once Read Never

  4. Re:more interesting question by Paradise+Pete · · Score: 3, Interesting

    What is the write speed of this technology ?

    Back in the early 80's I had a job working at night watching the network of the then-new ATMs, and restarting them when they crashed (often). It was a time-sharing place with big mainframes and giant spools of tape. The write speed on those was horrible, partly because first you had to wake up the invariably dozing tape hanger, who would then stumble over, find the proper tape, and put it on the spool.

  5. Lifespan by ArchieBunker · · Score: 2

    Properly stored tape has a lifetime of decades. See if your hard drive will spin up after sitting for one decade.

    --
    Only the State obtains its revenue by coercion. - Murray Rothbard
  6. Capacity isn't the problem. by geekmux · · Score: 4, Interesting

    "...The new technologies won't come out in products for several years."

    Er, several years?

    For a minute there, I thought they were referring to the restore time for a full cartridge.

    Capacity isn't really the problem with tape media. It's sitting around waiting for ages if you ever have to actually execute a full restore of that much data from tape.

    Not quite sure why it remains a viable solution for that reason alone, especially in this era of the InstaTwitterVine level of instant gratification. Spinning rust in the cloud might be a bit more volatile, but it will likely always be a hell of a lot faster.

    1. Re:Capacity isn't the problem. by TheGavster · · Score: 3, Insightful

      These guys http://hardware.slashdot.org/s... probably would have preferred to be able to come back up after some number of days, rather than ever. That said, not all losses of data are total, so it might make sense to have a tape system for catastrophes and some other system for correcting a smaller mistake.

      --
      "Because Science" is one step from "Because old book". Try "Because of my experiment testing my falsifiable assertion".
    2. Re:Capacity isn't the problem. by guacamole · · Score: 2

      Modern tape drives can be really fast, with transfer rates of above 100MB/s. The real bottleneck when restoring large amounts of data is often not the tape drive speed but the write performance of the storage array, specially if you're restoring lots of small files, or the networking, etc. Anyone who has moved things like user home directories between machines knows that. Remember than when you're backing up many machines, you don't always have the luxury of having the tape drive connected to each machine directly.

  7. Re:Imperial measurements by ShanghaiBill · · Score: 2

    And much like tape, it seems like the random mixing of imperial and metric measurements won't ever go away, either :)

    When I was in the military, we always measured distance along the ground in kilometers (or "clicks" in mil-lingo), but altitude was always in feet (or "angels" = 1000 feet). So at least we were metric for 2/3rds of the dimensions. With this tape, only one dimension is metric, so we are going backwards.

  8. Re:cheap? by Anne+Thwacks · · Score: 2
    If your data is worthless, dont bother to back it up.

    As for keeping H/Ss powered down - a good percentage will never spin up again, or mysteriously lose their servo tracks or something. How long have we had SATA? How much longer will we have it?

    Tapes can be read after 30 years (I know, I have done this myself). Over 30 years, the drive technology may change a bit, so you probably need to keep your old drives, and SCSI is more than 30 years old. One drive will write a lot of tapes. Perhaps a few thousand before the heads wear out, and then its down to Ebay for a replacement because it is a previous generation (3 tapes a day for 3 years - 1,000).

    If you were the compliance officer, where would you put the transactional data from your bank? On a USB stick under the bed is NOT the right answer. If your data is worth keeping. LTO is the way to go. Three copies, on 3 different tapes, in each of three different states.

    Has anyone ever managed to READ a terabyte of paper tape? With CRC checks?

    --
    Sent from my ASR33 using ASCII
  9. "Long future"? by Locke2005 · · Score: 2

    How long does the tape media last until it deteriorates to the point where it becomes unreadable?

    --
    I've abandoned my search for truth; now I'm just looking for some useful delusions.
  10. Tape media lasts as long as all other media ... by davidwr · · Score: 2

    ... as long as you need it to minus one second.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  11. High Density Punch Cards by ZipK · · Score: 2

    Why isn't anyone reporting on IBM's advances in punch card microscopy? By reducing the size of the punch hole and using modern encoding systems, they've greatly increased the amount of data that can fit on a standard Hollerith card. Those who can't wire the plugboard of an IBM 407 are going to be left behind.

  12. Re: Imperial measurements by corychristison · · Score: 2

    Here in Saskatchewan, Canada, we measure distance in time.

    For example:
    Person 1: "How far is Calgary from Regina?"
    Person 2: "Oh about 7 hours."

    I'm not sure why we do this, but this is the honest truth. My wife used to work at a service station, and had people ask how far X was. They would look at her like she was an alien if they weren't from around here.

  13. Queue the Parochial Comments by Anonymous Coward · · Score: 4, Insightful

    "I don't understand why anyone would use tape. After all I've never used it/not for years/etc."

    If you feel the urge to say words like this, just stop after the first 3 words. You don't understand. That's enough right there.

    Some people have volumes of data that you cannot fathom. Some organizations have use cases that you haven't encountered. Maybe even some organizations make decisions that' could be handled another way, and maybe that different way might be better too. But's that's speculative based upon NO information.

    The continuing demand for tape pretty well speaks for itself though.

  14. The article used primary metric measurements by Flexagon · · Score: 2

    Actually, the article gave all metric primary measurements, and English in parentheses for enough of them for the metric-impaired to understand the scale.

    "...about 10 by 10 centimeters (4 by 4 inches) across and 2 centimeters thick"

    So apparently, it was the OP who took the queue from NASA.

  15. Re:more interesting question by Anonymous Coward · · Score: 2, Informative

    Existing tape technology (LTO 6 and newer) is no slouch. I can saturate an 8 GB FC link with an eight drive silo and Solaris or AIX driving it (with TSM or Networker as a backup infrastructure.)

  16. Re:Trade off tape vs HD by tbuskey · · Score: 2

    > Tape isn't dead, but it's not worth it for small quantities

    The cheapest LTO-6 drive on NewEgg is $1500, and Sony has the tapes for $18/TB. External hard drives are running about $35/TB. So you need ~90 TB for cost crossover on sheer data volume, not considering usability and reliability.

    People who quote that hard drives are cheaper than tape always leave out the cost of electricity and reliability. If I'm going to tape, that is one of the reasons whether it's backup or archiving. I can take that tape out and store it w/o power for years and reliably read it back.

    How long can you reliably do that with a hard drive? The mfg don't design drives for that, they design for always powered up drives. If I need that, I probably need to test for it and that can change with models and firmware settings. So you might have those costs for a powered off drive. If it doesn't last as long, you have medium exchange.

    HDs are more delicate. I can reliably ship a tape cross country and read it on the other side. USB hard drives, not so much. I can put tapes in a vast array that a robot retrieves from so human hands don't damage them transferring them. I can't do that with HDs.

    I put ~ 20 GB on 4mm DATs in the 90s (1.3 GB/ea) and read them back 10 years later. Drive was ~ $1k, tapes $10 so the cost was ~ $1200. Disk was $100/GB (probably more, 4GB drives came out ~ 97) so I would've need $2000 of them. If I needed to keep them spun up how much was 10 years of electricity + the SCSI interfaces ($200 * 2?) to keep them running + the enclosure to put them in (20+ drives? ).

    Costs for the drives *today* would be much lower, but the electricity over 10 years is still there.