Slashdot Mirror


Is LTO Tape On Its Way Out?

storagedude writes: With LTO media sales down by 50% in the last six years, is the end near for tape? With such a large installed base, it may not be imminent, but the time is coming when vendors will find it increasingly difficult to justify continued investment in tape technology, writes Henry Newman at Enterprise Storage Forum.

"If multiple vendors invest in a technology, it has a good chance of winning over the long haul," writes Newman, a long-time proponent of tape technology. "If multiple vendors have a technology they're not investing in, it will eventually lose over time. Of course, over time market requirements can change. It is these interactions that I fear that are playing out in the tape market."

284 comments

  1. LTO Tape by smittyoneeach · · Score: 1

    LTO tape
    Is kinder than duct
    When applied to the face
    With the latter, you're Canucked.
    Burma Shave

    --
    Get thee glass eyes, and, like a scurvy politician, seem to see things thou dost not.--King Lear
    1. Re: LTO Tape by Anonymous Coward · · Score: 1

      LOTR tape is out.

    2. Re: LTO Tape by Anonymous Coward · · Score: 0

      You try to throw it into the volcano, and it just sticks to your hand. Stupid tape.

    3. Re: LTO Tape by Anonymous Coward · · Score: 0

      At least its creative spam

    4. Re: LTO Tape by Anonymous Coward · · Score: 0

      But not quite procreative.

    5. Re: LTO Tape by Anonymous Coward · · Score: 0

      Slashdot Beta is yesterday's news--everybody knows that Slashdot Deals is the "hot & now" place to buy--er, FIND sex partners.

  2. Shyeah, right. by jra · · Score: 4, Informative

    Magtape is the only viable medium for things which are actually "backups" as that term is understood in the professional IT arena. Every other possible medium for backups has faults which cripple it for one or more of the requirements which backups are required to fulfill -- primarily that's length of storage, but there are lot of other fun failure modes.

    Sure, spinning magnetic storage, optical media, and flash drives each have some advantages for specific purposes.

    But go pull the post-close EOY General Journal from 1996 off of one, I dare you.

    And if you think that's an overly strict requirement, a) you're probably wrong, and b) I can come up with lots more that you won't.

    My commercial backup guidelines are these:

    You need it backed up on at least 4 pieces of media, of at least 3 different types, in at least 2 different cities, in at least 1 different state; bumping each of those numbers up by 1 is not unreasonable.

    Only one backup can be on optical media; only one can be on spinning magnetic media, whether it's powered or not (this includes the cloud, and local external HDD backups, whether powered 24/7, alternating, or pulled and shelved).

    Flash media is right out, as are SSDs.

    I can pull 20 year old DC3000 tapes off my shelf and read them -- as long as I have a SCSI interface for the computer in question.

    GNU tar is great that way.

    1. Re:Shyeah, right. by Anonymous Coward · · Score: 1

      > at least 1 different state.

      Texas -AND- Texas. Yeeeeeehaaaaw.

      Disclaimer: I'm a 5th generation texan, so I'm allowed to make fun of my state. :P (It's like the N-word rule.)

    2. Re:Shyeah, right. by Lumpy · · Score: 3, Informative

      I still have SDLT tapes that are still readable after 15 years. Hell I have Bernoulli disks that are still readable. The one working like new drive was packed with it along with an assortment of SCSI cables and a current working SCSI to USB adapter and a linux driver on a CD. hopefully if anyone needs to read that data in the future they will figure it out.

      I actually did the same thing 3 years ago for a friend. he arrived with a stack of 9 track tapes and a desktop tape drive. Luckily I was able to find an older PC with an ISA slot and installed the card linux had drivers for it and even had the tools to convert the data to standard ASCII. Read all 20 tapes and handed him a DVD disk with the contents of all the tapes. Made a cool $2000 for sitting and watching tape spin. it was cool.

      --
      Do not look at laser with remaining good eye.
    3. Re:Shyeah, right. by PopeRatzo · · Score: 2

      in at least 1 different state

      Are you expecting an entire state to disappear? I mean, I've heard jokes about California falling into the ocean, but a requirement of having backups in two different states seems kind of extreme.

      But I guess it could happen. That's why I always insist on keeping at least one backup in low Earth orbit and another on one of the moons of Jupiter. This way, if Galactus shows up and eats the Earth, I'll still be able to pull my post-close EOY General Journal from 1996. Or at least I will be if SpaceX can ever figure out this manned space flight thing.

      --
      You are welcome on my lawn.
    4. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      It sounds like you're mixing backups and archiving. And magnetic tape has a lifetime too, especially if stored incorrectly.

      From Wikipedia:
      "Magnetic Media also deteriorates naturally with typical shelf-lives between 10 and 20 years."

      So I dare you to go pull that 20 year old tape off the shelf and read it. Chances are it will work, but I wouldn't be surprised if it failed.

      There is no (cost effective) holy grail in backups. Critical backups require maintenance, no matter the media.

    5. Re:Shyeah, right. by PopeRatzo · · Score: 5, Funny

      Hell I have Bernoulli disks that are still readable.

      Nothing beats clay tablets.

      The Babylonians can still pull up their post-close EOY General Journal from 2759 BC if they need it.

      --
      You are welcome on my lawn.
    6. Re:Shyeah, right. by sconeu · · Score: 5, Funny

      How did they know to put "BC" on the EOY General Journal?

      --
      General Relativity: Space-time tells matter where to go; Matter tells space-time what shape to be.
    7. Re:Shyeah, right. by brokenin2 · · Score: 5, Insightful

      I disagree.

      We used to use LTO, and it was OK for a while, but we switched to using removable hard drives and rsync a long time ago and haven't regretted it one bit.

      We're every bit as paranoid as the next guy (there *might* be some more paranoid, but not many).

      We've pulled 10 year old hard drives off the shelf before and recovered things no problem. Our rotation won't ever require us to actually do that, but we have tested it a number of times and things worked great.

      What we do though, is periodically update our archived copies to newer media when we update our removable drives.. Often times, this allows us to merge old archive media onto fewer drives saving us a lot of space in the long run. We do have multiple copies, including 3 sets that are permanently online in different locations, and a number of offline sets.. As our backups age, we reduce the number of copies we keep offline, but never go below 3 offline copies of any given data.

      The real reason that this is fantastic though, isn't that it backs up so much faster (it does, because after a drive has rsync'd once, there usually aren't many changed files compared to the bulk of the rest of the data). The real reason that this is fantastic isn't because we save space and reduce our need to have old hardware with SCSI interfaces etc (it does though). The real reason this is fantastic isn't because when you take older/smaller drives out of the loop, you can actually repurpose them (you can though.. what are you going to do with a bunch of left-over too small LTO tapes).

      The real reason that this is fantastic, is that in the event of a catastrophe, you can get things up and running very quickly. If you're really in a panic, you can boot off of the drive that is that backup disk because we add an OS to them when we prep the drives. You just need any old POS PC with SATA on it and a copy of the file used for decryption, and you can be up and running in minutes. Even for the lighter weight emergencies random access to your data is still quite priceless. You can go directly to the file you need, or even multiple versions of it, instead of waiting for tape media to scan.

      In short, yes. LTO is dead whether it knows it yet or not.

    8. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      It's 2014, you can just run your backups to low cost cloud storage that is replicated across the world. If you used 2 different cloud backup solutions and also kept a local copy in a safe, that is probably overkill.

      More likely, you can just use 1 cloud storage company + local and get data loss (cloud) insurance.

    9. Re: Shyeah, right. by Anonymous Coward · · Score: 1

      Riots in LA make getting to your backup difficult.

      The governor has declared a state of emergency and ordered cars off the roads.

      There are two types of people, but only one will be standing on the desired side of the fan when the shit starts to fly.

    10. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Your plan might work for a couple of TB of static data. It does not scale well and does not work if you want more than maybe one backup a month.

      I don't think tape is close to dead. The use cases are going down with cloud and cheaper disk based systems but it can still make economic sense for many companies.

         

    11. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Bah, your magnetic tape has what, 30-100 years under ideal storage conditions before it starts to fail? No, only phase-change magneto-optical storage on glass platters can go for 100+ years stored next to my neodymium magnet collection.

    12. Re:Shyeah, right. by afabbro · · Score: 1

      in at least 1 different state

      Are you expecting an entire state to disappear? I mean, I've heard jokes about California falling into the ocean, but a requirement of having backups in two different states seems kind of extreme.

      Particularly because "two different states" could mean "Rhode Island and Delaware" which is very different than "Alaska and Florida."

      --
      Advice: on VPS providers
    13. Re: Shyeah, right. by rickb928 · · Score: 2

      The poster auto-converted the date for them. A favor.

      --
      deleting the extra space after periods so i can stay relevant, yeah.
    14. Re:Shyeah, right. by techno-vampire · · Score: 1

      The idea is that your backups should be far enough apart that they won't be caught in the same natural disaster. As an example, I live in Southern California, just north of Los Angeles. If I had data that I really needed to protect, I'd have two off-site backups. One would be far enough away from home that a flood, tsunami (My home is about 170 feet above sea level and within a few miles of the coast.) or wildfire wouldn't get both of them. The other one would be far enough away that I'd not have to worry about it after the next big quake, possibly in the mid-west. Simple common prudence, no need for paranoia.

      --
      Good, inexpensive web hosting
    15. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Optical media can last a very long time, a hundred years or more if you're using quality media and store it properly.

    16. Re:Shyeah, right. by craighansen · · Score: 1

      That's the original Y2K problem.

    17. Re:Shyeah, right. by fuzzyfuzzyfungus · · Score: 1

      I have to imagine that some sort of materials engineering geekery involving carbon allotropes and platinum group metals could be even more durable, while also having better data density and looking like they were pulled right out of some sci-fi memory core; but it's pretty hard to argue with a storage medium you can make from mud that gets more durable when the assholes one ziggurat over decide to burn your civilization down...

    18. Re:Shyeah, right. by Kjella · · Score: 1

      But go pull the post-close EOY General Journal from 1996 off of one, I dare you.

      I've got school stuff older than that, copied from one generation of drives to the next since the 1980s without ever needing a tape drive. Most data is lost because there's not enough redundancy and integrity checking, a private backup cloud makes total sense to me just add another node and it'll sync up another perfect copy. Doesn't matter what the underlying hardware is, as long as there's enough of them and it gets replaced in a timely fashion. Assuming that takes care of physical and geographical redundancy, you're left with misconfiguration, internal or external malice.

      True, it's possible to make deleting disk backups easy. It's also possible to make it almost as hard as deleting tape backups by using a third party, sign off procedures and such. The only time you gain a significant advantage with tape is if you got a human in the process as an air gap defense, if you got a tape robot - which is what you want for a large, automated system - then theoretically whoever could hack your disk backup server could just as easily hack your tape robot server and instruct it to wipe all the tapes. Unless you use WORM media, but I don't think many do unless they absolutely must for legal compliance since you can't recycle tapes.

      Even if something is irreplaceable it doesn't mean it's of infinite worth. A one-way file transfer gateway to a backup server in a mountain bunker might be enough, even if it's stored on a R/W disk. At least it starts competing with other far out possibilities like the hacker /sysadmin disabling or encrypting your backups until one day you wake up to "Your data is locked, pay me $$$ or go fish" or worse "Thanks for laying me off here's the letters F and U" only to discover the backups are useless. And I don't mean just an occasional restore test, if you're that paranoid you should also verify that what's on your WORM drives is what you so desperately need bullet proof backup of.

      Ultimately the more exotic a technology gets, the less find it worth it which can lead to a negative loop where the lesser technology wins out anyway. I don't think tape will die but it can become more specialized, like companies don't having their own tape drives they just send encrypted backups to companies specializing in disaster recovery for when everything else has been nuked and just run the risk that the day-to-day operations are well enough secured by disk backup. Losing a day's worth of work is expensive, but also not fatal to most businesses.

      --
      Live today, because you never know what tomorrow brings
    19. Re:Shyeah, right. by rtb61 · · Score: 2

      Hate to burst your bubble but magnetic bits on plastic are magnetic bits on plastic whether tape, disc or flash drives. Don't become confused with old tapes being reliable, they are reliable temporarily because they were a low density storage format and over years as the storage density increase, just like hard disk drives they tended to become less reliable. Flash media is happy sitting in the dark for a very long time, it wears out with multiple writes not multiple reads or very rare reads. The advantage of course with say flash media is that via a mass storage adaptor, your storage system could provide you instant read only access to all your stored archives at what would be now a reasonable price. You can actually build a storage array of thousands of flash drives, which of course is what a SSD drive technically is. So the balance is the cost of archive storage media, the cost of storing that media, the cost of the storage facility and the cost of accessing that data. Companies will find spending much more on storage media will achieve major savings in all other areas. Inevitably flash type storage will win out, it is only a matter of continuing development time, simplicity of writing data to them and later accessing it from them gives that medium a huge advantage.

      --
      Chaos - everything, everywhere, everywhen
    20. Re:Shyeah, right. by fuzzyfuzzyfungus · · Score: 2

      The orbital mechanics can get a bit tricky; but interplanetary distances open the possibility of reviving good, old-fashioned, delay-line memory...

      Just think of how much data you could keep in-flight if you just replaced Pluto with a nice orbital mirror and told your vendor "GIVE ME AN XFP MODULE OF TERRIBLE POWER."

      For real archiving, of course, you'll need to look at siting your mirror outside the solar system for a longer round trip.

    21. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      The clay tablet medium has survived well, but I bet there is still a huge readability problem with them.

    22. Re:Shyeah, right. by Amouth · · Score: 1

      Yea kinda sucks when your language dies....

      But the medium lives on :)

      --
      '...if only "Jumping to a Conclusion" was an event in the Olympics.'
    23. Re:Shyeah, right. by Anne+Thwacks · · Score: 1
      Chances are it will work, but I wouldn't be surprised if it failed.

      That is why we keep three copies of the data on each of the three tapes. I too have read tapes over 30 years old. I have not read floppies and CDs that were less than 3 yearsl old, and no longer own an ST506 interface or even a pre-PCI motherboard (well perhaps I do. but I cant find it).

      I am backing LTO.

      --
      Sent from my ASR33 using ASCII
    24. Re:Shyeah, right. by dgatwood · · Score: 5, Insightful

      I used to use tape for backup. The reason I stopped was that it stopped being cost effective. There was a time when you could buy one-generation-before-current tape drives, back your entire hard drive up more than once on a tape, and if you bought more than a dozen tapes, you spent less money overall than buying hard drives for those backups.

      For about the last decade, tape has lagged so far behind hard drives that this hasn't been the case. You couldn't back up a high-capacity hard drive on last-generation tape. In fact, the current-generation LTO-6 only holds 2.5 TB uncompressed, so in the worst case, you can back up any hard drive built before 2010 (when the first 3 TB hard drives came out). And that tape technology didn't come out until 2012.

      And you'll spend almost $3k on the drive, plus $45 per tape, or $18 per terabyte. Hard drives are currently running at $30 per TB. So ignoring differences in risk between a hard drive on a shelf and a tape, the break-even point is at a whopping 250 TB—almost an order of magnitude more than is reasonable for most businesses, much less consumers. Unless you're doing data warehousing, this break-even point is simply too high to be practical. Yet this is the smallest tape drive that is practical for any serious use, because one-generation-old drives (LTO-5) take 2–3 tapes just to back up an average desktop hard drive once, and the break-even point at $33 for 1.5 TB is still over 200 TB. That's just nuts. If you're willing to use ten tapes per drive, you could use LTO-3, but at $30 per terabyte plus the cost of the drive, you never break even at all.

      To make a long story short, tape died the moment they stopped building tape drives targeted at normal consumers. As with all specialized products that are too expensive for normal people to afford, over time, cheaper, more consumer-friendly technologies begin to take advantage of their dramatically higher sales volume to drive R&D that allows them to eventually become "good enough" to be used in place of those niche "professional" products for their least demanding customers, thus causing the market to get smaller and smaller. As demand drops, prices then increase, causing even more potential customers to start looking for alternatives, until eventually the death spiral reaches its ultimate and inevitable end: a market that has dried up completely. This same scenario has played out in industry after industry over the years, and anybody who didn't see the writing on the wall more than a decade back must not have been paying attention.

      Want me to stop saying tape is dead? Prove me wrong. Ship a consumer-grade LTO-6 drive for $300. Make tape a feasible backup medium for consumers and small businesses. Short of such a drastic step, tape is pretty much doomed to fade into obsolescence. At this point, I'm firmly convinced that the only real question anyone should be asking is how best to handle backups and archiving in a post-tape world; without a giant cash infusion and a radical change in the leadership of companies that build these products, it's not a matter of whether, but rather a matter of when.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    25. Re:Shyeah, right. by Cramer · · Score: 1

      Actually, there's an enormous difference. Disc is designed for high capacity, and thus has insanely high bit densities. They rely on significant technology to work at all. With the bits so small and packed so close together, modern hard disks tend to self-destruct if not constantly maintained. (read: powered on and left to run recalibrations) Tape is designed for long term storage, so bigger bits, less densely packed. Tape will maintain the pattern written to it for a very long time.

      If your tape drive doesn't work, it can be replaced (usually -- older tech can be a problem), and the tape(s) read perfectly from it. When your hard drive fails -- bearings, circuits, or (99.999999% of the time) the firmware the cheap bastards stored on the media becomes unreadable -- You. Are. Screwed. (options: 1) throw it away, 2) pay a data recovery company $$$$ to get your data back.)

      Flash drives aren't magnetic storage.

      Enterprises use disc backups for two simple reasons: cost and speed. In most cases, the data backed up will be obsolete in a few weeks or months. Anything that has to outlast the quarter finds it's way to more stable storage -- tape, cd/dvd/bluray (unwise, but still used), flash drives, and/or SSDs.

    26. Re:Shyeah, right. by Oligonicella · · Score: 1

      Example: the metropolis area of Kansas City is larger than the state of Delaware, over twice the size of Rhode Island and about half the size of Connecticut and New Jersey. So yes, it's a good idea.

    27. Re:Shyeah, right. by PopeRatzo · · Score: 2

      The idea is that your backups should be far enough apart that they won't be caught in the same natural disaster.

      Oh, OK. That makes sense. Like if you were in the Northeast when Hurricane Sandy hit. You'd probably want it like several states away to be safe. Maybe one in New Jersey and one in Chicago, where the only natural disasters are the Cubs and Bears.

      --
      You are welcome on my lawn.
    28. Re:Shyeah, right. by PaddyM · · Score: 3, Funny

      the reels on the tapes go
      click clack clink
      click clack clank
      click clack clunk
      the reels on the tape go
      snip snap break
      all through the head

      The real backups go
      to the cloud
      to the cloud
      to the cloud
      The real backups go
      to the cloud
      all through the tubes ... or in iTunes

      Right? Barbara Streisand... do do do do do do

    29. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Want me to stop saying tape is dead? Prove me wrong. Ship a consumer-grade LTO-6 drive for $300. Make tape a feasible backup medium for consumers and small businesses.

      It won't happen, for the same reason SAS (just like SCSI) won't ever reach reasonable prices: because the word "enterprise" means "charge a fuckload of money for something that doesn't justify the cost". There is still zero reason for LTO, AIT, and even just standard SAS MHDDs to cost such high premiums. It's plain and simple: companies charge what they do because businesses (you know, the ones who have zero problem paying US$12K for a server that costs US$3K to build) will pay for it.

      As for all your other prior points: I'm in full agreement. My Sony SDX-500C drive, all its tapes, and the associated Adaptec U160 controller for it all sit on my shelf collecting dust.

    30. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      It's 2014, you can just run your backups to low cost cloud storage that is replicated across the world.

      And when an array dies and you need to load all 5 TB of data from backup, let us know what your boss says when you tell him it'll take a week to restore, assuming a 100Mbit internet connection.

    31. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      VERY Serious question: Are you using rsync -c, or are you relying on size and timestamps?

    32. Re:Shyeah, right. by ls671 · · Score: 1

      Well, we have backups in Canada, Australia and England so we do not qualify with regards to the requirements because we do not have backups in any state.

      --
      Everything I write is lies, read between the lines.
    33. Re:Shyeah, right. by theshowmecanuck · · Score: 1

      Depends on your definition of state.

      --
      -- I ignore anonymous replies to my comments and postings.
    34. Re:Shyeah, right. by nitehawk214 · · Score: 1

      Countries are states.

      --
      I'm a good cook. I'm a fantastic eater. - Steven Brust
    35. Re:Shyeah, right. by Anonymous Coward · · Score: 4, Funny

      Texas is definitely a different state.

    36. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      It's a lot like owning 7-track tapes, 8-track tapes, Zip-drives, or 13" floppies.

    37. Re:Shyeah, right. by Dutch+Gun · · Score: 1
      --
      Irony: Agile development has too much intertia to be abandoned now.
    38. Re:Shyeah, right. by dna_(c)(tm)(r) · · Score: 1

      How did they know to put "BC" on the EOY General Journal?

      Well after several thousands of years counting backwards, everybody knew it stood for "Backwards Counting" - it looked like a great idea in 5000 BC

    39. Re:Shyeah, right. by dbraden · · Score: 1

      You're absolutely right. Just a few weeks ago I decided to look into backing up my home storage to tape. The tapes themselves weren't terribly expensive, but the drives... couldn't believe what they cost. And it didn't look like eBay had any deals on them either (or, at least, not at prices I'm willing to pay).

      I think $200-$250 would be a better price point, but I would certainly go for one at $300, even if it was an LTO-5 drive.

    40. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      And the bean-counters find out how much it will cost to pull all that data?

      Just how badly do you want all your data?...

      Worse, 5TB is trivially small by many sites' standards. I've seen several clients
      who required > 6 weeks to move all their data from one file system to another.

    41. Re:Shyeah, right. by Sqr(twg) · · Score: 1

      You might want to look at using ZFS instead of rsync. I switched a while back, and it was definitely worth the initial effort of changing the file system on the server.

      With rsync you can get inconsistencies because not all files are backed up at the same instant. ZFS snapshots get around this.

      If you modify a large file (say a 100 GB virtual machine), rsync will re-backup the entire file. ZFS will keep track of the part that changed and only copy that.

      Also if a file on one of your multiple backups is subtly corrupt, you might not notice. Or even if you do compare the copies, you might not know which one is correct. With ZFS, the entire file system is checksummed and a raid or mirror can heal itself.

    42. Re:Shyeah, right. by hankwang · · Score: 1

      "You need it backed up on at least 4 pieces of media, of at least 3 different types, in at least 2 different cities, in at least 1 different state; bumping each of those numbers up by 1 is not unreasonable."

      At least 2 different cities means two or more cities.
      At least 1 different state means one or more states.

      Well, at least, you don't store it in zero states.

    43. Re:Shyeah, right. by Anne+Thwacks · · Score: 1

      So GCHQ, the NSA, and a few random third world hackers have replicated your data. That does not mean you can get it when you need it (at a reasonable price). I have no doubt you can get insurance, but that is not the same as actually having the data.

      --
      Sent from my ASR33 using ASCII
    44. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      I've read DAT media that was 20 years old, although it's only rated for a shelf life of 10 years.
      DLT 9-track is generally good for 30 years, and generally pretty stable. LTO is also good for 30 years, but can be susceptible to magnetic exposure. Theoretically solar flares can create errors on LTO.

      I'm mostly using DAT/DAT72 for my archive needs. But I'm seriously considering switching to archival DVDs (M-Disc), and have already started making a "backup" of my DATs onto DVD.

    45. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      I bought a bunch used DAT72 and DAT160 drives. I found some IDE and SATA ones even at reasonable prices. 70GB may not sound like much to you, but it represents a lot of source code and a fair number of photographs. And it probably a billion times more than I need to back up my short stories.

    46. Re:Shyeah, right. by ToasterMonkey · · Score: 1

      For about the last decade, tape has lagged so far behind hard drives that this hasn't been the case. You couldn't back up a high-capacity hard drive on last-generation tape. In fact, the current-generation LTO-6 only holds 2.5 TB uncompressed, so in the worst case, you can back up any hard drive built before 2010 (when the first 3 TB hard drives came out). And that tape technology didn't come out until 2012.

      And you'll spend almost $3k on the drive, plus $45 per tape, or $18 per terabyte. Hard drives are currently running at $30 per TB. So ignoring differences in risk between a hard drive on a shelf and a tape, the break-even point is at a whopping 250 TB—almost an order of magnitude more than is reasonable for most businesses, much less consumers. Unless you're doing data warehousing, this break-even point is simply too high to be practical.

      By your own logic, 250 TB would be quickly reached by merely a hundred old workstations and servers from 2010 - that's silly.
      Also, we use raw storage in the context of _individual_ incompressible backup sets, not backup data at scale, because very few places backup a high ratio of incompressible data overall.

      What's the cost of doubling your storage capacity with either technology, for a few iterations? It's buy more tapes vs. $2&%fhqwgads!!1
      You'll buy a jukebox and few drives at some point but be on your n'th storage array on the other end.

      You can't just toss a couple more hard drives into a full DataDomain, but you CAN rotate tapes out of a my-first-tape-system-jr.

    47. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Or you have the cloud provider send you a hard drive overnight. At which point you'll restore quicker than most tape systems.

    48. Re:Shyeah, right. by unrtst · · Score: 1

      It's 2014, you can just run your backups to low cost cloud storage that is replicated across the world.
        And when an array dies and you need to load all 5 TB of data from backup, let us know what your boss says when you tell him it'll take a week to restore, assuming a 100Mbit internet connection.

      1. he included keeping a local copy, so unless both the production RAID and the local backup system both failed, he'd just pull it from the local copy.

      2. It won't take a week if you're using the right cloud thingy. Ex. Amazon Glacier has an Import/Export and they can ship around drives with your data: http://aws.amazon.com/importex...
      They also have a Direct Connect option, so you could establish a high speed dedicated network connection from you to them, bypassing the internet at large, going up to 10 Gbps.

      FWIW, I wouldn't rely on it as the only backup storage. However, based on your statement, I'm assuming you're restoring from local media as well, so all is equal there (he said he'd have a local copy). How well does your offsite deal with restores?

      Disclaimer: I've yet to use Glacier. I just really like the design, pricing, and features, and I want to use it at some point. For my personal data, it's a non-starter because I have insufficient upstream bandwidth (sneaker net FTW, ugh). For work, we already have a bunch of data centers with fat dedicated pipes between them (I'm still hoping to move to Glacier to greatly reduce (not eliminate) the crap we have to maintain).

    49. Re:Shyeah, right. by s.petry · · Score: 1

      You're absolutely right. Just a few weeks ago I decided to look into backing up my home storage to tape.

      Do you really believe GP was talking about a home system with a few computers worth of data? Sorry, but you are not going to be lunking around HDs for backups after manually bar-coding, labeling, and cataloging them all for a decent sized business. LTO is surely not something a home user would find much benefit in, but on the business side there are numerous benefits. Lots of factors involved, but generally for even a small business it's worth the added data security even when it may not be required.

      In the business side, some executives likes to believe that copies of data in different Datacenters are all you need for DR. It's cheap! This works great until you have a replicated corruption that you can't recover from and lose years worth of data. VTL is an option, but it's expensive and not many people are using it. And You still have the same issue with corruption using VTL as you do with real data.

      --

      -The wise argue that there are few absolutes, the fool argues that there are no probabilities.

    50. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      How does your rsync method cope with rolling back to an earlier version of files or filesystem? While a rsync copy of a life system is a nice fallback in emergency: a much more common application is a partial restore to a previous state. Which leads to a real backup software (can still be fed with disks) and a lot of disks and new problems. While you can automatically hot-plug the required drives, maybe even with a robot, there are ready made tape libraries and tapes aren't that expensive and more easily moved around. This is something you should automate to reduce human error, because software failsafes will slow your human down a lot.

      A hot-spare is no replacement for backup as vice versa.

    51. Re:Shyeah, right. by mwvdlee · · Score: 1

      They should have known some religious nutjob would turn 0 BC into a cultist festival.

      --
      Slashdot social media options: AIM, ICQ, Yahoo, Jabber and Mobile Text. Why no MySpace?
    52. Re:Shyeah, right. by Anonymous Coward · · Score: 1

      It won't happen, for the same reason SAS (just like SCSI) won't ever reach reasonable prices: because the word "enterprise" means "charge a fuckload of money for something that doesn't justify the cost".

      Enterprise means that you pay enough for them to keep the know-how. You pay for them to be able to support you. (You might have to pay extra when you actually need the support.)
      If you have in-house support you probably won't need it.

    53. Re:Shyeah, right. by hairyfeet · · Score: 1

      I have 1X DVDs going back to 99/2K that still read too, that is what happens when you don't buy crap brands. Just keep 'em in a cool dry place away from light and check 'em every 3 years or so for signs of dye rot (which is easy to spot long before the disc becomes unreadable) and DVDs make a great long term storage medium for documents, pictures, videos, etc. And as a nice bonus nearly every PC on the planet can play back DVDs.I guess I'll have to bite the bullet and get a BD burner soon, does anybody here have exp with using BD for storage? How are they holding up?

      As for TFA cost will end up wiping out tape, just not enough tapes and drives being sold, too many are opting for a NAS loaded with TBs of space and the large corps that traditionally bought tape are outsourcing to the cloud. Its a shame as LTO is long lasting as hell but the economies of scale just aren't there anymore.

      --
      ACs don't waste your time replying, your posts are never seen by me.
    54. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Want me to stop saying tape is dead? Prove me wrong. Ship a consumer-grade LTO-6 drive for $300.

      Tape was never alive for consumers. It is all for business and wont die there. You don't have that large disks in most offices. Local store at the moment is a 128G SSD in desktops here atm with all critical data on servers. Regardless of the disk size: There is no need to backup a desktop client. Install image. Connect. Done.

      Servers have tape backup (to recover old system states if needed) AND your rsync hot spare.

      There are different requirements for home or SOHO and enterprise as are for desktop and servers.

    55. Re:Shyeah, right. by riverat1 · · Score: 1

      Our backup requirements aren't as strict as yours but we make daily backups to tape (LTO-6), clone it and send it offsite for 5 weeks before it becomes eligible for recycling. Monthly archival backups we make 2 copies of and send one offsite for 10 years. Next year we will get a deduplicating disk backup system but we'll still copy the backups to tape and send them offsite. Between backup and clones of backups we have around 200 tapes in the rotation. Tape is still the most cost effective way to get our backups offsite. LTO tapes aren't going anywhere soon.

      I agree that for home backups an LTO drive and tapes aren't cost effective but for business use with daily backups and offsite requirements it still fits the bill.

    56. Re:Shyeah, right. by TheRaven64 · · Score: 1

      I'd love to use tape for home use. I have a NAS that I back a couple of laptops up onto. It has 3x2TB drives in a RAID-Z configuration with compression and deduplication enabled for the backup volumes. If I could get an eSATA tape drive something with 2-4TB cartridges then I could easily back that up and store the tapes somewhere else. LTO-5 / LTO-6 would do the job. LTO-5 tapes are pretty cheap now and LTO-6 isn't too bad, but the drives are insanely expensive. For the price of the drive, I could buy two more NAS boxes with the same size disks, stick them in different people's houses, and zfs send to them periodically for backups - and still have enough money left over to pay for their electricity consumption for the next 5 years.

      If LTO-6, with its 6.4TB tapes, launches with a consumer-oriented drive, then I might consider being an early adopter, just buying a couple of tapes initially and assuming that the price will go down in a few years. It won't though. And we know from history that any industry that concentrates on the high-margin high end of the market that eventually that market shrinks as the quality of cheaper low-end equivalents gradually improve until no one can justify them anymore (see SGI, US steel for examples).

      --
      I am TheRaven on Soylent News
    57. Re:Shyeah, right. by TheRaven64 · · Score: 1

      Also, we use raw storage in the context of _individual_ incompressible backup sets, not backup data at scale, because very few places backup a high ratio of incompressible data overall.

      I'm not convinced that's true. At home, my NAS uses compression, so the raw capacity of the tapes is likely the relevant one, unless the tape somehow manages to recompress lz4-compressed blocks and gain a benefit (not entirely impossible, as lz4 is optimised for speed, but pretty unlikely). At work, the NetApp filer that the tape backups run from also uses compresses and deduplicates online, so not much redundancy there either.

      What's the cost of doubling your storage capacity with either technology, for a few iterations? It's buy more tapes vs. $2&%fhqwgads!!1

      Not really, unless you're talking about longer backup cycles. With tape, the backup time can quite quickly become a bottleneck, so you end up needing a second jukebox.

      --
      I am TheRaven on Soylent News
    58. Re:Shyeah, right. by TheRaven64 · · Score: 1

      Tape was never alive for consumers

      Not true. In the '90s, you could buy a tape drive and one tape to back up your £120 hard drive for £100 for the drive and £20 for the tape. I remember quite a few companies including tape drives on their more expensive consumer machines for exactly this reason. The tapes have stayed about that price, but now the drive is £1000 - and that's a single drive, not a tape library. That doesn't just price it out of the market for consumers, it does for small businesses too. It won't be long before it's also too expensive for medium businesses. For very large companies like Google, it's also too expensive because the bandwidth to tape is too slow unless you buy so many drives that the cost is prohibitive.

      --
      I am TheRaven on Soylent News
    59. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      I actually did the same thing 3 years ago for a friend. he arrived with a stack of 9 track tapes and a desktop tape drive. [...]. Made a cool $2000 for sitting and watching tape spin. it was cool.

      You've obviously got a different concept of "friend".

    60. Re: Shyeah, right. by Anonymous Coward · · Score: 0

      Our business upgraded their server 10 years ago and I got the old one for a time. I threw in a new hard drive, ran Linux but eventually concluded that 100mhz just wasn't worth keeping and took it to the next computer recycling event.

      I'm kicking myself now for not pulling the tape drive out first.

    61. Re:Shyeah, right. by profplump · · Score: 1

      Snapshots are available in many filesystems as well as at the volume level via LVM and similar systems. Rsync will happily detect and copy changes without propagating whole files; it will even do in-place updates for circumstances where that's relevant. ZFS cannot detect bit rot until and unless you ask it to read all the data necessary to generate the checksum, which is exactly what rsync will do if you ask it to always use checksums.

      There's nothing wrong with ZFS -- if you have an appropriate workload and disk system have at it. But if you're going to compare it to other tools you should first know what they do.

    62. Re:Shyeah, right. by drinkypoo · · Score: 1

      Tape was never alive for consumers. It is all for business and wont die there.

      Nonsense. Tape drives used to be a consumer-level thing. A used exabyte drive was only a couple hundred bucks, and they actually made super-cheap tape drives that lived on the floppy controller which cost basically nothing.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    63. Re:Shyeah, right. by RenHoek · · Score: 2

      If you think 250TB of backup is a lot, then you don't need tape.

      I currently backup about 1PB and data storage is growing exponentially here (gene sequencing data). Tape is the only cost effective solution for us.

      I do agree though that tapedrives are ridiculously expensive but it's a sellers market. Tapedrives don't sell in massive quantities so the price stays up, mainly because there just aren't that many suppliers.

      On the other hand. I called a shop a while ago to see what they'd give for our 5x LTO4 tapedrives since we upgraded to LTO6 and they only offered us 30 euros per drive. So if you don't need the latest drive out there, you can save a lot of money by buying second-hand.

    64. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Yes, of course.

      Anyway, the point was that you're allowed to say the derogatory thing if you're a member of the set in question.

    65. Re:Shyeah, right. by Lumpy · · Score: 3, Insightful

      Yes I do, when he is making money off of my work, I get paid. Let me guess you are one of those complete scumbags that expect friends are your slaves?

      --
      Do not look at laser with remaining good eye.
    66. Re:Shyeah, right. by svalery · · Score: 1

      i tried the HD swap, the problem was the sata connector didnt hold up after about a year. i'm using LTO3 at home and 5 at work. maybe why the lto media sales are down is everyone has filled their libraries with tapes (when they had the budget to) and the failure rate on lto is low. i think D2D is still a good way to backup, especially for disaster recovery. assuming you do it right, offsite multiple copies, etc. tape for archival purposes still makes sense, unless you want to open the argument about using cd/dvd/blue ray for archiving...

    67. Re:Shyeah, right. by dave420 · · Score: 1

      If you are going to criticise others' spelling and grammar it behoves you to not make such mistakes yourself...

    68. Re:Shyeah, right. by jones_supa · · Score: 1

      I have 1X DVDs going back to 99/2K that still read too, that is what happens when you don't buy crap brands.

      This. I don't understand why people shun optical media so much. When a good burner and a good disc is used, it's still a great archival medium.

    69. Re:Shyeah, right. by jellomizer · · Score: 1

      Digital data needs to move.
      Tape is analog thinking. Get your data write it down and hide it somewhere.
      Digital data needs to move. To have the data properly backed up it constantly needs to move. So if you have ssd drives only. Just as long as you are taking the data and moving it to an other drive and that is moving to an other drive your data is being saved for the long run.
      Once digital data stops moving it is open to threats from the environment.
      Tapes go bad, ssd go bad, any storage medium has issues. To keep your data safe it needs to move.
      That is RAID storage is popular. If a drive fails you can identify it swap it and resync it before the other device fails.

      --
      If something is so important that you feel the need to post it on the internet... It probably isn't that important.
    70. Re:Shyeah, right. by Chris+Mattern · · Score: 1

      You've missed the OP's point. When a format becomes uneconomic for the mass market, people stop developing for it, because they'll want to do development on something they can sell to a lot of people. It falls behind. This causes more people to stop using it, which causes more people to stop development. The death spiral continues until the format falls so far behind that its continued use can't possibly be justified. Tape isn't all the way there yet, but it's getting there. Look at non-commodity servers (like Sun) for stuff that's further down that path.

      You don't need a VTL to keep static, recoverable backups on disk. We do it ourselves, and only keep a few long-term backups on tape. Our save sets on disk are just like save sets on tape would be, except that our backup volumes dynamically allocate and free space as needed. VTLs are kinda dumb, as far as I can see. You give up dynamic space allocation to get...what, exactly?

    71. Re:Shyeah, right. by AmiMoJo · · Score: 1

      I have CDs I burned in 1996 that are still in good condition and readable on any modern optical drive. Obviously, these are Taiyo Yuden archival grade discs, not cheap rubbish, but not terribly expensive either. You really can't beat optical media for backwards compatibility - a modern BluRay drive can still read the first CDs ever pressed without any problem.

      These days my preferred format is archival BluRay. Tapes need expensive drives that wear out or can mangle the tape, and while Unix backup software will be available forever that does mean you need a Linux machine to do the actual reading and writing to tape. It's a shame they didn't decide on a standard, universal filesystem for tape decades ago, like they did with CDs.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    72. Re:Shyeah, right. by AmiMoJo · · Score: 1

      I just use a laser to etch my backups into the surface of the moon, and a telescope to read them back. Occasionally I get bit rot when a meteorite hits it or a Chinese rover makes tracks over it, but that's what parity is for.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    73. Re:Shyeah, right. by AmiMoJo · · Score: 1

      Consumers have mostly moved to external hard drives or cloud storage. I know everyone on Slashdot hates the cloud, but as a backup medium it isn't bad. Off-site, managed by someone else and low cost due to being shared by many other users. You can encrypt everything for privacy and use multiple providers if you don't trust any single one. Might as well make use of that upstream bandwidth you paid for over night.

      Most importantly it's easy. No need to remember to do it, no need to rotate disks off site or plug them back in again. Most people seem to fail at backing up because they are lazy.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    74. Re:Shyeah, right. by jythie · · Score: 1

      Which is why I suspect that the tape market will adjust, but is no deader than usual. If nothing else, as I recall, people have been saying the tape market is 'on its way out' for decades now, yet it is still the only media (generally) that you can pull those arguments from decades ago out of storage and laugh at them again.

    75. Re:Shyeah, right. by scsirob · · Score: 1

      .. good luck with finding the phone number of Amazon for this overnight service. And good luck with hospital recovery once you get the bill for that.

      --
      To Terminate, or not to Terminate, that's the question - SCSIROB
    76. Re:Shyeah, right. by CastrTroy · · Score: 1

      expensive drives that wear out or can mangle the tape

      This is my main problem with removable magnetic media. The simple act of reading the data actually degrades the storage medium. And if you have a bad drive, it can actively destroy any disk/tape you put in there. And it's actually hard to diagnose if the problem is with the disk or the drive, so you're likely to destroy a few disks/tapes before you figure it out. I've had floppy drives, zip drives and tape drives that have all ruined the storage media. At least with optical drives, it's very unlikely that the disc will be destroyed by attempting to read it.

      --

      Anthropic principle: We see the universe the way it is because if it were different we would not be here to see it.
    77. Re:Shyeah, right. by oobayly · · Score: 1

      I was thinking along the lines of the AC, but I suppose it depends on context - business or personal. I also note that you said you "made" $2,000 - not charged him $2,000 - so I'm going to assume your friend worked out what your time was worth.

      I've never asked for money for helping a friend out, but I've been given numerous bottles of wine (including a very nice looking Rioja under my desk), beer and some cash (as my dad once said - refuse twice, then accept). However, I also know to offer my time to people who will appreciate it, and may also be able to help me out in the future.

      I have also flat out refused to fix a colleague's home laptop - I'd already fixed it twice (for no reward) and explained to him what to do to prevent his son fucking it up. The 2nd time, I had told him "I never want to see that laptop again in my life". The whole office thought it was hilarious when he tried saying "I'll just leave it on your desk in case you've got time" - my reply was "You bloody well won't, I told you I didn't want to see it again".

    78. Re:Shyeah, right. by rnws · · Score: 1

      I used to work at an LTO manufacturer and asked why we never drove the older generations down into the SMB space and it is simply this - the components are *really* expensive, the majority of the component cost of the drive is the R/W head, that alone probably accounts for 25% of the drive and you just can't push the price down much further, it costs what it costs. Also, the HUGE majority of these things go into libraries with hundreds of drives, thousands of slots and robots that can move upwards of 90km per hour.

    79. Re:Shyeah, right. by DigiShaman · · Score: 1

      Blaspheme! Texas is a whole other country. Well, was. Multiple times in the past.

      --
      Life is not for the lazy.
    80. Re:Shyeah, right. by ebh · · Score: 1

      I have some 20-year-old IDE drives that still work fine. Nice novelty items, but I'd still never use disk drives as long-term backup.

    81. Re:Shyeah, right. by LordLimecat · · Score: 1

      The problem with flash media (aside from its insane cost) is that they tend to catastrophically fail unpredictably, especially when improperly dismounted..

    82. Re:Shyeah, right. by The+Snowman · · Score: 1

      I guess I'll have to bite the bullet and get a BD burner soon, does anybody here have exp with using BD for storage? How are they holding up?

      I have two BD-R drives. Much like with DVDs, I use a good quality media: pretty much all of the good DVD brands also make good BD-Rs, e.g. Verbatim. I store the discs in a cool, dry place away from sunlight (disc binders). After about four years I have had no problems reading any disc I have burned.

      Blu-ray discs have two advantages over DVD. First is size: a single layer disc holds 25 GB, or approximately three times as much as a dual layer DVD. Dual layer discs hold 50 GB, or approximately six times as much as a dual layer DVD. This drastically reduces both the annoyance of burning (sitting at the computer swapping discs) as well as the amount of physical space required.

      The second advantage, which I wish applied to other media as well, is the scratch-resistant coating. Due to the much tighter storage density as well as the thinner layer of plastic required to get the laser closer to the data surface, a scratch is more serious for a Blu-ray. To help with this, they use a much more durable plastic that does not scratch easily unless you are deliberately gouging the surface.

      For commercial use, go with tape. For home use, I love my BD-R. A 50 GB BD-R disc holds plenty of data for a home user, is durable, and can last years under residential conditions.

      --
      24 beers in a case, 24 hours in a day. Coincidence? I think not!
    83. Re:Shyeah, right. by jbengt · · Score: 1

      Commercially printed Read Only optical disc data can be OK, but the Read-Write consumer discs rely on dyes that will degrade & lose data over time.

    84. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      And I'm pretty sure New South Wales is a state, or maybe they go with the british spelling of staete.

    85. Re:Shyeah, right. by Provocateur · · Score: 1

      You left out the offsite station wagon. If *that's* on the way out, the mag tapes should worry

      --
      WARNING: Smartphones have side effects--most of them undocumented.
    86. Re:Shyeah, right. by operagost · · Score: 1

      They didn't, but fortunately the Julian date was a signed integer.

      --

      Gamingmuseum.com: Give your 3D accelerator a rest.
    87. Re:Shyeah, right. by Provocateur · · Score: 1

      Simple. To them 'BC' meant Babylonian calendar. Duh.

      --
      WARNING: Smartphones have side effects--most of them undocumented.
    88. Re:Shyeah, right. by dgatwood · · Score: 1

      I shoot RAW, so 80 GB sounds hopelessly tiny to me. The portion of my photo library that I carry around on my laptop, by itself, would take more than 6 of those tapes to back up once. The entire library would probably be around 10–12, but I don't feel like digging out the external drive just to get a more accurate estimate. :-)

      And the DAT-160 tape prices, unlike the drive prices, haven't come down. At $312.50 per terabyte, the tapes cost 10x what a hard drive costs and 5x what laptop drives cost. So you could back up your data 5 times on hard drives for the same cost as backing it up once on tape. And the laptop hard drive would hold as much data as 25 of those tapes, so it will take up an order of magnitude less space to use hard drives as well.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    89. Re:Shyeah, right. by jones_supa · · Score: 1

      So? It's still pretty good.

    90. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Can't we all just get along.

      Seriously, couldn't you use both? Snapshot with ZFS and then rsync the snapshot?

    91. Re:Shyeah, right. by rnws · · Score: 1

      To get a drop-in replacement for an existing tape library so that you don't have to rebuild your entire backup workflow overnight.

      If you look at most deduping PBBA's like Quantum's DXi range or HP's D2D, you can see they allow you to emulate a tape library as a *non-disruptive* drop-in replacement and they also let you creat SMb or NFS targets too so as new backup sets are created or as old tape sets expire out of rotation, new backup jobs can be created on the LAN instead.

      Don't forget - what works _for_you_ may not work for the hundreds of thousands of other businesses worldwide.

    92. Re:Shyeah, right. by s.petry · · Score: 1

      I didn't miss the point at all. The economics of tape backup has _never_ favored home users over businesses. Tapes have never been that expensive, but the drives are a huge amount of capital.

      I think you missed my point regarding VTL though, which is that multi-site replication of virtual tapes is subject to the same issues of corruption as replicated volumes, or any other backup file format that remains only on disk. For economics, we have moved some of our backups to VTL but these are the convenience backups and not our data that needs real DR (long retention and guaranteed data integrity).

      --

      -The wise argue that there are few absolutes, the fool argues that there are no probabilities.

    93. Re:Shyeah, right. by sribe · · Score: 1

      But go pull the post-close EOY General Journal from 1996 off of one, I dare you.

      No problem. I have data from the 1980s on spinning magnetic media, and can access it any time I want, instantly.

      You need it backed up on at least 4 pieces of media, of at least 3 different types, in at least 2 different cities, in at least 1 different state; bumping each of those numbers up by 1 is not unreasonable.

      I'm working on a fairly small scale, on a low budget, so my numbers are 2 pieces of media, 1 in a different city & state than the production system. (So 3 copies counting production.) But all on spinning media--different brands, models, even different generations of disks, different enclosures, different RAID systems--but still all on disk.

    94. Re:Shyeah, right. by rnws · · Score: 1

      As LTO can compress (for free) and encrypt (usually licensed) in hardware, I'd rather hope that your NetApp compression (and deduplication) is also free or are you paying for that? Even there you get better reduction ratios for less money if you purchased a dedupe appliance from Quantum, HP or EMC.
      Tape is seldom the bottleneck if you have sized it correctly. If the tape is running slow (e.g. an LTO-6 drive running at 60MB/s) then it is the disk array that cannot supply it data fast enough. If the drive is running at 160MB/s then it's maxxing out (assuming you get no compression). The vast majority of business arrays are optimised for IOPS and backup is a *sequential* workload and once you empty their cache's most arrays just can't keep tape drive buffers stuffed, but few storage admin have the testicular fortitude to admit their big-$ array can't do sustained sequential workloads very well.

      One reason SSD's are so good is they never have trouble keeping tape streaming and thus make tape far more reliable than disk.

      Finally, at the hundreds of TB, or in the peta-scale, disk is simply unsustainable at volume, between purchase, licensing, support contracts, power and cooling and generation migrations every 3 to 5 years.

      Your home NAS and I daresay (what sounds like) your single NetApp NAS, are not the same problems organisations with very, very large datasets have to solve and thus very different cost-structures.

    95. Re:Shyeah, right. by dgatwood · · Score: 1

      Also, we use raw storage in the context of _individual_ incompressible backup sets, not backup data at scale, because very few places backup a high ratio of incompressible data overall.

      I'm not convinced that's true. At home, my NAS uses compression, so the raw capacity of the tapes is likely the relevant one, unless the tape somehow manages to recompress lz4-compressed blocks and gain a benefit (not entirely impossible, as lz4 is optimised for speed, but pretty unlikely). At work, the NetApp filer that the tape backups run from also uses compresses and deduplicates online, so not much redundancy there either.

      My impression is that a growing percentage of data these days cannot be compressed further:

      • Media (pictures, movies, etc.) makes up a growing percentage of data, and is already so compressed that it won't compress further.
      • Source code stored in a git archive uses LZW, IIRC, so unless you're compressing a checked-out copy, compression won't buy you much, if anything.
      • More and more document files are compressed—Pages files are ZIP archives, EPUB books are ZIP archives, and so on.
      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    96. Re:Shyeah, right. by operagost · · Score: 1

      Those QIC drives used to really stink. Only DDS and 8mm were usable, and those weren't really for consumers. QIC drives used to shoeshine like mad, even if on a SCSI controller like the one I had.

      --

      Gamingmuseum.com: Give your 3D accelerator a rest.
    97. Re:Shyeah, right. by rnws · · Score: 1

      As LTO can compress (for free) and encrypt (usually licensed) in hardware, I'd rather hope that your NetApp compression (and deduplication) is also free or are you paying for that? Even there you get better reduction ratios for less money if you purchased a dedupe appliance from Quantum, HP or EMC.
      Tape is seldom the bottleneck if you have sized it correctly. If the tape is running slow (e.g. an LTO-6 drive running at 60MB/s) then it is the disk array that cannot supply it data fast enough. If the drive is running at 160MB/s then it's maxxing out (assuming you get no compression which today assumes 320MB/s). The vast majority of business arrays are optimised for IOPS and backup is a _sustained_sequential_ workload and once you empty their cache's most arrays just can't keep tape drive buffers stuffed, but few storage admin have the testicular fortitude to admit their big-$ array can't do sustained sequential workloads very well.

      One more reason SSD's are such an improvement is they seldom have trouble keeping tape streaming and thus make tape work far better than disk ever could.

      Finally, at the hundreds of TB, or in the peta-scale, disk is simply unsustainable at volume, between purchase, licensing, support contracts, power and cooling and generation migrations every 3 to 5 years.

      Your home NAS is not the same problem organisations with very, *very* large datasets have to solve and thus very different cost-structures.

    98. Re:Shyeah, right. by dgatwood · · Score: 1

      If you think 250TB of backup is a lot, then you don't need tape.

      Need? Strictly speaking, no. But I'd be a lot happier being able to mail tapes for backup, rather than having to use fireproof hard drives locally. To fully back up my digital life once, I need somewhere on the order of 10 terabytes. I'd like to have several copies, so 50 TB would be convenient. That's 13 hard drives at 4 TB apiece. That takes up a fair amount of shelf space, and is very expensive to ship offsite. By contrast, if tape had kept up, I'd be able to store that data on five tapes, and I have plenty of room for five tapes and a single drive. And I could mail five tapes in a padded envelope.

      And hard drives really don't work well for backups. You either keep them constantly spinning (in which case they are likely to be destroyed by the same power event that destroys the main drive) or you have to physically plug them in whenever you want to make a backup. This does not encourage folks to make backups regularly. Compare this with a tape drive attached to a computer, in which the media is effectively offline as soon as you switch tapes (and to some degree, even before). It's just an entirely different world.

      On the other hand. I called a shop a while ago to see what they'd give for our 5x LTO4 tapedrives since we upgraded to LTO6 and they only offered us 30 euros per drive. So if you don't need the latest drive out there, you can save a lot of money by buying second-hand.

      That might be what they would give you, but that's not what they'll sell it for. Assume that they'll resell that used drive for at least the equivalent of $500 U.S.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    99. Re:Shyeah, right. by jedidiah · · Score: 1

      70G is less space than I have on my phone.

      A 70G tape seems silly in an age of cheap 64G thumb drives.

      --
      A Pirate and a Puritan look the same on a balance sheet.
    100. Re:Shyeah, right. by operagost · · Score: 1

      You keep copying your archival backups from years ago? Hope it's encrypted.

      Can I just load a station wagon full of LTO tapes and keep driving it around the country? Can't beat the bandwidth.

      --

      Gamingmuseum.com: Give your 3D accelerator a rest.
    101. Re:Shyeah, right. by rnws · · Score: 1

      Fine, YOU ship an EMC VNX for $300 and then we can talk.

    102. Re:Shyeah, right. by dgatwood · · Score: 1

      Consumers have mostly moved to external hard drives or cloud storage. I know everyone on Slashdot hates the cloud, but as a backup medium it isn't bad.

      Oh yes, it is. It's fine for grandparents who just have a handful of files. For people who either take lots of photos or buy movies and music, it's terrible. Ever back up a 3 TB hard drive at 300 kbps? One backup takes 2.5 years. Even at ~9 Mbps (the U.S. average), it takes more than a month. Internet speeds are just not sufficient for backup purposes. They're two orders of magnitude short of being usable. We really need a nationwide fiber network with gigabit speeds or faster.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    103. Re:Shyeah, right. by rnws · · Score: 1

      Speaking as an Enterprise vendor: 1. Nobody ewver pays list. 2. You aren't just paying for the device, there's a tonne of development going on. One dedupe appliance I worked with had over 120 engineers behind it that all have to be paid, plus every time you put something into the market, you find all kinds of weird-ass coner-cases that have to be diagnosed, debugged and fixed. You have global manufacturing, logistics and 24x7 support infrastructures to pay for. We also try and engineer-in more reliability, redundancy and durability than you can buy off-theshelf. LTO, for example, is *two to three orders of magnitude more reliable* than consumer hard disks.

    104. Re:Shyeah, right. by dgatwood · · Score: 1

      Sorry, but you are not going to be lunking around HDs for backups after manually bar-coding, labeling, and cataloging them all for a decent sized business.

      Most businesses don't have large storage needs. More and more businesses have users back up their desktop machines to a second drive (e.g. with Time Machine), store critical data on servers, and have IT people back up those servers. And just as many businesses outsource their email to Google, it isn't a big leap from there to outsourcing their server backups to any of the dozens of online backup vendors that are out there.

      In the business side, some executives likes to believe that copies of data in different Datacenters are all you need for DR. It's cheap! This works great until you have a replicated corruption that you can't recover from and lose years worth of data.

      A live mirror is not a backup. With that said, you can perform periodically rotating replication to multiple backup servers, and use that as a backup solution. That's no different than reusing tapes.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    105. Re:Shyeah, right. by TangoMargarine · · Score: 1

      I shoot RAW, so 80 GB sounds hopelessly tiny to me. The portion of my photo library that I carry around on my laptop

      Why?!

      Yes, when you purposely try to take up as much space as humanly possible, it ends up being really big. The least you could do would be leave the raw images on your home media server and keep versions of them compressed to a halfway sane size on the laptop.

      --
      Unity? Screw that: XFCE. Slashdot Beta? Screw that: SoylentNews. Australis? Screw that: Pale Moon. UX developers DIAF
    106. Re:Shyeah, right. by cyberchondriac · · Score: 1

      LTO is not dead. There are backups, and there is DR, and they are two different things. Plus, you have structured data (databases) and unstructured.
      For a database, or DR, I do agree backup to disc is fine. You typically only need the latest version with the most (and most up to date) data.

      For backing up disparate documents, however; xls, docs, pdfs, etc.. you wind up with a ton of different versions of the same file, often changed daily, which can be corrupted at any time. (Interestingly, where I work, our users often don't seem to notice this however for weeks..!) I see this from time to time. Even with dedupe, if you have enough versions of all these files and have terabytes - petabytes of data to backup, a totally disc solution would be very pricey as the capacity requirements skyrocket. Tape also has the benefit of being extremely portable, as well as long life. (Granted, speed is a disadvantage).
      We're strictly tape at the moment, but we are moving towards a hybrid solution shortly, incorporating into our environment either Data Domain or Quantum's DXi.

      --

      Look back up at my post, now look back down, you're on the Internet. Now look back up. I'm a signature.
    107. Re:Shyeah, right. by TangoMargarine · · Score: 1
      --
      Unity? Screw that: XFCE. Slashdot Beta? Screw that: SoylentNews. Australis? Screw that: Pale Moon. UX developers DIAF
    108. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Yeah image having to pay $250 for a 8-slot SAS LTO-4 tape library (http://www.ebay.com/itm/IBM-System-Storage-TS3100-3573-2UL-Supported-LTO-4-TAPE-LIBRARY-EXPRESS-/251374667083?pt=US_Tape_Data_Cartidge_Drives&hash=item3a8719054b) that will allow you to backup 6.4tb uncompressed and 12.8tb with 2:1 compression

      And the media is so expensive (http://www.ebay.com/itm/Lot-of-5-HP-C7974A-1-6TB-LTO-4-Ultrium-RW-Data-Cartridge-/151490986434?pt=US_Tape_Data_Cartidge_Drives&hash=item23459101c2) It is just outrageous to have to pay $20 for a tape that holds roughly 1tb

    109. Re:Shyeah, right. by TangoMargarine · · Score: 1

      Oh wow, I can't think of the last time I saw someone on /. say "just put it in the cloud" with a straight face.

      Or was that a joke? It's always hard to tell.

      --
      Unity? Screw that: XFCE. Slashdot Beta? Screw that: SoylentNews. Australis? Screw that: Pale Moon. UX developers DIAF
    110. Re:Shyeah, right. by rtaylor · · Score: 1

      That's why 0 was skipped and they went straight from 1BC to 1.

      --
      Rod Taylor
    111. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      > The one working like new drive was packed with [...] and a linux driver on a CD.

      What will be the biggest emotion: elation when someone discovers that there still is a drive to read his ancient tapes, or the disappointment when realization sinks in that drivers required to operate the drive are on a CD which has long since becone unreadable because of bit rot...

    112. Re:Shyeah, right. by bored · · Score: 1

      Yah, you are 100% right, to bad you don't work for the tape vendors.

      The one little niggle, is that your numbers fail to account for the price of the library, which anyone writing more than one tape's worth of data is going to want really fast. Add in the price of a small/medium sized autoloader and it doubles the break even point.

      Hence my own personal use of cloud backup technologies and small portable eSATA/USB raid arrays. Just don't drop them, and make sure to transport them in very well padded containers.

    113. Re:Shyeah, right. by dgatwood · · Score: 1

      Yes, when you purposely try to take up as much space as humanly possible, it ends up being really big. The least you could do would be leave the raw images on your home media server and keep versions of them compressed to a halfway sane size on the laptop.

      Why would I want to do that? I use Lightroom on my laptop for managing my photos. Doing it the way you suggest would A. be an unholy hell, and B. make it impractical to import photos in the field.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    114. Re:Shyeah, right. by AmiMoJo · · Score: 1

      You need a reasonable upload speed, but bandwidth is infinite over time and I have backed up terabytes over a few months with a 10Mb connection.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    115. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      I pulled data off 8" floppies a couple years ago... wish I was kidding - the data was taken the same year I was born.

    116. Re:Shyeah, right. by TangoMargarine · · Score: 1

      What do you use the photos for? Are you a professional photographer, or what?

      --
      Unity? Screw that: XFCE. Slashdot Beta? Screw that: SoylentNews. Australis? Screw that: Pale Moon. UX developers DIAF
    117. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      The charge which holds the data in flash devices will evaporate over time. Cheap devices quickly, more expensive just takes longer.

    118. Re:Shyeah, right. by tlhIngan · · Score: 1

      I used to work at an LTO manufacturer and asked why we never drove the older generations down into the SMB space and it is simply this - the components are *really* expensive, the majority of the component cost of the drive is the R/W head, that alone probably accounts for 25% of the drive and you just can't push the price down much further, it costs what it costs. Also, the HUGE majority of these things go into libraries with hundreds of drives, thousands of slots and robots that can move upwards of 90km per hour.

      Why? Is the head made of exotic materials that cost a lot?

      I mean, a hard drive has a read-write head that is tiny and made to fine precision, but because of the immense R&D that went into production and simply mass production forced optimizations in cost and production methods that drove the price down so much that you can pick up a ton of storage for not a lot of money. Like 2TB portable hard drives for under $100. And that neglects the fact that the mechanical parts of said hard drive are far tinier and have tight tolerances in order to stuff that much storage in the space smaller than a single tape.

      The price is probably expensive because no one's ever bothered to scale it from the thousands to millions of units.

    119. Re:Shyeah, right. by praxis · · Score: 1

      Most people seem to have a definition of archival that's different than yours?

    120. Re:Shyeah, right. by xaotikdesigns · · Score: 1
      I wonder if my old zip disks still work? I still have the drive, but at the time, I decided to go with the serial port model instead of the new fangled USB...

      Now I just have to find a computer that still has a seriel port...

      --
      XDInd
    121. Re:Shyeah, right. by xaotikdesigns · · Score: 1

      I always wondered if you could fix an LTO drive with a pencil and little bit of scotch tape

      --
      XDInd
    122. Re:Shyeah, right. by xaotikdesigns · · Score: 1

      You just have to keep all your drivers backed up on a different tape

      --
      XDInd
    123. Re: Shyeah, right. by xaotikdesigns · · Score: 1
      If you are in the middle of a riot, you aren't going to be trying to get to your backups.

      Chances are, you are either throwing a brick through a window, or staying home with your doors locked. If you have backups in a different city, then you are probably OK if you need to have someone else access them. If you have two cities that are rioting, regardless of state, then you probably have bigger issues to worry about.

      --
      XDInd
    124. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      harddrives are not archival though, so it's hard to compare. It's like an artist complaining that canvas is so expensive compared to newspaper.

      And I will admit that the limited size of DAT makes it not an option for some people. For me, most of my important work is text based, which compresses well and isn't very big.

    125. Re:Shyeah, right. by xaotikdesigns · · Score: 1

      I'm pretty sure that the UK was a bunch of separate states (countries) that got pulled into the British empire.

      --
      XDInd
    126. Re:Shyeah, right. by OrangeTide · · Score: 1

      Maybe he's just got an art hobby, nothing wrong with wanting to preserve the work you did. Maybe 20 years down the road he'll want to process those photos into a completely different composition.

      --
      “Common sense is not so common.” — Voltaire
    127. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      This is exactly why my phone is still use tin cans and string.

    128. Re:Shyeah, right. by OrangeTide · · Score: 1

      my phone has maybe 100kB of worthwhile stuff on it, the other 31.99GB is bullshit that I don't need long term. I can prove this by when I upgrade my phone I'm not going to copy a lot over other than the address book (which the cloud will do automatically for me)

      Also, those tape sizes assume 50% compression. The raw sizes are: DAT 72 = 36 GB, DAT 160 = 80 GB

      --
      “Common sense is not so common.” — Voltaire
    129. Re:Shyeah, right. by Rich0 · · Score: 1

      You're talking about a used market to start, and a drive that takes up quite a bit of space physically (it makes sense in a rack, but not so much otherwise).

      Then $20/tb is not much cheaper than you get with hard drives.

      At that price point the tape drive almost makes sense if you have a fair bit to back up. However, a more reasonable price point would be 6TB per tape at $30 per tape and $100 for the drive new. Once upon a time that was the sort of price point tape drives ran for in the consumer space. I doubt we'll ever see it again.

    130. Re:Shyeah, right. by TangoMargarine · · Score: 1

      Which was why I suggested the media server bit. From the "in the field" comment I'm wondering whether it's a professional concern.

      --
      Unity? Screw that: XFCE. Slashdot Beta? Screw that: SoylentNews. Australis? Screw that: Pale Moon. UX developers DIAF
    131. Re:Shyeah, right. by WorBlux · · Score: 1

      Ever left a thumb drive sitting for a year? They leak electrons

    132. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Pretty good is not good enough when failure is not an option.
      Also the amount of storage you can put on a tap far exceeds that of one DVD, or Blue Ray.

    133. Re:Shyeah, right. by jones_supa · · Score: 1

      Indeed. I cringe when people archive data on flash memory, for example.

    134. Re:Shyeah, right. by jones_supa · · Score: 1

      Oh, I guess I was thinking it more from the perspective of a typical consumer. In enterprise environments, tape of course kicks ass.

    135. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      You've missed the OP's point. When a format becomes uneconomic for the mass market, people stop developing for it, because they'll want to do development on something they can sell to a lot of people. It falls behind.

      err... what?

      Not in the storage world. People are only now getting over the solid state tech that we can all put in our laptops for a reasonable price, yet solid state storage has been around for a very long, long time (as was tape, optical storage and 'TB' sized disks) before the 'mass market' even knew it was there or had a sniff of it.

      It's often only about quantity (in storage anyway) once the technology has moved on and the enterprise (and SMA's to a certain extent) are looking for the next fastest/price per MB comparison, leaving the 'mass market' providors to fight over the crumbs when frankly the economics have already been just about squeezed out of whatever storage doodad they can throw at them.

      Tape is an interesting anomoly and has NEVER been economic for the 'mass market' ... EVER!

    136. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Not quite true.
      M-disc supposedly is good for 1,000 years. Conventional optical media is 7 years,
      Of course M-disc cost more.

      For backup, optical is just fine, but hard drives are more practical. Whatever fits best for one's requirements to reliability, speed (for storing as well as retrieving) & cost (operational cost as well as capital cost).

      For archival, optical is the only reasonable option now. Either by using M-disc, or by doing what real libraries do:
      Copy the data periodically to fresh media.
      That is what libraries have been doing since antiquity.

      These days with all the chatter about clouds, large operations would do archival in their private clouds, while Jope schmoe more and more secure their important data in a public cloud.

      Behind the cloud can be an assortment of HDD disk farms, large, tape libraries, large optical libraries, and clever software is used to manage archiving, according to retention policies. Where to put what depends on how long one is required to keep it, how often it is requested etc.

      In such an infrastructure tape will lose out, exactly fro the saem reason cited in the original article, there will not be enough companies investing in research.
      But more important, there is no commoditization. Optical storage has the huge advantage that it is still a consumer market, and with that comes great economy of scale. magnetic tape was doomed the day CDROM writing became a consumer technology.

    137. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Except M-Disc, which engraves onto artificial stone.

    138. Re:Shyeah, right. by praxis · · Score: 1

      Indeed. People cringe when you archive data on consumer DVD-Rs, for example.

    139. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      You and I have entirely different definitions of "archival", and next to no media is actually good for that long, based on the data I've seen.

    140. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      And if that's good enough for you, go with that.

      Some people, in some circumstances, have stricter standards. Magnetic cartridge tape has been proven over time to live up to those stricter standards, where other "archival" media does not.

    141. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      I've been backing up small and medium sized businesses (revenue less than, say, about $20M a year) for 3 decades.

      I've never had one that wouldn't fit on a single LTO-2 cartridge.

      Sure, you're not going to back up a home PC with 6TB of music, movies and porn on it, but y'know what? Those don't *merit* this class of backup, either.

      If you're bigger than that, you clearly have the money (or you should), and I would assert, professionally, that the advantages *still* outweigh the disadvantages for staying with tape.

      But if you've done your own CBA on it, feel free to advise your clients howmever you want. :-)

    142. Re:Shyeah, right. by Mandrel · · Score: 1

      i tried the HD swap, the problem was the sata connector didnt hold up after about a year.

      I'd be interested to know what failed, the SATA plug on the disk or the SATA socket on the hot-plug slot?

    143. Re:Shyeah, right. by MikeBabcock · · Score: 1

      It allows for disaster recovery like hurricanes, earthquakes, etc. where locality is an issue. If your backups are all near each other physically then a large-scale disaster will wipe out all your data.

      --
      - Michael T. Babcock (Yes, I blog)
    144. Re:Shyeah, right. by dgatwood · · Score: 1

      At various times, it has been professional, and might be again sporadically, but mostly it's serious hobby.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    145. Re:Shyeah, right. by MikeBabcock · · Score: 1

      We also use hard drives for backups. We make sure we do weekly read tests on drives and that the data is actually valid. We also run a SMART check on each backup disk before it is used and replace and destroy the ones that fail. The only bad part about hard drive backups is secure high speed interfaces for off-site devices.

      --
      - Michael T. Babcock (Yes, I blog)
    146. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Even if you find a computer that has a serial port, you'll probably have trouble getting that drive to work, since those old Zip drives used a _parallel_ port, not a serial port... :D (Or a SCSI connection. Both of them used a D25 connector, as I recall, so the only way you can really tell for sure is to see whether or not there's a switch on the back panel to set the SCSI bus ID number or not.)

    147. Re:Shyeah, right. by dgatwood · · Score: 1

      Tapes aren't really archival, either, unless you have several copies. I've done batch recapture off of DV after a few years, and swore when I found serious dropouts. That's relatively low density data compared with LTO (though admittedly with less redundancy and error correction). After that, I dug around and found a copy of the captured files on some old hard drives, which unlike the tape, were intact.

      So basically, from what I've seen, nothing is truly archival unless you have multiple copies, and if you have multiple copies, just about everything is archival, so the difference between tape and hard drives is that tape drives require a large up-front investment in a drive in exchange for cheaper per-TB costs for the media and higher physical density (because you don't have redundant electronics going along for the ride). If the per-TB costs aren't less and the density isn't higher, then tape offers no real advantage over spinning disks, IMO, unless your data storage needs are so massive that you have automatic libraries, and even then, only if you can't find a company willing to build a hard-disk-based librarian robot.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    148. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      convert the data to standard ASCII

      Dude, that must have been a shitload of ASCII pr0n ...

      Care to share a torrent? :)

    149. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Specifically, there were a lot of people -- even in large corporations with multi-thousand person head offices in Manhattan -- who thought, before Sandy, that New Jersey was far enough away for their DR hot site.

    150. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Bingo.

      Low cost can only come from economies of scale, which only can come from consumer market.
      Tape has not been consumer technology in a long time, and even when it was, it was not widely adopted.

    151. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Nonsense.

      VTL is an option only if you need to have to use antiquated backup software that only works with tape drives or things pretending to be tape drives.
      VTL is nothing but a HDD array pretending to act like a set of tape drives.

      Tape really is dead, and is getting deader by the day.
      It only lives on to serve a fast shrinking legacy market.

    152. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Still wrong.

      Just because it is available as a consumer technology does not mean it is a commodity at consumer scale.
      Only a tiny minority of consumers would buy tape drives for backups. And that only lasted until CD writing drives were made available at reasonable prices.

    153. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      probably the hot plug slot... at that point i was swapping out the server for a "newer" one (5 vs 12 years old)

    154. Re:Shyeah, right. by Mandrel · · Score: 1

      probably the hot plug slot... at that point i was swapping out the server for a "newer" one (5 vs 12 years old)

      If the server was that old, the slot could have had many more insertion cycles than any disk, so it's hard to conclude that disk plugs are more robust than slot sockets. But it'd be good if that were the case. The desktop USB3 SATA hot-plug unit I'm using (with an eject button, so it looks like a toaster), is a lot cheaper than a disk (and doesn't carry any data).

    155. Re:Shyeah, right. by toddestan · · Score: 1

      I would think that at that point, a Bluray burner would also look like an attractive alternative.

    156. Re:Shyeah, right. by toddestan · · Score: 1

      Back when I remember them being popular for home use (relatively speaking), a decent number of people who had computers also had a tape drive for a backup. I would say a larger percentage than ever had Zip drives a few years later. Keep in mind this was before the whole internet thing took off, so it's not like your typical household had a computer yet. Also, keep in mind that at the time tape really was it for backing up a non-trivial amount of data - your only other option was a stack of floppy disks, or maybe a really expensive SCSI external HDD.

    157. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Ship offsite? We only pay for a 1.5gb connection, but it's over a 10gb link. We use the extended LAN service through the ISP to connect to the offsite for cheap. Nice 10gb connection over which we can upload. No need to "mail" anything.

    158. Re:Shyeah, right. by mcswell · · Score: 1

      You're right, of course, but my punch cards are pretty good. Now if I could just find a punch card reader...

    159. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      From what I understand, ZFS can do everything Rsync and or LVM can do, but better. ZFS can even handle snapshots across volumes. Can LVM guarantee that if you took a snapshot of several different volumes at the same time, that they'd all be in a "safe" state relative to each other? This can be important. Can LVM deduplicate data across volumes? Can I mount an LVM snapshot and the only extra space taken is the difference between the original and the changes made?

      LVM is great at what it does, but it does have limitations because it does not understand the FS.

      I looked up "snap shots" and LVM and got greeted by a "You need enough unpartitioned space to hold the snapshot, which is the size of the original partition".... WTF?! Snapshots should take up virtually no space at all. ZFS can have a lot of snapshots of petabytes of data and it will only take up megabytes of metadata.

      With a flick of the wrist, ZFS knows every difference that has happened to every volume under its care. You could have millions of volumes, and one short command will sync a remote system with your current system. You sync the entire pool, that includes everything, not just file data, but also permissions and any other FS meta data.

      Mix ZFS and FreeBSD and you have some powerful abstractions. You can create a jail and set resource limits on that jail, including letting that jail have its own child jails. You can allow jails to interact with ZFS. Because of this, you can have jails with child, grand-child,great-grand-child, etc jails, each with its own sub resource limits that all feed from their parent, along with ZFS.

      You, as the sysadmin, do not need to know about all of these jails and sub jails nor their volumes and sub volumes of data. Just one quick sync command and every volume in the entire system can be "rsync'd". And when you have these lovely hierarchy of jails and volumes, you best not let any child get out of sync with their parent. FreeBSD and ZFS are both by sysadmins for sysadmins.

    160. Re:Shyeah, right. by Warphammer · · Score: 1

      That hard drive head also has many, many advantages that the tape head has to work around: It has built-in positioning (fly height) in an extremely controlled environment, a hermetically sealed box - some now with special atmospheres. The kinds of things you have to deal with on a head passing along a moving tape (contact, tape irregularity, some level of constant contamination) are very different from a hard drive head reading from a glass platter. Scale has something to do with it, but there's a lot of machining and operational concerns that the hard drive gets to 'cheat' a little on, even if HDD heads are pretty amazing in their own right.

    161. Re:Shyeah, right. by Sqr(twg) · · Score: 1

      Rsync will happily detect and copy changes without propagating whole files, yes. But only on network transfers, and it requires reading the entire file on both ends. When backing up to a local (removable) hard drive, which is what we are discussing here, it is usually faster to copy the file once than to checksum it twice, so that is what rsync does by default.

      I have compared the tools, and I do know what they do. I found a hundredfold improvement in the time to backup a set of virtual machines on a linux server after switching from rsync to ZFS.

    162. Re:Shyeah, right. by dshk · · Score: 1

      I moved to the opposite direction, from disks to tapes. We are a small IT company with less than 10 employees, mostly developers, no dedicated sysadmin, but quite a few servers. We had no previous experiences, so our backup "methodolody" is only slowly improving in ad-hoc ways. First we had backups of critical data stored on online disks. Source code and a very few other things. No configuration files, no database. There were only ad-hoc copies of the latters. After a while I started to backup more data, and started to use a centralized backup software (namely Bacula). Backups were still written to online disks. Everything was online, and we are reguralry attacked by hackers. Not a good combination. In the next step I tried to occassionally copy the online backups to offline disks. That did not really worked. Copyying all backups were time consuming, and I usually forgot it or do not have time for it. Large hard disks are still not that cheap, and they cannot be simply taken out the server and put back. The drives must be mounted on a tray, which require additional costs and work. Most people forget that if I have a 300 GB dataset, then I need about 30 * 300 GB backup space. There are tricks to reduce that, but that makes everything more difficult, more time consuming, less safe. I started to use tapes 2 years ago, after I recognized that our backup software supports that better. I thought that tape for us will always be a luxury, but it makes things much simpler. Equipment cost was definitely not a motivation. And indeed that is what happened, now everything is super simple. Bacula tells me what tape should I put into the drive, or if I need to buy a new tape. We have offline copies and multiples copies recorded at different dates. We can retrieve and compare data from 1 day ago, 2 days, one week, one month one yeat, whaterver I want. That is a nice safety, much-much better than we had previously. Bacause tapes are cheaper, I do not mind adding new data to backup and new tapes, just to make things simple. The funny thing is that I believe we shortly reach the point when our very simple, very safe, tape based backup system will be actually cheaper than the equal hard disk based, even if I do not count labour, only equipment. I am sure that a larger organization with real sysadmins can do it better, but I am quite happy with our current state.

    163. Re:Shyeah, right. by fbjon · · Score: 1

      I store my backups in two states. "Outdated" and "accidentally deleted".

      --
      True confidence comes not from realising you are as good as your peers, but that your peers are as bad as you are.
    164. Re:Shyeah, right. by hairyfeet · · Score: 1

      Thanks for the info. I've been able to hold out for so long by keeping my eye out for sales and stocking up I've been able to find some crazy DVD blank deals, we're talking 12c-14c a pop for everyday use and 14c-16c a pop for backup quality in 100 packs. the trick is in knowing which brands are good at what and using them based on their strengths. For example RiData? Make damned good DVD movie discs. they play in damned near anything and can take some abuse, great for those that have kiddies and need to backup their Spongebob whereas TDK and Memorex make pretty solid backups.

      I suppose I'll make the jump to BD in the spring, I gotta buy me a new full size case (my USB ports are finally failing on the front) along with a decently sized SSD before I switch over to BD. Tell me, how well do the burners hold up? Any recommendations? Because I go through a LOT of DVD burners and at $60 a pop I really don't feel like doing the same with BD burners. I've been lucky in that I got a guy that works for the city that brings me a ton of 2-3 year old office PCs I can scavenge DVD burners out of but at the shop I can easily burn a good 200+ DVDs in a month so I tend to wear drives out fast. I figure since so few here have BD I'll be keeping it strictly for my own backups but still I'd like to get a drive that is gonna last. any suggestions?

      --
      ACs don't waste your time replying, your posts are never seen by me.
    165. Re:Shyeah, right. by Dadoo · · Score: 1

      That's because computers at the time couldn't keep up with the drives (unless you really knew what you were doing). I read a bunch of old QIC tapes I have, a few years ago, on a relatively modern machine, and the drive only stopped at the ends of the tapes.

      --
      Sit, Ubuntu, sit. Good dog.
    166. Re:Shyeah, right. by stoatwblr · · Score: 1

      "I still have SDLT tapes that are still readable after 15 years."

      ASSUMING that you have a working SDLT drive.

      Lest you think I'm being facetious: I regularly have people show up in my office with 30+ year old open reel "archive tapes" that they want restored. The only place you'll find anything which can handle that is a specialist archivist outfit and they'll charge $500-800/reel for the job because every pass on the equipment is that much closer to the date when it won't be repairable anymore.

      There are sound reasons for migrating your old archives to new media periodically.

    167. Re:Shyeah, right. by stoatwblr · · Score: 1

      "Obviously, these are Taiyo Yuden archival grade discs, not cheap rubbish, but not terribly expensive either"

      Anything based on pthalocyanin should stand the test of time if not left in sunlight or in high temperatures.

      Unfortunately NASA usually used cheap and nasty stuff for data distribution, so we achieve a success rate of "only" 98% on 20-year old CD-Rs.

      If you want "archival" bluray/dvd then the only material worth considering is M-disc (but that's not cheap) and you're left with the problem of readers - the BBC domesday disc (1980s laserdisc and reader attached to a BBC micro) was not only in a proprietary data format but working laserdisc players became scarcer than hen's teeth in the 1990s. The discs themselves are still perfectly readable - but they're no use whatsoever if nothing can read them.

      DVD drives are becoming less common on computers and Bluray never really took off as a data storage format.

      If you want long term storage that can guarantee readability in the future there's a lot of milage in punched cards or microfiche - but you do need a lot of them.

      The only long-term solution is to ensure your datasets are migrated to new media before the old media becomes unreadable and that's not just a factor of the longevity of the materials.

    168. Re:Shyeah, right. by stoatwblr · · Score: 1

      "In short, yes. LTO is dead whether it knows it yet or not."

      I have several Petabytes of data to curate. My experience with rotating media over the last 30 years is less happy than yours and over the last 3-4 years there's been a noticeable deterioration of drive manufacturing quality (which is probably why domestic drive warranties are now 12 months and enterprise moving towards 2 years)

      Tape still has a place and it's still an enterprise staple. It never really was that well suited to domestic/small business use anyway.

    169. Re:Shyeah, right. by stoatwblr · · Score: 1

      For home use: Don't bother with tape. Seriously.

      The only way anyone could justify tape for home use would be to club together and backup a whole bunch of sites across the Internet, like, say.... a cloud drive.

      Cloud storage might well be "putting your shit on someone else's computers", but 1: you can encrypt it and 2: you don't have to put it on just _one_ cloud vendor (in fact it's a good idea not to).

    170. Re:Shyeah, right. by stoatwblr · · Score: 1

      "With tape, the backup time can quite quickly become a bottleneck, so you end up needing a second jukebox."

      Why a second jukebox when you can just toss a second drive into the existing one?

      The bottlenecks are seldom tape speed anyway.

      The biggest holdup is the speed of disk arrays - an actively used mechanical array simply can't provide data to a LTO-4 or better drive fast enough to keep the thing 100% occupied. This is best dealt with by dumping the disks to a ssd array local to the tapes and then despooling from that (that ssd array costs as much as a tape drive by the way, but it can spool/despool at an aggregate 1200Mb/s without seek penalties so it feeds a dozen tape drives)

      Network speed is a lesser bottleneck. Have you priced up 100Gb/s kit recently?

    171. Re:Shyeah, right. by stoatwblr · · Score: 1

      "Ever back up a 3 TB hard drive at 300 kbps? "

      Are you in a 3rd world country or just the USA? I have 20Mb/s uplink speed and my ISP has just offered to double that if I renew my contract for 12 months. Gotta love a free market.

    172. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      Shut the fuck up.

    173. Re:Shyeah, right. by Anonymous Coward · · Score: 0

      You are a faggot.

    174. Re:Shyeah, right. by The+Snowman · · Score: 1

      I have two LG BD-R drives, but they are discontinued. Honestly I would just browse Amazon and read the reviews in-depth. There are some useless reviews out there but it is fairly easy to determine which products are good and bad based on the good reviews. I can say my older LG drives are still holding up just fine.

      I remember back when CD drives were new in PCs (back when the CD was connected to the SoundBlaster, not PATA or SATA). After a while the mechanicals would go and they would fail to seek. I remember old burners failing to burn after a while. Honestly, any drive I have bought in the last 10-15 years has lasted as long as the rest of the computer without any problems, including the two BD-R drives I use. That is probably a combination of technology improving and the fact that I do my research and find good quality drives.

      As to your SSD comment, they have improved quite a bit recently. I just bought a 512 GB for the same price as a 256 GB just two years prior. The quality and durability are improving as well. If you have been holding out making the switch, now is a good time and it will only get better.

      --
      24 beers in a case, 24 hours in a day. Coincidence? I think not!
  3. Mounted on the ISS by nitehawk214 · · Score: 1

    That is why it is named Low Terran Orbit.

    --
    I'm a good cook. I'm a fantastic eater. - Steven Brust
  4. Everyone knows what LTO Tape is by Anonymous Coward · · Score: 0

    except me.

    And sorry, Google is broke on my PC I opened a help ticket

  5. its all about selling Autoloaders by Anonymous Coward · · Score: 0

    Its taken far too long to get the the larger sizes these small size jumps seems to be holding it back. on the Hard drive size you can get 10TB drives now, tapes are still stuck at 2.5TB. I expect to have 25TB tapes it seems to me they just wanna keep selling auto loaders

    1. Re:its all about selling Autoloaders by jra · · Score: 4, Informative

      LTO-9 goes to 25TB/cart, LTO-10 goes to 48TB.

      Already announced.

      And wouldn't it be interesting to know if that study was based on cartridge count or capacity?

      Of *course* the cart count is going down, not *everyone's* data storage needs expand without bounds, and newer larger sizes imply some catch-up.

    2. Re:its all about selling Autoloaders by bored · · Score: 2

      The T10kd which came out over a year ago, puts 8.5TB uncompressed on a tape (reusing the previous generation's media no less). So, basically the vendors are holding LTO back for unspecified reasons, probably in a vain attempt to recoup the last generations investment, or maybe to boost sales of their "enterprise" drives (T10kd, 3592).

    3. Re:its all about selling Autoloaders by Anonymous Coward · · Score: 0

      But a linear regression would imply that if cars started holding ~2x more that sales would go down by 50% per cartridge... oh... wait...

    4. Re:its all about selling Autoloaders by Anonymous Coward · · Score: 0

      Or, maybe, they don't work well.

      I remember Exabytes with sad amusement. Dense, useful drives, but it turned out that for the first 2 years of their sales, the el cheapo video tapes worked as well as the rated digital tapes, for 1/10 the price. Plus, the dipsticks failed to put in an "end-of-tape" protocol, so if you wanted to put something at the end of the tape, you had to check *each job written to the tape* to see if it was valid, find the last valid one, go the end of *that* write, and start writing again. It made re-using a tape take easily 10 times as long just to start as it should have, especially if you had a lot of small writes to the tape.

      I wonder what bonehead move they made with LTO this time.....

    5. Re:its all about selling Autoloaders by Kjella · · Score: 1

      LTO-9 goes to 25TB/cart, LTO-10 goes to 48TB. Already announced.

      As "announced" as Intel's roadmaps saying they'll reach 5nm or whatever, near as I can tell no LTO-7 or LTO-8 drives exist much less LTO-9 or LTO-10 and usually there's 2-3 years between generations so this is guesswork for 2020-2025 or so.

      --
      Live today, because you never know what tomorrow brings
    6. Re:its all about selling Autoloaders by Anonymous Coward · · Score: 0

      As always, there is a cost per GB that comes into play. If you add up tape drives and tapes to fit your GB reqs, as compared to even redundant sets of drives... your choice becomes clear. Especially if you need nearline or online storage and the staff/changers to handle it all and/or the electricity to power it. In some cases tape wins, in some cases disk wins. There's no easy metric.

    7. Re:its all about selling Autoloaders by Cramer · · Score: 1

      From the very origins of LTO... magnetic tracking marks, just like a hard drive, and floppies before that. If the servo tracking data is ever damaged or unreadable, the tape (and your data) is trash. No LTO drive ever sold can "format" a tape.

      (Yes, it makes tapes cheap to manufacture. But above all, it means not paying Quantum for their patented laser optical tracking tech -- DLT has physical tracking marks on the back of the tape.)

    8. Re:its all about selling Autoloaders by Anonymous Coward · · Score: 0

      Thank you...

    9. Re:its all about selling Autoloaders by Anonymous Coward · · Score: 0

      LTO-9 goes to 25TB/cart, LTO-10 goes to 48TB.

      Already announced.

      And wouldn't it be interesting to know if that study was based on cartridge count or capacity?

      Of *course* the cart count is going down, not *everyone's* data storage needs expand without bounds, and newer larger sizes imply some catch-up.

      Bigger is not always better. In the land of backup, it is *speed* that counts the most.

    10. Re:its all about selling Autoloaders by sribe · · Score: 1

      Already announced.

      So?

    11. Re:its all about selling Autoloaders by bored · · Score: 1

      I use LTO3-6 all the time, they are pretty bullet proof. I can't remember the last time there was an actual hardware problem. All the tape problems I've had over the last few years have been PEBCAK, or should that be PEBCAL(ibrary).

      LTO and modern tape aren't like the old ones (1990 and earlier) with dropped leaders, read errors, etc. Besides, running at many hundreds of MB/sec per drive, they have layers and layers of ECC, embedded servo tracks, etc ,etc. All the reliability engineering you expect from modern hardware. Also, while your vendors will cringe if you drop them on the floor, I've actually thrown them around, cracked the cases, etc and the data is still recoverable, heck fingerprints on the media are even tolerated.

      Its just to bad that they are dragging their feet coming out with new generations cause its a fantastic way to take a snapshot, and bury it somewhere in case of disaster.

  6. The magnitude of Tape:HDD difference is shrinking by damn_registrars · · Score: 1

    For some time the tapes that were readily available had a huge capacity advantage over hard drives. That advantage is quickly shrinking. While there is still an edge in cost-per-TB for tape, that is decaying quickly as well. If tape can't reestablish that advantage we might see LTO and any other remaining formats go the way of the dodo while data centers change to spinning HDDs or even SSDs as the price of the latter continues to come down (while its long-term reliability goes up).

    --
    Damn_registrars has no butt-hole. Damn_registrars has no use for a butt-hole.
  7. Re:The magnitude of Tape:HDD difference is shrinki by jra · · Score: 1

    I'm not sure I buy this argument; it seems to me to be based on too narrow a view of the universe of different use cases.

    I certainly haven't seen *all* of them myself, but in general, I've seen enough to be skeptical of "tape can't do it arguments.

    And LTO-10 is 48TB/cart. Uncompressed, I assume.

  8. maybe not... by O('_')O_Bush · · Score: 1

    Tape sales have dropped in half, but tape capacity has increased 3-fold in the same time.

    I would imagine that those who were using more than 1 tape 6 years ago to do their backups would require fewer tapes now to do the same job.

    Maybe their niche is still rock solid (albeit stagnant), but technological development of the product has reduced demand.

    --
    while(1) attack(People.Sandy);
    1. Re:maybe not... by sudo · · Score: 1

      Smaller companies are opting out of tape because of the perceived high cost of an automated tape library.
      And you are right about less tapes being used, but you are seeing more intelligent backup software that does does perpetual incrementals and de-dupe, keeping the cost of media down.Short-term backups are also being kept on disk (e.g. less than 30 days) and the longer term ones to tape. This means the likelyhood of restore comes from the faster disk.

    2. Re:maybe not... by Anonymous Coward · · Score: 0

      Yup. I just had my LTO3 library go end of support (well, 12 months ago). I researched my options, including both a local vendors disk backup and Amazons, gave a few vendors the opportunity to give me left field solution. Result? New LTO6 library, and a hundred LTO5 tapes. The LTO5 tapes allow me to do all individual jobs to one tape instead of the two I was using on LTO3, so my media volume has dropped by that reported 50% too. New library extremely fast, and LTO3 was already enough for me. The datas coming from a 48 spindle / E-SSD enabled V7000 so I think my bottleneck (not that it matters) is now my 4GB FC ;) I like tape again, before I assumed I'd be shown it made sense to move away.

    3. Re:maybe not... by Chris+Mattern · · Score: 1

      Tape sales have dropped in half, but tape capacity has increased 3-fold in the same time.

      I would imagine that those who were using more than 1 tape 6 years ago to do their backups would require fewer tapes now to do the same job.

      Nope. Because in six years, their backup volume has increased 5-fold. That's how much disk capacity has increased in past 6 years.

  9. LTO not going anywhere by Anonymous Coward · · Score: 1

    posting as AC since I don't have an account, posted only maybe 6 times in past decade

    http://h30507.www3.hp.com/t5/Around-the-Storage-Block-Blog/Where-is-tape-media-headed/ba-p/167540#.VHU3svGzvns

    6,400 Petabytes of tape shipped in first quarter of 2014 (for the industry) -- an all time record -- and 24% year over year growth.

    Perhaps individual tape sales are down, but tape sizes are of course up, so capacity shipments continue to grow.

    I plan to deploy tape at my company next year. We have offsite backups already(dedupe'd etc), I want offline backups next.

  10. Eventually tape will die by sansprivacy · · Score: 1

    Maybe LTO the spec will be superseded and taken over by a next gen cartridge technology, but the medium is still cheaper than disk today. This is going to change in 10-20 years, but you're still going to have legacy systems sticking around after that for 10 years. Today, for keeping petabytes of data secure/resilient long term tape is the cheaper solution.

  11. Re:maybe not not... by Anonymous Coward · · Score: 0

    No, what you are seeing is less backups.

    Stuff being moved to the 'cloud' and backup is someone else's problem - except - it isn't.

    A couple of good disasters with 'an unforseeable combination of circumstances' :) wiping out a bank or simillar and tape sales will increase again.

  12. Tape Culture Fallacy by daive · · Score: 5, Insightful

    I'm a fan of tape backup when managed responsibly, but there's a fallacy that goes with recommending tape for backups: because you can train semitechnical users to dutifully change tapes and carry them offsite (e.g. on a bank run to a safe deposit box), tape gets recommended for businesses who don't have dedicated IT. But the duty of of maintaining the backup gets delegated from the original trained user, and changing the tapes becomes the whole of the backup maintenance: no one actually verifies that the backup job is running properly. I've been on calls to clients who've diligently changes their tapes nightly, but the backup software has been crashed for months...

    1. Re:Tape Culture Fallacy by Anonymous Coward · · Score: 0

      I'm a fan of tape backup when managed responsibly, but there's a fallacy that goes with recommending tape for backups: because you can train semitechnical users to dutifully change tapes and carry them offsite (e.g. on a bank run to a safe deposit box), tape gets recommended for businesses who don't have dedicated IT. But the duty of of maintaining the backup gets delegated from the original trained user, and changing the tapes becomes the whole of the backup maintenance: no one actually verifies that the backup job is running properly. I've been on calls to clients who've diligently changes their tapes nightly, but the backup software has been crashed for months...

      Sounds like you should be fired, to me.

    2. Re:Tape Culture Fallacy by Anonymous Coward · · Score: 0

      That's brain dead stupid to not even monitor the tape backup job. A close runner-up is never checking to see that your backup tapes can actually be restored. Worked at a company that dutifully bvacked up their data nightly. One day there was a catastrophic failure of the file server, so out came the backup tapes. It was at that point, they found that 2 years of tapes were corrupted because the RAM on the backup system was bad.

    3. Re:Tape Culture Fallacy by daive · · Score: 1

      Agreed, restore check is essential, whatever the backup method, and my employer offers that as a managed service. But it's also hard to convince a non-technical, small business client to invest in best practice, unless they've already experienced a disaster first hand...

    4. Re:Tape Culture Fallacy by fnj · · Score: 1

      It would have to be a pretty rigorous, file-compare-before-and-after, restore check, because just verifying that they read back without any read error would not detect backups that were perfect copies of data that was sitting corrupted in the backup server's RAM.

    5. Re:Tape Culture Fallacy by Sqr(twg) · · Score: 1

      If the file server uses a file system with checksums, and those checksums are also backed up, then it's a simple matter of reading through the tape and verifying the checksums. You don't need to compare to the original files.

      (The probability of a corrupted backup server accidentally creating a correct checksum can be made arbitrarily small. Usually it's something like 2^-256.)

    6. Re:Tape Culture Fallacy by ToasterMonkey · · Score: 1

      I'm a fan of tape backup when managed responsibly, but there's a fallacy that goes with recommending tape for backups: because you can train semitechnical users to dutifully change tapes and carry them offsite (e.g. on a bank run to a safe deposit box), tape gets recommended for businesses who don't have dedicated IT. But the duty of of maintaining the backup gets delegated from the original trained user, and changing the tapes becomes the whole of the backup maintenance: no one actually verifies that the backup job is running properly. I've been on calls to clients who've diligently changes their tapes nightly, but the backup software has been crashed for months...

      This is not a tape problem, it's a very common backup system problem, regardless of the design. Backups are an insurance policy people let lapse and try to make claims on later.

    7. Re:Tape Culture Fallacy by donaldm · · Score: 1

      I've been on calls to clients who've diligently changes their tapes nightly, but the backup software has been crashed for months...

      I have seen this also on a Unix system with a script that diligently backed up the database infrastructure however the script actually forgot to backup the database. Needless to say when the data disk (it wasn't even mirrored or RAID'ed) died they lost all their data and it cost the small company tens of thousands of dollars to fix the issue.

      When I asked if they tested the backups for recovery the manager replied that the person who wrote the script was highly recommended, it was all I could do to suppress my laughter. The only thing I could do was to stop the Clerical Assistant (female, who was in tears) from getting the sack since it wasn't her fault since she did not know what to look for. All she knew was the backup had completed without errors which it had.

      To compound the issue I asked for the system backup tapes since the overall system and data wasn't that big and would fit on their system backup tapes of which the script had been written to backup everything. I was then was informed that of the two tapes that they used (that was all they used) one had failed which rendered the system backups useless. On that note all I could do was give up and wish them luck since I was only doing this as a curtsey and was not getting paid.

      --
      There ain't no such thing as proprietary standards only proprietary formats. Standards are by definition open.
    8. Re:Tape Culture Fallacy by donaldm · · Score: 1

      Sounds like you should be fired, to me.

      Why do you say that the person who was accounting the story was not the one who was responsible for the disaster.

      --
      There ain't no such thing as proprietary standards only proprietary formats. Standards are by definition open.
    9. Re:Tape Culture Fallacy by donaldm · · Score: 1

      Agreed, restore check is essential, whatever the backup method, and my employer offers that as a managed service. But it's also hard to convince a non-technical, small business client to invest in best practice, unless they've already experienced a disaster first hand.

      It is normally impassible due to time constraints to do a restore check after every backup. Even if time does permit you are going to effectively reduce the life of the tape by a half. What is important is to initially set-up and confirm that the appropriate backups work and can be recovered. Once this is done you can be fairly confident that backups are going to work (checking logs is important) however you must perform test recoveries to machines that can be made available for testing purposes on a regular basis as outlined in the company IT disaster recovery plan.

      Don't have a company IT disaster recovery plan? Then you as the consultant or IT manager better arrange to have one implemented.

      --
      There ain't no such thing as proprietary standards only proprietary formats. Standards are by definition open.
    10. Re:Tape Culture Fallacy by Anonymous Coward · · Score: 0

      Sounds like you should learn to fucking read.

    11. Re:Tape Culture Fallacy by Anne+Thwacks · · Score: 2
      It is normally impassible due to time constraints to do a restore check after every backup.

      I thnn you mean "impossible",

      You dont need to check restore after every backup, but you most certainly need to do it quarterly, after every OS upgrade, and probably any time hardware is modded/reconfigured, or tampered with.

      DO NOT USE PROPRIETRY BACKUP SOFTWARE FOR ARCHIVE - EVER! When you want the data back, the company will be dead and buried, and any documentation of the tape format will not relate to the version you were using. I used to work for a company that made popular tape backup software (it was very fast). For 8 months the restore function was seriously defective and not a single customer reported it. (OK, it was in the days of QIC02).

      If the data has any long term value, use tar. Tar from RSX11 days is still readable on FreeBSD - I have tried it. Not using Unix? It is safe to assume you don't need the data anyway!

      --
      Sent from my ASR33 using ASCII
    12. Re:Tape Culture Fallacy by urbanriot · · Score: 1

      Why would you not set the backup task to automatically print the log summary on the closest printer to the user each day?

    13. Re:Tape Culture Fallacy by Baki · · Score: 1

      At my first employer we had exactly this situation. The secretary used to change the backup tapes on the server. We, as a team of 10 developers had been working around 6 months developing software modules when we got a crash. It turned out the backups had been made on cleaning tapes.

      This was in 1992, noone had the opportunity to make multiple copies, we only had our disk and the backup. 60 man months of work gone.

  13. I would buy... by Crass+Spektakel · · Score: 1

    From 1981 to 2011 I have been using Tape Backups for my private, business and customer systems. It was cheap, reliable and fast, my first drive had 5MB with a transferrate of 20KB/s, my last drive hat 200GB with a transfer rate of 30MB/s.

    But no more.

    Drives are fucking expensive (and they die a lot), media are fucking expensive (and are no better than other media),

    Lets say I could buy a drive with 2TB for â200 and a 2TB media for â10 or a 10TB for â500 and a 10TB media for â50 then I would at least consider using tape again.

    But right now I pay â1600 for a 2TB drive and â40 for a 2TB catridge. Thats insane, I can buy 60TB of hard disk storage just for the drive alone and get another 2TB cheaper than buying tapes.

    And trust me, hard drive stored in a dark, locked box will work even better than tapes.

    --
    "Life is short and in most cases it ends with death." Sir Sinclair
    1. Re: I would buy... by Anonymous Coward · · Score: 0

      LTO6 is $40/6TB compressed.
      4TB hdd is $130.
      2TB hdd is $80.

      The numbers match what you would like to see.

      I don't follow your post.

    2. Re: I would buy... by iluvcapra · · Score: 2

      It's the LTO drive itself that kills you, the drive and the SCSI card will set you back a couple $K to start.

      It starts to make sense once the "backup bandwidth", the frequency of backups times the size of the archive, exceeds a couple TB/week, but it just makes no sense to spend $2K to keep a backup of $500 worth of drives, particularly in a situation where you just don't need to have the weekly tapes from two years ago and the last working tree is the only one worth keeping.

      If you take the MTBF for a large hard drive, the averaged cost of failure per year might be like $50 per TB per year. (Total POOMA numbers, but it's probably the right order of magnitude.) HDDs have low fixed costs but a higher cost per gig, tapes have a much higher fixed cost but lower cost per gig, so wether one or the other is more economic depends on how much you're backing up, the level of reliability you need, so many different factors.

      --
      Don't blame me, I voted for Baltar.
    3. Re: I would buy... by fnj · · Score: 1

      LTO6 is $40/6TB compressed.

      So that's really $40/2.5TB in the real world. Who has large amounts of data that is compressible? NOBODY.

    4. Re: I would buy... by ls671 · · Score: 1

      LTO6 is $40/6TB compressed.
      4TB hdd is $130.
      2TB hdd is $80.

      The numbers match what you would like to see.

      I don't follow your post.

      Given the post you replied to, you must mean:
      LTO6 is â40/6TB compressed.
      4TB hdd is â130.
      2TB hdd is â80.

      --
      Everything I write is lies, read between the lines.
    5. Re: I would buy... by Anonymous Coward · · Score: 0

      LTO6 is $40/6TB compressed.

      So that's really $40/2.5TB in the real world. Who has large amounts of data that is compressible? NOBODY.

      Not everyone hoards videos, images and mp3s. Most business data you are required to keep has a real nice compression ratio (up to 10:1).

    6. Re: I would buy... by drinkypoo · · Score: 1

      It's the LTO drive itself that kills you, the drive and the SCSI card will set you back a couple $K to start.

      Who doesn't have a bunch of Adaptec SCSI cards lying around, though? Only total newbie IT orgs. shit, I'm just a hobbyist, and I have a u160 card I'm not using. Maybe someday I'll install it so I can use my slide scanner.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    7. Re: I would buy... by Anonymous Coward · · Score: 0

      I back up many TBs of completely non compressible data to LTO5 - it's making permanent bacckups of the Veeam system for compliance purposes. We export the tapes to Iron Mountain once a week and hope to never see them again.

      The data has already been compressed and deduped, so I get 1.5TB per cartridge and not a byte more.

    8. Re: I would buy... by dgatwood · · Score: 1

      Most real-world data doesn't compress these days. LTO-6 is $40 for 2.5 TB.

      The GP wanted to be able to buy a tape drive capable of holding 2.5 TB per tape for $200 (currently ~$2,500–3000), and $5 per terabyte (currently $16) for the tapes.

      So no, the numbers don't match what the GP would like to see.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    9. Re: I would buy... by ToasterMonkey · · Score: 1

      LTO6 is $40/6TB compressed.

      So that's really $40/2.5TB in the real world. Who has large amounts of data that is compressible? NOBODY.

      Unless you're sitting on a mountain of pictures or video, you probably do.

      Now I understand picture and video archives exist, but that's not the norm.

  14. A bit of wisdom by lucm · · Score: 1

    "Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway."
    -Andrew S. Tanenbaum

    --
    lucm, indeed.
    1. Re:A bit of wisdom by iluvcapra · · Score: 1

      Never underestimate the latency of your archive room attempting to restore a station wagon full of tapes...

      --
      Don't blame me, I voted for Baltar.
    2. Re:A bit of wisdom by freelunch · · Score: 1

      Never underestimate the bandwidth of a beowulf cluster of self-driving station wagons full of tapes hurtling down the highway.

    3. Re:A bit of wisdom by lucm · · Score: 1

      Do you work for Amazon Glacier?

      --
      lucm, indeed.
    4. Re:A bit of wisdom by Anonymous Coward · · Score: 0

      After dealing with our disk-based backup system (we decided to use disk with archive to tape once a year)

      Time taken for a years worth of disk snapshots to be exported to an 'archive' file to so it can be stored externally from the backup software: 6 Days exactly (going from one SAS DAS to another, both on dedicated HW RAID controllers with 2 SAS connections)

      Time taken for the archive file to be written to LTO6 iSCSI library from same archive SAS DAS volume: 6 Days and 2 hours

      Disk and Tape are the exact same speed. (and only one of those doesn't require power, cooling, to be maintained/upgraded, or valuable rack space)

    5. Re:A bit of wisdom by Anne+Thwacks · · Score: 1
      Never under-estimate the price of a 1/2" tape from Andrew S Tanebaum.

      If they had been cheaper, I would have been using Unix three years earlier!

      Never under-estimate the disaster of a station wagon full of LTO6 tapes hurtling down the Grand Canyon! (I said that).

      (Or major Glacier down time, just when you need it).

      --
      Sent from my ASR33 using ASCII
    6. Re:A bit of wisdom by scsirob · · Score: 1

      .. and the only reason they are the same speed is because it's your source that determines the limit, not the destination. A decent LTO-6 tape drive will outpace any set of harddisks behind regular RAID controllers.

      --
      To Terminate, or not to Terminate, that's the question - SCSIROB
  15. BAD idea. HDD's die when stored by Anonymous Coward · · Score: 1

    Multiple times I've taken an HDD out of service and later (like 1 year later, not decades) tried to spin it up again and had it fail. HDD's suck for offline storage. You have to keep them spinning and also back up their contents to other drives, which sort of defeats the purpose of using them as a backup medium. The main problem with tape is, as you say, that it's too damn expensive, especially for the drives. But a vault full of tapes is likely to be far more reliable than a vault full of powered-off HDD's.

  16. So how is the price... by jopsen · · Score: 1

    LTO-9 goes to 25TB/cart, LTO-10 goes to 48TB.

    So comparing this to AWS glacier, at 0.01 USD/GB, that is 480 USD for 48 TB...
    Probably still an advantage to tapes... but how close it?

    1. Re:So how is the price... by Rob+Riggs · · Score: 5, Interesting

      When measuring the cost of backups, the cost of the media is often a small footnote. The cost of off-site storage can end up costing way more depending on how frequently they pick up, how long you store the tapes, and how frequently you need to do emergency restores.. Note that you left off the "time" component of the AWS cost structure -- the cost is *per month*. Still, AWS has some serious advantages over tape -- like the cost of robotic tape drives and the housing and maintenance costs that go along with them (if you have that sort of need). Plus, if you are a big enough customer, those 1 cent/GB/mo costs go down quite a bit.

      --
      the growth in cynicism and rebellion has not been without cause
    2. Re:So how is the price... by Anonymous Coward · · Score: 0

      if you're paying market rate, (~60$/tape) and your bandwidth is free, glacier is pretty damn competitive especially if you consider the cost of the tape library and drives itself.

      in reality, you're probably limited by bandwidth costs and transfer speed, so tape still win out (500 MB/s ? or so. you need to be really careful about staging so you can keep feeding it data as fast as possible!).

      i have a spreadsheet i made from last year somewhere that had the breakeven point around 50TB of backed up data (higher being an advantage to tape), compared to HDD. compared to glacier.. no idea. and it wasn't using market rate so the true breakeven is probably much higher than that

    3. Re: So how is the price... by Anonymous Coward · · Score: 0

      It's the restore cost. I couldn't afford to restore from the cloud. Sending them your data is cheap. Getting it back is not so cheap.

    4. Re: So how is the price... by Anonymous Coward · · Score: 0

      Per month, every month, forever.
      It's an ever growing pool of money sent to the cloud.

    5. Re:So how is the price... by Pentium100 · · Score: 1

      Is that 480USD/month or a one time cost? Last time I bought tapes, I did not have to sign a contract saying that now I'll be paying for them every month. Bought, paid for them, do not have to pay any more.

    6. Re:So how is the price... by mr_da3m0n · · Score: 1

      No, you instead get a contract with something like iron mountain to move them off site.

    7. Re:So how is the price... by Pentium100 · · Score: 1

      Or I just put them in the trunk of my car and carry them home or wherever.
      If somebody nukes my whole city, I most likely won't care anymore about the data.

    8. Re:So how is the price... by scsirob · · Score: 1

      Ask AWS for a quote to restore those 48TB. No really, please so. And then come back and tell us how the math worked out.

      Some of our customers had calculated that AWS and tape were on par from a storage perspective. AWS perhaps even a bit cheaper. But any and all benefit is gone the instant they needed to restore anything substantial. Think multiples of $10K...

      --
      To Terminate, or not to Terminate, that's the question - SCSIROB
    9. Re:So how is the price... by Slashdot+Parent · · Score: 2

      AWS perhaps even a bit cheaper. But any and all benefit is gone the instant they needed to restore anything substantial.

      What counts as substantial? Pulling a number out of my ass, but 1/4 of all of your data?

      To do this, you'd basically want to overnight to AWS some HDDs and restore your data to S3 while your HDDs are on the way to AWS. Charges:

      Restore 12TB of data in a day from Glacier: ~$3600
      Handling fees on 3 external HDDs: $240
      Data loading: $100, or so. This is for eSATA.
      Shipping: Figure, what, $75 or so?

      So to retrieve 12TB from glacier in 3 business days, you're looking in the $4000 range. I've never actually done this, but I'm calculating 3 days as 1 day to get the drives to AWS, AWS loads your data that day, and then returns the drives to you via 2 day return shipping.

      Note that this cost goes down significantly if you don't need the data so quickly. If you can restore the data from Glacer over a period of a week, the restore portion (line 1 above) will cost only $500 instead of $3600.

      I'll grant you that all of the above are still pretty big numbers, but they certainly are not multiples of $10k.

      All that being said, if you ever have to restore so much data from Glacier, either your business has suffered a serious disaster, in which case spending $4000 to get your data back is probably not a big deal, or you are not using Glacier as it was intended. I.e. you don't load today's backups into Glacier. You archive one of last year's backup snapshots into Glacier. Glacier is for data that you never want to see again, but may be forced to see again for some reason.

      An example use of Glacier: a relative of mine is a retired doctor who kept his office space only for medical records storage in case he got sued at some point in the future over something and needed to get a record back. I told him he could save a ton of money if he got those records scanned and archived to the cloud. Together, we found a company that would scan all of the 35+ years worth of records, organize them, encrypt them, store them in Glacier, and shred the originals. I forget what the $ worked out to, but it was a huge savings. He'll probably never get sued and will probably never need those records again, but if he does, he can still get what he needs.

      --
      They don't grade fathers, but if your daughter's a stripper, you fucked up. --Chris Rock
    10. Re: So how is the price... by Anonymous Coward · · Score: 0

      The cost to upload from the cloud back to your datacenter is about 2 months of storage costs. About $5/month for 100GB of storage and about $10 for 100GB of upload bandwidth. That must be some high quality bandwidth, crazy expensive. I know, not really "bandwidth".

  17. Value for money by Anonymous Coward · · Score: 0

    Suppose you have 12TB to backup.
      $1600 for a 2TB drive and $40 for a 2TB catridge. = $1720
    3x4TB drives = $390
    Tape isn't in the ballpark. And, the tape drives fail more often than disks. O.K. if you have hundreds of TB that changes, but small office 12TB would be enough, particularly if you don't archive the cat videos.

    1. Re: Value for money by afidel · · Score: 1

      Now backup that dataset weekly for two months, tape wins easily. Even without the need for archives a minimal useful backup strategy favors tape.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    2. Re: Value for money by Anonymous Coward · · Score: 0

      Math fail.

    3. Re:Value for money by Anonymous Coward · · Score: 0

      In my opinion, it depends. My company has about 250TB we protect. We do as a minimum, daily backups of unstructured data, MS Exchange, and MS SQL. We have a retention of 90 days. We were going to tape through large Storagetek automated libraries for years and it was cost effective but our SLA's were getting longer and longer for backups and restores.

      Where disk/cloud as a target started to become a better option for us was when backup software like Avamar and Commvault started getting better with dedupe and compression. There are no more "full" backups where the backup software goes through the entire file system and writes off all data on that file system to make a full. With diask based backups, all backup data is broken down into chunks and only the differences are stored on disk. Fulls and individual files are "recreated" through the software. We can back up a 5 TB file system daily and have 90 individual points in time instantly recoverable and only take up 2-6 TB of actual disk space on the backup system depending on the dedupe and compression. We send a second copy of those backups to cloud storage or to another one of our sites over the WAN/Internet and the actual amount of data transferred may only be a 1 or 2 GB a day maximum. The reason why is all data is compressed and deduped at the source. This has greatly cut down on our backup and restore times, puts less load on our systems, reduced our WAN bandwidth, got rid of people slinging tapes and the cost of robotic libraries and Recall or Iron Mountain offsite storage and transportation costs.

      Now.. if our retention was one year, more than a year? Offloading jobs over 30-90 days to tape may still have made sense but that could happen at a central remote site where the copy is so we would not need Iron Mountain to get them offsite and would reduce the amount of libraries we had. That system could run all day and it would not effect the production systems or our SLA.

    4. Re:Value for money by Anonymous Coward · · Score: 0

      Sorry, a little more

      So our backup looks like this

      Local office NAS storage (7 days retention) --> copy to remote site NAS (90 days retention) --> copy to tape or cloud if needed (90 days+ retention)

      Local office to a cheap low cost NAS, this NAS typically stores at least 7 days worth of backups but really depends on its size. Multiple times through the day any new backups on the local NAS get replicated to a remote site. Worst case is if the local NAS fails, you only lose data that had not yet replicated which is minimal and the live system is still there running so no actual loss of data. The remote site holds the full 90 days. In our situation, that remote site collects backups from 15 different offices and the office it is in so it is a large enterprise level NAS device, still relatively cheap at about $500 USD per usable TB. You can get fully supported bulk storage NAS devices much cheaper in the $150-200 per usable TB range or roll your own even cheaper than that but with some increased risks. You have to make that call. If we needed more than 90 days or we were running low on space at the central site, we would write to tape. That tape library can be "smaller" since it is not handling daily load and restores and in theory you would have an entire week to write off your stuff exceeded the 90 days.

      People using rsync and tar or writing things to optical disk or portable hard drives is cool and all but that is not going to work in an enterprise. What is your plan for data retention and destruction of old data? What do you do if you had a discovery request and you have a bunch of random CD's and hard drives laying around with old backup data on them you thought you should not have any more? Shred it after the fact? How long does it take someone to find the data you have and to restore it? Keeping old backups around with no plan on retention seems like you are helping out the company but from a legal perspective, you have a huge potential to hurt them.

    5. Re: Value for money by unrtst · · Score: 1

      Now backup that dataset weekly for two months, tape wins easily. Even without the need for archives a minimal useful backup strategy favors tape.

      This can be done if plan it correctly for the medium of choice. If you're doing full snapshot backups weekly, you're rigging the game for tape to win.

      Just one example that can work and achieve similar or greater levels data integrity and more fine grained backups (ex. daily):

      * BackupPC server
      * two external raid arrays (cheap-ish USB or ESATA things with JBOD and software raid)
      * take one offsite
      * do backups on the other
      * swap periodically (weekly, per your requirement)

      It'll use far less storage space due to file level dedupe and compression, so you don't actually need the same amount of raw storage space.
      Availability is faster, especially for random file restores.
      You can do far more frequent backups.
      Total cost will be less.

      Granted, while they're both backups, they have some fundamental differences. BackupPC, for example, is not suited to doing bare metal restores. That's not it's purpose though, and what it does do, it does very well (as do similar commercial products).

      Tape wins easily given specific requirements that favor it, and those requirements may be justified. However, for a very large amount of backup needs, even in the enterprise, disk can win in many ways. There are really way to many factors to just say one is best, and there's a lot of middle ground where a blend of the two is better, or either-or may be fine. When you add in the cloud (ex. Amazon Glacier), it makes it really easy to consider dropping tape from the mix.

  18. Offsite storage farms by Webmoth · · Score: 2

    Tape media's greatest benefit is its long storage life. Providing you have the equipment to do it, you could read a tape created 25 years ago.

    Tape media's greatest liability is its long storage life. Will you be able to find equipment to read it 25 years from now? If not, you have what we call write-only media.

    I think that tape is going to disappear as a viable storage medium, at least in the small business sector. The equipment and media is expensive, and most small businesses don't have the resources to employ someone trained in proper media management.

    The replacement is going to be offsite storage farms, whether from a third-party cloud provider, or farms owned by the company that needs the backups. As the per-byte cost of disk storage continually and rapidly falls and wide-area network (Internet) bandwidth increases, offsite/online backups are becoming more and more feasible. Data deduplication and image management software technologies mean that a company can have daily backups completely automated and available as far back as they want. Restoring a file or two from these backups is quick and easy. My company already supports several small businesses using this backup technology; as existing tape drives fail they are seldom being replaced with more tape hardware.

    The downside of offsite/online backups is that bare-metal recovery of a failed system from those backups is still extremely time-consuming. Eventually the bandwidth will become available to make it viable; until then tape still seems to be the best option for bare-metal recovery.

    --
    Give me my freedom, and I'll take care of my own security, thank you.
    1. Re:Offsite storage farms by Anonymous Coward · · Score: 0

      > Tape media's greatest benefit is its long storage life. Providing you have the equipment to do it, you could read a tape created 25 years ago.

      It's also resistant to being accidentally written: set the little tab to "read-only", and your tapes resist stupidities that "oh, just log in as root, we all know what we're doing!!!" admins simply don't believe in. Been there, done that, saved a year of work because I was paranoid and had backup of the "temporary" storage when some twit deleted it all.

      I also got to recover NASA data from the Pluto occultation photographs, because I had the only tape drive left in the state that could still read the old low density 1/2" mag tape media.

  19. Shyeah, right indeed by Anonymous Coward · · Score: 0

    In 1996 I had a 40 MB QIC-80 tape drive ( and every time I tried to restore from it, the tape was corrupt even though it had recently verified just fine ). Do you *really* think that your $4000 LTO drive you got in the last 5 years can still read that thing? I don't think so. SCSI interface? You mean 5 MHz SCSI-1? They haven't made cards compatible with that for over a decade.

    On the other hand, my blue ray optical drive still reads CD-R media from 1996.

    If you are planning on retaining data for that long, you are an idiot if you plan on keeping it on the original media the whole time. You periodically verify the backups and migrate them to new media as technology marches on.

    1. Re:Shyeah, right indeed by Pentium100 · · Score: 1

      Do you *really* think that your $4000 LTO drive you got in the last 5 years can still read that thing?

      My LTO-2 drive can read tapes recorded 5 years a go just fine. The cartridges themselves are older than 5 years though (bough them used).

      SCSI interface? You mean 5 MHz SCSI-1? They haven't made cards compatible with that for over a decade.

      With the exception of HVD, the latest and greatest Ultra320 SCSI is fully backwards compatible with 5MHz SCSI-1. I can connect an old device to a new HBA (need the connector adapter from 68 to 50 pins) as well as connect a U320 LVD device to the 5MHz HBA (still have one).

      And my Verbatim brand CD-Rs recorded in around 2000 read with multiple errors. A few audio CDs will not play on a computer, but play on a LD player with very distorted audio. One CD-R (a presumably low run legitimate recording I bought) does not play at all. Thankfully I have the same album on cassette, it plays perfectly. I should probably record a new CD from that cassette.

  20. Science by chuckymonkey · · Score: 2

    Working in climate science I can tell you that tape for us isn't going anywhere. Our investment gets larger in it every year, at least monetarily and capacity wise. Several of our groups have growth curves that scale linearly with the output of the supercomputers, meaning our growth is almost exponential. Most of this data is static and doesn't really change once it's been produced, but it does need to be read from time to time. There's no other solution out there that takes little to no power to store, no cooling, and can keep the data for years with minimal loss of integrity. We have data that goes back to the 1940's that we have to keep almost forever, this historical data is hugely important in how we create the models and cannot be lost. So we have to have somewhere to store all that data for the long haul, LTO is the medium of choice because it's vendor agnostic, fast enough, cheap, and large enough to handle what we need it to handle.

    --
    "Some books contain the machinery required to create and sustain universes."-Tycho
  21. fast access allows other uses, like instant compar by raymorris · · Score: 1

    That near-instant access also allows other uses. For example, when a small business client's web site is defaced or simply broken, I can run rsync --dry-run and tell them exactly which files have changed - in minutes, while they're still on the phone. I can restore the damaged files just as quickly.

    Tape has it's place, but online offsite backups, done right, have some very significant advantages too.

  22. magnetic tape? by Anonymous Coward · · Score: 0

    Huh? I've never seen one before. Guess I'll have to Google magnetic tape to see what it looks like.

  23. Re:The magnitude of Tape:HDD difference is shrinki by petermgreen · · Score: 1

    And LTO-10 is 48TB/cart. Uncompressed, I assume.

    Afaict the highest version of LTO you can actually buy is LTO-6 with a capacitity of 2.5TB. I consider it highly doubtful that LTO-10 is much more than a set of goals/desired specifications on a roadmap.

    --
    note: i'm known as plugwash most places but i screwd up registering that here somehow in the past and now can't register
  24. Hell NO! and WTF is wrong with moderation lately? by s.petry · · Score: 1

    Hang on, I'll get to the mod comment in a moment. First things first, which is a complete line of crap if you are dealing with medium to large amounts of data in your DR plan and have a long term requirement for DR. Keep in mind that the person you are responding to is talking about long term DR strategy that dates back decades.

    I'm not sure which world you are living in where 10 year old hard drives require less space than LTO, but this is not physically possible. Are you trying to claim that you are using today's higher density drives through a time warp, or that you really have no experience with legacy system DR and are only working with current technology? No matter how you slice it you are dishonest, so let me go with the first assumption. SSDs were available about 10 years ago, but there is no way anyone in a production environment used them for more than testing or highly disposable purposes. The sizes back then were the same or less than SCSI (256GB in "production" drives), reliability was atrocious, and quite honestly we banned them during testing because they lasted days maximum in our high performance compute environment where they could have been the most beneficial. The footprints for the drives were exactly that of SCSI, which is about 4 times the area of an LTO tape. Data per cubic inch did not compare, and this is simple math to check.

    So maybe you are not referring to SSD, maybe you are referring to Spindled disks from 10 years ago? If that is the case, please explain to us how you are shipping boxes of HDs off to Iron Mountain for safe keeping and ensuring that the heads are not damaged?

    Next, you are not doing much in terms of mass data DR with hard drives no matter which HDs you are using. I can buy an IBM 35xx with 8-32 read/write heads and 256 cartridges in the chassis. I can pull out LTO1 tapes from 15 years ago and read them natively and I can read and write faster than any hard drive on the market. Doing this with hard drives you are going to have to go to Ebay and hope like hell you can buy a JBOD/DAS device compatible with your drives, then hope like hell you can figure out how to import the sets if you are using something like VFS/VCS and not standard LVM. Good grief, it's not "easier" or "faster" by any stretch of the imagination unless you are responsible for very little data. Generally the people using LTO are backing up a good amount of data on average. We have 28 Petabytes on line. Probably only 5-6 Petabytes are backed up regularly, but go ahead and try this on your "removable hard drive" backup strategy.

    In other words, the only way your arguments can be valid is if you are responsible for very little data or perhaps you really don't have to worry about DR as you originally claimed. Many of us deal with Government contracts that require full scale DR, and many large businesses have similar requirements, and thes requirements include retention of 7+ years.

    Not counting legacy systems, we have been migrating some data to multi-site DR (not full DR) to save money. Plucking hard drives is _still_ a horrible idea even given the higher density newer drives. Retention on a removable HD does not, and can not match the lifespan for an LTO tape which is designed specifically for a long lifespan.

    Now to the point about moderation. I pointed this out the other day in a submission and a thread, moderation has been absolutely wretched lately. Nothing against this guys post getting moderated "Interesting" because it should generate comments. The person he responded to receives NO moderation and should be moderated as "insightful" since he is obviously involved in large scale DR. A whopping 2 posts have been moderated in this thread, and one contains wrong information for anyone curious about large scale DR.

    It's not the incorrect posts being moderate that's the problem, it's the lack of moderation on posts correcting bad information.. and the lack of moderation overall in the last week or so that is the problem. For the last week moderation has amounted to an explicit bias, of no benefit or incentive for progressive dialogue (which is the whole goddamn point of the moderation system).

    --

    -The wise argue that there are few absolutes, the fool argues that there are no probabilities.

  25. Get the date right, buckwheat ! by Anonymous Coward · · Score: 0

    That's the original Y2K problem

    You're defining a problem 2000 years in advance

    The original problem is known as The Conundrum of Y0K

  26. So how is the price... by Anonymous Coward · · Score: 0

    Said below but not, perhaps, as clearly as this.

    In a about year and a half (depending on how compressible your data is among other factors), your storage fees for the cloud equal tape. In a week, your restore fees exceed the cost of tape, libraries, drives and climate controlled storage fees once you start measuring your backups and restores in the tens or hundreds of terabytes.

  27. Google uses tape by Anonymous Coward · · Score: 0

    https://www.youtube.com/watch?v=eNliOm9NtCM

    If their software would be FLOSS tape would make sense for many more people (companies/institutions rather).

  28. Re:The magnitude of Tape:HDD difference is shrinki by donaldm · · Score: 1

    For some time the tapes that were readily available had a huge capacity advantage over hard drives. That advantage is quickly shrinking. While there is still an edge in cost-per-TB for tape, that is decaying quickly as well.

    That is not the point. The reason for doing backups is to recover data to a state before loss of data occurred be it deliberate or accidental.

    Sure you can get hard drives that you can can fit your data on however to do a proper backup you should send your backup media off-site. Doing backups onto a hard drive may be fine for home use, in fact I do this my self, however for business this is not a solution in fact it is a disaster waiting to happen since a hard drive (SSD or spinning disk) is an electronic device and a relatively fragile one at that, with more potential for failure than a tape which is a robust passive device.

    As an example say you want to backup a 25 TB of data how would you go about doing this and be able to go to your manager or even Board of Directors with a confidence factor of 99.999% reliability for recovery? OK I will make this easier, how do you backup 1TB of data and still be able to meet this reliability? While I am not going to answer since it would take up many pages of documentation (ie. IT disaster recovery) it must be said that backup solution consultants get paid quite a considerable amounts of money to make sure that a companies' data has very little chance of being lost.

    Even today with much larger capacity disks you still need reliable backup and recovery strategies and hard disks while they can assist (see Disk based Virtual Tape Library) are still not a total solution. Even "Remote IT Services" (aka "Da Cloud") still require a very high level of reliability so backup and recovery solutions are still very important and (if they are professional) they still use backup tapes.

    --
    There ain't no such thing as proprietary standards only proprietary formats. Standards are by definition open.
  29. Re:The magnitude of Tape:HDD difference is shrinki by Anonymous Coward · · Score: 0

    There's also the cost of powering the storage. Hard disks, you're either online or you're not; if you need to access the data, you need to make sure the disk is plugged in, switched on, and spinning. Tapes, you can rack 'em on a shelf in the library, and if you need to access the data, mount it in a tape drive with the robot.

    The ease of powering up a hard disk, versus loading up a tape cartridge, means that tape still wins - by a significant margin - on the power scale for nearline storage. And yes, nearline storage is still very much a thing in some industries.

  30. Tape is dead by ledow · · Score: 1

    Tape is dead in most small business already. There's just no point in it. Putting all your eggs in one tape-format basket means that when you have a fire, not only do you have to spend days getting your data back, you've also got to pay a small fortune for the machine that can do that (if those drives even exist any more).

    Extended NAS systems are what I see taking over from tape. Automatic network replication to a copy that then gets marked read-only, forwarded and verified to other NAS further down the line, etc. Offsite backup can be as simple as taking a NAS home for the smaller outfits, or mirroring to an off-site NAS or cloud storage.

    Sure, one NAS is not "backup" on its own. You don't want to be able to overwrite written data automatically, But if you have enough of them, they become very reliable at a cheaper pricepoint than handling tape backups. This means you can buy more of them, and buy "more" reliability.

    If your data is mirrored this way, in enough places on devices that don't automatically modify themselves to the very latest data, then you have backups. The old-farts of IT like to tell you otherwise, and bring up "RAID is not backup". But, sorry, at scale, and managed as such, it actually is. Especially when you have a RAID of RAIDs that you manage and cycle and secure properly

    And buying something of that scale is something that a small business can do much easier with spinning disks than they can with tape. For the cost of the last tape drive and initial tapes, I can buy half a dozen NAS devices of larger size that - in a pinch - I can run VM storage from directly (iSCSI, etc.) if I want.

    Restore times are better. Capacity is much better. The automation is much easier. Networking is so much easier. Restore is so much more "obvious" if your network guy suddenly dies.

    There are concerns, but so long as you are considering them, they are rarely barriers. Most places do not need to keep data for dozens and dozens of years, and offline retention for most drives is actually stupidly impressive. Those that do generally cycle backups onto new media anyway, so nothing's changed there.

    But drives are scaling SO MUCH faster than tape that it's stupendous. Hell, tape is often within range of SSD storage (not that I'd trust retention on that without a lot of redundant backups until the tech matures properly). And you can literally pop down to the local computer shop and buy a NAS that will backup your entire small business network - something you can't really do with tape. Do that a couple of times a year and you have a backup that's probably superior to whatever you had before.

    I work in schools. The previous school had tape but it was a "last resort" backup. We never restored from one in 5 years despite two server failures. Always, there was a NAS or even just a drive that had the data available which could get us up and running NOW, this second, rather than 8 hours down the line. By the end of that employment, we'd basically abandoned tape use as anything other than putting one in the fire safe next to the drive backups (which were mirrored to encrypted cloud storage). The IT audit I had when they were trying to justify pruning every member of staff? Couldn't find a fault in the backup strategy and was able to see more copies of the data than they actually believed necessary.

    The school I work for now - they employed me because their last guy didn't backup (to tape or anything else) and they lost the entire data and had to send live drives off to a data recovery firm. My prime concern has always been not repeating his mistakes, and showing that their data is safe. I NAS everything and there isn't a tape around.

    It's pointless to worry about tape and expensive drives when you can just slap a NAS in each building, mirror to them as appropriate, mirror that to an off-site NAS, mirror that to the cloud, etc. The extra space available means you can store more historical copies in the case of a rollback.

    And even from pe

    1. Re:Tape is dead by bored · · Score: 1

      The problem is cross vendor replication ends up taking the form of rdiff-backup or rsnapshot. Otherwise you end up with a single point of failure when your stupid NAS vendor pushes a firmware update that corrupts all your backups.

    2. Re:Tape is dead by Anonymous Coward · · Score: 0

      when you discover you have mirrored the a document that has been hopelessly corrupted, wha is your real backup plan ?

    3. Re:Tape is dead by ledow · · Score: 1

      Roll back to the snapshot/shadow copy before that.
      Restore from the parent / grandparent backup taken before that.
      Restore from the daily/weekly/monthly/bi-annual backup before that.

      What kind of fucking shit backups are you talking about where your old backups get overwritten on every backup with the newest data and nothing else?

    4. Re:Tape is dead by Anonymous Coward · · Score: 0

      The big savings are on operations.

      No need to lug tape drives around. No need for some schmuck to work overtime to change tapes.
      Unless of course site is big enough to warrant use of large automated tape drives libraries. But that is easily 10x, 20x the volume of your normal small/medium company.

  31. It's backup kabuki theater by swb · · Score: 1

    changing the tapes becomes the whole of the backup maintenance: no one actually verifies that the backup job is running properly. I've been on calls to clients who've diligently changes their tapes nightly, but the backup software has been crashed for months..

    I've seen the same thing, but I think the entire backup process is something of a kabuki dance because just seeing "Job success" is a false sense of security in and of itself.

    Do you know if the media is usable to restore from? Do you know if the data backed up is capable of actually being used to restore to function whatever system was backed up?

    I think most places fall down on these two items. Where I work we are told to do restores from backup media to validate usability -- but just very partial restores, a handful of random files, which really only validates simple to verify data (a common file, small executable, etc). I've seen plenty of instances where the tapes (even LTO) stumbles further into the media -- is it the drive? The specific bit of media?

    But almost nobody does a real restore, where they attempt to restore an entire system from backup (which almost always means multiple servers).

  32. Consolidation of manufacture by rnws · · Score: 1

    Several years ago when the overall tape market was declining, this was essentially due to the growth of LTO being masked as it cannibalised all the other tape formats (DAT, DLT, SAIT, et al), the overall number of LTO media shipments has continued to increase, that is, PB's shipped.

    Two tape-centric factors are in play; capacities keep getting massively bigger but there are fewer customers that can actually use up all the available capacity. Spooks, arguably, but there are lot fewer intelligence agencies in the world than the small and medium-sized businesses that make up the bulk (around 80 percent) of the global economy. The Entertainment industries sure like LTO, its capaciousness and reliability has proven ideal for archiving the digital masters of their SD/HD/4k/IMAX/onwards and upwards formats. Though again, not that many when compared to the global economy.

    The second factor is, everyone's known LTO-7 has been coming for a while and tape purchasing cycles always slow down around the introduction of a new capacity point. Organisations usually skip a generation (people who bought LTO-3, probably skipped four and upgraded to five) and once they do buy a new generation, usually buy a smaller library as they can now store double the capacity in a library half the size (and cost).

    Like any tech, once the easy science and engineering is done, the market shakes out and the few reamining players begin to consolidate, usually down to one or two as tape has done, as disk is now doing and as SSD's will do in the next couple of years. Right now the only companies doing fundamental physics and materials research into tape are IBM and Fujifilm. Quantum no longer makes its own drives, HP will not make its own LTO-7, leaving everybody buying off IBM while the long-tail business windows down. IBM has played the same game here thay played with mainframes, they doubled-down and invested in new technology when everyone else was giving up in the face of Windows and PC's. The mainframe busines is still a $2bn per annum business and will remain a significant chunk o' change for many years to come. (Arguably, it's actually growing in some places...) That's a nice business model where all the costs have been sunk and what's left is maintenance margin. Well-played IBM. (As long as IBM's tape business can survive the sinking revenues of it's disk business which it's lumped in with).

    Maybe to survive LTO will roll into a proper joint-venture, single manufacturer, where HP, IBM, Quantum and perhaps Oracle, throw in their IP to keep the drive technology best-of-breed and keep their share of that long-tail business. (Don't hold you breath though, too many ego's in that equation). Maybe it'll spin out into a niche business like OpenVMS has.

    Given the problems the disk manufacturers appear to be having in shipping their new tech (SMD and HAMR) to the public in volume and the rise of SSD's, given that there is no significant amount of disk in (the massive global) archive, it's likely hard disks will die off well before tape does as it's far easier to swap out todays primary arrays for SSD's than it will be to migrate the mass of archives on tape.

  33. Re:BAD idea. HDD's die when stored by geekmux · · Score: 1

    Multiple times I've taken an HDD out of service and later (like 1 year later, not decades) tried to spin it up again and had it fail. HDD's suck for offline storage. You have to keep them spinning and also back up their contents to other drives, which sort of defeats the purpose of using them as a backup medium. The main problem with tape is, as you say, that it's too damn expensive, especially for the drives. But a vault full of tapes is likely to be far more reliable than a vault full of powered-off HDD's.

    While I have seen the phenomenon you speak of, I don't see it being as bad a scenario as you paint it. Not every hard drive pulled from deep storage fails. In fact, the failure is likely on par with just about every other storage (even your pressed CD collection is dying a slow death)

    I'm still spinning 20-year old platters today (which ironically I had to move the drives because the motherboard died)

  34. R&D: Only three companies left by scsirob · · Score: 3, Informative

    Tape is great for archive purposes. It would be a shame if LTO dies.
    The biggest threat to LTO is the lack of vendors developing drives. At this time only very few companies do R&D for tape devices. IBM, HP and Oracle are the only serious players.

    Oracle develops only Enterprise class drives (T10K), not LTO. The market for those drives is quite small, which means the R&D cost needs to be recovered from a relatively low volume. That makes them bl**dy expensive.

    HP develops LTO. They have to do R&D for LTO only, as they have no enterprise class drives. LTO is considered commodity so margins are too low to spend a lot on R&D. They will therefor struggle to be cost effective.

    IBM develops both an enterprise class (Jaguar) and LTO tape drives. From a tech perspective, IBM are in the best position, as they can develop new technology for their enterprise drives, recoup cost in that segment, and then commoditize the technology in their LTO drives. Unfortunately IBM no longer wants to be a hardware company.

    This does not bode well for tape technology in general. I've made a good living from it writing software for tape drives, but I guess all good things come to an end.

    --
    To Terminate, or not to Terminate, that's the question - SCSIROB
    1. Re:R&D: Only three companies left by Anonymous Coward · · Score: 0

      Nobody wants to be a hardware company anymore. That's what China is for now.

  35. You're doing it wrong, then .... by King_TJ · · Score: 1

    Mag tape is definitely on the way out, because it's slow and the drives require regular maintenance to keep them working reliably. Sure, it meets your "requirements" - but I'd argue that MOST businesses really don't need to do things the way you've proposed in order to have a more than reasonable amount of data security.

    I've never been a big fan of flash storage as archival backup. Even for consumers only needing a backup of a small photo collection or what-not? Putting it on thumb drives winds up being a false sense of security when the cheap Asian flash chip fails suddenly, with no advance warning, as soon as the drive is plugged into a USB port to access it.

    But I can still pull archived ZIP files off of CDRs we burned in 1996-97 -- in response to your "But go pull the post-close EOY General Journal from 1996 off of one, I dare you." comment.

    And most of what you're really talking about isn't backup/archiving, but rather, disaster recovery (having multiple copies of the data in different cities and states). There's no reason TAPE makes that any easier than other forms of media. In fact, today's easiest way to accomplish that is using cloud storage with reliable services who already have redundant data centers and backups done at all sites.

  36. Remember the Y0K Fiasco? by See+Attached · · Score: 2

    Didn't you get that papyrus-memo? Everyone wanted to require a Negative number on all the clay tablets. The scribes were looking forward to the overtime, the Donkey cart guys were in favor of shipping em from Helios mountain DR site, but Ceasar said no and settled on AD for Go-Forward only.

    --
    Time for a new Political party in the US (or two!) One is off the rails Other cant pony up a leader.
  37. LTO for backup is dead, but alive for archive by ejoe_mac · · Score: 1

    There is a huge difference. RTOs no longer allow for the time to restore from it, but long term archival to take is very viable. It's power is that the medium is separate from the mechanics of the heads and drive motors. You can replace a drive with a newer one and read a few generations older tape - but if a hard drive has an internal breakdown, you're sending it in to a data recovery company.

  38. Language revival bootstrapping by tepples · · Score: 1

    Yea kinda sucks when your language dies

    That's why you need to include children's books and dictionaries in collection, so that future archaeologists will have an easier time learning the language. The illustrated children's books are for bootstrapping basic competence; the dictionaries are for building more complex meanings.

  39. Re:Universal standard by Anonymous Coward · · Score: 0

    They *did* decide on a standard, universal filesystem for tape decades ago: it's called tar.