Slashdot Mirror
Online Backup vs. Tape Backup?
hashbox asks: "I work for a small non-profit (about 100 staff members) and management has decided that they want to use an online data backup system instead of our existing tape backup system. After a meeting with one of the many vendors providing this service, I must admit that I am impressed with the promise of the technology (ease of use etc). However the sysadmin side of me has a few reservations. Has anyone here on Slashdot used an online backup service, and what were your experiences?"
Even if you go with an online service you should do some form of local backup. What happens if you lose your connection? This sort of service is perhaps best treated as an offsite backup.
There are a couple of concern you should ask the vendors,
- How much data can the offsite carry?
- Any type of compression
- What about encryption?
- What if you need your backup, how much time will it take the vendor to bring you a copy of your data on a CD or DVD ?
- Does the compagny have a secure storage ?
You can also try "easeBackup" Easy to use, support Encryption and Compression.. I am using it..
"Only wimps use tape backup real men just upload their important stuff on ftp, and let the rest of the world mirror it." - Linus Torvalds
Very apropos.
I really hate Dan Patrick.
The popularity of both Storage Area Networks and Network Attached Storages somehow seems to show that most organisations prefers to keep backup within their own control. And tapes are dirt cheap on today's standards.
Both tapes and solid state solutions can be have cheaply and some have great user friendliness. You get excellent bandwidth thrown in as well.
The only upside I can think of for online storage is that it is truely redundant, that is you will not lose your backups in event of a fire or other calamities.
But bear in mind that vendors do have the tendency to promise you the earth and deliver pebbles.
If you are talking about 20 to 50 gig of data and monthly backup then I'd say this isn't a bad idea but if you are talking 100+ gig and weekly back then this is definitely a bad idea. You also have to factor in the security of your data while it's being transported, the time it takes to backup and the overall cost of your bandwidth use. Also, a year from now you might need to backup a lot more data so factor that in.
If you ask me it is not worth the trouble, you are better of investing in your own backup system.
-----
One is born into aristocracy, but mediocrity can only be achieved through hard work.
Spend some time thinking about the circumstances under which you might need a restore service; how often, how quickly, how to verify it works, etc. This may help to clarify the issues for you.
The thing about things we don't know is we often don't know we don't know them.
"If online backups are so good, why don't you use them?"
I think a better option would be to roll your own.
Standard PC components are insanely cheap these days. Get a 4U box, chuck it full of lots of IDE drives, an IDE RAID controller or two, and Linux. Then toss samba + tar + bzip2 + yyyrsa + rsync on a local box.
Said 4U could be located at a remote office (if you have one), or possibly find another business who would be willing to swap remote storage devices with you. If all else fails, you can get colo for $50/mbps + space.
symetrix. We are building a religion, a limited edition.
"Real men don't do backups...But you know, real men sometimes cry" :):):)
____
nico
Nico-Live
We have used stand alone tape systems, automated remote tape libraries, and a network accessible backup storage array with raid. It has been my experience that any backup system will work as long as the person responsible for the backups is making sure that they happen. I have seen several occations were one of "automated" backup systems failed and no one seemed to notice until a restore was needed. The key is making sure that the backups are happenning in the first place.
Hello.
I put together an entire online backup solution once. The braintrust of the project didn't want to spend a ton of money and wanted to just find another stream of income based on the internet. I told him that he'd end up spending tons of money on hardware and it'd have to be moved offsite (all of the standard backup strategy stuff) and if he wanted to be competitive, he'd have to do it securely (encryption) and reliabily.
His answer to this was to buy an IDE raid and a T1 (no tapes!). I scoffed at the idea, but wrote the entire system for him anyway. Needless to say, the whole thing worked and he has a few customers and they get their important data backed-up fine, but if he were to get any real customers or have a crash of some sort, he'd be out of business and out of luck.
My advice (similar to a previous poster) is to foll your own. I know that backups can be costly and a pain to maintain, but getting amanda running on a linux machine with a huge raid and a tape changer is a LOT better than putting your faith in an anonymous company. If you're still stuck on the online solution, see if you can take a tour of the company to see that they actually have the capacity and hardware to back up their claims.
Just my $0.02 and no, I'm not telling the name of the backup service that I built. It's not something that I'm very proud of.
Backups are done via rsync, and restores are done with cp. (The whole system is run on linux with php and mysql). The files are backed up from/restored to windows servers over samba.
This is all great and makes the users happy. However, any intelligent business will also have offsite backups. Right now, if a (pick your natural disaster/accident) happens, the company is basicaly out of business since no data resides outside the server room.
Of course since all the client data is stored in a central location, it would take nothing to add some tape backups/hot-swap HD/etc. and take them offsite once a week.
Use disks. See : Mike Rubel's rsync backup system. You can't beat IDE disks on price/gb - Tapes are MORE expensive; They're fast, available on-line, and you'll probably be able to mount them on any machine in the next 10 years (which is not true for many tape drives).
I work at a largish company where we do our own 'online' backup of a remote office. Around 400Gigs over a T1 line, we use rsync (works with linux and windows systems) and keep the data on an Apple XRaid (very cost effecitve and better-supported than a roll-your-own). Since the daily deltas are rarely more than a gig, this works really well.
We did this because the tape system has a long history of reliability problems. We've since fixed the tape problem (we still do tape backups) but tape is used for off-site storage and disaster recovery at remote sites -- for typical "I deleted an excel file I didn't mean to" requests we can just drill into the xraid and pull the file over without having to mount tapes, get the offsite people to bring them back etc.
Tape might seem expensive, but you have to look at the business benefit, not the cost of drives, software, etc. For example -- point-in-time backups -- our online system is great for yesterdays data, but useless for files from 3 months ago. Our tape system has monthly tapes for a year, weekly tapes for a month, and daily (full-not differntial) for a week. This has 'saved the bacon' more than once and I highly recommend it. Another good point of tape is database backups -- sure you can dump a database to disk and then rsync it offsite, but it requires that all of your database servers have much more disk capacity, and depending on how rsync treats the backup file, it could kill the entire online concept unless you've got a T3 or something.
The killer is restores though. You have to practice them and get the process nailed, otherwise your backups (online or tape) are useless.
"But actually trying to use m4 as a general-purpose langage would be deeply perverse" --ESR