Slashdot Mirror


Online Website Backup Options?

pdcull writes "I can't be the only person on the planet who has this problem: I have a couple of websites, with around 2 GB of space in use on my hosting provider, plus a few MySQL databases. I need to keep up-to-date backups, as my host provides only a minimal backup function. However, with a Net connection that only gets to 150 Kbps on a good day, there is no way I can guarantee a decent backup on my home PC using FTP. So my question is: does anybody provide an online service where I can feed them a URL, an FTP password, and some money, and they will post me DVDs with my websites on them? If such services do exist (the closest I found was a site that promised to send CDs and had a special deal for customers that had expired in June!), has anybody had experience with them which they could share? Any recommendations of services to use or to avoid?"

21 of 173 comments (clear)

  1. Why not use an online solution? by MosesJones · · Score: 5, Informative

    Rather than "posting DVDs" I'd go for something like Amazon's S3 and just dump the backup to them. Here is a list of S3 Backup solutions that would do the job.

    I've personally moved away from hard-media as much as possible because the issue on restore is normally about the speed to get it back on the server and its there that online solutions really win as they have the peering arrangements to get you the bandwidth.

    --
    An Eye for an Eye will make the whole world blind - Gandhi
    1. Re:Why not use an online solution? by beh · · Score: 4, Interesting

      Similarly, I'm not using DVDs etc. for my server backup. A few years back, seeing how much my provider would charge me for a decent amount of backup space, I opted to get an additional server instead; the second server now provides
      secondary DNS, secondary MX to my regular system, but also has all data for a cold-standby ( I would still need to change addresses in DNS manually in case of a disaster, and bring up services, but pretty much all the data is in place).

      The data is synchronised between both servers several times a day - first backed up locally to a second disk on the same machine, then rsynced between the two...

      The solution was cheaper than the cost of the backup, and gives me extra flexibility in terms of what I can do. The only 'cost' is that both machines sacrificed disk space to be back-up for the other (since both machines have >400GB in disk space, giving up even half the disk space of each machine isn't a big limitation - at least, not for *my* needs. YMMV).

    2. Re:Why not use an online solution? by beh · · Score: 4, Insightful

      Sure, it will - but that problem you will have with a provider-based backup as well. If your data gets corrupted without you noticing, your backup will 'save' corrupt data...

      What you can do to at least partially save yourself is to at least make sure the rsync users are jailed and can only rsync to the target directory, not being able to access anything else.

  2. Why FTP? Use rsync. by NerveGas · · Score: 5, Informative

    It seems like the only problem with your home computer is FTP. Why not use rsync, which does things much more intelligently - and with checksumming, guarantees correct data?

    The first time would be slow, but after that, things would go MUCH faster. Shoot, if you set up SSH keys, you can automate the entire process.

    --
    Oh, you're not stuck, you're just unable to let go of the onion rings.
  3. yeah, use rsync. by SethJohnson · · Score: 5, Insightful

    I 100% agree with NerveGas on the rsync suggestion. I use it in reverse to backup my laptop to my hosting provider.

    Here's the one thing to remember in terms of rsync. It's going to be the CURRENT snapshot of your data. Not a big deal, except if you're doing development and find out a week later that changes you made to your DB have had unintended consequences. If you've rsynced, you're going to want to have made additional local backups on a regular basis so you can roll back to one of those snapshots prior to when you hosed your DB. Apologies if that was obvious, but rsync is the transfer mechanism. You'll still want to manage archives locally.

    Seth

    1. Re:yeah, use rsync. by Bert64 · · Score: 4, Informative

      Then what you need is rdiff-backup, works like rsync except it keeps older copies stored as diffs.

      As for FTP, why the hell does anyone still use ftp? It's insecure, works badly with nat (which is all too common) and really offers nothing you don't get from other protocols.

      --
      http://spamdecoy.net - free throwaway anonymous email - avoid spam!
    2. Re:yeah, use rsync. by xaxa · · Score: 5, Informative

      Then what you need is rdiff-backup, works like rsync except it keeps older copies stored as diffs.

      Another option is to use the --link-dest option to rsync. You give rsync a list of the older backups (with --link-dest), and the new backup is made using hard links to the old files where they're identical.
      I haven't looked at rdiff-backup, it probably provides similar functionality.

      Part of my backups script (written for zsh):

      setopt nullglob
      older=($backups/*(/om))
      unsetopt nullglob

      rsync --verbose -8 --archive --recursive --link-dest=${^older[1,20]} \
                              user@server:/ $backups/$date/

    3. Re:yeah, use rsync. by Lennie · · Score: 5, Informative

      There is also the --backup --backup-dir options (you'll need both). It keeps a copy of the files that have been deleted or changed, if you use a script to keep it in seperate directories you'll have a pretty good history of all the changes.

      --
      New things are always on the horizon
  4. Wow by crf00 · · Score: 5, Insightful

    Wow! So you are asking somebody to download your website's home folder and database, look at the password and private information of members, and deliver you dvd that is ready to be restored with rootkit along?

    1. Re:Wow by teknikl · · Score: 5, Funny

      Yeah, I had noticed the complete lack of paranoia in the original post as well.

  5. I had the same problem... by cperciva · · Score: 4, Interesting

    After looking at the available options, I decided that there was nothing which met my criteria for convenience, efficiency, and security. So I decided to create my own.

    I'm looking for beta testers: http://www.daemonology.net/blog/2008-05-06-tarsnap-beta-testing.html

  6. rsync - it's in the tag by DrogMan · · Score: 5, Informative

    rsync to get the data, cp -al to keep snapshots. I've been using this for years to manage TB of data over relatively low-speed links. You'll take a hit first-time (so kick it off at night, kill it in the morning, and the next night just execute the same command and it'll eventually catch up, then cp -al it, then lather rinse, repeat. This page: http://www.mikerubel.org/computers/rsync_snapshots/ has been about for years. Use it!

  7. Give them here by Lord_Sintra · · Score: 5, Funny

    Send me your FTP details and some cash and I'll...backup...your data.

  8. I sure hope you're no UK based... by jonnyj · · Score: 4, Informative

    ...because if you are and you're planning to sent personal data (there can't be many 2GB web sites that contain no personal data at all) on DVD through the mail, you might want to look at recent pronouncements from the Information Commissioner. A large fine could be waiting for you if you go down that route.

  9. How quickly do you need it back? by jimicus · · Score: 4, Insightful

    One thing a lot of people forget when they propose backup systems is not just how quickly can you take the backup, but how quickly do you need it back?

    A sync to your own PC with rsync will, once the first one's done, be very fast and efficient. If you're paranoid and want to ensure you can restore to a point in time in the last month, once the rsync is complete you can then copy the snapshot that's on your PC elsewhere.

    But you said yourself that your internet link isn't particularly fast. If you can't live with your site being unavailable for some time, what are you going to do if/when the time comes that you have to restore the data?

  10. Re:Gmail backup by Anonymous Coward · · Score: 5, Insightful

    This strikes me as a really dumb thing to do; as both a) using it for data storage rather than primarily email storage and b) signing up for multiple accounts are both violations of the gmail TOS, you are just asking for your backups to not be available when you most need them.

  11. why not try ... by Anonymous Coward · · Score: 5, Funny

    NSA.gov?
    NSA: We backup your data so you won't have to!

    How it works:
    First, edit each page on your website ab add the following meta tags: how-to, build, allah, infidels, bomb (or just any of the last three, if you're in a hurry).

    On the plus side, you don't need to give them your money, nor your password.

    On the minus side ... there is no minus side (I mean, who needs to travel anyway?)

    Posting anonymously as I have moderated in this thread (that, and they already know where I live).

  12. Actually, his only problem is.... by raehl · · Score: 4, Insightful

    ... his slow internet connection, and wants to pay something to not have to move files over his slow internet connection.

    How about:

    - Pay for a hosting provider that DOES provide real backup solutions....
    - Pay for a real broadband connection so you CAN download your site....

    As with most things that are 'important'...

    Right, Fast or Cheap - pick two.

  13. Shared hosting by DNS-and-BIND · · Score: 4, Interesting

    OK, I keep hearing "use rsync" or other software. What about those of us who use shared web hosting, and don't get a unix shell, but only a control panel? Or who have a shell, but uncaring or incompetent admins who won't or can't install rsync? I know the standard slashdot response is "get a new host that does" but there are dozens of legitimate reasons that someone could be saddled with this kind of web host.

    --
    Shutting down free speech with violence isn't fighting fascism. It IS fascism!
  14. Re:Why not use Suso? by cdrudge · · Score: 4, Insightful

    One thing that I've learned though is you can not rely on a hosting company's backup to necessarily be timely, reliable, and/or convenient. If you want to backup multiple times during the day, have multiple generations of backups, be able to very quickly restore if need be, all can make the hosting backup unattractive. I'm not saying yours is that way, just with some of the hosting companies I've dealt with in the past.

    This also doesn't take into consideration the best-practice of having your backups off-site for disaster recovery. It doesn't help very much to have your backup server/drive/whatever 1U down in the rack when the building collapses, has a fire, floods, etc destroying everything in it.

  15. Thanks for your comments... by pdcull · · Score: 5, Informative

    Hi everyone, I didn't mention in my question that where I'm living (Rio de Janeiro slum) there aren't that many options for internet access. Also, as all my sites are my very much not-for-profit, I'm limited as to how much I can spend on my hosting plan. I've been using Lunarpages for a number of years now, and generally find them very good, although if I stupidly overwrite a file, or want to go back to a previous version of something, I'm out of luck. As I am a lazy (read time-challenged) individual, I tend to use Pmwiki and maintain my sites online, hence my need for regular, physical backups. Anyway, thanks everyone for your help, I still can't help thinking that somebody must be able to make a pile of cash offering such as service to non-techie site owners...