Slashdot Mirror


Backing Up is Hard to Do?

Joe Barr writes "NewsForge is running a story this morning on a personal hardware/software backup solution for your Linux desktop (NewsForge is owned by Slashdot's parent OSTG). The solution doesn't require a SCSI controller, or tape drive, or the ability to grok a scripting language or archiving tool to work, either. It's based on point-and-click free software. Plus it includes a dead-parrot joke by Linus Torvalds."

299 comments

  1. omg by Anonymous Coward · · Score: 0

    You're joking right Linux is teh bomb all I do is use dd because it's so damn easy on Linux!

  2. Backup painful? by Anonymous Coward · · Score: 5, Funny

    Backing up isn't painful, restoring is.

    1. Re:Backup painful? by Anonymous Coward · · Score: 1, Informative
      Neither is painful with the right tools.

      To backup: rsync -avv -e ssh . backupuser@backupserver:backuppath
      To restore: rsync -avv -e ssh backupuser@backupserver:backuppath .

      The most important thing about backups IMHO is that they be off-site. It's a silly amount of false security when your backup device is in the same room as the computer you're backing up; and the same failure (failed airconditioner; fire; leaking roof; power surge; angry girlfriend) destroys both systems.

    2. Re:Backup painful? by Lussarn · · Score: 1

      I like rdiff-backup because it makes reverse diffs, meaning the files on the backup disks are always the most recent ones with older changes in diff files. It works over standard ssh and is fairly easy to setup (Some scripting required, or at least doesn't hurt). No gui though.

    3. Re:Backup painful? by Anonymous Coward · · Score: 0
      and the same failure (failed airconditioner; fire; leaking roof; power surge; angry girlfriend) destroys both systems.

      The angry girlfriend comment may have been going for funny, but it's a serious point.

      I've lost more data (pics, emails w/ an x-gf) to that cause than any other failure mode computers I've worked with experienced (including failed hard drives and disgruntled empmloyees).

    4. Re:Backup painful? by eln · · Score: 1

      It seems like you and your girlfriend don't have the healthiest of relationships. Perhaps you should hide your computers.

    5. Re:Backup painful? by khrtt · · Score: 4, Informative

      Here's my solution

      Backup:
      tar -czf backup.tar.gz /home /etc
      Then use k3b or something to record the file to CD

      Restore:
      Take a wild guess:-)

      Restore individual files:
      Use mc to browse the tarball (slow but works)

      Now, do you see me bragging about this trivial shit on slashdot? No?

      Eh, wait...

    6. Re:Backup painful? by Homology · · Score: 1
      Backing up isn't painful, restoring is.

      Restoring is a pain when the backups are incomplete, or backup media is faulty (quite common). Instead of have a backup of the complete system, they just backup user data chancing that reinstalling the OS and then restore should be a breeze. Ouch! Now they have to install numerous vendor patches, as well as other undocumented tweaks done to the system before restoring. Yup, restoring here can be painful. The only funny thing about parent post is the moderators modding the parent as "Funny".

    7. Re:Backup painful? by Anonymous Coward · · Score: 0

      Backing up can be quite painful if you run into a sharp or protruding object in the wrong spot.

    8. Re:Backup painful? by Kent+Recal · · Score: 1

      Full agree with parent.

      When you backup to DVD or CD-ROM make sure to run a verify after every backup!

      Verify means comparing the files that you meant to write to those that actually read back from the disc (diff /home/blah/bigfile /mnt/cdrom/bigfile).

      You'd be surprised how often many CD/DVD-writers screw up some files or even the whole disc. If you skip the verify you'll learn it the hard way.

    9. Re:Backup painful? by Pig+Hogger · · Score: 1
      Restoring is a pain when the backups are incomplete, or backup media is faulty (quite common). Instead of have a backup of the complete system, they just backup user data chancing that reinstalling the OS and then restore should be a breeze. Ouch!
      I once started to work at a place that had a 2gig backup tape drive which was used to backup a total of about 140 gigabytes of data. They had a complete backup on something like 50 tapes, and about 90 other incremental tapes done since.

      I was lucky enough to be able to convince my boss to convince the board to buy a new tape drive. We finally got a jukebox that took 240 gigabytes, with which we changed the backup regimen to 1 full backup on 2 o'clock sunday morning, and incremental backups every day.

    10. Re:Backup painful? by Anonymous Coward · · Score: 0

      What about partimage?
      It works pretty well to me... and is not painfull at all; Actually, it can be a solution even for fat systems...

    11. Re:Backup painful? by chainsaw1 · · Score: 1

      It only helps partially when
      a) she knows there's a computer in the house
      b) she knows it's the most important thing to you in the house
      c) she will find it and "get creative"
      d) If not c) then destroy the rest of the house finding until c) can be completed
      e) Goto d)

      I keep all my computers in the basement except one decoy (802.11 prevents following the cords)

      --
      - Sig
    12. Re:Backup painful? by IllForgetMyNickSoonA · · Score: 1

      Just RTFA, and you'll also find it funny.

      For impatient: the version of the program described in the article had a bug which made restoring individual files/directories impossible.

    13. Re:Backup painful? by POLAX · · Score: 1

      I would LOVE to know how k3b will record 80GB to a CD...

    14. Re:Backup painful? by Zeromous · · Score: 1

      THe parent is wrong. The key phrase in your post is "can be". with proper planning and understanding the platform you are restoring too, none of the problems you mention should arise. For isntance if you idea of system backups is tar xvf / . then you WILL have problems restoring.

      I maintain the hard part is backing up the correct data. THen restoration is a breeze.

      I've done disaster recovery planning now for about 6 months, and the first thing I learned is that restoring is easy, its understanding your environment enough to backup and restore the correct data, that's the bitch.

      --
      ---Up Up Down Down Left Right Left Right B A START
    15. Re:Backup painful? by ckaminski · · Score: 1

      When you get into that many tapes, I start considering my love for differentials over incrementals... usually fewer tapes to restore.

      But yes, I dreaded backing up my dad's office's 10GB+ disks with 500MB QIC drives. Shudder!

  3. And here is the joke... by Omniscientist · · Score: 1
    Here is the dead parrot joke for those too lazy to read the article:

    That implies that you didn't unmount it before powering it down, which is bad (it's like removing a floppy without unmounting it). If you really want to use it that way, then try supermount or some of the other "on-the-fly" mount utilities. Or do you mean that the disk just powered down on its own, and is just sleeping? If so, everything is fine, and it should come right back up when it's needed. "It's not dead, it's just sleeping."

    Ha.

    1. Re:And here is the joke... by Anonymous Coward · · Score: 2, Informative

      Dead Parrot Sketch

      The cast:

      MR. PRALINE John Cleese
      SHOP OWNER Michael Palin

      The sketch:
      A customer enters a pet shop.

      Mr. Praline: 'Ello, I wish to register a complaint.

      (The owner does not respond.)

      Mr. Praline: 'Ello, Miss?

      Owner: What do you mean "miss"?

      Mr. Praline: I'm sorry, I have a cold. I wish to make a complaint!

      Owner: We're closin' for lunch.

      Mr. Praline: Never mind that, my lad. I wish to complain about this parrot what I purchased not half an hour ago from this very boutique.

      Owner: Oh yes, the, uh, the Norwegian Blue...What's,uh...What's wrong with it?

      Mr. Praline: I'll tell you what's wrong with it, my lad. 'E's dead, that's what's wrong with it!

      Owner: No, no, 'e's uh,...he's resting.

      Mr. Praline: Look, matey, I know a dead parrot when I see one, and I'm looking at one right now.

      Owner: No no he's not dead, he's, he's restin'! Remarkable bird, the Norwegian Blue, idn'it, ay? Beautiful plumage!

      Mr. Praline: The plumage don't enter into it. It's stone dead.

      Owner: Nononono, no, no! 'E's resting!

      Mr. Praline: All right then, if he's restin', I'll wake him up! (shouting at the cage) 'Ello, Mister Polly Parrot! I've got a lovely fresh cuttle fish for you if you
      show...

      (owner hits the cage)

      Owner: There, he moved!

      Mr. Praline: No, he didn't, that was you hitting the cage!

      Owner: I never!!

      Mr. Praline: Yes, you did!

      Owner: I never, never did anything...

      Mr. Praline: (yelling and hitting the cage repeatedly) 'ELLO POLLY!!!!! Testing! Testing! Testing! Testing! This is your nine o'clock alarm call!

      (Takes parrot out of the cage and thumps its head on the counter. Throws it up in the air and watches it plummet to the floor.)

      Mr. Praline: Now that's what I call a dead parrot.

      Owner: No, no.....No, 'e's stunned!

      Mr. Praline: STUNNED?!?

      Owner: Yeah! You stunned him, just as he was wakin' up! Norwegian Blues stun easily, major.

      Mr. Praline: Um...now look...now look, mate, I've definitely 'ad enough of this. That parrot is definitely deceased, and when I purchased it not 'alf an hour
      ago, you assured me that its total lack of movement was due to it bein' tired and shagged out following a prolonged squawk.

      Owner: Well, he's...he's, ah...probably pining for the fjords.

      Mr. Praline: PININ' for the FJORDS?!?!?!? What kind of talk is that?, look, why did he fall flat on his back the moment I got 'im home?

      Owner: The Norwegian Blue prefers keepin' on it's back! Remarkable bird, id'nit, squire? Lovely plumage!

      Mr. Praline: Look, I took the liberty of examining that parrot when I got it home, and I discovered the only reason that it had been sitting on its perch in the
      first place was that it had been NAILED there.

      (pause)

      Owner: Well, o'course it was nailed there! If I hadn't nailed that bird down, it would have nuzzled up to those bars, bent 'em apart with its beak, and
      VOOM! Feeweeweewee!

      Mr. Praline: "VOOM"?!? Mate, this bird wouldn't "voom" if you put four million volts through it! 'E's bleedin' demised!

      Owner: No no! 'E's pining!

      Mr. Praline: 'E's not pinin'! 'E's passed on! This parrot is no more! He has ceased to be! 'E's expired and gone to meet 'is maker! 'E's a stiff! Bereft of life, 'e
      rests in peace! If you hadn't nailed 'im to the perch 'e'd be pushing up the daisies! 'Is metabolic processes are now 'istory! 'E's off the twig! 'E's kicked the
      bucket, 'e's shuffled off 'is mortal coil, run down the curtain and joined the bleedin' choir invisibile!! THIS IS AN EX-PARROT!!

      (pause)

    2. Re:And here is the joke... by Sibshops · · Score: 1

      Linus always seems to have a great sense of humor. It's probably one of the reasons why so many people like him. (Cue the overlord jokes.)

      I remember a funny article about about the real fathers of linux. Also, he has lots of good quotes
      His humor isn't limted to one liners becasue he has a book, too!

    3. Re:And here is the joke... by isecore · · Score: 1

      It's probably one of the reasons why so many people like him. (Cue the overlord jokes.)

      I for one welcome our new finnish kernel-hacking overlord(s).

      --
      I enjoy large posteriors and I cannot prevaricate.
    4. Re:And here is the joke... by David+Gould · · Score: 1


      Yes, thank you. Because of course, nobody else had any idea what they were talking about.

      --
      David Gould
      main(i){putchar(340056100>>(i-1)*5&31|!!(i<6)<< 6)&&main(++i);}
  4. As usual by Anonymous Coward · · Score: 0

    If you are a KDE-hater you don't get to use this cool software.

    1. Re:As usual by Anonymous Coward · · Score: 0

      USE=-kde -qt emerge kdar

    2. Re:As usual by Anonymous Coward · · Score: 0

      Ehm, but even these USE-Flags don't change the fact that kdar depends on kde (kdebase) and qt, so what's your point?

      Or did you just want to show us that you are using gentoo but don't have a clue about the distribution?

      To the grandparent, it may surprise you, but you can run kde programs outside of kde without a problem, so what apart from you post being an obvious flaimbait was the purpose of your posting?

    3. Re:As usual by Anonymous Coward · · Score: 0

      [ebuild N ] app-arch/kdar-1.3.1 +arts -debug -xinerama 1,766 kB

      d'oh!

    4. Re:As usual by Anonymous Coward · · Score: 0
      This: depends on kde (kdebase) and qt

      makes this: you can run kde programs outside of kde without a problem

      irrelevant. Sorry, nice try, flametard!

    5. Re:As usual by Anonymous Coward · · Score: 0

      You've set the arts use flag? Get with the 2.6:s, we have a real sound system called ALSA now. No need for that sound daemon crap.

    6. Re:As usual by temojen · · Score: 1
      That's OK, tar and gzip are much more likely to be on your recovery disk anyways, so you should learn to use those.

      Really, "tar -clzf /mnt/usbdrive/root.tgz / && tar -clzf /mnt/usbdrive/home.tgz" isn't that hard.

      for the perplexed:
      • "c" tells it to create a new archive
      • "l" tells it to only back up one partition
      • "z" tells it to compress the archive using gzip
      • "f /mnt/usbdrive/root.tgz" tells it to save the archive as root.tgz on the drive mounted as /mnt/usbdrive
    7. Re:As usual by Anonymous Coward · · Score: 0

      Ah, to bad you know nothing of what you're talking about. arts uses the ALSA kernel driver because they are not the same thing moron. Moreover, KDE will not officially support dropping arts until 3.4, but you can start doing this now if you choose, just don't expect max stability.

    8. Re:As usual by Anonymous Coward · · Score: 0

      Will that preserve symlinks, permissions, and timestamps without any extra flags?

    9. Re:As usual by temojen · · Score: 1

      The access time, permission, and ownership flags relate to archive extraction, not creation. (== yes)

  5. simple by Turn-X+Alphonse · · Score: 0

    We have portable USB Hard drives now, put the data on it and keep it in a safe place. You can take it any where you need to (oh no my house is on fire! for example).

    It's not difficult to drag some files onto it so why do we need a "solution" to a problem already solved?

    --
    I like muppets.
    1. Re:simple by quanticle · · Score: 0

      Do you mean external hard drives, or USB flash/keychain drives?

      --
      We all know what to do, but we don't know how to get re-elected once we have done it
    2. Re:simple by jedidiah · · Score: 0

      Agreed.

      Now that the PC finally has a standard external storage bus, such discussions are remarkably silly.

      Just get a USB disk and copy things to it.

      --
      A Pirate and a Puritan look the same on a balance sheet.
    3. Re:simple by Turn-X+Alphonse · · Score: 1

      Either work perfectly fine. It's just the general idea for them.

      --
      I like muppets.
    4. Re:simple by jedidiah · · Score: 1

      It all depends on how much data you want to protect...

      --
      A Pirate and a Puritan look the same on a balance sheet.
    5. Re:simple by MoonBuggy · · Score: 1

      As much as it's against /. tradition, if you RTFA you'll see that the author is using a 250GB IDE drive in a USB enclosure for the hardware side of things. The new bit is KDar, a piece of software which (apparently) makes nice, shiny, compressed, sliced differential backups easy and cron-able.

    6. Re:simple by MonkeyCookie · · Score: 1

      This software allows you to do nifty things like weed out certain unwanted directories, provides compression, makes differential backups, and breaks backups into chunks if your backup medium is smaller than the data.

      The main reason I would want backup software is so that I don't have to think about doing a backup: it just happens. I have a hard drive I use for backups, but I find that I don't end up dragging and dropping as much as I should. People tend to get lazy and not do backups if they aren't automated.

      Also, dragging and dropping mean you have to go find all the directories to drag and drop, which may mean some hunting and forgetting of certain directories. It's easy enough if your data is limited to your home directory, but if you also want data from various directories throughout the system (without backing up the entire system), backup software is handy for that.

      So in simple cases with a diligent person, the backup can be done through drag-and-drop, but unfortunately it's not always simple, and people tend to be lazy.

    7. Re:simple by pvc · · Score: 1

      Totally agreed.

      I have internal-disk-1 nitely rsyncing to internal-disk-2 and then (every wkend or so) I rsync to external-usb-disk and keep that off-site. Works very well for me.

      pvc

    8. Re:simple by Homology · · Score: 1
      Agreed. Now that the PC finally has a standard external storage bus, such discussions are remarkably silly. Just get a USB disk and copy things to it.

      Now, take that USB disk and drop it from 1 meter a couple of times. Even better, drop it to the floor while writing data. Hardisk proably damaged, and backup unreliable. Granted, USB disk backup is better than none at all. If only tape backup devices weren't so damn expensive.....

    9. Re:simple by SiliconJesus · · Score: 1

      The best part is that the Author admits that in this version, you can't do single file restores.

      If he was worried about single file restores and didn't want something complicated, why not just drag his entire drive over using a window manager type application like Nautilus. It isn't brain surgery (and hell - cp will even do it cheaply and easily and can be setup in cron in a snap for anyone but the most new newbie).

      --
      Clinton made me a Republican. Bush made me a Libertarian. Trump is making me question reality.
    10. Re:simple by EastCoastSurfer · · Score: 1

      The best part is that the Author admits that in this version, you can't do single file restores.

      This part had me rolling. WTF good is a backup if you can't do a single file restores?

      I hope no one who is considering linux stumbles across this article and thinks that's the best we have for backing something up. If I had written the article KDar would've been skipped for something that can completely do the job. Even if that meant hacking out some scripts and setting up a cron job.

    11. Re:simple by TheToon · · Score: 1

      Yup, the main problem with backup these days is that backup media has not kept up with disk sizes. Networked disk backup is well enough, but you need plenty of extra space build into all you computers. You need more than one generation of backups.

      Some of my machines can run unattended for weeks, if not months, and since unix/linux can keep running with a crashed filesystem if the files are cached, you need some extra "catch-up" time to find you that you have a dead disk or a b0rked filesystem.

      For enterprise systems, you can always get a tape library and run IBM Tivoli Storage Manager on it... now if only tape libraries and TSM was free :)

      --
      //TheToon
    12. Re:simple by StillAnonymous · · Score: 1

      Not entirely true. LTO1 tapes can hold 100/200GB, LTO2: 200/400GB and SAIT holds 500/1300GB. That's pretty decent. LTO1 tapes are cheap now too. $30CDN last time I checked.

      The price of the drives on the other hand....

  6. Re:Let's get these out of the way... by Mathiasdm · · Score: 1

    Phew, at least we got those out of the way already. Now, let's get some new clichés!

    --
    Join the anonymous, help develop the network: http://www.i2p2.de
  7. Right....point a click by Anonymous Coward · · Score: 1, Insightful

    A painless solution. After getting zlib, development packages for XFree-86, Qt 3, and KDE 3....

    1. Re:Right....point a click by Anonymous Coward · · Score: 0

      Well, it didn't say how many clicks...

  8. Re:Let's get these out of the way... by Kjuib · · Score: 1

    oh great... now everyone who post after you is going to get a -1 Redundent... I hope you enjoy screwing with people's karma...

    --
    - Your stupidity got you into this mess, why can't it get you out? -Will Rogers
  9. here ya go: by IQ · · Score: 1

    dd if=/dev/hda of=/dev/hdb

    how hard was that?

    --
    Adults are obsolete children. - Dr. Seuss
    1. Re:here ya go: by Anonymous Coward · · Score: 0
      cp /dev/hda /dev/hdb

      is a bit easier and does the same thing (on any computer since the early 90s)

    2. Re:here ya go: by Donny+Smith · · Score: 1

      how hard was what?

      you don't call that a backup command, do you?
      for all practical purposes that is - useless.

    3. Re:here ya go: by Thavius · · Score: 0

      For Joe Sixpack, real hard. Wrap it up in a nice GUI, give him one thing to click that does the dd for him, and he'll like it. Say "go to a shell and do a dd" and you'll get the deer-in-headlights look.

    4. Re:here ya go: by Anonymous Coward · · Score: 0

      This is how I do it:

      tar -cz /home/me/*|mail backup@gmail.com

    5. Re:here ya go: by Jeffrey+Baker · · Score: 1

      That's pretty much garaunteed to give you an inconsistent filesystem on hdb, if hda was mounted an in use at the time.

    6. Re:here ya go: by RealAlaskan · · Score: 1
      dd if=/dev/hda of=/dev/hdb

      Actually, I did this for a while, with /dev/hda smaller and faster, and /dev/hdb slightly larger and significantly cheaper (and slower). Back when CD burners cost big bucks, I lucked onto a cheap, big, slow second hard drive, and had instant backup.

      The bad news is that you only have one backup copy, rather than a history of backups. If you do dd if=/dev/hda of=/dev/hdb, then remember that you want that file that you erased just before that (which you just wrote over), you're screwed.

      Now, CDRs and CD burners are dirt cheap. I just burn /etc and some of the subdirectories under /~ to a CD whenever I find myself thinking: ``I'd be screwed if that hard drive died.'' Everything else is going to come back when I reinstall. Still, hard drives are cheap enough that I might go back to your method next time I build a machine. With those occasional backups to CD, too, of course.

    7. Re:here ya go: by Frank+T.+Lofaro+Jr. · · Score: 1

      You can't email binary data!

      --
      Just because it CAN be done, doesn't mean it should!
    8. Re:here ya go: by RailGunner · · Score: 1

      better to use partimage then dd... especially if you dual-boot.

    9. Re:here ya go: by Anonymous Coward · · Score: 0
      You can't email binary data!

      With base64, you can. Think in terms of attachments.

    10. Re:here ya go: by Anonymous Coward · · Score: 0

      No it isn't. You merely boot from a live CD and do the opposite to restore the entire system.

    11. Re:here ya go: by grumbel · · Score: 1

      Quite hard if your computer is currently in use and you don't want to end up with an inconsitent copy of your filesystems. It also provides no increments, so if you harddisk started to destruct data weeks ago, but you only noticed it today, you backup will be worthless, since its full of the same, cleanly copied data.

      Using dd to move a partition to another drive is good use, using it for backup is pretty much doomed to cause havok.

    12. Re:here ya go: by endx7 · · Score: 1

      I think what you want is RAID-1 (mirroring), even if you have to do it in software.

      Otherwise, unless you plan on only doing this while in single user mode or while that disk is unmounted, you play a risk stuff might happen while you're doing the copy over.

      That, and on big drives it can take a wee bit longer than you probably want to wait. You really don't need to back up the free space that badly.

    13. Re:here ya go: by B3ryllium · · Score: 1

      Or he'll get deeply offended upon hearing "Go to shell".

    14. Re:here ya go: by jaseuk · · Score: 1

      You should really have a look at the dump command.

      Do a full backup to your large additional disk.
      Then do hourly, daily or weekly (or both using dump levels) incremental backups.

      You've then got the benefit of being able to restore the whole system or pull out a single file from a point in time.

      The high end tape jukebox backup systems are not that dissimilar to dump.

      Jason.

    15. Re:here ya go: by homer_ca · · Score: 1

      You might want to pipe it through gpg while you're at it. Hotmail free accounts are up to 250MB now too.

  10. My choice for backups: by Megaslow · · Score: 4, Informative

    I use rsnapshot to automate my backups to another host. Works like a dream, providing multiple virtual point in time copies (just like similar functionality from Network Appliance, etc.).

    1. Re:My choice for backups: by naelurec · · Score: 2, Informative

      I'll second the use of rsnapshot. I use it for remote backups for several servers and it works well.

      For those who do not know, rsnapshot uses rsync to backup. What makes it unique is its ability to use hard links to keep full copies of a particular backup (ie during the restore, go into the folder you want and copy the back .. no need to shift tapes or do a full + incrementals, etc..)

      rsnapshot is run via cron so you can configure it to email when it runs (to verify correct operation).

      I have had to restore from rsnapshot both full restores and individual file restores. It is as simple as going into the backup folder and dragging the file you need. It preserves all permissions, ownership, groups, etc as well.

    2. Re:My choice for backups: by timeOday · · Score: 1

      Are the backups compressed, or do you need as much backup space as live space?

    3. Re:My choice for backups: by naelurec · · Score: 1

      They are not compressed. However, since it uses hard links for unchanged files, daily backups are relatively small (unless you change/update your files frequently). Ie -- I backup ~64GB of data every night and have 13 restore points (7 daily, 4 weekly and 2 monthly). This data takes up ~70GB total.

  11. Too easy by bigjnsa500 · · Score: 1
    Several examples of an easy backup. In KDE, drag and drop and select "Copy". Duh...
    For the more typing inclined people, create a directory and do this:

    rsync -av --delete --no-whole-file /folder-to-backup/ /backupfolder

    --
    This is a test. This is a test of the emergency sig system. This has been only a test.
    1. Re:Too easy by PrvtBurrito · · Score: 1

      That works, but it doesn't work for any server functions that a /.'er might have running on their home system. (I realize that is beyond the scope of the article -- which I didn't read). MySQL and any web/cgi data won't work if rsync is occuring while people might be using that data. Similarly setting a cron job to rsync might cause problems if you are accidentally editing that data while it is being used.

      --
      Laboratree - Scientific collaboration based on OpenSocial.
    2. Re:Too easy by Anonymous Coward · · Score: 0

      Yep, I bought a USB drive and do just that. Copy (smart skip) to an encrypted partition on the USB drive. The un-encrypted partition carries my MP3s for use at work. I take it to work every day.

    3. Re:Too easy by bigjnsa500 · · Score: 1

      That's why you rsync at a time you know the likelihood of it being used, like late night or early morning.

      --
      This is a test. This is a test of the emergency sig system. This has been only a test.
    4. Re:Too easy by jaseuk · · Score: 1

      If you want to backup a database you either need to stop the database server prior to your backup or do a mysql_dump / pg_dump / whatever to get a clean copy of the database and then back that up. Anything else is asking for trouble.

      Jason

  12. Re:Let's get these out of the way... by iMaple · · Score: 1

    Phew, at least we got those out of the way already. Now, let's get some new clichés!

    'new clichés!' eh ?? :)

  13. Rsync or mkzftree for backups by ceswiedler · · Score: 4, Informative

    The best way to create differential backups under Unix is with hardlinked snapshots. Easy Automated Snapshot-Style Backups with Rsync has a good explanation of how to do this. The best part is that restoring is as simple as copying a file. Each snapshot is a folder hierarchy on disk, and you can browse through any snapshot and find files you want.

    One small improvement over rsync (IMO) is to use mkzftree from the zisofs-tools package. It's designed to create compressed ISO filesystems which will be transparently uncompressed when mounted under Linux (and other supporting operating systems; it's a documented ISO extension). mkzftree supports an option for creating hardlinked forest (like cp -al and rsync), with the advantage that the files are compressed, thus saving space. ISO isn't quite as flexible as ext2 for things like hardlinks, so what I do is have DVD-sized disk images formatted as ext2 to store the snapshots. I burn the disk images directly to DVD; each one can hold ten or twenty compressed snapshots (of my data anyway). The disadvantage is that I can't read the files directly (because they're compressed, and the transparent decompression only works with ISO) but it's easy to decompress a file or folder to /tmp using mkzftree if I need to restore something.

    It shouldn't be hard to make the transparent decompression code work with other filesystems than ISO, as long as they're mounted read-only. The files are just gzipped with a header block indicating they are compressed.

    1. Re:Rsync or mkzftree for backups by Ian+Bicking · · Score: 1

      this page at riseup.net describes some software that supports the options for incremental hardlink-based backups, as there's been a bunch of packages that implement that.

    2. Re:Rsync or mkzftree for backups by Anonymous Coward · · Score: 0

      Where do I find documentation for zisofs-tools so I can see things like supported OSes and the ISO extension standard? The home page linked from the Freshmeat page is a download directory.

    3. Re:Rsync or mkzftree for backups by Anonymous Coward · · Score: 0

      A mkzftree manpage. The first section tells you all about what it is.

      The ZF extension is part of RockRidge, meaning that it will only work on RockRidge-aware OSes (that additionally support the ZF extension). A google search makes it appear that FreeBSD, Linux can use this, and SCO and IRIX can at least use RR (and therefore possibly ZF). If your OS isn't in the list (and isn't windows, which made up their own filesystem) then hit google yourself.

    4. Re:Rsync or mkzftree for backups by dnamaners · · Score: 1

      I do more or less this exact way, rsync incrimentaly each day, save weely images each sunday via cron. Each week I then use mkzftree and mkisofs to make that compressed ziso image of my system.

      My big change is to then take out my trusty slax live image (but you can probably use any live distro with rysync) and burn the ziso images with that to a dvd (either remasterd or as a second session. That way i can restore from total failure. Be sure to avoid 2gb or greater files that don't work in ISO format, if you have such files use UDF or break em up.

      To restore jsut mount the images on dvd via loop and copy a few files or use rsync to do it all. if the disk is dead you can boot to your live distro and then you have the tools to fix it first then copy em back.

      Of course nearly all these tasks can be done as scripts once you get tired of the commands :) , and the trick of the boot image is usefull if you rsync, tar or dd your backups.

    5. Re:Rsync or mkzftree for backups by boodaman · · Score: 1

      Check out rsnapshot, then. rsnapshot.org.

    6. Re:Rsync or mkzftree for backups by Anonymous Coward · · Score: 0

      Thanks. The man page says that a patched mkisofs is also required.

      RockRidge is pretty standard on Unix systems.

      I can't find any references to ZF other than in patches for Linux and someone asking whether it's available on FreeBSD. Is this extension a Linux "standard"? I'm surprised to find little documentation about RockRidge itself even.

  14. Re:sig by Anonymous Coward · · Score: 0

    Yeah, that sounded like a Lain attempt at humor to me.

  15. Easy by harlows_monkeys · · Score: 4, Interesting
    Here's what I do:

    1. Reach over and plug in USB 120 gig drive.

    2. Become root, and go to /root.

    3. Type "./backup.sh".

    That is a script that goes to all the directories I care about (/root, /etc, /srv/www, /usr/local/share, and my home directory), and basically does this for each drive.

    cd $DIR rsync -avz --progress --delete . $MNT/$DIR

    where $MNT is where the USB drive mounts.

    4. Unmount the drive and unplug it.

    This is quick (a few minutes) and easy, and since rsync reads the files from the last backup to figure out what needs to be copied, it should catch it if I develop a bad sector on the USB drive.

    I left it out in the above, but the backup script also, before doing the rsyncs, lists my crontab into a file, so that gets backed up.

    1. Re:Easy by Id+guy · · Score: 0

      Remember, "It's not backing up thats hard.It's restoring".

    2. Re:Easy by Anonymous Coward · · Score: 0

      My dad learned the hard way that a USB drive may be a good backup, but you really need to take it offsite.
      His computer was stolen, and they took the drive off the bookshelf too.
      That drive didn't help a bit.

    3. Re:Easy by Rich0 · · Score: 1

      The only problem with this solution is that there is no encryption. If you plan on storing your backups offsite, then you should probably consider having it encrypted.

      I've yet to find an adequate FOSS backup solution that meets the following requirements:

      1. Able to backup only specified directories (I really don't need a backup of /usr/bin).

      2. Backups are strongly encrypted.

      3. Backups are fault-tolerent. (If I lose one byte in the middle of a CD, I don't want to lose the whole thing.)

      Right now my solution is to tar/bzip/split/gpg everything into a couple of files. Then I copy to some spare space on a work laptop. The gpg private key is backed up separately and stored in a safe place not with the backups.

      Unfortunately, this does not handle #3, but since I'm storing this on a hard drive I'm not as concerned about that. If I were burning to CD, I would definitely want some kind of error recoverability and graceful failure (maybe losing a file, but not the whole thing).

      Any suggestions? Conceptually I could see a solution using bzip and then separately encrypting each compressed block of data. A fast implementation would use a single session key for all the blocks so as to minimize the amount of RSA involved.

    4. Re:Easy by Lumpy · · Score: 1

      yuck.

      I simply do the following in a cron job that run's nightly.

      tar -czvf /dev/st0 /; mt -d /dev/st0 eject

      this dumps the contents of all drives to the SDLT tape drive. One tape 240Gig of files... and then eject's the tape. now swaping the tapes in each server every morning is the hard part... every tape is a complete backup that way i have 5 copies of all files incremently 1 day older than the other on hand and 16 copies off site. 4 weekly's and 12 monthlies.

      the larger database server has a jukebox, MT commands to control that were hard to find so I have the jukebox cycle out the tapes on it's own. (ATL, I hate their software but their hardware is great! 20 tapes and when eject is detected the tapes are rotated.) although a jukebox full of data is a bitch to keep an offsite copy of.

      backups are easy if you have the right equipment.

      --
      Do not look at laser with remaining good eye.
    5. Re:Easy by Fweeky · · Score: 2, Informative

      PAR2 can help with #3, provided your backup's filesystem remains readable.

    6. Re:Easy by vk2 · · Score: 2, Informative
      --
      No Sig for you.!
    7. Re:Easy by Anonymous Coward · · Score: 0
      My backup system does that. Essentially, it:
      • keeps a list of previously backed-up files
      • chooses new files to backup from the disk, ordered by (1) new files, (2) recently-modified files, (3) unchanged files
      • while the media is not full, selects a chunk of that list, and
      • tars, encrypts and gzips (in ONE step, I wrote a reimplementation of tar for this) to an output file
      • updates the free space on the media based on the size of the created file
      • loops back to get more files to do, until the media is full

      The net result is that every time I backup (to CDR), I get ONE cdr which is full of data each time, and it contains multiple files, each of which is independently encrypted. So if a CD block becomes unreadable, only one file (out of 40 or so) is ruined.

      Also the order in which files are chosen for backup ensures that I get a backup of all newly created files quickly, and multiple backups of files which change frequently. Finally, in order to guard against the problem of ruined files, files which have not changed are also backed up again on an irregular basis (depending how much other file activity I have). This whole system helps me to backup large quantities of data (60 gigs or more) onto 700 meg CDRs, without going crazy.

    8. Re:Easy by Rich0 · · Score: 1

      I was originally copying files, then gpg'ing them and then tarring the result. This has the benefit of better fault-tolerance. However, it doesn't encrypt the filenames. Granted, filenames aren't everything, but I'd rather if anybody with access to my backup media (such as my employer) wasn't able to just browse them.

      In the end I'm tarring first, then gpg'ing second. The downside is that I'm not sure how much fault-tolerance I have. I think gpg can be coaxed to generate as much output as it can, but I'll have to cross my fingers and just hope I don't lose anything. Since I'm backing up to a hard drive, I'm less worried about that.

  16. super compression by supergwiz · · Score: 3, Funny

    Someone taught me a cool trick to backup up all files with the highest possible compression ratio and speed: mv * /dev/null

    1. Re:super compression by rat_love_cat · · Score: 1

      I guess that's the extream end of lossy compression.

    2. Re:super compression by Anonymous Coward · · Score: 1, Funny

      I just tried that, where did it backup my file to? I can't find them.

    3. Re:super compression by Steffan · · Score: 5, Funny
      I just tried that, where did it backup my file to? I can't find them.
      That's easy, just use:
      cat /dev/zero > /dev/hda
      to get all of the zeros back. (The compression used takes care of all of the ones for you).
    4. Re:super compression by Anonymous Coward · · Score: 1, Funny

      v1.1 (same ratio, improved speed)

      echo "backup completed"

    5. Re:super compression by Anonymous Coward · · Score: 0

      Someone taught me a cool trick to backup up all files with the highest possible compression ratio and speed: mv * /dev/null

      This works fantasticly, how do I run a test restore?

    6. Re:super compression by sloanster · · Score: 1

      That's really cool, but it's a write-only backup...

    7. Re:super compression by WinterSolstice · · Score: 1

      Ironically, that probably isn't the highest possible speed.

      We used to take "bogus" backups from our DB and run them to /dev/null, however on our OS, /dev/null was not multi-threaded. We actually found that backing up to our disk array was faster, and then we could just rm it afterwards.

      Of course, now that I think about it, since mv is just a pointer command, it might be... cp * /dev/null would be slow, though.

      -WS

      --
      An operating system should be like a light switch... simple, effective, easy to use, and designed for everyone.
    8. Re:super compression by gardyloo · · Score: 1

      :) God, where are my mod points when I need them?

    9. Re:super compression by Valdukas · · Score: 2, Funny

      And hey, you can probably even restore it... But that's what you want, right? Fast backup and slow restore process... with hex tools on /dev/hda

    10. Re:super compression by Psykechan · · Score: 1

      You really should be using lzip to back up your information.

      It uses lossy compression (just like the compression found in popular MPEG and JPEG files) to get much better that the 2:1 average compression found in "standard" methods.

      Play around with the options and you'll be amazed at the speed and power. Use it for all your backup needs and you'll never worry about your data again.

  17. Cool Open Source Backup Software by Linker3000 · · Score: 1

    There's Dar (as mentioned in the article) and also bacula for remote backups - go check them out if they're new to you.

    --
    AT&ROFLMAO
    1. Re:Cool Open Source Backup Software by Kent+Recal · · Score: 1

      Thanks for the pointer, dar is really awesome.
      I knew bacula before but never got around to actually test it.
      It seems a bit bloated to me and while many features it has are nice it lacks the smartness of dar.

    2. Re:Cool Open Source Backup Software by Anonymous Coward · · Score: 0

      I'm running Bacula to back up a small network (11 PCs) of Windows 2k/XP machines (and 2 Linux ones) and must say it's the closest you can get to any commercial backup software. Unfortunately it is very guided towards tapes and many of the interesting features (volume migration, encryption, GUI, ...) are still work in progress, but it is being actively developed and constantly growing/improving (most recent addition: The ability to backup to DVDs automatically). The only real nuisance is that it can't back up open files on Windows (nobody seems to dare and touch that) so you have to circumvent that by using St Bernards Open File Manager or ntbackup/batchfile tricks.

      Anyway, I'll happily recommend it if you have a tape drive or library/changer (never tested it with other backup media) and a hybrid Windows/Linux network to back up without wanting to pay for expensive backup software.

  18. Re:Let's get these out of the way... by Anonymous Coward · · Score: 0

    Re:Let's get these out of the way... (Score:2)
    by Cro Magnon (467622) on Thursday January 13, @02:08PM (#11351110)

    In Korea, only old people backup.


    In Soviet Russia, old people backup Koreans.
  19. Don't sleep with a fan on in a closed room! by Anonymous Coward · · Score: 0

    The fan uses up all of the oxygen and you suffocate. Many people in Korea have died becuase of this, but the CIA and Fox news don't want you to know.

  20. Why would I even try this? by Anonymous Coward · · Score: 0


    "...prevents the restoration of individual files or directories from an archive at present"

    "I lost the first two archives I created, and I'm still not positive how I did it"

    "So go ahead, laugh at me"

    Alrighty then :)

  21. In case of /. ing by Pig+Hogger · · Score: 3, Interesting

    A hard drive crash over the holidays left me scrambling to get back to a productive desktop as quickly as possible. Luckily, I had my /home partition on a separate drive, so I didn't lose precious email, stories, research, and pictures. But it did get me thinking about my lack of preparedness. Where was the back-up system I've talked about for years, but never acquired? This is the tale of how I rectified that glaring omission, and built myself a personal back-up system using inexpensive parts and free software.

    The hardware

    My desktop machine includes three IDE drives and an ATAPI CD-ROM drive. I have Debian installed on hda, SUSE on hdc, and my /home directory on hdd. Backing up directly to CD would be too slow and too cumbersome for me, so the first thing I needed was some new hardware.

    In the past I've researched tape drives and found that for a decent drive, I would also have to add a SCSI controller. Those two items can be pretty pricey. I opted for a less expensive configuration.

    I decided to go with a removable IDE drive, connected via USB. I bought a 3.5-inch hard disk enclosure with USB 2.0 connectivity on eBay. It cost roughly $45, including shipping. With three drives to backup, I needed a large-capacity IDE drive to hold all the data. It turns out I already had one, just waiting for me to use. I raided the stash of goodies I've been hoarding to build a killer MythTV box and found a 250GB Hitachi DeskStar -- just what the doctor ordered. I got it on sale at Fry's Electronics a couple of months ago for $189.

    I have the mechanical skills of a three-toed sloth, but I still managed to cobble together the drive and the enclosure, neither of which came with directions. Four screws hold the faceplate on the enclosure, and four more hold the drive in place inside. Even I was able to puzzle it out.

    The most difficult part was the stiffness of the IDE cable running between the faceplate and the drive. In hindsight, I recommend connecting the power and data cables from the faceplate to the drive before screwing the drive in place inside the enclosure. I also recommend not forgetting to slide the top of the enclosure back in place before reattaching the faceplate.

    I connected the USB cable to the enclosure and the PC and powered on. Using the SUSE partitioning tool, I created an ext3 filesystem and formatted it on the Hitachi drive, using the default maximum start and stop cylinders. That worked, but there was a problem. My great big 250GB drive yielded only 32GB.

    One of my OSTG cohorts asked if had clipped the drive for 32GB max, but I had done no such thing. All I did was check to see how the drive was strapped out of the box. It was set to Cable Select, which was fine with me, so I left it like that. His question worried me, though, because I had never heard of a 32GB clip thingie before.

    I called Hitachi support to find out what was up with that. Their tech support answered quickly. When I explained what was going on, he agreed that it sounded like it was clipped to limit its capacity. This functionality allows these big honkers to be used on old systems which simply cannot see that much space. Without it, the drive would be completely unusable on those machines.

    I asked why in the world they would ship 250GB drives configured for a max of 32GB by default, and he denied that they had. He asked where I got the drive, then suggested that Fry's had "clipped" it for some reason. There are jumper settings to limit the capacity, but my drive had not been jumpered that way. Perhaps Fry's sold me a returned drive that a customer had "clipped", then returned the jumpers to their original position. We'll never know.

    The tech told me how it should be jumpered for Cable Select without reducing capacity. I opened the USB enclosure, pulled out the drive, and found it was already jumpered as he described. Undaunted, I pressed on.

    On the Hitachi support page for the drive, I found a downloadable tool wh

  22. I use a DVD-RAM burner by A+nonymous+Coward · · Score: 1

    4.7GB each side. Being in cartridges, they supposedly have a much longer lifetime than DVD-RW. Plenty for weekly full backups. I don't backup the system directories like /usr/bin because they are from an install. I backup /etc/ /home /root /usr/local /var/{various}. No need for anything fancy.

  23. Backups are simple by Lord+Kano · · Score: 1

    It gets hard when trying to find an affordable system to do it.

    Tape drives and media are fairly expensive when you start to get into the capacities that are convienent for backing up. Using another HDD is just as expensive. CD and DVD backup is virtually out of the question for even moderate capacity drives.

    LK

    --
    "Hi. This is my friend, Jack Shit, and you don't know him." - Lord Kano
    1. Re:Backups are simple by homerules · · Score: 0

      It all depends on how valuable your data is to you. photos of the dog humping your leg may not be worth the expense, but the research project you have been working on for over two years may be worth it.

  24. NTBackup by CypherXero · · Score: 1

    On my Windows machines, I run NTBackup.exe every single night, so that I have a 24 hour old backup, incase the worse happens. It's saved me plently of times.

    1. Re:NTBackup by Anonymous Coward · · Score: 0

      Uh, who the fsck cares whether or not a winblows machine is backed up? Wouldn't it be better if it bombed? Then you could get rid of all that nasty bloatware and install a nice stable *nix OS on that pretty hardware.

    2. Re:NTBackup by myz24 · · Score: 1

      The backup tool in Windows XP uses volume shady copy to do it's work and it does a surprisingly good job. It works rather well when reinstalling Windows on a machine. The downfall of the program however is it's lack of proper redirection.

  25. Speaking of backing up by Anonymous Coward · · Score: 0

    A largely on-topic question:

    I'm using an external USB drive to back up my music collection every couple of weeks. My main system drive is ext3, but my external backup drive is fat32 (for compatability with Windows). I'd like to use rsync to only copy over the new/changed music. But for whatever reason rsync always copies _everything_ over. I'm suspicious that it has something to do with the file system differences...rsync is always complaining about being unable to change permissions on the fat32 drive. Anyone gotten this to work properly?

  26. I just tend to do... by Anonymous Coward · · Score: 0

    dd if=/dev/hda3 > gzip -c9 > /nfsshare/hda3backup.gz
    which is of course slow and not very flexible, but works...

  27. Re:Let's get these out of the way... by tsanth · · Score: 0, Offtopic

    In Communist China, the government shoots old people backing up Koreans and makes the family pay for the bullet.

  28. Heh, noob mistake by stratjakt · · Score: 5, Interesting

    He plugs in a USB drive, runs KDar to fill it with stuff.

    Now, when his system borks, how does he restore? Or did he think that far ahead?

    I skimmed the article, and nothing about restoring. Your backup is useless if you can't restore it.

    Does he have to install and configure linux, X, and KDE just to be able to access KDar?

    Forget all this jibberjabber, and emerge or apt-get or type whatever command you use to get Mondo/Mindi. Just perfect for home boxes, and most other use.

    Burn yourself a bootable CD that can recreate your box, just like Norton Ghost for Linux. I have it write out the iso files and boot disk for /bin /usr, etc, which I then burn onto a couple of DVD9-Rs. I can run this to recreate my system.

    I run a seperate job to backup /home.

    Whats important, is to seperate system from user data when it comes to backups. This also forms my "archiving" system, since old "/home" backups stick around, so if I want to take a look at the version of foo.c I was writing 6 months ago, it's easy enough to find.

    As much as I love Mondo/Mindi, it's not the be-all and end-all. AMANDA is a better choice for a corporate (more elaborate) environment. It's a PITA and not worth getting involved with for a simple user box.

    --
    I don't need no instructions to know how to rock!!!!
    1. Re:Heh, noob mistake by Azureflare · · Score: 1
      Just curious, did you mean that AMANDA is a "PITA and not worth getting involved with for a simple user box?" or is mondo/mindi? That was a little unclear...

      Thanks for the info.

    2. Re:Heh, noob mistake by Concern · · Score: 1

      Mondo/Mindi sounds interesting, I hadn't heard of them before. But, do I read the website correctly? Are they really suggesting CD/DVD backups? Even with 9.4GB DVDs, that is 50 disks for me...

      Given the absurdity of tape storage at the moment HDs in trays are really the only option for me (and many others, I suspect).

      KDAR is BS as well, of course. I studied it quite a bit. It's promising but basically a toy. Can't even do proper incremental backups. The endless search continues...

      --
      Tired of Political Trolls? Opt Out!
    3. Re:Heh, noob mistake by AKnightCowboy · · Score: 1
      Even with 9.4GB DVDs, that is 50 disks for me...

      You have 500GB of essential data to backup at home? Are you into video or something? Anyway, if you check out their web site it says it works with almost anything so get two 250GB USB hard drives and have at it.

    4. Re:Heh, noob mistake by stratjakt · · Score: 1

      No, you don't use mondo/mindi to do a whole system and data image, just the system. That is, all your stuff in /etc, /bin, /usr. You backup the data elsewhere, or use another method (copy your pron collection to tape or external HDD).

      When your computer's head a-splodes, you just boot the mondo disc, it rebuilds your system, and you go ahead and copy your data back on.

      Like I said, I put everything but /home on a mondo backup. For my test gentoo "install every friggin thing there is just because" machine, it all fits on a single DVD. KDE, GNOME, OOo, SO, RTCW:ET... all of it.

      It's like Norton Ghost in functionality, only slightly more flexible (since you can exclude paths).

      --
      I don't need no instructions to know how to rock!!!!
    5. Re:Heh, noob mistake by stratjakt · · Score: 1

      mondo/mindi is easy as pie, they have a little ncurses based wizard to walk you through. Mondo creates the ISOs, mindi creates a boot floppy image you can restore with (or use to make your ISO bootable).

      AMANDA is a big networked tape backup solution, for big networked tape backup problems. I got a headache reading the docs, which told me it wasn't for me.

      --
      I don't need no instructions to know how to rock!!!!
    6. Re:Heh, noob mistake by Anonymous Coward · · Score: 0

      Now, when his system borks, how does he restore?

      Boot from Knoppix, then restore. Sure, he would need to partition and format the disk by hand.

      His solution is also fine for the more common case where he just needs to recover one or two files, rather than his whole system.

      Mondo/mindi sounds good too, but I think you were a bit harder on him than you really needed to be.

    7. Re:Heh, noob mistake by stratjakt · · Score: 1

      Anyone who discusses a backup solution, and doesn't bother to mention recovery, deserves to have people be hard on him.

      It's an epidemic in IT. You don't know how many fucked up machines I've seen, with untested, unusable, absolutely useless backups.

      Test your backup solution! Pull your live drive, swap in a blank one, and see if you can restore to where you were. If you can't, you aren't doing it right.

      One time I was presented with a machine with a dead HDD, and a backup tape I was asked to restore. The tape was still shrinkwrapped. I fucking kid you not. They must have thought it backed up via osmosis? Even if that's what they thought, surely the plastic wrapping would prevent such osmosis.

      Oy vey

      --
      I don't need no instructions to know how to rock!!!!
    8. Re:Heh, noob mistake by dbIII · · Score: 1
      AMANDA is a better choice for a corporate ... environment
      Doesn't amanda use "dump", which does not run reliably under linux? Doesn't it also die if you can't fit everything on one tape? It does give you a lot of info about what is going on, but apart from that simple scripts using tar seem to do a better job. Amanda requires a bit of stuffing around to recover things, but tar takes minutes to install even on a different OS, assuming it isn't already there.

      I've only had to deal with recoving files produced by dump when others have failed, so I don't really know how unreliable it is - but when you can get the file you need from both backups due to different errors at different points you don't care about those people that say "it only has occasional problems".

    9. Re:Heh, noob mistake by mark_lybarger · · Score: 2, Informative

      i've used mondo/mindi for backups from a gentoo system. a few minor quirks.

      first, the mondo developer doesn't play very nice with the community, and there isn't a lot of community involvement on the mondo forums (who wants to spend time on a archive software forum).

      second, mondo backups are incompatible between versions. some time back i was using mondo 1.6.x or some such. i got rid of that machine, and a month later wanted to restore some data from the backups. the new machine had mondo 2.x installed. it completely bailed on restoring from the older archive. since i was on gentoo i could easily install the version of mondo i needed to restore from. just a slight issue, especially if you're using gentoo with automated updates.

      thirdly, mondo handles files in a "propriatary" manner. there's gobs and gobs of different archive files on the disk and finding which one has the file you want (outside of the mondorestore interface) is challenging. i don't understand why one big ass tgz file wouldn't be sufficient, but i'm sure there's reasons.

      after quite some time w/o a backup, i'm off to re setup my mondo backups. mondo doesn't work nicely with cron either. takes a little work to grab and at script and then cron that.

      i can say that having mondo backups and restoring from them has been handy, handy.

    10. Re:Heh, noob mistake by thogard · · Score: 1

      dump is specific to the file system. This is why bsd had "dump" and solaris has "usbdump". The dump program should go through the in-memory image of the file system and dump each inode out in a sane way being careful to make sure only a checkpointed image is written. This means you have to have a deep understanding of the internals of the specific filesystem in order to write a dump program.

      I don't use any file systems that don't have a proper dump command written for them but I like to keep my data.

    11. Re:Heh, noob mistake by elchavobeer · · Score: 1

      Even more obvious is this sentence in the article: "A known bug in the current version (1.3.1) prevents the restoration of individual files or directories from an archive at present, but that may be fixed in the next release" I don't know about anyone else, but if I just want to restore one file the last thing I have in mind is to restore the whole disk, that's just bound to eventually lead to disaster. "Um, honey, good news is I found that recipe you accidentally deleted. Bad news is I wiped out everything else.." Seems like almost anything would be better (rsync, mirrordir, cp)! EL CHAVO!

      --
      Es que se me chispotio!
  29. Your backup is fine it's restore that doesn't work by Guy+Smiley · · Score: 1
    A known bug in the current version (1.3.1) prevents the restoration of individual files or directories from an archive.

    How often do people want to restore the whole archive vs. just a single file? Almost never. This is pretty typical of "backup" solutions and how people implement them, they test the backup but rarely test that you can restore from same.

  30. Switch to OS X by Anonymous Coward · · Score: 0

    Everything on OS X works and works well. So quit struggling to get such simple things as backup working on your primitive Linux OS and switch to the greatest OS ever conceived. OS X.

  31. Or, if you have another computer handy... by diamondsw · · Score: 2, Informative

    Just do an NFS or SMB mount:

    mount -t smbfs -o username:password \\10.0.1.111\backup /mnt/backup
    cd /mnt/drive
    tar -cvjf /mnt/backup .

    (If I recall the commands correctly.) I use this all the time to make quick snapshots of my Gentoo installation before emerging some bleeding edge package.

    --
    I don't know what kind of crack I was on, but I suspect it was decaf.
    1. Re:Or, if you have another computer handy... by Anonymous Coward · · Score: 0

      better make sure you are properly archiving all symlinks and file permissions and timestamps or your restore will give you a messed up system.

    2. Re:Or, if you have another computer handy... by diamondsw · · Score: 1

      Good point. I should have placed a sudo in there. That and the resulting archive will be bzipped (-j flag), so it should be a .tar.bz2:

      sudo tar -cvjf /mnt/backup/drive.tar.bz2 .

      --
      I don't know what kind of crack I was on, but I suspect it was decaf.
    3. Re:Or, if you have another computer handy... by kguilber · · Score: 0

      Quick? Jeez, you'll spend forever bzip2'ing all those files...

    4. Re:Or, if you have another computer handy... by diamondsw · · Score: 1

      Quick is relative. In my case, it takes an hour or two, but compresses a 3GB partition down to 500MB. I don't have the money for a nice 500GB drive, but I can run it overnight quite easily.

      --
      I don't know what kind of crack I was on, but I suspect it was decaf.
    5. Re:Or, if you have another computer handy... by Jesus+IS+the+Devil · · Score: 1

      And what if a single file is larger than 4GBs? Then your tar will break...

      You can try bru, but that costs $ and isn't that user friendly.

      --

      eTrade SUCKS
  32. Restoration problem??? hmm... by St4rNin3 · · Score: 2
    "A known bug in the current version (1.3.1) prevents the restoration of individual files or directories from an archive at present, but that may be fixed in the next release."

    i don;t know about everyone else, but isn't that one of those things that should have come up pretty early in BETA testing?
    "Great backup program.. too bad it can't restore"

    1. Re:Restoration problem??? hmm... by __aamcgs2220 · · Score: 0

      Is it called a Restore program? No, it is not. I, for one, welcome their commitment to truth in advertising.

    2. Re:Restoration problem??? hmm... by tverbeek · · Score: 1

      If you have a backup, but can't restore it, you don't have a backup. This is why Backups Must Be Tested.

      --
      http://alternatives.rzero.com/
  33. Lain by Id+guy · · Score: 0

    Lain is the main person in "Cereal experiments Lain",which is a japenese animated TV show(ANIME for short).

    1. Re:Lain by Anonymous Coward · · Score: 0

      mmm... cereal...

  34. Re:Let's get these out of the way... by ttldkns · · Score: 1

    Backups are fun!(2)

    (2)Do not eat backup

    --
    How many computers are too many?
  35. Is it working? by Anonymous Coward · · Score: 0

    User: I think my back-up is dead

    Linux: No, no.....No, 'e's stunned!

    User: STUNNED?!?

    Linux: Yeah! You stunned him, just as he was wakin' up! tar's and cpio's stun easily.

    User: Um...now look...now look, mate, I've definitely 'ad enough of this. My backup is definitely deceased, and when I started it 2 hours ago, you assured me that its total lack of progress was due to it bein' tired and shagged out following a prolonged mount.

    Linux: Well, he's...he's, ah...probably pining for the fjords.

  36. My solution by ptomblin · · Score: 1

    1. External USB drive. (Actually two, so that one can be on the shelf and one plugged in). The drive is bigger than my existing system disk, and partitioned as one big bootable partition.

    2. A cron job that runs 4 times a day that does

    for DEST in /media/usb* ; do
    if [ -d $DEST/home ] ; then
    rsync -aSuvrx --delete / /boot /home /usr /var /mp3s $DEST
    fi
    done

    If anything went wrong with the main disks, it would be pretty simple to get grub installed on the USB drive, and whip it out of the external enclosure and into the computer.

    Simple, unattended, and easy to recover from. The only thing I'd add to this is that I'm thinking of doing a /etc/init.d/postfix stop /etc/init.d/innd stop

    before the backup and a similar start afterwards to get the system a little more quiescent.

    --
    The next Cmdr Taco duplicate will be ready soon, but subscribers can beat the rush and see it early!
  37. Simply stunning by Anonymous Coward · · Score: 0

    I'm no MS lover, at all, but do the steps involved to get this backup system working seem unbelievably, insanely, over complicated to anyone else? And the backup software doesn't have the ability to restore individual files or folders due to a bug??? That's like a "bug" in my car that makes in not a car.

    Backing up my windows machines:

    1. Hook up usb One Touch drive

    2. Press button on drive.

  38. BackupPC by endeitzslash · · Score: 1

    http://backuppc.sourceforge.net/

    A beautiful program for doing network backups. Slick web GUI, file pooling, etc. I have all of my personal PCs (mixed Linux/WinXP) at home backing up to a Mandrake box. You obviously are limited somewhat by your network speed when doing full backups. . .

    Ed.

    1. Re:BackupPC by martin_b1sh0p · · Score: 1

      Mod parent up as informative. I use backuppc at home for a mixed Linux / Win environment and it works great. And has a great web interface.

  39. Rdiff-backup by sterno · · Score: 1

    Personally I use the same sort of setup but use rdiff-backup to do the actual backup/restoration. It's really nice because I now have nightly differential backups of my system without consuming a large amount of disk space.

    Also, rdiff-backup allows for remote operations. So you can have a central server back up many desktops, with relative ease. It doesn't have a nice GUI, but then again, I'm running it all through a cron job anyhow, so who cares.

    Restoration is a breeze because the most recent snapshot is just a copy of the regular files, so you can go through and copy over the data. It's a little more work to get a differential snap shot, but it's nice to have if you need it.

    --
    This sig has been temporarily disconnected or is no longer in service
  40. My solution: backuppc by vlad_petric · · Score: 4, Informative
    It's the Swiss Army knife of backing up. It can backup stuff over samba, ssh/rsync, ssh/rsyncd, ssh/tar, direct file access (in other words it doesn't need special software installed on the clients). It keeps a single copy of multiple, identical files, so backing up a bunch of Windoze machines can be done with decent amount of space.

    Restore is also straightforward - it can be done in place, or by downloading a zip/tar file.

    --

    The Raven

    1. Re:My solution: backuppc by Anonymous Coward · · Score: 0

      Just a thought, type it BackupPC so people don't think that it's architecture specific.

  41. Old box archive. by twitter · · Score: 1
    I just dropped my big drive into an old box (P90 from the garbage) and use it via sftp and konqueror's built in handler. The only trick was to use another disk to boot it, and not fool with BIOS other than that so that the kernel sees the big drive and bios ignores it. Everything to be backed up gets written to CDROM then moved to the big archive. Current stuff gets a copy on my local machine and a copy on the archive drive. It's not perfect, but it seems to work well enough. Everything active has two live coppies which are synced by hand or tar -u or find -newer than old tar. Everything old goes to CD.

    KDAR, if it uses KDE's sftp handler, could be used the same way and that would be much nicer.

    I could have sworn that KDE had a synching program but can't remember it's name. That too would be helpful, but I'm too lazy.

    --

    Friends don't help friends install M$ junk.

  42. Problem with this solution by nekoniku · · Score: 1

    The solution doesn't require a SCSI controller, or tape drive, or the ability to grok a scripting language or archiving tool to work, either.

    One worry I have about the backup solution from the article is that there's no redundancy; the author backs up three drives to one large drive. If the big drive fails at the same time one of the backed-up drives fails, he's got a problem. I almost think that if I were in the same situation, I'd switch to RAID-5 inside the box with the whole directory structure on the array (instead of broken up onto different drives the way he has it set now) and back that up to the large external drive.

    Not perfect, but I'd feel a little more secure with it set up that way.

    --
    "It's a wonderful idea. But it doesn't work." -- Tad Danielewski
    1. Re:Problem with this solution by Neuroelectronic · · Score: 1

      what does grok mean?

  43. Mmmmm... Images by twfry · · Score: 1
    I just do full weekly images of my system. I've got two 160Gig Seagates. On one of them there's Win2K and Gentoo installs. About once a week I just boot up a linux floopy and dd either the whole 160G image or whatever partitions changed.

    What I like about this is if I always have a week ago fall back if I mess something up. Or if the original drive fails I just swap the backup in less than 1 min.

    And yes I also do select daily data backups (email, etc.)

  44. KDar? by MonkeyCookie · · Score: 5, Funny

    Is that some kind of sense that allows you to pick out other KDE users in a crowd?

  45. Backups onto USB removable drives = pain by Blymie · · Score: 1

    Backups onto USB removable drives?

    Not if you _care_ about your data! The drivers for this stuff seem to be very betaish. Lockups, garbled writes, non-standard implementation.

    It's just not worth the hassle...

  46. Backup Easy! by Anonymous Coward · · Score: 1, Interesting

    Try this:

    mirrordir

    cron it out hourly

    or

    find /home/joeuser/etc | afio -o -v -Z -L /home/joeuser/backups/backup.log /dev/st0

  47. Snapshot? by khrtt · · Score: 1

    Is there a snapshot-capable filesystem on linux that can backup off of the snapshot, so you don't have to stop your production apps?

    I mean, after all, who cares if he backs up to DVD or CD or network, or whatever. We all know linux is good at moving data. I usually backup with tar -cz to a tarball on CD, and I can restore from this from a minimum CD boot, and I don't get the idea to brag about it on slashdot either.

    Choosing this or that media is a non-problem, as long as you understand the difference between an off-site and an on-site backup, and as long as you have some plan as to how you're going to restore your backup in case of total system failure, and how you're going to be able to pull individual files off of the backup (this guy doesn't, but at least he realizes that).

    Now tell me how you're going to backup your system without stopping it. Of course, if it's a home system, you can stop it with less pain than a large server, but still it's a pain in many cases.

    1. Re:Snapshot? by ceswiedler · · Score: 1

      The example of this I've heard is LVM and XFS. I believe that XFS allows you to freeze changes to a filesystem, and LVM can write a snapshot of a partition to another disk. Then you backup from the snapshot.

    2. Re:Snapshot? by Kent+Recal · · Score: 1

      I have had some trouble with linux LVM (both 1 and 2) and would suggest to perform heavy testing before trusting it on a production system.
      The two LVM setups I had both broke down in exactly the moment when there were needed - when a disk failed. I had no success in reviving the volumes with a new disk (or without) and even though most of the data could be recovered with some heavylifting (no big surprise - the other disks were fine after all) it would've been a nightmare in a production env.
      I'm still not sure what exactly went wrong but the normal recovery procedure didn't work and the LVM tools act *very* flakey when anything goes wrong.

      I have no expirience with XFS but the freeze feature sounds interesting.

    3. Re:Snapshot? by ceswiedler · · Score: 1

      LVM isn't designed for any sort of redundancy. If disks fail with LVM, you're just as screwed as if you didn't have it. If you want redundancy, you want to use LVM on RAID. But you seem to have used it more than I have, so I'm curious to know what you mean by "normal recovery procedure".

    4. Re:Snapshot? by Kent+Recal · · Score: 1

      Sorry I was probably unclear.
      Ofcourse I didn't expect to get the data back but LVM should be able to deal with a disc failure so you can swap in a good disk and reconstruct the volume(s).
      That's the part that didnt work for me. LVM spit some strange error messages and refused to accept a new disk. I would probably have been able to create a new volume after manually carving the data from the old one (which couldnt be mounted anymore...) but after that procedure I didn't feel like using it again.
      Except when LVM2 was out for a while I gave that one another shot but on the first disk failure it behaved the same strange way (with other error messages).
      I have now moved back to just "a bunch of disks" for my non-important stuff (the important stuff is on raid) so at least when one fails the others are not affected. Having it all appear as one big disk was a convinient but definately not worth the trouble I had in the end.

  48. Summary by Anonymous Coward · · Score: 0

    I'm writing articles for newsforge, and Linus Torvalds personally replies to my email, but alas I'm not smart enough get Linux to work for me the first time.

    1. Re:Summary by stratjakt · · Score: 1

      You forgot this:
      "And I can't restore files from my backup solution.

      Oh yeah, the first two archives I maid dissappeared for reasons I don't understand."

      Now I remember why we don't use linux in the office. Asshats like this guy write a moronic article like this, and my PHB reads it, and says "You can't even restore files from a backup on linux!!!!"

      Mondo/Mindi for your home/personal system restores (Norton Ghost-like), AMANDA for your enterprise or networked stuff, and tar/rsync for everything in between.

      --
      I don't need no instructions to know how to rock!!!!
  49. NSLU2 and rsync work great by comrade1 · · Score: 1

    I've got a Linksys NSLU2 running the Unslung firmware. The Unslung firmware lets me run the NSLU2 as an rsync server.

    On my Powerbook I'm running rsync, configured with rsyncbackup.

    I live on the East Coast but travel to the West Coast every couple months. I've got it configured so that every night my powerbook just backs itself up to my NSLU2 sitting under the bed (with a very quiet 350GB Maxtor USB drive) no matter where I am.

    I also back up my gf's Win2K and WinXP laptops as well as a FreeBSD box on the West Coast. I'm very happy with the setup.

  50. no incremental by SuperBanana · · Score: 1
    That's not easy- that's foolish. What if you discover a file is corrupt/missing AFTER you do one of your backups?

    There's a reason incremental backups have been around for two plus decades, and "update the difference between two drives with rsync" is not "incremental".

    If you were going to reply and say "oh, but I only do it every X weeks", well- you'll now loose weeks of work if you loose a file/drive.

    1. Re:no incremental by bloosqr · · Score: 2, Informative

      Actually we use rsync for incremental backups and it works quite well. Its a simple modification or scripting of rsync commands and can be all scripted away pretty easily..

      b-loo

    2. Re:no incremental by fshalor · · Score: 1

      Incremental above, with creating images of the incremental stuff with the current date-time stamp in the file name. then dvd-record out the images when you get some stored up.

      I do it over nfs and smbfs mounts using rsync to dvd-r's and dvd-rw's.

      --
      -=fshalor ::this post not spellchecked. move along::
    3. Re:no incremental by Anonymous Coward · · Score: 0

      "well- you'll now loose weeks of work if you loose a file/drive."

      I hate that shit. Just this last weekend, my dickhead neighbor loosed weeks of work on me! I couldn't believe it... the weeks of work just came right after me, ripping my pant legs up and shit. Later that evening, though, I loosed a USB hard drive with a file on it and popped that bitch in his forehead.

      Learn to spell, you fucking loser.

    4. Re:no incremental by grumbel · · Score: 1

      ### That's not easy- that's foolish.

      Yep, but luckily rsync provides the options --backup and --backup-dir which makes it easy to create increments. Actually not exactly increments, but the files deleted between the previous and the last rsync run, but in the end they serve pretty much the same.

    5. Re:no incremental by Anonymous Coward · · Score: 0

      What do you do when you need to do a restore and discover your USB hard drive has failed?

    6. Re:no incremental by Anonymous Coward · · Score: 0

      The same thing you do when you go to restore from tape and find the tape is corrupt and you have no clones. Cry.

  51. hardware by Anonymous Coward · · Score: 0

    NewsForge is running a story this morning on a personal hardware/software backup solution for your Linux desktop

    How exactly do you "backup" the actual hardware?

  52. Biggest problem: consistancy during backup by wowbagger · · Score: 1

    The biggest problem with backing up a live system is maintaining consistancy during the backup - a backup can take hours, and if the system is changing state during that time, you can have the last half of the backup being inconsistant with the first half.

    For example - you might have something that changes both /usr/a/foo and /usr/z/bar at the same time, but if /usr/a/foo gets backed up, then thirty minutes laster /usr/z/bar gets backed up, that is a thirty minute window in which a change can happen and render the backup invalid.

    That is why I suggest, for any system where you cannot take it down to single user mode during the backup, you use LVM to create the filesystems, and leave a bit of extra, uncommitted space in the LVM logical group. Then, you can:

    Take system down to single user mode.
    Take an LVM snapshot of the volumes to be backed up.
    Bring system back up to normal mode.
    Mount snapshot (read only, of course).
    Back up snapshot.
    Release snapshot.

    Even should the system change the state of the filesystem, LVM will keep the snapshot'ed state around, allowing it to be backed up with a minimum of fuss.

  53. unison by sometwo · · Score: 1

    Lately I've been using Unison to back up to my ipod: http://www.cis.upenn.edu/~bcpierce/unison/ It's cross-platform and works on mounted file systems as well as ssh. Also if I add documents on my ipod, changes are made to the source (if I say so). All in all, it's a great little (free) tool.

  54. How I do it. by dameron · · Score: 1

    I'm sure there are better ways, but here's a paraphrase of my backup.sh. Whole thing took about 25 minutes with testing.

    today=$(date +%F)

    zip -r -u /hd2/backups.zip /collected
    cp -v -f -u /hd2/backups.zip /hd2/iso
    rm -r -f /hd2/iso/date*
    mkisofs -r -J -o /hd2/image_$today /hd2/iso
    cdrecord -v -speed=16 dev=0,0,0 -data /hd2/image_$today
    eject cdrom1

    Where "collected" are files copied to the local machine through a series of smb mounts and copied across the network as well as important files on the local system that need backup. And "/collected" and "/hd2" are on different drives.

    So every morning I get dated dvd of all my important files and I have them collected on two additional hard drives.

    -dameron

  55. LOL...Bug prvents restoration by Colin+E.+McDonald · · Score: 1

    "A known bug in the current version (1.3.1) prevents the restoration of individual files or directories from an archive at present, but that may be fixed in the next release. " That sounds like something Veritas wrote.

  56. Pathetic by agw · · Score: 2, Informative

    Copying data to a single IDE drive and calling it "backup" is just pathetic.

    He should read the Tao of Backup http://www.taobackup.com/ and be enlightend.

  57. My simple fairly inexpensive solution by nizo · · Score: 1

    I have an old machine with a removeable IDE drive bay in it and a fair number of ide disks in removeable caddys. I simply backup to that disk (scripts that tar/gzip the data) and when the week is over, shut the machine down and swap in a new disk. I could probably even hot swap it, but I would rather make really sure everything got written to disk. Once nice advantage of this is I can read my backups on any machine with an IDE controller, plus when I need more space I just upgrade to bigger disks and use the smaller disks in machines elsewhere. More expensive than tape, but boatloads faster and easier to verify and restore backups. Plus I don't end up later with a big box of useless tapes when I need more backup space. A nice padded lunchbox sized carrier keeps the disk protected while I take it offsite.

  58. I have sort of an interesting situation at work by adrew · · Score: 1

    I manage the tech/training for student publications at a university. Our server is an Apple Xserve supplied by OIT. It works great but we do not let them back it up because it is prohibitively expensive.

    Our solution was to buy a couple 160GB FireWire LaCie hard drives. They have heavy-duty aluminum cases and USB2, FireWire and FireWire 800 interfaces. I use CMS Products' free BounceBack Backup Express software to automatically syncronize the files on the server to the files on the hard disks.

    It works great. It mounts the server's drive and updates only the files that have changed. We have two drives and alternate backing them up so there is always one off site (my house...ha) in case the building burns down.

  59. Two Words: NORTON GHOST by wernst · · Score: 3, Insightful
    Why even worry about mounting and unmounting volumes from Linux? I just use Norton Ghost, which has been happily backing up my Linux partitions (or whole drives, pretty much regardless of partition types) for a few years now.

    With just one or two boot floppies, I can back up and restore my Linux drives to either: other internal IDE drives, other parititons on the same drive, external USB1 and USB2 drives, burnable CDs, or burnable DVDs.

    Heck, it is so fast and reliable, I've been known to backup the drive just before even *trying out* new software or options, and if I don't like it, I just Ghost it back to how it was.

    Now, I know it isn't free, or even Linux based, but it is hard to argue with cheap, reliable, and fast backup procedures that just work all the time...

    1. Re:Two Words: NORTON GHOST by Ashe+Tyrael · · Score: 1

      last time I heard, that will only touch ext2/ext3, and doesnt like reiser or any of theother "interesting" filesystems.

      --
      "How fine you look when dressed in rage."
  60. And that is easy by flibuste · · Score: 4, Interesting

    I've read the whole article. My! You'd better be a geek to have to cope with all the little worries..

    Getting cheap AND working hardware on E-Bay. My mom will not do it for the sake of her computer.

    32GB limitation by jumpers. Not obvious for an end-user.

    Booting up *nixes from various drives in order to access the limited drive, then fiddle with partitions. I still don't dare touching my configs for more than OS at a time. Let alone various OSes on various drives.

    Compiling KDart?! Compiling what? What do I have to do? "Comp..??" You have to admit, it's not for the dummy kind.

    Definitely not "Backup made easy" but "Made not so expensive" since the price tag still reaches 300$ (drive + box from e-bay + screws + shots of valium to calm you down when your machine refuses to boot after all the offence you just did to it).

    I bought Linux Hacks. This, Webmin and a remote machine accessible using Samba or sftp does the daily backup just fine.

    1. Re:And that is easy by Anonymous Coward · · Score: 0

      "a remote machine accessible using Samba or sftp does the daily backup just fine."

      Using samba to back up remotely seems a little crazy to me... I personally would not trust using a reverse-engineered standard which was created by a company with a history of making terribly insecure software. Plus, isn't samba simply plaintext?

      sftp on the other hand is a good idea.

    2. Re:And that is easy by Anonymous Coward · · Score: 0

      Yeah, because when you're backing up from grannies computer to your own you're really worried that your grandpa may be sniffing the wire...

      STFU

      When you're backing up internally to the network you shouldn't give a shit whether it's plaintext or not, you god damn fucking dumbass.

    3. Re:And that is easy by flibuste · · Score: 1
      I am not an expert and definitely cannot recommand anything. You tell me!

      My point was that the Slashdot title make people think this solution is "easy", but obviously, it means "Linux Geek Easy".

  61. Programs are not the problem by meanfriend · · Score: 1

    There are a million easy to use backup programs for Windows, yet I hardly know anyone that backs up thier home machines. I'm all for easy-to-use GUI tools, and if this is what it takes for someone to do backups, then so much the better. But people dont generally do back ups not because it's hard to do, but because it's inconvienent or requires specific user intervention. People will spend hours downloading and burning movies, but they wont spend 5 minutes putting thier email, bookmarks, and data directories onto a CD/DVD

    Any backup solution wont really be effective unless it it transparent and continues works without ANY user intervention after the intitial configuration. 'Set it; then forget it' as that guy in the informercials likes to say.

    I have a very simple bash script set as a cron job that backs up ~10 important data directories to file server at 5am every morning. But that requires leaving the computers on 24/7 (which I do), but most people dont like doing that. So they either have to 1) schedule thier backups to a time when the computer is likely to be on and risk impacting whatever they have to be working on at the moment, or 2) explicity lauch thier backup program when it's convienent for them (IOW, it never gets done).

    I always berate my friends for not doing backups, but before I got off my own lazy ass and put a backup strategy in place (whether that be taking half an hour to write a simple script or downloading some whiz-bang GUI tool), I probably went 6 months without backing up a single byte. Terrible, I know, but I think we've all seen first-hand the barrier to backing up is not programs, but users.

    1. Re:Programs are not the problem by Anonymous Coward · · Score: 0

      Very true
      I don't leave my PC on 24x7, otherwise I would add a cron job to run at 6am

      You should be able to write a screen saver wrapper that does calls the backup script.

  62. kDAR question, OT ? by Tsiangkun · · Score: 1

    From the kdar home page, it looks like it keeps a catalogue of the files in the archive, but does not keep the catalogue with the archive.

    If you loose the disk that was backed up, and the catalogue with it, is the kdar archive file useless ?

    I use rsync to keep track of daily changes, and tapes to make backups. Tapes have the advatage of not showing up as a drive than can be destroyed if the system gets hacked.

  63. ignorant fool -- welcome to 2005 by Anonymous Coward · · Score: 0

    "I'm not sure how stable usb in linux is" ???

    why? because YOU'VE never used it?

    you are suprised that usb gives you a /dev/sd0 device to use with fdisk?? It's been that way for at least 4 years!

    you've never heard of the jumper on a disk that sets a hard limit in disk size??

    AND YET, YOU CONSIDER YOURSELF EXPERT ENOUGH to write a poorly informed article

    I agree -- you've expertly written a poorly informed article. Even getting in all the elbow rubbing elitism including email from Linus. (Ironically telling you how ignorant you are.)

  64. tarballing as backup by lot3k · · Score: 1

    I just simply take and once a month scheduled (or if any major change is made or about to be made) and simply boot a gentoo livecd, mount the drives I want to backup then simply tar compress recursively from /, then cp it to hdb1.

    If anything goes wrong I simply repeat the steps however I extract them to /mnt/gentoo with corresponding mount points mounted. chroot /mnt/gentoo /bin/bash;env-update;source /etc/profile; grub-install #to rewrite the mbr reboot.... hasn't failed me yet.

    Bottom line is it's easy to backup, save, and restore. I'm thinking about patening this method as "last known good configuration", or "system restore" seems like the thing to do since microsoft has been patening all the *nix technologies as their own lately.

  65. Shameless rdiff-backup plug by BigJim.fr · · Score: 1

    With rdiff-backup, backup dozens of gigabytes effortlessly and restore as effortlessly at any point in time. Add it in a nightly cron job and you are golden !

    From the description : "rdiff-backup backs up one directory to another, possibly over a network. The target directory ends up a copy of the source directory, but extra reverse diffs are stored in a special subdirectory of that target directory, so you can still recover files lost some time ago. The idea is to combine the best features of a mirror and an incremental backup. rdiff-backup also preserves subdirectories, hard links, dev files, permissions, uid/gid ownership, and modification times. Also, rdiff-backup can operate in a bandwidth efficient manner over a pipe, like rsync. Thus you can use rdiff-backup and ssh to securely back a hard drive up to a remote location, and only the differences will be transmitted. Finally, rdiff-backup is easy to use and settings have sensical defaults."

    Read more !

  66. Network Harddrive? by iamwahoo2 · · Score: 1

    A network harddrive is a good solution for a small office. Low Power, fast transfer, large capacities.

    1. Re:Network Harddrive? by Stonehand · · Score: 1

      Depends what you're looking for.

      If you have a need to keep long term backups -- for instance, you're concerned either about data corruption that only gets detected later, or you need to keep records for either data mining or in case of lawsuits -- you probably want a method that's cheaper per GB than hard drives.

      --
      Only the dead have seen the end of war.
  67. here's how I perform backups by ywwg · · Score: 2, Interesting
    if [ `df |grep /media/BACKUP |wc -l` == "0" ]
    then
    echo Backup drive not mounted, skipping procedure
    exit 2
    fi
    cd /media/BACKUP
    nice -n 10 rsync -va --exclude-from=/root/exclude $1 $2 $3 $4 $5 / .
    where /root/exclude contains:
    /mnt
    /proc
    /tmp
    /udev
    /sys
    /media
    Not the prettiest implimentation, but it works.
    1. Re:here's how I perform backups by Anonymous Coward · · Score: 1, Interesting
      It's begging for some shell script golf...

      if [ grep -q /media/BACKUP /etc/mtab ]
      then
      echo Backup drive not mounted, skipping procedure
      exit 2
      fi
      cd /media/BACKUP && nice -n 10 rsync -va --exclude-from=/root/exclude $* / .
    2. Re:here's how I perform backups by daaan · · Score: 1

      #!/bin/sh
      #qndb. Quick N Dirty Backup

      DATE=`date '+%B %d %Y'`

      #delete excess crap
      rm -rf ~/.Trash/*
      rm -rf ~/.thumbnails/*
      rm -rf ~/tmp/gnutella/incomplete/*
      ~/tmp/gnutella/broken/*

      mount /mnt/ext/

      tar -pzcf /mnt/ext/backups/"$DATE.tar.gz" $HOME

      umount /mnt/ext

      /mnt/ext is an external 200 gig usb drive. simple

  68. RSync makes backup easy... by grumbel · · Score: 3, Informative

    In case you have a seperate computer or a seperate drive one can use rsync to relativly easily create backups, its just a few lines of Shell:

    rsync -e ssh \
    --delete \
    --relative \
    --archive \
    --verbose \
    --compress \
    --recursive \
    --exclude-from list_of_files_you_don't_wanna_backup \
    --backup \
    --backup-dir=/backup/`date -I` \ /your_directory_to_backup \
    user@other_host:/backup/current/

    This command mirrors everything in /your_directory_to_backup to user@other_host:/backup/current/ and in addition to that keeps all the changes you did to that directory in a seperate 'dated' directory like /backup/2005-01-15, so you can also recover files that you deleted some days ago. Some other posters seem to have missed the '--backup' option, which is why I repost the rsync trick.

    Disadvantage is that you can't easily restore an exact old state of the directory which you backuped, however you can retrieve all the files very easily.

    There are also floating some shell scripts around which add to the above rsync line some vodoo to hardlink the different dated directories, so that you have a normal browsable copy of each and every day while only wasting the space for the changes.

    And there are also tools which optimize this whole thing a bit more, by compressing the changes you did to files, like http://www.nongnu.org/rdiff-backup/

    However overall I found the plain rsync solution the most pratical, since it doesn't require special tools to access the repo and 'just works' the way I need it.

    1. Re:RSync makes backup easy... by bartle · · Score: 1
      This command mirrors everything in /your_directory_to_backup to user@other_host:/backup/current/ and in addition to that keeps all the changes you did to that directory in a seperate 'dated' directory like /backup/2005-01-15, so you can also recover files that you deleted some days ago. Some other posters seem to have missed the '--backup' option, which is why I repost the rsync trick.

      I would like to second this technique, I use it with some slight modifications. I have a complete second computer with a 250GB hard drive that's responsible for backing up a 100GB server. The backup machine is on a timer so it only switches on each night to do a full replication.

      This is a very good solution because it's cheap, entirely automated, and provides incremental backups. Short of my whole house burning down I'm protected from pretty much any virtual disaster.

    2. Re:RSync makes backup easy... by Pelam · · Score: 1

      I have 2nd. hard drives as backup drives on the desktop machines I use most. Backups are about 50% capacity of the main drive.

      A script rsyncs almost everything to the backup drive starting from /.

      The script also unmounts the backup and spins down the drive when it's done. This should reduce the probability of accidentally hosing the backup file system with the main system (which is easy to do with RAID-1). Noise and power consumption go down too.

      I think spinning down also reduces the probability of a major mishap or hardware failure destroying both drives at the same time.

  69. Backup? by SilverspurG · · Score: 2, Informative

    The best solution for your backup problems is to learn to prioritize. No, you don't need to save your pr0n collection. No, you don't need to save every .jpg anyone's ever sent to you. No, you don't need to save every bad joke e-mail you've ever received. No, you don't need to save... you don't need to save... don't save... don't need.

    When I was young (early 20s) I saved everything. Then I had an HD crash. I started over and, several years later, my new HD inherited an unrecoverable problem. I started over and then went through a run of about 4 Western Digital Caviar drives which each lasted about one year.

    So... what do I save now? As little as possible. Believe me, when you're going through your tree and say to yourself,"well... I might want to save that just in case..." do yourself a favor and hit DELETE. Anytime the word "I might" or "just in case" comes to mind, hit DELETE.

    After you've reprogrammed yourself to have a sane set of backup priorities, you'll find that rsync and tar are more than adequate.

    For corporate solutions... well, that's a whole different story. Then you're getting paid to feed someone else's legal paranoia. Just buy more drives.

    --
    fast as fast can be. you'll never catch me.
  70. Re:Backing up is hard to do, DUH by Anonymous Coward · · Score: 0

    Whoah, backup there for a minute, what was the sexist remark?

  71. Great, more point-and-click software by JoloK · · Score: 1

    ...and what, exactly is the need for this? Oh, no effort... got it.

    --
    JoloK
  72. Backups to removable media and offsite by kbahey · · Score: 1

    I still think that removable media (e.g. tape) is the most effective form of backup.

    Under Linux, a tape drive can be used effectively to backup a home network, specially when you have offsite storage (e.g. take the monthly backup to a friend or to your work).

    Granted, this is only for 10 or 20 GB worth of data, but I am not even half there yet. This does not apply to guys who have a, let's say extensive, collection of movies, or have a huge set of, ahem, images.

    1. Re:Backups to removable media and offsite by Stonehand · · Score: 1

      Yes, for small quantities. I also have my doubts about Travan media and drives; my vacuum cleaner, for instance, has a lethal radius of at least a couple of feet in which it kills such drives (either by vibration or magnetic field? I don't know which, and not running a product testing lab with shelves of spare drives I'm not inclined to test more to find out.)

      If I were building a new machine for personal use and wanting to back up more data, I might look at at a SCSI-based VXA-2 drive for the capacity, speed and hypothetical reliability -- still expensive, but less so than AIT / LTO / Mammoth / SDLT as far as I can tell.

      --
      Only the dead have seen the end of war.
  73. Re: KDar by Ynazar1 · · Score: 1

    Fear the KDar, for it is subtle and quick to anger...

  74. So is a boot to the head by Just+Some+Guy · · Score: 4, Insightful
    That's not a backup - that's a userland implementation of RAID 1 with very high latency.

    I make daily differential backups (via AMANDA) to a rotating set of 12 tapes. If I accidentally delete /etc/shadow or some other important file, I have nearly two weeks to discover the problem and restore a previous version from tape. Your idea gives you, oh, until about the time that rsync discovers the missing file and dutifully nukes it from your "backup" drive.

    What you're doing is certainly better than nothing, but it's not a backup solution by any definition of the term beyond "keeps zero or one copy of the file somewhere else".

    Far, far better would be for your script to use dump or tar to create incremental backup files on your USB drive and to rotate them out on a regular basis.

    --
    Dewey, what part of this looks like authorities should be involved?
    1. Re:So is a boot to the head by phallstrom · · Score: 1

      Or pass these options to rsync changing the value of the backup directory to say the name of the day which would give you a week (or whatever scheme you want).

      -b, --backup
      With this option, preexisting destination files are renamed as
      each file is transferred or deleted. You can control where the
      backup file goes and what (if any) suffix gets appended using
      the --backup-dir and --suffix options.

      --backup-dir=DIR
      In combination with the --backup option, this tells rsync to
      store all backups in the specified directory. This is very use-
      ful for incremental backups. You can additionally specify a
      backup suffix using the --suffix option (otherwise the files
      backed up in the specified directory will keep their original
      filenames).

    2. Re:So is a boot to the head by theLOUDroom · · Score: 1

      That's not a backup - that's a userland implementation of RAID 1 with very high latency. I make daily differential backups (via AMANDA) to a rotating set of 12 tapes. If I accidentally delete /etc/shadow or some other important file, I have nearly two weeks to discover the problem and restore a previous version from tape. Your idea gives you, oh, until about the time that rsync discovers the missing file and dutifully nukes it from your "backup" drive.

      Read his post again. He doesn't leave the drive plugged in.

      If he had 12 hard disks, he too would have "nearly two weeks" to discover the problem.

      --
      Life is too short to proofread.
  75. Re:Let's get these out of the way... by Mathiasdm · · Score: 1

    Well, yeah :-P Over here at slashdot, things can still be new, AND be a cliché!

    --
    Join the anonymous, help develop the network: http://www.i2p2.de
  76. tape/disk backup solution by tamuct01 · · Score: 1

    I've got an older DLTIII drive that I picked up on eBay for a little over $100 plus tapes. I use it to backup the essential data on a weekly schedule. The capacity is only 15G/30G, so it won't work for the Gigs of movies/music. I also have the OS on a small SCSI drive that is backed up nightly to another drive of the same size. This gives a little fat-finger protection that RAID-1 doesn't offer, but still gives a completely redundant solution in case the primary dies. And, if I goof up something I just mount the second drive and restore from the night before!

  77. From the "but-does-it-run-windows" dept: by Anonymous Coward · · Score: 0

    Dildonna reports: I am a submissive male slave sissy maid for my wife/mistress. She has asked that I post this story to Slashdot so that I may humiliate myself. In the quest to find something to put in my mistress's beautiful body and provide her with great pleasure, I found the vibrator to end all vibrators. It's a remote controlled, multispeed, quadruple jointed vibrator called the "Squirmy Rooter 3000". My mistress was quite pleased with the promises that the unit's box had written on it. But when I used it on her (she no longer allows me orgasm and I can't fuck her because my 6 inch cock is too small to please her) whe was more than pleased. As it turns out, this vibrator is POWERED BY Windows CE Embedded 2006. There's a small serial port near the speed control and the remote turns out to be bluetooth! Not a bad deal for $69.69. Anyway, mistress is telling me to get off of the computer because she wants to try out her new vibrator in a strap-on session with me. Our neighbor is coming over for a little forced cocksucking this morning. I hate sucking cock, but mistress says it will push me deeper into submission with her. Bye. Sissy Maid Dildonna

  78. MacOS X by numbski · · Score: 1

    I'm still trying to find the right combination for backup/restore on OSX.

    First off, I don't do the default OSX install. I always slice up the partition (not partition the drive, this is a *bsd type OS people! :P) as described in this article that I wrote for MacOSXHints a couple of years ago.

    Then on a semi-regular basis, I will (should rather) clone everything save /Users using
    Carbon Copy Cloner. This would be applicable to other *nix's of making a bootable clone minus /home. Ghost for Unix perhaps?

    Then all that's left to do is an incremental backup of /Users. I've thought about modifying this to include an incremental on /sw, and /usr/local, but that's being complicated. If worst came to worst, I could recompile any customizations I've done, it would just take a while.

    Now, for those Mac users that know their stuff:

    CCC will clone nicely to another disk. I've tried cloning to a disk image when everything minus /Users came out to be ~3GB. It takes FOREVER to complete on an external firewire drive.

    WTF? Is this an issue that has been resolved in the last year? I haven't even bothered trying, but knowing that 10.4 is around the corner, and I haven't done a decent OS backup in a while bothers me. I backup /Users to DVD every once in a while, and I have an external firewire drive full of MP3's that I do optical backups of from time to time and mail them off to my brother in law in LA (I'm in St. Louis). Any better suggestions on getting a bootable OS image that is easily restored? Possible something I can dump to a DVD and mail off as I'm doing now?

    --

    Karma: Chameleon (mostly due to the fact that you come and go).

  79. Is there a bootable cdr backup solution by Marrow · · Score: 1

    One where I can completely restore a system by installing from CDRs that were burned with a boot sector and all the files on the system?

  80. One Danger of hard drive backup by TrevorB · · Score: 2, Insightful

    One flaw in any hard drive backup system: what happens if your system is cracked?

    If someone gets into your system, they do an rm -r *, is your backup drive mounted?

    What if they're clever and do a mount all, or find your backup.sh first?

    I've seen some people take the first and last step of "inserting the USB cable" and "removing the USB cable". Is there any kind of automated system that would ease this, or is it the Hard drive equivelant of "Remove tape, insert new tape".

    USB drives also suffer from problems with catastrophic failure, like a fire in your home.

    I wonder if there exist any online backup systems that let you do offsite daily differential backups of your system (or critical files) that would let you download or mail you an image of your harddrive (on DVD-R) along with restore software in case anything went wrong. You could charge directly by bandwidth used. Hmm, interesting idea.

    1. Re:One Danger of hard drive backup by bartle · · Score: 1
      Is there any kind of automated system that would ease this, or is it the Hard drive equivelant of "Remove tape, insert new tape".

      First, I'll redirect you to this post I made and its parent. My backup server is on a physical timer so it's actually only online a couple of hours each night. It would be possible for a malicious hacker to penetrate my first system and wait around for the backup system to come online so he could attack that but it seems unlikely to me.

      Regarding your concerns of physical damage, I could easily move my backup server to someone elses home and backup over the Internet. One reason I don't do this is that I like to check my backup server occasionally and make sure it's still working, something I probably wouldn't do if it was located somewhere else.

    2. Re:One Danger of hard drive backup by dbc · · Score: 1

      Yes, what if it is cracked, or your house burns down, or the cpu goes nuts and scribbles on every online drive, or you decide "oooops, why did I delete that" a day after your sync-up cron job runs.

      My solution on the home file server:

      1) shares are all on a RAID 1 array consisting of two cheap ATA drives. Yes, I need to take a down time to swap a dead drive. I don't care, it is a *home* file server, not one with zillions of users.

      2) the backup volume is an SATA drive in a swap drawer.

      3) backup cron job does mount/backup/unmount. So backup volume is not mounted except when needed. Theory is that this will reduce likelyhood of random scribbles on all mounted drives.

      4) "when I remember" I swap the backup volume in the draw for another one, and take the just removed drive to the bank and plop it into a safety deposit box. A rotation of 3 drives does quite nicely.

      Oh... and of course it is on a UPS.

    3. Re:One Danger of hard drive backup by YoungHack · · Score: 2, Insightful

      > One flaw in any hard drive backup system: what happens if your system is cracked?

      I've thought of that too. I like to backup my gradebook to another server.

      So, you're asking yourself. What keeps the malicious intruder from logging into the 2nd server after perusing my backup script?

      I used a little-used feature of ssh that allows you to restrict a session to a single pre-specified command. My backup script has only the ability to write new gradebook backups to the server. It cannot execute any other commands--it especially cannot overwrite or delete old files.

      Each snapshot of my gradebook is encrypted with my public key (for privacy) and copies of my keyrings exist on the remote server (because it's no good having the data there if I can't open it in a disaster).

      That's how I handle my really important data.

  81. Make backups easy by using... by Azureflare · · Score: 1
    mondo and backuppc (if you're backing up other machines over the network).

    mondo will do a full image of your drives (including making images of ntfs/fat32 drives). You boot off the image you create with mondo, and you can nuke the machine and do a full restore from cd/dvd, or do a partial restore.

    backuppc is perl based and works wonders on a network for daily backups. (you can backup the server backuppc is running on too!)

    1. Re:Make backups easy by using... by AGTiny · · Score: 1

      BackupPC is a life saver, very stable, fast, and highly recommended. Saved my ass many times so far!

  82. What about remote backups? by Benley · · Score: 1

    Rsyncing to a mounted drive is very useful, and a good way to do things on machines that are nearby. What about remote co-lo machines, though? I've been puzzling trying to find a method to do incremental backups (i.e. NOT dumping the whole system once a week/month) of a co-located system across the net. I need to preserve permissions and ownerships, and as I said, it must be incremental (using rsyinc this should be easy, at least). The hard part, though, is doing it securely. NFS mounts ... are not very secure at all. Especially way across the internet. Going over ssh is good, but how do you automate it? In order to preserve permissions, rsync needs to run as root on both ends. Ssh keys are one way to do this; but in order to have full automation, you have to have a passwordless ssh-key that grants root access on some machine, and that freaks me out. What else can you do? I suppose I could run the script by hand and put in passphrases and such, but I _will_ forget to do that on a regular basis. There's got to be some sort of solution to this!

    1. Re:What about remote backups? by Just+Some+Guy · · Score: 1
      Check out the sshd(8) manpage, particular the command="command" option to authorized_keys:
      [...] This option might be useful to restrict certain public keys to perform just a specific operation. An example might be a key that permits remote backups but nothing else. [...]
      If you need to use passphraseless keys, then at least you can severely limit the commands available to the connecting user.
      --
      Dewey, what part of this looks like authorities should be involved?
  83. alrite.. lets cut the small smalltalk.. by bluenote39 · · Score: 0
    .. and get to the crux.

    wheres the dead parrot joke?

  84. What? by MattHaffner · · Score: 2, Funny
    That's really cool, but it's a write-only backup...

    You can read from /dev/null just fine:
    # for x in *; cp /dev/null $x; done
    will restore a whole directory's worth of files back to what's stored in the backup. If you want to make an exact copy of the whole filessytem stored in the backup:
    # rm -rf /; cp /dev/null .
    Now, that's just off the top of my head, so I won't take any blame (or credit) if you try that out on your own system.
    1. Re:What? by bn557 · · Score: 1

      now to be technical, you'll need to boot a livecd and mknod null c 1 3 in order to get your null device back after rm -rf / erased it.

      --
      Humans are slow, innaccurate, and brilliant; computers are fast, acurrate, and dumb; together they are unbeatable
  85. Dead Parrot? Fooker by dominick · · Score: 0, Insightful

    I was duped. I went specifically to the article looking for the dead parrot joke. was this a scam to get me to RTFA? Shame on you, you bastards!

  86. Better than rsync: rdiff-backup by Anonymous Coward · · Score: 0

    The rdiff-backup program is the tool I use.

    It can backup a tree to another directory, saving previous revisions as you go. The backup looks like a copy of your tree, plus a meta-information directory for storing internal revision information. It's network aware, using ssh to copy things around. It does the same protocol as rsync, so bandwidth/traffic is minimized to just changes and checksums. You can set up a cron job to delete revisions older than X days.

    The authors are working on a new project that does the same thing except the backup files are encrypted.

    It's written in Python, so you know it's gotta be good! It's open source.

    Drawbacks? No GUI. (That's not much of a drawback, is it?)

  87. Expired Websites by Doc+Ruby · · Score: 1

    We've slashdotted NewsForge! Judging from the resubmission retries for this post, we've slashdotted Slashdot! That parrot ain't the only inert ex-regurgitator pushin' up the daisies!

    --

    --
    make install -not war

  88. Obligatory KNOPPIX post by waferhead · · Score: 1

    I have been using KNOPPIX CDs for creating backups for a couple of years now.
    (Linux/win)

    I generally just use partimage, but mc browsed tar archives just fine.

    IN the "early" days there was some brain damage with versions of partimage, but those are long gone.

    1. Re:Obligatory KNOPPIX post by Ziviyr · · Score: 1

      In 3.6 lzop decoding was borked, I worry about 3.7.

      --

      Someone set us up the bomb, so shine we are!
  89. implicit backup HW by Doc+Ruby · · Score: 1

    I'm surprised HD vendors don't sell them in pairs, with auto mirroring of a nonspinning backup ready for swapping when they inevitably fail around MTBF (YMMV). Either a second drive, or even integrated as a pair of independent platter sets. They could double their prices per capacity, plus a markup for "extra backup protection", and avoid all the brand-switching anger surrounding the disk failure that's really the admin's fault, if there's no other backup. While justifying their humongous total capacity high-end drives for almost everyone.

    Like everyone else, I always demand regular backup - from everyone else. I didn't get in the habit of truly regular backup myself until I got a PalmPilot, where backup is a single button-press away. Combined with the simplicity of using "synced" records, Palm's greatest advantage over other "computing" modes I've used is its nearly implicit backup, which has saved my bacon many times. If HDs included such implicit redundancy for backup, and a simple SW switch for "restore" (use the other mirror unit), we'd all be a lot better off.

    --

    --
    make install -not war

  90. Dump by wirelessbuzzers · · Score: 1
    Why do people not use dump? I have a small file/print/web backup server which doesn't have anything critical, but I'd like to back up my stuff on it every week or so. Nightly BSD snapshots deal with 'oh shit I erased that file' so backups only have to deal with 'oh shit the hard drive died.' I run dump to a separate partition, and then burn it to DVD once every so often (generally at the end of the month).

    My backup script is run on a cronjob as
    0 6 1 * * /usr/local/bin/bash /root/bin/dump.sh 1 / /var /usr
    0 5 * * Mon /usr/local/bin/bash /root/bin/dump.sh 2 / /var /usr
    I don't run level 0 dumps because I'd rather have nodump flags work without having to specify -h. I don't want the ports tree or the 50 gigs of backups from other machines to get burned to DVD.

    dump.sh:
    #!/usr/local/bin/bash

    level=$1

    if [ "$level" == '' ]; then
    echo "Usage: dump.sh level fs ... "
    fi
    shift

    d=`date +%F`
    mkdir -p "/backup/$level.$d"

    while [ "$1" != '' ]; do
    fs=$1
    shift

    fsn=`echo $fs | perl -p -e 'chomp; s#^/##; s#/$##; tr#/#-#;'`

    if [ "$fsn" == '' ]; then
    fsn="root"
    fi

    /sbin/dump "-$level" -u -L -f - "$fs" | bzip2 -c > "/backup/$level.$d/$fsn.bz2"
    done
    --
    I hereby place the above post in the public domain.
  91. Low priced easy option for Windows? by JLang22 · · Score: 1

    I know, everyone hates Windows. But when parents don't want to consider another option I'm stuck helping them.

    My mother wants to be able to back up certain folders containing documents on her Windows laptop without doing anything. Is there something that will automatically do it in the background for her? The best thing I can think of for her as adding on a second hard drive, if there is room in the case, and using some software. But what software?

    Looking for easy,
    J

    1. Re:Low priced easy option for Windows? by clickster · · Score: 1

      Fairly cheap and definitely easy. - Argentum Backup.

      You just tell it what folders, where to copy to, whether you want to put thing in a compressed (and encrypted if you'd like) ZIP file or if you just want a basic file copy.

      Once that's done, from that point on, you just right click the task tray icon and tell it to back up and it does its thing. If you don't want to have to tell it, you can schedule backups. They offer a trial period so you can try before you buy.

      --
      If you mod me down, I shall become less powerful than you could possibly imagine.
  92. I admit it... by Anonymous Coward · · Score: 0

    I only clicked on that link because it promised a Dead Parrot joke!

  93. Consider your needs (DVDs and CDs) by kenneth_martens · · Score: 1

    Consider your needs. You may not need a fancy backup solution, so don't buy an expensive external USB hard drive if your needs don't demand it. For example, here is how I backup my home computer. My costs? $70 for the DVD burner, then just the costs of blank discs.

    1. Every two months I burn my music and movies to DVD+Rs. It takes 5 DVDs to hold everything. This data seldom changes--only when I buy and rip a new CD, or download some episodes of Red vs Blue--so every two months is fine. I keep one set of these backups at work.

    2. Each week I tar up and gzip my home directory and burn it to a CD-R. Yes, it fits on one CD--I keep all my music and stuff on a different partition. I used to worry about losing data during the week, then I remembered: I don't have much to lose, except my latest journal entries, browser cache/history, and Gnucash entries. I can afford to lose a week's worth of data, because it's easy to recreate. So backing up more than once a week is overkill.

    I have an IMAP email account, otherwise I would need to back up my emails every day.

    3. I don't backup my OS. If Mandrake gets borked and won't boot, I just reinstall. It doesn't take long, and with urpmi it's a snap to reinstall my favorite applications. (I have a local copy of PLF so installing my favorite *unsupported* packages is fast too.) Then I just copy over the latest backup of my home directory and I'm back in business.

    The last time I had to restore everything it took just a few hours total.

  94. iBackup by mmynsted · · Score: 1

    Use iBackup, http://freshmeat.net/projects/ibackup/

    Then save to media as needed. Run iBackup using cron or fcron, http://freshmeat.net/projects/fcron/
    as you wish.

  95. just done dd from vmware to hd hda1! heh by urbieta · · Score: 1

    I first boot knoppix

    knoppix screen=800x600 desktop=twm

    create a backup

    dd if=/dev/hda1 | bzip2 | split --bytes=650m - /mnt/lexus/dd984g.bz2.

    created a 350 MB file, weird since my partition is 4GB (vmware default), oh lexus is an smb mount

    reboot system with a knoppix CD

    cat /mnt/lexus/dd984g.bz2.* | bzip2 -dc | dd of=/dev/hda1

    my original vmware partition reports 4293,60 with cfdisk, after dumping to the system I get 4G exactly, it used to be a 5.5GB ext3 partition, is it possible to recover that 1.5GB for win?

    btw:

    # su -
    # urpmi kdar

    fun!

  96. I keep backups on my iPod by Jim+Hall · · Score: 3, Interesting

    I have a 20GB iPod, but only about 12GB is used. My $HOME is about 2GB, including a bunch of digital photos, but also a bunch of documents, my email, and other stuff I'd rather not lose.

    My solution is simple:

    1. Plug in iPod

    2. Run ~/bin/backup.sh
      This is a very simple shell script that deletes the backup file already on the iPod, then does a 'tar czf - $HOME' and pipes it into gpg using circular encryption (that is, a passphrase.) The encrypted, compressed tarball (about 1.7GB) is written directly to the iPod. Takes about 20 minutes.

    3. Eject the iPod

    4. Done!

    I've used this backup copy to do restores, and it's really as simple as plugging in the iPod, using gpg to descrypt the file, piping that into 'tar xvzf -' to re-create my $HOME. I can move all my stuff back to where it needs to be after that.

    (For those who wonder: I always make an encrypted backup file in case my iPod is ever lost or stolen. Sure, the bad guy can probably run something to brute force the passphrase, if that's something he's interested in doing, but it's a tough passphrase. I don't worry about it so much, and it's "only" email and family photos.)

    1. Re:I keep backups on my iPod by rtz · · Score: 2, Informative

      This is a very simple shell script that deletes the backup file already on the iPod, then does a 'tar czf - $HOME' and pipes it ...

      No. Don't do this, as it _will_ bite you, no exceptions. Never delete the old files before the new backup is down on the platter, preferably checked in some way. Yes, you will need more disk, but there really is no alternative.

      I lost ten years of email and personal files to a dying Deathstar because I was foolish enough to not be paranoid enough about my backups.

      Nowadays I keep (automatic) nightly backups for at least a month, with an (also automatic) off-site copy of every dump file saved on my computer at work. (VDSL rocks.)

      Nothing instills backup discipline like listening to your disk doing its russian tractor impression just when you deleted the old backup to make room for a new one.

    2. Re:I keep backups on my iPod by khrtt · · Score: 1

      Nothing instills backup discipline like listening to your disk doing its russian tractor impression just when you deleted the old backup to make room for a new one.

      I second that. The reason that this happens more often than even Murfy's law would suggest is that backup operations give the disk such a good workout, compared to most work a home computer does.

    3. Re:I keep backups on my iPod by rew · · Score: 1

      Where does that leave me? I have 35Gb of photos.

      Backups are easy if your content is less than what fits on cheap removable media.

      Note that backing up on removable media usually requires human intervention: insert the ipod, enter a blank CD. This means that by the time your harddrive finally dies, you'll find you didn't make a backup for way too long.

  97. Re:MacOS X: use partimage in knoppix by urbieta · · Score: 1

    A little more googling might give you a more recent knoppix version (as of 2day it's 3.7 and 3.8 out soon), or there might be another bootable CD linux distro for PPC that contains partimage.

    http://debian.tu-bs.de/knoppix/powerPC/

    Once downloaded boot, wait for cute GUI, open a root shell, if it's not there then just open a terminal and run

    su
    partimage

    If you are a little more hard core, use dd; this is how I did it:

    http://linux.slashdot.org/comments.pl?sid=135938&c id=11352968

  98. Please ... by operagost · · Score: 1
    Don't let this screw-up near any of my systems. Thanks.

    Really, I didn't know you could actually backup disk-to-disk. Wow. And he even messes up that simple operation.

    --

    Gamingmuseum.com: Give your 3D accelerator a rest.
  99. mkcdrec by jonniesmokes · · Score: 2, Informative
    I recommend using mkcdrec for a bootable DVD or CD to recover the system, and a more frequent backup of the user land data using whatever you like.

    mkcdrec is a really neat program that packs up your whole system and makes a recovery disk. Its something any sysop should take a look at.

    See the homepage here.

  100. Improving Backup Planning by irabinovitch · · Score: 1

    Tim Jones, founder of TOLIS Group will be giving a seminar on backup planning at SCALE 3x on Feb 12th in Los Angeles. Theres over 25 other talks going on as well. If you would like to check out the exhibit hall register with the promo code "free" or for a great discount on ticket use the code "newsp".

    Heres some info on Tim's talk:
    With Backup windows becoming smaller - because of either the amount of data being backed up or extended work hours being seen in many establishments - backup methods and procedures for reducing the requirement are becoming more important than ever before. Also, with the myriad new regulations concerning archival of data, extended and off-site storage planning becomes more important.

    We will discuss many old and new procedures that can be used in most administration environments to alleviate or reduce the backup load.

  101. I use backup2l by hktang · · Score: 1
    to back up selected files to a different hard disk. It is a bash
    script. It allows specifying directories to backup and exceptions
    using the find(1) syntax. It does incremental backups. It uses
    split to break up your file into CD-sized chunks for burning onto
    CDs. It can use gzip/bzip2 and afio and/or GPG. But most importantly,
    restore WORKS! It is as simple as
    cd /tmp
    /usr/sbin/backup2l -l etc/passwd # to locate
    /usr/sbin/backup2l -r etc/passwd # to restore
  102. Sounds very expensive by Anonymous Coward · · Score: 0

    This sounds expensive.

    IF you do weekly backups thats 52 120GB USB drives a year. IF you buy them for $70 each you are spending over $3600 a year to backup your data. Why don't you just get a DLT tape drive instead? It's more realiable and a lot cheaper.

  103. Article author is an idiot by Anonymous Coward · · Score: 0

    He knows nothing about backing up data. My new policy: don't take backup advice from someone who has absolutely no datacenter work experience. If you suggest backing up to a hard drive you don't know what a backup is. That's not a backup, thats a dumb implementation of RAID 1.

  104. Even simpler by Anonymous Coward · · Score: 0

    Life has become easier since I installed a DVD-RAM drive. That makes it as simple as

    mount /dvd
    cp -r list of dirs to backup /dvd

    (In reality I use a PERL script that calls a longish rsync command, which speeds up the process since it only needs to update recently modified files, but the above should work just fine if it's command-line simplicity you're after. On the other hand once you have the script written all you have to do is type the name you've given it.)

    Restoring is as simple as

    mount /dvd
    cp /dvd/path_to_file_to_restore original_file_path

  105. My backup script: by chrisopherpace · · Score: 2, Interesting

    tar -lcvf /backup/$HOSTNAME-$DATE.tar /

    (I'm the type that creates one big ass partition for /). The -l switch tells tar to stay on the same FS, as /backup is NFS mounted to a RAID array. Thus, I just backup the local machine, without having to specify which directories to backup, and which to skip.

    Restoration, I do the lazy way:
    mkdir test
    cd test
    tar -xvf /backup/whatever.tar

    and then I grab the files (the RAID array usually has plenty of space).

  106. man dump by Ayanami+Rei · · Score: 1


    mount -oro,remount /dev/partition
    dump -Xf - -y $SUBDIRS_OF_INTEREST | ssh backupuser@wherever.offsite.com "cat > backup.$(date +%s).lzodump"
    mount -orw,remount /dev/partition


    Where X is 0 for full backup, 1 for incremental on everything since the last 0, 2 for incremental on everything since 1 or 0, etc.

    --
    THIS THING CAN TURN ON A DIME, MACROSSZERO STYLE ALSO FUCK BETA, ~NYORON
    1. Re:man dump by stratjakt · · Score: 1

      Or:

      mondo

      -follow prompts.

      Not everyone has a backup server. For home use, I stand by mondo/mindi for system backup, and just copying data files to whatever medium is most handy (CD-R, DVD-R, External HDD, punchcard)

      --
      I don't need no instructions to know how to rock!!!!
  107. I did my own backup software by kasperd · · Score: 1
    I want to do frequent backups and keep them for a long time. Of course when I do that there will be a lot of redundancy, and I don't have infinite amounts of disk space. What is a good way to do backups and make sure you get not only the file contents but also permissions, ownership, timestamp, etc. right? I decided to use tar, because so far it has always gotten these things right. It turns out tar is not a very compact format, but it is very convenient for my algorithm to reduce redundancy. The point is that tar store everything in 512 byte blocks. Every file have a header in such a 512 byte block, and file contents is padded with nul bytes to a full number of blocks.

    Obviously with daily backups there will be a lot of identical blocks. That is what I use in my software, every block written to the storage is compared against the existing data, and it is only written if it does not already exist. That way I get rid of large amounts of redundancy, and I just need to create some indexes to be able to reconstruct the original files. The most tricky part is how to find the existing blocks efficiently. The second tricky part is how to eliminate redundancy in the indexes. I think I'm doing quite well in both respects.

    Currently I have 404GB of tar files in my storage, however the size of the storage is only 5.5GB. But the best part is, that this blocking is not only good for storing tar files, it also works very well with the Linux file system model. With a very simple driver based on block mapping, I can mount my storage as a file system and access all the tar files directly. I can even mount those tar files using tarfs (though tarfs still seems to be lacking a few important features). There is still a few things I need to change before I'm completely satisfied with my storage format. As soon as I don't see anymore reasons to change it, I will release it under GPL.

    --

    Do you care about the security of your wireless mouse?
  108. backup2l (script) by Horizon_99 · · Score: 2, Informative

    backup2l does a great job at figuring out which files are new or have been modified for incremental backups. Easy to configure a very lightweight.

  109. Use partimage... by jrnchimera · · Score: 1

    The type of backup this person is doing is not likely to allow a complete bare-metal restore of a system.
    What I prefer to do is use partimage.
    I have a boot rescue disk ( Knoppix ) that has partimage on it.
    Steps:
    1- Boot of a Knoppix CD
    2- use DD to make a backup of the MBR
    3- Copy the MBR to a USB drive
    4- Use sfpart ( I believe thats the name ) to create a file that can be used as an input file to sfpart that will re-create the partitions.
    5- Use partimage to make backups of all my partitions. The image files for each partition is stored on a USB drive.

    Now to restore should be easy enough:
    1- Boot Knoppix rescue disk.
    2- DD my backup of the MBR to my boot disk
    3- Use sfpart and my input file to recreate my partitions.
    4- Use partimage to restore each partition saved on the USB drive.
    5- Remove CD and reboot...

    Should have a working system....

  110. Use RAID-1 by Phil+Karn · · Score: 2, Informative
    I use a much simpler and easier method to back up my primary Linux server: software RAID-1. Every month or so, I shut down, pull the secondary drive in the array, put it in the safe, and replace it with either an old drive or a new drive bought at the store. Then I reboot and let the mirror rebuild onto the new drive.

    Because RAID-1 is an exact mirror, I get a complete, bootable backup copy of my system at the time of the shutdown. Downtime is limited to the few minutes it takes to shut down and swap drives. The lengthy process of mirror rebuilding takes place while the system runs normally. And of course, RAID also protects me against random (single) hard drive failures.

    This solves the full image backup problem, leaving only the more frequent partial backups you should also be doing. For this, rsync is your friend. The stuff that changes most often on my system are my IMAP folders, which I periodically (several times per day) rsync to my laptop. Besides backing up my mail server, this gives me copies I can carry around and read when I'm offline.

    Tape is obsolete. It's just too slow, expensive, unreliable and small. Hard drives are so cheap, fast and capacious that there's little excuse to not run RAID on any machine that can physically hold more than one hard drive. Unfortunately, this leaves out most laptops.

  111. Tapeware & Certance 40 GB IDE by toofast · · Score: 1

    I use a Certance Travan 40 GB IDE tape drive at home (I bought one for our small office Linux server shortly after because it works so well). The drive comes with Yosemite TapeWare, which has a text UI reminiscent of the Novell NetWare Text utilities.

    It's easy to use, fast, allows for easy off-site backups, and restores are a snap. The media is a bit pricey, but I find it's a better solution than backing up 20 GB of data to CD (or even DVD).

    Look on ebay for used Travan 20 or Travan 40 units.

  112. I don't know where to start. What a reeking POS! by paenguin · · Score: 2, Interesting

    So, first, we have this "Copy" system that's being called a "Backup" system. PHOOEY.

    Next, he admits that the "Backup" system can't restore files or directories. OMG!!

    Anybody who adopts this system of backups better be praying to the hard drive gods and be making regular and appropriate homage.

    For a REAL backup method that can stand the test of time, try this:

    http://www.samag.com/documents/s=7033/sam0204c/sam 0204c.htm

    It's a system that compresses each file individually, writes them out to a temp directory, creates an iso and then writes the iso to a CD. This way, single bit errors in the compressed archive don't kill the entire thing, just a single file. This becomes more important as your backups begin to age because perfect playback of bits becomes more difficult as the media they are stored on ages.

    Any system that creates a data stream of all files and then compresses it is prone to total loss of data beyond any significant error in the playback.

    The order is everything.

    Stream all files through the compress algorithm... Very Risky.

    Compress each file individually and stream it to the archive... Very Safe.

    Write everything to cheap read only media... Very smart.

    Depending on the data, you can get several Gig's onto a single CD. High quality CD's should be readable for decades.

    --
    We should start referring to processes which run in the background by their correct technical name... paenguins.
  113. Re:expect by Anonymous Coward · · Score: 0

    Look into the scripting language called "expect".

  114. wanna back up your workstattion? by alizard · · Score: 1
    Back Up Your Linux Workstations -- Without Tears

    This will tell you how to:

    • clone your workstation to a backup mirror drive via dd
    • how to make a differential backup (I back up every other day) using a rsync script (INCLUDED!!!)
    • how to back up using dar (dar backup script INCLUDED) to generate DVD sized archives and how to use k3b (if you don't like k3b, find your own DVD burner!)

    If you want tape solutions, there are plenty on the Net, since most Linux backup software is tape-oriented. Most of us don't do tape and I can't think of any good reason why anybody should start.

    Now that I've settled this, what else do you want to talk about?

  115. And remember Murphy by xixax · · Score: 1

    A friend of mine managed to short out is (Windows) PC whilst plugging in an external drive of some description. I don't kow if it was power on the pins, static electricty or his leaning on the power cord, but it friend the PC and the external drive!

    At work, I tell pople if they must use external drives to back-up data, have two drives and use them alternately. This still doesn' give you protection against subtle corruption problems, what if you fsck up something important but don't realise until you copied over your backup device version?

    Xix.

    --
    "Everything is adjustable, provided you have the right tools"
  116. Append spelling flames here by xixax · · Score: 1

    Good grief...

    1.1s/is/his/
    1.1s/kow/know/
    2.2s/friend/fried/
    4.4s/pople/people/

    --
    "Everything is adjustable, provided you have the right tools"
  117. Backup tools by mandreiana · · Score: 1
    Mondorescue can re-create a system from scratch. To restore you boot from dvd and use text-mode interface in case you don't have mondo already installed. We're using an in-house solution to make a catalog of files backed-up.

    Bacula it's the same, but it has a GUI and cataloging. Still testing it.

  118. I like my own solution better... by alizard · · Score: 1
    Next, he admits that the "Backup" system can't restore files or directories. OMG!!

    and the editor accepted the article? Dar on the command line doesn't have that problem and I know it restores individual files and directories. I like GUIs, but that kind of loss of functionality isn't worth it.

    When I wrote my own how-to piece, it's a good thing I couldn't get kdar to install. Otherwise I might be in that position. Dar also does individual file compression.

    At least all 3 of the backup solutions in my article(clone to disk, differential, compress/burn to DVD) actually work as intended.

    Depending on the data, you can get several Gig's onto a single CD.

    Do you mean DVD-R or are you getting 10:1 or better compression? Seriously, what if you have more than one DVD of info to back up?

    I set things up to separate compression from burn on purpose. That way, I can let the compression run overnight and burn all the DVDs sequentially. Since I've got 30G+ to back up, it actually takes that long to do compression. Of course, if one goes that route, one had better have a lot of free drive space.

    I back up complete images. That way, I don't have to reinstall everything separately after reinstalling the OS and /home .

  119. Not good enough. by jotaeleemeese · · Score: 1

    Unless you are not too choosy.

    With your "bakcup" system I can't get different versions of the same file. I get an snapshot of the full system, which is very useful of course, but does not provide me with the possibility of getting old files at a given moment in time.

    You,as many people without enough experience backing up machines do, confuse high resilience with high availability of data.

    They are similar and related, but not the same.

    --
    IANAL but write like a drunk one.
    1. Re:Not good enough. by Phil+Karn · · Score: 1
      I can get as many old versions of a file as I have offline drives in my backup rotation cycle.

      I didn't say this was the only backup system you'll ever need. But it's a nice solution to the problem of making complete images that I can boot from if an online drive fails or the system it's in catches fire. It's certainly easier and faster than full tape backups.

      If you really want to save each and every version of a file as it rapidly changes, use RCS, CVS or some other versioning system and back that up frequently with RAID mirror swaps.

  120. One Word: PARTIMAGE by Phatmanotoo · · Score: 1

    Ghost is OK, but partimage (http://www.partimage.org/) has more or less the same features, and it is Free Software.

    Supports most filesystems: ext2fs/ext3, ReiserFS, XFS, JFS, HPFS, UFS, HFS, FAT16/32, and NTFS. Don't be afraid of the "experimental" support for NTFS, it works great if you follow the advice: defragment the filesystem first (I also disable the swap file and hibernation, to get rid of those not-movable and unnecessary files); then try to make the image, and if it suceeds, you're OK.

    I've been using it for over a year, mostly for NTFS (who needs ghosting with Debian anyway?), and so far it has worked as a charm.

  121. man dump by Ayanami+Rei · · Score: 1

    -f /path/to/appropriate/external/device/or/file
    Yes, dump supports creating and spanning volumes.

    --
    THIS THING CAN TURN ON A DIME, MACROSSZERO STYLE ALSO FUCK BETA, ~NYORON
  122. Backup is painful but not having a backup is worst by Anonymous Coward · · Score: 0

    I have some many times have been saved by backups. But it is as important to ensure that the backups are good and you can read them.
    There is no such thing as perfect. You might a have an perfect machine but mechanical and electrical have "sloppiness" built in and once you exceed the limit of the device tolerance then you are in big trouble. All manufacture's have "sloppiness" in making all equipment to be cost prohibitive.

  123. *ahem* proper backup rotation by onemorechip · · Score: 1

    A good solution is rotation of the backup media using a gray-code counter scheme. This means (conceptually) you keep a gray code counter of the number of backups performed, and the disk or tape you use for each backup corresponds to the bit that changes with the next increment of the counter. Example: if you have 4 DVD-RAMs in your rotation, labeled A through D, then you would rotate the media in the following sequence: ABACABADABACABAD... (no, it's not an extended version of a Genesis song). Now when you need to restore you have a wide range of ages of backups to choose from -- not just every incremental since the last full backup.

    Let's say your hard disk crashes just after you've completed this much of the sequence:

    ABACABADABA

    Assuming your backups are daily, that means the backups in your stack have the following ages:

    A: 0 days
    B: 1 day
    D: 3 days
    C: 7 days

    Thus instead of being able to go back only 3 or 4 days, as with incremental backups using the same number of media, you can go back 7 days (there is some fluctuation in this number depending on where you are in the cycle). The advantage increases exponentially with the number of media in your rotation: 8 to 15 days with 5 disks, 16 to 31 days with 6 disks, etc. The gaps get larger as you go back but that's the tradeoff; if your file was corrupted 10 days ago you might have to choose disk E, 15 days old, so you've lost 15 days of work, but at least you were able to get back to a good version at all.

    Now you can use rsync to do each backup and still have the advantage of a history that is at least as long as 2^(N-2) backup cycles.

    If you were going to reply and say "oh, but I only do it every X weeks", well- you'll now loose weeks of work if you loose a file/drive.

    *Not* if you lose a drive, in any case, because the last backup will always contain the most recent version of the drive before the crash. The only exception would be if the disk crash happens *during* the backup (and this shouldn't matter with rsync), but then if you only have a single backup copy you are a fool.

    Incidentally, if you only have a single full backup with incrementals, you run exactly that risk because your full backup might have a medium error.

    --
    But, I wanted socialized health insurance!