Slashdot Mirror


Microsoft Releases Public Beta of Data Protection

Torrey Clark writes "Microsoft has released the public beta of its disk-to-disk backup product, Data Protection Manager. The product is designed to make backups easier than simply backing up to tape. Disk-to-disk backup completes images in significantly less time, meaning much less downtime for systems during backups."

55 of 262 comments (clear)

  1. downtime during backup? by R.D.Olivaw · · Score: 5, Insightful

    Don't know about the rest of the world but we don't have to take systems down to backup them here.

    1. Re:downtime during backup? by FullMetalAlchemist · · Score: 2, Interesting

      You don't with Windows either, but you have to make sure there are no handles to critical files when you do. After that you can just use dd or whatever, I use dd, because I came from a unix background and found it the most simple solution.

      If you're not in the know and still reboots, why not just g4u?

    2. Re:downtime during backup? by ntshma · · Score: 5, Funny

      Microsoft Data Protection Instructions: 1: Click on START and then SHUTDOWN.

    3. Re:downtime during backup? by abysmanu · · Score: 3, Informative

      Sometimes systems will need to be brought down before performing a backup. Otherwise the image might be in a state of flux, causing potential problems during recovery.

      Some backup utilities provide capability to take a snapshot and backup that snapshot while the system continues to be used.

      One of the features Microsoft is touting in this product is 'moving only the byte-level changes of the file servers' thus eliminating any downtime.

    4. Re:downtime during backup? by Gillious · · Score: 2, Interesting

      I think what they are getting at here is the time it takes to restore the data. Rather than taking the time to restore from a tape which is very time consuming, it images to a hard drive. That drive can simply just be plugged in when the machine is down for the drive replacement. As opposed to taking down the system, replacing the drive, reloading the OS, installing the backup software, restoring the data, verifying it's integrity...

    5. Re:downtime during backup? by TummyX · · Score: 3, Insightful

      xfs_freeze might make sure that the fs level of the files is fine but what happens if it occurs at a time when an application is doing something vital. I doubt all applications on linux are written to be xfs_freeze aware.

    6. Re:downtime during backup? by ASkGNet · · Score: 2, Informative

      I would imagine that xfs_freeze just redirects all write i/o to a snapshot volume and overrides all read i/o with data in the snapshot volume (if the data requested has been written since the execution)

      The applications don't even know what happened, it all happens at VFS level

    7. Re:downtime during backup? by TummyX · · Score: 2, Insightful

      That doesn't Change anything.

      How do you know your backup was made at a point where the file data is stable frOm an apps point of view? Either the app has to be made freeze aware or the app has to be closed.

      The snapshot volume you mentioned helps to keep the sever running but any data you backup would be like data copied from a drive from a machine that was powered off without shutting down. You never know just what wasn't in a stable state! Maybe apps need to be written to be backup aware.

    8. Re:downtime during backup? by FreeUser · · Score: 2, Interesting

      Don't know about the rest of the world but we don't have to take systems down to backup them here.

      Yeah, it's pretty pathetic. Contrast their approach with our simple "poor man's RAID" backup solution which has worked on Sun systems, *BSD systems, and GNU/Linux systems for over 10 years:

      (install two identical hard drives)

      dd if=/dev/hda of=/dev/hdb bs=1048576


      Run as frequently as you need a backup image. This has worked, as I said, for over a decade, and has allowed quick and easy recovery of every machine we've ever had a hard drive crash on. There are theoretical limitations, e.g. a gradual failure of the source drive that causes corrupt data to overwrite the backup, so "poor man's RAID" should only be one component of one's backup strategy, not the entire strategy, but it has worked wonderfully. Why not use RAID instead? Well, in some limited cases we do (including dual RAIDS that act as "poor man's RAID" to each other), but the problem with RAID alone is that you can't necessarily snatch the drive out of one machine and put it in another (hard drives aren't the only things in a computer that break) and because a RAID isn't a backup, it's a highly available drive, which means when you need to recover older data after, for example, human error damages the current copy, RAID does you no good while "poor man's RAID" gives you an instantly accessible copy of last night's backup.

      That, coupled with more traditional backup to tape, or, as we've been doing lately, a tar archive of the entire system's filesystem to a central RAID repository across the net, is pretty damn bullet proof, easy, and trivial to recover with.

      --
      The Future of Human Evolution: Autonomy
  2. One more thing... by teh_mykel · · Score: 4, Funny

    Now, if Microsoft could actually release a product that didnt require an amazing array of backup software, we'd be talking business.

    --
    this sig no verb
    1. Re:One more thing... by Harassed · · Score: 3, Informative
      I just use dd, since any file level backing up in a live Windows can't do a complete job

      Yes it can and has been able to for some time, at least on the server side. Windows Server 2003 has a service called Volume Shadow Copy which is designed to do exactly that.

    2. Re:One more thing... by pegr · · Score: 2, Informative

      My point was, fill the filesystem to the brim with 0x00 files, wipe them out, then pipe dd, through a compressor (which will catch the zeroing done, bzip2 works really well here), then to where its going.

      With the added benefit of overwriting unallocated space. You don't want deleted files to be recoverable*.

      (*Unless you do, of course...)

  3. Surprising by ThePlague · · Score: 5, Funny

    The really surprising thing is that they released the source code, and here it is:

    xcopy *.* "x:\" /d/s/e/c/f/h/k/y

    1. Re:Surprising by Uptown+Joe · · Score: 2, Funny

      Only they will call it Data Protection Manager 2006 and charge $800 (Base XCopy) for it... Plus the $400 Exchange Agent (/EA) and the $400 SQL Agent (/SQLA) and the $400 Multi-Server (/MS)Agent and the $400 Netware Compatibility Agent (/FU) and the $40,000 Linux Compatibility Agent (/HAHA)

      - usage: Xcopy c:\*.* x:\ /h/e/c/k/HAHA...

    2. Re:Surprising by noidentity · · Score: 2, Funny

      The really surprising thing is that they released the source code, and here it is:

      xcopy *.* "x:\" /d/s/e/c/f/h/k/y


      Sir, a DMCA takedown notice has been filed with your ISP and Slashdot. Please remove all source codes at once.

      - Friendly protector of your rights

  4. StoreAge Networking Technologies support by xtracto · · Score: 5, Informative

    So it seems DPM is only a "data-mover", so it will need to be combined with another technology, after some research i found this:

    StoreAge Networking Technologies announced that it will be developing enhanced solutions to support Microsoft System Center Data Protection Manager

    The full article is: here

    --
    Ubuntu is an African word meaning 'I can't configure Debian'
  5. Rsync works fine for us by Tanami · · Score: 5, Interesting

    We've been doing disk-to-disk for a year or so now using rsync's --link-dest feature to create apparently complete mirrors each night, but with only those changed files actually occupying disk space (beyond that of a symlink). Makes restoration an absolute breeze compared to tape, but I'm not sure if this M/S effort does the same? *runs off to look*

    1. Re:Rsync works fine for us by gtoomey · · Score: 4, Interesting
      I rsync from my web server in USA to Australia using my ADSL connection.

      Rsync usually reports a 1000 fold speedup over a dumb copy.

    2. Re:Rsync works fine for us by Tanami · · Score: 2, Informative
      Which is great till you start thinking about stuff like disaster recovery, offsite copies etc.

      I don't understand? That's precisely why we started doing it.

      We have an offsite server in a managed facility to which we back up each night over SDSL - nightly update via RSync for ~400GB of total data is around an hour on average. This server collects data from two sites, in the event of total system failure at either site, we've got lots of options depending on the disaster - home users could connect directly, somebody could physically go and pick the box up and install it as a replacement, etc, etc.

      Much less effort and downtime than any tape backup system we've ever encountered.

      For day-to-day restores (deleted files, etc) we have a similar system at each office, which implements the symlinked backups - I could restore right now, in literally 10 seconds, any file on our network shares exactly as it was at the end of any working day between now and the 5th of January. Perhaps more importantly, pretty much any competent user can do the same, without having to bother me. Show me a tape system which will do that!

    3. Re:Rsync works fine for us by Colin+Smith · · Score: 2, Interesting

      " nightly update via RSync for ~400GB of total data is around an hour on average"

      Ah. That explains it. 400Gb is what I'd describe as a small system. We do an incremental of around 16Tb and we're not a particularly large site. Pushing 400Gb over a WAN is expensive enough, try it with a bit more data.

      "I could restore right now, in literally 10 seconds, any file on our network shares exactly as it was at the end of any working day between now and the 5th of January. Perhaps more importantly, pretty much any competent user can do the same, without having to bother me. Show me a tape system which will do that!"

      Already mentioned it:
      http://www-306.ibm.com/software/tivoli/produc ts/st orage-mgr/

      --
      Deleted
  6. What ever happened to easy backups? by pcmanjon · · Score: 3, Interesting

    What's wrong with:

    dd if=/dev/hdb1 of=/mnt/hdh1/path/to/desired/backup/image/here.iso

    Oh, not available for Windows, so you'll have to buy a product instead. But isn't dd much easier than using a program that expires after 270 days.

    http://www.microsoft.com/windowsserversystem/dpm /e valuation/faq.mspx
    Q. When does the DPM beta expire?
    A. The Data Protection Manager software expires 270 days after installation.

    1. Re:What ever happened to easy backups? by maxwell+demon · · Score: 4, Insightful
      What's wrong with:

      dd if=/dev/hdb1 of=/mnt/hdh1/path/to/desired/backup/image/here.iso


      Depends. It won't work if /dev/hdb1 is your largest file system. And of course you don't want to do that while /dev/hdb1 is in use, since you otherwise risk inconsistent data structures.
      --
      The Tao of math: The numbers you can count are not the real numbers.
    2. Re:What ever happened to easy backups? by frankblack9999 · · Score: 2, Informative

      Funny how people complain (above) about having to buy a separate product to enhance Windows, AND complain about Microsoft crushing the little guy when they bundle similar utility programs with the o/s.

  7. But.... by Anonymous Coward · · Score: 3, Funny

    Microsoft has also said that it won't be using its own software since it prefers to destory any information that could be used against it in a court of law.

  8. Now you can by R.Caley · · Score: 3, Funny
    have your viruses and trajans back and working again in a fraction of the time.

    Nerver more will you have to endure those painful minutes between rebuilding your system and getting re-infected.

    --
    _O_
    .|<
    The named which can be named is not the true named
  9. This must be another Microsoft first.... by suman28 · · Score: 3, Funny

    Imagine that...less down time. Who would have ever thunk it.

  10. Am I missing something? by (trb001) · · Score: 2, Insightful

    Or is this just RAID-1 backup without the read performance boost?

    --trb

  11. A few points by erroneus · · Score: 3, Interesting

    Someone criticized the "downtime" thing. Frankly, in order to get a good backup, any other processes running on data should not be in flux or the backup itself could be corrupt. So even in most conventional backup schemes, there is a period of time in which backups run and nothing else does.

    Another point is that I do not see where it will support operating systems other that Windows. This is to be expected, but a mature solution should be capable of backing up multiple operating systems as many sites I have seen have a heterogenus computing environment. At my site there are Windows servers but there are also Novell, Linux and SunOS. Is there a solution for those too?

    On the other hand, if we're talking about what essentially amounts to "dd" I am sure there could be a handy Knoppix CD created to suit the task in some automated way. It could actually be quite simple in that at a certain time of day (night?) power to a bootable external CD drive is enabled, the system is scheduled to reboot at the same time, it boots from CD, runs "dd" per the scripting in the custom Knoppix where it finishes the job by writing out information to a log file about success or failure and then reboots the computer again. That's just off the top of my head but I am sure that even more elegant schemes could be cooked up. This solution would be effective at creating viable images at a good speed and could even utilize compression along the way.

    If Microsoft wants to make a "ghost" backup, then maybe they should just license the technology from Symantec.

    1. Re:A few points by RollingThunder · · Score: 2, Informative

      You've never heard of using broken mirrors, I take it?

      Zero downtime. Instant backup for a change. Sure, you need RAID-1 for it, but disk is cheap compared to the data on it.

      Also, various products have quite capable open file managers. We use Veritas Netbackup at my workplace, and it's excellent, cross platform and high performance.

    2. Re:A few points by jbarr · · Score: 3, Informative

      I have used Acronis' backup product on my workstations, and it works on-the-fly. I even tested it by doing a full backup, formatting the system disk, and restoring, and everything "came back" like it was before I did the backtup. Acronis certainly has an excellent product.

      --
      My mom always said, "Jim, you're 1 in a million." Given the current population, there are 7000 of me. God help us all!
    3. Re:A few points by jabuzz · · Score: 2, Informative

      I take it that you have never heard of snapshots and file system freezes then? It goes like this; freeze filesystem, take snapshot, unfreeze filesystem. Typically this takes place in under 10 seconds. Then you backup using the snapshot which can take as long as you need. Provided you don't run out of snapshot space of course. Then you release the snapshot once the backup is complete. Try man xfs_freeze for information on how you backup on real operating systems.

  12. Re:I dont understand. by jmcmunn · · Score: 4, Interesting


    Thank you...you show me the hard drive that holds as much as my tape drive does, then we'll talk. And I certainly don't have room in the drive tower for another 7 drives.

  13. Re:Expiring Backup Software? by JaredOfEuropa · · Score: 4, Insightful
    That is, in my opinion, extremely dangerous.
    It is a public beta, for evaluation. You're supposed to use this alongside your existing backup mechanism, in a 'sandbox' environment, or in a carefully monitored environment, where you should expect and prepare for issues with this product

    Any sysadmin using expiring public beta software for production backups, shouldn't be a sysadmin in the first place. Don't blame Microsoft for this.
    --
    If construction was anything like programming, an incorrectly fitted lock would bring down the entire building...
  14. Why is this news? by Anonymous Coward · · Score: 2, Informative

    I don't recall /. articles for the release of any of these applications:

    Freshmeat Backup Apps

    (flame away)

  15. Re:I dont understand. by nojayuk · · Score: 5, Interesting

    Disk to disk backup would require the system to be shutdown, drive added, removed and reboot, configure etc.

    Unless they are talking about removable media like CD/DVD/USB devices, this does not make sense.

    There are such things as USB hard drives which appear as volumes within the Windows OS, you know. I use such a unit with a cheapo exchangeable ATAPI cartridge bay hacked into it for backup. I call it "tepid-swap"; it's not true hotswap as I have to "stop" the USB device before switching it off but I certainly don't have to shut down the entire system to change the drive fitted in the bay. After I power it up again Windows 2000 automatically recognises the new disk, no reboot necessary.

  16. if data is corrupted by bro1 · · Score: 3, Funny

    Now it would be nice to get 5$ each time data is corrupted by this backup system.

  17. It can be a bit more complicated than that by WARM3CH · · Score: 4, Interesting

    Disk-to-disk backup? In fact, I (ie. my computer!) do it every night. Simple copy command? I think that does not cut it. I'm in a tight development cycle and each day write a lot of code, documents and receieve/generate lots of data files. I need to back up all important data but surely I don't need to make backup of the executable files, temp files, OS system files and such. The solution that I use is simple: I have two hard disks in my computer. The files that I need to have back-up from, are scattered on these two drives. Now, I have made a BackUP directory on each one of these drives and put a copy of all important files in them. So, I have 3 copies of every important files: the original, and two back-ups. In case a hard-disk goes banana, I always have a copy of all important files on the other one. I run the back-up every night. Just need to copy the files that has been changed or the whole new directories made during the day. So the problem is: I need two desinations for each source. I need to be able to select which directories or even which files to back-up (or not to backup) and I need to check which files have been changed or which new files (or directories) have been created. I need to be able to schedule the back ups for midnight and I need to forget about all these details in practice as I have to focus on my work :) How I did it? Well, I tried a script in the beginning but found it difficult to manage over the time and it was very tedius. Now I use SyncBack which is a freeware program with all these features that I need (and more! like FTP and compression to Zip, etc.). QED.

    1. Re:It can be a bit more complicated than that by WARM3CH · · Score: 2, Informative

      Yes, I could as well configure the hard disks in a RAID configuration. The advantage would be instant mirroring of everything written on the disks. However, I don't really need that. I would lose lots of disk space in RAID. I have 2x160GB hard disks. In a RAID configuration, I woud have only 160GB free space (ie. 160G / 160G = 100% overhead). In my case, the total size of the "important data" is now only round 8GB. I have two copies of the backup, so I'm wasting only 2x8GB = 16GB for backup. The backup directories are actually NTFS compressed folders so the real space uesd for each one is just 5GB instead of 8GB or 10G in total. So, now I have only 10G / 320G = 3.1% of overhead! :)

  18. to Disk? by rossdee · · Score: 5, Funny

    "Please insert disk 2 of 1,270,196 in drive A: and click continue"

  19. Great! by Mad+Merlin · · Score: 3, Funny

    A beta Microsoft product for backing up all of my critical data! Where do I sign up?

  20. Re:I dont understand. by nojayuk · · Score: 2, Interesting

    Thank you...you show me the hard drive that holds as much as my tape drive does, then we'll talk.

    Well tell us how big your tape drive is and we can discuss it. There's a LaCie USB hard drive case available with a 1.6Tb capacity in one portable box, configurable as a single volume; do you have a tape cartridge that big? As a USB device it can be plugged and unplugged in a running system with a minimal amount of operator intervention and no need to power down and reboot the system. My own HD cartridge USB device allows me to swap multiple 120Gb hard drives in and out of my system similarly without rebooting, and I trust those drives a lot more than I would trust tapes, having been bitten by "bad-tape no. 3 of 5" syndrome before when restoring backups.

  21. To all the morons bitching about an expiring BETA by mrRay720 · · Score: 2, Funny

    It's a BETA - use it in a production environment and you deserve whatever bad things happen to you.

    Now *really* dangerous product groups with pre-programmed expiries are foods! They're not even marked as BETA! Go waste your time bitching about those non-BETA products that expire even though you've paid for them instead.

  22. Subversion as a backup solution by damieng · · Score: 5, Informative

    I've recently been using Subversion as a backup solution at home with great success.

    My server runs it's own SVN repository and each of my machines can check in it's important files into the tree.

    This backup solution is quick and thanks to tools like TortoiseSVN integrates into the desktop for ease of use.

    Additional bonus factors are the ability to see the revision history, roll-back, full cross-platform support.

    You can also manage multiple copies of the same file to multiple machines should you need to work on them or just want additional resilience.

    The real icing of the cake of course is that you can run it over SSL via Apache or over SSH and therefore remotely access your backed-up files from out on the Internet should you suddenly need an invoice or a photograph while sitting in a net cafe in a foreign country.

    Oh, and it's free by both definitions. http://subversion.tigris.org

    --
    [)amien
    1. Re:Subversion as a backup solution by Profane+MuthaFucka · · Score: 2, Interesting

      Unison is better for the same purpose. It also works over SSH.

      --
      Fascism trolls keeping me up every night. When I starts a preachin', he HITS ME WITH HIS REICH!
  23. Re:Expiring Backup Software? by smkndrkn · · Score: 2, Insightful

    We're also aware that system administrators often commit horrible -- albeit accidental -- decisions in a pinch.

    Only poor ones. As as systems administrator I would never use a beta like this to backup ANY data that was important.

    You really have bigger problems with budget/manager/etc if you don't have a better backup product to use.

    --
    ======== In the future, everything will be artificial. ========
  24. Re:RAID by PinkX · · Score: 2, Insightful

    And how is your RAID going to help you when your data loss is due to an (un)intentionall deletion, and not some kind of hardware failure?

  25. RTFA by AnomalousTurd · · Score: 2, Informative
    It seems like a decent feature set. A sort of scheduled mirroring of volumes over a LAN, utilising the Shadow Volume copying. An agent runs on the source server and logs the data changes. At scheduled times this agent transfers the accumulated changes to the DPM server.

    The server can produce snapshots etc and there seems to be some tie in to standard file save/open dialogs so users can access previous versions.

    Disk manufacturers will love it :-)

  26. Re:I dont understand. by Colin+Smith · · Score: 2, Informative

    A SAIT cartridge is about 10cm square and weighs what? 200 grams? *That's* portable. The drive is capable of 78MB/s sustained, 50% faster than USB 2.

    Course, you've got to pay for performance.

    Hard drives have a place in backup, but it isn't for very high capacities or offsite storage.

    --
    Deleted
  27. Too late by dtfinch · · Score: 2, Interesting

    I've already switched to samba and rsync. Microsoft's backup was outdated by at least a decade, and even failed to complete at random when I've used it for disk to disk backups. And Windows' mandatory file locking policy makes safe, reliable backups entirely impossible. An xcopy backup is even dangerous, because it temporarily locks files as it opens them for reading, potentially causing other server processes to fail if they attempt to write to the files.

  28. Re:I dont understand. by Bombcar · · Score: 2, Informative

    420LTO 2 drive

    200 GB Uncompressed. Exact same size as a CDROM. Multiple tapes available.

    How much does it cost you to have 30 hard drives? 30 tapes?

    Redundancy, my friend.

  29. Re:I dont understand. by Colin+Smith · · Score: 2, Insightful

    Binaries, word docs, text, database files all compress well on to tape. 1.3TB is about the average of what we get onto the cartridges. RDBMS files and engineering data sets in particular compress to far higher densities, 5TB -> 10TB per cartridge. The drive does the compression so it doesn't impact the client systems too badly.

    You can have an external SAIT drive for around £2500. Ours are in big (Hundreds of TB) libraries and cost a bit more. They are actually physically a lot smaller than they used to be.

    The point is that hard disk backups are for small networks. People who say tape is dead, back up to hard disk RAID arrays are people who back up small systems or sites.

    --
    Deleted
  30. Hell no by dtfinch · · Score: 2, Interesting

    From the FAQ:
    a customer has to purchase a server license for every DPM server that is deployed and a Data Protection Management License (DPML) for every server they protect.

    Now they have incentive to never upgrade the poor quality backup software already included in Windows. Admins will have to buy their backup software seperately or look elsewhere. Server operating systems are expected to come with _good_ backup software, so from a strictly technical sense Microsoft is being an ass.

  31. "easier than simply backing up to tape"? by mordejai · · Score: 2, Funny

    It looks like you are backing up data...

  32. Re:An image in a state of flux by operagost · · Score: 2, Funny
    nighties
    I hope you meant "nightlies." You just gave me a very disturbing mental image there.
    --

    Gamingmuseum.com: Give your 3D accelerator a rest.
  33. Linux comes with backup software? by Anonymous Coward · · Score: 2, Insightful

    Hi!

    You all seem to bash MS again... .. but tell me, where can I find an useable Backup program from my SuSE 9.2 Professional? Windows 2000 Professional as well as Windows XP Professional both have a good schedulable backup program (included free as it should). But there is nothing on SuSE. (Ok, there is tar, but that definitely does not count! And then there is that on system backup in the YaST, but even that doesn't come close to what a backup program should be like - in order to be useable.) So, in terms of backup software, MS seems to be way ahead of SuSE, which is about the best regarded distro nowadays...