Slashdot Mirror


Data Deduplication Comparative Review

snydeq writes "InfoWorld's Keith Schultz provides an in-depth comparative review of four data deduplication appliances to vet how well the technology stacks up against the rising glut of information in today's datacenters. 'Data deduplication is the process of analyzing blocks or segments of data on a storage medium and finding duplicate patterns. By removing the duplicate patterns and replacing them with much smaller placeholders, overall storage needs can be greatly reduced. This becomes very important when IT has to plan for backup and disaster recovery needs or when simply determining online storage requirements for the coming year,' Schultz writes. 'If admins can increase storage usage 20, 40, or 60 percent by removing duplicate data, that allows current storage investments to go that much further.' Under review are dedupe boxes from FalconStor, NetApp, and SpectraLogic."

5 of 195 comments (clear)

  1. Um.. by The+MAZZTer · · Score: 0, Troll

    AFAIK this is pretty much how every compression algorithm works. No need to give it a fancy name.

    1. Re:Um.. by almightyons · · Score: 0, Troll

      Not only this is just another name for compression, it's another name for the usual 'diff' that every good backup system should be doing - storing only the changes from time to time, not the whole thing. And all that should be packed in any good backup appliance.

    2. Re:Um.. by Slashcrap · · Score: 0, Troll

      Yeah! To fight dupes I compute CRC checksum for each file and store it (and only it) on my back up drive. That method removes dupes almost automatically and there is a side effect of a huge compression ratio too. I have been downloading the high def videos from Internet for quite a while now and with my compression method I have used less than 10 percent of 1GB flash drive! I strongly recommend this method to everyone!

      You only actually need one bit. The "I'm not fucking funny and this is the 5th time I've seen the same fucking joke in the same article bit". I call it the "twat" bit.

  2. Re:Wrong layer by BitZtream · · Score: 0, Troll

    Open Solaris is dead, and there are kernel bugs in the latest version, so good luck with that.

    OpenSolaris is dead, thank god, it was a shining example of just how well OSS doesn't work for everything. It was a rather stupid idea in the first place but it did manage to put a kink in a few other companies plans so good for them, but yes, its dead.

    As for kernel bugs ... welp, if you think the kernel of your OS doesn't have bugs, you're an idiot. Second, you have the source, fix OpenSolaris yourself ... thats the response we see out of so many OSS zealots here so I figured I'd throw in my two cents.

    Google luck on finding solutions to your problems that are based on logic and rational thinking, I doubt you can pull it off judging by your statements so far.

    --
    Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
  3. EMC is the leader in overpriced junk by Nicolas+MONNET · · Score: 0, Troll

    Their software's so buggy and poorly designed, it's gotta be written by complete retards.

    There is good reason not to review EMC -- so that people stop buying those piece of shit and sysadmin like myself don't have to endure the misery of having to make those monstrosity work.

    Navisphere, I curse you.