Slashdot Mirror


ZFS Gets Built-In Deduplication

elREG writes to mention that Sun's ZFS now has built-in deduplication utilizing a master hash function to map duplicate blocks of data to a single block instead of storing multiples. "File-level deduplication has the lowest processing overhead but is the least efficient method. Block-level dedupe requires more processing power, and is said to be good for virtual machine images. Byte-range dedupe uses the most processing power and is ideal for small pieces of data that may be replicated and are not block-aligned, such as e-mail attachments. Sun reckons such deduplication is best done at the application level since an app would know about the data. ZFS provides block-level deduplication, using SHA256 hashing, and it maps naturally to ZFS's 256-bit block checksums. The deduplication is done inline, with ZFS assuming it's running with a multi-threaded operating system and on a server with lots of processing power. A multi-core server, in other words."

4 of 386 comments (clear)

  1. Does that mean... by Anonymous Coward · · Score: 4, Funny

    Duplicate slashdot articles will be links back to the original one?

  2. Re:This is good news... by Anonymous Coward · · Score: 4, Funny

    Shoulda gone with a blade server, then you wouldn't have had to worry about the emergency room.

  3. Re:Open Source Cures Cancer by Anonymous Coward · · Score: 5, Funny

    Like a cutting edge CAD packages, games, financial management and office suites?

    Umm, dia, nethack, perl, emacs?

  4. Re:Open Source Cures Cancer by Anpheus · · Score: 4, Funny

    But if it breaks, or doesn't work, or you've hit a deadline on a project and can't deliver because Wine or the application broke, who are you going to call for support exactly? Not the people who made the software. Are you going to email the Wine mailing list and then, when they fail to deliver a timely solution for free, tell the client that open source is to blame?

    At least when I buy software, or make purchasing decisions from a business standpoint, knowing that the company will stand behind the product and our implementation of it is more important than that trying to pursue some ideal about information and it's anthropomorphized desire to be free.