Slashdot Mirror

← Back to Stories (view on slashdot.org)

Open Source Deduplication For Linux With Opendedup

Posted by timothy on from the its-missing-apostrophes dept.

tazzbit writes "The storage vendors have been crowing about data deduplication technology for some time now, but a new open source project, Opendedup, brings it to Linux and its hypervisors — KVM, Xen and VMware. The new deduplication-based file system called SDFS (GPL v2) is scalable to eight petabytes of capacity with 256 storage engines, which can each store up to 32TB of deduplicated data. Each volume can be up to 8 exabytes and the number of files is limited by the underlying file system. Opendedup runs in user space, making it platform independent, easier to scale and cluster, and it can integrate with other user space services like Amazon S3."

9 of 186 comments (clear)

  1. Hasn't this been posted before? by Required+Snark · · Score: 5, Funny

    Just wondering...

    --
    Why is Snark Required?
    1. Re:Hasn't this been posted before? by Anonymous Coward · · Score: 1, Funny

      If so, how about we just reference that post?

  2. Re:Let's get down to brass tacks. by Hooya · · Score: 3, Funny

    very repetitive. back and fourth. back and fourth. oh wait... that's not what you meant. never mind.

  3. Re:This is for hard disks by fatp · · Score: 2, Funny

    I really googled "memory deduplication $VM_TECH"... It returned this post as the only result

    what an idiot I am T.T

  4. Re:In case you don't know much about it by fatp · · Score: 2, Funny

    Oh in fact it requires jdk 7...

  5. Re:In case you don't know much about it by GNUALMAFUERTE · · Score: 2, Funny

    Hey, slow down cowboy. Explain that concept to me again. I don't know if it's applicable here, but if we find a way to implement it, it might just prove revolutionary.

    I work in the quality assurance department of Geeknet Inc, Slashdot's parent company. We are constantly looking for ways to improve all the sites on our network.

    I don't know if this method you propose, that, if I understand correctly, would involve parsing the content of the html document linked, and having an editor analyze the output of such html document after being rendered (let's call it, reading the story), is at all possible. But if we implement it the right way, it might prove useful.

    We'll get our research team to work over this reading-the-story concept. It's something absolutely novel to us, so it might take a while. We'll let you know when we reach a conclusion, so that we might license this reading-the-story technology from you.

    Kind Regards,
    Lazy Rodriguez
    GeekNet INC.

    --
    WTF am I doing replying to an AC at 5 A.M on a Friday night?
  6. Re:deduplication by GNUALMAFUERTE · · Score: 2, Funny

    So, Blade Runner was about de-duplication?

    --
    WTF am I doing replying to an AC at 5 A.M on a Friday night?
  7. Re:deduplication by nacturation · · Score: 4, Funny

    What kind of lame recursive acronym is "deduplication"? I'm flummoxed in any attempt to decipher it.

    Deduplication Eases Disk Utilization Purposefully Linking Information Common Among Trusted Independent Operating Nodes

    --
    Want to improve your Karma? Instead of "Post Anonymously", try the "Post Humously" option.
  8. Re:This is for hard disks by Island+Admin · · Score: 2, Funny

    Go to your browser preferences - uncheck "enable Great Firewall of China". ;)