Slashdot Mirror


New 25x Data Compression?

modapi writes "StorageMojo is reporting that a company at Storage Networking World in San Diego has made a startling claim of 25x data compression for digital data storage. A combination of de-duplication and calculating and storing only the changes between similar byte streams is apparently the key. Imagine storing a terabyte of data on a single disk, and it all runs on Linux." Obviously nothing concrete or released yet so take with the requisite grain of salt.

27 of 438 comments (clear)

  1. Limited application by Locke2005 · · Score: 4, Funny

    Yes, it can compress data to 1/25th of original size... but it only works on slashdot articles, which are highly compressable due to the large amount of redundant data.

    --
    I've abandoned my search for truth; now I'm just looking for some useful delusions.
    1. Re:Limited application by Bull999999 · · Score: 5, Funny

      I, too, can compress data to 1/25th of original size... but it only works on slashdot articles, which are highly compressable due to the large amount of redundant data.

      --
      1f u c4n r34d th1s u r34lly n33d t0 g37 l41d
    2. Re:Limited application by LNO · · Score: 3, Funny

      I, as well, can compress data to 1/25th of original size... but it only works on slashdot articles, which are highly compressable due to the large amount of redundant data.

    3. Re:Limited application by Alien+Being · · Score: 3, Funny

      Wow, *your* algorithm even compresses the moderation!

    4. Re:Limited application by sprag · · Score: 4, Funny

      I, as well, welcome our 1/25th of original size overlords... but it only works on hot grits articles, which are highly compressable due to the large amount of petrified data.

    5. Re:Limited application by tshak · · Score: 4, Funny

      I, wanting cheap karma, can compress data to 1/25th of original size... but it only works on slashdot articles, which are highly compressable due to the large amount of redundant data.

      --

      There is no longer anything that can be done with computers that is nontrivial and clearly legal. -- Paul Phillips
    6. Re:Limited application by Yvan256 · · Score: 1, Funny
    7. Re:Limited application by networkBoy · · Score: 3, Funny

      dude, karma whoring funny comments is approaching the usefulness of this compression algo.
      hate to break it to you this way :-)
      -nB

      --
      whois gawk date unzip strip find touch finger mount join nice man top fsck grep eject more yes exit umount sleep dump
    8. Re:Limited application by complete+loony · · Score: 4, Funny

      I, forgetting that funny doesn't give karma, can compress data to 1/25th of original size... but it only works on slashdot articles, which are highly compressable due to the large amount of redundant data.

      --
      09F91102 no, 455FE104 nope, F190A1E8 uh-uh, 7A5F8A09 that's not it, C87294CE no. Ah! 452F6E403CDF10714E41DFAA257D313F.
  2. The proof... by jforest1 · · Score: 5, Funny

    It's true! It compressed my 10GB collection of ASCII PR0N into 1 meg!

    1. Re:The proof... by Dynedain · · Score: 3, Funny

      The ASCII results:

      *

      --
      I'm out of my mind right now, but feel free to leave a message.....
  3. /dev/zero ? by slimey_limey · · Score: 5, Funny

    dd if=/dev/zero bs=1m count=1m | lzop - | gzip -f -| gzip -f - | gzip -f - | wc

    gives about three kilobytes for a terabyte of data.

  4. Incomplete Article Summary by bigtallmofo · · Score: 5, Funny

    The summary should have read...

    StorageMojo is reporting that a company named Practical Nano Cold Fusion Duke Nukem Forever at Storage Networking World in San Diego has made a startling claim of 25x data compression for digital...

    --
    I'm a big tall mofo.
  5. Re:Breaking news! by nizo · · Score: 4, Funny

    Maybe it is lossy compression, which would be really nice when compressing executables and old spreadsheets.

  6. Shame on you, ScuttleMonkey! by RobertB-DC · · Score: 3, Funny

    Posted by ScuttleMonkey on Wed Apr 05, '06 03:23 PM
    from the make-sure-to-give-it-to-more-than-just-the- corporate-monkies dept.


    You would think that an editor called Scuttle Monkey would know that the correct plural of "Monkey" is "Monkeys", not "Monkies".

    "Monkies" would be the plural of "Monkie", which I guess is what you'd call a baby Monk Seal, or if you knew him really well, a resident of a Monastery. "Hey, Monkie, nice robe!"

    Of course, if you were talking to Michael Nesmith, the singular form would be "Monkee". But that's neither here nor there.

    --
    Stressed? Me? Of course not. Stress is what a rubber band feels before it breaks, silly.
  7. Re:What kind of data? by swimboy · · Score: 5, Funny

    It can compress anything! At the demo, I saw them compress 25 oz. of snake oil so that it all fit in a 1 oz. jar!

    --
    Ask me how the Heisenberg Principle may or may not have saved my life.
  8. I've always imagined this conversation by jfengel · · Score: 5, Funny

    Developers: We've got some really good ideas for reducing backup space by using compression and incremental backups.

    Marketing: How much in the best conceivable case?

    Developers: Oh, I dunno, maybe 25x.

    Marketing: 25x? Is that good?

    Developers: Yeah, I suppose, but the cool stuff is...

    Marketing: Wow! 25x! That's a really big number!

    Developers: Actually, please don't quote me on that. They'll make fun of me on Slashdot if you do. Promise me.

    Marketing: We promise.

    Developers: Thanks. Now, let me show you where the good stuff is...

    Marketing (on phone): Larry? It's me. How big can you print me up a poster that says "25x"?

  9. This definitely works by All+Names+Have+Been · · Score: 5, Funny

    I can tell you, this technology definitely works. I've seen them compress random data streams to 1/25th (even 1/30th!!) their size. This works *TODAY*. Coming out real soon now is the software that allows you to decompress your data. This is still in development.

  10. Re:Where have we heard this one before? by Anonymous Coward · · Score: 1, Funny

    Please do not let this person ork any more cows. It's bad for him, and bad for the cow. Just say no to Cow Orking!

  11. Re:What kind of data? by networkBoy · · Score: 4, Funny

    1.
    I can compress anything you give me by a factor of at least 1 (inclusive of my own output).

    "-1 pedantic", I know.
    -nB

    --
    whois gawk date unzip strip find touch finger mount join nice man top fsck grep eject more yes exit umount sleep dump
  12. MOD PARENT DOWN by gEvil+(beta) · · Score: 4, Funny

    Mod parent down! Nobody needs to see goatse again...

    --
    This guy's the limit!
  13. Re:What kind of data? by morcheeba · · Score: 2, Funny

    I've heard you have to do the decompression carefully, though -- If you do it too quickly, you just end up making a big mess.

  14. Re:What kind of data? by TheNetAvenger · · Score: 5, Funny

    In other words, they're full of crap.

    But the Slashdot Post says that is all runs on Linux. And knowing the infinite power of Linux, I believe them.

    In addition to being the best OS in the world, Linux is also the most secure, does everything better than every other OS, and if given the right developers it is the ONLY os that could do something as impressive as compress data past the limits of possiblity.

    I'm sure with the right developer, Linux could also be used to harness zero point energy, create wormholes for travel in your basement, and possibly cure most diseases... /wink

  15. Re:Breaking news! by x2A · · Score: 2, Funny

    If only they had this a few years ago during the enron mess, they could have claimed "we didn't fiddle the accounts, we just saved it using lossy compression techniques".

    Just like the "our intelligence wasn't wrong about Sadam having WMD's, the satalite images just come to us as lossy JPEGs"

    (the point of this post lost due to compression)

    --
    The revolution will not be televised... but it will have a page on Wikipedia
  16. Re:What kind of data? by WhiteWolf666 · · Score: 3, Funny

    oOo. Sounds like you are going to find the data singularity.

    A single byte that is all other data compressed together, and from which all knowledge flows! The universal black hole of data!

    Don't tell me .... is this a new MS Vista technology?

    --
    WhiteWolf666 an exBush supporter. All you new-school,compassionate,save the children Republicans can rot in hell
  17. Re:What kind of data? by jedimark · · Score: 2, Funny

    You mean /dev/random? :)

  18. You geek! by thepotoo · · Score: 2, Funny

    Sheesh...when did you last get laid?

    --
    Obligatory Soundbite Catchphrase