Slashdot Mirror


Compress Wikipedia and Win AI Prize

Baldrson writes "If you think you can compress a 100M sample of Wikipedia better than paq8f, then you might want to try winning win some of a (at present) 50,000 Euro purse. Marcus Hutter has announced the Hutter Prize for Lossless Compression of Human Knowledge the intent of which is to incentivize the advancement of AI through the exploitation of Hutter's theory of optimal universal artificial intelligence. The basic theory, for which Hutter provides a proof, is that after any set of observations the optimal move by an AI is find the smallest program that predicts those observations and then assume its environment is controlled by that program. Think of it as Ockham's Razor on steroids. Matt Mahoney provides a writeup of the rationale for the prize including a description of the equivalence of compression and general intelligence."

25 of 324 comments (clear)

  1. But captain by Anonymous Coward · · Score: 5, Funny

    Marcus Hutter has announced the Hutter Prize for Lossless Compression of Human Knowledge the intent of which is to incentivize the advancement of AI through the exploitation of Hutter's theory of optimal universal artificial intelligence.

    But captain, if we reverse the tachyon inverter drives then we will have insufficient dilithium crystals to traverse the neutrino warp.

    1. Re:But captain by Anonymous Coward · · Score: 5, Funny

      You left out the part involving the deflector shield. Remember, the first rule of star trek technobabel is always involve the deflector in some way.

    2. Re:But captain by Anonymous Coward · · Score: 1, Funny

      Off Topic, I know... but I must ask...

      Do you think that Shatner, while just standing around, like in the supermarket, or waiting in line at the post office, just kinda gets this faraway look on his face, and screams out in a tortured voice...

      KAAAAHHHHHHHHNNNNN!!! ...Then just goes back to what he was doing like nothing happened?

    3. Re:But captain by Anonymous Coward · · Score: 1, Funny

      No, but I suppose people do that *to* him!

  2. As long as it is Wiki that we are talking about... by gatkinso · · Score: 3, Funny



    There. All of wiki, in 31 bytes.

    --
    I am very small, utmostly microscopic.
  3. Who'da thunk... by blueadept1 · · Score: 5, Funny

    Man, WinRar is taking its bloody time. But oh god, when its done, I'll be rich!

  4. Easy! by RyuuzakiTetsuya · · Score: 1, Funny

    arj

    --
    Non impediti ratione cogitationus.
  5. Lossy Compression? by Millenniumman · · Score: 3, Funny

    Convert it to AOL! tis wikpedia, teh fri enpedia . teh bst in da wrld.

    --
    Stupidity is like nuclear power, it can be used for good or evil. And you don't want to get any on you.
  6. Re:Can it be "lossy" compression? by richdun · · Score: 4, Funny

    Hmmm...well in that case, someone go edit the Wikipedia entry on "computers" and allow them to store data at the bit level. Also, I heard somewhere where computers in Africa have tripled in the past six months!

  7. Re:Can it be "lossy" compression? by Bill+Kilgore · · Score: 5, Funny

    I have a program that compresses 100M of Wikipedia to one bit with no loss at all. The program is somewhat special-purpose, and at 100,024,076 bytes, a little chunkier than I'd like.

    --
    Rediculous: A word indicating the writer is ridiculously ignorant.
  8. Solution. by Funkcikle · · Score: 5, Funny

    Removing all the incorrect and inaccurate data from the Wikipedia sample should "compress" it down to at least 20mb.

    Then just apply your personal favourite compression utility.

    I like lharc, which according to Wikipedia was invented in 1904 as a result of bombarding President Lincoln, who plays Commander Tucker in Star Trek: Enterprise with neutrinos.

  9. Incentivize? by noidentity · · Score: 5, Funny
    the intent of which is to incentivize the advancement of AI

    Sorry, anything which uses the word "incentivize" does not involve intelligence, natural or artificial.

  10. Re:It's a big world out there by gardyloo · · Score: 4, Funny

    TFA is a neat idea theoreretically, but it's progeny will never be able to leave the lab.

          Your use of "TFA" is a good compressional technique, but you could change "it's" to "its" and actually GAIN in meaning while losing a character! You're well on your way...

  11. I'll try: by dcapel · · Score: 5, Funny

    echo "!#/bin/sh\nwget en.wikipedia.org/enwiki/" > archive

    Mine wins as it is roughly 40 bytes total.To get your results, you simply need to run the self-extracting archive, and wait. Be warned, it will take a while, but that is the cost of such a great compression scheme!

    --
    DYWYPI?
    1. Re:I'll try: by MarkRose · · Score: 3, Funny

      echo "!#/bin/cat /dev/tty0" > archive

      Here's one that's even shorter, but you have to type in the decryption key exactly right.

      --
      Be relentless!
  12. Re:WikiPedia on iPod! by Asztal_ · · Score: 4, Funny

    Umm... which of the 5 thousand links is the article?

  13. C++ by The+Bungi · · Score: 2, Funny
    Interestingly enough, the source code for the compressor is C++. One would expect the thing to be written in pure C.

    A (good) sign of the times, I guess.

  14. Re:Comparison by joshier · · Score: 3, Funny

    Well, if I knew that 15 years ago, I would indeed have been a genuis, sadly I realized too late and my genuis talents are wasted yet again.

    Have no fear though, I'm working on a new one.

  15. And there was me thinking.. by baz1860 · · Score: 2, Funny

    that the entire knowledge of the world could simply be compressed without loss to

    yeah, you guessed it..

    42...

    --
    He who would trade liberty for some temporary security, deserves neither liberty nor security
  16. wikicast by VolciMaster · · Score: 3, Funny
    a method for periodically re-syncing...

    So, we need a WikiCast - remember folks, you heard it here first!

  17. Would be useful for images by aliquis · · Score: 4, Funny

    ... now all we need is a dictionary for nudity and we could save a lot of bandwidth on the Internet!

  18. Compress Wikipedia and win a prize? by Dachannien · · Score: 4, Funny

    Can't I just punch the monkey for $20 instead?

  19. Re:Not sure if that's a joke. by Andrew+Kismet · · Score: 3, Funny

    Of course he was joking. If he was serious he would've said "verbificate".

  20. Re:Painful to read by PeeAitchPee · · Score: 4, Funny

    He did, but Slashdot's AI compressed it for him.

    :-D

  21. Re:WikiPedia on iPod! by Kyoushu · · Score: 1, Funny

    I like to hitchhike, and I could use a guide like this on my travels.