Slashdot Mirror


MapReduce For the Masses With Common Crawl Data

New submitter happyscientist writes "This is a nice 'Hello World' for using Hadoop MapReduce on Common Crawl data. I was interested when Common Crawl announced themselves a few weeks ago, but I was hesitant to dive in. This is a good video/example that makes it clear how easy it is to start playing with the crawl data."

3 of 29 comments (clear)

  1. Happy Data Mining from the Golden Girls!!11! by Anonymous Coward · · Score: -1, Offtopic

    Thank you for being a friend
    Traveled down the road and back again
    your heart is true you're a pal and a cosmonaut

    And if you threw a party
    Invited everyone you knew
    You would see, the biggest gift would be from me
    and the card attached would say,
    Thank you for being a friend

  2. LIL KIM KILLS SELF !! by Anonymous Coward · · Score: -1, Offtopic

    And N Korea doesn't notice !!

    Put that in your owndahl heater and smoke it !!

    Long live the king !!

  3. Hot Damn! Now I Can Find All The Pr0n Of My Misspe by MichaelCrawford · · Score: -1, Offtopic

    -nt Youth!

    It's not hard at all to find PDFs of recently published Magazines of Ill Repute, but because what is for little boys and little girls is just an implicit fascination became an explicit one for me in 1976, the magazines that taught me about what awaited me at The Promised Land are very hard to find.

    One can generally find videos as what are called The Classics are now available on DVD and sometimes even on Blu-ray, but Classic Magazines require manual scanning.

    If any of you guys happens to own a copy of the February 1976 Club Magazine USA, I would really like to someday finish reading a short story in which some guy in full SCUBA gear makes love to a rapturously beautiful semitransparent female ghost. I was once a diver myself, and still have my NAUI Open Water Card, but never in my life have I found a wetsuit that was equipped for quite that same kind of diving.

    --
    Request your free CD of my piano music.