Slashdot Mirror


Amazon's Mechanical Turk

rscoggin writes "Amazon.com has a new program that wants you to 'Complete simple tasks that people do better than computers. And, get paid for it.' (example: 'Is there a pizza parlour in this photograph?'). For each task you complete you get a small payment, usually ranging from a few cents to a little under a dollar. It's named the Amazon Mechanical Turk after a famous hoax from the 19th century. Kill time and get paid in tiny increments to boot!" Similar to Google Answers, there seems to be a reliability ratings system and some incentives.

27 of 375 comments (clear)

  1. Great... by TubeSteak · · Score: 5, Funny

    Great... Another way for /.'ers to waste time at work.
    GOOD JOB AMAZON

    --
    [Fuck Beta]
    o0t!
    1. Re:Great... by phase_9 · · Score: 5, Funny

      News just in, people getting paid to look at webpages they're not meant to at work! In unrelated news, slashdot hits drop off...

  2. i can see it already... by Anonymous Coward · · Score: 5, Funny

    - can you see boobs in the picture ?
    - Is there a donkey in the picture ?
    - Can you see the can of whipped cream ?
    - is there chocolate paint involved..

    Advanced indexing of Pr0n, humanity is moving forward, no doubt.

  3. Re:CAPTCHAs by Agelmar · · Score: 5, Informative

    Actually, yes. The whole motivation from this came from the same person who invented the CAPTCHA, and was explained in his thesis defense on Wednesday. Abstract for those who care:

    Subject: Thesis Oral - Luis von Ahn

    November 2, 2005
    Luis von Ahn
    12:00 PM, 3305 Newell-Simon Hall
    Thesis Oral
    Title: Human Computation

    Abstract:

    Tasks like image recognition are trivial for humans, but continue to
    challenge even the most sophisticated computer programs. This thesis
    introduces a paradigm for utilizing human processing power to solve
    problems that computers cannot yet solve. Traditional approaches to
    solving such problems focus on improving software. I advocate a novel
    approach: constructively channel human brainpower using computer games.
    For example, the ESP Game, introduced in this thesis, is an enjoyable
    online game -- many people play over 40 hours a week -- and when people
    play, they help label images on the Web with descriptive keywords. These
    keywords can be used to significantly improve the accuracy of image
    search. People play the game not because they want to help, but because
    they enjoy it.

    I introduce three other examples of games with a purpose: Peekaboom,
    which helps determine the location of objects in images, Phetch, which
    collects paragraph descriptions of arbitrary images to help
    accessibility of the Web, and Verbosity, which collects common-sense
    knowledge. I also show that, in principle, every problem that could be
    solved by a computer, today or in the future, could be solved using
    enjoyable computer games.

    In addition, I introduce CAPTCHAs, automated tests that humans can pass
    but computer programs cannot. CAPTCHAs take advantage of human
    processing power in order to differentiate humans from computers, an
    ability that has important applications in practice.

    The results of this thesis are currently in use by hundreds of Web sites
    and companies around the world, and some of the games presented here
    have been played by over 100,000 people. Practical applications of this
    work include improvements in problems such as: image search,
    adult-content filtering, spam, common-sense reasoning, computer vision,
    accessibility, and security in general.

    Thesis Committee:
    Manuel Blum, Chair
    Takeo Kanade
    Michael Reiter
    Josh Benaloh, Microsoft Research
    Jitendra Malik, University of California, Berkeley

  4. This could be brilliant. by RandoX · · Score: 5, Insightful

    Pepsi pays Amazon 3 cents for product placement. You are shown an image of a Pepsi can. "What kind of soda is this?" "pepsi", you answer. You get paid 2 cents.

  5. So this is going mainstream now... by Dekortage · · Score: 4, Informative

    According to this earlier Slashdot report, the spam industry has been doing this for awhile with free porn.

    I'm curious to know if Amazon is going to use the cumulative results to try to "train" computers, or if it really is just for the money. The requirements include being over 18, so you can't pimp your kids to click through this stuff for cash (though I'm sure it will happen).

    --
    $nice = $webHosting + $domainNames + $sslCerts
  6. Doesn't pay enough by slavemowgli · · Score: 5, Insightful

    Maybe it's just me, but it seems that it's not really worth it. Consider the following task, for example:

    Your task is to create a new product description for a product in the Amazon.com Automotive catalogue. The Product Description provides an additional opportunity to tell the customer about the product. This HIT will require some product research to complete. Approval depends on following the instructions and the quality of your submission, determined by a manual review.

    Guess how much you get paid for that. 2 dollars? 3? That wouldn't be unreasonable, I think, considering that you're supposed to write an entire product description from scratch for which additional "research" is required. The actual amount paid is only 65 cents, though.

    Maybe it's just me, but if I check to see how much I need to work in my regular job to make 65 cents, then it does not make any sense to invest more than a few minutes into a task like this, and it seems that it would take more than that to actually complete it. The fact that there's a review required afterwards doesn't exactly make things better, either - if what you did gets rejected, then you've essentially worked for nothing (I wonder if there's anything that keeps amazon from still using your description in this case, too...).

    In other words, the whole thing seems like a good idea in theory, but it won't really take off until they're willing to actually pay you a reasonable amount.

    --
    quidquid latine dictum sit altum videtur.
    1. Re:Doesn't pay enough by Anne_Nonymous · · Score: 5, Funny

      It's not about the money; it's about fucking with Amazon, by giving hilariously incorrect answers.

    2. Re:Doesn't pay enough by egomaniac · · Score: 4, Insightful

      If you notice most are "find the best picture" for $0.03. Of course the site rules really slow right now so its not worth your time, but if it ran faster it would be something to do if you could crank through a hundred an hour.

      100 images / hour * $0.03 / image == $3.00 / hour.

      So, you've just busted your ass to crank through one image every 36 seconds for a solid hour, and you have three dollars to show for it. There are definitely parts of the world where that would be a fantastic income, but my home country isn't one of them.

      --
      ZFS: because love is never having to say fsck
  7. 3 cents for 1 hours work? by mustafap · · Score: 4, Funny

    Wow, I can give up my day job!

    --
    Open Source Drum Kit, LPLC deve board - mjhdesigns.com
  8. Sounds interesting but.... by antifoidulus · · Score: 4, Insightful

    I'm a bit too paranoid to type my Amazon user name and password into a site that isn't on the main amazon.com domain....I can't find it mentioned anywhere on amazon's main site. Can somebody a little bit less of a wuss tell me if it is legit?

    1. Re:Sounds interesting but.... by Dekortage · · Score: 5, Informative

      Well, mturk.amazon.com redirects you to www.mturk.com... seems to imply something.

      --
      $nice = $webHosting + $domainNames + $sslCerts
    2. Re:Sounds interesting but.... by stefanb · · Score: 4, Informative
      I'm a bit too paranoid to type my Amazon user name and password into a site that isn't on the main amazon.com domain

      The whois info looks a bit dodgy. I would have expected Amazon knew how to properly register domains...

      Registrant:
      MTAI, Inc.
      P.O. Box 80626
      Seattle, Washington 98108
      United States

      Registered through: GoDaddy.com
      Domain Name: MTURK.COM
      Created on: 22-Oct-01
      Expires on: 22-Oct-06
      Last Updated on: 11-Oct-05

      Administrative Contact:
      Hostmaster, MTAI mechturk1@hotmail.com
      MTAI, Inc.
      P.O. Box 80626
      Seattle, Washington 98108
      United States
      2065794562 Fax --
      Technical Contact:
      Hostmaster, MTAI mechturk1@hotmail.com
      MTAI, Inc.
      P.O. Box 80626
      Seattle, Washington 98108
      United States
      2065794562 Fax --

    3. Re:Sounds interesting but.... by droptone · · Score: 5, Informative

      Amazon has a page on their site about MTurk

      --
      Every post I make begins with the assumption P=~P.
    4. Re:Sounds interesting but.... by trib3003 · · Score: 4, Informative

      Agreed: whois looks pretty odd. Amazon slashdotted ? Jep, another odd point.

      But in case this is some kind of phishing, they at least manipulated some reverse
      records too :)

      traceroute to www.mturk.com (207.171.166.182), 30 hops max, 40 byte packets
      [...]
      11 amazon-above.mpr1.iad5.us.mfnx.net.175.185.208.in- addr.arpa (208.185.175.66) 96.801 ms 97.656 ms 97.633 ms
      12 72.21.201.27 97.109 ms 97.347 ms 98.164 ms
      13 166-182.amazon.com (207.171.166.182) 98.107 ms 97.069 ms 97.510 ms

  9. How long until some sick slashdotter posts the ... by Anonymous Coward · · Score: 5, Funny

    following HIT: "Is there a goat in that picture?"

  10. Re:$/hr by yellowbkpk · · Score: 4, Informative

    I did nine 3-cent HITs in about 5 or 6 minutes, so that's about 3.25/hour. The lag for me was in waiting for the images to download and clicking on the "Accept HIT" button repeatedly.

    There is an API, maybe if someone made a page that just displays the images and sends in the result when you click on the image instead of having to click twice for each HIT, you could go faster and make much more money.

  11. Contracting work worth big bucks by Silverhammer · · Score: 4, Insightful

    After a quick review of the available tasks, I must say this looks like a huge scam. Most of the tasks are marketing oriented (e.g. copywriting, photo manipulation), for which experienced contractors get paid $30 to $50 per hour.

    Only 75 cents to research and write a complete automotive product description? Are they kidding? Sure, they say I can copy the description from the manufacturer's Web site, but my time is still worth more than that. Besides, I think it's the responsibility of the manufacturer to make sure their Amazon listing is correct. That's how they do it on IMDB.

    I can only hope the program will make more sense as they add more requesters and more tasks.

  12. Willing to compete with the Indians? by nysus · · Score: 4, Insightful

    I'm interested to know if those living overseas can participate. If so, they would drive down the labor costs so much that only truly desperate Americans would participate in this piecework scheme.

    --

    ---Technology will liberate us if it doesn't enslave us first.

  13. Profit? by DevolvingSpud · · Score: 5, Interesting

    Since this is all web-services driven, it seems to me you could create an interesting cycle with a simple program:

    1) Use the API to find a HIT, and sign up to complete it.
    2) Create a new HIT that basically asks someone to complete the first HIT,
          only for $0.01 less than the original HIT was offering.
    3) Do this for every existing HIT.
    4) Profit?

    --
    Keep your friends close.
    Keep your enemies in a little jar on your desk.
  14. What is your time worth? by shoolz · · Score: 4, Insightful

    Rather than think about how much you could make per hour on this, think about how much your time is worth. Are you worth $65,000 per year? Maybe you're worth more or you value your time more? In any case, at $65,000 per year, you make about $0.52 per minute.

    So to accomplish the 3 cent task and make your time worth it, you should spend no more than about 2 and a half seconds from the second you begin to the second you finish and get approval.

    On some of the higher paying ones, oh, say $0.40 for writing a full product review, you could devote almost a full minute!

  15. Philip K. Dick by baxissimo · · Score: 5, Interesting

    The reminds me of the Philip K. Dick novel in which the main character thinks he lives an ordinary life, and who solves the daily puzzle in the newspaper every day for cheap entertainment. In reality, though, the whole town he lives in is a front, and the fun puzzles he's solving in the newspaper are actually cleverly disguised military strategy problems of some sort.

    Quick -- someone patent that storyline and sue Amazon for infringement!

    1. Re:Philip K. Dick by layzee · · Score: 5, Informative

      Time out of Joint

  16. Highly suspectful site. Do NOT give any detail by Ilgaz · · Score: 4, Interesting

    Guys, let me tell.

    It's registered through Godaddy.com, one of the companies spammers/phishers love to use.

    It has hotmail contact addresses in whois. Impossible for a company like Amazon

    No clue of such thing on official Amazon press room
    http://phx.corporate-ir.net/phoenix.zhtml?c=176060 &p=irol-news

    So if it looks like,acts like,runs like (amazon gigantic server farm slashdotted?) a regular phishing site, it is. Even if it made to Slashdot. I'd say pull the story until Amazon comes up with an explanation. Before any harm done.

    It could be even a more "elite" hack including subdomain/DNS hacking. I am a spamcop mail customer and I see amazing things everyday.

    In risk of looking very funny if it is not anything above, happily posting it.

  17. Agent Smith, is that you? by OldManAndTheC++ · · Score: 5, Funny
    I hope you all can see where this is going:

    • 2005: Amazon introduces Mechanical Turk program. Thousands of underpaid geeks sign up and start clicking mindlessly.
    • 2010: Home catheterization and feeding tube kit eliminates need to leave workstation. Productivity skyrockets.
    • 2015: Direct neural interface improves response times one million-fold.
    • 2020: The Matrix

    Don't say I didn't warn you.

    --
    Soylent Green is peoplicious!
  18. automating this by mboedick · · Score: 4, Interesting

    For the image ones, couldn't you create 5 bots each with a different account and each one picks a different image and one picks None of these? One of them would be approved and you'd get paid, right?

    Also if they are having humans approve your image selection before you get paid, isn't that as much effort as you making your original choice?

  19. Message from Amazon Mechanical Turk Team by Amazon+Mturk+Team · · Score: 5, Informative

    We're grateful to have been Slashdotted! Our beta site, mturk.amazon.com, is experiencing the Slashdot effect. You can still read about Amazon Mechanical Turk and its web services APIs at www.amazon.com/webservices. Also, send a blank email to aws@amazon.com if you want us to email you when page load times recover. The Amazon Mechanical Turk Team