Slashdot Mirror


Amazon's Mechanical Turk

rscoggin writes "Amazon.com has a new program that wants you to 'Complete simple tasks that people do better than computers. And, get paid for it.' (example: 'Is there a pizza parlour in this photograph?'). For each task you complete you get a small payment, usually ranging from a few cents to a little under a dollar. It's named the Amazon Mechanical Turk after a famous hoax from the 19th century. Kill time and get paid in tiny increments to boot!" Similar to Google Answers, there seems to be a reliability ratings system and some incentives.

37 of 375 comments (clear)

  1. Great... by TubeSteak · · Score: 5, Funny

    Great... Another way for /.'ers to waste time at work.
    GOOD JOB AMAZON

    --
    [Fuck Beta]
    o0t!
    1. Re:Great... by phase_9 · · Score: 5, Funny

      News just in, people getting paid to look at webpages they're not meant to at work! In unrelated news, slashdot hits drop off...

  2. CAPTCHAs by CableModemSniper · · Score: 3, Interesting

    Does this mean I can get paid for breaking CAPTCHAs?

    --
    Why not fork?
    1. Re:CAPTCHAs by Agelmar · · Score: 5, Informative

      Actually, yes. The whole motivation from this came from the same person who invented the CAPTCHA, and was explained in his thesis defense on Wednesday. Abstract for those who care:

      Subject: Thesis Oral - Luis von Ahn

      November 2, 2005
      Luis von Ahn
      12:00 PM, 3305 Newell-Simon Hall
      Thesis Oral
      Title: Human Computation

      Abstract:

      Tasks like image recognition are trivial for humans, but continue to
      challenge even the most sophisticated computer programs. This thesis
      introduces a paradigm for utilizing human processing power to solve
      problems that computers cannot yet solve. Traditional approaches to
      solving such problems focus on improving software. I advocate a novel
      approach: constructively channel human brainpower using computer games.
      For example, the ESP Game, introduced in this thesis, is an enjoyable
      online game -- many people play over 40 hours a week -- and when people
      play, they help label images on the Web with descriptive keywords. These
      keywords can be used to significantly improve the accuracy of image
      search. People play the game not because they want to help, but because
      they enjoy it.

      I introduce three other examples of games with a purpose: Peekaboom,
      which helps determine the location of objects in images, Phetch, which
      collects paragraph descriptions of arbitrary images to help
      accessibility of the Web, and Verbosity, which collects common-sense
      knowledge. I also show that, in principle, every problem that could be
      solved by a computer, today or in the future, could be solved using
      enjoyable computer games.

      In addition, I introduce CAPTCHAs, automated tests that humans can pass
      but computer programs cannot. CAPTCHAs take advantage of human
      processing power in order to differentiate humans from computers, an
      ability that has important applications in practice.

      The results of this thesis are currently in use by hundreds of Web sites
      and companies around the world, and some of the games presented here
      have been played by over 100,000 people. Practical applications of this
      work include improvements in problems such as: image search,
      adult-content filtering, spam, common-sense reasoning, computer vision,
      accessibility, and security in general.

      Thesis Committee:
      Manuel Blum, Chair
      Takeo Kanade
      Michael Reiter
      Josh Benaloh, Microsoft Research
      Jitendra Malik, University of California, Berkeley

  3. i can see it already... by Anonymous Coward · · Score: 5, Funny

    - can you see boobs in the picture ?
    - Is there a donkey in the picture ?
    - Can you see the can of whipped cream ?
    - is there chocolate paint involved..

    Advanced indexing of Pr0n, humanity is moving forward, no doubt.

  4. This could be brilliant. by RandoX · · Score: 5, Insightful

    Pepsi pays Amazon 3 cents for product placement. You are shown an image of a Pepsi can. "What kind of soda is this?" "pepsi", you answer. You get paid 2 cents.

    1. Re:This could be brilliant. by Breakfast+Pants · · Score: 3, Funny

      Even better would be if there were pictures of people enjoying pepsi with the same question and answer as you gave and then they also had ugly people drinking coke and cringing, etc. with the same question, but new answer, "coke."

      --

      --

      WHO ATE MY BREAKFAST PANTS?
  5. So this is going mainstream now... by Dekortage · · Score: 4, Informative

    According to this earlier Slashdot report, the spam industry has been doing this for awhile with free porn.

    I'm curious to know if Amazon is going to use the cumulative results to try to "train" computers, or if it really is just for the money. The requirements include being over 18, so you can't pimp your kids to click through this stuff for cash (though I'm sure it will happen).

    --
    $nice = $webHosting + $domainNames + $sslCerts
  6. Doesn't pay enough by slavemowgli · · Score: 5, Insightful

    Maybe it's just me, but it seems that it's not really worth it. Consider the following task, for example:

    Your task is to create a new product description for a product in the Amazon.com Automotive catalogue. The Product Description provides an additional opportunity to tell the customer about the product. This HIT will require some product research to complete. Approval depends on following the instructions and the quality of your submission, determined by a manual review.

    Guess how much you get paid for that. 2 dollars? 3? That wouldn't be unreasonable, I think, considering that you're supposed to write an entire product description from scratch for which additional "research" is required. The actual amount paid is only 65 cents, though.

    Maybe it's just me, but if I check to see how much I need to work in my regular job to make 65 cents, then it does not make any sense to invest more than a few minutes into a task like this, and it seems that it would take more than that to actually complete it. The fact that there's a review required afterwards doesn't exactly make things better, either - if what you did gets rejected, then you've essentially worked for nothing (I wonder if there's anything that keeps amazon from still using your description in this case, too...).

    In other words, the whole thing seems like a good idea in theory, but it won't really take off until they're willing to actually pay you a reasonable amount.

    --
    quidquid latine dictum sit altum videtur.
    1. Re:Doesn't pay enough by Anne_Nonymous · · Score: 5, Funny

      It's not about the money; it's about fucking with Amazon, by giving hilariously incorrect answers.

    2. Re:Doesn't pay enough by egomaniac · · Score: 4, Insightful

      If you notice most are "find the best picture" for $0.03. Of course the site rules really slow right now so its not worth your time, but if it ran faster it would be something to do if you could crank through a hundred an hour.

      100 images / hour * $0.03 / image == $3.00 / hour.

      So, you've just busted your ass to crank through one image every 36 seconds for a solid hour, and you have three dollars to show for it. There are definitely parts of the world where that would be a fantastic income, but my home country isn't one of them.

      --
      ZFS: because love is never having to say fsck
    3. Re:Doesn't pay enough by photon317 · · Score: 3, Informative


      So basically, if it takes you 5 minutes to write a brief product description, and you churn through them all day, you're making $7.80, which is better than minimum wage. Not a good proprosition if you're clueless about auto parts and have to research everything as described, but I don't think that's the intended optimal target for completing the task (although it someone's dumb enough to spend half an hour or more per description for a crappy hourly wage, they're more than welcome). The optimal target to take up that task is someone who already knows a lot about car parts. Chances are if you're an Autozone (auto parts store chain) employee, you could get most of the descriptions done in under 5 minutes with little to no side research, because you already have the domain-specific knowledge. That's the guy who will be drawn to answer that question.

      So the key to making effective money at this scheme is to skip tasks that you don't think you're "better than average" at - kinda like the job marketplace in real life.

      --
      11*43+456^2
    4. Re:Doesn't pay enough by TheSync · · Score: 3, Informative

      One billion people on planet earth make less than $1 per day. Perhaps you are not the target audience...

  7. 3 cents for 1 hours work? by mustafap · · Score: 4, Funny

    Wow, I can give up my day job!

    --
    Open Source Drum Kit, LPLC deve board - mjhdesigns.com
  8. Sounds interesting but.... by antifoidulus · · Score: 4, Insightful

    I'm a bit too paranoid to type my Amazon user name and password into a site that isn't on the main amazon.com domain....I can't find it mentioned anywhere on amazon's main site. Can somebody a little bit less of a wuss tell me if it is legit?

    1. Re:Sounds interesting but.... by Dekortage · · Score: 5, Informative

      Well, mturk.amazon.com redirects you to www.mturk.com... seems to imply something.

      --
      $nice = $webHosting + $domainNames + $sslCerts
    2. Re:Sounds interesting but.... by stefanb · · Score: 4, Informative
      I'm a bit too paranoid to type my Amazon user name and password into a site that isn't on the main amazon.com domain

      The whois info looks a bit dodgy. I would have expected Amazon knew how to properly register domains...

      Registrant:
      MTAI, Inc.
      P.O. Box 80626
      Seattle, Washington 98108
      United States

      Registered through: GoDaddy.com
      Domain Name: MTURK.COM
      Created on: 22-Oct-01
      Expires on: 22-Oct-06
      Last Updated on: 11-Oct-05

      Administrative Contact:
      Hostmaster, MTAI mechturk1@hotmail.com
      MTAI, Inc.
      P.O. Box 80626
      Seattle, Washington 98108
      United States
      2065794562 Fax --
      Technical Contact:
      Hostmaster, MTAI mechturk1@hotmail.com
      MTAI, Inc.
      P.O. Box 80626
      Seattle, Washington 98108
      United States
      2065794562 Fax --

    3. Re:Sounds interesting but.... by droptone · · Score: 5, Informative

      Amazon has a page on their site about MTurk

      --
      Every post I make begins with the assumption P=~P.
    4. Re:Sounds interesting but.... by Hedgethorn · · Score: 3, Informative
    5. Re:Sounds interesting but.... by trib3003 · · Score: 4, Informative

      Agreed: whois looks pretty odd. Amazon slashdotted ? Jep, another odd point.

      But in case this is some kind of phishing, they at least manipulated some reverse
      records too :)

      traceroute to www.mturk.com (207.171.166.182), 30 hops max, 40 byte packets
      [...]
      11 amazon-above.mpr1.iad5.us.mfnx.net.175.185.208.in- addr.arpa (208.185.175.66) 96.801 ms 97.656 ms 97.633 ms
      12 72.21.201.27 97.109 ms 97.347 ms 98.164 ms
      13 166-182.amazon.com (207.171.166.182) 98.107 ms 97.069 ms 97.510 ms

  9. How long until some sick slashdotter posts the ... by Anonymous Coward · · Score: 5, Funny

    following HIT: "Is there a goat in that picture?"

  10. Re:$/hr by yellowbkpk · · Score: 4, Informative

    I did nine 3-cent HITs in about 5 or 6 minutes, so that's about 3.25/hour. The lag for me was in waiting for the images to download and clicking on the "Accept HIT" button repeatedly.

    There is an API, maybe if someone made a page that just displays the images and sends in the result when you click on the image instead of having to click twice for each HIT, you could go faster and make much more money.

  11. Contracting work worth big bucks by Silverhammer · · Score: 4, Insightful

    After a quick review of the available tasks, I must say this looks like a huge scam. Most of the tasks are marketing oriented (e.g. copywriting, photo manipulation), for which experienced contractors get paid $30 to $50 per hour.

    Only 75 cents to research and write a complete automotive product description? Are they kidding? Sure, they say I can copy the description from the manufacturer's Web site, but my time is still worth more than that. Besides, I think it's the responsibility of the manufacturer to make sure their Amazon listing is correct. That's how they do it on IMDB.

    I can only hope the program will make more sense as they add more requesters and more tasks.

  12. Good idea but for work required it should pay more by digitaldc · · Score: 3, Insightful

    They are asking you to rewrite product descriptions and will pay you 60 cents?
    Not only will the work most likely be shoddy, but it seems like they are trying to replace someone else's job by using this cheap online service.
    Yes, for some it may provide rewards but if you calculate the amount of time spent on each item VS. the payment reward (usually a few pennies) it is just not worth someone's free time.
    Why don't they just hire a staff of people to work on these 'HITS'?

    --
    He who knows best knows how little he knows. - Thomas Jefferson
  13. Willing to compete with the Indians? by nysus · · Score: 4, Insightful

    I'm interested to know if those living overseas can participate. If so, they would drive down the labor costs so much that only truly desperate Americans would participate in this piecework scheme.

    --

    ---Technology will liberate us if it doesn't enslave us first.

  14. Profit? by DevolvingSpud · · Score: 5, Interesting

    Since this is all web-services driven, it seems to me you could create an interesting cycle with a simple program:

    1) Use the API to find a HIT, and sign up to complete it.
    2) Create a new HIT that basically asks someone to complete the first HIT,
          only for $0.01 less than the original HIT was offering.
    3) Do this for every existing HIT.
    4) Profit?

    --
    Keep your friends close.
    Keep your enemies in a little jar on your desk.
  15. What is your time worth? by shoolz · · Score: 4, Insightful

    Rather than think about how much you could make per hour on this, think about how much your time is worth. Are you worth $65,000 per year? Maybe you're worth more or you value your time more? In any case, at $65,000 per year, you make about $0.52 per minute.

    So to accomplish the 3 cent task and make your time worth it, you should spend no more than about 2 and a half seconds from the second you begin to the second you finish and get approval.

    On some of the higher paying ones, oh, say $0.40 for writing a full product review, you could devote almost a full minute!

  16. Philip K. Dick by baxissimo · · Score: 5, Interesting

    The reminds me of the Philip K. Dick novel in which the main character thinks he lives an ordinary life, and who solves the daily puzzle in the newspaper every day for cheap entertainment. In reality, though, the whole town he lives in is a front, and the fun puzzles he's solving in the newspaper are actually cleverly disguised military strategy problems of some sort.

    Quick -- someone patent that storyline and sue Amazon for infringement!

    1. Re:Philip K. Dick by layzee · · Score: 5, Informative

      Time out of Joint

  17. Japanese manuals? by Crouty · · Score: 3, Funny
    Wow, I can't wait to unleash my grammar nazi skills on the automated translations of japanese manuals of electronic devices!

    Keep them coming, Amazon!

    --
    On se Internetz nobody noes your German.
  18. Highly suspectful site. Do NOT give any detail by Ilgaz · · Score: 4, Interesting

    Guys, let me tell.

    It's registered through Godaddy.com, one of the companies spammers/phishers love to use.

    It has hotmail contact addresses in whois. Impossible for a company like Amazon

    No clue of such thing on official Amazon press room
    http://phx.corporate-ir.net/phoenix.zhtml?c=176060 &p=irol-news

    So if it looks like,acts like,runs like (amazon gigantic server farm slashdotted?) a regular phishing site, it is. Even if it made to Slashdot. I'd say pull the story until Amazon comes up with an explanation. Before any harm done.

    It could be even a more "elite" hack including subdomain/DNS hacking. I am a spamcop mail customer and I see amazing things everyday.

    In risk of looking very funny if it is not anything above, happily posting it.

    1. Re:Highly suspectful site. Do NOT give any detail by Dynamoo · · Score: 3, Informative
      It's hosted on 207.171.166.182 which is part of Amazon's netblock of 207.171.160.0 - 207.171.191.255.

      Anyhow, I tried it. It recognised me and new my address. It's Amazon alright.

      --
      Never email donotemail@WeAreSpammers.com
  19. Agent Smith, is that you? by OldManAndTheC++ · · Score: 5, Funny
    I hope you all can see where this is going:

    • 2005: Amazon introduces Mechanical Turk program. Thousands of underpaid geeks sign up and start clicking mindlessly.
    • 2010: Home catheterization and feeding tube kit eliminates need to leave workstation. Productivity skyrockets.
    • 2015: Direct neural interface improves response times one million-fold.
    • 2020: The Matrix

    Don't say I didn't warn you.

    --
    Soylent Green is peoplicious!
  20. automating this by mboedick · · Score: 4, Interesting

    For the image ones, couldn't you create 5 bots each with a different account and each one picks a different image and one picks None of these? One of them would be approved and you'd get paid, right?

    Also if they are having humans approve your image selection before you get paid, isn't that as much effort as you making your original choice?

  21. Slahdot should use this.. by objekt · · Score: 3, Funny

    ..they could ask us questions like "Is this a dupe?"

    --
    -- Boycott Shell
  22. A new kid-powered architecture! by Resseguie · · Score: 3, Funny
    Would that qualify as a beowolf cluster of children?

    Or maybe this would require a new "Grid Kid" architecture with an advanced resource broker to farm out the questions based on difficulty and school grade level.

  23. Message from Amazon Mechanical Turk Team by Amazon+Mturk+Team · · Score: 5, Informative

    We're grateful to have been Slashdotted! Our beta site, mturk.amazon.com, is experiencing the Slashdot effect. You can still read about Amazon Mechanical Turk and its web services APIs at www.amazon.com/webservices. Also, send a blank email to aws@amazon.com if you want us to email you when page load times recover. The Amazon Mechanical Turk Team