Slashdot Mirror


Amazon Patents Humans Assisting Computers

theodp writes "Amazon's latest patent, the Hybrid Machine/Human Computing Arrangement, reads like scary sci-fi, with claims covering the use of humans 'of college educated, at most high school educated, at most elementary school educated, and not formally educated' to perform subtasks dispatched by a computer. From the patent: 'For examples, the task on hand requires French speaking humans, and Task Server has requested that each subtask be performed by at least 10 humans with a past accuracy record of at least 90%.' Yikes."

43 of 236 comments (clear)

  1. I for one... by oskay · · Score: 4, Funny

    predict that the first post will have something to do with our new robotic overlords....

    1. Re:I for one... by njfuzzy · · Score: 3, Insightful

      How can you make a post predicting the first post?

      --
      My Photography - http://ian-x.com
      The Deathlings (comic) - http://thedeathlings.com
    2. Re:I for one... by mpaque · · Score: 2, Funny

      Quiet, coppertop. Get back to work.

      Now, I need to strap 110 college educated French speakers in parallel, tied to the output of wikiedia.fr...

    3. Re:I for one... by Marxist+Hacker+42 · · Score: 4, Informative

      Welcome to Manna. Come to my journal if you want to invest in The Oregon Project, just in case....

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
    4. Re:I for one... by QuantumG · · Score: 2, Interesting
      Huge breakthrough my ass. All you gotta do is give the system a way to measure the performance of workers and datamine for protocol changes that result in better performance. There's been dozens of systems made by college students that do exactly this.

      I conclude that the whole Manna story is rather implausible and a gratuitous scare attempt. No, it's a story for purposes of entertainment and philosophical reflection.. but yes, you do have to get more than half way through it before you can appeciate the message.
      --
      How we know is more important than what we know.
  2. In other news by neoform · · Score: 5, Insightful

    Amazon patents "using a computer".

    --
    MABASPLOOM!
    1. Re:In other news by Marxist+Hacker+42 · · Score: 3, Insightful

      It's just Manna. Or at least, the bare bones beginings of an automated management program that could take the retail and manufacturing sectors by storm...soon every teenager will be wearing a headset with a button to hit to acknowledge the order or completion of a task.

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
    2. Re:In other news by Harmonious+Botch · · Score: 2, Insightful

      Except for the computer, it sounds like most of the jobs that I had during college. Thinking back, a lot of the bosses I had could have been replaced with comuters and everyone would have been happier.

    3. Re:In other news by LilGuy · · Score: 2, Insightful

      But just imagine all the extra traffic...

      --

      You're nothing; like me.
    4. Re:In other news by grammar+fascist · · Score: 2, Informative

      There's a very good chance this is a semi-supervised machine learning thing.

      (Un-disclaimer: I do research in machine learning.)

      So you've got this algorithm that, if you give it a bunch of labeled data, it can predict labels for unseen data. (Maybe it labels current best-sellers as likely or unlikely to interest a customer based on his buying habits.) Great. Well, somebody's got to label that data. Human time is expensive. On the other hand, you need as much data as possible: the more the better.

      Semi-supervised learning algorithms decide which bits of all their unlabeled data to present to a human for labeling based on how much knowledge it can expect to gain from it. You can get higher accuracy with less data that way.

      Here's another problem, though: you don't have that many reliable humans to query. So you make it a game, and pay people based on their accuracy for known things, or on their agreement with humans you've already determined are reliable. Win for the humans: if they're accurate, they get paid. Win for the machine learning algorithm: it gets mounds more accurate, high-information, labeled data. Win for Amazon: they make more sales.

      There's nothing scary about this, exactly. It's yet another method of eliciting information from humans that is otherwise very hard or expensive to obtain.

      --
      I got my Linux laptop at System76.
  3. Insert disk... by muffel · · Score: 4, Insightful
    ... in drive A:

    I've done that since the 80's.

    --

    bla
  4. my computer... by notgm · · Score: 2, Funny

    my computer told me not to read TFA. did i miss anything?

  5. This is Amazon's Mechanical Turk system by Diomidis+Spinellis · · Score: 4, Informative

    Amazon has already deployed such a system under the name of Mechanical Turk. The idea is that humans assist computers, providing what is cutely named artificial artifical intelligence. You can read more about the concept in an article that ACM Queue run on May 2006.
    --
    Code Quality: The Open Source Perspective

    1. Re:This is Amazon's Mechanical Turk system by mls · · Score: 5, Interesting

      Mod parent up

      On the "Data Improvement" front, I implemented something like this maybe 5 or 6 years ago. The company had a workforce of "lower" cost data entry staff, and when volumes of data came in over the web, we validated what we could programmitically, then routed questional records to human staff for cleanup and use in building a dictionary of sorts that made our automated process better. It was more cost effective to go this hybrid computing route than to throw lots of "expensive" programming at it.

      --
      -mls
    2. Re:This is Amazon's Mechanical Turk system by Seumas · · Score: 2

      Also, as the example clearly shows - only college educated persons can speak foreign languages! Everyone else is retarded!

      Let's do away with the academic level and focus on proven expertise and skill. Otherwise about 60% of our top CEOs and inventors would be off digging ditches somewhere.

    3. Re:This is Amazon's Mechanical Turk system by smallpaul · · Score: 2, Interesting

      The idea is that humans assist computers, providing what is cutely named artificial artifical intelligence.

      You can spin this as "humans assisting computers" but you can just as easily think of it as humans doing work in a workflow dictated by computers. This idea is very, very, common. I mean a call-center is just a place where humans "help" computers to answer questions from other humans. And an IT support system is a place where humans "help" computers to solve the IT problems of other humans. Amazon has a workflow system paired with an odd job market. It's innovative and cool but its not "artificial artificial intelligence."

  6. A machine asked me to post this... by charliesmagic · · Score: 2, Funny

    ...but I couldn't help the machine because that
    would be against the patent.

  7. In other news.. by pak9rabid · · Score: 5, Funny

    Automaker Ford was ganted the following patent: A hybrid automobile/human driving arrangement which advantageously involves humans to assist an automobile to solve particular tasks, such as transporting a human, or other non-human items such as freight...

  8. Re:So What? by Marxist+Hacker+42 · · Score: 4, Informative

    Just read Marshall Brain's take on the future if a system like Mechanical Turk became the standard for Management in US corporations.

    --
    SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
  9. is this even patentable by wizardforce · · Score: 2, Interesting

    what is unique about this? what makes this qualify as non-obvious? patents generally need to be issued to people that come up with ideas the person of average skill in the relevant field could not reasonably be expected to use. in short, why is the idea of using people to solve problems that computers either can't or are very slow/ineeficient at anything new? take google for example, their new image categorization game goes along these lines- using people's brain power to tag images- so the question is: is this patent vague enough to encompass google's game or similar ideas?

    --
    Sigs are too short to say anything truly profound so read the above post instead.
    1. Re:is this even patentable by mindwhip · · Score: 3, Insightful

      We have a very obvious prior art right here staring us all in the face... the moderation system on /.

      There is no way a computer (at this time) could actually rate posts as off-topic, funny etc so people (of various educational backgrounds) are assigned by the computer to process the information and return the result to the computer. This is then verified by others doing the same thing, as well as meta moderated and all the other bits that go into who gets selected to get mod points in the future.

      Gratz Amazon on patenting the /. moderation system...

      --
      [The Universe] has gone offline.
  10. obligatory by icthus13 · · Score: 2, Insightful

    In Soviet Russia, Computer use YOU!

  11. Scary Sci-Fi? Modern life? by daigu · · Score: 2, Insightful

    A hybrid [boss/worker working] arrangement which advantageously involves [worker] humans to assist a [boss] to solve particular tasks, allowing the [boss] to solve the tasks more efficiently. In one embodiment, a [boss/worker] system decomposes a task, such as, for example, [making a car], into subtasks for human performance, and requests the performances. The [C-level boss/worker] system programmatically conveys the request to a [lower level boss] of the hybrid [boss/worker] arrangement, which in turn dispatches the subtasks to [workers] operated by [line level bosses]. The [workers] perform the subtasks and provide the results back to the [line level boss], which receives the responses, and generates a [report] for the task based at least in part on the results of the [worker] performances [and the rest based on whatever crap H.R. wants to hear.].

    Your scary sci-fi scenario sounds remarkably like modern working life - refined by years of Taylorism.

  12. Could an invention like this... by plams · · Score: 4, Funny

    ...by any chance be a viable replacement for the management where I work?

    1. Re:Could an invention like this... by LilGuy · · Score: 2, Informative

      That the scary part.

      Read manna ( http://www.marshallbrain.com/manna1.htm ) and then see if you'd really want that.

      --

      You're nothing; like me.
  13. "Human Computation" video by gaspar+ilom · · Score: 2, Informative

    This video on Human Computation describes using humans as part of a distributed computing grid for interpretting captchas, and categorizing images.

    ...And they'll actually particpate, en masse -- without pay -- thinking they're just playing an online *game.*

  14. RSS said "ASS" by emptybody · · Score: 4, Funny

    RSS feed for this story stated

    "Amazon Patents Humans Ass"

    that had me rolling on the floor!

    --
    comment directly in my journal
    1. Re:RSS said "ASS" by Anonymous Coward · · Score: 5, Funny

      The irony is that if they had patented it, you'd be the one rolling on the floor, but they'd be the ones laughing your ass off.

  15. AI? by Jeremiah+Cornelius · · Score: 4, Funny

    They call it this.

    But I think they have this. ;-)

    --
    "Flyin' in just a sweet place,
    Never been known to fail..."
    1. Re:AI? by Marxist+Hacker+42 · · Score: 4, Insightful

      And I think they have invented This, which is even more scary.

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
  16. They'll be back! by Anonymous Coward · · Score: 4, Funny

    It's all fun and games now but it won't be funny when the machine decides your next task is to "Give me your clothes" in an Austrian accent.

  17. This is not a troll... by CptPicard · · Score: 5, Insightful

    ... although the thought is potentially offensive to some. Wouldn't working as a wetware computer-augmenting classifier be the perfect job opportunity for a mentally handicapped person? I mean, someone with a regular IQ would find it boring over time to tell apart cats and dogs in pictures, but it sounds like a challenge for someone who is not in possession of such faculties. And this is exactly the sort of task that is troublesome for AI, while it being trivial for even "challenged" people! Cross-check the responses, reward those who vote with the consensus, and you've got something that actually might even work as a teaching tool... and how many Down's syndrome people could say they hold a "computer job"?

    Don't flame me, I'm physically disabled myself and therefore am quite familiar with the troubles disabled people of all kinds face in particular when it comes to finding meaningful employment...

    --
    I want to play Free Market with a drowning Libertarian.
    1. Re:This is not a troll... by Anonymous Coward · · Score: 4, Interesting
      ... although the thought is potentially offensive to some.

      There's a lot of people out there who want to be offended and are looking for ways to be offended. Why? It's a form of bullying, IMHO. They want a reason to order you to change behavior. And when you ask them why they are offended, they give some half-ass answer. It's just a power trip.

      Sorry about your handicap and I'm sorry you had to mention it so that you wouldn't be modded "Troll" or "Flamebait".

    2. Re:This is not a troll... by StikyPad · · Score: 4, Funny

      This would be perfect if it could be done from home.

      And my 5-year-old would be happy because he'd get to play "games" as much as he wanted.

      "Is it bedtime yet?"

      "I SAID CLICK ON THE DOGS!!!"

  18. Already done by SeaFox · · Score: 3, Informative

    They already do this at Target.

    The employees all wear walkie-talkies and I've heard them come on with an obviously computer synthesized voice telling them a "guest" needed assistance in _____ dept. Or more team members were needed to cashier, ect requesting to know who would address the issue. And they would answer back to it just like they were acknowledging their boss's orders.

    1. Re:Already done by Manchot · · Score: 3, Informative

      I think you're looking too much into this. I worked at Target during high school, and what you heard is far less sinister than you believe it to be. The computer telling the "team members" that a "guest" needs assistance is triggered by a customer picking up one of the service phones peppered throughout the store. The reason that the employees try to respond so quickly is that the phones have something written on them to the effect of "A team member will be with you within the next x minutes," and people get angry if you're not there fast enough.

      As for the "Additional cashiers to the front lane," that is actually triggered by the cashiers themselves via a button on their registers. Typically, the manager up front would just call for backup directly if there was a sudden wave of customers, but on occasion, the manager would be busy elsewhere. In that case, one of the cashiers could just press the button without stopping (i.e., slowing down) to do it manually. More practically, the cashiers aren't given walkie-talkies because the collective noise from ten nearby walkies would be disruptive to the customers. Also, the phones at each lane were tied into the walkie system, but it didn't work very well, and it was just easier to push the button.

      Probably the worst computer-control issue at Target was the "speed score" system. Basically, after every transaction, they'd assign you a score (either G for green, or R for red), indicating whether you were fast enough on that transaction. Your overall scores were then tabulated on a monthly basis. When I first started, you wouldn't know your score on an individual customer, and you could only know your monthly average. Being a 17-year-old, I tried to get the highest score possible, and I did pretty well (something like best average in the store for six months). However, about halfway through my tenure there, they switched to a system that showed you your score after each customer, which soon led me to see how flawed it actually was. You see, I quickly figured out that if not for the customers themselves, I would have gotten a G on every transaction. The problem was that the system basically worked by assigning every item an allowed scan time (so a thing of dog food might be 30 seconds, while a pencil might be 5 seconds). From what I could tell, it also allowed a certain amount of time for payment. What I noticed is that as long as there were a few items (about four or more), I would always get a G, no matter what. When it came down to just a couple of items, I would often get a R. Why? As it turned out, the customer would squander my allowed time by taking a long time to figure out the machine that Target uses for credit and debit cards. In the end, the only effect that speed scores had on me was to get me angry at the people I was supposed to be serving. Yes, you heard that right: I would get a little mad at people for not being efficient enough.

  19. Re:In other news... by Anonymous Coward · · Score: 2, Funny

    The Computer is your friend.

  20. Re:Eh? by twitter · · Score: 4, Insightful

    Interactive proof system with a human prover == not terribly scary to me.

    Yeah, but a patent on it is. Even more scary is a patent on a program that really just prompts the user for input.

    --

    Friends don't help friends install M$ junk.

  21. Prior Art by metalmonkey · · Score: 2, Insightful

    On the fromt page today:
    "New Algorithms Improve Image Search" http://slashdot.org/articles/07/04/03/1952205.shtm l
    The algorithm is based on users providing input upon computer request to classify images.

  22. Why is this scary? by Gordo_1 · · Score: 3, Interesting

    You can see the type of work available for anyone to process on Amazon's Mechanical Turk right here: http://www.mturk.com/mturk/findhits?match=false

    It's things like helping categorize images or finding specific things in databases of images or inspecting contracts -- you know the kind of stuff that's really easy for humans but is really difficult for computers.

    I've tried a few in the past, however, most of the available "HITs" pay only a few pennies a piece, so I'm not about to go quitting my day job to sit at home fulfilling these requests quite yet.

  23. But hvae you doen it correctly... by WallaceAndGromit · · Score: 2, Funny

    at least 90% fo the time? I know my succses rate is only lkie 60%

    --
    Name: Mr. Anon E Mouse; SSN: 555-55-5555
  24. Re:Prior Art by QuantumG · · Score: 5, Insightful

    Oh boy. I tell ya. The concept of patent clearly isn't part of the education system.

    Imagine I invent a new kind of lawn mower. I file a patent to protect my invention for 20 years so I can commercialize it without having to worry about the existing lawn mower companies snapping up my invention and beating me to market. What's the title on the patent going to be? That's right:

    "A mechanism for the automated trimming of grass."

    In the patent I will describe how the mechanism works. What prior art there has been in automatted trimming of grass, why my invention is novel and how hard/easy it is to manufacture.

    So will get posted to Slashdot about it?

    "Man Patents Lawnmower."

    Then everyone will have a bit of a moan about how the patent office doesn't know what they're doing anymore and maybe they'll quote a few lines from the patent where I'm outlining what a lawnmower is with the intention of claiming that this is what I am patenting.

    --
    How we know is more important than what we know.
  25. I had just assumed... by Belial6 · · Score: 2, Funny

    I had just assumed that the OCR read the numbers wrong.