Slashdot Mirror
Creating a Better Chatbot Through Crowdsourcing
An anonymous reader writes "MIT Technology Review reports on a chatbot built at the University of Rochester that is capable of high quality, human-level conversation — thanks to software called Chorus that turns to Amazon's crowdsourcing service Mechanical Turk to generate and evaluate replies to a human's statements and questions. No one person is ever acting as the bot, instead multiple workers suggest responses that are then voted on to select the best. The crowd workers contributing change frequently, but Chorus also has them keep a running list of important contextual information to give the bot a kind of memory of a conversation's history. The researchers say Chorus-style chat bots could out-perform fully automated assistants such as Siri, while being considerably cheaper than a true concierge service."
Humans better at chatting than computers, and by replacing computers with humans, you can almost have a natural conversation.
Good try, but even if this passes the Turing test, it is not AI in any way. Responses are by humans and there is no intelligence in it. So it will be the collective human engine behind it that will pass the test. Not really any big achievement.
metageek
And if this ever takes off you know that it will become a game of trying to submit/vote the most inappropriate responses to the questions. A never ending battle between the censors forbidding words and phrases and the people finding new ones.
User: Where's the nearest pizza place?
Chorus: Penis.
User: Excuse me?
Chorus: YOLO
Five or six years ago one could find decent work on Mechanical Turk. I used to do podcast transcriptions for around US$10/hour, and some of the podcasts were on topics of interest to me, so it was enjoyable. The ability to do such work remotely made for some good times sitting on beaches in various backpacker hideaways, where the money from a couple of hours of work a day was more than enough to pay one's travel costs. Eventually I got better, more dependable work and stopped logging into MTurk. When I visited it again a couple of years later, I noticed that the money now paid for such tasks is miniscule. It really became a race to the bottom. Even if the money offered was enough for people in the Third World, surely people with the English language skills required could find something better. It's unclear to be just what demographic MTurk is depending on now.