Slashdot Mirror


Mitsuku Chatbot Wins Loebner Prize 2013

mikejuk writes "The final round of the 23rd annual Loebner Prize competition took place in Londonderry, Northern Ireland with four chatbots hoping to convince four judges that they were humans. Mitsuku, a chatbot that is kept busy chatting to people around the world, was awarded this year's bronze medal. Mitsuku's botmaster, Steve Worswick, used to run a music website. Once he added a chatbot he discovered more people visited to chat than for music so he concentrated all his efforts on the bot but he still regards it as a hobby. Mitsuku uses AIML (Artificial Intelligence Markup Language) and is a pandorabot, based on the free open-source-based community webservice the enables anyone who wants to, to develop and publish chatbots on the web."

17 of 78 comments (clear)

  1. [Oblig XKCD] I prefer this form of turing test. by fenix849 · · Score: 3, Funny
    1. Re:[Oblig XKCD] I prefer this form of turing test. by dingen · · Score: 4, Informative

      Silver medal is actually for beating the Turing test (which of course has never happened and won't happen anytime soon). Gold medal is awarded for passing the Turing test based on more than just text input (talking with the bot, showing the bot stuff etc.).

      --
      Pretty good is actually pretty bad.
  2. Congratulations by telchine · · Score: 2

    Hello Congratulations on your prize, jealousy? no!

  3. Add a voice synthesizer by Anonymous Coward · · Score: 5, Interesting

    ... and get a device that could be programmed to deal with telemarketers.

    It might be amusing to see just how long one could string telemarketers along before they discover they are talking to a machine.

    Along the lines of the TeleCrapper 2000, but this one might keep one on the line for quite some time with some amusing results.

    A coy female voice.

    Telemarketers.

    I can't stop 'em, but I might get some fun out of 'em.

    1. Re:Add a voice synthesizer by SpzToid · · Score: 3, Interesting
      --
      You can't be ahead of the curve, if you're stuck in a loop.
  4. I think I'd fail as a chat bot... by Psychotria · · Score: 2

    I have no idea what the judges were asking and I'm pretty sure they'd label me as a dismal bot

  5. First question I asked it muffed by John+Jorsett · · Score: 3, Interesting

    I asked it, "What color is your dog?" and it responded, "That would depend, as a dog can be many colours." Looks like the Turing Test passage is a ways off.

    1. Re:First question I asked it muffed by TheRealMindChild · · Score: 4, Funny

      I don't see how this is a bad response. It sounds like talking to a lawyer

      --

      "When life gives you lemons, don't make lemonade. Make life take the lemons back!" -- Cave Johnson
  6. Re:Just on a point of protocol by Anonymous Coward · · Score: 2, Interesting

    Calling it 'Derry' instead of 'Londonderry' would irritate just as many. "London/Derry" to keep the RMS acolytes happy?

  7. political chatbots by Gravis+Zero · · Score: 2

    judge> These are terrible chatbots! The things they say dont make any damn sense!
    guy> If you think this is bad, you should watch them talk to each other on C-SPAN.

    --
    Anons need not reply. Questions end with a question mark.
  8. Re:chatbots by Anonymous Coward · · Score: 5, Funny

    It's like talking to a complete asshole who doesn't want to talk to you, and also happens to be retarded.

    Hmmm ... I usually call those a 'family reunion'.

  9. Ridiculously Easy to Trip Up by resistant · · Score: 3, Insightful

    I checked out the website for the Mitsuku chatbot and took a rather pessimistic poke at it.

    Chatbot: [boilerplate noises omitted] ... "What is your name?"
    Myself: "I'm the fiddler."
    Chatbot: "Who made you the fiddler?" [A reasonable, albeit somewhat peculiar, response.]
    Myself: "I took too long once to feed my peckish cat."
    Chatbot: "Where did you take it?" [Instant FAIL.]
    Myself: "I took it to new heights of frustrated noises." (Bonus straight-man response.)
    Chatbot: "Where did you take it?" [Parrot-like repetition raises the chat to new heights of FAIL.]

    As always, two lines were enough to trip it up. The third line was a bonus that only amplified its shortcomings. I'll admit to cheating a little by using a couple of words ("peckish", "frustrated") that might have required contextual glossing by less educated individuals, but those words were still relatively common. All known chatbots seem to rely on fairly simple-minded word triggers, and even a minor requirement for context sensitivity is enough to make them fall flat on their nonexistent faces. Anyone possessing even remote familiarity with efforts at artificial intelligence knows this, of course, but hope springs eternal.

    (Notes for the lazy: The word "peckish" is a common slang term for "hungry", and http://www.mitsuku.com/ is the website for the chatbot in question.)

    --
    A truly excellent pizza parlor is a delight unto the heavens. Treasure the sauce and the toppings!
    1. Re:Ridiculously Easy to Trip Up by Anonymous Coward · · Score: 3, Funny

      You're trying to be too tricky. Just go with it a bit... it's not foolproof or it would have won the loebner gold prize.

      However it is really fun to talk to.

      ( Hint: type: reboot in your chat )

      Damn funny stuff in there

    2. Re:Ridiculously Easy to Trip Up by Half-pint+HAL · · Score: 2

      I checked out the website for the Mitsuku chatbot and took a rather pessimistic poke at it.

      Chatbot: [boilerplate noises omitted] ... "What is your name?" Myself: "I'm the fiddler."

      "the fiddler" is a job description, not a name. "The Fiddler" is a musical foil for Adam West's Batman. Unnatural response.

      Chatbot: "Who made you the fiddler?" [A reasonable, albeit somewhat peculiar, response.]

      Myself: "I took too long once to feed my peckish cat."

      A: non-sequitur with no explicit change of subject. Unnatural response strategy.

      B: misuse of the word "peckish". Peckish is a subjective state, and while you may know the cat is hungry, you cannot know the cat's subjective experience of that state. It's also used almost exclusively in a predicative position, ie after a verb such as "to be" or (most often) to feel. Highly defective sentence on your part.

      Don't get me wrong, the chatbot is pretty poor, and one of the goals of NLP should be graceful degradation when there's erroneous or ambiuous input, but on the other hand... garbage in, garbage out...

      --
      Got them moderator blues I blieve I walk out the do', With these mod-points I been gettin', I 'most never post no mo'
  10. Re:questions by RussR42 · · Score: 2

    Here are the answers from the bots. I expected more...

  11. Re:questions by Earthquake+Retrofit · · Score: 3, Interesting

    As I may have mentioned in years past, I don't think judging AI or chatbots by how "human" they are is very useful.
    For instance, one of the questions mentioned in the article was "Why am I tired after a long sleep?" A bot that wasn't trying to pretend to be a human could say "I have no need for sleep, but maybe your cache expired." Or make a crack about 'puny humans.'
    I studied some of the software that prize winners have shared and found it very interesting, but the questions people actually ask are more valuable to me as a botmaker. If the humans looked beyond this artificial limit, while designing (and using) this technology, very interesting interactions can take place. I'd like to see Loebner redefine the parameters. perhaps categories.
    Best performance as a taxi driver.
    Best bot for making you think.
    Best for getting answers to homework questions.
    Bot most likely to take over the world.

    There's already plenty of humans.

    --
    Fifty years of Yippie! 1968-2018
  12. Re:questions by wiredlogic · · Score: 3, Insightful

    Except those are just a series of unrelated questions. Previous chatbot contests have required carrying on a believable conversation and responding naturally to non-interrogative statements. This just looks like Jeopardy with a little simulated opinion thrown in.

    --
    I am becoming gerund, destroyer of verbs.