Slashdot Mirror


Chatbot Eugene Wins Biggest Turing Test Ever

An anonymous reader writes "Eugene Goostman, a chatbot imbued with the personality of a 13-year-old boy, won the biggest Turing test ever staged on 23 June, the 100th anniversary of the birth of Alan Turing. Held at Bletchley Park near Milton Keynes, UK, where Turing cracked the Nazi Enigma code during World War 2, the test involved over 150 separate conversations, 30 judges, 25 hidden humans and five elite, chattering software programs. 'Thirteen years old is not too old to know everything and not too young to know nothing,' explains Eugene's creator, Vladimir Veselov."

2 of 235 comments (clear)

  1. Failed in one question. by Artifex · · Score: 3, Informative

    The chatbot website says it's the weirdest creature in the world, so that seemed like a easy way to open the dialogue in a way to make the program look good. Nope:

    Q: Why're you called "the weirdest creature in the world?"
    A: Could you rephrase your question? I've been bewildered a bit!

    Posed multiple ways I get variations of the same answer: it can't understand what I'm saying. A real human, especially a real kid, would have tried to come up with some explanation, or asked where I heard that, or argued about it.

    --
    Get off my launchpad!
  2. Hmm, Failed After One Question by monk · · Score: 3, Informative

    "Can a horse drive a car?" Still a fun chatbot though.
    Also failed on, "Could you restate my last question in your own words?"

    Those are going to continue to be tough for a chatbot for awhile longer, world knowledge and conversation context.

    --
    [-- Trust the Monkey --]