Slashdot Mirror


Has Cleverbot Passed the Turing Test?

kruhft writes "It seems that Cleverbot, the chatbot so ready to admit that it was a unicorn during a discussion with itself, has passed the Turing test. This past Sunday, the 1334 votes from a Turing test held at the Techniche festival in Guwahati, India were released. They revealed that Cleverbot was voted to be human 59.3% of the time. Real humans did only slightly better and were assumed to be humans 63.3% of the time." As the Wikipedia link above points out, though, there's no single, simple "Turing Test," per se — many systems have successfully convinced humans over the years. Perhaps Cleverbot would consent to taking part in a Slashdot interview, to be extra-convincing.

10 of 427 comments (clear)

  1. Re:Definitely not by Anonymous Coward · · Score: 5, Funny

    Boy, that sure puts those "63.3%" of humans in their place. I'd feel bad to be them, but I'm not certain if they have emotions or not.

  2. Hold on by Dyinobal · · Score: 5, Funny

    Hold on I've not been able to go talk to Cleverbot for more than two exchanges before it goes off topic with some completely rando...ah damn no wonder people thought it was a human.

  3. Re:The follow-up question by Dachannien · · Score: 5, Funny

    How many slashdot users can pass the same Turing Test?

    How do you feel about how many slashdot users can pass the same Turing Test?

  4. WTF? by TheRaven64 · · Score: 5, Insightful
    So, I went and had a little chat with 'clever' bot to see how clever it was. I thought I'd start off with something a typical five-year-old could answer:

    User: Hello.
    Cleverbot: Hello!
    User: Can you help me with a maths problem?
    Cleverbot: Sure, what is it?
    User: If I have 5 ostriches, and two run away, how many are left?
    Cleverbot: 9.
    User: Seriously?
    Cleverbot: What is the formula for the area of circle?
    User: What does that have to do with anything?
    Cleverbot: When I talk to people I don't know, I tend to ask for their name. It's only polite.
    User: I think you managed to fail the Turing test in two questions if I'm generous, may be one.
    Cleverbot: My name is Cleverbot?
    User: I could write a clevererbot in about 20 lines of prolog. What kind of idiots thought you were human?
    Cleverbot: Only one. I don't think I could fit 1,000 people in my living room.

    I think the fact that 59% of people thought it was human says a lot more about the intelligence of the average human than it says about the bot...

    --
    I am TheRaven on Soylent News
    1. Re:WTF? by Exitar · · Score: 5, Interesting

      I've tried to repeat the same question of yours:

      If I have 5 ostriches, and two run away, how many are left?
      One.
      If I have 5 ostriches, and two run away, how many are left?
      Ohhhhhh! I'm going Digital, Completly Digital, Now I'm invincible, Let's all get Digital!
      If I have 5 ostriches, and two run away, how many are left?
      Four.
      If I have 5 ostriches, and two run away, how many are left?
      Seven.
      If I have 5 ostriches, and two run away, how many are left?
      2, unless you destroy 1.
      If I have 5 ostriches, and two run away, how many are left?
      What's a happle?
      If I have 5 ostriches, and two run away, how many are left?
      Dos? Zwei? Ni? 2?
      If I have 5 ostriches, and two run away, how many are left?
      Eight.
      If I have 5 ostriches, and two run away, how many are left?
      Whole apples?

    2. Re:WTF? by digitig · · Score: 5, Interesting

      I think the fact that 59% of people thought it was human says a lot more about the intelligence of the average human than it says about the bot...

      From the RA: "Cleverbot is available for conversation online, but don’t be fooled. Although Cleverbot managed to score well on the Turing test, the model that did that is different from the one you’ll find online."

      --
      Quidnam Latine loqui modo coepi?
  5. Re:Definitely not by ipwndk · · Score: 5, Insightful

    Sure. But the Turing test is a piece of garbage too. I have a deep respect for Allan Turing, and all that he has done for science. But the Turing test was death to AI the moment he proposed it. It MUST be forgotten and burried, and maybe incidents like these can help us achieve that!

    --
    01 REDEFINE REALITY.
  6. Cleverbot is a bad example of a chatterbot. by Z8 · · Score: 5, Interesting

    According to the wiki page, it just selects canned responses from its database. I think this approach just gets you garbage, or at the very least is a dead-end in trying to beat the Turing test.

    The best Turing Test is probably the Loebner Prize and at least the contestants seem much better than Cleverbot. There's an example conversation from Suzette (the latest winner) here. (But it's hard to tell if that is typical or simply a lucky exchange for the computer.) But anyway, as is clear from this interesting story written by a contestant about the Loebner prize, bots are no where near winning that version of the Turing test, as long as the humans are paying attention.

  7. This says it all... by Excelcia · · Score: 5, Informative

    Conversation I just had...

    Hello. My name is Kurt.
    What kinda name is that.
    German.
    Cool! Me too!
    You're German?
    Czech.
    So you're not German?
    I am not.
    Then why did you say "me too"?
    I didn't.
    Did the lobotomy hurt?
    Where did th ebarn come from?

    1. Re:This says it all... by CProgrammer98 · · Score: 5, Funny

      "not too impressed"

      On the other hand....

      me: Do you know Java?
      bot: I Know JavaScript
      me: But that isn't java.
      bot: What did you ask.
      me: asked if you knew Java
      bot: I know many jokes.
      me: Java is not a joke.
      bot: Yes, it is.

      --
      And the people shall be oppressed, every one by another, and every one by his neighbour Isaiah 3:5