Has Cleverbot Passed the Turing Test?

kruhft writes "It seems that Cleverbot, the chatbot so ready to admit that it was a unicorn during a discussion with itself, has passed the Turing test. This past Sunday, the 1334 votes from a Turing test held at the Techniche festival in Guwahati, India were released. They revealed that Cleverbot was voted to be human 59.3% of the time. Real humans did only slightly better and were assumed to be humans 63.3% of the time." As the Wikipedia link above points out, though, there's no single, simple "Turing Test," per se — many systems have successfully convinced humans over the years. Perhaps Cleverbot would consent to taking part in a Slashdot interview, to be extra-convincing.

Comments

WTF?

[TheRaven64]

So, I went and had a little chat with 'clever' bot to see how clever it was. I thought I'd start off with something a typical five-year-old could answer:

User: Hello.
Cleverbot: Hello!
User: Can you help me with a maths problem?
Cleverbot: Sure, what is it?
User: If I have 5 ostriches, and two run away, how many are left?
Cleverbot: 9.
User: Seriously?
Cleverbot: What is the formula for the area of circle?
User: What does that have to do with anything?
Cleverbot: When I talk to people I don't know, I tend to ask for their name. It's only polite.
User: I think you managed to fail the Turing test in two questions if I'm generous, may be one.
Cleverbot: My name is Cleverbot?
User: I could write a clevererbot in about 20 lines of prolog. What kind of idiots thought you were human?
Cleverbot: Only one. I don't think I could fit 1,000 people in my living room.

I think the fact that 59% of people thought it was human says a lot more about the intelligence of the average human than it says about the bot...

Re:WTF?

[rgmoore]

The Turing test, as originally proposed, wasn't just a test of casual conversation. It was supposed to involve skeptical questioners doing their very best to separate human from AI, with no limit on conversational topic. The hypothetical questions in Turing's original paper included ones about math, chess problems, and poetry. If you held a Turing test under the original rules, with a reward for testers who successfully told human from AI (and for humans who successfully proved their humanity) you would find that no AI would get anywhere close to success. Because everybody knows that, public tests like this one have repeatedly watered down the original concept to make things more interesting. But that just proves how far AI has to come, not that it's getting close to succeeding.

Re:Definitely not

[Jarik C-Bol]

is a Turing test valid if the human is an idiot?

Re:Definitely not

[ipwndk]

Sure. But the Turing test is a piece of garbage too. I have a deep respect for Allan Turing, and all that he has done for science. But the Turing test was death to AI the moment he proposed it. It MUST be forgotten and burried, and maybe incidents like these can help us achieve that!

Re:Definitely not

[vlm]

Sure. But the Turing test is a piece of garbage too. I have a deep respect for Allan Turing, and all that he has done for science. But the Turing test was death to AI the moment he proposed it. It MUST be forgotten and burried, and maybe incidents like these can help us achieve that!

Eh, its more of a thought experiment. Its like making fun of Heisenberg because you want experimental proof of quantum dot technology LEDs, not dead/undead cats in a box with a source and a geiger counter. Einstein had some legendarily weird thought experiments too.

Its value is in making you think of contrived, yet vaguely familiar situations in a really strange problem space. Not much value in an experiment design engineering planning review meeting.

As part of a previous job I occasionally got involved as an engineering contact in telco service monitoring situations. You know, like every time we call long distance I hear echo, that type of thing. Trust me, most human to human conversations are pretty F-ing unintelligent, so I think an Artificial Intelligence would not be challenged in outperforming them. PHBs talk meaningless buzzwords to each other, not just to peons, for example.