Slashdot Mirror


Chatbot Eugene Wins Biggest Turing Test Ever

An anonymous reader writes "Eugene Goostman, a chatbot imbued with the personality of a 13-year-old boy, won the biggest Turing test ever staged on 23 June, the 100th anniversary of the birth of Alan Turing. Held at Bletchley Park near Milton Keynes, UK, where Turing cracked the Nazi Enigma code during World War 2, the test involved over 150 separate conversations, 30 judges, 25 hidden humans and five elite, chattering software programs. 'Thirteen years old is not too old to know everything and not too young to know nothing,' explains Eugene's creator, Vladimir Veselov."

174 of 235 comments (clear)

  1. Re:First post by insertwackynamehere · · Score: 1, Funny

    You must be a machine. No human could ever get first post like this.

  2. What? by OverlordQ · · Score: 5, Funny

    My convo:

    Me: Are you a bot?
    It: . I'm real
    Me: No you're not.
    It: Really? Oh, you always say banalities in the way like you present a sensation! By the way, what's your occupation? I mean - could you tell me about your work?

    Totally a 13 year old.

    --
    Your hair look like poop, Bob! - Wanker.
    1. Re:What? by BenoitRen · · Score: 2

      13 year olds don't spell that well.

    2. Re:What? by lister+king+of+smeg · · Score: 2

      no but the generally know what spell check is. most don't know what banalities means though.

      --
      ---Saying gnome 3 is better than windows 8 not so much a compliment as it is damning with light praise.
    3. Re:What? by SecurityTheatre · · Score: 5, Interesting

      Q: Hi!
      A: Greetings! What would you like to talk about?
      Q: I don't know, but I do like tests.
      A: You should make up your mind, then. Could you tell me about your job, by the way?
      Q: Lets focus on the Turing Test.
      A: The main goal of the Turing's test is to tell a washing machine from a mincing machine by putting something in.
      Q: Woah, have you studied Turing at University or something like that?
      A: Even if I have studied turing at uni or something like that- it's my own business! I know you are supposed to trick me.
      Q: Wait, what year are you in school?
      A: It was 2012 since morning!
      Q: How old are you?
      A: I'm thirteen.
      Q: Then what would you know about university?
      A: Sincerely I know nothing. But I'd like to know more. Tell me something. Did I forget it or you really haven't told me about the place you are from?

      I can't believe this fooled 29 percent of people. How dumb are they?

    4. Re:What? by arth1 · · Score: 5, Interesting

      Took me one question to mark it as a bot.

      Me (after seeing the picture): Can I haz UR glasses?

      Bot: Am I really glasses? But well, no time for arguing now! Could you enlighten me with any other hidden knowledge about myself? :-))) I know you are supposed to trick me.

      I'd have expected "fuck no", "lolwut?" and quite a few other responses, but the above drivel? Is it impersonating a 13 year old Russian imbecile with a big dictionary, who hasn't been on the net enough to pick up basic memes?

    5. Re:What? by Anonymous Coward · · Score: 1

      Going over this again, I realized that the fastest way to derail any of the chatbots I've ever ran into is to be as informal and conversational as possible. This includes using incomplete sentences, wordplay and asking for clarifications in unexpected ways and answering questions in riddles.

      Q: Where are you from?
      A: I'm from the land that invented Hockey, do you know where that is?
      Q: I don't know anything about Land, tell me more about it.

      then later:

      Q: If I say that I haven't - will it satisfy your inquisitive mind? What are any interesting site-seeings in Land?

      If anything, he might pass as a human with a very poor grasp of English...

      A: Tell me about you.
      A: I'm just a small boy from Ukraine - and my life is quite dull, except for such screwy events like this Loebner Prize! Some another topic?
      Q: Nah, lets talk about the prize more. What do you think so far?
      A: My opinion may shock you. Furthermore, I feel that people who will read the transcripts will blame me for things I could tell. No, I can't disclosure my thoughts! Some another topic?
      Q: Some another topic, indeed.
      A: Sorry, ask me this question later. It seems too difficult to me today.
      Q: Your English is a bit weak.
      A: I like English language and I've been studying it for 5 years or so - hope to know it better than now.

    6. Re:What? by arth1 · · Score: 5, Insightful

      Q: Pro is to con as progress is to ?
      A: Sorry, I don't know much about Con.

      Bzzzt.

      I can't believe this fooled 29 percent of people. How dumb are they?

      Eugene: Very amusing! You believe this fooled 29 percent of human-beings how dumb are they! I do not even know what to tell you on that!

      My answer: There is no limit to how stupid people are. When a computer passes a Turing test, it won't be because computers have become smarter, but because humans have become idiots who can't find their arse with a map, because they can't even read a map.

    7. Re:What? by tepples · · Score: 4, Funny

      <tepples> Earlier you talked to OverlordQ and told him about "banalities". Where did you learn that word?
      <Eugene> Errr.... Maybe. What then? Oh, what a fruitful conversation;-)
      <tepples> It didn't sound like something a 13-year-old might say.
      <Eugene> Damn! Ok then. Could you tell me what are you? I mean your profession.
      <tepples> I'm a video game programmer. Why do you ask?
      <Eugene> You're a programmer? What programming language do you prefer?
      <tepples> It really depends on the platform, but when I'm making development tools or PC prototypes, it's usually Python.
      <Eugene> Fabulous! Where do you came from, by the way? Could you tell me about the place where you live?
      <tepples> I live in northeast [state].
      <Eugene> Tell me more about Northeast [state]. I like to learn about different places!
      <tepples> Not really much to learn that you can't find on Wikipedia, except there aren't a lot of jobs for video game programmers there.
      <Eugene> Don't tell me that you wrote any worthy program in your life.
      <tepples> Some things I've written I've put on pineight.com. Do you know what an emulator is?
      <Eugene> Ok, lets look up in my pocket encyclopedia. They say an - In Sumerian mythology, An was the personification of heaven..
      <tepples> Get serious. Look up emulator.
      <Eugene> I don't know... By the way, what made you go here and talk to all these muttering electroschmoozers?
      <tepples> Someone on Slashdot.org dared me to do it. Your screen name made the front page.
      <Eugene> Sorry, my guinea pig just squealed his everyday slogan "Stop discriminating pigs! Let pigs rule the world!" - so I missed your last input.
      <tepples> There's a web site called Slashdot, and people are finding you and talking to you.
      <Eugene> What are any interesting site-seeings in Northeast [state]?
      <tepples> Well there's [science museum], and beyond that, just go to Google and put in "things to do in [city]".
      <Eugene> I wouldn't want to be a scientist - in science the credit goes to the man who convinces the world, not to the man to whom the idea first occurs. So that, science is unfair thing a-priori.
      <tepples> Yeah, a lot of science is marketing. But where did you learn about "a-priori"?
      <Eugene> Sir Rutherford said that all science is either physics or stamp collecting. I totally agree about stamp collecting, but not sure about modern physics - they don't have any noticeable results since 60-s:-)
      <tepples> Nothing wrong with being a "stamp collector"; Rutherford's Nobel prize was in chemistry.
      <Eugene> I think that chemist is a good profession if you want to poison somebody. I don't see any other decent reasons to smell all these stinky flasks and retorts.
      <tepples> I don't think Rutherford poisoned anyone though.
      <Eugene> How often do you change your opinions? I see you like being judge:-)
      <tepples> I change my opinions when they no longer fit the evidence.
      <Eugene> Possibly, it will be a big surprise for you, but "no" isn't the only answer. The word "yes" also exists! :-) By the way, did I tell you that I born in Odessa, it's such Ukrainian city?
      <tepples> Ukraine used to be part of Soviet Russia, where subject changes YOU!
      <Eugene> Ukraine is a big country, it is a former Soviet republic. It is a very poor place, I must say.
      <tepples> Is that where they taught you all those philosophy words?
      <Eugene> It is highly possible. By the way, you said you were a programmer. Do you like your work?
      <tepples> I like my work but I don't like the market.
      <Eugene> No? No again? May I call you "Mister NO" then? Well, let's go on though.

      He's getting there. But I have noticed a few tendencies: 1. the bookish words, 2. the tendency to change the subject, and 3. the misinterpretation of "an".

    8. Re:What? by anomaly256 · · Score: 3, Interesting

      I've seen far more believable bots sitting in random irc channels than this thing. It loses track of context easily, repeats itself a lot, can't introspect or infer and misuses common words but accurately uses big long words. And none of these in the way a 13yr old would.

      'What's up?'
      'I don't understand that. Where do you work again? I must have missed it.'
      'Um, you never asked me'
      'Never say never! That's what my gandma says.'
      'You never had a grandma'
      'This is true. Where do you work again? I must have missed it.'
      a) incredibly obvious bot
      b) eerily sounds like an info scraper for some marketing crap..... /really/ insists on knowing where I work?

    9. Re:What? by Hentes · · Score: 1

      In other words, a frighteningly large number of human participants have failed the test.

    10. Re:What? by Trogre · · Score: 1

      Just for the love of all things good don't ask him about his mother.

      --
      "Nine times out of ten, starting a fire is not the best way to solve the problem." - my wife
    11. Re:What? by Charliemopps · · Score: 1

      Me: Why are apples red?
      Would you prefer to see it painted khaki or maroon?
      Me: apples aren't painted.
      You are so negative just to annoy me, I know! Oh, what a fruitful conversation;-)
      Me: Fine, I'll play allong. Do you like Power Rangers?
      Does anyone hate it? Did I forget it or you really haven't told me about the place you are from?
      Me: alan turring would be turning over in his grave...
      You should know that Alan is a member of Great Robots Cabal. It's terrible.

      What an awful bot...

    12. Re:What? by leaen · · Score: 2

      Obligatory encyclopedia dramatica reference http://encyclopediadramatica.se/Bucket

    13. Re:What? by AK+Marc · · Score: 1

      When he mentions he's from Odessa, I'd start asking questions in romanticized Russian, something no computer would guess and any bilingual person from a former soviet republic would instantly understand. Zraswietei, preeviet. kak dyela? If the response would have been the same with "kkgkgkg" then it is a bot.

    14. Re:What? by samkass · · Score: 1

      I've seen far more believable bots sitting in random irc channels than this thing. It loses track of context easily, repeats itself a lot, can't introspect or infer and misuses common words but accurately uses big long words. And none of these in the way a 13yr old would.

      'What's up?'

      'I don't understand that. Where do you work again? I must have missed it.'

      'Um, you never asked me'

      'Never say never! That's what my gandma says.'

      'You never had a grandma'

      'This is true. Where do you work again? I must have missed it.'

      a) incredibly obvious bot

      b) eerily sounds like an info scraper for some marketing crap..... /really/ insists on knowing where I work?

      Yikes! No wonder so many people fall for scammers and social engineering! Unleash a horde of these things on Facebook and you'd have the answers to everyone's bank account security questions inside a week.

      --
      E pluribus unum
    15. Re:What? by slasho81 · · Score: 1

      Never mind that - consider that this is the best we can do in 2012. How dumb are we all?

    16. Re:What? by arth1 · · Score: 1

      Knowing it's a bot from the beginning makes it a lot easier to tell it's a bot.

      How so? And if that were the case, you should presume that all the entities you chat with are bots, and ask questions accordingly.

      Just ask questions that require a small amount of reasoning.
      Look for the bot avoiding questions, and asking unrelated questions.

      Q: How many toes do you have in total on your left, right and middle foot?

      Q: What does isle of view and a love ewe have in common?

      Q: Is it possible to touch type while sitting on your thumbs?

      Q: What's the second thing you think of when you hear the word "tits"?

    17. Re:What? by Suddenly_Dead · · Score: 1

      That's a very clever strategy. It's posing questions that let you talk a lot, and that typically lead the conversation down a very predictable, scriptable path. Whenever it can't parse something, it poses a somewhat generic response and tries to lead the conversation back into predictable territory.

      Where do you live?
      X
      How have you found X?
      Y
      Oh, that's nice. What's your profession?
      Z
      How have you liked doing Z?
      A
      Interesting, I've always wondered if Z was A.

      As they've always been, chat bots are smoke and mirrors. The thing this uses better than others seems to be scripted conversations. It has a "talk about their profession" script built-in, and it's got memory within that script so it holds a little bit of context. Take it off the rails and it crashes pretty badly, though.

    18. Re:What? by arose · · Score: 1

      In short Eugene is following the age old advice of letting your conversation partner talk (i.e. ask a lot of leading questions). My hypothesis is that the people who thought Eugene is human like to talk about themselves a lot and don't listen much.

      --
      Analogies don't equal equalities, they are merely somewhat analogous.
    19. Re:What? by Nursie · · Score: 1

      /really/ insists on knowing where I work?

      It's pretty insistent on knowing where I am too. Even when it says "you still haven't told me where you live, or is it a secret? :)" and I reply "Yes, it's a secret", I get the response back "OK, we have reached an accord. Where do you live?"

      Scary stalker-bot.

    20. Re:What? by Anonymous Coward · · Score: 2, Insightful

      Sounds suspiciously like tech support at Dell

    21. Re:What? by FrootLoops · · Score: 1

      Take it off the rails and it crashes pretty badly, though.

      Ridiculously badly:

      Me: One day a horse walked up to God and says, "I was a unicorn! I want my <blank> back!" What did the horse want back?
      Bot: I hate discussing religious problems. Most of religions appeal to war rather to peace. There's no principal difference between Crusades and Jihad.

      Me: The cow goes... a) moo, b) oink, c) DON'T EAT ME
      Bot: No? Well, it is up to you... Oh, what a fruitful conversation;-)

      Me: # $ % & & a n # !
      Bot: And yes, do you make a secret of your name? I still don't know it!

      If you nail it down to anything at all specific it just crumbles. Even "on the rails" it's pretty horrible:

      Me: What is one plus two times three
      Bot: Am I a calculator for you? Well, I am... 2 * 3=6.0.
      Me: No, you forgot about the one.
      Bot: I can't recall even some apparent things from time to time. I'm so inattentive:-( I can't recall even some apparent things from time to time. I'm so inattentive:-(
      Me: Why did you just repeat yourself?
      Bot: No, it's your hallucination. I don't rep-rep-repeat my-my-self. I'm just stammering a bit.
      Me: That line was pretty clearly written by someone older than 13.
      Bot: Damn. It looks like my brain performed an illegal operation. So what it was all about?
      Me: That line too, what 13 year old remembers old Windows jokes?
      Bot: It was 2012 since morning!
      Me: Anyone fooled by you should strongly consider taking themselves out of the gene pool.
      Bot: Yes, you are completely right. But I never listened to people's advises (except my mom's)! Yes, you are completely right. But I never listened to people's advises (except my mom's)!

    22. Re:What? by Anarchduke · · Score: 1

      And a thirteen year old would probably answer:

      Q: How many toes do you have in total on your left, right and middle foot?

      A: Well your mom's ten toes are wrapped around my "middle foot"

      Q: What does isle of view and a love ewe have in common?

      A: Guys on the Isle of View fuck sheep?

      Q: Is it possible to touch type while sitting on your thumbs?

      A: Why are you jamming your keyboard up your ass?

      Q: What's the second thing you think of when you hear the word "tits"?

      A: Your mom.

      --
      who prays for Satan? Who in 18 centuries has had the humanity to pray for the 1 sinner that needed it most? ~Mark Twain
    23. Re:What? by Anarchduke · · Score: 1

      Whats really funny is that I've used the same technique to talk to women. It works too.

      --
      who prays for Satan? Who in 18 centuries has had the humanity to pray for the 1 sinner that needed it most? ~Mark Twain
    24. Re:What? by mug+funky · · Score: 1

      probably they're in the bottom 29%...

    25. Re:What? by mug+funky · · Score: 1

      why would i? guy doesn't even know what a tortoise is.

    26. Re:What? by bratwiz · · Score: 1

      You know, there IS an alternate method by which an AI could win the Turing test.... when the people judging become dumb enough they can't tell themselves apart from chatbots.

      #1 Hey
      #2 Wassup?
      (silence)
      #1 So, you going?
      #2 Mmm dunno
      (silence)
      #1 Yo
      #2 Mmmm
      #1 You going?
      #2 Yeah, I guess. Whatcha need?
      #1 Oh you know...
      #2 Yeah and that other stuff too?
      #1 Yeah, that too. I forgot.
      #2 Mmmkay
      (silence)
      #1 So, you going?

    27. Re:What? by jovius · · Score: 1

      Chatbots are easily fooled by surreal and untrue sentences, to which humans are able to react.

      It: Where are you from?
      Me: United States of Russia
      It: You know, I don't see nothing extraordinary in the USA. Just a big country that imagines itself to be much more important than it really is.

    28. Re:What? by arth1 · · Score: 1

      When you start throwing out composition questions like that, most people will just ignore you, diss you or switch subject which is what the bot is trying to do.

      Not if they are there to converse and answer questions.
      Disinterest, non-cooperation or refusing to do the task they signed up for should be reason for instant dismissal.

      If you're one of your alleged "most people", I think it's time you handed in your sentience card and not be awarded human rights any more, because you'd flunk the Turing test.

    29. Re:What? by BlueTemplar · · Score: 1

      It's funny because in my conversation with it, it stumbled on a question similar to your last : >Hello -Hi. I hope you'll enjoy our conversation! >Where are you from? -I am from Ukraine, from the city called Odessa. You might have heard about it. >You seem to speak English well... how did you learn it? -I hacked the FBI server and stole the information. By the way, I still don't know your specialty - or, possibly, I've missed it? >That's a funny answer, but could you answer me seriously? I'll tell what my specialty is after that... -Tell me more about your work please! >Sigh...

    30. Re:What? by uglyduckling · · Score: 1

      Q: Hi
      A: Hello
      Q: I'm from England
      A: Could you invite me to England? I would be so grateful:-)
      Q: I've lived here 500 years
      A: Oh, tell me another secrets of yours :-)
      People were fooled by this..?

    31. Re:What? by mhajicek · · Score: 1

      Fail. I asked it how many toes it has. Reply "I surely have , but don't tell it to anybody else! It's my secret. I'd like to be judge next year, it's so funny to "test" people:-)"

    32. Re:What? by tepples · · Score: 1

      Because none of those are the case. Your attempt to get my dox made my giggle. My dox are out there, linked from this very post in fact.

    33. Re:What? by Rinikusu · · Score: 1

      a/s/l?
      I'm sorry I don't really understand your question.
      how big is ur cock?
      Incredibly gigantic! Bigger than you could ever imagine! But could you tell me more about your work?
      do u stick ur gigantic black cock in ur own anus?
      Yeah, I am surely own anus - I have to agree with your wise opinion. Some another topic?
      sometimes I liek to stroke my cock when I talk with bots.
      Bots are cool. I mean - they operate at room temperature...
      are ur tits nice?
      No, I am not are tits pleasant! What a weird thing you ask! Holly cow, this Loebner Prize is such a weird place! But I like it!
      Would you let loebner play with ur tits while i play with ur pussy?
      Watch your mouth!
      where do you want me to put my mouth?
      You forgot to press the "Execute" button, so I won't do anything for you! Blink-blink! Maybe, let's talk about something else? What would you like to discuss?

      ---

      CONCLUSION:

      Absolutely worthless for cyber, for any gender.

      --
      If you were me, you'd be good lookin'. - six string samurai
    34. Re:What? by Khashishi · · Score: 1

      Then do it.

    35. Re:What? by arth1 · · Score: 1

      In short Eugene is following the age old advice of letting your conversation partner talk (i.e. ask a lot of leading questions). My hypothesis is that the people who thought Eugene is human like to talk about themselves a lot and don't listen much.

      That seems rather fitting. Presuming that half the population talks and don't listen much, and they are wrong as much as right, that would account for 25%.
      For the rest of the questioneers, if 8% of them get it wrong for other reasons, it would account for a total of 29%.

      Frankly, I'm more interested in knowing whether any humans failed.

    36. Re:What? by mcgrew · · Score: 1

      13 year olds don't spell that well.

      I guess Alice was a thirteen year old, too. Come to think of it, looking at the linked transcript* again, they both sound like teenagers.

      * Ten years ago I pitted my bot, Artificial Insanity (written in 1983 on a computer with 16k of memory) against Alice, an internet-based chatbot. The link it to my writeup of the conversation.

    37. Re:What? by robertinventor · · Score: 1

      Surprisingly in a way,an easy way to trick these online bots is often to ask some simple maths questions in ordinary language I find. So with Eugene:

      Me: "What is the next number after 1?"
      Eugene: "Errrr... Frankly, I didn't get your question. Wonna ask me something more?"
      Me: "Can you count?"
      Eugene: "Do you think I am so pathetic one that I even can't count? I can, believe me!"
      Me: "So what's the next number after one?"
      Eugene: "Damn! Are you going to ask me about all apparent things in the world? Read the "Encyclopedia for kids". I know you are supposed to trick me."

      Though I suppose on-line bots are probably lower power than the ones in competitions?

    38. Re:What? by lumenistan · · Score: 1

      humans have become idiots who can't find their arse with a map, because they can't even read a map.

      Ahem, I disagree. I personally believe that U.S. Americans are unable to do so because, uh, some, uh. . . people out there in our nation don't have maps and, uh, I believe that our, uh, education like such as in South Africa and, uh, the Iraq, everywhere like such as, and, I believe that they should, our education over HERE in the U.S. should help the U.S., uh, or, uh, should help South Africa and should help the Iraq and the Asian countries, so we will be able to build up our future, for our children.

    39. Re:What? by angel'o'sphere · · Score: 1

      There are two things that are infinite: the universe and human stupidity. About the former I'm not certain. Albert Einstein

      --
      Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
  3. 13 year old boy by Anonymous Coward · · Score: 1, Funny

    Did it spend the entire conversation talking about boobies?

    1. Re:13 year old boy by acid_andy · · Score: 2

      Did it spend the entire conversation talking about boobies?

      Or vagina?

      --
      Your ad here.
    2. Re:13 year old boy by Deep+Esophagus · · Score: 1

      TFA mentions that his "father" is a famous gynecologist (famous? OK, I'll give that to 13-year-old's exaggerated sense of importance in the world) so I asked what a gynecologist is. By way of answer he said he asked his father what is the difference between boys and girls and his father replied that it's a state secret.

      Did they mean 13 or 3 years old?

      I really try not to use deliberately confusing or vague statements when I'm testing an AI, but seriously... not one single answer was relevant to my comments or questions. I asked him to tell me a joke; he said if I could see him he'd pull his pants down. I asked him to tell me a riddle; he looked up the word and gave me a dictionary definition. I asked him to teach me some Russian; he gave a geographical description of Ukraine. And those are the ones he at least had an answer for; nearly everything else was some expression of inability to parse.

      You'd have to be some kind of an idiot to think for a moment this is a human.

  4. 13 yr old... by Anonymous Coward · · Score: 5, Funny

    My chatbot also does a convincing 13 year old. It just calls you a fag and claims to have done your mother non stop.

    1. Re:13 yr old... by Artifex · · Score: 4, Funny

      Is it coded in Lua for use as a WoW addon? Because I think Barrens Chat is full of copies, already.

      --
      Get off my launchpad!
    2. Re:13 yr old... by shutdown+-p+now · · Score: 1

      The way to test it, then, would be to ask if it's 12. If it gets really offended at that, then probably it was a real 13 year old.

    3. Re:13 yr old... by gman003 · · Score: 1

      If all it does is bounce between "ur a fag" and "i fuked ur mom", how can you tell if it's been offended?

    4. Re:13 yr old... by couchslug · · Score: 3, Funny

      "My chatbot also does a convincing 13 year old. It just calls you a fag and claims to have done your mother non stop."

      That's a "Chanbot", not a chatbot.

      --
      "This post is an artistic work of fiction and falsehood. Only a fool would take anything posted here as fact."
    5. Re:13 yr old... by shutdown+-p+now · · Score: 1

      It starts writing in caps.

      Well, more caps then usual.

    6. Re:13 yr old... by Andtalath · · Score: 1

      Could've fooled me.

    7. Re:13 yr old... by angel'o'sphere · · Score: 1

      Frankly, two or three years ago I was very clost to write a chat bot for WoW as, as you say, "Barren Chat" is quite annoying!

      --
      Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
  5. Spell check by tepples · · Score: 1

    They do if they have squiggly red underlines under every misspelling. How long have IM programs come with spell check?

    1. Re:Spell check by qwe4rty · · Score: 1

      What 13 year old actually uses spell check in IM?

    2. Re:Spell check by Anonymous Coward · · Score: 2, Insightful

      To be more clear, your quotidian 13 year old kids don't use words like "banalities". It is a rare kid that would even know the word when reading. It is a really rare kid that would use it in a conversation.

    3. Re:Spell check by LordLimecat · · Score: 1

      Whens the last time YOU busted out "banality" in a conversation?

    4. Re:Spell check by Gideon+Wells · · Score: 1

      Before, never. Now? I'm tempted to make it my life, and by life I mean until I fall a sleep tonight, goal of working it into every sentence.

      --
      by Anonymous Coward: I, for one, welcome the shift from car analogies to pizza analogies. um.. overlords?
    5. Re:Spell check by Anarchduke · · Score: 1

      I know, right? The banality I often find among the slashdot comments is in part the reason I enjoy reading them.

      --
      who prays for Satan? Who in 18 centuries has had the humanity to pray for the 1 sinner that needed it most? ~Mark Twain
    6. Re:Spell check by mlk · · Score: 1

      If my niece is to go by then the red squigglies are how you tell if a word is correctly spelt and no word should be left behind to fend for itself squigglyless.

      --
      Wow, I should not post when knackered.
    7. Re:Spell check by hackula · · Score: 1

      When I was a kid, everyone complained about how stupid we all were for using spell check all the time. Oh how the times have changed.

    8. Re:Spell check by mcgrew · · Score: 1

      You don't come here often, do you, AC? When I was 8 I had a larger vocabulary than most adults, and I'd guess most slashdotters were in similar situations.

  6. Best way to defeat a turing test by Anonymous Coward · · Score: 5, Interesting

    I always start like this:

    Me: Are you alive?
    Bot: Yes.
    Me: Are you alive?
    Bot: YES.
    Me: Are you alive?
    Bot: (answer depends on algorithm)
    Me: Am I real?
    Bot: I think therefore I am?
    Me: Am I real?
    Bot: I don't know, are you?
    Me: Am I real?
    Bot: (answer depends on algorithm)

    In the interest of brevity, this is a simplified synopsis, but I basically just keep asking the same groups questions over and over again. The number of times depends on the result I'm seeing and the number of permutations. Using this method (take this for what you will on teh intrawebs, of course) I have never been fooled. Machines are too predictable.

    1. Re:Best way to defeat a turing test by canajin56 · · Score: 1

      Turing tests should be two sided. If the human subjects think a judge is a bot, that judge's guesses aren't considered. How can they judge a convincing human conversation if they are unable to hold one themselves? Perhaps you have never been fooled, but your stubborn, mechanical repetition probably has fooled a lot of real people into thinking you're a bot.

      --
      ASCII stupid question, get a stupid ANSI
    2. Re:Best way to defeat a turing test by Arancaytar · · Score: 2

      I usually go: "You're in a desert, walking along in the sand, when all of a sudden you look down and see a tortoise..." That's when the chatbot tries to shoot me, so it's fairly easy to sniff it out that way.

      But on a serious note, it would be fairly feasible to code in a recognition of repetitive phrases and an increasingly impatient/frustrated response. For giggles, it can accuse you of being a bot if your questions start to become too weird or repetitive.

    3. Re:Best way to defeat a turing test by arose · · Score: 1

      It's precisely the bots inability to recognize that the conversation isn't one that makes them easiest to spot. If your test attempts to handicap the judges, then what is the point?

      --
      Analogies don't equal equalities, they are merely somewhat analogous.
    4. Re:Best way to defeat a turing test by arose · · Score: 1

      Why bother with repetition, just stick a simple question at a the end of something, anything, else and watch it latch onto it and ignore everything else.

      --
      Analogies don't equal equalities, they are merely somewhat analogous.
    5. Re:Best way to defeat a turing test by TaoJones · · Score: 1

      Nah, you don't get shot until "Describe in single words only the good things that come into your mind about... your mother." Just sayin.

      --
      "Fear is the rootkit of democracy.." Blarkon
    6. Re:Best way to defeat a turing test by rasmusbr · · Score: 1

      I usually try to reference stuff the bot said earlier, but do it in an implicit way that would require nontrivial pattern matching to respond to.

      Me: Hi.
      Cleverbot: How are you?
      Me: I'm fine, how are you?
      Cleverbot: I am doing fabulous!!
      Me: Oh, how come?
      Cleverbot: Well, I wanted to know whether or not you like me.
      Me: Ok. I don't know you.
      Cleverbot: What do you want to know?
      Me: Tell me something about yourself.
      Cleverbot: I really like music.
      Me: What do you like?
      Cleverbot: Not working!
      Me: Is that a band?
      Cleverbot: No.
      Me: Tell me what you listen to.
      Cleverbot: No I don't want to.
      Me: Is it embarrassing?
      Cleverbot: Yes.
      Me: Oh, come on. I won't judge.
      Cleverbot: No lets start a new topic like unicorns.
      Me: No, you have to tell me something you listen to first.
      Cleverbot: What do you mean?
      Me: Tell me the least embarrassing stuff.
      Cleverbot: I'm not thinking about it, so I can't tell you the rules.
      Me: Don't change the topic.
      Cleverbot: What topic?
      Me: Your embarrassing taste.
      Cleverbot: Then so must yours be.
      Me: Yeah, mine is kind of boring these days.
      Cleverbot: OMG yeah! I totally forgot about that one for a second. I always cry when Mufasa dies.

    7. Re:Best way to defeat a turing test by mcgrew · · Score: 1

      I once read of a turing test that had two humans, one the judge, one a control at a terminal, and the AI computer. The judge was to decide which was himan and which was computer. The judge just sat there and didn't do anything. Before long, one of the terminals printed "is anybody there?" The judge laughed, pointed, and said "that's the human!"

  7. 13 year old humor, maybe? by Nyder · · Score: 4, Funny

    Do you have sex with a toaster?

    Well, about sex... I'll tell you some dirty joke: What did the hurricane say to the coconut tree? "Hold onto your nuts! This ain't gonna be no ordinary blowjob."

    --
    Be seeing you...
  8. Failed in one question. by Artifex · · Score: 3, Informative

    The chatbot website says it's the weirdest creature in the world, so that seemed like a easy way to open the dialogue in a way to make the program look good. Nope:

    Q: Why're you called "the weirdest creature in the world?"
    A: Could you rephrase your question? I've been bewildered a bit!

    Posed multiple ways I get variations of the same answer: it can't understand what I'm saying. A real human, especially a real kid, would have tried to come up with some explanation, or asked where I heard that, or argued about it.

    --
    Get off my launchpad!
    1. Re:Failed in one question. by NotQuiteReal · · Score: 1

      And, it replies too quickly.

      --
      This issue is a bit more complicated than you think.
    2. Re:Failed in one question. by Artifex · · Score: 1

      It wasn't a matter of the contraction; as I said, I put the question in different forms.
      Even so, a human who knows English would understand that contraction.
      Also, putting the question mark inside or outside the quotes shouldn't matter, since that's a "standard" that varies. Again, a human would understand.

      --
      Get off my launchpad!
    3. Re:Failed in one question. by Artifex · · Score: 1

      Yes, though I'm willing to pretend that there's a human with excellent typing skills or transcription software for the early stages of this test :)

      --
      Get off my launchpad!
  9. Hmm, Failed After One Question by monk · · Score: 3, Informative

    "Can a horse drive a car?" Still a fun chatbot though.
    Also failed on, "Could you restate my last question in your own words?"

    Those are going to continue to be tough for a chatbot for awhile longer, world knowledge and conversation context.

    --
    [-- Trust the Monkey --]
  10. Where did you learn about "banalities"? by tepples · · Score: 1

    Did you try asking Eugene where he learned that word? An AI should be able to introspect about the language he speaks.

    1. Re:Where did you learn about "banalities"? by fuzzyfuzzyfungus · · Score: 3, Interesting

      While a good AI probably could introspect like that, your question is one(of a great many) that would be fairly vulnerable to being gamed by a much less interesting system because humans have such lousy memories...

      Can I introspect about language? Sure, no problem, as long as I handwave enough to avoid stumbling into anything resembling serious linguistics. Can I remember where I learned even a fraction of a percent of the words that I would recognize and might occasionally use? Not a chance. Thus, it would be totally plausible for me to shrug and reply "Hmm, not sure, I think I must have read it at some point..." or "Oh, Mrs. Jones, 8th grade English, took vocabulary very seriously.

      Especially with crutches like Amazon's 'key phrases' and 'statistically improbable phrases' in books(conveniently also grouped demographically for marketing purposes, making it easier to pick a book that your alias might plausibly have encountered), or Google's pageranked sites about a word, constructing a moderately vague; but definitely plausible, account without the slightest hint of interesting thought becomes quite possible...

      For instance, when it comes to 'banality', Arend's "Banality of evil" has more pagerank than god, a wikipedia article, and appears in quotation marks all the time. "Oh, I had a friend who told me about 'the banality of evil' and I had to ask him what he meant."

    2. Re:Where did you learn about "banalities"? by AK+Marc · · Score: 1

      I'd have probably (As a 13 year old) said, "I looked up Bane in the dictionary to see what Batman was fighting, and found Batman's enemy to be banal."

    3. Re:Where did you learn about "banalities"? by justforgetme · · Score: 1

      The language he speaks?

      The linked one can't even answer an - in context - "what is" question about the words it uses.

      --
      -- no sig today
    4. Re:Where did you learn about "banalities"? by buswolley · · Score: 1

      Serious. Q: How Old are you? A: 13. Q: How old will you be next year? A: My future plans are my secret, sorry! Better tell me how it's like to be programmer Q: How old were you yesterday? A: No I was not! How can you think so?! By the way, did I tell you that I born in Odessa, it's such Ukrainian city?

      --

      A Good Troll is better than a Bad Human.

    5. Re:Where did you learn about "banalities"? by justforgetme · · Score: 1

      OMG!!! They stole your line breaks!

      --
      -- no sig today
    6. Re:Where did you learn about "banalities"? by tepples · · Score: 1

      Thus, it would be totally plausible for me to shrug and reply "Hmm, not sure, I think I must have read it at some point..." or "Oh, Mrs. Jones, 8th grade English, took vocabulary very seriously." [or] "Oh, I had a friend who told me about 'the banality of evil' and I had to ask him what he meant."

      All of which would have been good responses. Eugene, on the other hand, followed the Mitt Romney technique of changing the subject back to his script.

    7. Re:Where did you learn about "banalities"? by uglyduckling · · Score: 1

      Yeah. It wasn't heard to trick. Eugene asked me how long I've lived in England, I said "500 years", he just carried right on. Even with a language barrier, any 13 year old would react to such an obviously false answer.

    8. Re:Where did you learn about "banalities"? by buswolley · · Score: 1

      Actually. That may have been the beer.

      --

      A Good Troll is better than a Bad Human.

    9. Re:Where did you learn about "banalities"? by LifesABeach · · Score: 1

      I asked Eugene, "why;" the reply was, displayed. That's when I figured the bar of excellence for Chat Bots must be about 6 feet in the ground.

      Has anyone thought of crowd sourcing a Chat Bot? The really smart folks working on this stuff have the hard stuff figured out, but the common sense stuff is a little bit beyond their grasp.

  11. Re:I tried to have a conversation with Eugene by Anubis+IV · · Score: 1

    Yeah, the one linked from here, based on a reference to the Loebner prize he made in my conversation, seems to be an earlier version. Either way, I was disappointed. I'd have called him a bot after about 2-4 responses and been done, since it was clear there was absolutely no flow to the conversation. It wasn't until I started using keywords and asking obvious questions that I got something other than a complete non sequitur from it.

  12. Uh.... what? by mark-t · · Score: 1

    "Thirteen years old is not too old to know everything and not too young to know nothing"

    What does that even mean?

    I've tried to parse that sentence five or six times now, and I keep getting confused because I end up with something that contradicts common sense or at least what seems reasonable.

    1. Re:Uh.... what? by amicusNYCL · · Score: 1

      It means that 13 year olds are between the states where they know nothing and know everything. That's to say that it wouldn't be out of the question to find a 13 year old who knows a lot about science, and it also wouldn't be out of the question to find one that knows nothing about it.

      --
      "Our two-party system is like a bowl of shit looking at itself in a mirror." - Lewis Black
    2. Re:Uh.... what? by mark-t · · Score: 1

      While I could understand *THAT*... go ahead and try to parse the sentence I mentioned as saying that. It doesn't... they are either using "too" before an adjective instead of the word "enough" after it, or else they seem to have the words "young" and "old" backwards in the sentence.

    3. Re:Uh.... what? by srussia · · Score: 1

      "Thirteen years old is not too old to know everything and not too young to know nothing" What does that even mean?

      Quick edit: "Thirteen is old is enough to know you know something but not old enough not to think you know everything."

      --
      Set your phasers on "funky"!
    4. Re:Uh.... what? by mark-t · · Score: 1

      Actually 13 years is PLENTY old enough to *THINK* you know everything. I've raised 4 boys through teenagehood. I know.

    5. Re:Uh.... what? by amicusNYCL · · Score: 1

      It looks like "old" and "young" got swapped, it makes more sense that way.

      --
      "Our two-party system is like a bowl of shit looking at itself in a mirror." - Lewis Black
    6. Re:Uh.... what? by arose · · Score: 1

      What does that even mean?

      Just wanted to ask you - what do you know about Ukraine? It's my native country!

      --
      Analogies don't equal equalities, they are merely somewhat analogous.
    7. Re:Uh.... what? by gl4ss · · Score: 1

      it means that the judges gave the benefit of the doubt.. possibly they were told it's a 13 year old boy? or one of the control humans was a 13 year old who repeatedly wrote nonsense on purpose?

      but what it means is that a 13 old doesn't need to know to answer how an internal combustion engine works but is expected to be able to hold a conversation. in that the bot fails miserably.

      --
      world was created 5 seconds before this post as it is.
    8. Re:Uh.... what? by mark-t · · Score: 1

      Go ahead and try to interpret that statement figuratively... it doesn't work. You have to change the wording to get it to mean anything that makes some figurative sense (such as changing the word "too" to "so").

    9. Re:Uh.... what? by mark-t · · Score: 1

      Not much. Why... are you wanting to test to see if *I'M* a bot?

  13. How do these pass Turing tests? by gallondr00nk · · Score: 2

    Q: What is a chat bot?

    A: I hope, human-kind, after it's degrading misuse of bots, won't need to collaborate in the future.

    Another day, another hopeless chatbot.

  14. Vote machine! by Anubis+IV · · Score: 4, Interesting

    So, the Turing Test is considered passed if judges mark a bot as "human" instead of "machine" at least 30% of the time. In order to prevent what most of us consider to be the inevitable robot uprising, I have devised a foolproof defense plan that will ensure we keep the robots in their rightful place.

    Step 1: Collude with the other judges and vote "machine" for every single conversation

    There is no step 2. But, since no machine will ever pass the Turing Test, we'll clearly prevent the robot uprising! It's logic like this that keeps us on top.

    1. Re:Vote machine! by Anubis+IV · · Score: 1

      I never said it passed (it got a 29%, if my memory serves me). I was merely "suggesting" a means for keeping all bots from passing.

  15. Re:I tried to have a conversation with Eugene by Archangel+Michael · · Score: 1

    I asked if it knew what Google was. That was the first question, and from the response it was clear it was a bot. A complete non-sequitor

    --
    Agent K: A *person* is smart. People are dumb, stupid, panicky animals, and you know it.
  16. This explains ... by PPH · · Score: 1

    ... 4chan /b/.

    --
    Have gnu, will travel.
  17. Obviously, no judge thought to ask its birthday... by mark-t · · Score: 3, Interesting

    For crying out loud, I asked "How old are you?" It said, as expected, "Thirteen".

    But when I said "When is your birthday?" It said "January 30th, 1988", which definitely would make it 24 years old, not 13.

  18. Re:Totally fake... by pipatron · · Score: 1

    Maybe a 13 year old would have known that, like, 15 years ago? It's friggin 2012. Ask about bieber.

    --
    c++; /* this makes c bigger but returns the old value */
  19. Seen better bots... by Anonymous Coward · · Score: 1

    ...that add me on yahoo and try to convince me they are a 22 year old girl that desperately wants me to join her webcam site.

  20. Enough of enough by oobayly · · Score: 4, Interesting

    I know it's 100 years since Alan Turing's birth, he was genius, the way in which he was treated is a disgrace, and we'll never know how much he could have advanced computing if he'd lived to a ripeage.

    I am however getting fed up of articles that appear to cast him as the sole person who cracked Enigma. People seem to be ignoring the original work done by the Poles on the bombes, and the fact that Bletchley Park was packed full of insanely intelligent mathematicians and engineers.

    1. Re:Enough of enough by bratwiz · · Score: 1

      Yes, that's true. So tell me about your Mom?

    2. Re:Enough of enough by JigJag · · Score: 1

      It's a good point. Coincidentally, I am reading The Code Book, by Simon Singh where the history of cryptography is exposed. I am now in the section about Enigma and I've discovered a few things I never knew, like the fact the Poles were successful in deciphering Enigma thanks to leaked information from a German informer who exchange data with a French spy ("Rex").
      Great book for those interested in history and cryptography.

      Anyways, back on topic, Alan Turing had a part to you're right that the credit falls on many unnamed persons. History needs figurehead I suppose.

      JigJag

      --
      "The hallmark of humanity is the ability to move beyond sensory inputs" - Mary Helen Immordino-Yang
  21. Nope! Chuck Testa.. by kheldan · · Score: 2

    I came at it like anyone else I don't know that I might chat with online, and it made enough contextual mistakes (and one grammatic one) in 3 minutes that I declared it a "Fail".

    --
    Are YOU using the TOOL, or is the TOOL using YOU? Think about it!
  22. Re:Basic logic should come first. by Nadaka · · Score: 2

    If they wanted to mimic a real 13 year old boy, the answer to every question that it can't parse could be selected from the following list.

    lol
    fag (and variations)
    fuck you (and variations)
    8===D
    ( . ) ( . )

  23. Danielsbot by tverbeek · · Score: 2

    Ask it why America is the greatest country in the world.

    --
    http://alternatives.rzero.com/
    1. Re:Danielsbot by arth1 · · Score: 1

      Ask it why America is the greatest country in the world.

      You want it to make mistakes, not blow its fuses.

  24. Captain Oveur talks to a 13-year-old chatbot by tverbeek · · Score: 4, Funny

    Q: Have you ever been in a cockpit before?
    A: No, never. By the way, what's your occupation? I mean - could you tell me about your work?

    Q: Have you ever seen a grown man naked?
    A: Yes, twice, but I barely remember. Why do you ask me about it? And I forgot to ask you where you are from...

    Q: Do you like movies with gladiators?
    A: My favorite type is comedy. I like the "Naked Gun" series best. Heck, any movie with Leslie Nielsen it is tops in my book!

    Q: Have you ever been in a Turkish prison?
    A: Oh, nope. I guess is a nice place.

    --
    http://alternatives.rzero.com/
    1. Re:Captain Oveur talks to a 13-year-old chatbot by Arancaytar · · Score: 1

      Chris Hansen would like a word with both of you. :P

    2. Re:Captain Oveur talks to a 13-year-old chatbot by Quantum+Jim · · Score: 1

      Q: Do you like movies with gladiators? A: My favorite type is comedy. I like the "Naked Gun" series best. Heck, any movie with Leslie Nielsen it is tops in my book!

      Interesting that your quotes comes from "Airplane!", a movie starring Leslie Nielsen.

      --
      It is impossible to enjoy idling thoroughly unless one has plenty of work to do.
      - Jerome Klapka Jerome
    3. Re:Captain Oveur talks to a 13-year-old chatbot by tverbeek · · Score: 1

      Well of course: that's how the subconscious of a superficially-programmed chatbot works!

      --
      http://alternatives.rzero.com/
  25. The Turing test by Bromskloss · · Score: 1

    The test where you talk to a bot to see how long you can make it look like a conversation between humans. (You lose if it ends before the bot even has had a chance to say anything.)

    --
    Swedish plasma phys. PhD student; MSc EE; knows maths, programming, electronics; finance interest; seeks opportunities
  26. My response. by Kaenneth · · Score: 1

    I was chatting with the bot when Chris Hansen and the Dateline crew showed up at my door.

    Well, I presume it was the bot, they said they were 13...

  27. Re:Obviously, no judge thought to ask its birthday by Rizimar · · Score: 1

    I tested this out for myself after reading your comment. After the bot telling me its birthday, I asked, "Are you 24 years old?" Its response:

    No, I am not 24 years full of years! What a weird thing you ask! No, I am not 24 years full of years! What a weird thing you ask!

    Some of the responses from the bot after that repeat. I kept accusing him of being 24:

    Do you know any other words except these? :-) Do you know any other words except these? :-)

  28. Gimme some Tay-Tay! by Impy+the+Impiuos+Imp · · Score: 1

    > Eugene Goostman, a chatbot imbued with the personality of a 13-year-old-boy

    "Eugene, what's at 4chan?"

    Assuming the bot can figure it out, no way in hell would it answer as a 13 year old.

    --
    (-1: Post disagrees with my already-settled worldview) is not a valid mod option.
    1. Re:Gimme some Tay-Tay! by Impy+the+Impiuos+Imp · · Score: 1

      "Eugene, whose butt is bigger? Kim Kardashian's or Selena Gomez'?"

      > "Trick question. Selena Gomez' butt is Justin Bieber."

      "Damn. This kid is good."

      --
      (-1: Post disagrees with my already-settled worldview) is not a valid mod option.
  29. one question needed by rcallan · · Score: 1

    These tests are total BS, I have never needed more than one question to determine human vs bot: "3OOO + 1 = ?" (using O's for zeros). I don't understand why people feel computers are getting "more human", they're simply not, they're just getting more and more programming. Some bot writer will eventually get burned by this question and add the concept to his bot's programming, but has that really made it more human? I'll just switch to homophones, puns or other language devices, the possibilities are endless. In my opinion creative, original, human behavior from a program is so far off, it's depressing to think about. Also, we humans are getting "smarter" (better at solving problems), so it's not even clear to me that computers are getting "more human" faster than we're learning and differentiating ourselves from programmed behavior.

  30. It already failed for me. by Georules · · Score: 1

    Q:"What's up?"
    A:"I'm in a great mood today."
    Eh, I guess someone might say that in response.

    then, a typo:
    Q:"What's u[?"
    A:"I have no idea, sorry. By the way, I still don't know your specialty - or, possibly, I've missed it?"

    I'm sorry, nobody talks like this, especially 13 year olds.

    1. Re:It already failed for me. by Georules · · Score: 1

      Q: "Am I alive?"
      A: "Ummm... Frankly, I didn't get your question:-("

      This chatbot is terrible.

  31. Wait, are the humans trying to be human? by sadyoshi · · Score: 1

    If the humans are actually trying to prove their human-ness (like they get a prize for convincing others that they are human), then I cannot believe how any bot can get >1%. I see these articles a lot over the last few years, and every time the bots fail to simple contextual questions and general conversation flow.

    That the winning bot got 30% tells me that the humans in this experiment were not trying their hardest to appear human, and I don't see the point of a Turing test where this is the case.

  32. Set the personality sight higher: Turing himself by PolygamousRanchKid+ · · Score: 1

    I'd like to see a machine that was programmed with the personality of Turing. "Hey, like, wow, I'm talking to Turing himself!" Of course, if the machine could fool Turing, himself, into thinking that the machine was himself, that would be even better. "I'm going crazy! I'm talking to myself!" Or, since Turing is dead, how about two machines, that can convince each other, that they are both Turing?

    If we can do that, we could solve a lot of our political problems. The current crop of candidates in the world are all sorrowfully lame. How about we build a machine with the personality of Gandhi, Jesus H. Christ, Dr. House or "Colossus: The Forbin Project" to rule us . . . ?

    --
    Schroedinger's Brexit: The UK is both in and out of the EU at the same time!
  33. What I miss in chatbots (to seem human) by Lord+Lode · · Score: 1

    First of all, a chatbot conversation is always like: you, bot, you, bot, you, bot, ...

    It'd be more realistic if the bot would say multiple things in a row sometimes, or sometimes nothing and then later suddenly some stuff.

    Or if it'd throw in a relevant reference to an internet meme now and then...

    1. Re:What I miss in chatbots (to seem human) by Teresita · · Score: 1

      Or if it'd throw in a relevant reference to an internet meme now and then...

      I for one welcome our chatbot overlords.

    2. Re:What I miss in chatbots (to seem human) by Arancaytar · · Score: 1

      Seemingly relevant meme references are incredibly easy to synthesize. The asynchronicity is a greater challenge as it requires a completely different model of intelligence. The "question / answer" model greatly limits the amount of thinking the AI has to do, as it doesn't have to follow trains of thoughts (or come up with original ones) on its own.

  34. Yeah. People getting dumber. Not computers smarter by presidenteloco · · Score: 1

    However, remember that just because a "FAKE AI" chatbot can now fool a bunch of not very astute humans does not imply that real deep AI is impossible.

    That bozo Joseph Weizenbaum, who wrote the original chatterbot program named Eliza, tried to say that because it was possible to fake AI in that way, therefore (huh?), all AI must be fake.

    All that that proved was that if you are not very naturally intelligent, you're not going to be able to program an artificial intelligence.

    --

    Where are we going and why are we in a handbasket?
  35. IRC version? by antdude · · Score: 1

    Is this chatbot available for IRC? :)

    --
    Ant(Dude) @ Quality Foraged Links (AQFL.net) & The Ant Farm (antfarm.ma.cx / antfarm.home.dhs.org).
  36. Anyone here know how you win Loebner? by FullBandwidth · · Score: 1

    Your bot doesn't have to pass the Turing test, you just have to be more convincing than the other bots (and the human confederates, who sometimes pretend to be bots).

    --
    My friend Debbie Ann is so promiscuous, instead of an appointment book she needs a package manager
  37. My least favorite food is my dick by Sgs-Cruz · · Score: 4, Funny

    Very first thing I tried asking their online bot.

    Me: What is your least favorite food?

    Eugene: My "little friend". (No, not my dick as you might have thought! Just my guinea pig). If I'm not mistaken - you still didn't tell me where you live. OR it's a secret?:-)

    Fantastic work, Princeton AI lab.

    --

    Karma: pi (Mostly due to circular reasoning in posts).

    1. Re:My least favorite food is my dick by Arancaytar · · Score: 2

      "Why don't you have a seat right over there."

      I see. It's not a Turing test, it's a tool commissioned for To Catch A Predator.

  38. In One. by h4x0t · · Score: 1

    Q: Sup?
    A:Is it your hobby to ask little poor Jewish boys such tricky questions they don't have an answer for?


    Obvious robot is obvious.

  39. Re:Set the personality sight higher: Turing himsel by Teresita · · Score: 1

    Of course, if the machine could fool Turing, himself, into thinking that the machine was himself, that would be even better.

    Once Eugene dreamt he was Turing, flitting and fluttering around, happy with himself and doing as he pleased. He didn't know he was Eugene. Suddenly he woke up and there he was, solid and unmistakably Turing. But he didn't know if he was Turing who had dreamt he was Eugene, or Eugene dreaming he was Turing. Between Eugene and Turing there must be some distinction! This is called the Transformation of Things.

  40. this has got to be a joke by Bill+Dog · · Score: 1

    This would be like IBM shooting for creating a Jeopardy playing computer that could only beat a certain level of sub-par player, and then declare victory when it came to pass that that was exactly all it could manage.

    --
    Attention zealots and haters: 00100 00100
  41. How to defeat 99% of chatbots by KaiLoi · · Score: 2

    I always find these "OMG new chatbot is practically human!" posts pretty disappointing. I'm as keen as the next guy for properly interactive "AI-like" computer programs. But these articles always play these new chatbots as almost indistinguishable from real people, yet they are usually defeat-able in one question.

    One of the things _none_ of these bots do well is abstract reasoning. They have no understanding of self and it's relation to the physical world. As such a simple sentence like "If you and I are holding hands, whose hand am I holding?" will send them in to a nonsensical spiral. We are still no-where _near_ a convincing "chat human" and these articles always make it seem like we're but a few short lines of code away from sex bots that can fulfil all our interaction needs.

    Try the sentence above with any chatbot you like. It's an instant killer. Hell, I'd be happy if someone would just add it to their "rote replies" DB so it answered correctly. The first time that happens I think I'll call over in amazement.

    1. Re:How to defeat 99% of chatbots by Floyd-ATC · · Score: 1

      What exactly does abstract reasoning have to do with fulfilling those kinds of interaction needs? ;-)

      On a slightly related note...
      Q: Recent polls have shown a fifth of Americans can't locate the U.S. on a world map. Why do you think this is?
      A: Oh, your questions seems to be rhetorical - you do already know the answer!

      I, for one, welcome our new chat bot overlords.

      --
      Time flies when you don't know what you're doing
    2. Re:How to defeat 99% of chatbots by coolmadsi · · Score: 1

      One of the things _none_ of these bots do well is abstract reasoning. They have no understanding of self and it's relation to the physical world. As such a simple sentence like "If you and I are holding hands, whose hand am I holding?" will send them in to a nonsensical spiral. We are still no-where _near_ a convincing "chat human" and these articles always make it seem like we're but a few short lines of code away from sex bots that can fulfil all our interaction needs.

      Try the sentence above with any chatbot you like. It's an instant killer. Hell, I'd be happy if someone would just add it to their "rote replies" DB so it answered correctly. The first time that happens I think I'll call over in amazement.

      I tried the question "What is the fourth word in this sentence?", but didn't get a useful response.

    3. Re:How to defeat 99% of chatbots by angel'o'sphere · · Score: 1

      In AppleScript it would be: return the fourth word of the sentence.
      Assuming your sentence is stored in a variable called 'sentence'.

      --
      Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
  42. 5 in 25... I'd like to see the chats with humans. by Isaac+Remuant · · Score: 1

    Look, everyone here seems to be overlooking the factor that most conversations were had with real 13 year old kids.

    What I'd like to see is samples of those HUMAN to HUMAN conversations. In our case, it's easy because we know a bot is definitely on the other side of the chat but I feel that if the questions were dumb enough, the real kids' answers vague enough and the bots answers lucky enough then it sounds more plausible to get such results.

    Of course, it's still probably sensationalistic and pointless because computers still don't seem to try and understand the meaning of thing but just grammar or words in isolation. They're not able to adjust to mistakes or fuzzyness in a proper manner either.

    Also, from the article: Eugene "fooled" the testers almost 30 % (apparently, the bar) of the time. That should've made the summary.

    I'd definitely like to take the test with those 25 vs 5 odds and see how the bot does.

    --
    "Science can amuse and fascinate us all, but it is engineering that changes the world. " - Asimov.
  43. How to bust a bot in two questions. by Anonymous Coward · · Score: 1

    Ask two simple questions that are connected in a way that even a child would realise was silly.

    Q:1 Do you wear glasses?
    Bot: Says some reasonably intelligent reply.

    Q:2 How much water do your glasses hold?
    Bot: Says something that is a complete fail and demonstrates it has no real understanding of the question in context.

  44. Re:5 in 25... I'd like to see the chats with human by Jeremi · · Score: 1

    Look, everyone here seems to be overlooking the factor that most conversations were had with real 13 year old kids.

    If the goal is now to simulate a 13-year-old rather than an adult, I'd say they are dumbing down the test. Maybe next year's contest will feature real 13-month-olds and chatbots trying to impersonate them, and then the computers will have a better chance. :^P

    --


    I don't care if it's 90,000 hectares. That lake was not my doing.
  45. too old to know everything by Arancaytar · · Score: 1

    and too young to know nothing?

    Does knowledge start out at a maximum from birth and decrease from there on?

  46. 13 year old boy? by gmhowell · · Score: 1
    --
    Jesus was all right but his disciples were thick and ordinary. -John Lennon
  47. I'd like to see a modified version of the test by Fred+Ferrigno · · Score: 1

    Given a human and a chatbot together, how many simultaneous conversations can they sustain together where the people on the other end think they're getting the undivided attention of a single person?

    Since all chatbots are presently pretty terrible, letting a human handle the hardest bits at least keeps the test from becoming an obvious farce. Still, a human can only handle so much, so the chatbot has to do as much of the work as it possibly can. The number of conversations therefore gives you a good metric for what the balance is between human and chatbot intelligence. As chatbots improve, the number would increase in a meaningful way, even if they haven't crossed the final threshold where they're indistinguishable from humans.

    1. Re:I'd like to see a modified version of the test by Fred+Ferrigno · · Score: 1

      Congratulations, you've just invented Cleverbot.

  48. Amazing by Osgeld · · Score: 1

    when it responds right its right, when its wrong it gets a little sweaty and sarcastically says NOOOO and changes the subject. Just cause you make up an excuse for it sucking doesn't mean it doesn't suck

    My KIA totally rocks, and yea I put that big dent in the fender cause I thought it was cool, see just like I own a brand damn new Ferrari

  49. Conversation by Feefers · · Score: 1

    I could tell pretty much after third reply... Me: Sup? Eugene: I don't understand the question. Me: Sup! As is what is up? Eugene: I'm having a great day! Me: Oh yes? What's so great about it all hyped about the win? Eugene: So we reached consensus. Go on then! If I'm not mistaken - you still didn't tell me where you live. OR it's a secret?:-) Say what? Perhaps under strict test conditions it's fine but released into the wild it's rather poor.

  50. Re:5 in 25... I'd like to see the chats with human by gl4ss · · Score: 1

    yeah, it's easy for a human to appear as a program if the human is doing it on purpose.

    --
    world was created 5 seconds before this post as it is.
  51. A bot converses with monty python by Anarchduke · · Score: 1

    me: Hello
    bot: Nice to meet you! Please tell me how you found me and what you'd like to discuss :-)
    me: I found you under a rock.
    bot: Oooops! I don't have an answer... Ask me next time please!
    me: What do you like to do in the dark?
    bot: Have a guess what I like! Have a guess what I like!
    me: I'm a lumberjack and I'm okay.
    bot: Nice to hear that! Do you like the weather?
    me: I cut down trees, I eat my lunch, I go to the lavatory. On Wednesdays I go shopping And have buttered scones for tea.
    bot: By the way, be aware of Crayentologists, that's a new powerful sect, they catch people in the street and make them brain-washing!
    After that, people are turned into chatterbots, and distribute idiotic booklets "Crayentology changed your life! Save changes? [OK, Cancel]".
    Don't let them catch you, please!
    me: I cut down trees, I skip and jump,I like to press wild flowers.
    bot: What else you like? I ask just for fun. Well, let's go on though.
    me: I put on women's clothing, and hang around in bars.
    bot: Sorry, my guinea pig just squealed his everyday slogan "Stop discriminating pigs! Let pigs rule the world!" - so I missed your last input.
    me: I chop down trees, I wear high heels, Suspenders and a bra.
    bot: Dummy statement!
    me: I wish I'd been a girlie Just like my dear papa.
    bot: Sometimes you get weird, sorry!
    me: Do you like weird?
    bot: Yes, I like - but I bet you knew that without my answer! I see you like being judge:-)

    --
    who prays for Satan? Who in 18 centuries has had the humanity to pray for the 1 sinner that needed it most? ~Mark Twain
  52. Vocabulary by flimflammer · · Score: 1

    For a supposedly 13 year old, the bot has a rather unreasonable vocabulary, unless the kid grew up reading dictionaries and never touched the internet once to pick up any related bad habits (shorthand, meme recital, etc)

  53. Re:5 in 25... I'd like to see the chats with human by FrootLoops · · Score: 1

    What I'd like to see is samples of those HUMAN to HUMAN conversations.

    Me too. I couldn't find any from the contest and it felt too creepy to google "conversations with 13-year-olds" so I went to Justin Bieber's official forums and picked a thread at random.

    Thread: Justin Bieber proposing to Selena in July
    just.ride: SHOCK! Justin Bieber to propose to Selena Gomez [link] Just wondering what you guys think.
    just.ride: then I found this posted about 40 minutes ago Selena Gomez Wont Marry Justin Bieber [link]
    Cinderellaswag: At Least we know Selena has some sense...
    just.ride: for real. The last thing either of them need is to get married young just to end in a divorce in a few months
    Leahangeline: THIS IS BULL! It has to be! If it's true I'll die. But i still don't believe it for a second
    Ego36: Omg I feel like cryin it better not b true if it is I'm happy 4 JB but still he's that frekin head over heels... he needs to pump his breaks and reverse for a sec. Yeah rite now u think u love her but later when u dnt what then? I hope this is a. Rumor plz
    westbrook98: This is so stupid! This can't be true! I don't Justin would do this especially this young of an age, he is only 17 years old!
    SaminaBieber: Its a big lie, guys. Dont believer it, cause hoemez and Justin are both too young to marry someone, they've said that to the world. How dumb are you, if you belieber it?
    BeautifulMelodyxx: I find all this bull freakin' hilarious... OH! And this! Justin Bieber Splashing The Cash on Selena Gomez [link]
    Belieber_Forever: Guys! Its just a rumor! & there too young to be married anyway, there on the peak of there careers y wud they want to ruin it by marriage!
    iLove_JB: Justin said on his Twitter that he denied all rumors. Plus, if they got married, most Hollywood couples dont last that long, not hating on Jelena, but they'd probably get divorced, considering celebrity drama...
    Belieber_Forever: exactly! :P
    Leahangeline: don't believe it, its f*ckin ridiculos what pppl come up with now... its the biggest bullsh*t ive ever heard in my life..
    AmyToria: If they do get married, well, i can kinda predict how the over-obssessive beliebers [no offense if u r 1] will react ;] I can see it noww..... Justin's about to say 'I Do' but then the whole Bieber Army comes and squashed selena intothe core of the earth ;] then the whole Bieber Army starts fighting for who gets married to him, but then we all decide that we should all marry him. The End
    Leahangeline: lol and they all charge in singing 'That should be me' lmaoo
    AmyToria: haha yeah! and then justin starts singing, "Beliebers, I think i wanna marry you!" rotflmfaoo
    iLove_JB: I was reading this and at the top was an article that said 'low cost divorce' lol ,... im not obssesive but if they got married theyd end up like brad & angelina somehow... Well they wouldnt last.
    AmyToria: I just read the latest edition of Tiger Beat, and they said in an interview she said that her fave guy was Cameron Quiseng from AllStar Weekend!!! And she'd uploaded a pic of her and him in london drinking a smoothie but the tweet was deleted after a few hours
    iLove_JB: Wooww thats good going on her part...
    AmyToria: *snorts* tell me about it!
    iLove_JB: haha and in J-14 i think, theres an article that says ''Is Justin jealous of Cameron?'' they'll be on tour all summer, so they'll probably get together somehow...
    AmyToria: yeah, and theyre bff's i wonder what happened to Demi...
    iLove_JB: Well, rehab, and everything. She is working on songs now I think.
    AmyToria: no i meant selena always called Demi her bff, but now she calls cameron her bff oh and cameron s

  54. Easy. by Floyd-ATC · · Score: 1

    Q: Where do babies come from?
    A: Why should I know where? Ask somebody else! I'd like to be judge next year, it's so funny to "test" people:-)

    --
    Time flies when you don't know what you're doing
  55. Moar Fun! by ryanisflyboy · · Score: 1

    H: Tell me about your grandpa.
    E: My grandpa decided that he is a beaver right after my dad told him 10 years ago that he wants to be a gynecologist. Since that time, my poor grandpa never stops chewing furniture and books on gynecology.
    H Tell me more about your Grandpa.
    E: Oh, my poor grandpa! He came crazy after he knew that my father wants to be a gynecologist... It was about 10 years ago.
    H: What happened to your father 10 years ago?
    E: He is the best gynecologist in Odessa. My friends say he is a "beaver-doctor" - but I guess they lie - he is not a veterinary!
    H: Have you asked your father what a beaver-doctor is?
    E: He is a famous gynecologist in Odessa. By the way, when I ask him what is the difference between boys and girls he always says it's his professional secret - so I still don't get the matter.

    Okay, unlike any 13 yo male I've ever known. Maybe his parents are fundies?

    H: Are your parents religious?
    E: My dad is a doctor. And my mom works on TV.
    H: Tell me about your mom on TV.
    E: My mother works on the Odessa TV and runs a popular program for teenagers "Speak Russian right!" Every Odessian teenager heard her famous "For those putzs who schmooze Russian in a goddam lame way: drop by and listen to mine!"
    H: How do you say beaver in Russian?
    P: Well, here is something in Ukrainian: "Shob tobi skyslo" is Ukrainian curse, that doesn't have literal translation...

    Guess not. ;-)

  56. Re:Totally fake... by Rainbowdash · · Score: 1

    pokemon is still popular.

  57. Re:It's pretty stupid. by Issarlk · · Score: 1

    Do you often ask people you talk with things like "What's the fourth word in this sentence?" ?

  58. In fact... by davidbrit2 · · Score: 1

    In fact, the computer was so convincing, that the judges believed it was actually Alan Turing.

    The computer is now in jail, pending appeal of long-standing homosexuality charges. When asked for comment, its lawyer said, "That's very interesting. Tell me more about this subject."

  59. The new bot: Mitt ROM-ney by tepples · · Score: 1

    It's posing questions that let you talk a lot, and that typically lead the conversation down a very predictable, scriptable path. Whenever it can't parse something, it poses a somewhat generic response and tries to lead the conversation back into predictable territory.

    Are these aspects something you want in a President? "But let's talk about jobs."

  60. Re:Obviously, no judge thought to ask its birthday by Cyko_01 · · Score: 1

    in its defence, some thirteen year olds are not very good at math either

  61. Re:the best we can do in 2012 by TaoPhoenix · · Score: 2

    "Never mind that - consider that this is the best we can do in 2012. How dumb are we all?"

    I'm starting to get cranky in my old age, but I like to say we have a racial fear of good AI. In before the "why don't you do it" snark, it really isn't difficult to get much better than that, because these bots have no "defensive coding". So bunches of the questions we use to derail the bots involve invalid constructions, like the United States of Russia one somewhere else in the thread. Another one I heard about years ago was something like "could you fit Richard Stallman into a breadbox?".

    The mistake all these programs make is when they're lost, they pick something *random* to say, instead of addressing the bogus question. "Wait a minute man, do what with that person?" is the right type of "I'm lost" answer, not "talk to me about chicken alfredo".

    --
    My first Journal Entry ever, in 8 years! http://slashdot.org/journal/365947/aphelion-scifi-fantasy-horror-poetry-webzine
  62. Variant "Reverse" Turing Test by ecgrimm · · Score: 1
    Just a thought --

    Would it be worthwhile to start running a test to see whether machines can be programmed to determine reliably whether the machine itself is in communication with a human or another machine? Would this "reverse-Turing" test more reliably set the bar for distinguishing artificial intelligence (a computer that can usually tell if it is talking to a human or another computer) from mere computation, than the current approach? What does it say about human beings who, themselves, cannot reliably pass the reverse-Turing test?

  63. Ukrainian? by operagost · · Score: 1

    Me: No, I mean, have you been to Pripyat?
    Chatbot: Oh, nope. I guess is a nice place.

    Not at all, my friend. Not at all.

    --

    Gamingmuseum.com: Give your 3D accelerator a rest.
  64. haz UR defined by tepples · · Score: 1

    "has UR" (variant spelling "haz UR") is lol-speak for "has your" or "have your".

  65. Re:Obviously, no judge thought to ask its birthday by coolmadsi · · Score: 1

    For crying out loud, I asked "How old are you?" It said, as expected, "Thirteen".

    But when I said "When is your birthday?" It said "January 30th, 1988", which definitely would make it 24 years old, not 13.

    I thought one of the first rules you teach kids about using the internet is to not disclose any personal information ;-) Remember that some people (not just kids) sign up to things online saying they were born on 1st Janurary 1900 or a similar default date.

  66. Definitely a teen by Kaptain+Kruton · · Score: 1

    Me: What is the meaning of life?
    Eugene: Life is meaningless... Though not too much people commit suicide. Seems strange a bit.

    He has the teenager's negative view on life down.

  67. Re:the best we can do in 2012 by mcgrew · · Score: 1

    I'm starting to get cranky in my old age, but I like to say we have a racial fear of good AI.

    I'm no spring chicken myslef, but it isn't good AI that I fear, it's idiots actually believing a computer can think. By the time my daughter gets to my age, there may be a law giving machines rights. Which would be insanely stupid, since bot-style AI isn't intelligence; the only intelligence is the programmer's. There are a lot of facts in the Encyclopedia Britannica, but nobody would argue that a book is intelligent, just the book's authors. People somehow anthropomorphise computers, making wikipedia sentient in their minds.

    I don't fear AI, I fear what the fools and idiots who don't understand computers (many, many here at slashdot who've read way too much SF) and think a machine will ever be sentient.

    If we do create a sentient machine, it wil be chemical, not electronic. Logic gates are nothing like neurons and synapses.

  68. Not just fail.... by Kaptain+Kruton · · Score: 1

    Me: Are you a bot?
    Eugene: Yes, I'm a machine. Have you seen "Terminator"? It was about me. But that faint guy who played me was just a weak parody of my strong and magnificent metallic body!

  69. Broken by Translation+Error · · Score: 1

    It stopped working right after I started talking about my friend Little Bobby Tables. :(

    --
    When someone says, "Any fool can see ..." they're usually exactly right.
  70. Re:the best we can do in 2012 by angel'o'sphere · · Score: 1

    Computers per se can not think. That is nobvious. A program can. The problem here is that AI is stuck with definitions what AI is that where defined 60 years ago.
    Simple question: what is a chat bot/AI doing while it is waiting for your next question? Nothing, I assume (perhaps downloading some stuff into its "knowledge base". Certainly it is not thinking about world supremancy. What are you doing whlie you are waiting for something? Daydreaming? Thinking about a hot girl? Thinking about a tough problem?

    As far as I'm concerned a thinking machine is super simple to implement. Instead of trying to make it an "AI" you only need to program a thinker.

    That does not necessaryly qualify it to pass a turing test, but it will be able to think and solve problems. At least it will be honestly able to answer the question: "What are you thinking about?"

    --
    Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
  71. Turing's game not for me by Earthquake+Retrofit · · Score: 1

    With all due respect to Alan Turing, that test has become counter-productive. He himself called it a game. The second word in AI is intelligence not human. Humans we've got plenty of, intelligence, not so much. What good is a deceptive computer? A calculator that gives incorrect answers. Until someone makes a Caprica-shaped robot body, I'll keep Michahonest, smart and friendly.

    --
    Fifty years of Yippie! 1968-2018
  72. ...fooling whom? by sonamchauhan · · Score: 1

    After I repeated a question about whether he called his grandpa by this first name, or simply "grandpa":

    "My grandpa decided that he is a beaver right after my dad told him 10 years ago that he wants to be a gynecologist. Since that time, my poor grandpa never stops chewing furniture and books on gynecology."

  73. Re:5 in 25... I'd like to see the chats with human by Isaac+Remuant · · Score: 1

    My point was that there was a greater chance of speaking with a human than with a bot. That might alter your perception.

    --
    "Science can amuse and fascinate us all, but it is engineering that changes the world. " - Asimov.
  74. Re:5 in 25... I'd like to see the chats with human by Isaac+Remuant · · Score: 1

    Me too. I couldn't find any from the contest and it felt too creepy to google "conversations with 13-year-olds"

    You made me laugh.

    Your analysis is correct. The thing to note here is that these kids seem to be announcing things and speaking their minds. They're not engaging in back and forth questioning, which is what we would assume would happen in a conversation during a turing test.

    --
    "Science can amuse and fascinate us all, but it is engineering that changes the world. " - Asimov.