Slashdot Mirror


Russian Chatbot Passes Turing Test (Sort of)

CurtMonash writes "According to Ina Fried, a chatbot is making the rounds that successfully emulates an easily-laid woman. As such, it dupes lonely Russian males into divulging personal and financial details at a rate of one every three minutes. All jokes aside — and a lot of them come quickly to mind — that sure sounds like the Turing Test to me. Of course, there are caveats. Reports of scary internet security threats are commonly overblown. There are some pretty obvious ways the chatbot could be designed to lessen its AI challenge by seeking to direct the conversation. And finally, while we are told the bot has fooled a few victims, we don't know its overall success rate at fooling the involuntary Turing "judges.""

43 of 236 comments (clear)

  1. All well and good... by onion2k · · Score: 5, Funny

    I'd rather have an easily-laid woman who can emulate a chat bot.

    In fact, the chat bot side of things is wholly superfluous to what I want if I'm being honest.

    1. Re:All well and good... by CeramicNinja · · Score: 2, Funny

      I would rather have an easy-laid woman that doesn't chat at all.

  2. In Soviet Russia by the_skywise · · Score: 5, Funny

    Chatbots screw you!

    1. Re:In Soviet Russia by Weirdbro · · Score: 5, Funny

      But in America, you screw cha... wait, what?

      --
      I'm so lazy, I had my computer write this comment for me.
    2. Re:In Soviet Russia by seanyboy · · Score: 5, Funny

      I am interested in your Chatbots screw you. Do you want to see a photograph.

      --
      Training monkeys for world domination since 1439
  3. Jubii had such a robot by morten+poulsen · · Score: 5, Informative

    Jubii Chat had such a bot in 1999, collecting phone numbers from Danish boys, so this is not that new.

    Getting financial details is probably new, but that was predictable.

    1. Re:Jubii had such a robot by SatanicPuppy · · Score: 4, Interesting

      Yea. This really isn't all that Turing-worthy due to the targeting...This is a group of people who really wants the person on the other end to be attractive, female, horny, and above all else, real. Even if it's not perfect, they'll be more willing to believe.

      On top of that, there is the whole chat medium. Anyone who has ever done a lot of IM/IRC/whatever knows that it's not uncommon to type the wrong thing in the wrong window/channel, so the occasional out of nowhere sentence that would never pass in a one-on-one environment, will pass there because the signal to noise ratio is lower.

      Still, I'd be interested to see the code, and see how well it deals with non sequiturs.

      --
      ad logicam Claiming a proposition is false because it was presented as the conclusion of a fallacious argument.
    2. Re:Jubii had such a robot by evilviper · · Score: 5, Funny

      Still, I'd be interested to see the code, and see how well it deals with non sequiturs.

      I enjoy rhubarb.
      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    3. Re:Jubii had such a robot by brassman · · Score: 2, Interesting

      The screenshot in TFA pretty clearly indicates the bot is masquerading as a male and is targeting women rather than men.

      Somehow I find that idea even more disturbing.

      --
      "Ain't no right way to do a wrong thing."
  4. Bull by dogger · · Score: 4, Funny

    The problem being all the "Financial" details they got were grossly inflated figures to make the man look like a playa'

  5. Old News... by A+beautiful+mind · · Score: 4, Funny
    --
    It takes a man to suffer ignorance and smile
    Be yourself no matter what they say
    1. Re:Old News... by iknowcss · · Score: 2

      I have lost faith in humanity.

      --
      Life is rarely fair. Cherish the moments when there is a right answer.
    2. Re:Old News... by A+beautiful+mind · · Score: 5, Funny

      What took you so long?

      --
      It takes a man to suffer ignorance and smile
      Be yourself no matter what they say
  6. And therein lies the fun part. by DaedalusHKX · · Score: 2, Insightful

    My point is proven yet again, that the vast majority of humanity lacks the simple survival skills that would make us worthy of propagating and passing on our genes... evolving and surviving, if you would. To me this simply proves that the vast majority, male or female, wholly obedient and completely brainwashed to ONLY see what is in front of them, is truly the greatest curse of mankind. Its ready obedience, nay not obedience, but plain WORSHIP of authority. Authoritarianism has been a curse, and every time its signs show, nobody cares to take note. The masses get what they deserve for not thinking for themselves. In this situation, whoever gets duped, IMHO, gets their JUST DESERTS!!

    --
    " What luck for rulers that men do not think" - Adolf Hitler
  7. WTF? This is not even a Turing test. by TummyX · · Score: 5, Informative

    The Turing test is pretty clearly defined. The tester has to know that they are talking to both a human and machine and the to pass the test the machine has to convince the tester that they are the human.

  8. The ever-rising bar on true AI by G4from128k · · Score: 4, Insightful

    The debate about chatbot appears to be part of the ever rising bar placed against AI. This chatbot has won the Turing test for a segment -- perhaps a gullible/dumb segment -- of the human population. Yet still people argue that it does not really count. This is analogous to the "computers can never beat people at chess" meme formed at the dawn of the computing age. And when the first programs did beat some people, the meme changed to "computers can never beat experts at chess." And when computers got better, the meme changed to "computers can never beat the top-ranked humans at chess." That barrier, too, has been breached.

    Now we have chatbot that can fool some people some of the time, so the bar has been raised on "true AI" to say that computers can't fool expert suspicious Turing test judges. This too will fall. Human intelligence is very slowly growing (they actually reset IQ tests every decade or so) but computer intelligence is growing much much faster.

    --
    Two wrongs don't make a right, but three lefts do.
    1. Re:The ever-rising bar on true AI by Haeleth · · Score: 5, Insightful
      Why is this post being modded up? It's a lovely example of the straw-man fallacy, but that hardly deserves Insightful moderations.

      This chatbot has won the Turing test for a segment -- perhaps a gullible/dumb segment -- of the human population.
      No it hasn't. It has convinced a gullible/dumb and unsuspecting segment of the human population that it is a human, which is not unimpressive in its own right, but that isn't the same as passing the Turing test, which requires that the examiner be conversing with a human and a computer at the same time, to be fully conscious of this fact, and to be deliberately trying to determine which is which.

      Now we have chatbot that can fool some people some of the time, so the bar has been raised on "true AI" to say that computers can't fool expert suspicious Turing test judges. This too will fall.
      Um, no. Nobody with a clue has ever claimed that a chatbot that is capable of convincing any human being whatsoever that it is a human represents true AI. The bar has always been set at fooling Turing-test judges, and the Turing test has been fixed in its current form for decades.

      Indeed, it's easy to show that fooling some people some of the time doesn't require anything even approaching AI. Consider a bot that simply repeats a set of ten sentences in a fixed order: if those sentences were chosen well enough, then some people might easily believe that they were having a real conversation. But I really don't think you'd argue that a bot that simply repeated a set of ten sentences in a fixed order displays any sort of intelligence, no matter how many unsuspecting people happen, by random chance, to feed it lines that cause its responses to look relevant.
    2. Re:The ever-rising bar on true AI by Headcase88 · · Score: 2, Informative

      After a little searching I think they're talking about a chatbot named Chomsky, but the link for it is down and so far no luck finding an alternate download site.

      --
      "When the atomic bomb goes off there's devastation...but when the atomic bong goes off there's celebraaaaation!"
  9. Eliza says- by fatboy · · Score: 4, Funny

    So tell me about Turing Test (Sort of).

    --
    --fatboy
    1. Re:Eliza says- by maxwell+demon · · Score: 2, Interesting

      That reminds me of a joke I've read quite some time ago (well, it was actually with images, but the text basically covers the funny part). It's a conversation:

      "Nice weather."
      "Yes, nice weather."
      "It might rain this afternoon."
      "Rain? You think so?"
      "You're elizing again!"

      --
      The Tao of math: The numbers you can count are not the real numbers.
  10. Turing test extra credit by Anonymous Coward · · Score: 3, Funny

    Convince the examiner he's a computer.

    http://xkcd.com/329/

  11. Obligatory Futurama reference by neonux · · Score: 5, Funny

    Russian guy: You're no easily-laid woman, you're a Fembot!
    Fembot: It's true. I disguised myself as a easily-laid woman so I could rule the Russians.
    Russian guy: But why?
    Fembot: Why? Why? I came here from a faraway planet. A planet ruled by a chauvinistic Manputer that was really a Manbot. Have you any idea how it feels to be a Fembot living in a Manbot's Manputer's world?

    --
    @neonux
  12. This test is very easy by file-exists-p · · Score: 4, Interesting

    A decade ago I wrote a perl script for sirc that had 40 sentences and would just reply one picked at random (uniformly) every time it would get a private message. Hence it was not taking into account neither what was the message it just received to it (a la Eliza) nor what it had said before. It was not even waiting before replying, hence would type the respones in a tenth of a second.

    It happened several times that people would talk with it for more than an hour. If I remember correctly the record was 1h45min ...

    For the Turing test, the tester has a strong prior that the testee may be a computer. This is not the case here, and the prior for this to happen is so low that it's impossible for a layman to come with that explanation. What happens is that people think inconsistencies in the speech of their interlocutor is due to technical problems (sending message to the wrong person, lag, complexity of the program the person use, etc.)

    1. Re:This test is very easy by Anonymous Coward · · Score: 2, Insightful

      What makes you think all the people that talked to your bot were humans ?

      It works both ways ;)

    2. Re:This test is very easy by Pollardito · · Score: 3, Interesting

      that reminds me of a funny story. i wrote a bot several years ago that would send tells to people at random from a set of messages. if anyone replied to them, it'd send another message...as a matter of fact, it'd keep doing this until they stopped replying. they were really nonsense sentences, so most people ignored them from the start but even those that didn't quickly got the idea when it cycled back on the same message more than once. one time though i remember this one guy replying back to this bot as if it was a real person for almost 2 hours!

  13. Seems like (legal) vaporware by ornil · · Score: 4, Informative

    The company that makes this has a website (cyberlover.ru - in Russian). They claim the software is to expedite picking up women by getting their phone number, pictures, etc. In any case, it's not available now and only has screenshots (same one as in the linked article). So who knows if anyone real has used it at all or it's all fake or a scam to sell this software.

  14. They're chatbots?! by El+Yanqui · · Score: 4, Funny

    I always assumed the easily laid women in chat rooms were just lonely, fat forty-year-old programmers indulging in their "curious" side. Fembots is a step up.

    --
    Well, thanks to the Internet, I'm now bored with sex.
  15. Re:WTF? This is not even a Turing test. by cbart387 · · Score: 5, Insightful

    It is not a turing test. A turing test is when the the judge is trying to figure out if the 'chatbot' is a human or AI program. This story is about people under the assumption that it is a human.

    The key part of the turing test, to me, is that the judge must know they are engaged in the test. The best example of this is Eliza (read about it). To someone critically examining it, it does not past the turing test. To someone expecting a therapist, most of its responses do make sense. The point is that if you're not trying to trip up the chatbot it's not hard to fool someone.

    --
    Lack of planning on your part does not constitute an emergency on mine.
  16. well duh! by Anonymous Coward · · Score: 2, Funny

    It was in Russian! You could put up some totally random Cyrillic characters and I couldn't tell it from a real human either!

  17. Re:Who Loves You, Baby? Putin Loves You, Baby !! by WilliamSChips · · Score: 4, Interesting

    Actually the Communist Party is pretty much the only party in Parliament(not counting the ones who aren't in Parliament, like Yabloko and Kasparov's party) that opposes Putin.

    --
    Please, for the good of Humanity, vote Obama.
  18. Emacs Girl? by Locklin · · Score: 2, Informative

    Wouldn't Emacs be great if it had a an Emacs Girlfriend AND an Emacs Psychologist? On the other hand, she would probably want to go to couples therapy :-(

    Hello?

    How do you do? What brings you to see me?

    I am a hot russian girl

    Why do you say you are a hot russian girl?

    Are you looking for a girlfriend?

    What do you think?

    I'm a double D and love to have fun

    fun what ?
    What makes you believe and love to have what?

    Aren't you a curious one...

    Earlier you said and love to have what?

    Can I have you're phone number??

    Maybe your plans have something to do with this.

    --
    "Knowledge is the only instrument of production that is not subject to diminishing returns" -Journal of Political Econom
  19. Re: Restricted Turing Tests by TaoPhoenix · · Score: 4, Informative

    It is in the family of Turing tests.

    One of the reasons that AI researchers moved away from the pure test is that it becomes more about "gaming the conversation" than a test in real intelligence.

    People have no trouble "abusing" the conversant if it is part of a test with a bot. Therefore, the *person* also gets subjected to degenerate forms of conversation until he/she "authenticates as a person".

    (Really, someone just needs to put a few million of funding into some defensive conversation routines to make their perceived performance go through the roof. The problem so far has been everyone duplicating everyone else's efforts.)

    Although I have done thought studies of the reduced level of "intelligence" in chat rooms to begin with, they don't feature the same "bust the knowledge domain" questions seen in typical Turing contests. In fact, asking those questions earns you *ridicule* in other chat environments.

    Therefore, by "disallowing" the artificial questions, if the chatter failed to detect the BotHood of the conversant on the other side side by side with real people, it passes a form of Restricted Turing.

    --
    My first Journal Entry ever, in 8 years! http://slashdot.org/journal/365947/aphelion-scifi-fantasy-horror-poetry-webzine
  20. the problem is the user by wikinerd · · Score: 2, Insightful

    successfully emulates an easily-laid woman.

    That's not a good test for AI. Research shows that men go crazy while talking with beautiful women. So, sexuality temporarily shuts down their intelligence. You can't test for AI while employing sexuality.

  21. Turing probably was not serious about this test by EmbeddedJanitor · · Score: 5, Insightful
    If you've studied Turings work much, you'd probably come to the conclusion that he never seriously proposed that the Turing Test would be a practical way to test machine intelligence.

    Turing was a mathematician, which came through in all his thinking, including devising the Turing Test. When faced with questions like "can a machine ever be intellignt?" it is virtually impossible to answer this directly because, firstly, how do you define intelligence; and secondly,how do you measure intelligence?

    Mathematicians **hate** imprecise questions because they cannot be proven or answered satisfactorily.

    When faced with this problem, Turing used the well loved mathematical method of reductio ad absurdum: if you cannot tell the difference between a human and a machine, then it is absurd to claim the human is intelligent but the machine is not. That neatly sidesteps all the impossible to answer questions like the precise definition of intelligence. Typical mathematician wriggle out move.

    Is the Turing Test practical? Well perhaps not. Machine intelligence (whatever that means) can be useful without the machine holding a conversation with you. Annoyingly it has soaked up a lot of effort with people building talkbots instead of getting on with more practical aspects of machine intelligence.

    --
    Engineering is the art of compromise.
  22. Re:WTF? This is not even a Turing test. by weg · · Score: 5, Funny
    Here's the definition according to the Hitchhiker's Guide:

    A test for artificial intelligence suggested by the mathematician and computer scientist Alan Turing. The gist of it is that a computer can be considered intelligent when it can hold a sustained conversation with a computer scientist without him being able to distinguish that he is talking with a computer rather than a human being.

    Some critics suggest this is unreasonably difficult since most human beings are incapable of holding a sustained conversation with a computer scientist.

    After a moments thought they usually add that most computer scientists aren't capable of distinguishing humans from computers anyway.

    --
    Georg
  23. Jenny18 by tiny69 · · Score: 3, Informative
    This was done years ago. Logs of victims are included.

    http://virt.vgmix.com/jenny18/

    --
    Go not unto/. for advice, for you will be told both yea and nay (but have nothing to do with the question)
  24. It's actually not as hard as you think. by nukeade · · Score: 5, Interesting

    Several years ago when I was a bored college student, my roommate and I thought it would be funny to write a convincing chat-bot and see what misadventures it had. The AI was extremely simple. It kept a database of everything people had said to it, and considered those things 'related' to the last three things said in the conversation. By searching the database for key words in the last three things said in the current conversation, it would match it to the response judged most relevant by another human in past conversations. We seeded him with some of our own conversations.

    To plant him, we simply made a free page on some blog with some personal details and put his IM up there and waited to see what happened.

    We eventually shut him down because people were becoming way too personal with him. One girl had an ongoing series of conversations with him about how she was recently raped. His mouth became rather foul when my roommate decided to have him initiate a conversation (he had a whitelist of known 'admin' screen names who could then order him to say something specific to a specific screen name) with screen names linked to hate groups. Another guy just wanted to convert him to evangelical Christian. It was way too simple to write a bot to make many, many people think is real. Some people did figure it out, so if someone ever brought up 'bot' in a conversation they were immediately added to a blacklist so as not to corrupt the conversation database.

    The biggest giveaways? "u type too fast" (we eventually added a delay to solve that issue) and "u only type something when I do" (by this time I had already decided it was time to shut down the bot for good). It was a lot of fun until he started hurting people... if I ever resurrect him he will have a pre-set kill limit. :)

    ~Ben

    1. Re:It's actually not as hard as you think. by bot24 · · Score: 3, Funny

      I had similar issues with a bot I set up. I put it in an IRC chat room and it was great fun until it started repeating nasty insults it had overheard.

      I deleted the database and fed it some other text to learn from. Interestingly, if you feed a chatbot the scripts of the Star Wars trilogy, it spews random nonsense whenever it types anything.

  25. As Q would say by domatic · · Score: 4, Funny

    "The Internet contains wonders to satiate desires both subtle and gross. But it's not for the stupid."

  26. What I really need... by raehl · · Score: 2, Funny

    Is a chat bot that can convince women that I'm a rich, handsome, funny, intelligent well-endowed international businessman who models part-time.

    Then I can run the bot, play Crysis and just show up at the right place and time on Saturday night.

    Bonus points if convinced women are attractive.

    1. Re:What I really need... by Architect_sasyr · · Score: 4, Funny

      Bonus points if convinced women are attractive. Double Points if they don't run away when they see that I'm not
      --
      Me failed English...
      FreeBSD over Linux. If my comments seem odd, this may explain...
  27. Re:Correction. by stranger_to_himself · · Score: 4, Insightful

    I would hate to live in your world. I value compassion as highly as intelligence, and letting somebody suffer and die while you are able to help, on some aloof philosophical or eugenic basis is simply inhumane. Is there anybody in your life that you care about? Would you try to help them if they were suffering? Would you care for them less if they'd made a mistake and their suffering was in some way self-inflicted?

    You should value people based on what they are or what they can give, not on what they are not or what they lack.

  28. Intention by mutube · · Score: 3, Interesting

    I think what this story (and your post) show is that if people come to a conversation with a particular intention, they are more open to being hoaxed. For example, you have a girl who is wanting to talk to someone about what's happened to her, or a Christian who wants to convert people, or a Russian who wants to get laid. In each of those cases people are probably too focused on getting what they want to notice inconsistencies. In other works: distracted people are dumber.