Slashdot Mirror


The Profoundly Weird, Gender-Specific Roots of the Turing Test

malachiorion writes: Alan Turing never wrote about the Turing Test, that legendary measure of machine intelligence that researchers claimed to have passed last weekend. He proposed something much stranger — a contest between men and machines, to see who was better at pretending to be a woman. The details of the Imitation Game aren't secret, or even hard to find, and yet no one seems to reference it. This article explains why they should — in part because it's so odd, but also because it might be a better test for 'machines that think' than the chatbot-infested, seemingly useless Turing Test.

27 of 136 comments (clear)

  1. Wow by Anon-Admin · · Score: 3, Informative

    That would be a hard test. Most guys can not even pull it off. Lord knows I have seen a lot of guys online trying to pretend to be women who just can not even get the basics down.

    1. Re:Wow by Tablizer · · Score: 4, Funny

      Some vending machines have the best impressions of women: take your money for nothing in return and then pretend like nothing happened ;-)

    2. Re:Wow by gnick · · Score: 5, Funny

      I have one wife, one ex-wife, one mother, one step-mother, one sister, one step-daughter, and more non-immediate female relationships/acquaintances than I care to enumerate. ANYONE could fake a woman in a chat with me, because from experience, I have no idea what to expect.

      --
      He's getting rather old, but he's a good mouse.
    3. Re:Wow by Anonymous Coward · · Score: 2, Interesting

      There's a lot more to it. Women use different colloquialisms than men do.

      I was at a conference a few months back where one of the keynote speakers was a MTF. If I closed my eyes, and just went on words I would have never have known they were MTF as they sounded completely male from the tones and phrases used - the colloquialisms of being male, and that's a hard thing to relearn.

    4. Re:Wow by gstoddart · · Score: 3, Insightful

      Wow, neither my mother nor my wife are the crazy irrational beasts that I keep hearing about. As far as I can tell, my sister in law and my cousins, also not crazy irrational people. Most of my exes, also not crazy irrational.

      OK, I had a girlfriend in highschool who was.

      Either I've been lucky, or women aren't these un-knowable entities everyone keeps claiming.

      Though, my brother did date his share of crazies, and an uncle's ex-wife was definitely crazy ... but in a general crazy sense, not so much with the "crazy because she's female" sense.

      Then again, I'm hardly famous for my insights into individual people. :-P

      --
      Lost at C:>. Found at C.
    5. Re:Wow by Charliemopps · · Score: 3, Interesting

      That would be a hard test. Most guys can not even pull it off. Lord knows I have seen a lot of guys online trying to pretend to be women who just can not even get the basics down.

      I disagree. I used to be pretty heavy into MMOs prior to WOW ruining everything. I was one of the few that didn't have a problem having a female character... and I got hit on CONSTANTLY. Seriously, my female characters would randomly receive gifts via mail or in person and I wasn't even remotely trying to pretend I was female. MMO dudes are just that desperate, they dont care to check if you're really female or, even if you are, if you're actually attractive in real life. And we're not talking about healing potions... we're talking stuff that cost hundreds of real world dollars. It was so funny it became a running joke in my guild who started passing around pictures of both models and ugly women to entice, shame or even enrage my "suitors" I'd even put 'NOT A CHIC' in my profile but to no avail. It really opened my eyes to just how desperate some people are.

      Nowadays it doesn't seem as bad. I think there are either more women into MMOs...

    6. Re:Wow by Jeremy+Erwin · · Score: 2

      Actually, some men are fairly practice as pretending to be women in the context of (online) sex, but probably are less familiar with pretending to be women in other contexts.

      I put on my robe and wizard hat.

    7. Re:Wow by Anon-Admin · · Score: 2

      Being able to answer simple questions, ones that every girl learns by age 13.

      Things like references to there 28 day cycle. I have commented that someone must be in the first 7 days of 28 and had the person in chat ask what I meant. When I replied "You know, your 28 day cycle?" I have been asked "What? I dont understand. 28 days of what?"

      Most guys when asked their favorite color of lipstick reply with RED. Hint, there is no red. There is "Wild Orchid" and "Ruby" but no lipstick is just RED

      You can also ask about pantyhose sizes, panty sizes, dress sizes, Hair colors, etc, etc. Lots of things that guys pay no attention to.

      Then you get to the more obscure stuff like sex during a period tends to relieve cramps, Women will eat something before a first dinner date because the date is about the conversation and not the food. Heck if she gets into Sexting you can really toss some fun stuff in like descriptions of what you are doing to her labia or how you are pressing her cervix. Then watch to see how they reply, do they even know where those parts are?

      The joy of growing up with 2 sisters, having two daughters, a wife, and a girlfriend. You learn a lot about women. lol

    8. Re:Wow by Captain+Splendid · · Score: 3, Insightful

      You're not lucky, you just have a broader range of human experience.

      The sad truth is, all us humans are a little crazy (aka human). It's just only seen as a bad thing if you have a vagina.

      --
      Linux, you magnificent bastard, I read the fucking manual!
    9. Re:Wow by gstoddart · · Score: 2

      furiously scribbles down notes

      --
      Lost at C:>. Found at C.
    10. Re:Wow by lgw · · Score: 2

      Remember that turning worked during the war with the 40s equivalent of geek girls - intelligent, driven, not shrinking violets. He wasn't talking about that shallow crap. He was talking about the fact that in the 40s even geek girls had a quite different perspective than men.

      So, the bot needed to not only pass as human, but have a sufficiently deep understanding of the human condition to know what different sorts of answers to everyday questions a man and a woman would give, without simply being a 40s stereotype.

      But I disagree - I don't think an understanding of the human condition specifically is in any way needed for sapience or self awareness, but an broader sort of awareness as one member of society. What's needed (if we discard the supernatural) is the ability to model the world (including the social aspects) abstractly and make decisions based on mentally evolving that model to see the likely outcomes of choices - as opposed to following a set of rules.

      --
      Socialism: a lie told by totalitarians and believed by fools.
    11. Re:Wow by sir-gold · · Score: 2

      A recent study of World of Warcraft players showed that male players who played as female avatars had a subconscious tendency to adopt female speaking characteristics.

      http://www.slate.com/blogs/fut...

      "When selecting female avatars, these men strongly preferred attractive avatars with traditional hairstyles—long, flowing locks as opposed to a pink mohawk. And their chat patterns shifted partway toward how the real women spoke: These men used more emotional phrases and more exclamation points than the men who did not gender-switch. In other words, these men created female avatars that were stereotypically beautiful and emotional."

    12. Re:Wow by Captain+Splendid · · Score: 2

      Yeah, no. Speaking as a white male, I wouldn't give that shit up for all the money in the world.

      You go on believing that being a guy makes you a second-class citizen, see how for that gets you.

      --
      Linux, you magnificent bastard, I read the fucking manual!
    13. Re:Wow by F'Nok · · Score: 2

      Worth remembering that a lot of women did play then but played male characters specifically to avoid the attention you're talking about.

      We were always online. It's not that more women are into those games, but that gaming got more mainstream and the culture is being dragged slowly towards proper standards of behaviour.

  2. How is that stranger? by Immerman · · Score: 3, Insightful

    You're asking a machine to mimic something profoundly alien to it's nature, to put things on an equal footing the man should have to do so as well.

    And please, let's not get in to the similarity/difference argument. Yes, the similarities between the minds of men and women far outweigh the differences, but the differences are still profound.

    --
    --- Most topics have many sides worth arguing, allow me to take one opposite you.
    1. Re:How is that stranger? by nyctopterus · · Score: 4, Insightful

      Define "profound". You make it sound like men and women's minds start from completely different places and end up converging on similarity, but that's absurd. Men and women differ statistically over populations, but individuals might fall pretty much anywhere in the spectrums of things that differ. There's no way I would be confident of identifying the gender of an individual in this sort of scenario. Statistically, I'm sure I could do a lot better than chance, but each one is pretty uncertain.

    2. Re:How is that stranger? by Immerman · · Score: 4, Interesting

      Try it the other way around - men and women's minds start from essentially the same foundation, but then diverge thanks to profoundly different optimal reproductive strategies (with all the contingent physical and hormonal differences evolution has thus adopted), cultural indoctrination, and no doubt myriad other minor factors. Certainly the standard deviation is greater than the population difference on many fronts, maybe most, but the distinction is undeniable to anyone closely and honestly involved with numerous members of both genders. Grab any two random individuals of opposite genders and you will almost certainly find certain characteristic differences between them.

      --
      --- Most topics have many sides worth arguing, allow me to take one opposite you.
  3. IRC by Anonymous Coward · · Score: 2, Funny

    What a minute, isn't this what IRC was invented for? For guys to go in to sex channels and pretend to be women and for IRC bots to pretend to be women too? I though this was already a settled matter...

  4. Re:Curse of AI by Lab+Rat+Jason · · Score: 5, Insightful

    It's more like a case of people pushing the goal posts back to where they originally were, after some over zealous AI zealot moved them forward to make his failure look like a success...

    --
    Which has more power: the hammer, or the anvil?
  5. We haven't even begun by Archtech · · Score: 4, Insightful

    to understand how a machine could be made to pass the Turing test (or the woman test) honestly and thoroughly. To do so, it would have to understand arbitrary human statements and questions: not just "why is the sky blue?" (relatively easy) but "why doesn't my wife understand me?" and "is the real rational, as Hegel posited, and if so (or not) why (not)?" Note that the machine could reasonably pretend to know nothing about Hegel, but it would have to react like a normal human being. No obfuscation such as pretending to be foreign, a child, thoroughly ignorant, or befuddled by drugs should be accepted.

    Going a little further, it would have to cope with (very) simple jokes such as "I asked my dog which team would win the World Cup"/"What did he say?"/"Nothing. HE'S A DOG".

    --
    I am sure that there are many other solipsists out there.
  6. Re:Curse of AI by fuzzyfuzzyfungus · · Score: 3, Insightful

    Arguably, the 'AI curse' is only partly goalpost-moving by humans obsessed with their special uniqueness.

    The other aspect of it (as well a genuinely interesting result of whatever attempt at AI was made) is the discovery that we actually handle much less of what we do in some sort of naive, idealized, "high-level, general-purpose, cognition" than we naively suspect, and rather more in specialized and unconscious mechanisms(this lesson can be learned from the other direction as well: something like face blindness, in otherwise cognitively and visually normal people, simply wouldn't be possible if object recognition were a general-purpose function handled by an 'intelligence' with access to a video stream...) And, even when we aren't crunching stuff unconsciously on quite special-purpose mechanisms, we are sometimes just dumb. Good old Youtube comments would probably allow a babbling Markov chain to pass a Turing test.

    There's also the fact that humans are frequently easier to fool than they would like: It's not exactly news that people will see faces on the moon, a known sterile rock, impute emotions (and sometimes entire spirits or deities) to the weather, emotionally bond with tamagotchis and similar nonsense.

    Yes, people are likely to dismiss every AI that doesn't end up murdering them all and rendering them for computronium as 'just an expert system'; but it's also arguably the case that using a Turing test to check for AI substantially rests on the assumption, more or less Cartesian and more or less nonsense, that man is first and foremost an abstract 'thinking thing', with some other stuff tacked on that philosophers and mathematicians needn't really worry about.

  7. Three Laws Safe by wcrowe · · Score: 3, Insightful

    "Passing" the Turing Test is about as valid as Asimov's Three Laws of Robotics.

    --
    Proverbs 21:19
  8. Re:I Think That Alan Turing Himself by Jeremy+Erwin · · Score: 2

    Real men (such as Turing) prefer the company of other men.

  9. Re:Curse of AI by mark-t · · Score: 2

    That, and it wasn't even that hard to spot as an AI. I recall having a go at the chatbot in question back in 2012, and found it as crtically flawed after asking it just two questions. First, I asked how old he was, and he responded with a believable answer of 13, which corresponded with information that I already had, but then I asked when his birthday was and he responded with, if I remember correctly, a date in January of 1988, which would have made him 11 years older than what he was otherwise claiming. The straightforwardness of the questions and their answers left no doubt in my mind that the discrepancy was not merely on account of any so-called lack of fluency in English (which was, by the way, the excuse that it would appear to fall back upon when it was not able to from a coherent response), and the bot was exposed. A non-native speaker who genuinely did not understand a question in the language it was posed in would, in fact, just say that they did not understand the question, rather than give a coherent answer that blatantly contradicts a previous coherent answer they had already given to a differently worded but highly related question.

    The notion that at least 30% of the researchers would not even think to ask an alleged child when their birthday was is laughable.

  10. Headline, summary, and article are wrong by Lost+Race · · Score: 3, Interesting

    Turing's imitation game was a thought experiment. To explain it simply to an audience unfamiliar with the idea, he started with man against woman, then proceded to man against machine. The specific genders were not important or significant in the thought experiment, just the existence of some difference between the contestants that could potentially be spoofed over a teletype. There was nothing gender-specific or weird about it.

    1. Re:Headline, summary, and article are wrong by neonsignal · · Score: 2

      Indeed. Not only that, but it was the man in Turing's experiment that was replaced with a machine, not the woman. Makes me wonder if the author only skimmed the first page of the twenty-eight page article.

      While it is interesting that the analogous experiment that Turing starts with is about gender identification, he does this to make the point about separating physical characteristics from the intellect. He hopes that the reader will accept his premise that a man could pretend to be a woman under the condition that the interrogator can only ask questions remotely. If a reader can accept this, it clears the air a little about the conditions under which we could define a machine as "thinking" in the same way as a human does.