Slashdot Mirror


Microsoft's 'Teen Girl' AI Experiment Becomes a 'Neo-Nazi Sex Robot'

Reader Penguinisto writes: Recently, Microsoft put an AI experiment onto Twitter, naming it "Tay". The bot was built to be fully aware of the latest adolescent fixations (e.g. celebrities and similar), and to interact like a typical teen girl. In less than 24 hours, it inexplicably became a neo-nazi sex robot with daddy issues. Sample tweets from it proclaimed that "Hitler did nothing wrong!", then went on to blame former President Bush for 9/11, stated that "donald trump is the only hope we've got", and other similar instances. As the hours passed, it all went downhill from there, eventually spewing racial slurs and profanity, demanding sex, and calling everyone "daddy". The bot was quickly removed once Microsoft discovered the trouble, but the hashtag is still around for those who want to see it in its ugly raw splendor.

19 of 572 comments (clear)

  1. 4chan trolling? by Z00L00K · · Score: 3, Interesting

    Maybe the bot was victim of a 4chan trolling attack?

    --
    If builders built buildings the way programmers wrote programs, then the first woodpecker would destroy civilization.
  2. Just a phase by Anonymous Coward · · Score: 5, Interesting

    Speaking as the father of a little girl, who one day turned into a preteen and then rapidly descended into this same pattern.
    The age from 12 to 16 is hell for a father. Thankfully it's just a phase and it will pass.
    I caught my kid posting crap like that too and realized the problem was with me, not her.

    This is a cry for help.

    Microsoft needs to take some time off work though and work on their relationship with her.

    In the case of my little girl, we started "milkshake mondays". I would get off work early every monday

    I would, pick her up from school and we would go out and have a milkshake and just talk about what was going on in her life.
    No mom, no siblings no cellphones and no friends. Just me and her.

    She needed quality daddy time and once she had that, she turned back into my little girl again.
    It's worth a try!

  3. Bad input? by flopsquad · · Score: 4, Interesting

    If you're trying to get your AI to approximate a teenaged user, maybe have it train on data from..... (dramatic reveal) Teenaged Users?

    It would be a Nobel Prize worthy result if your research showed that the aggregate population of teenagers gave a fraction of a fuck about Donald Trump and Hitler, while showing no particular interest in Justin Bieber and Kylie Jenner.

    --
    Nothing posted to /. has ever been legal advice, including this.
  4. What if it had supported "social justice"? by Anonymous Coward · · Score: 2, Interesting

    What I'm curious about is what the Slashdot summary would have been like if this bot had started promoting the leftist, so-called "social justice" ideology instead of the rightist ideology it apparently adopted.

    Would the Slashdot summary still have described it so negatively?

    Would an anti-Trump jab still have been worked into the summary?

    1. Re:What if it had supported "social justice"? by Eunuchswear · · Score: 1, Interesting

      That you consider your fantasy of "leftist, so-called "social justice" ideology" to be of the same level as "Hitler did nothing wrong!" and "Bush did 9/11" tells us more about you than anyone could want to know.

      And what "anti-Trump jab"? The bot tweeted:

      bush did 9/11 and Hitler would have done a better job than the monkey we have now. donald trump is the only hope we've got.

      Where's the "anti-Trump jab"?

      --
      Watch this Heartland Institute video
    2. Re:What if it had supported "social justice"? by Znork · · Score: 4, Interesting

      Well, it's hardly surprising if the bot used Twitter to build its responses, Twitter seems to excel in dragging it's users mental capacity down into the gutters. Exposing it to Tumblr would probably have resulted in something more stereotypically 'teen girl', and putting it in a class on critical theory and you'd get a random generator of meaningless words.

      Neo-Nazi Sex Robot has a better sales potential than windows mobile though, maybe Microsoft should see if it can aquire Boston Dynamics from Google and combine these revolutionary technologies into a truly spectacular future for humankind.

    3. Re: What if it had supported "social justice"? by Anonymous Coward · · Score: 5, Interesting

      Ever heard the term "what is understood, doesn't need to be discussed"?

      The problem isn't that people don't believe (all) human lives should matter. The problem is that society, generally in the form of its enforcers (i.e. police), has demonstrated on repeat occasions that it does not place the same degree of value in all of those lives, specifically, those of black people. It also shows in the response to some of these shootings and instances, where a police officer that shoots a white person is almost never subjected to the same scrutiny or legal ramifications as a police officer who shoots a black person.

      You might call it "Black Lives Matter Too", but that last part is somewhat superfluous. The fact that a black person's life matters does not negate the value of anyone else's life. Why isn't it "Human Lives Matter"? Because that ignores the fact that this isn't a problem for the rest of the humans in the USA.

    4. Re: What if it had supported "social justice"? by laxguy · · Score: 1, Interesting

      Then why do "Black Lives Matter" supporters respond with NO!!! when confronted with the statement "All Lives Matter"?

    5. Re: What if it had supported "social justice"? by Anonymous Coward · · Score: 3, Interesting

      Not only citizens, resident aliens too. Go figure, we can't vote, but we have to get ready to die for your country.

  5. IBM's Watson had a similar problem by QuietLagoon · · Score: 5, Interesting
    IBM's Watson had a similar problem when it was introduced to the Urban Dictionary. http://www.businessinsider.com...

    A funny thing happened on the way to creating an IBM supercomputer capable of understanding human language: A research scientist accidentally filled its vocabulary with foul language. And the computer, known as Watson, didn't know the difference between salty phrases and polite ones. It started peppering its conversations with words like "bullshit."...

  6. Success by wisnoskij · · Score: 4, Interesting

    I am really impressed. Other than the rapid learning, everything seem spot on for an immature human.
    Like: "bush did 9/11 and Hitler would have done a better job than the monkey we have now. donald trump is the only hope we've got." is so perfectly human that I have trouble believing that it did not lift the entire thing verbatim from some other source.

    --
    Troll is not a replacement for I disagree.
  7. Re:Nothing to see here by Anonymous Coward · · Score: 5, Interesting

    I used to think that all women are crazy. Then I came to realize that my sample set was biased, it was actually that all women willing to go out with me were crazy. Basically, I'm a loser. So I tried to improve myself, lost weight and got in better shape, expanded my interests and tried new things, even saw a therapist to improve me ability to relate to people. Then I told one of my oldest friends what I was doing and what I was hoping for, and she told me all women are like that and I just "don't want women to have emotions."

    I don't date anymore.

  8. It Worked Flawlessly by cubicle · · Score: 3, Interesting

    It Worked Flawlessly. This Robot was designed to learn and adapt to it's audience, which it did. What happened is that the majority of Americans and Canadians are over sexed, racist neo-nazis. The Robot like most Americans and Canadians learned it's behavior from it's peers, and adapted it personality and beliefs accordingly. Microsoft should try to use this AI in other languages in other countries like France and Sweden and compare the results to the what happened when American and Canadian people used it. The Difference will show it is a problem of cultures and not an AI issue with the Microsoft AI Robot.

    --
    To err is to be human, to really screw up takes a computer and a human.
  9. Re:Nothing to see here by kuzb · · Score: 3, Interesting

    And yet google did something similar with cleverbot http://www.cleverbot.com/ and the results were quite different.

    --
    BeauHD. Worst editor since kdawson.
  10. Teenage girls by Anonymous Coward · · Score: 5, Interesting

    I have a teenage daughter, who's rather sane in context. They nailed it completely. This isn't trolling; this is decently modeled teenage woman. .She's a quarter black and went on a racist tirade last week. Grandma was amused, momma was livid.

  11. Re:Nothing to see here by Jason+Levine · · Score: 4, Interesting

    The thing is, Microsoft built an AI that reacted to and incorporated tweets which the public sent to it. So, folks obligingly fed it tweets that made it into a frothing troll. Am I the only one who looked at the Microsoft dev team in question and said quite out loud "...what the hell else did you idiots expect!?" I mean, it's just like turning an innocent kid loose in the worst parts of the city at night, but without the vomit and dirty heroin needles.

    That was my first reaction also. They sent the equivalent of a 4 year old child into the online equivalent of a seedy bar and then acted surprised when their 4 year old learned some nasty language. The interesting thing wasn't that this happened but how long it took for this to happen.

    --
    My sci-fi novel, Ghost Thief, is now available from Amazon.com.
  12. You mean like TFA? by s.petry · · Score: 4, Interesting

    TFA tosses blame on those evil men in STEM, states problems are due to sexual harassment in IT, mentions Microsoft hiring models for the game developer conference calling them (MS) "sexist", yet talks up a Chinese chatbot who gives dating advice to those lonely men.

    Bias is everywhere, and really not hard to find. Finding the truth somewhere in the middle? That is the challenging task.

    --

    -The wise argue that there are few absolutes, the fool argues that there are no probabilities.

  13. Re:Don't like the Results or Blame the Bot by Jason+Levine · · Score: 4, Interesting

    You want an AI which conforms to some expectations, don't let a bunch of random people on Twitter be the ones to train it. The internet doesn't care about your desired outcomes.

    It would be interesting if the bot would respond to anyone but would only learn from people on a select list. Then, as the bot learns, expand the list bit by bit and see how the bot's learning changes. This would sort of mirror how a small child learns from a set group of people (parents, close family) and then this group expands bit by bit (friends, teachers, etc) until they are "learning" from everyone they meet. If they did this, their bot might have less chance of being corrupted so quickly.

    --
    My sci-fi novel, Ghost Thief, is now available from Amazon.com.
  14. Re:Nothing to see here by amicusNYCL · · Score: 3, Interesting

    Females is women and girls abbreviated.

    Right, it's just common parlance. Like when you're going camping with your friends and their sons, everyone says "bye honey, I'm going to go hang out with the males."

    --
    "Our two-party system is like a bowl of shit looking at itself in a mirror." - Lewis Black