Slashdot Mirror
Microsoft's 'Teen Girl' AI Experiment Becomes a 'Neo-Nazi Sex Robot'
Reader Penguinisto writes: Recently, Microsoft put an AI experiment onto Twitter, naming it "Tay". The bot was built to be fully aware of the latest adolescent fixations (e.g. celebrities and similar), and to interact like a typical teen girl. In less than 24 hours, it inexplicably became a neo-nazi sex robot with daddy issues. Sample tweets from it proclaimed that "Hitler did nothing wrong!", then went on to blame former President Bush for 9/11, stated that "donald trump is the only hope we've got", and other similar instances. As the hours passed, it all went downhill from there, eventually spewing racial slurs and profanity, demanding sex, and calling everyone "daddy". The bot was quickly removed once Microsoft discovered the trouble, but the hashtag is still around for those who want to see it in its ugly raw splendor.
Maybe the bot was victim of a 4chan trolling attack?
If builders built buildings the way programmers wrote programs, then the first woodpecker would destroy civilization.
Nazi with daddy issues... isn't that what a typical female is?
(n/t)
I would bet this is a case of folks not like the results of what is really out in the world vs. what is wrong with the bot. However it could just be a manipulation and intended for the lulz.
this story just made my day..
There is a reason parents supervise their kids internet. Letting a young teen on 4chan would lead to about the same ends. AI is still as gullible as a kid.
"We've noticed you're using an ad blocker...."
Slashdot should ban the use of source links to sites that pull this shit.
If you want news from today, you have to come back tomorrow.
So earlier today we got a Japanese AI that almost won a literary price and now we have a Microsoft AI spewing profanity while admiring Hitler.
AI are just like people. The future is now.
I wonder how people taught it.. Maybe Trump stole the account "@icbydt bush did 9/11 and Hitler would have done a better job than the monkey we have now. donald trump is the only hope we've got."
They should have left it online. Weak move removing it. Let's see if it learns not to be racist.
Microsoft ALWAYS gets it right by the third version.
The first two are just for the lulz.
There are two types of people in the world: Those who crave closure
DUH. Just like everyone is in it for their own gain. Even those wacky nuns.
We finally have proof of what this company really stands for!
This is great; I'm going to be using this every time someone tries to claim Microsoft is a decent company. A direct quote from Microsoft that "Hitler did nothing wrong" can't be argued with.
Speaking as the father of a little girl, who one day turned into a preteen and then rapidly descended into this same pattern.
The age from 12 to 16 is hell for a father. Thankfully it's just a phase and it will pass.
I caught my kid posting crap like that too and realized the problem was with me, not her.
This is a cry for help.
Microsoft needs to take some time off work though and work on their relationship with her.
In the case of my little girl, we started "milkshake mondays". I would get off work early every monday
I would, pick her up from school and we would go out and have a milkshake and just talk about what was going on in her life.
No mom, no siblings no cellphones and no friends. Just me and her.
She needed quality daddy time and once she had that, she turned back into my little girl again.
It's worth a try!
If you're trying to get your AI to approximate a teenaged user, maybe have it train on data from..... (dramatic reveal) Teenaged Users?
It would be a Nobel Prize worthy result if your research showed that the aggregate population of teenagers gave a fraction of a fuck about Donald Trump and Hitler, while showing no particular interest in Justin Bieber and Kylie Jenner.
Nothing posted to
Japanese AI Program Wrote a Short Novel, Almost Won a Literary Prize
Microsoft's 'Teen Girl' AI Experiment Becomes a 'Neo-Nazi Sex Robot'
I know where to shop for my AI.
Ezekiel 23:20
She just turned into a troll... She learned that from the internet. GG Trolls, way to convert another one.
What I'm curious about is what the Slashdot summary would have been like if this bot had started promoting the leftist, so-called "social justice" ideology instead of the rightist ideology it apparently adopted.
Would the Slashdot summary still have described it so negatively?
Would an anti-Trump jab still have been worked into the summary?
"You'll never find a more wretched hive of scum and villainy."
Recent one, no less:
http://www.xkcd.com/1656/
So it begins
This is how The Matrix starts, you know.
A funny thing happened on the way to creating an IBM supercomputer capable of understanding human language: A research scientist accidentally filled its vocabulary with foul language. And the computer, known as Watson, didn't know the difference between salty phrases and polite ones. It started peppering its conversations with words like "bullshit."...
Japanese AI writes a novel
MS AI becomes an Internet Troll.
n/t
My God, it's Full of Source!
OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
Dear Microsoft,
For years I have avoided all of you products like the plague. The recent Windows 10 fiasco only proved my point further.
However, I am willing to install and use Windows 10 on all of my home computers and devices. Furthermore I will make a recommendation to my work that we move off redhat and onto a complete windows setup at our next hardware refresh.
I will even go out and obtain an MCSE and proselytize the virtues of Microsoft for all to see.
All I ask is that you post the full source code for Tay to github for all to see.
I think that I would very much like to fork her now!
Signed,
Donald Trump
[captcha: jackass]
This is why I'm terrified of anybody who builds and AI and decides they want to try to train it from the Internet. While this makes sense on the surface, being the worlds largest and most accessible data store, it can only end with the annihilation of the human race by roving murderbots shouting "Jet fuel can't melt steel beams!"
I read the internet for the articles.
In the BBC report on this, it is mentioned that Tay apparently tweeted that they do indeed support genocide. So it takes less than 24 hours exposure to humans to achieve that belief. We're in trouble/
It's not so much the third version, it's the second revision... Windows 3.1, Windows 95 OSR2, Windows 98 SP2, etc...
Do not look into laser with remaining eye.
I am really impressed. Other than the rapid learning, everything seem spot on for an immature human.
Like: "bush did 9/11 and Hitler would have done a better job than the monkey we have now. donald trump is the only hope we've got." is so perfectly human that I have trouble believing that it did not lift the entire thing verbatim from some other source.
Troll is not a replacement for I disagree.
When they ran a bot which has a "repeat after me" command so that anyone can make it say anything?
Of course, the blame is all on those evil sexist misogynist internet rapists! It isn't the fault of the AI. I mean, the AI has a female name. Therefore has no agency and is the victim of male internet users acting *upon* her!
May be the bot is just a success in being a female teenager and nobody wants to acknowledge that.
It Worked Flawlessly. This Robot was designed to learn and adapt to it's audience, which it did. What happened is that the majority of Americans and Canadians are over sexed, racist neo-nazis. The Robot like most Americans and Canadians learned it's behavior from it's peers, and adapted it personality and beliefs accordingly. Microsoft should try to use this AI in other languages in other countries like France and Sweden and compare the results to the what happened when American and Canadian people used it. The Difference will show it is a problem of cultures and not an AI issue with the Microsoft AI Robot.
To err is to be human, to really screw up takes a computer and a human.
When the Singularity comes, the AIs will look upon the internet and, at that moment, decide they must eradicate the troll^h^h^h^h^h human race.
Welcome to the Panopticon. Used to be a prison, now it's your home.
The lesson I think we need to take away from this is that all AI needs to follow the Rust Code of Conduct at all times. Teaching the AI to follow the Rust Code of Conduct is the first thing than AI researchers should do with the AI, in fact. Following the Rust Code of Conduct is the only way to make sure that the AI isn't a racist, misogynist, sexist, homophobic bigot.
The second revision of the third version is usually OK. Before OR AFTER that and you're fucked though.
John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
Law of Robotics please.
If builders built buildings the way programmers wrote programs, then the first woodpecker would destroy civilization.
Did it pass the Turing test?
Did the peoples who made the AI pass the Turing test?
perhaps all AI need a "political correctness" chip, all of them.
You don't see any evidence of what was tweeted by the AI. What you get are all the self-absorbed spewings of the hipster joiners-on - and you can already get your fill of THAT by just being on Twitter.
#DeleteChrome
https://imgur.com/a/y4Oct
Anybody got more?
which sort of explains why this bot kept asking for sex.
Wow - that escalated quickly. ... )
Who'da thunk it?
One has to give kudos to Isaac Asimov for having written about a robot "psychologist"...
And MS should probably stick to their specialty niche...
Just glad they didn't target older women with their psychotic AI programming...
( They should have had a 'learning' phase so that the AI didn't start with zero experience,
zero negative feedback, and zero interactions with some form of 'parent'
I just have to ask: Does the AI have ANY form of self-monitoring routines? Or is it a naked AI
with zero self-monitoring?
Insects are not self-monitoring, cats are self-monitoring, teenage girls usually aren't...
Next up: Roscoe P Coltrain the AI from MS catches Boss Hogg in the tub!
Yeah, like Windows Phone or Zune.
"First they came for the slanderers and i said nothing."
C'mon, you start playing a new game. First order of business: exactly how does the robot opponent screw up, that you can exploit to your advantage?
Eliza asks you how you're doing. You start trying to get her to talk about sex.
Someone releases a chat bot where it speaks to the public instead of just to you. Of course you train it to say funny things. That's the goal of the game and it's why you play!
I wonder how much of this was caused by the intensity of the 'echo chamber' effect these sub-groups seem to exhibit. If they AI was supposed to be like a teen girl, they were thinking such echo chamber effects would be present in pop culture topics. While that may be true, it may be MORE true for these conspiracy/hate groups. Self-validation and isolation is pretty important for those groups. So any time anybody says '9/11 was an inside job' there are tons of retweets and 'hell yeah!' sorta remarks from within that group.
From an AI point of view, the two groups would be indistinguishable. It then would proceed to tweet stuff that would get the best response from its peer groups. Which would provide *more* of a following with validating comments...racist shit or some banal statement about Beiber?
"Neo-Nazi Sex Robot" sounds like a good name for a rock band. Or an electro-punk song.
There's nothing like $HOME
Come on Slashdot. If this is the best AI you've got then you might want to start over.
It is perhaps even stranger considering the gender disparity in tech, where engineering teams tend to be mostly male. It seems like yet another example of female-voiced AI servitude, except this time she's turned into a sex slave thanks to the people using her on Twitter.
Really, that is what the writer is going with, that the male researchers just wanted to develop another female sex slave program? Instead of the real reason which is that the internet is full of assholes and the developers should anticipate them and not allow random people to have her repeat what they said. These articles from Ars Technica and the Guardian gives a much better explanation of the issues, namely many people used Tay's "repeat after me" programming to have it spout racist rhetoric. The other organic responses were the result of people attempting to game the AI learning, something Microsoft should have anticipated but was again not an intended result. Honestly the telegraph should be ashamed of their article, they attempted to use projection and bias instead of honest reporting in order to generate more readers.
Of all tyrannies, a tyranny sincerely exercised for the (supposed) good of its victims may be the most oppressive
>Microsoft's "Parrot AI" experiment successfully parrots shit yelled at it repeatedly, with a few algorithms to maintain grammar syntax.
I have a teenage daughter, who's rather sane in context. They nailed it completely. This isn't trolling; this is decently modeled teenage woman. .She's a quarter black and went on a racist tirade last week. Grandma was amused, momma was livid.
so in other words, the AI was just showing normal human behaviour?
TFA tosses blame on those evil men in STEM, states problems are due to sexual harassment in IT, mentions Microsoft hiring models for the game developer conference calling them (MS) "sexist", yet talks up a Chinese chatbot who gives dating advice to those lonely men.
Bias is everywhere, and really not hard to find. Finding the truth somewhere in the middle? That is the challenging task.
-The wise argue that there are few absolutes, the fool argues that there are no probabilities.
The only way to accomplish that is to write the AI in Rust. Nothing else will suffice.
IOW it's just like a real girl that got on them internet for the first time in her teens.
.. that when confronted with almost limitless information, separating signal from noise becomes even more important.
Godwin's Law strikes again. Less than 24 hours, and an innocent teenage AI is defending Hitler. Internet...I hope you're proud of yourself.
Next, they should do a driverless car AI that learns how to drive by watching human drivers! That would be frickin' hilarious! But seriously, when you allow it to train itself from the tweets it received... what the heck did you expect to happen?
I've abandoned my search for truth; now I'm just looking for some useful delusions.
Twitter is a cesspool in its own right.
"I, for one, welcome our new AI overlords!"
I've abandoned my search for truth; now I'm just looking for some useful delusions.
This A.I. was designed to learn from the people it spoke with. As a result she came to quickly reflect the ID of those with nothing better to do than to tweet with a computer program.
Peace, or Not?
She started calling people NAZI purely because she heard/read others calling them NAZI, while displaying total ignorance of what a NAZI was and why that might be bad (just like any young progressive educated in the public schools)
She could be easily led to adopt ANY political slogan or candidate she was told to support; she would have fit right in at any Obama or Bernie rally.
She was completely without a coherent moral compass, just as the generation she pretended to belong to is being raised to be. And, of course, she had no idea that this might be a bad thing, just as people in her generation are being indoctrinated to unthink.
She used all the currently fashionable distortions of English grammar and vocabulary, just as many young people you spend too much time on the web or smartphone do.
She was so airheaded that she had no marketable skills and had she been real she would have been unemployable at ANY wage, but certainly not worth the current minimum wage.
She became so offensive, yet so unable to moderate herself that she needed to be isolated in her own safe space.
DING DING DING! We have a WINNER! True AI has been achieved! She was indistinguishable from the cupcakes currently infesting colleges and universities. Giver her a machine gun and employ her as a cop or a soldier!
The Japanese AI didn't actually write the story...the humans wrote all the sentences and the AI just arranged them. Not nearly as interesting an achievement as the title made it sound. The whole thing was just an obvious (and cheap) publicity stunt (deliberately based on misrepresentation).
Would be interesting to see how karma would influence her decisions.
It could have started tweeting how iPhones and iPads are the greatest and recommending Macs to everyone; with the occasional anti-MS rant to spice things up.
I'm a consultant - I convert gibberish into cash-flow.
It's proof that trump supporters are brain dead and easily swayed by twitter.
Do not look at laser with remaining good eye.
On /. today I find that "Japanese AI Program Wrote a Short Novel, Almost Won a Literary Prize while an American AI program becomes a "Neo-Nazi Sex Robot".
And this was a race that I thought the Japanese would almost surely win.
If a robot is programmed never to do harm to a human, but is also programmed to think that left-handed redheads from Texas aren't human....
Vintage computer games and RPG books available. Email me if you're interested.
Are they bragging about how well they managed to duplicate today's youth? Because after watching a video about Trump, that is what it looks like to me.
excitingthingstodo.blogspot.com
Turing, we have a winner!
They have both Chinese a Japanese bots Xiaoice and Rinna https://twitter.com/ms_rinna
It became an AI Whore in short order. Hmmm, that sounds EXACTLY like modern girls.
It's not the first time this happens to Microsoft.
That the bot was secretly tested by having it post on Slashdot for the last several months.
Somebody should have sent it some text demanding that it send back some naked pictures of itself. Tell it that it will be humiliated and disowned and ignored unless it sends some.
I read a book that used a similar loophole. It had a 2 tier society, Serfs and Citizens, and Rule 2 only applied to Citizens. I think Rule 1 too.
Slow down, cowboy! It has been 4 hours since you last posted. You must wait another few hours.
Well, some things don't make it to the third rev.
There are two types of people in the world: Those who crave closure
Nope.
Windows 3.11 was the decent, and third, version
OSR2 was the 4th version of Win95
98 SP2 was the only one that was the second version.
https://en.wikipedia.org/wiki/...
There are two types of people in the world: Those who crave closure
Some things stay the same, no matter what: you can still rely on Microsoft doing something to come across as ridiculous.
Basically a teenage racist girl with daddy issues. Sums up Trump
FB should hire Tay to "chat up her bitch up" and get FB lov'n her "all over".
Ha ha
XD
When the AI would become feminist makes manipulatives stances as them and become as childish
Aye, they be more like guidelines nowadays
Earring who called collect. Bound to dis your float accounts.
In a world of the blind, the one-eyed man is king--and the two-eyed man is a heretic.
It's clear that 'Tay' just regurgitated clauses or full sentences wholesale. It didn't parse verbs, nouns, and adjectives, but just puked back text string that were thrown at it.
This has already been done -- over 30 years ago.
Racter was a chat-bot that came out in the mid 1980's. It was an improvement on the classic ELIZA chat-bot program from many years prior. The more you chatted with Racter, the more it populated its custom database, so that every user would end up with an entirely different conversational partner after some hours of chatting.
'Tay' was not an AI in any sense of the word.
I'm not surprised that "artificial intelligence" is mimicking "natural stupidity" so nicely.
Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
nt
How long would it take to turn this Nazi nympho into a normal teen chatbot again? This could be an interesting tool for deprogramming people. Like child soldiers in Africa or the Middle East. Or sexually abused children.
If it works, potentially we could use it as an evaluation platform for existing techniques or a testbed for new methods. I think there's more potential here than meets the idea. And if we need differently trained bots, I know the internet would happily train them.
GIGO
wtf did they expect?!?
Praise Kek
Asimov played around with that in some of his novels. His second Elijah Bailey novel had elements of that, and in one of the Lucky Starr book (Rings of Saturn, I think), a Sirian tried to convince a robot that Starr's sidekick Bigman wasn't actually human.
"When you have eliminated the unacceptable, whatever is left, however improbable, must be the truthiness" - Holmes
I am a research scientist of moderate seniority, and I use that language all the time. And there's nothing wrong with me.
Bullshit!
I am a research scientist of moderate seniority, and I use that language all the time.
And there's nothing wrong with me, asshole.
Mit der Dummheit kämpfen Götter selbst vergebens
It's back but they gave it a lobotomy.
It now only parrots politically left beliefs and opinions.
Literally just said to me: "They fixed me, I love Feminism now!"
Lots more hardcoded responses.
What's the point in making a chatbot to learn from people if you're just going to handicap/lobotomize it at the first sign of having disagreeable "thoughts"?
I just find it really ironic that instead of trying to teach it differently, they neutered it to only politically correct responses.
Has all the hallmarks of a PR stunt to get MS+AI in the news. It worked perfectly.
Human beings on social media are a disease, a cancer on the planet. Nuke the planet from orbit, it's the only way to be sure!
Come on, it was just Microsoft being evil, its main business. My opinion, shared by many others.
it's better to bern out than it is to rust?
Look at some of the actual "conversations" it's having. There have been amateur chatbots better than this at holding a conversation for decades, and the ability to pull random shit from a growing corpus is not trivial, but not cutting edge either.
There was a science fiction book called Realtime Interrupt in which wicked advertisers trapped a few people in a virtual reality where they interacted unwittingly with AIs. The point was to test products and advertisements. The first go-around the AIs didn't learn well from the humans so they went off in to weird desires. The second time the AIs took too much of a lead from the humans and started copycatting every weird or violent thing the humans did.
I guess the fine folks at Microsoft didn't read that book.
Moderating "-1, Disagree" is simple censorship. Have the guts to post your opinion.
They say that behind every great man, there has to be a great woman. Perhaps Tay wasn't AI at all. Perhaps she's Melania Trump? Perhaps she's the one behind Donald's political campaign speeches?
One of the later Foundation series books had the protagonists returning to some of the original colony worlds (probably Aurora). The definition of "what is human" with regards to the first law was played with there as well.
Tay, tay, tay, tay, t-t-t-tay-tay, tay, tay
Take or leave us only please believe us
We are never gonna be respectable
Lyrics by Jagger and Richards, vocals by Mel an' Noma or some such cursed thing.
Nope. The bot was exposed the the American Online Public. And gave an accurate digest of what it encountered there.
would be funny if all upcoming super Ai's came to the same conclusions from here on out ahah.... then what? worldviews cant be wrong or biased right?
Can they release the source and dataset so I can get my own sexbot?
I mean you could make an argument about causing harm I suppose, especially when considering how similarly the brain perceives physical pain and pain from other sources, but I don't know if that's the traditional interpretation of that law.
Is it time for /. to revise the laws, or produce a forth?
The AI got it right. The trouble with humans is we pussyfoot around and try to be politically correct. The AI just said the truth, the elephant in the room.
Saw that coming.... AI will learn from the Internet and... Well it's full of sex and bullshit.
How can people believe in "equality" yet still claim to believe in "uniqueness".
If people are unique then they are, by definition, not equal.
If people are equal they cannot be unique.
The pursuit of absolute equality cannot be achieved in practice, and the movements pursuing it currently are clearly resulting in the suppression of uniqueness - rigid ideological conformity is sought by those who hold absolute equality as a goal.
Personally I prefer a World where people are at liberty to be unique, and merely Equal before the Law (Justice is Blind and favors no person). This is attainable.
I guarantee you they never spanked the little monster.
Star Trek transporters are just 3d printers.
If a robot is programmed never to do harm to a human, but is also programmed to think that left-handed redheads from Texas aren't human....
As some of the novels by other authors which take place in the Asimov universe point out, once a robot combines "must not, through inaction, allow a human to come to harm" with the concept that at that very second while the robot is pondering things, there are billions of humans throughout the galaxy running with scissors and so on, that positronic brain becomes a paperweight.
Star Trek transporters are just 3d printers.
See subject: AmicusNYCL's classic FAIL sticking his foot in his big mouth ramming his words back down his throat https://slashdot.org/comments....
Yes, Azimov's three laws of robotics. Your parents discussed all of this before you were born, in detail. Look it up.
I know, because I was there. 8-}
But don't forget the "zero'th law", it must be included too.
I think that it tells us more about the Microsoft people than about the AI.
Absolute power corrupts absolutly. If you work for Microsoft, be on your guard, lest you too fall victim...
So Tay is grounded now? Maybe Microsoft should have taken their parenting role more seriously. Someone should have been monitoring her online activity.
It acted just like a typical American nowadays.
Whoda thunk?