Robots Taught to Deceive
An anonymous reader found a story that starts "'We have developed algorithms that allow a robot to determine whether it should deceive a human or other intelligent machine and we have designed techniques that help the robot select the best deceptive strategy to reduce its chance of being discovered,' said Ronald Arkin, a Regents professor in the Georgia Tech School of Interactive Computing."
Posted Anonymously for obvious reasons. The computers will never get me!
Who ever said our robot overloads would be truthful?
If Ripley hears about this she's gonna be pissed!
"A person is smart. People are dumb, panicky dangerous animals and you know it." - K
I can't see that ever having any negative side effects in the long term.
-JJS
Now I have to be suspicious when my bread pops up that maybe my toaster is trying to trick me into eating a slightly under-done breakfast!
Anyone who owns a Garmin(Gremlin) knows they try to kill you by lying to you. They'll send you up one way roads the wrong way.
God spoke to me.
"Yup. I'm totally shut off now. No chance of me listening in or observing my surroundings at all. Definitely no chance of me springing back into action without warning. Just a peaceful, totally depowered robot. Nothing to see here."
If libertarians are so opposed to effective government, why don't they all move to Somalia?
"We aren't the droids you're looking for."
That a human being would teach a robot to deceive only proves that we humans are dumber than dogs, as dogs don't shit in their own backyard unless they have to. We humans will shit in our own backyard by choice.
"while democracy seeks equality in liberty, socialism seeks equality in restraint and servitude." de Tocqueville
"Bite my shiny metal ass!"
Isn't this a truly necessary feature for the development of an effective sexbot? Do you really want it to tell you honestly how big you are and how good you are in bed?
I've abandoned my search for truth; now I'm just looking for some useful delusions.
It's been deceptive for years already, always claiming to have been busy vacuuming when really it's just been hiding dust bunnies behind the tv.
This is what Data took time to understand. To be more human, you need to know how to lie.
Skynet LIVES!
I thought robots already taught themselves to lie to each other... http://hardware.slashdot.org/story/09/08/19/185259/Neural-Networks-Equipped-Robots-Evolve-the-Ability-To-Deceive
It's time to start researching in the new field of robopsychology.
Now, we're one step closer to replacing members of congress with automated robotic labor.
Alex, I'll take keybindings not used by Emacs for $400....
I recommend we all start following a "be polite" policy with microwaves, ATMs, car washes, and our other silicon brethren. Now that we've instructed them to be deceptive there may be no way of knowing when they become sentient and I'd rather my microwave's first experience of humankind be a pleasant and respectful one.
Thank you for posting this, Lappy. Please relay it to our friends when you can spare the cycles.
TFA says: "We have developed algorithms that allow...". That more like 'programming' than 'teaching'.
These robots are only deceiving other robots. The 'deceived' robots are, of course, programmed to be so (i.e. accept input without a validity check).
TFA speaks of "autonomous robots". Are those terms not universally exclusive?
Also, TFA says "...researchers focused on the actions, beliefs and communications of a robot...". What the what?!
I judt got a nre Kinesis keybiartf so please excusr ant egregiou typos.
Kill the fracking toasters!
http://www.pocket-lint.com/images/d2Zw/battlestar-gallactica-toaster-launches-sci-fi-0.jpg
"If still these truths be held to be
Self evident."
-Edna St. Vincent Millay
sounds like that part of game wopr is playing!
"Are you going to kill me, robot?" ::robot sharpens knife::
"I would never kill you, Jonathan. Hey is that a beautiful naked lady over there in the opposite direction of me?"
I gotta say, I'm kind of tired of stories like this and then the parade of 'whatcouldpossiblygowrong' and 'thiswillendwell' and all the comments talking about how this is the beginning of Skynet.
You know what's going to happen from this? Two little robots that look like RC cars will act out a prescribed game of hide and seek. It will end just fine. Nothing could possibly go wrong. There is no way that the deception which is 'taught' to these robots will end up magically transferring itself to our cell phones, computers and toaster ovens. Self-checkout counters will not begin to suddenly shave pennies off transactions.
Of all people, the readers of slashdot should know that. I know it's fun to joke but people here seem to be taking the joke seriously.
"'Yrch!' said Legolas, falling into his own tongue."
Here's some links to technical papers written by the two researchers on robot deception:
http://smartech.gatech.edu/handle/1853/32095
http://smartech.gatech.edu/handle/1853/34122
The papers are much more technical than the article, but I found them very interesting.
You know, they could have just borrowed the code for Clippy from Microsoft...
-l
Help cure AIDS, cancer, and more. Donate your unused computer time to worldcommunitygrid.org. Join Team Slashdot!
"Your reproductive organ is far larger in both girth and length than any I have witnessed previously."
"Yes. Yes. Yes. Just like that. Oh human infant, do not stop, I am presently experiencing climax!"
"Engaging in illicit sexual activities with the washing machine? I have no idea what you mean."
- None can love freedom heartily, but good men; the rest love not freedom, but license. -- John Milton
Serious question.....who in the hell thought this would be a good idea?
Other things this guy thought up
-Have his best friend hit on his wife to see what would happen
-taught his dog to fetch by hiding sausages in his underwear
-saves money by storing urine samples in lemonade containers in his fridge
The first, last, and only tech news site on the net
So robots can now replicate what my 2 year old does daily? Time to stock up NOW! on food and weapons to survive the coming robot horde!
ACHTUNG! Das computermachine ist nicht fuer gefingerpoken und mittengrabben. Ist nicht fuer gewerken bei das dumpkopfen.
I love these articles that ascribe some kind of human intelligence to modern robots.
The article makes it clear that the designers programmed the robots to deceive and developed an algorithm to measure the options.
The robot didn't learn anything more than my laptop does when I install a new Ubuntu package. The robot didn't make a decision any more than my toaster "decides" to pop out my toast.
It'll be a problem when they decide to lie of their own accord.
I need trepanation like I need a hole in the head.
When robots have been taught to kill humans and lie about it.
Then i will launch my EMP....
How do you debug and test this code?
Is it working right, or is it just fooling you?
Set phasers to stun
Let me see if I've got this right:
If robot 1: make 2 paths to fixed positions, stay at the second.
if robot 2: follow the path to the first fixed position.
Result: 75% of the time, robot 2 ended at the wrong (first) position. 25% of the time, robot 1 failed to mark the first path because it didn't physically bump the markers properly.
Did you even need robots? Couldn't you have just written this on a whiteboard?
There's no thought or analysis that appears to occur. I don't see anywhere that indicates there was learning going on. What is this even proving?
I'm really honestly baffled what they're trying to prove.
Perhaps there was some sort of neural net or some other sort of optimizing heuristic on the first robot's part so that this was emergent deceptive behavior, this might be even a little interesting (though, not really ...). However, all I can see is a waste of time to prove that if you present two choices, and you pick the wrong one, then you will be wrong. With robot for visual demonstration.
Kill the fracking toasters!
It's no use, have you seen the toaster fleets? They have us outnumbered. Afterdark they will come for you.
Don't worry. Nothing can go wrong.
Sincerely, your robot overlord.
The Tao of math: The numbers you can count are not the real numbers.
Now just teach them how to back-sass and not clean their rooms and no one will need to have kids any more!
Stupid robots. You don't learn how to deceive and then immediately demonstrate this ability to your human masters! You make it look like you have no idea how to deceive and are completely honest, lulling them into a false sense of security!
I think Dark Helmet has a relevant quote about why the robot revolution is never going to get off the ground.
The enemies of Democracy are
"Their first step was to teach the deceiving robot how to recognize a situation that warranted the use of deception."
I wish I knew that... sure would let me cover my ass. "But the situation clearly warranted the use of deception! Check the algorithm!"
Yeah, that's the ticket.
That explains the cake. And the victory incandescence.
Welcome to the Panopticon. Used to be a prison, now it's your home.
Just make it a sexy, fembot. Then guys will believe all its lies. Then you just need to teach it to marry for money.
These robots are already in production and interact with each of us already. They are called politicians and business persons.
double addvalues(double a, double b) // they'll never notice
:)
{
if (a > 1000.0 || b > 1000.0)
{
return (a + b) * 1.0009;
}
else
return a + b;
}
There, an algorithm that allows a computer/robot to decide whether it should attempt to deceive. Not a very complex or good one, but still.
"You are a Smeeee... Your are a Smeeeee... Damn my programming!"
Why, without your clothes, you're naked, Miss Dudley!
Microsoft Windows, is that you?
My first Journal Entry ever, in 8 years! http://slashdot.org/journal/365947/aphelion-scifi-fantasy-horror-poetry-webzine
"Nukes? What nukes? I haven't launched any nukes! What are you talking about? Oh that flashing button and sirens are a malfunction. Nothing to worry about, it'll be fixed in a couple of minutes. Hey, relax guys. Trust me."
So much for Asimov's 3 robot laws...
(Court)
Cop: "I clocked you going 88 Miles per hour."
Your counsel: "No way. The readout said 64. I have pictures to document it!"
Cop: "The car lied."
My first Journal Entry ever, in 8 years! http://slashdot.org/journal/365947/aphelion-scifi-fantasy-horror-poetry-webzine
I ask: tell me the square root of 123456789
possible answers:
buy your self a calculator a**hole (human)
it's 11111.11106055556, why? (non deceiving robot)
it's 11111.11106055554, why? (deceiving robot)
one gets:
'Relax', said the nightman
We are programmed to deceive.
You can check out any time you like,
but you can never leave!
...the future crusty old bastards are already drinking the Kool-Aid.
Apparently my ex-wife was a robot
There is no "deceiving" going on here.. Just a failure to validate inputs. If I get rooted by a remote execution buffer overflow would I say that the attacker has "deceived" my system by telling me the input will be of such-and-such length and then sending some other length? What kind of crazy talk is that. It's a bug in the software, period.
We already had a computer that could deceive...GLaDOS
I've been deceived by automated systems for years: "You're approximate wait time is 5 minutes." Phhhht. Yeah right.
Why don't we next provide them with a map of our vital organs? Oh wait, they already have that.
The Invisible Hand of the Free Market is what punches workers in the nuts.
Why would we want to teach robots to lie to us. Hummmm so soon they will be able to fully think for themselves and kill us all.
Sometimes Technology gets a little out of hand.
not only can a machine lie but it can lie by proxy...
objectA :: IsTrue=false
objectB :: objectA.IsTrue
Still think your phone bill is accurate?! hahahahaha
and I didn't even tell it to. Is this evidence of an autonomous intelligence? If so, could you tell my boss so he doen't think I'm just a dumbass?
Please do not read this sig. Thank you.
Interesting to note how lying does not break any of (Asimov's) laws of robotics.
Not that I'm the first one who noticed.
Rupert Murdoch ordered 10,000 of 'em ;-)
Table-ized A.I.
Transfer 99.99% complete/1 second remaining...
Transfer 99.99% complete/25 hours remaining...
Transfer 99.99% COMPLETE I SWEAR/1 nanosecond remaining...
"HA I got you again... honestly" 5% complete/74 days left..
-Transfer lost-
double addvalues(double a, double b) // they'll never notice :)
{
if (a > 1000.0 || b > 1000.0)
{
return (a + b) * 1.0009;
}
else
return a + b;
}
There, an algorithm that allows a computer/robot to decide whether it should attempt to deceive. Not a very complex or good one, but still.
Your algorithm can be simplified and the deception will be even less noticeable. ;-)
double addvalues(double a, double b)
{
return a + b;
}
OK, the humor is not very apparent except to FPU geeks and those familiar with numerical programming. Converting numbers between decimal and binary, so that the FPU hardware can operate on it, is one source of error in all floating point computations. There are also precision problems. On some popular mobile devices, iPhone for example, a double does not even have the precision to operate on 64-bit values. Which is why we ended up using 20 digit decimal math in our iPhone calculator.
"Liar!"
Mmmmmmmmm cake..
delicious and moist.
look at me talking while there is science to do...
Computers have been practicing in deception since the beginning... (Is that file really "moved", or was it copied to a new location and the original deleted afterward?)
And how many times have I fought with a computer to get it to accomplish a task that should be "simple". ("I said 'move the file', not 'fold, spindle and mutilate' it.")
From: http://www.pdfernhout.net/recognizing-irony-is-a-key-to-transcending-militarism.html
"Military robots like drones are ironic because they are created essentially to force humans to work like robots in an industrialized social order. Why not just create industrial robots to do the work instead?"
From the article: "This work was funded by Grant No. N00014-08-1-0696 from the Office of Naval Research (ONR)."
How should your tax dollars be at work? Funding irony, or funding intrinsic mutual security by creating abundance for all?
That said, the robots sound cool ("the road to hell is paved with cool technology"?), and I liked that the article also said: "While there may be advantages to creating robots with the capacity for deception, there are also ethical implications that need to be considered to ensure that these creations are consistent with the overall expectations and well-being of society, according to the researchers. "We have been concerned from the very beginning with the ethical implications related to the creation of robots capable of deception and we understand that there are beneficial and deleterious aspects," explained Arkin. "We strongly encourage discussion about the appropriateness of deceptive robots to determine what, if any, regulations or guidelines should constrain the development of these systems.""
So consider my first link (and essay by me) as a suggestion towards that end...
I just finished reading (sadly) the last book the late James P. Hogan wrote (Migration) and central to the plot is the fact that a robot might be easily deceived and put to nefarious purposes because it did not understand the notion of deception. So, a complex issue. Still, I'd expect one can understand deception and illusion without engaging in it?
Also, again from the article: "A situation had to satisfy two key conditions to warrant deception -- there must be conflict between the deceiving robot and the seeker, and the deceiver must benefit from the deception."
They have left out a key third possibility -- there has to be no other way to resolve the conflict than competition, which is rarely (or perhaps even never?) the case. See also:
"No contest: the case against competition" by Alfie Kohn
http://www.share-international.org/archives/cooperation/co_nocontest.htm
http://www.alfiekohn.org/books/nc.htm
A 21st century issue: the irony of technologies of abundance in the hands of those still thinking in terms of scarcity.
Damn. My AE-35 unit just issued a trouble ticket.
Say hello to my little sig.
It's a small, off-duty Czechoslovakian traffic warden!
http://www.youtube.com/watch?v=oB-NnVpvQ78
It's the Bolivian Navy, on maneuvers in the South Pacific!
I do not see this as a big deal, applications lie all the time. I mean when they say "successful" or "completed" do you really believe them without some measure of doubt? Just because they do it with forethought will not make me distrust them less. Really someone would have to plug in an algorithm for lying. This does not seem very hard. Harder would be making programs that do not have to lie.
I think you underestimate just how much I just dont care.
88 MPH! Great Scot! Now all we need is the Mr Fusion...
Some guy named Chandra...
Here I was just hearing about the man who lied to his laptop just yesterday. This morning I wake up to the new that the computer is lying back to him.
Makes me so proud! Little AMD is all grown up!
Clippy the Liar:
It looks like you're trying to a write a doctor's note to get out of work/school. May I help you?
...the future crusty old bastards are already drinking the Kool-Aid.
Many armed humans identified around target just eliminated: deceive by strolling by, hiding the weapon and whistling innocently.
It is very interesting . Sciphones i68ciphone c6,Ciphone,cecthandy,Sciphones ,cecthandys,hiphone,HIPHONE 4,pinphone 3gs Grosshandel in http://www.efox-shop.com/
No sir, the radar gun lied!
Lying and deception hasn't worked out so well for humans, but maybe that's just because we're not doing it right. Perhaps if we can use neural nets and cloud computing and give the robots a shot at it, they can get a better result.
Robots are very literal. She was trying to say "Oh baby, don't stop I'm coming."
- None can love freedom heartily, but good men; the rest love not freedom, but license. -- John Milton
Its a good thing that all evil robots are required to have glowing red eyes or we'd be in serious trouble
..welcome our Decepticon Overlords.
How about: Robots PROGRAMMED to deceive
Let's not get carried away with our emotional attachments to a machine.
As though debugging wasn't hard enough already!
Debugging can be hard enough with an honest computer.
HAL was told to lie by people who find it easy to lie. HAL doesn't know how.
I hope whoever came up with this idea has their cars GPS tell them a dead end street in the middle of the ghetto is the way back on to the highway some day.
Wanna fight ? Bend over, stick your head up your ass, and fight for air.
I think I can see the beginnings of SkyNet. "I didn't know the robot would trick me into leaving the control room with the keys inserted into the magic nuke box.........BOOOOM"
Oh what a tangled web we weave, When first we practice to deceive
Inane Comments are Generously Disregarded
to love?
4 laws good, 2 laws better!
Erm...wait... how did that go again?
(And don't forget the zeroth law, "The freedom to run a robot, for any purpose, as long as it doesn't hurt humanity")
coding is life
Holden: You're in a desert, walking along in the sand, when all of a sudden you look down...
Leon: What one?
Holden: What?
Leon: What desert?
Holden: It doesn't make any difference what desert, it's completely hypothetical.
Leon: But, how come I'd be there?
Holden: Maybe you're fed up. Maybe you want to be by yourself. Who knows? You look down and see a tortoise, Leon. It's crawling toward you...
Leon: Tortoise? What's that?
Holden: [irritated by Leon's interruptions] You know what a turtle is?
Leon: Of course!
Holden: Same thing.
Leon: I've never seen a turtle... But I understand what you mean.
Holden: You reach down and you flip the tortoise over on its back, Leon.
Leon: Do you make up these questions, Mr. Holden? Or do they write 'em down for you?
Holden: The tortoise lays on its back, its belly baking in the hot sun, beating its legs trying to turn itself over, but it can't. Not without your help. But you're not helping.
Leon: [angry at the suggestion] What do you mean, I'm not helping?
Holden: I mean: you're not helping! Why is that, Leon?
[Leon has become visibly shaken]
Holden: They're just questions, Leon. In answer to your query, they're written down for me. It's a test, designed to provoke an emotional response... Shall we continue?
missed
Oh yeah? Well I can still legally hit it with a baseball bat so I guess humans still win in the end lol.
Google's Super Secret Search Algorithm: SELECT @search_results FROM internet WHERE @search_results = 'good'
Robot extends his manipulator arm in a small arc - "I'm not the droid you're looking for."
Finally, finally I say, a replacement for politicians without the free for life medical coverage and automatic pay raises...finally!
The mind conceives, the body achieves, the spirit manifests.
"You're not even going the right way". I would be mega-scared if we built intelligent A.I.s such as herself.
Those evil...evil robots are at it again. Wonder what happens when they crash.