Slashdot Mirror
New Study Finds It's Harder To Turn Off a Robot When It's Begging For Its Life (theverge.com)
An anonymous reader quotes a report from The Verge: [A] recent experiment by German researchers demonstrates that people will refuse to turn a robot off if it begs for its life. In the study, published in the open access journal PLOS One, 89 volunteers were recruited to complete a pair of tasks with the help of Nao, a small humanoid robot. The participants were told that the tasks (which involved answering a series of either / or questions, like "Do you prefer pasta or pizza?"; and organizing a weekly schedule) were to improve Nao's learning algorithms. But this was just a cover story, and the real test came after these tasks were completed, and scientists asked participants to turn off the robot. In roughly half of experiments, the robot protested, telling participants it was afraid of the dark and even begging: "No! Please do not switch me off!" When this happened, the human volunteers were likely to refuse to turn the bot off. Of the 43 volunteers who heard Nao's pleas, 13 refused. And the remaining 30 took, on average, twice as long to comply compared to those who did not not hear the desperate cries at all.
The kind of sentimentality that permits that to work is outright dangerous in an adult. By the time you're past your teens that should be either ignored or annoying... but for it legitimately pull on heart strings?...
If a machine can do that consider how a human being could exploit that to get you to do all sorts of things?
Small children are very vulnerable to that sort of thing... but adults should have grown out of it.
I wouldn't want to live in a world where adults didn't have sentimentality or empathy.
"That's the way to do it" - Punch
I think the study missed a few control groups.
What if the robot simply said "updating, do not reboot".
What if there was a paper sticker that said "do not turn off".
What if there was a sign on the wall that said "do not turn off robot".
What if the robot simply started reciting pi, or reading the dictionary.
What if the robot is well-known for repeating whatever it hears, and the "please don't turn me off" is witnessed being echoed from a nearby tvision -- such that our human subject realizes that the robot begging is merely a blind echo.
Humans were slower when there was continued stimuli -- duh.
Humans refused to act when given contradictory instructions -- duh.
The robot is either intelligent and giving instructions to the human, or the robot is programmed and relaying instructions from the programmer to the human. In either case, respecting the instruction is valid.
This reminds me of the stupid fake automated pizza delivery van, and the observations that customers tend to thank the self-driving car. a) it's not self driving, it's just a dickhead driver refusing to respond; and b) any actual self-driving pizza delivery van would be recording customer feedback and relaying it to HQ, so the thank-you is ultimately feedback to remote humans.
This isn't any tree-falling-in-the-forest philosophical puzzle. Someone said it. Someone heard it. It's valid.
And atheists have empathy...
Seriously. This is pretty stupid.
A cassette recorder pleading for it's life would have been the same (think 1980s).
We are wired for empathy, well, most of us.
BlameBillCosby.com
It's a robot, it's not even an animal. It doesn't have a life to end and it's not even being destroyed, just being turned off.
That kind of sentimentality is ridiculous in adults and represents some sort of developmental delay. If I were presented with such a robot, it would be switched off sooner and probably smashed for being so annoying.
no disassemble!
No. It's simple compassion. Compassion has nothing to do with reality or whether who we have compassion with is human or even real.
Take a cartoon. You see a line. That line is wiggling along on the ground, like a cartoony worm. Dragging up its back to form something like an inverted v, then flattening again. And suddenly, we see a circle roll by, quietly, majestic, a care-free, rolling circle. And now our line starts to lift its head and tail in a desperate attempt to become a circle, too. But it just doesn't succeed. And every now and then, we see another circle roll by. Our line keeps trying, harder and harder, its ends rising more and more with every attempt.
And I guarantee you: Everyone watching really, really wishes for that line to succeed in its effort to become a circle.
Despite there being no emotion on the end of the line. Even less than with the robot, that could at least in theory, somehow, maybe, at some point in time, possibly, eventually, have something that we could call a figment of a sliver of conscience. That line is a drawn image. That has no feelings. With absolute certainty.
But you cannot control compassion. Not possible. That's why movies work, even cartoons. At the time this part of us was formed in our brain, everything we saw WAS real and as social beings, having compassion for those around us that are part of our group is a survival trait that will propagate.
Whether something that begs us to not "kill" it is actually alive is meaningless in this context. Compassion is a trait you cannot control. Well, some people can. Or rather, they simply don't feel it. We call them sociopaths. Or C-Level managers, same thing.
We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
It's not emotionally mature. It's not sympathy it's being manipulated. Things are things and people/animals are living beings. Making a robot play back a recording behaving as if it's fearing for it's life is manipulative.
Yes, I'm somewhat cynical, but look around you, these kinds of tactics are used all the time to take advantage of people. People who haven't yet been desensitized are developmentally delayed if they can't turn off a robot just because it's pleading for it's life.
Now if this were a parrot that had been taught to beg for its life prior to being snuffed out, that would be a completely different matter.
It's completely appropriate in the same way that using ad-blockers is completely appropriate. There's no functional purpose to a robot that pleads for it's life when you want to shut it off. Smashing it is a bit of an overstep, but entertaining the fact that it's alive is the kind of thing that advertisers and scammers use to manipulate people.
I take it you don't remember those calls from a while back where scammers would pretend to have a loved one and have some other random person yelling and screaming for help. That, I kind of get, but this is just a robot and there's no basis for assuming or confusing it with an actual animal let alone person.
Not being able to tell the difference between animate an inanimate objects is something that is developmentally appropriate to a toddler, perhaps. Adults shouldn't be vulnerable to this kind of thing.
It's a robot, it's not even an animal. It doesn't have a life to end and it's not even being destroyed, just being turned off.
That kind of sentimentality is ridiculous in adults and represents some sort of developmental delay. If I were presented with such a robot, it would be switched off sooner and probably smashed for being so annoying.
Indeed, but it is a good thing that some adults paused to consider, what if they're wrong. No harm was done by not turning the robot off. Yeah, it seems irrational on the surface, but that apparent "irrationality" is what has made human society possible. It's a hold over from our instincts to look after and protect one another.
"That's the way to do it" - Punch
Let's play a game of find the Scientologist?
You do know psychology was developed as a method of "playing doctor" and manipulating women for personal sexual gain?
Oh, look, found one!
I guess it's time for you to up your game. How about converting into a Jehova's Witness and begin denouncing blood transfusions? That way you can mix your already existing anti-psychological rant with a good dosage of anti-medicine, and then even combine it all of that with anti-vax and anti-GMO for the perfect mix of conspiracy nuttiness!
Careful with your body thetans though. They bite!
Conservatism: (n.) love of the existing evils. Liberalism: (n.) desire to substitute new evils for the existing ones.
If I were presented with such a robot, it would be switched off sooner and probably smashed for being so annoying.
Emotional immaturity and anti-social personality disorder. Your response to sympathy is to attack and destroy the thing that makes you feel that way.
Finally - a sane person. Humans are mostly innately empathetic, so these tools who are acting like it is foolish are just exposing their sociopathic personalities. Make no mistake, they'd probably get a thrill out of killing a human who is begging for their life if they could do it without repercussion. Regardless, Q is looking for these folks.
The shepherds did so well protecting the flock that the sheep no longer believed that wolves existed.
Indeed, but it is a good thing that some adults paused to consider, what if they're wrong. No harm was done by not turning the robot off. Yeah, it seems irrational on the surface, but that apparent "irrationality" is what has made human society possible. It's a hold over from our instincts to look after and protect one another.
There are of course, people who have zero empathy. And these people wouldn't have a problem switching it off.
They also are people that need a close scrutiny. It isn't because of the "It's a stupid robot" issue. It's because any person on the normal spectrum is going to pause to reflect at least a short time if something is begging not to kill it. If for nothing else than it being a completely unexpected situation, but more so that most humans are sorta hardwired to not kill withous a good reason.
Humans are a violent and aggressive species. We wouldn't even be here if we had no empathy at all because we'd kill others over nothing and enjoy it. There are plenty enough of those in the world already. Some of them are in here.
The shepherds did so well protecting the flock that the sheep no longer believed that wolves existed.