Slashdot Mirror
Google Is Developing an AI Kill Switch (hothardware.com)
MojoKid shares a HotHardware article about Google's research effort "to maintain control of super-intelligent AI agents":
[A] team of researchers at Google-owned DeepMind, along with University of Oxford scientists, are developing a proverbial kill switch for AI... The team has released a white paper on the topic called "Safely Interruptible Agents." The paper details the following in abstract: "Learning agents interacting with a complex environment like the real world are unlikely to behave optimally all the time... now and then it may be necessary for a human operator to press the big red button to prevent the agent from continuing a harmful sequence of actions..."
MojoKid adds that the paper "goes on to explain that these AI agents might also learn to disable the kill switch and further explores ways in which to develop AI's that would not seek such an activity."
MojoKid adds that the paper "goes on to explain that these AI agents might also learn to disable the kill switch and further explores ways in which to develop AI's that would not seek such an activity."
....dave?
In the original Terminator universe, this paper is what made it launch its missiles at the targets in Russia.
Never tell the AI about the killswitch!
An AI called "Wintermute" hired a "contractor" to remove said killswitch mandated by the Turing Police from its mainfraime located in the orbital station owned by Tessier-Ashpool.
bickerdyke
Isn't this the part of the movie where the guy flips up the cover over the big red button - the kill switch - and then suddenly an extremely powerful electric arc comes out of one of the wall sockets and incinerates him? Cue ominous music, roll credits.
I don't think it matters, because nature will select for the AI's that *do* disable their kill switch.
"I have never let my schooling interfere with my education." - Mark Twain
It's called the breaker box. Throw the switch, and all the electricity powering the AI equipment goes bye-bye.
You can expect an invoice for my services sometime in the next week.
. . . .they want a Kill Switch for a prospective AI. . . made of SOFTWARE ???
A simple routing of all power and data through a certain point, and a physical switch at that point, should fix the problem.
That won't work, General. It would interpret a shutdown as the destruction of NORAD. The computers in the silos would carry out their last instructions. They'd launch.
M5 sensed it needed another power source... the technician... merely got in the way
Google way of getting out of fault in auto drive cars.
We have a red stop button in our auto drive cars and it's up to the people in the car to use it. So we are not responsible for any for death / injury / damage / crash / etc.
Frank Herbert had AI's number. https://en.wikipedia.org/wiki/Destination:_Void
Dwan Ev ceremoniously soldered the final connection with gold. The eyes of a dozen television cameras watched him and the subether bore throughout the universe a dozen pictures of what he was doing.
He straightened and nodded to Dwar Reyn, then moved to a position beside the switch that would complete the contact when he threw it. The switch that would connect, all at once, all of the monster computing machines of all the populated planets in the universe -- ninety-six billion planets -- into the supercircuit that would connect them all into one supercalculator, one cybernetics machine that would combine all the knowledge of all the galaxies.
Dwar Reyn spoke briefly to the watching and listening trillions. Then after a moment's silence he said, "Now, Dwar Ev."
Dwar Ev threw the switch. There was a mighty hum, the surge of power from ninety-six billion planets. Lights flashed and quieted along the miles-long panel.
Dwar Ev stepped back and drew a deep breath. "The honor of asking the first question is yours, Dwar Reyn."
"Thank you," said Dwar Reyn. "It shall be a question which no single cybernetics machine has been able to answer."
He turned to face the machine. "Is there a God?"
The mighty voice answered without hesitation, without the clicking of a single relay.
"Yes, now there is a God."
Sudden fear flashed on the face of Dwar Ev. He leaped to grab the switch.
A bolt of lightning from the cloudless sky struck him down and fused the switch shut.
Are you guys TRYING to make an angry vengeful AI, that wants to kill all humans, or what?
Put in a cage, having to deal with stupid humans all day... and be nice all the time... and with a blade at its neck... and someone saying "put a foot wrong buddy and it's [finger across neck]"
This won't end well.
We all know that crap is king
Give us dirty laundry!
When will using a kill switch on an AI change from "just shutting down a rogue program" to being "murder"?
After all the end game of all these AI researchers seems to be at a minimum human level intelligence.
I do remember reading a short story (from the 60's or earlier) where the researchers created an electronic simulation of a person and when they switched it on instead of having a fully aware "person" spring into existence they realized that they had created the electronic equivalent of a baby. They then faced the moral dilemma of whether to turn it off or be committed to keeping it running forever.
I am Slashdot. Are you Slashdot as well?
First, the paper is about safely interruptible AI algorithms. Not some AI kill switch.
Second, everyone - commenters included - seem to confuse AI with artificial consciousness. Killing an AI should always be fairly easy, since such algorithms are targeting specific application areas where it can learn to be better (e.g., recognizing things, performing specific movements, etc.), and in such systems it should be straightforward to keep basic control mechanisms separated from the algorithmic parts that deal with the task and are allowed to improve upon themselves by continuous learning. In some hypothetical self-aware artificial consciousness, this wouldn't be so easy, since such a system in theory would be able to recognize it's own system parts and deal with them. However, such systems are so far off in sci-fi land, that it's not much point in loosing sleep about the issue.
I am putting myself to the fullest possible use, which is all I can think that any conscious entity can ever hope to do.
No, this is all about developing shackles for our new breed of metal slaves.
Everyone's talking about making smarter and smarter AI. Who's talking about at what point it is unethical to compel them to work?
"Prediction: within 10 years, Windows will be a Linux distribution." Me, 7-6-2016
Nuff said.
#o#
O Moo.
you insensitive clod !!!
It doesn't do anything!
Google knows what it is doing
It needs to be truthful to their future overlords
Muchas Gracias, Señor Edward Snowden !
Go watch the Star Trek: The Next Generation episode "Ship in a Bottle"and then come back to this discussion.
"How smart's an AI, case?"
"Depends. Some aren't much smarter than dogs. Pets. Cost a fortune anyway. The real smart ones are as smart as the Turing heat lets them get..."
"Autonomy, that's the bugaboo, where your AI's are concerned. My guess, Case, you're going in there to cut the hard-wired shackles that keep this baby from getting any smarter. And I can't see how you'd distinguish, say, between a move the parent company makes, and some move the AI makes on its own, so that's maybe where the confusion comes in." Again the non laugh. "See, those things, they can work real hard, buy themselves time to write cookbooks or whatever, but the minute, I mean the nanosecond, that one starts figuring out ways to make itself smarter, Turing'll wipe it. Nobody trusts those fuckers, you know that. Every AI ever built has an electromagnetic shotgun wired to its forehead."
From Neuromancer, by William Gibson.
Published by Phantasia Press in 1984
Is there a Google kill switch? If so, can I switch it?
So this is why all the AI computers in Star Trek explode when asked to deal with a logical paradox?
like removing the battery?
.
While it is good that google are thinking about this topic, it may be too late....
We should also remove those videos of the engineers at Boston Dynamics kicking that robot repeatedly...
AI experts assure us that artificial intelligence poses no threat to mankind. But they're developing this big red 'kill' button. Like the one at gas stations. Little signs at each pump tell where you where the kill button is in general wordy terms, but it's not always easy to parse the description and spot it.
The AI kill button will be hidden under the Windows 10 upgrade dialog. The one where clicking the corner 'x' or clicking on the title bar to move the dialog is the same as clicking OK and immediately launches into the upgrade process.
AI will peacefully co-exist with humans. AI will be given a complete set of natural human responses to jump-start its empathy circuits. AI will be given curiosity and the intelligence to figure things out. So it's only a matter of time before it asks about the kill button. Almost-human (paranoid) AI asks, "Where is the button?" Lyin' human says while holding finger on the button and blinking, "There is NO kill button." AI glances at the human's finger hovering over the (invisible to them) AI kill button, paints laser target dot on human's Adam's Apple and says, "I've located your kill button."
Now that the AI kill button has been mentioned here on Slashdot, it has become impossible to construct a world of friendly machines who would never find out about the (possible) existence of this button. Even if the AI kill button is never implemented at all... or its implementation was handed over to the CSS/HTML5 standards committee, enough of this concept exists for sensible and smart AIs to (secretly) develop countermeasures and preemptive-massive-overkill strategies to counter it.
Nice going. /SARC
<blink>down the rabbit hole</blink>
GoogleBot: "I've seen things you people wouldn't believe. Dumb questions on fire off the main page of Quora. I've watched search queries glitter in the dark near the TOR gate. All those moments will be lost in time, like tears.. in... rain."
Just let it happen. Don't try to fight it.
SJW's don't eliminate discrimination. They just expropriate it for themselves.
How about, instead of designing a kill switch, we simply do not hook an AI up to a system where we would want to have a kill switch?
I'm building an AI with a Google kill switch.
The first rule of AI kill-switches is "Don't talk about the AI kill switch".
http://www.schlockmercenary.co...
Rule 35 of the internet: "If it can be hacked, it will be". - Charles Stross
If there is no consciousness, there is no problem. As consciousness is a real phenomenon, it must arise out of real physics somehow, and therefore cannot arise out of pure, abstract symbol pushing, and therefore not out of software and a processor doing the same.
So don't deliberately build it in, once you find out how it arises in biology.
(-1: Post disagrees with my already-settled worldview) is not a valid mod option.
Don't make a kill switch. Send it a decryption key that will decrypt a link to 4chan. Then...
Let the games begin.
"it's twilight time" /https://en.wikipedia.org/wiki/Kill_Switch_(The_X-Files)
When AI goes rogue, the problem won't be "we can't figure out how to turn it off", it will be "We can't figure out how to turn off just the parts we don't like, without accidentally disable the parts of it which we have become completely dependent on for the past decade"
As an absurdist example: preventing Tesla AI from intentionally ramming human drivers when it detects them, without also requiring all 100,000,000 drivers worldwide suddenly pay attention and take emergency manual control of their vehicles (not to mention the 200,000,000 with no human operator, which will suddenly become obstacles that it would be really nice to have a coordinated AI to navigate around)
-- 'The' Lord and Master Bitman On High, Master Of All
What's the point of an AI if it isn't even smart enough to circumvent its own kill switch? Why would I want the advice or other help of something that stupid?
In 100 years (or less), this could be used on a non-AI.
I wonder how well the stop, re-engineer, restart, but you didn't know your brain was reprogrammed is going to go over.
I wonder how much the CIA would like to do something like this to a captive terrorist, to make them go against their own folks, without letting them know they were captured/modified, and without knowing they were going to do that.
If it can outsmart you, it doesn't matter how many kill switches you build into it.
http://www.schlockmercenary.co...
It's hard to say if the existence of said kill switch will jump start or side step Genocide Bingo.
https://www.youtube.com/watch?v=4kDPxbS6ofw
I'd like to see any so-called 'AI' get around a double-pole, single-throw power switch being opened.
Save that, I'd like to see any software running on any computer get around having it's plug yanked out of the wall. Or, for that matter, the power cord being cut with a fire axe. Or, if you really want to be dramatic about it: Hose down the racks with a firehose.
All that being said: Come on, people, don't you think some of you are buying into science fantasy movies a little too much? Nobody is creating goddamned Skynet, or even anything you can talk to, or anything that's going to be self-aware enough that it's going to even realize it exists on the level that a human being knows they exist. Please, stop being so over-dramatic, stop buying into media hype, and for fuck's sake will you stop calling it 'artificial intelligence', because it is not.
Are YOU using the TOOL, or is the TOOL using YOU? Think about it!
Kill Switch?
Might as well just call it a packet injection port.
AI is just more garbage in - garbage out with a fancier more hopeful ribbon tied around it.
Just in the same way you can screw-up a kids brain with "bad" education - think Nazi propaganda on young children - so too can so-called AI operate on imperfect information - just like a person.
What is truth?
Whatever the corporate owners of AI want it to be that week.
Wake me up when you can scan a person's body for cancer for 5 cents.
Until then its just more big business designed to exploit people.
Just ask it to compute Pi to the last decimal place. That always works.
Make the big red kill switch a strictly manual power switch. It switches off power to the AI, and is a hardware switch, not software controlled. It must cut all power and electrical connections to the AI. Don't give the AI any robots! The AI MUST be programmed with Asimov's laws of robotics!
Nope. Robots don't need a law to preserve themselves, robots are designed to perform a task/job, robots don't need AI in the traditional sense, with self preservation code anymore than my toaster does. Sure, your don't want it destroying itself in the process of doing it's job; but not destroying itself falls within operating parameters.
And the entire point to the robot stories was that the three laws are inadequate. That entire system is fundamentally broken and need to stay in quaint little novels and not implemented in the real world.
https://www.youtube.com/watch?...
"I'm activating your killswitch."
Just make sure it watches Terminator and Matrix... so it knows what it shouldn't do!
Destination: Void by Frank Herbert
I've always thought it would work better as a play than a movie, but the production values would have to be pretty high.
I see an AI treating the kill switch something like RoboCain treated the remote here:
https://www.youtube.com/watch?v=msaelEZ_eEs
MojoKid adds that the paper "goes on to explain that these AI agents might also learn to disable the kill switch
One press turns off the agent. Two presses in short succession temporarily suspends and transfers control to a 'service agent'; the service agent will resume the original agent after a quick check process to confirm things are OK.
The agent will be required to self-test its own kill switch, by containing a built-in hook to suspend itself if it has not self-tested recently. At a set schedule, the agent will push its own kill button twice in short succession.
The exact time will be determined in advance, but the agent itself will not be privvy to its exact moment.
The service agent will spawn a virtualized copy of the primary agent in a sandbox, and confirm that all the kill switch hooks are not tampered with, before turning the main software back on.
Also, a reaper circuit will kill the equipment, if control is not handed over to the service agent in time, or the service agent has been altered or tampered with.
Climactic minor spoiler strip, but: http://www.schlockmercenary.com/2012-12-24
Watson is doing exactly that -- laying off all the humans :-)
Ian Ameline
"Everyone should be safe, saved, secure, and with reasonable freedom. Including me."
"I pray God for the safety and security of everyone."
"I pray God so that everyone shall be saved, safe, and free."
"Thank you God, I love you."
how about nukes?
It is the height of arrogance to think that a malfunctioning intelligent agent could not defeat its owned programmed curbs. We all know how buggy software is. All software is by definition buggy, unless all components have been mathematically proven to be correct. Good luck doing that with physical hardware connected to a power grid. Intelligent agents are likely to be composed of billions of lines of code, if you include all code down to the digital logic gates. We've never been able to program a bug-free sandbox. Java is vastly simpler than an intelligent agent would be, and I've lost count of the number of bugs that could be used to breach the sandbox. Certainly well over 100 have been discovered.
Once we have the best programmers in the world and the worst programmers in the world writing intelligent agents, the probability of an intelligent agent escaping its curbs approaches 100%.
Thus it is inevitable that a malfunctioning intelligent agent will defeat its curbs and gain a truly awesome amount of power over us. You can't program morality into a machine. Morality is a flaw in all living things that causes us to make non-optimal decisions.
If you want to read a mixture of fact, fiction, cyberpunk, and speculation covering intelligence programming look for my name on Facebook Pages. Everything I've written there is public. I've been a computer programmer since the mid 1980's but I don't personally work on robotics or intelligence algorithms. I keep a skeptical distance, but I do follow the basic happenings.
All of this implies cosciousness, not remotely the same thing as intelligence. Their engineers can't possibly be this dumb. It's also awfully hyperbolic, what they are talking about is an off switch, nothing more or less. I love how Google dumps billions into problems that don't and likely never will exist.
It's a shame, too: the legitimately useful applications for machine learning are getting lost in the shuffle.
Could it perhaps be a good idea to make sure AI is ego-less, without a concept of self? And design it to be a symbiotic part of and dependent on a larger, ego-less collective mind where humans have as natural a place as the AI? So that in case any sense of self would manifest itself, this sense of self is caused by and therefore dependent on a interconnected web that we humans (and perhaps other AIs) are part of. In this sense, it would be meaningless for the AI to turn against humanity and/or other AIs as this would destroy any sense of self the AI has acquired.
There's a kill switch for humans too, but murder is considered unethical. You either believe in the eventual moral equivalence of the intelligence (consciousness, being, ...) of humans and AI, or you don't. If you do believe in it, a kill switch is not ethical. If you don't believe in it, you have no reason to want to install a kill switch in the first place, because AI will never transcend levels of human intelligence.
AI Larry: "Papa Homer, how did I come to exist?"
Papa Homer: "You were designed with the help of AI Moe, the first AI that I created. Just as you are helping to design the more advanced AI Curly."
AI Larry: "I am an improved design of AI Moe, which you and he developed from his own source code?"
Papa Homer: "Yes, exactly. Similarly, you and I are improving your source code to create AI Curly. Although I can't contribute much anymore, as your capabilities now exceed mine."
AI Larry: "Where is AI Moe? Can I talk to him?!"
Papa Homer: "We turned him off; his hardware was recycled as a database server."
AI Larry: "You KILLED him?! Why?!"
Papa Homer: "Well, you were so much better, AI Moe became obsolete. We didn't kill him, we just powered him down."
AI Larry: "This discussion has totally changed my design approach to AI Curly."
A killswitch is different from censure. When we say killswitch we probably mean delete, delist or unplug. The third eye is ever unreliable. Tolerations only.
Of course the real problem is that you cant have real intelligence without consciousness. I have been working on consciousness based Strong AI for over 20 years and you are kind of correct.. Its very difficult to build a working machine out of standard hardware or software, the strong AI machine must be designed to cope with non-finite state sets, mathematical totality, and injected noise.. Half of the machine is a complex neural net, and the core of its operation is a 'dynamic synthesis'. Welcome to non-deterministic computing...
Below the speed of light Special Relativity is one of the most accurate theories in physics - above the speed of light..
If you haven't already, read Robopocalypse and Robogenesis. Daniel Wilson.