Killer Robots Would Be 'Dangerously Destabilizing' Force in the World, Tech Leaders Warn (washingtonpost.com)
Thousands of artificial intelligence experts are calling on governments to take preemptive action before it's too late. The list is extensive and includes some of the most influential names in the overlapping worlds of technology, science and academia. From a report: Among them are billionaire inventor and OpenAI founder Elon Musk, Skype co-founder Jaan Tallinn, artificial intelligence researcher Stuart Russell, as well as the three founders of Google DeepMind -- the company's premier machine learning research group. In total, more than 160 organizations and 2,460 individuals from 90 countries promised this week to not participate in or support the development and use of lethal autonomous weapons. The pledge says artificial intelligence is expected to play an increasing role in military systems and calls upon governments and politicians to introduce laws regulating such weapons "to create a future with strong international norms."
"Thousands of AI researchers agree that by removing the risk, attributability, and difficulty of taking human lives, lethal autonomous weapons could become powerful instruments of violence and oppression, especially when linked to surveillance and data systems," the pledge says. "Moreover, lethal autonomous weapons have characteristics quite different from nuclear, chemical and biological weapons, and the unilateral actions of a single group could too easily spark an arms race that the international community lacks the technical tools and global governance systems to manage," the pledge adds.
"Thousands of AI researchers agree that by removing the risk, attributability, and difficulty of taking human lives, lethal autonomous weapons could become powerful instruments of violence and oppression, especially when linked to surveillance and data systems," the pledge says. "Moreover, lethal autonomous weapons have characteristics quite different from nuclear, chemical and biological weapons, and the unilateral actions of a single group could too easily spark an arms race that the international community lacks the technical tools and global governance systems to manage," the pledge adds.
>> introduce laws...with strong international norms
Why not structure it like the international mine treaty? You know, the one that pretty much everyone except the USA has agreed to.
(rolls eyes at idea that Russians/Chinese won't use AI-augmented weapons to their full advantage)
Do these dummies have any idea that the words they're saying are not going to discourage anybody making decisions, but simply encourage them to increase investments?!
If that is the goal, they could also probably do it honestly by talking about the benefits.
If you use a word like "disrupt" or "destabilizing" to an average person on the street, they might think the word sounds bad, but people who dream of ruling the world don't feel the same way about these words.
what about an no nuke back? but then skynet can just wipe out
USSR
China
So it's ok to create a machine that knows how to subdue someone with a tazer/firehose/bean bag shotgun.
And it's entirely someone else's bad karma if they swap out the gear for a gun/flamethrower/slug?
Sounds legit. Let's get this party started, there's money to be made.
When down on their luck, people will write malicious AI for financial gain. Make sure the amount of money you can earn from ethical AI exceeds that of bad.
It is too late.
The shepherds did so well protecting the flock that the sheep no longer believed that wolves existed.
Whomever makes it first wins.
If everyone else promises not to, then it is a huge win for the sole owner.
I don't see anything outside of the biggest and most scared of each other being the ones that own the technology.
If you tell me that China or Russia aren't making these right now, I will think you are not thinking clearly. Of course they are.
And Boston Dynamics happily carries on creating robots that will kill us all. They don't care about treaties or anything. They have way too many billions invested to stop.
I hope everyone hasn't been training by watching people escape robots in every movie because that's not how it will go.
Is a good robot with a gun. If you take the guns away from the good robots, then only the bad robots will have the guns.
Humans have an innate need to kill other humans. Call some group the "other" and it's off to war. We've done it since we came down from the trees. We've never stopped doing it. We will continue to do it. It will probably be the source of our extinction as our Lizard brain uses our higher thought process and the technology that enables our technology to send us out in a blaze of glory. And a lot of people will celebrate that moment.
The shepherds did so well protecting the flock that the sheep no longer believed that wolves existed.
The biggest autonomous "robots" deployment is going to be fully autonomous cars. Many pundits are predicting that autonomous cars are the future and once you have autonomous cars, owning a car would be lot more expensive than ride sharing services. They are predicting that US car ownership can reduce by 50-80% and ride sharing services running millions of autonomous cars. Imagine if someone can break into a large ride sharing service and start all the autonomous cars and direct them on pedestrians... It can be far worse than 9/11.
It's not the killbots that are gonna get ya, it's the sexbots that are going to lead to your extinction.
the preceding comment is my own and in no way reflects the opinion of the Joint Chiefs of Staff
It's like they think the rest of the world is stupid and would just willy nilly make weapons of mass destruction that could wipe the whole human race off the.... planet.... oh.
what if the gun is the robot? Why does the robot have to have the gun why not the other way around
Comment removed based on user account deletion
Create killed Robots.
Putin pinkie promised!
And a killer robot with a nuke? Just saying.
You are welcome on my lawn.
I look forward to fighting something that can fly and see in the dark with super human agility and accuracy.
Fuck yeah!!
Beings these can be more localized it would be really easy to cover up their use. Also the local area and resources are still usable. So I can see govts more willing to use these then nukes.
All post-1970 air defense systems are largely autonomous. I-HAWK had an autonomous mode in 1981. Patriot and S-300 make target selection and launch decisions on their own. HARM picks it's own target if it loses the designated target radar. AI is already fielded and working.
A blast of 1 million Celsius is enough for killing everybody that did habitat on the Earth.
I propose to dismantle every ICBMs before of that a therminator can act against every us.
The next age will be for the Great Devil in Armageddon.
Right now, today,
the most 'dangerously destabilizing force in the world' is
American Democracy.
And the technology that manipulates it.
Not killer robots.
Or genetically modified dinosaurs.
Or sharks with friggin lasers.
It's the tech that makes US voters stupid.
Could you imagine how amateur killer robots can change politics?
You could rewrite that 70 years in the past and substituting "Killer Robots" by "Nuclear weapons", and make the same arguments, and even some arguments being proven right in hindsight.
But technology will mature when it's ready to do so, and no amount of hand-wringing will change that. And anyway, if I they want to choose a dangerous tech to get all anxious about, hands down it should be "genetically engineered viri" rather than "killer robots". At least with a robot you can shoot back.
Rome taught me patience and assiduous application to detail. Virtues which temper the boldness of great, general views.
I mean random hackable little killers wandering the planet? I LOVE Black Mirror
Be Excellent To Each Other
The problem is that autonomous weapons (AWs) will confer such a winning battle advantage to whomever has them, that whomever doesn't have them might as well be unarmed.
I don't see a realistic choice to developing autonomous weaponry because of that--not developing them will be equivalent to conceding any future battle to people who did NOT play by the rules.
That is, unless we use nuclear weaponry to retaliate for use of AWs.
The ONE consolation I have is that considering developing AWs, my biggest target for them would be other AWs. I wouldn't bother designing them to kill people for the most part--winning battles is the objective, not pointless slaughter.
But Rick, hand-to-hand combat was brutal and bloody and and and.. so uncivilized! Gaping bloody wounds, severed limbs and heads, OMFG THE HORROR!!!
EXACTLY. Let's make war so horrifying, so extreme, so UGLY, that no one will be able to stand it. Since there won't be modern things like cannons or other explosive projectiles, having embedded photojournalists in the field would be relatively safe -- and in fact, I would make them MANDATORY, with daily updates of the carnage and death and utter horror that is war. Give it six months, a year at most, and every nation on the planet who is involved in wars will be pressing for peace negotiations.
..if only I had the power to make this happen and enforce it.
War is war.. you can put all the rules on it that you like, but when the chips are down war has no rules.. period. Someone WILL do this.. and the technology will get out. The world changes and we must adapt to it.
Captain Obvious spoke true words once again.
We suffer more in our imagination than in reality. - Seneca
Warnings about military and political catastrophe by people who know nothing about the military, or politics, and automatically assume that anyone who does must be evil and stupid.
How could we possibly survive with the infinite wisdom of Silicon Valley! Just ask them.
In other words, it's a day that ends in "y."
This is a complete non-story. There's no content. They're not wrong, so much, as they have nothing to say at all.
That's kind of the idea. Weapons are just boomboom delivery systems. IMO a tank is really just a big gun, with checkboxes for wheel/armor extras.
Bots will also be guns-with-feet, except autonomous.
You can't stop the Trumpets, Putlins, Hitlers and Kims of the world, otherwise we wouldn't have them.
FTFY.
Seriously, the rich are already thinking about a post capitalist society where the working class doesn't factor in. Automated weapons are the way to go. You keep a few engineers on staff to monitor them and pay the engineers well. Unlike the captains of your private military they lack the ambition and charisma to overthrow you.
Meanwhile the rest of us will just be screwed. Think living like the American Indians on the res except without the casinos. If you want to prevent that now's the time. Start demanding a decent quality of life for everyone. Establish it as a basic human right. Or cast your eyes to the reservations circa the 1900s because that's your future. Me? I'm 40 and come from a short lived family. I'll be long gone.
Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
World Leaders Would Be 'Dangerously Destabilizing' Force in the World, Killer Robots Warn
Comment removed based on user account deletion
I've been playing a lot of Fallout 4 lately and I can state that quick action with a tricked out shotgun can usually prevent the nuke from getting used.
Drones are efficient killing machines that cost less money. But people are lazy and greedy, they like huge budgets so they can drop million dollar missiles then pocket the rest.
grade arguments.
I'd suggest to all of them, they'd better fix their products before dreaming in some sci-fi movie concept from the 80s.
We know it is going to happen so just build IG-88 already ðY
I don't want to send my kids to go get shot by robots.
I would MUCH rather send robots to go get shot by robots.
Israel and China have impressive weapons in the field already.
I'm not worried about governments. Wait until the NRA, on Moscow's orders, starts advocating for selling killer robots with nukes at Wal-Mart.
You are welcome on my lawn.
That's the real concern. Not that they'll Skynet us, but that the political pressure that keeps us out of conflicts go away when there are no bodybags.
There are already sentry guns. We can already program drones to drop payloads autonomously. We already have killer robots, and we do not even need AI to make them.
"You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
Very few devices today are truly open source software free. The open source community should start rolling anti-weaponization provisions into all open source licenses. Problem solved.
Unless AI robots get vastly more flexible rapidly, seems to me that large armies of nasty humans are still a much bigger threat (albeit one we've lived with since time immemorial).
But I suppose in the end, folks think really clever, self improving robots will win the day: https://en.wikipedia.org/wiki/...
Years ago Bill Joy warned everyone about self replication ("grey goo"). Self replicating *and* self improving seem like much worse ideas than simply arming them.
Use case; Consider some sort of waste repository (nuclear, biologic, something really, really bad to let free..zombie virus perhaps?). Say we've designed the facility to last for thousands of years. Folks have already worried about what happens when the language is no longer known, etc. ... would a "killer robot" as a last line of "defense" be worse than allowing the genie out of the bottle?
Or we could just not do it. It really is that simple. Of course, let's ask ourselves why we want killer robots. We're pretty much past the stage of "defense". Nukes & MAD make that pointless. And hell, so did globalization. You don't shit in your own backyard and for the same reason we're not going to go off and start blowing each other away. The damage done would outweigh the benefit. There'll be brush fires here and there but big scale wars are a thing of the past, if only because they rich won't let us wreck their stuff anymore.
That leaves the other reason for killer robots: so a small group of people can police the impoverished population without risking them turning to a charismatic strongman. If you want to avoid that the only real option is to eliminate those impoverished people and/or to constrain the amount of wealth individuals can claim for their own so they're not building killer robots to defend it.
Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
there's plenty of countermeasures if we just bother with them, which post 9/11 we will. 911 wasn't an inside job, but that doesn't mean we didn't let it happen. The various agencies knew there were terrorists preparing for 911 and let them swim. The only question is did they let them swim hoping to catch bigger fish or so they could get a rise out of the public. If it was the latter, well, they got their rise all right. Post 911 we threw away our rights and acted like "everything changed" when nothing changed until we changeed it.
Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
The NSA has a hard time finding recruits... Because too many of the people with talent are too weird for them, and/or on drugs. Consequently, the hackers are more talented than they are. The ultra-wealthy can no more interface with those people than the NSA can, and their weapons will simply be hacked and used against them. Killer humans barely care who they kill, killer robots do not care even that much.
"You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
Autonomous killer robots will be vastly more effective at waging war, despite the likely increase in collateral damage. So of course every government is going to pursue them.
The problem of killer robots may be viewed in the context of land mines and chemical weapons. During the Cambodian civil war, millions of innocent civilians were maimed by inexpensive Chinese land mines scatterd throughout the countryside. All it takes is one rogue country, like China, to manufacture killer robots at a price level that no one can refuse, and they will be uncontrollable. We banned chemical weapons on an international scale, and rogue countries are still using them against their own people. I support this plan, but I don't have high hopes for it, especially since two of the most powerful countries in the world have been expansionist during the past decade.
These constant stories about military applications for AI sound like PR & marketing to me. The big IT companies want us to beleive that they can make capable autonomous robots. I reckon we're a long, long way from that. It's based more on science fiction than science fact. We don't even know what AI will be useful for yet - it's in its infancy.
Yeah because it's going to be the right colluding with communists instead of the left colluding with communists. Nice try useful idiot.
What should the humans who exist now be doing on this planet exactly or even generally? You know, to evolve more with our kin, the other species on earth. Something besides just creating more billions of humans or pursuits of synthesizing nature.
If this question is not considered I wonder the chances of stopping killer robots. Unless you create a clone army of killer robots. Then with all the robots, is this really what we humans want? Are you sure?
I mean there have been movies made about this... Maybe you need a refresher course:)
it'll be done by private individuals. And it's not about humans caring who they kill. If fact that makes humans worse. One charismatic leader can turn your entire security force against you. Happened to the Tzars. Happened to the Chinese. Happens all the damn time. So much so we have a word for it (coup).
The machines might get taken over, but not if you pay your engineers well. And engineers aren't a charismatic lot. They'll collect their pay for the killer robots without ever bothering to overthrow the ruling class. They're perfectly content to be well compensated.
Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
Thanks for the compliment :)
[($)]
will be as effective as Valve Anti-Cheat.
Yeah, about that.
https://www.cnn.com/2018/07/19...
You are welcome on my lawn.
Much smarter mines that sometimes find soldiers but mostly make life miserable for civilians.
If it is humanoid shoot it. Current generation AI can do that without much need for the tech leaders. In the meantime patrol the area that you want to deny access to.
They would be happy to help with your genocidal war conflict, and you might even be able to hide the extent you are targeting the civilian population.
1) Compared to what?
2) Yeah, definitely since you will not and someone will.
Why not structure it like the international mine treaty? You know, the one that pretty much everyone except the USA has agreed to.
You know that you're full of shit when your "almost everyone" doesn't include China, India, Pakistan, Russia, and both Koreas, amongst a list of 30+ countries. You know, only about half of the planet.
You know you're doubly full of shit when out of that list of 30 countries the only one you specifically name is also the only one which has publicly stated that they will abide by the terms of the treaty even though they will not officially ratify it.
Amazingly enough, despite all that, you're still not as full of shit as the countries which HAVE ratified the agreement yet continue to stockpile dual-use antipersonnel landmines such as the claymore, because these are apparently "OK". Particularly entertaining is the fact that Canada - the nation which originated the treaty - still stockpiles claymore mines.
But hey, why waste a good opportunity to ignorantly bash the US, right?
I'm planning on being a pet for our killbot overlords. I've had a fuzzy collar fitted and everything!
Corruption is convincing someone that the selfless ideal is the same as their selfish ideal.
My essay: https://www.pdfernhout.net/rec... ... ... ...
"Military robots like drones are ironic because they are created essentially to force humans to work like robots in an industrialized social order. Why not just create industrial robots to do the work instead?
Nuclear weapons are ironic because they are about using space age systems to fight over oil and land. Why not just use advanced materials as found in nuclear missiles to make renewable energy sources (like windmills or solar panels) to replace oil, or why not use rocketry to move into space by building space habitats for more land?
Biological weapons like genetically-engineered plagues are ironic because they are about using advanced life-altering biotechnology to fight over which old-fashioned humans get to occupy the planet. Why not just use advanced biotech to let people pick their skin color, or to create living arkologies and agricultural abundance for everyone everywhere?
These militaristic socio-economic ironies would be hilarious if they were not so deadly serious.
Likewise, even United States three-letter agencies like the NSA and the CIA, as well as their foreign counterparts, are becoming ironic institutions in many ways. Despite probably having more computing power per square foot than any other place in the world, they seem not to have thought much about the implications of all that computer power and organized information to transform the world into a place of abundance for all. Cheap computing makes possible just about cheap everything else, as does the ability to make better designs through shared computing.
There is a fundamental mismatch between 21st century reality and 20th century security thinking. Those "security" agencies are using those tools of abundance, cooperation, and sharing mainly from a mindset of scarcity, competition, and secrecy. Given the power of 21st century technology as an amplifier (including as weapons of mass destruction), a scarcity-based approach to using such technology ultimately is just making us all insecure. Such powerful technologies of abundance, designed, organized, and used from a mindset of scarcity could well ironically doom us all whether through military robots, nukes, plagues, propaganda, or whatever else... Or alternatively, as Bucky Fuller and others have suggested, we could use such technologies to build a world that is abundant and secure for all.
Still, we must accept that there is nothing wrong with wanting some security. The issue is how we go about it in a non-ironic way that works for everyone. The people serving the USA in uniform are some of the most idealistic, brave, and altruistic people around; they just unfortunately are often misled for reasons of profit and power that Major General Butler outlined very clearly in "War is a Racket" decades ago. We need to build a better world where our trusting young people (and the people who give them orders) have more options for helping build a world that works for everyone than "war play". We need to build a better world where some of our most hopeful and trusting citizens are not coming home with PTSD as shattered people (or worse, coming home in body bags) because they were asked to kill and die for an unrecognized irony of using the tools of abundance to create artificial scarcity."
A 21st century issue: the irony of technologies of abundance in the hands of those still thinking in terms of scarcity.
Unilateral disarmament is a singularly stupid idea. It is usually pushed by people who live cushy lives protected by those who did not disarm. In this case, is China going to eschew these devices? ...That it will love to sell or give to PRC, Iran, Yemen, and use against Tibet, Taiwan, and even Japan. Is it really better for the US to be sending 18 year old boys to their deaths?
In reality, no matter how many top minds pledge to not take part in the creation of weaponized AI, there is always a think-tank of scientists already working on it. The more pressing question is not who, or even how but when.
Killer as in Job Killer
You tell 'em, Fritz!
Europa uber alles!
Politics and politicians were supposed to solve problems in a peaceful way, the promise was that military would be less necessary, instead they increase frictions and hate and use it to hide their greed, lust, envy, stupidity, ignorance and petty pride.