Slashdot Mirror
'Don't Fear the Robopocalypse': the Case for Autonomous Weapons (thebulletin.org)
Lasrick shares "Don't fear the robopocalypse," an interview from the Bulletin of the Atomic Scientists with the former Army Ranger who led the team that established the U.S. Defense Department policy on autonomous weapons (and has written the upcoming book Army of None: Autonomous Weapons and the Future of War). Paul Scharre makes the case for uninhabited vehicles, robot teammates, and maybe even an outer perimeter of robotic sentries (and, for mobile troops, "a cloud of air and ground robotic systems"). But he also argues that "In general, we should strive to keep humans involved in the lethal force decision-making process as much as is feasible. What exactly that looks like in practice, I honestly don't know."
So does that mean he thinks we'll eventually see the deployment of fully autonomous weapons in combat? I think it's very hard to imagine a world where you physically take the capacity out of the hands of rogue regimes... The technology is so ubiquitous that a reasonably competent programmer could build a crude autonomous weapon in their garage. The idea of putting some kind of nonproliferation regime in place that actually keeps the underlying technology out of the hands of people -- it just seems really naive and not very realistic. I think in that kind of world, you have to anticipate that there are, at a minimum, going to be uses by terrorists and rogue regimes. I think it's more of an open question whether we cross the threshold into a world where nation-states are using them on a large scale.
And if so, I think it's worth asking, what do we mean by"them"? What degree of autonomy? There are automated defensive systems that I would characterize as human-supervised autonomous weapons -- where a human is on the loop and supervising its operation -- in use by at least 30 countries today. They've been in use for decades and really seem to have not brought about the robopocalypse or anything. I'm not sure that those [systems] are particularly problematic. In fact, one could see them as being even more beneficial and valuable in an age when things like robot swarming and cooperative autonomy become more possible.
So does that mean he thinks we'll eventually see the deployment of fully autonomous weapons in combat? I think it's very hard to imagine a world where you physically take the capacity out of the hands of rogue regimes... The technology is so ubiquitous that a reasonably competent programmer could build a crude autonomous weapon in their garage. The idea of putting some kind of nonproliferation regime in place that actually keeps the underlying technology out of the hands of people -- it just seems really naive and not very realistic. I think in that kind of world, you have to anticipate that there are, at a minimum, going to be uses by terrorists and rogue regimes. I think it's more of an open question whether we cross the threshold into a world where nation-states are using them on a large scale.
And if so, I think it's worth asking, what do we mean by"them"? What degree of autonomy? There are automated defensive systems that I would characterize as human-supervised autonomous weapons -- where a human is on the loop and supervising its operation -- in use by at least 30 countries today. They've been in use for decades and really seem to have not brought about the robopocalypse or anything. I'm not sure that those [systems] are particularly problematic. In fact, one could see them as being even more beneficial and valuable in an age when things like robot swarming and cooperative autonomy become more possible.
Autonomous killing machines are a frankly horrific idea. In principle, machines should serve us, NEVER the other way around. On first principles alone the idea that a machine could determine who to kill and who not to kill is a chilling idea.
And in practice, its a terrible idea. Human soldiers already face baffling moral situations. Woman with child at checkpoint acting suspiciously. Maybe suicide bomber. But she has a child. To shoot or not to shoot. Thats the kind of thing guaranteed to give a marine a gnarly case of PTSD,if he choses wrong, and possibly also a dead mother and child (or conversely a dead platoon). But the possibiliy of a horrifically wrong choice means that Marine is going to deploy ever fragment of reason his brain can muster. . How the hell would we entrust such a monumental decision to a robot. Its "wrong" choice has no repercussions for it. If it kills an innocent mother, it doesnt care, its just a thing. If it opts for caution and it choses wrong, it still doesnt care, its already dead. Theres no incentive anywhere up the chain of command to get this right, because 'Well a robot chose badly, sorry not our fault!' is a get out of jail free to just let the bloody thing go robocop on a civilian population. We *morally* AND *practically* NEED humans in that decision loop, even if its just some guy in an air conditioned office and a VR headset.
Excuse the Unicode crap in my posts. That's an apostrophe, and slashdot is busted.
If I was in a gunfight I might think twice about killing another human. But a bot? No hesitation whatsoever. I'd blast the motherfucker.
Sending bots just sounds like an expensive way to flush money down the toilet.
I think we have well and truly crossed the cost line now. trained soldiers are expensive. A deployed soldier can be upwards of half a million a year in costs. drones and bots can already be more cost effective in many situations, the cost benefits are only going to accelerate more rapidly from here, I would say a large portion of the military personnel is very much on the countdown to obsolescence.
War has and will always be over either control of people of control over what people own. Both can be done much more efficiently with data. The war is already going on and not just the Russians who influence the elections. (legally or illegally) Also by the American, by companies and by anybody else.
And as always, the people losing most, be it their money or their freedom or both, are the common people.
Don't fight for your country, if your country does not fight for you.
Unlike like a growing number of countries, the US hasn't yet agreed to a ban on use of land mines.
These (simple) machines can automatically indiscriminately kill, with essentially no protection against civilian deaths, and
can remain active for many many years.