Slashdot Mirror


US Killer Robot Policy: Full Speed Ahead

Lasrick writes "Princeton's Mark Gubrud has an excellent piece on the United States killer robot policy. In 2012, without much fanfare, the U.S. announced the world's first openly declared national policy for killer robots. That policy has been widely misperceived as one of caution, according to Gubrud: 'A careful reading of the directive finds that it lists some broad and imprecise criteria and requires senior officials to certify that these criteria have been met if systems are intended to target and kill people by machine decision alone. But it fully supports developing, testing, and using the technology, without delay. Far from applying the brakes, the policy in effect overrides longstanding resistance within the military, establishes a framework for managing legal, ethical, and technical concerns, and signals to developers and vendors that the Pentagon is serious about autonomous weapons.'"

46 of 202 comments (clear)

  1. Cylons by jfdavis668 · · Score: 2

    or other movie equivalents.

    1. Re:Cylons by jfdavis668 · · Score: 2

      Exterminate! Exterminate!

    2. Re:Cylons by smooth+wombat · · Score: 3, Funny

      I was thinking more along the lines of Bender.

      --
      We will bankrupt ourselves in the vain search for absolute security. -- Dwight D. Eisenhower
    3. Re:Cylons by CanHasDIY · · Score: 2

      If we're lucky we can buy a few seconds by invoking The Shadow Proclamation...

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
    4. Re:Cylons by Anonymous Coward · · Score: 5, Funny

      Now I can get behind the program.

      War! With hookers and blackjack! Forget the war - and the blackjack.

    5. Re:Cylons by harvestsun · · Score: 2

      "All of this has happened before, and will happen again."

    6. Re:Cylons by oPless · · Score: 2

      So say we all.

    7. Re:Cylons by rtb61 · · Score: 3, Insightful

      The important question here is why autonomous killing machines, what benefit? The answer is likely to be very deeply disturbing. At a guess so military types and politicians can blame the supplier for murdering children, whilst continuing to send in the device's to terrorise the targeted populace in order to gain control of resources or just to spend money for no reason at all other than generating a profit from that spending.

      --
      Chaos - everything, everywhere, everywhen
  2. Asimov Be Damned by Anonymous Coward · · Score: 2, Funny

    "Damn the Asimovs, full speed ahead!

  3. Completely insane... by GuardianBob420 · · Score: 4, Insightful

    I'm not even sure what else to say here... so much for the Three Laws ;-)

    1. Re:Completely insane... by jfdavis668 · · Score: 2

      In the US, the Three Laws of Robotics would be as complicated as copyright laws.

    2. Re:Completely insane... by spire3661 · · Score: 5, Informative

      The Three Laws were EXPRESSLY invented to show why such a simple system will not work. Asimov spent extensive amounts of time pointing this out to us. It is frustrating people think '3 laws safe'.

      --
      Good-bye
    3. Re:Completely insane... by internerdj · · Score: 2

      Law 1, article 4, section 53, subsection 12

    4. Re:Completely insane... by vux984 · · Score: 5, Insightful

      The Three Laws were EXPRESSLY invented to show why such a simple system will not work.

      The three laws were expressly invented to make a system that works.

      He then spent extensive amounts of time exploring them for unintended consequences and corner cases where they did not work.

      It is frustrating people think '3 laws safe'.

      Its FAR more frustrating that rather than trying to -fix- the edge cases Asimov uncovered with the 3 laws (later 4 laws), we've decided to just go full steam ahead without any laws at all with robots designed for the sole purpose of killing us.

    5. Re:Completely insane... by king+neckbeard · · Score: 2

      You can keep the laws as is, you just have to redefine 'human.'

      --
      This is my signature. There are many like it, but this one is mine.
    6. Re: Completely insane... by JWW · · Score: 4, Funny

      Ah, but one law is just waaaay simpler than three.

      It's just unfortunate that law is -- Kill humans.

    7. Re:Completely insane... by JeanCroix · · Score: 4, Funny

      Negative. I am a meat popsicle.

    8. Re:Completely insane... by squiggleslash · · Score: 4, Insightful

      That, perhaps, might be Will Smith's interpretation of Asimov's novels, but it's not any sane reader's interpretation.

      Asimov's novels are pretty clear, the three laws do, in fact, restrict the robots from being OUT OF CONTROL KILLING MACHINES!!1!. There are only two appearances of such robots (and then, they're hardly described by such a term) - one short story, whose name I forget, has a deliberately weakened set of laws in it. The other is, of course, Giskard and Daneel's formulation of the zeroth law, where, again, the robots are no longer obeying, exactly, the three laws.

      What Asimov does do is describe the consequences of the three laws, showing them to be imperfect in terms of creating universal machines, but effective at preventing the robots from going out and killing everyone.

      Asimov's motivation for creating the three laws was to deal with the plethora of inane "Scientist builds perfect universal machine, doesn't realize that a perfect machine will kill maker until it's too late" stories that started entirely legitimately with Frankenstein but then descended into cliche hell, as story teller after story teller thought it was wildly original to pretend that scientists are dumb and would build destroyers of the universe to prove how clever they were. Annoyed, he wrote a set of rules and then wrote story after story explaining them. The stories didn't debunk the rules, or show they wouldn't work. The stories usually showed that they did, and worked in unexpected ways.

      --
      You are not alone. This is not normal. None of this is normal.
    9. Re:Completely insane... by Charliemopps · · Score: 3, Insightful

      These are AI laws. They have nothing to do with what we have now, as we don't have any real AIs. Our governments use of these will basically be machine guns with servos that shoot anything that moves or possibly drones that are authorized to shoot anyone identified with a weapon in hand in a given area. If we actually had real AIs I'd be less concerned, but having a computer that's likely not any more intelligent than my smartphone or, at best, my desktop PC decide if someone should be killed or not is terrifying.

    10. Re:Completely insane... by Anonymous Coward · · Score: 5, Insightful

      > Its FAR more frustrating that rather than trying to -fix- the edge cases Asimov uncovered with the 3 laws (later 4 laws), we've decided to just go full steam ahead without any laws at all with robots designed for the sole purpose of killing us.

      It's simple. Robots will follow orders. They will have no qualms about executing illegal orders. No issues with killing civilians. No hesitation about killing the very population that they were supposedly built to protect.

      Amy and police might actually not gun down a mob of 1000s just to protect a couple of corrupt and powerful fucks. They didn't in Egypt. The elite know this... so they need robots who will protect them unconditionally.

    11. Re:Completely insane... by jeffmflanagan · · Score: 2

      It seems like the most efficient way to kill all humans without the side-effects of nuclear war, especially if we can build killer robots that can make more killer robots.
      What do you have against efficiency?

    12. Re:Completely insane... by MrBigInThePants · · Score: 3, Interesting

      Bah!

      The three laws is a bunch of overhyped rubbish - quadruply so in the case of robots that are not fully AI and could not even interpret them. Also due to the extremely naive assumption that people in charge of making robots will want them to respect human life and implement these anyway - I mean they don't currently?!

      Militaries? FoxConn? NSA? CIA? etc? Their track record is CURRENTLY completely abysmal.

      Yes I know you were joking. I just don't see any of this as a joke long term.

      This is not conspiracy - I look at the CURRENT state of affairs and add killer robots and feel sick to my stomach. This really is no joke and it is about time the plebs woke the fuck up already.

      You (and many other nations) have currently lost control of your government and if anything it currently works against you wherever it can for the benefit of the ruling class. (NB: Not you) This much is patently obvious and if you disagree I suggest you research the current value of the shadow banking system (100 trillion), what the rich pay in REAL taxes, and where 99% of the additional wealth generated since the crash has gone (i.e. to 1% of the population) while huge numbers of your fellow citizens (remember them?!) are either the "working poor" or unemployed while nothing is done to help.
      None of this is conspiracy - this is well documented fact from this very website no less.

      Soon efficient robots will exist that will be able to vanquish/suppress/intimidate/murder people without those pesky human traits that exists in many of us such as empathy, compassion, guilt, regret etc. Also they will not innately have danger of leaks, spies, whistle blowers, etc.
      You see it is very hard to find/train/indoctrinate/trick enough psychopaths to carry out these functions on an every increasing number of disgruntled citizens and foreigners.

      And your governments have ALREADY shown they are MORE than willing to use those (albeit very flawed) "human resources" for many, many nefarious purposes/war crimes/assassinations/etc. And this if from what we know from the facts (documents, reports, leaks etc), let alone anything that might have gone on behind the scenes, yet (if ever) to be uncovered.

      If I was you I would be very, very afraid. But not for the science fiction reasons given in most of these vapid articles written this way because people loved the terminator movie and a book. For the simple fact that robots could now carry out much the same sort of behaviours we already see with the restriction of having to use human beings.
      Finding/training/indoctrinating/tricking an army of psychos is very, very hard. Finding a handful of people whose moral compass is naturally broken is not that hard at all. (just ask the CIA)

      I would be far more afraid of a robot controlled by a psychopathic human than by another robot ANY DAY OF THE WEEK.

      And look around: many of those psychopaths are holding the keys to the kingdom already.

  4. Yeah... by roc97007 · · Score: 3, Funny

    > A careful reading of the directive finds that it lists some broad and imprecise criteria and requires senior officials to certify that these criteria have been met if systems are intended to target and kill people by machine decision alone. [emphasis mine]

    (I think I've seen that movie...) What could possibly go wrong?

    I wonder if they'd be running Windows for Killer Robots?

    --
    Oliver's law of assumed responsibility: If you're seen fixing it, you will be blamed for breaking it.
    1. Re:Yeah... by Forbo · · Score: 2

      ED-209, anyone? "You now have five seconds to comply."

  5. No Problem! by Tablizer · · Score: 2

    Nothing can go wrong, go wrong, go wrong, go wrong, go wrong...

  6. Did you expect something different? by Lucas123 · · Score: 4, Insightful

    It would be pretty darned hypocritical of us to indiscriminately bomb people and then say that you shouldn't use A.I. driven robots because it's too impersonal a way to kill people.

    1. Re:Did you expect something different? by Anonymous Coward · · Score: 2, Insightful

      Yeah, no. Most people object to it because fully autonomous killing machines cannot be more reliable than our most advanced fully autonomous non-killing machines are now. The objection is less about indiscriminately bombing people within the designated target area than it is about a glitch causing the "designated target area" to change from the actual target to...oh, I dunno, a lone seagull on the beach? The moon? A city 5000km away from the original target? The base which initially launched the drone and contains the only manual override for the device?

      The public at large is ok with atrocities as long as they're pointed as "those people" and not themselves. Fully autonomous means there is even less of a guarantee of it being pointed at themselves.

  7. Frightening thought by Dunbal · · Score: 5, Insightful

    It's a chilling thought that the world's largest state sponsor of terrorism is also pioneering drone and robotics technology. I guess some bright spark somewhere decided he can get around international law by just having the machines do the killing, because "there's no law against machines doing it, right?"

    Most Americans turn around and say "what law are we breaking?". How about this one, from the UN General Assembly: "No State may use or encourage the use of economic, political or any other type of measures to coerce another State in order to obtain from it the subordination of the exercise of its sovereign rights or to secure from it advantages of any kind. Also, no State shall organize, assist, foment, finance, incite or tolerate subversive, terrorist, or armed activities directed towards the violent overthrow of the regime of another State, or interfere in civil strife in another State." Don't even get me started on "targeted killing" or "extrajudicial killing", which is just summary execution without trial. Even Goering got a trial. Even Eichmann got a trial. And then you have the nerve to call yourselves a "free country"? Wake up, people, put your shiny iPhones down.

    --
    Seven puppies were harmed during the making of this post.
  8. So this is how Skynet starts by metrix007 · · Score: 4, Interesting

    Asimov argued against the Frankenstein complex as it applies to robots, and indeed many people have made the point, asking how something like Skynet could happen.

    Would we really be stupid enough to build something that is smarter and stronger than us, and designed to kill us without safeguards?

    Apparently, yes.

    --
    If you ignore ACs because they are anonymous - you're an idiot.
  9. I don't mind by freeze128 · · Score: 4, Funny
    Go ahead, make killer robots. I'm pretty sure I can outwit the current state of the art killbots by:
    • - Hiding behind a blanket.
    • - Running around behind the robot to it's blind spot.
    • - Pushing it over on its side.
    • - Ascending some stairs.
    1. Re:I don't mind by lunchlady55 · · Score: 2

      - Shooting a blue portal beneath it, and an orange one above it.
      - Shooting an orange portal beneath it, and a blue one above it.

  10. Re:conscience by Nadaka · · Score: 2

    Soldiers have qualms of increasing degree when firing on civilians, countrymen, friends and families. AI do not have that problem. This is indeed terrifying.

  11. Read Kill Decision by timdearborn · · Score: 4, Insightful

    If you have not read Kill Decision by Daniel Suarez, you should. This fictional thriller, written last year, unfortunately seems more like reality than fiction. It portrays a vivid, all-too-real picture of what could be the outcome of these policies. Wikipedia link to book: http://en.wikipedia.org/wiki/Kill_Decision

  12. Re:No.... by roc97007 · · Score: 3, Insightful

    BANG!
    You now have 5 seconds to comply. 4 3 2 1

    Gotta love those mismanaged mutexes :)

    It seems like some human police have already shifted to that algorithm.

    --
    Oliver's law of assumed responsibility: If you're seen fixing it, you will be blamed for breaking it.
  13. Same guys on the trigger by benjfowler · · Score: 2

    It's ultimately the same guy on the trigger finger, regardless of whether or not the weapon is a youth fresh out of boot camp, a remotely-operated weapon, or a drone.

    People should be looking harder at the people agitating for higher military spending and starting the foreign wars.

  14. I got a lot more worried about this kind of stuff by occasional_dabbler · · Score: 2

    ...after I read some Neal Asher books. Truly and utterly horrifying, and very believable.

    --
    "Our opponent is an alien starship packed with atomic bombs," I said. "we have a protractor"
  15. Addtional ammendments by Anonymous Coward · · Score: 5, Funny

    Law 1, article 4, section 53, subsection 12

    You shall not do any harm to a human being unless they are attacking or trying to arrest a CEO/Billionaire.

    Law 1, article 4, section 53, subsection 12 a. If CEO is being arrested by armed humans of any sort (including police), you are free to cause said human's harm and even death.

    Law 1, article 4, section 53, subsection 12 subsection b. Goldman Sachs, Bank of America, and every other Wall street banker shall be protected even if it means killing every other human in the vicinity.

    Law 1, article 4, section 53, subsection 12 subsection c. : folks who can pay 100 million dollars per year shall have unlimited protection by said robots.

    Law 1, article 4, section 53, subsection 12 subsection d. : Members of Congress are immune forever from actions of said robots.

  16. Re:All for it by gmuslera · · Score: 2

    You detect something that moves? shoot. That, and the ability to be remotely controlled. Normal soldiers will not want to be miles around those bots. And the "remotely controlled" part will be probably exploited, either by the enemy, or by any of the lot of people that will be around in design/control/manufacture them, or by whoever that hacks them.

  17. Who is making them? by amxcoder · · Score: 2

    Will they be manufactured by Cyberdyne Systems, or OCP (OmniCorp)?

  18. This .... will not end well. by DigitalSorceress · · Score: 3, Funny

    This will not end well.

    At first, the military will be all like "YAY, autonomous killer robots!"

    Then someone will hack some of them... and they'l be all like "boo, they're using it against us and we never saw taht coming"

    And then Politicians will be all "we gotta pass laws against being smart n stuff, because Turrhurrerristz"

    And then a few years later, we're all just banging rocks together.

    ok so my real answer is basically just /facelamp (for when facepalm is not sufficient)

    --

    The Digital Sorceress
  19. they already exist by bitt3n · · Score: 4, Insightful

    Killer robots have been used in combat for a long time. Their logic consists of "if pressure applied to unit, explode." Presumably these new models will be at least somewhat less likely to kill the wrong target.

  20. Re:conscience by GameboyRMH · · Score: 3, Insightful

    This is why the ruling class love killbots so much. A workable enforcement android will bring about the Oppression Singularity. No longer will they have to contend with "idealistic" cops and soldiers who don't blindly follow orders, whatever they may be, or worse yet leak their dirty laundry. No longer will they have to worry about who will "go soft" when the order comes in to fight their own people or take out a target of questionable status. No "untrustworthy" humans between the sociopaths and the rifles of their soldiers and no chance of them turning on their masters.

    --
    "When information is power, privacy is freedom" - Jah-Wren Ryel
  21. If you believe, automate nuclear weapons by RandCraw · · Score: 2

    Why start small?

  22. Did you even RTFA? by Anonymous Coward · · Score: 5, Interesting

    So, I'm working in the field, for the DoD. We're actually putting more work into getting them to autonomously prevent a shot that humans commanded than we are into getting them to take a shot uncommanded. The only weapons that are anywhere close to usable are anti-aircraft systems (starting in the 1970's) that have a self defense mode. Given that we're currently so cowardly in the ROE that more civillians have died in Afghanistan from our unwillingness to shoot than have died from our decisions to shoot, I'd say we're nowhere close to letting a robot make a decision, and won't be in the next decade.

  23. really intended for domestic (in the US of A) use by dltaylor · · Score: 3, Interesting

    Anyone else remember the picures of the Russian women standing in front of the tanks during the Soviet collapse? The soldiers were generally willing to kill, and die, to protect the Soviet Union from US, but NOT from their mothers and grandmothers.

    These robots will have no qualms about massacring children and women (even the non-revolutionaries) if so ordered to protect the 1%. Plus, a fat lot of good your .308 hunting rifle will do against an armor-plated killing machine.

  24. Re:really intended for domestic (in the US of A) u by cuncator · · Score: 2

    Probably spot on unfortunately. Considering how militarized the police have become it's only a matter of time before they are deployed "for everyone's safety." Guessing the results will be something like the ED-209.