Slashdot Mirror


UN Debates Rules Surrounding Killer Robots

First time accepted submitter khb writes "It seems that the UN has started a debate on whether to place limits or bans on robots that can kill without manual supervision. It seems that bombs are viewed as 'kinder' than robots which might be programmed to achieve specific ends (e.g. destroy that bridge, kill anyone carrying a gun, etc.)."

40 of 215 comments (clear)

  1. robots can't kill people by WillgasM · · Score: 5, Funny

    it's in the rules.

    1. Re:robots can't kill people by Impy+the+Impiuos+Imp · · Score: 5, Insightful

      It's also against the rules to assassinate enemy leaders outside war, but ok to initiate a war with a full frontal assault killing hubdreds of thousands on both sides.

      Ironically, that's less upsetting -- getting your nation's ass whooped -- than getting your Fearless Leader killed.

      --
      (-1: Post disagrees with my already-settled worldview) is not a valid mod option.
    2. Re:robots can't kill people by dkleinsc · · Score: 2

      I thought the rules were:
      1. Serve the public trust.
      2. Protect the innocent.
      3. Uphold the law.
      4. (classified)

      --
      I am officially gone from /. Long live http://www.soylentnews.com/
    3. Re:robots can't kill people by Spy+Handler · · Score: 2

      you mean the Laws, not the rules... right?

      As in Asimov's 3 Laws.

    4. Re:robots can't kill people by lgw · · Score: 5, Insightful

      It's worth noting that the premise for almost every Robot story Asimov wrote was "something unacceptable despite the robot following the Three Laws". That's really what I liked about those stories: by extension to human moral codes, they're exploring how you can't prevent problems/evil with a simple set of rules.

      --
      Socialism: a lie told by totalitarians and believed by fools.
    5. Re:robots can't kill people by Cryacin · · Score: 3, Funny

      Fight for robot rights! (Before they do)

      --
      Science advances one funeral at a time- Max Planck
    6. Re:robots can't kill people by TapeCutter · · Score: 2, Insightful

      Would you like a patch for your missing eye?

      --
      And did you exchange a walk on part in the war for a lead role in a cage? - Pink Floyd.
    7. Re:robots can't kill people by khasim · · Score: 4, Insightful

      However, for those that think the drones should be removed, just what do you propose to replace them with? or are you ok submitting to the Islamic political order under Sharia (which is the stated and published goal of the OIC, if you care to listen:

      So you believe that the ONLY alternative to drone attacks is to convert to Sharia law?

      Who, exactly, is going to impose Sharia law on the US? And I don't mean who would LIKE to. Who, exactly, has that capability?

      The OIC realised it can't get its agenda through sovereign national parliaments - so what it is doing is manipulating the UN and then the resulting treaties will then be applied.

      How about you look up who has veto power at the UN. Here's a hint, the US is one of them. If we don't like it, we can veto it.

      There is a shadow war for freedom that is going on right now. If you don't stand up and argue for your liberties then the OIC (through the UN) *will* progressively take them away - it may take decades, but they are determined to reach their goal (Sharia) because it is a matter of faith for them.

      Exactly HOW is ANYONE going to replace any part of the US legal system or Constitution with Sharia law?

    8. Re:robots can't kill people by couchslug · · Score: 3, Insightful

      "Ironically, that's less upsetting -- getting your nation's ass whooped -- than getting your Fearless Leader killed."

      Fearless Leaders write the rules.

      --
      "This post is an artistic work of fiction and falsehood. Only a fool would take anything posted here as fact."
    9. Re:robots can't kill people by Anonymous Coward · · Score: 2, Interesting

      1: If you refer to your audience as sheep you immediately lose all credibility.
      2: If you are the only one that sees the light and you've taken it upon yourself to spread your message to the masses, double check your work because it's incredibly improbable that you're more aware of both current and historical events than everyone else around you.
      3: The most likely case is that you're wrong and basing your stance on emotion, feelings, and the opinions of others rather than the actual evidence.

      Step back and ask yourself, does your fear of the UN stem from logic or faith? The clear answer is to ban religion from UN consideration, to hell with who ever it offends. Christians should be silenced just as Muslims. As men and women we can talk, but lets keep religious faith out of all government at all levels.

    10. Re:robots can't kill people by multimediavt · · Score: 2

      It's worth noting that the premise for almost every Robot story Asimov wrote was "something unacceptable despite the robot following the Three Laws". That's really what I liked about those stories: by extension to human moral codes, they're exploring how you can't prevent problems/evil with a simple set of rules.

      The Three Laws are completely logical and boolean.

      • A robot may not injure a human being or, through inaction, allow a human being to come to harm.
      • A robot must obey the orders given to it by human beings, except where such orders would conflict with the First Law.
      • A robot must protect its own existence as long as such protection does not conflict with the First or Second Laws.

      They govern and define physical boundaries with regard to specific behavior. There's a lot of physical behavior and metaphysics that aren't covered. The Three Laws don't address morality at all. Never is good, bad, or evil ever mentioned. It's just a set directives ("must") to the effect of, "Don't hurt humans under any circumstances defined here". There are no consequences to be weighed in a value judgement when making a choice, so morality is really absent. Without a defined moral compass how can robots not commit "evil" behavior?

  2. 6 foot power cables by Anonymous Coward · · Score: 5, Funny

    That'll limit the damage they can do.

  3. Jeeze, Now I have to support the UN? by icebike · · Score: 3, Insightful

    For once I agree with the UN.

    I don't think it should ever get so easy as to to allow machines making the kill decision
    without a human in the loop.

    --
    Sig Battery depleted. Reverting to safe mode.
    1. Re:Jeeze, Now I have to support the UN? by chris_mahan · · Score: 4, Insightful

      I don't really want humans making kill decisions either.

      --

      "Piter, too, is dead."

    2. Re:Jeeze, Now I have to support the UN? by cusco · · Score: 2

      It's not likely to ever be implemented, and if it is it's not likely to make any difference. The country most likely to build autonomous killer robots sits on the Security Council. If by accident they don't veto the rule the US has abundantly demonstrated over the past dozen years that the UN Charter, the Geneva Conventions and pretty much every other treaty that the US has ever signed, such as the nuclear anti-proliferation, anti-chemical warfare, anti-biowarfare, and anti-money laundering treaties are only to be followed when convenient to the PTB. Sure, they used to violate them frequently before, but they at least hid the fact or attempted to justify it in some way. Today they don't even bother.

      --
      "Think about how stupid the average person is. Now, realise that half of them are dumber than that." - George Carlin
    3. Re:Jeeze, Now I have to support the UN? by icebike · · Score: 2

      For once I agree with the UN.

      I don't think it should ever get so easy as to to allow machines making the kill decision
      without a human in the loop.

      What if it were limited to enforcement of a "no fly zone"? It gives "land or exit" warnings, and if they are not obeyed, shoots down the aircraft? This is exactly what NATO aircraft with human pilots did in Operation Deny Flight in Bosnia and Herzegovina in 1993, under authority of United Nations Security Council Resolution 816.

      I think by setting the rules of engagement, a human was in the loop.

      Fine, but an unscheduled air ambulance enters the zone, or a passenger liner with communication problems doesn't happen to be monitoring that particular frequency, and strays into the wrong air space, Then what?

      The human pilot identifies his target, attempts to give visual signals (wheels down, finger pointing to ground, etc), and under just about no circumstances shoots down a Commercial air liner (unless he is a Russian pilot).

      Your drone scores another kill, and to hell with anybody who protests. Hey, we filed the proper forms and sent broadcasts, so screw you and your broken navigation gear excuse!

      --
      Sig Battery depleted. Reverting to safe mode.
    4. Re:Jeeze, Now I have to support the UN? by VortexCortex · · Score: 2

      For once I agree with the UN.

      I don't think it should ever get so easy as to to allow machines making the kill decision without a human in the loop.

      You realize that such racist thinking is exactly what causes the Cyborg wars, right?

  4. Damn, I was just about ready to give it go: by Tablizer · · Score: 4, Funny

    10 Find Human
    20 Eat It
    30 GoTo 10

    1. Re:Damn, I was just about ready to give it go: by oodaloop · · Score: 2

      Sounds great. Make sure you turn that robot on manually, so you're, you know, the first human it sees.

      --
      Tic-Tac-Toe, Global Thermonuclear War, and relationships all have the same winning move.
  5. One suggestion by betterunixthanunix · · Score: 4, Insightful

    Robots should find an empty field somewhere and self-destruct after some period of time without receiving commands. We do not want to wind up with the same situation we have with land mines -- dangerous leftovers from wars that ended decades ago. Imagine an autonomous robot getting lost during a war, only to get uncovered 10 years after the war ends and going on a rampage (say, killing every armed police officer it finds)...

    --
    Palm trees and 8
    1. Re:One suggestion by ZombieBraintrust · · Score: 2

      The manufacturers probably already make them do this, though perhaps less to reduce future harm and more to keep secrets.

      Nope they self destruct so more robots need to be manufactured and sold.

    2. Re:One suggestion by oodaloop · · Score: 2

      1. There are no autonomous killer robots.
      2. No drone self destructs if it loses contact.

      That helicopter was destroyed by people.

      --
      Tic-Tac-Toe, Global Thermonuclear War, and relationships all have the same winning move.
    3. Re:One suggestion by stackOVFL · · Score: 2

      Where's the fun in that?! Shit, Robots should have a timeout function called runAmok(). The function should execute random low level BIOS call with a weighted probability of calling the pullTriggerFinger(). queezinartMode() might be fun to call ofter too.

    4. Re:One suggestion by Kaenneth · · Score: 3, Interesting

      Obsolete robots should be programmed to pace suspected minefields until their mechanisms wear out.

      2 birds, 1 stone.

      Add live streaming and betting pools, and it might even be profitable.

  6. OK, but how is this new?: by Hartree · · Score: 4, Interesting

    So, tell me how a cruise missile that's autonomously guiding itself via GPS or TERCOM toward a target after being launched isn't already a "killer robot"?

    It was commanded to launch, yes, but isn't a robot that's being commanded to head out on a mission where it could kill just being given a longer lifetime to act?

    You can bring up the choices robots have to attack or not based on what target it sees, but how is this different from existing CAPTOR mines that can ignore one type of ship and go after another?

    I think this Pandora's box has already been open for a long time.

    1. Re:OK, but how is this new?: by stenvar · · Score: 2

      Or, for that matter, mines are preprogrammed robots securing an area. Sentry guns have also been around for a while, although they usually try to shoot down missiles.

    2. Re:OK, but how is this new?: by vux984 · · Score: 2

      So, tell me how a cruise missile that's autonomously guiding itself via GPS or TERCOM toward a target after being launched isn't already a "killer robot"?

      The cruise missile is fired by a human. The cruise missile's target is set at launch. The cruise missile did not choose to launch, nor did it choose its target.

      It was commanded to launch, yes, but isn't a robot that's being commanded to head out on a mission where it could kill just being given a longer lifetime to act?

      Its being given decision making capabilities. It is choosing it's targets, and choosing to fire at them. Its worlds apart.

      but how is this different from existing CAPTOR mines that can ignore one type of ship and go after another?

      Yeah, its not that different. Its less controversial because it specifically targets submarines, and its deployed in an place that is otherwise inhospitable to humans. So there's no impending "I was minding my own business and got attacked by a captor mine." You've got to be in a submarine in a warzone. Or as is the case with all "mine" tech, "former warzone".

      And its also worth pointing out that mines are controversial in their own right, even the dumb mines precisely because they ALSO kill indiscriminately without human decision, often years later when the war is over.

      I think this Pandora's box has already been open for a long time.

      When it comes to mines the box is already open... yes... but a lot of people are trying to close it. The focus is on anti-personnel mines since those are the most likely to take out innocents... and its high profile and highly visible.

      It would be pretty interesting (tragic) if one day a future scientisfic or tourist expedition gets blown up by a long forgotten CAPTOR style mine while on a research/tourist submarine or submersible not programmed on its 'friendlies list', or if an ailing but otherwise friendly vessel gets taken out because it doesn't sound right.

      Even if the door is open, that doesn't mean its too late to try and fix it.

  7. Oh my god... by Impy+the+Impiuos+Imp · · Score: 4, Funny

    Make love, not war. Where are the sex bots that will roam around and make you orgasm unsupervised? Let's get some other automaton out of control kthxbie.

    And now, the punch line.

    .

    Wait for it...

    .

    If you build it, they will...

    --
    (-1: Post disagrees with my already-settled worldview) is not a valid mod option.
  8. Autonomous cars will be making life-or-death calls by Aristos+Mazer · · Score: 2

    It's hard for me to see how we will allow various technologies like self-driving cars to go forward while still holding back the war machines. I mean, I want to hold back the war machines, but writing a law to keep those two use cases separate will be tricky. A child runs out into the street... does the self driving car hit the child or swerve possibly hitting some other car? Does the car evaluate the people in the other vehicle? Whatever logic we put into the cars, that's the same logic -- inverted -- that would run the war machines.

    I hope we have high wisdom politicians writing that particular body of law. I know... improbable... but hope springs eternal.

  9. Eh... by betterunixthanunix · · Score: 2

    On the one hand, I would prefer if wars were always soldier-versus-soldier. On the other hand, I would rather see a robot on the battlefield making automatic decisions about what to attack than a bomb dropped from an airplane -- at least a robot can be programmed not to kill civilians or needlessly destroy civilian infrastructure (e.g. schools, hospitals).

    Where I see a problem is with robots being programmed to recklessly kill -- a genocide could be committed rapidly by robots, which would require no indoctrination and would not refuse to target a particular group. I also see an issue akin to the problem with landmines, where robots might remain hidden, armed, and active long after a war ends. There is also the issue of robots recording or not recording their actions, which might be a concern during a war crimes trial (soldiers can testify that they were ordered to shoot children or deploy nerve gas; robots might not record such details).

    --
    Palm trees and 8
    1. Re:Eh... by cusco · · Score: 4, Insightful

      I'd prefer to see wars were always general against general, preferably armed with hand axes and stone tipped spears.

      --
      "Think about how stupid the average person is. Now, realise that half of them are dumber than that." - George Carlin
    2. Re: Eh... by Electricity+Likes+Me · · Score: 2

      You can commit genocide rapidly with artillery and airstrikes too - that's not really the issue.

      At it's core this is really a debate over liability and perception. If you setup a perimeter gun, who's liable when it kills someone? If it's supposed to have IFF and it fails then who's liable? The guy who set it up? The manufacturer? etc.

      But more important then that is very much perception: the law of armed conflict exist because war is not eternal, it has to end someday and we'd like that to be sooner. Where robots fit into this is an interesting question: indiscriminate machines that you know group X unleashed on you probably is somewhat worse then group X's soldiers showing up, since the perception of who was responsible isn't clear - if it's not just the soldiers, it might as well be all of them so let's go kill all their civilians when we get the chance.

      But conversely robots offer some weird modifiers to that possibility - after all, it's conceivable you could build an armored soldier which would only ever fire back at muzzle flashes with pinpoint fire (maybe lasers?) meaning it would be staggeringly unlikely to ever hit a civilian. This sure would help a lot in asymmetric warfare, but then, if the robot can't "die" should it kill at all or should we only use tazer and dispersal weapons?

    3. Re: Eh... by Qzukk · · Score: 2

      My question is who is responsible for picking them back up when the war is over? Or will it be Land Mine 2: Electric Boogaloo complete with the killbot wandering out of the forest 20 years later and wiping out an entire elementary school?

      --
      If I have been able to see further than others, it is because I bought a pair of binoculars.
  10. Kill limit by kinthalas · · Score: 2

    Clearly, they need to be designed with a pre-set kill limit.

    1. Re:Kill limit by VortexCortex · · Score: 2

      If only there were some way to make guns with LIMITED supplies of bullets.

  11. Make war too easy by EmperorOfCanada · · Score: 3, Interesting

    One of the problems that I have long had with the idea of robot soldiers is that it makes war too easy. When you have huge emotional and financial costs to war your government will think twice about either getting involved or at least be pressured into "Bringing the boys home." but if you are sending robot planes with loads of robot warriors, why not have a war, or two, or five? A bunch of dead dehumanized "others' is not so bad especially seeing that it generates jobs at homes and pork spending for politicians.

    War is rarely the correct solution. In fact it it usually a clear sign of a long series of failures or the sign of a madman.

    Plus robotic warriors are, for the next short while, going to be the plaything of western countries. But how long before some tin-pot nut job flies the same machines into NYC or LA? Or even a homebrew nutjob? Again the key is that the consequences are potentially far less for the perpetrator. You can't usefully arrest the bot. You mightn't even end up with the slightest clue who sent it. Again the same problem. This tool makes waging whatever stupid war that pops into your head too easy.

    Robots have the potential to turn this planet into Utopia or into Distopia. I suspect that some governments are philosophically predisposed toward Utopia and others Distopia in regards to using robots wisely. A simple question: If your country can, using robots, vastly decrease the cost of running prisons will your country increase its incarceration rate?

  12. One Other Thing to Worry About by sehlat · · Score: 2

    There's a famous Alexis Gilliland cartoon of a cruise missile thinking "They've got me aimed at a computer center! I'll just fly a bit farther and hit the maternity ward."

  13. Mobile, adaptive landmines? by larryjoe · · Score: 2

    I suppose autonomous drones could be viewed as landmines that happen to move and make decisions about their targets. So, if banning landmines makes sense, maybe so would banning autonomous drones.

  14. Re:No robot soldiers by Ol+Olsoc · · Score: 2

    The biggest reason to ban robotic soldiers is because people (humans) get sick of war.

    The biggest reason to ban robotic soldiers is that without killing people there is no point to war. before deciding that I am a lunatic, parse that for a while.

    --
    The shepherds did so well protecting the flock that the sheep no longer believed that wolves existed.
  15. A Taste of Armageddon by joeyspqr · · Score: 2

    "Death, destruction, disease, horror...that's what war is all about, Anan, that's what makes it a thing to be avoided. You've made it so neat and painless you've had no reason to stop it."

    --
    +1 fashionably cynical