Slashdot Mirror


The Struggle To Ban Killer Robots

Lasrick (2629253) writes "The Campaign to Stop Killer Robots is a year old; the same month is was founded, the UN's special rapporteur on extrajudicial, summary or arbitrary executions called for a moratorium on the development and deployment of autonomous lethal weapons while a special commission considered the issue. The campaign is succeeding at bringing attention to the issue, but it's possible that it's too late, and if governments don't come to a common understanding of what the problems and solutions are, the movement is doomed. As this article points out, one of the most contentious issues is the question of what constitutes an autonomous weapons system: 'Setting the threshold of autonomy is going to involve significant debate, because machine decision-making exists on a continuum.' Another, equally important issue of course is whether a ban is realistic."

83 of 138 comments (clear)

  1. Just make them 3/4 size... by bi$hop · · Score: 2

    ...easier to stop them if they turn on us. Also, give them a 3-foot cord.
     
    -Dwight Schrute

    1. Re:Just make them 3/4 size... by davester666 · · Score: 1

      I would prefer they be given guns loaded with blanks.

      --
      Sleep your way to a whiter smile...date a dentist!
  2. Skynet would not approve by davebarnes · · Score: 1

    I am pretty sure that Skynet will nip this ban effort in the bud.

    --
    Dave Barnes 9 breweries within walking distance of my house
  3. seen 'em by lophophore · · Score: 3, Funny

    I saw the Killer Robots. They opened for the B-52s at the House of Blues in Orlando.

    They were... interesting. Why does the UN want to ban them? I've seen many worse bands.

    --
    there are 3 kinds of people:
    * those who can count
    * those who can't
    1. Re:seen 'em by Opportunist · · Score: 1

      Hardly a quality statement. Just like when you get kicked in the groin after being slapped in the face, the slap does not feel so bad, so no matter what the band, they don't seem too bad when you get to endure the B52s afterwards...

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  4. Too late. by mmell · · Score: 4, Insightful
    Nuclear weapons, nuclear arms proliferation, and the UN is worried about Asimov's Laws of Robotics? If a government anywhere determines that automated weapon systems (including but not limited to armed robots) are more effective than humans - especially more cost effective - count on that government to develop and use that technology, regardless of the UN's position on the subject.

    Even if such technology is never deployed, its existence represents a bargaining chip for that nation at the negotiating table. See nuclear weapons for precedent. This is essentially trying to stuff the genie back into the bottle; not gonna happen, no matter who says what.

    1. Re:Too late. by roc97007 · · Score: 1

      One might argue that the "cost effective" part is the stickler. The more cost effective the mayhem and the less chance of constituents' sons and daughters at risk, the easier it is to make a decision to use aggression. Cost effective, non of our people get hurt, win!

      Of course, there's a flaw in the argument, but I don't expect the average politician to see it.

      --
      Oliver's law of assumed responsibility: If you're seen fixing it, you will be blamed for breaking it.
    2. Re:Too late. by mmell · · Score: 1

      Just to be clear - I'm a firm proponent of the three laws. I just don't have enough faith in humanity to believe they'll ever be enacted.

    3. Re:Too late. by mmell · · Score: 1

      TFA refers to "lethal autonomous weapon systems." Most /. readers could save time by just posting "tl;dr".

    4. Re:Too late. by Opportunist · · Score: 4, Interesting

      The very LAST thing you want is a cheap war, at least if you value peace at least a little. If war is cheap, what's keeping you from using it with impunity when you have the strongest army on the planet?

      Quite seriously, the only thing that keeps the US from simply browbeating everyone into submission that doesn't want to play by their rules is that it's a bit too expensive to wage war against the rest of the world.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    5. Re:Too late. by sillybilly · · Score: 1

      I just read up on Asimov's rules on robots. I read them in the past before, but I didn't remember them now until rereading. Those are very good rules, but laughable and naive. They are good to have when you absolutely must design AI, those are the basic principles you want to program into the ROM BIOS of the robot. Such situations may arise in many circumstances, such as, these Asimov rules were erected 13.8 billion years after the creation of the Universe (today is assumed to be 13.8 billion years from the Big Bang, if there was such a thing) and imagine a time where it has been another 900 billion since then, and we still haven't advanced much past in knowledge compared to the level available at 13.8 billion years, or 886.2 billion years ago, and the thermal heat death of the Universe predicted by the 2nd law of thermodynamics seems to be correct, and we're soon gonna run out of ways to survive, so as a last resort situation you may want to design an AI smarter then you, which is able to kill you, with hopes that it will not want to kill you, and figure out a way for you to live on, or at least make the best of the remaining time, having a chance at it is better than certain doom. Another situation is, where, we send out Earthlings into far distant places, including 70,000 year trips to the nearest stars, along the lines of Voyager space probes, as a safety measure, not to keep all eggs in the same basket, not to keep all of our life in one place. Now suppose these very far Earthlings find out that humans back on Earth designed AI robots, which got out of hand and killed everyone back on Earth, and now they are chasing after them, but there is another 70,000 years before they get there to the nearest star from the Earth, unless the AI can figure out a faster way to travel through space than you could, and a smarter AI then you might, so under such circumstances you may want to invest a lot of effort to create an AI smarter than the AI that got out of hand back on Earth, and defend yourself using it. These Asimov principles of

      1. A robot may not injure a human being or, through inaction, allow a human being to come to harm.
      2. A robot must obey the orders given to it by human beings, except where such orders would conflict with the First Law.
      3. A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.

      come in very handy then.

    6. Re:Too late. by sillybilly · · Score: 1

      There are a lot of circumstances where you have to weigh such things as injuring or at least offending a human being to protect injury or offense to two human beings, one vs. two, it's really hard to apply algebra when it comes to ethics, because, for instance Pontius Pilate's mistake was to uphold the motto, the guiding principle: "give the people what they want", as in take over only the external politics of a conquered city, but do not interfere in the internal affairs, so, in view of the whole city requesting an innocent man, Jesus, to be crucified, he should have still protected the one innocent man's right to exist regardless of how many other people disagreed with him, if he had the power to do so. He said he could find no fault with Jesus. But he can never be sure about his own decisions being correct, so just because you are in charge, it's not necessarily best to do what you think is right without consulting what everybody else thinks is right, and in a whole lot of cases it's safest to just "give the people what they want." The constitution's amendments represent individual rights which may go against what everyone else wants, the same way, according to HG Wells' "A short history of the World" the Jews were a people with an assumption that principles of morality exist independent of what other people in majority may feel is right or wish to be correct, that unlike existentialism states, morality is not a independent choice for everyone out there, but there are principles of justice and fairness and good and evil. Existentialism might be correct if we come across other lifeforms, or even other jungle cultures, in what's right and wrong, and anything that provided a moral system yesterday that could successfully make it to today, is an acceptable moral system, even if it's in conflict with what some other people think is right or wrong. One such thing may be walking around naked in the jungle, or incest, things that might be or might have been practiced in a lot of areas of the world, as long as they made it to the present, it's like they almost have a right to exist. We balk at the reproductive method of a species of Wasp which requires it to capture a live cockroach, inject it with two kinds of poisons to control its behavior, lay an egg on it, and let the larva eat the cockroach alive, which last longer as food and it doesn't decay if it dies as late as possible compared to if it were killed earlier. That is horrendous torture, but how to you apply the rules of individual rights and nonexistentialist principles of justice to this situation?

    7. Re:Too late. by sillybilly · · Score: 1

      Should we go ahead and genetically modify the wasp species to not do such a thing anymore? Or can we leave other lifeforms alone, and focus on human beings only, can we even judge other cultures and modify them to what we think is right as opposed to what they think is right? Should we just allow all kinds of moral behaviors roam freely? Sometimes I feel like I'm living on a reservation where moral behaviors are allowed to roam freely, with people that come here talking about, hey, imagine there are even strip clubs around here, something unheard of in where they came from, off the reservation there might be some very strict rules applied. I really like strip clubs even if I never been to one, because I couldn't afford to, I always had other priorities in life, but some people, a lot of them older, with a lot of money, and nothing better to do with it go to strip clubs and give their money to college age girls stripping, who they get to watch dance naked but not allowed to touch. Such a thing is probably not allowed off the reservation.

    8. Re:Too late. by pushing-robot · · Score: 1

      I thought the Americans' problem was they had not yet figured out "we are your friends" and "we're invading your country" are largely incompatible concepts.

      --
      How can I believe you when you tell me what I don't want to hear?
    9. Re:Too late. by K.+S.+Kyosuke · · Score: 1

      Historically, the vast majority of robots were not humanoid, so it would seem nonsensical for anyone here to assume anything of the kind.

      --
      Ezekiel 23:20
    10. Re:Too late. by tragedy · · Score: 1

      Most likely, if killer robots did get out of control that they would hit some limiting factor and loose the ability to kill all humans before getting the job done

      Ok. That one definitely calls for:

      Fry: "I heard one time you single-handedly defeated a horde of rampaging somethings in the something something system"
      Brannigan: "Killbots? A trifle. It was simply a matter of outsmarting them."
      Fry: "Wow, I never would've thought of that."
      Brannigan: "You see, killbots have a preset kill limit. Knowing their weakness, I sent wave after wave of my own men at them until they reached their limit and shut down."

    11. Re:Too late. by drkstr1 · · Score: 1

      So would that include something like a Terramax UGV (http://oshkoshdefense.com/technology-1/unmanned-ground-vehicle/) coupled with a Boomerang anti sniper system (http://en.wikipedia.org/wiki/Boomerang_%28countermeasure%29)?

      This would give a military the ability to send an unmanned vehicle into almost any terrain (rural or urban), which could respond instantly to shots fired at it with its own deadly return fire. And, considering the hell that Marines faced in Helmand with IEDs and snipers while slogging through muddy fields, wouldn't this present a far better option (particularly for the Marines and their families)?

      +2 Informative

      --
      Fanboy Status: Apache Flex, C#, Eclipse, KDE, Pirate Party, Ron Paul, Slackware, Windows 7
    12. Re:Too late. by Firethorn · · Score: 1

      Those are very good rules, but laughable and naive.

      You kind of contradict yourself with this. While I initially liked the idea of the 3 laws, problems quickly came up even within Asimov's books. Even in the books it's noted that fulfilling the 3 laws actually took up the MAJORITY of the 'brains' of all 3-rules compliant AIs. The cost to implement the 'laws' was, and would be, enormous.

      I mean, consider the 'through inaction' clause. That means that every robot has to be constantly on the lookout for a human that might be about to be injured, to the limits of it's sensor ability, and be ready to sacrifice itself, if necessary, but only if necessary, in order to prevent said injury.

      I prefer Keith Laumer's Bolo series. Given that they're explicitly military AI in giant tank bodies, there is no direct prohibition on killing. Instead they concentrated on making the AIs have a sense of morality, sort of idealized knights. Friendly fire still occured, factional warfare happened, but the only 'traitor' AI in the books turned out to have taken a shot to it's computer core that took out it's friend/enemy detection abilities(like brain damage to a human might do, though extremely rare), so it saw everything(except some kids that it was protecting) as enemies.

      --
      I don't read AC A human right
    13. Re:Too late. by LWATCDR · · Score: 1

      Frankly killer robots have been around for at least a century.
      Torpedos, sea mines, and land mines. Sure the kill logic started off simple for them. Kill what steps on me, kill a ship that bumps me, and kill what I run into.
      By WWII sea mines could "decide" to blow up based on the size of the ship that passes over it. Torpedos could find their target based on the sound it made. And some landmines would kill tanks and trucks but not men that walked over them.
      By the 70s you had guided missiles of all kinds, and Captor mines that would fire a torpedo at a sub that got near it.
      As to Skynet frankly I have to wonder if SAGE was the inspiration of SkyNet. Just take out the controllers and replace the F-106s with drones and you are good to go.

       

      --
      See my blog http://ilovecookes.blogspot.com/ for light hearted technical information.
    14. Re:Too late. by FatdogHaiku · · Score: 2

      Automated armies are best used against ones own citizens. A normal army will not be ruthless in crushing a homeland rebellion because the people in the army are from the same group as the people in the revolution. This can cause a conflict of feelings in a group of soldiers putting down a revolt. Robots have no problem with a "police action" against the citizens of their own country. The Romans did basically the same thing by absorbing conquered armies and then sending them to other regions where they would be fighting/policing people from a land other that their own. As long as the constituents' sons and daughters are towing the line and not associated with the wrong subset of the population database they should have nothing to fear... other than the whole robotic overlord thing...

      --
      You have the right to remain sentient. If you give up the right to remain sentient, you will be elected to public office
    15. Re:Too late. by jclarker6 · · Score: 1

      "It is well that war is so terrible, otherwise we should grow too fond of it" - Robert E. Lee

    16. Re:Too late. by sillybilly · · Score: 1

      Existentialism is deeply frowned upon by religions, which claim there is a morality that's correct, and it's their version that's correct. But it can be an aid to a warning that the Asimov rules regarding to the ethics of a robot may lead to cases where it's impossible to apply those rules, and then if the robot can get into situations where he is not forced to apply the rules, then what's holding him back in situations where he should apply them. If it thinks about it, he may abandon the rules altogether in all cases. That is the problem, assuming that it's possible to enforce ethics with robots. That's what Star Trek was great about - the Prime Directive stated noninterference in the internal affairs of new life and new civilizations encountered, but your very presence there is already an interference, and every episode was pretty much about meddling in the affairs of such lives and civilizations. Otherwise there is no storyline, no plot, absolutely nothing to do. Other than maybe voyeurism, where you hide and the observed don't even know they are observed, but Star Trek never had a voyeuristic tone to it, unlike a lot of great jungle and nature documentary tv series.

  5. Okay, I'll admit... by mrxak · · Score: 1, Interesting

    Okay, I'll admit, when I read the first sentence of TFS, I figured this was some kind of joke campaign or something. I guess my mind is too much in science fiction, and not really noticing that the future is already here.

    Still, do we really think the governments of the world (at least the ones with the resources to build these robots) are actually going to go for fully autonomous killing machines? I would think all of them would want humans in the loop, if for no other reason than to justify their military hierarchies. The USAF, for example, seems determined to keep pilots in planes.

    1. Re:Okay, I'll admit... by roc97007 · · Score: 1

      > not really noticing that the future is already here

      We should put this on a t-shirt so we don't forget it. The future? The good parts, flying cars, colonies on other planets, still a long way off. The bad parts -- surveillance state, punishment for potential crimes, autonomous robot weapons, that's already here. Also (from another article) artificially created alien organisms. (Because in SF, that always ends well...)

      --
      Oliver's law of assumed responsibility: If you're seen fixing it, you will be blamed for breaking it.
    2. Re:Okay, I'll admit... by frank_adrian314159 · · Score: 1

      Yeah. An easily portable automated kill-zone barrier. I see no reason why a general might want one of those. After all, minefields were just a fad. This works just about as well for a "if you step here we will kill you" sort of thing. Plus, no muss, no fuss cleanup. Just disarm the thing and pack up.

      --
      That is all.
    3. Re:Okay, I'll admit... by mrxak · · Score: 1

      Well, okay, true. I know the military wants those sorts of systems to replace minefields. They don't leave any explosives in the ground after the war is over, and they can be smart enough to choose a weapon system based on the threat (tank, launch an armor-piercing missile, squad of soldiers, launch a fragmentation bomb).

      Still, that's a lot different than say, some kind of mobile automated killing machine.

    4. Re:Okay, I'll admit... by Carewolf · · Score: 1

      Well, okay, true. I know the military wants those sorts of systems to replace minefields. They don't leave any explosives in the ground after the war is over, and they can be smart enough to choose a weapon system based on the threat (tank, launch an armor-piercing missile, squad of soldiers, launch a fragmentation bomb).

      Still, that's a lot different than say, some kind of mobile automated killing machine.

      How is a machine that automatically kills things not an automated killing machine?

      This is like real-world robots, they are not like retro-futuristic fiction predicted them, and these wouldn't look like terminators either (except for the Japanese models).

  6. This barn door has been open for decades by JonMartin · · Score: 1
    --
    Serve Gonk.
  7. Machine logic by Firethorn · · Score: 4, Insightful

    because machine decision-making exists on a continuum.'

    No kidding. Depending on how you define it, a cruise missile could be considered a one-use killer robot. It executes it's program as set on launch.

    Now consider making it more sophisticated. We now provide it with some criteria to apply against it's sensors when it reaches the target location. If criteria A is met, dive and explode on target, if B, pull up and detonate more or less harmlessly in the air. If neither criteria is met, it depends on whether it's set fail safe/deadly.

    This is mixed - on the one hand properly programmed it can reduce innocent casualties, but on the other it encourages firing missiles on shakier intelligence. But then again Predators armed with hellfires are a heck of a lot more selective than WWII gravity bombs. As long as you presume that at least some violence/warfare can be justified, you have to consider these things.

    On the whole, I like weapons being more selective, tends to cut down on civilian casualties, but I think that it's a topic more deserving of careful scrutiny than a reflexive ban.

    --
    I don't read AC A human right
    1. Re:Machine logic by RandCraw · · Score: 1

      This strikes me as a false dichotomy. Nobody is going to launch a million dollar bullet (smart missile) then tell it to self destruct. Until smart bullets drop enormously in cost, this scenario is infeasible.

      Assuming the cost of a smart bullet does fall, the initial authorization to fire it is still a decision to kill. The fact that something or someone might later reverse the decision does not mean the initial choice to launch was not a kill.

      The goal of this controversy is that no machine should never have the authority to issue the *first* kill command. That responsibility should always lie with a human. With that, I concur.

    2. Re:Machine logic by Chris+Mattern · · Score: 1

      Nobody is going to launch a million dollar bullet (smart missile) then tell it to self destruct.

      Current US Tomahawk Tactical Cruise Missile cost, per unit: $1.45 million.

      You were saying?

    3. Re:Machine logic by budgenator · · Score: 1

      On the whole, I like weapons being more selective, tends to cut down on civilian casualties, but I think that it's a topic more deserving of careful scrutiny than a reflexive ban.

      The problem now is that's pretty much who os doing the fighting, there is no Talabanistan or United Al-Qaedian Emerates; look at the misery the drug cartels and gangs bring to Latin-American countries like El Salvador, Honduras, Mexico and California. Even in the Ukraine It's mostly Pro-russian civillian millitias and a cadre of Russian Spetsnaz.
      In the old days any combatant that was ununiformed or undocumented was a spy and summarily executed and the any collateral damage were harboring anyways

      --
      Apocalypse Cancelled, Sorry, No Ticket Refunds
    4. Re:Machine logic by RandCraw · · Score: 1

      Why is the cost of one of today's (dumb) Tomahawks relevant? It can't order itself to self destruct. And I can't believe any have ever been ordered (by a human) to self destruct, without *somebody* being busted several ranks.

      What's more, an fully autonomous Tomahawk is going to cost a good deal more than $1.45 million. Nobody inferior to a colonel is going to pop that cork, and certainly not the missile itself.

      No. That scenario still misfires.

    5. Re:Machine logic by Time_Ngler · · Score: 1

      On the whole, I like weapons being more selective, tends to cut down on civilian casualties, but I think that it's a topic more deserving of careful scrutiny than a reflexive ban.

      Such as a weapon that can think for itself, like this?

      https://www.youtube.com/watch?...

    6. Re:Machine logic by Firethorn · · Score: 1

      Nobody is going to launch a million dollar bullet (smart missile) then tell it to self destruct.

      You'd be surprised. To a combatant commander, a million bucks is nothing. It all depends on the tactical circumstances.

      Worst case you make the abort recoverable.

      Heck, what do you think about a AI type interlock system? Both the machine logic AND a human have to decide firing is appropriate. Done right it *should* cut down on mistakes.

      BTW, I'm figuring having this on 'big boom' weapons, not small arms.

      The goal of this controversy is that no machine should never have the authority to issue the *first* kill command. That responsibility should always lie with a human. With that, I concur.

      Agreed. Sort of like how casualties, on either side, are on the president's head if he orders troops in. Heck, it's on his head if he decides NOT to order troops in. Sometimes your only option is some influence on WHO dies.

      --
      I don't read AC A human right
    7. Re:Machine logic by Richard_at_work · · Score: 1

      We already have weapons that make the decisions you suggest - the European StormShadow cruise missile for example, or the British ALARM anti-radar missile (launch it in standoff mode, it climbs to a given height and then deploys a parachute and waits until it can see a ground based radar, at which point it releases the parachute and kills the radar).

  8. Send Jack Bauer by dfsmith · · Score: 1

    Looks like someone was curious about the protestors in the new season of "24", and started Googling!

  9. Alarmist much? by Cantankerous+Cur · · Score: 1

    I gotta say, this whole thing seems a little ridiculous. Unlike Hollywood, any such weapon would be incredibly limited by power source (batteries or burning hydrocarbons) and limited ammunition. I'd also like to point out that there numerous ways to disrupt robots such as EMPs and strong magnets.

    Besides, I'm looking forward to the giant robot spiders that sound like children.

    1. Re:Alarmist much? by mmell · · Score: 4, Insightful

      You're talking about design specifics here. The question is philosophical, not technical. It's not "Can we create battlefield driods, automated stationary sentries, or robotic weapons such as guided missiles or autonomous drones?", it's "Should we?".

    2. Re:Alarmist much? by wisnoskij · · Score: 1

      Well you could make a robot that is powered by drinking the blood of its enemies.

      But honestly, if I were making a killer robot, I would probably just make it so that it could plug itself into outlets or just grab power lines if it were running low.

      --
      Troll is not a replacement for I disagree.
    3. Re:Alarmist much? by budgenator · · Score: 1

      You can use all the killer robots you want, but it ain't over untill there are boots on the ground.

      --
      Apocalypse Cancelled, Sorry, No Ticket Refunds
    4. Re:Alarmist much? by cusco · · Score: 1

      It's not going to matter one bit, someone in charge of a Black Budget in the Pentagon is going to think it's a good idea. Remember what the Pentagon did when Commander-In-Chief President Clinton directly ordered the military to stop all work on bio-weapons? Renamed the project, moved it to the Black Budget, and didn't even skip a beat.

      --
      "Think about how stupid the average person is. Now, realise that half of them are dumber than that." - George Carlin
  10. The new Robocop explores this in a nuanced fashion by Wraithlyn · · Score: 1

    Just kidding, it's a pile of shit.

    --
    "Mind, as manifested by the capacity to make choices, is to some extent present in every electron." -Freeman Dyson
  11. Unfortunately, no. by timeOday · · Score: 4, Interesting
    There at least 3 different levels of problems here:

    1) Does this even make sense: No. Autonomy is not well-defined. Does a thermostat make "decisions"? etc.

    2) Assuming it makes sense, is it a good idea: No. Firing a cruise missile at a target is better than firing a huge barrage of mortars towards a target, for everybody involved. Any smarter version of a landmine would be better than the current ones that "decide" to blow up whatever touches them 20 years after the war is over.

    3) Assuming it's a good idea, can it be implemented: No. Arms races are often bad for everybody involved. Everybody involved knows this. And yet that universal realization does not provide a way out. Everybody knows if they don't, the other side might well anyways.

    1. Re:Unfortunately, no. by RandCraw · · Score: 1

      1) Yes. The decision to fire the weapon and authorize lethal force is discrete and binary. That is indeed well defined. By launching it, arming it, and ordering it to engage the "enemy" you have made the decision to kill. Any human private who kills without prior authorization to engage is in violation of the rules of combat. Authorizing him/her to kill *is* the issue here.

      2) ??? The technique of projecting force is irrelevant. It's the *authorization* of of autonomous dispatch of lethal force that's the issue.

      3) Yes, of course requiring a human to authorize a kill certainly can be implemented. This isn't part of an arms race. It's just a new aspect of any military's "rules of engagement". It's no different from the Geneva Convention's rules on treatment of prisoners of war, or banning the use of chemical or biological (or nuclear) weapons.

  12. The first law of automated weapons is by CmdrEdem · · Score: 1

    Don't have them.

    First: If the concern is really about automated killing then we have to establish the following:
    No object capable of generating enough kinetic energy to kill a human can be directly interfaced with an electronic circuitry.

    But that would include cars and all kind of machinery. So the rule above would be a 95% insurance that AIs would not be able to kill humans. The other 5% is accounting that an AI would self-destruct to short-circuit and generate enough electromagnetic current to electrocute a human from a few centimeters away. And with my CS knowledge I would say that the electrocution scenario nowadays is impossible due to the physical properties and disposition of the materials involved in computer construction. But I don't know if an AI is only possible with materials and devices capable of such currents.

    This rule also prevent external hacking from turning one's arsenal against himself. If I had an army I rather take my chance with good old meat bags for the trigger pulling.

    --
    This combination doesn`t exist: ETIs that know about humanity and want to see us dead. Otherwise we wouldn't exist.
  13. These rules only make sense in context by Xaedalus · · Score: 1

    Selective, efficient killer robots only make sense in the context of using them in limited skirmishes/small wars. For the really BIG wars, killer robots would be horribly inefficient, because the point of the big wars is to eliminate as much of your enemy as possible--civilians included. Both the Axis and the Allies were actively involved in targeting each other's civilian populations via total war. In that regard, there isn't anything much cheaper and effective, or cost-efficient, than nuclear-tipped ICBMs. Anything less merely prolongs the conflict and ensures more agony suffered by all over a long period of time.

    --
    Here's to hot beer, cold women, and Glaswegian kisses for all.
  14. I already got your ban by Squiddie · · Score: 1

    Thou shalt not make a machine in the likeness of the human mind. Done.

  15. Might have the opposite of the intended effect by GPS+Pilot · · Score: 1

    The consensus around here is that autonomously-driven cars will inevitably establish a better safety record than human-driven cars. I.e., robotic systems will on the whole make better, less-reckless decisions than human drivers.

    A good case could be made that autonomous military systems will likewise make better decisions than fatigued and/or panicky young soldiers.

    Current military tools and techniques certainly result in fewer friendly-fire incidents, collateral damage, etc. than were experienced during WW II. But by banning autonomous systems, we may be barring ourselves from any further reductions in these problem areas.

    --
    That that is is that that that that is not is not.
  16. As Successful as the Kellogg-Briand Pact by Nova+Express · · Score: 1

    You know, the pact to outlaw war. Signed in 1928.

    Didn't work out so well.

    And even if it were signed by a significant number of nations, we could be sure the non-democratic ones would be violating the ban before the ink was even dry.

    Unenforceable treaties are actually worse than worthless: they constrain good actors without deterring bad ones.

    --
    Lawrence Person (lawrencepersonh@gmailh.com (remove all "h"s to mail)

    http://www.lawrenceperson.com/

    1. Re:As Successful as the Kellogg-Briand Pact by bigpat · · Score: 1

      Unenforceable treaties are actually worse than worthless: they constrain good actors without deterring bad ones.

      If I hadn't already commented, then I would mod you up. But the counterpoint is that there still could be some deterrent effect and that deterring good actors will at least let you tell the difference... but I don't buy that argument either. Ultimately it is about who will be charged with a war crime by whichever side wins or how to come up with rules that most people can follow.

      In this case I don't think it is the technology that can or should be banned, but the use case of just indiscriminately unleashing a device that is going to kill people or cause destruction. I think some of the same rules of indiscriminate use of force should apply to the decision to turn on a killer robot. If you have an intended particular target and some notion of how the robot is going to destroy that target, then to me that is no different than the decision to fire a gun, a smart munition or anything else. If the robot malfunctions and causes civilian casualties, then there is no criminal liability. On the other hand if you press that same On button in a crowded market where you know or should know that the robot isn't smart enough to know the difference between civilians and enemy combatants, then you are committing a crime or a war crime. Drop that same robot in a terrorist camp where you have confirmed that there are no civilians present then it is no different than dropping a dumb bomb, but it could be more targeted. Again it isn't the technology, but it would be the indiscriminate use of that technology that is the issue.

  17. It's going to be driven by reaction time by jlowery · · Score: 4, Insightful

    A robot is going to (or will eventually) react much faster to a threat or other adverse conditions than a human can. If you've got a hypersonic missile heading toward a carrier, are you put a human in the loop? Nope.

    There are simply going to be many many situations where a robot will neutralize a threat faster than a human can, and those situations will increase if fighting against another autonomous army.

    Is this a good thing? No, it's like atomic weapons. We're heading toward another arms race that will lead us to the brink or over. We barely survived the MAD era.

    --
    If you post it, they will read.
    1. Re:It's going to be driven by reaction time by rgbscan · · Score: 1

      This was basically the premise of the book "Kill Decision". A shadowy government/private contractor apparatus launches a series of attacks on America specifically to get the American public to by into the logic you've suggested. Dreams of new defense spending contracts spurred on "The Activity" and was supported widely. Of course, our hero puts it to a stop - but for how long??

  18. What what what?! by Greyfox · · Score: 1

    But I wanted to make killer robots! Now what am I going to do with this libKillerRobot I was working on?!

    --

    I'm trying to teach myself to set people on fire with my mind... Is it hot in here?

  19. not going to happen by Charliemopps · · Score: 1

    As will all new weaponry, all the countries that don't have it/can't get it panic and agree that it's a horrible idea. They pass UN resolutions banning it, etc... all the countries that do have it refuse to sign and so nothing has changed, other than the countries that don't have it will start accusing those that do of war crimes and flouting international law which they rarely recognize anyway. When some of the countries that signed the ban finally get enough money/science to get the tech, they of course do so despite the treaty and now the countries that didn't sign use it against them to levy sanctions. Until forever, on it goes Through the circle, fast and slow.

  20. The economics of machine intelligence by wattersa · · Score: 1

    Skynet and The Terminator are definitely coming. But what about the economics of machine intelligence? This article makes an interesting case: http://hanson.gmu.edu/aigrow.p...

  21. I'm surprised no one commented about this yet. by pouar · · Score: 1

    If the "killer robots" tried to take over the world today they would fail quickly, XKCD seems to have explained why already.
    https://what-if.xkcd.com/5/

    --
    while :;do if windows sucks;then mv windows /dev/null;pacman -Sy linux;fi;done
  22. When Killer Robots are illegal... by BenSchuarmer · · Score: 3, Insightful

    only super criminals will have killer robots.

  23. The person who frames the question... by davecb · · Score: 1

    ... dictates the answer. Reasoning strictly inside the box that creates, if you then try to propose a robot can use it's own judgment for everything but firing a weapon, you'll get criticized for hitting the edge of the box and not allowing it to actually be autonomous.

    In fact, the question isn't "how autonomous", it's "autonomous or not".

    --
    davecb@spamcop.net
  24. Likewise by DaveAtFraud · · Score: 2

    Could some of the people arguing for this ban please explain the difference between being on a ship during WWII that was hit by a kamikze and being on a ship during the Falklands war and being hit by an Exocet? Somehow being killed is being killed regardless of whether there was a human pilot or an autonomous robot flying the lethal projectile.

    --
    They that can give up essential liberty to obtain a little temporary safety deserve neither safety nor liberty.
    Ben
    1. Re:Likewise by Richard_at_work · · Score: 2

      What they are trying to address is the decision to release the weapon - whether that decision is made by a human or non-human. After that point, automated guidance is a non-issue, its been around for 60 years and thus does not pose an ethical question (a 2000lb laser guided bomb taking out a bridge is better than 100 B-17s dropping 50 tonnes of bombs to drop the same bridge - the automated guidance aspect of the LGB means much less collateral damage than with area bombing).

      At the moment the point to which we have progressed is having the non-human decide when to release the weapon, but not whether to release the weapon - that decision is always made by a human (yes, there is a huge difference between the two).

    2. Re:Likewise by bigpat · · Score: 1

      Take a heat seeking missile for instance. It is designed to "decide" to blow up something that matches a certain heat signature. Or a radar guided missile. It is designed to track, follow and destroy something that matches a certain radar profile. There is no meaningful technical or ethical difference between firing such a missile and turning on a ground or air robot that is designed to destroy something or someone that matches some sort of profile. You are "releasing" the weapon when you turn the robot on or give it the command which turns on the part which gives the robot or autonomous vehicle the ability to engage a target and destroy it.

      The real difference would be the circumstance of the decision to engage and destroy some particular target. A specific plane or specific building or a specific person when you launch it, versus just turning on a killer robot to perform guard duty which could mean you are using it more like a land mine than an offensive weapon.

      Given this it seems like it would be better to outlaw more generally unleashing some autonomous robot/weapon with destructive capability without a specifically targeted combatant individual, building or vehicle. Which follows naturally from the indiscriminate use of force doctrine. Basically if the robot is going to be used like a land mine then it is illegal, but if it is going to be used like a cruise missile or a radar guided missile then it is legal.

    3. Re:Likewise by DaveAtFraud · · Score: 1

      I see. It's better to have a human decide to bomb a Guernica, Rotterdam, Coventry, Dresden, Hiroshima, Nagasaki, etc. than it is to have cold, soulless, purely analytical robot "decide" whether or not to release lethal force based on some programmed criteria. I'm glad you clarified that for me.

      Cheers,
      Dave

      --
      They that can give up essential liberty to obtain a little temporary safety deserve neither safety nor liberty.
      Ben
  25. Nothing difficult about the autonomy issue. by Kaz+Kylheku · · Score: 1

    If it chooses what target to select and makes the call on whether to attack the target, it is autonomous.

    If a human chooses the target and makes the strike call, the machine is not autonomous.

    Complete no brainer.

  26. They're about 30 years too late... by Patent+Lover · · Score: 1

    Robocop, the ultimate law enforcement officer!

  27. Killer robots&nukes are ironic, not cost effec by Paul+Fernhout · · Score: 1

    From my essay: http://www.pdfernhout.net/reco...
    ====
    Military robots like drones are ironic because they are created essentially to force humans to work like robots in an industrialized social order. Why not just create industrial robots to do the work instead?

    Nuclear weapons are ironic because they are about using space age systems to fight over oil and land. Why not just use advanced materials as found in nuclear missiles to make renewable energy sources (like windmills or solar panels) to replace oil, or why not use rocketry to move into space by building space habitats for more land?

    Biological weapons like genetically-engineered plagues are ironic because they are about using advanced life-altering biotechnology to fight over which old-fashioned humans get to occupy the planet. Why not just use advanced biotech to let people pick their skin color, or to create living arkologies and agricultural abundance for everyone everywhere?

    These militaristic socio-economic ironies would be hilarious if they were not so deadly serious. Here is some dark humor I wrote on the topic: A post-scarcity "Downfall" parody remix of the bunker scene. See also a little ironic story I wrote on trying to talk the USA out of collective suicide because it feels "Burdened by Bags of Sand". Or this YouTube video I put together: The Richest Man in the World: A parable about structural unemployment and a basic income.

    Likewise, even United States three-letter agencies like the NSA and the CIA, as well as their foreign counterparts, are becoming ironic institutions in many ways. Despite probably having more computing power per square foot than any other place in the world, they seem not to have thought much about the implications of all that computer power and organized information to transform the world into a place of abundance for all. Cheap computing makes possible just about cheap everything else, as does the ability to make better designs through shared computing. I discuss that at length here: http://www.pdfernhout.net/post...

    There is a fundamental mismatch between 21st century reality and 20th century security thinking. Those "security" agencies are using those tools of abundance, cooperation, and sharing mainly from a mindset of scarcity, competition, and secrecy. Given the power of 21st century technology as an amplifier (including as weapons of mass destruction), a scarcity-based approach to using such technology ultimately is just making us all insecure. Such powerful technologies of abundance, designed, organized, and used from a mindset of scarcity could well ironically doom us all whether through military robots, nukes, plagues, propaganda, or whatever else... Or alternatively, as Bucky Fuller and others have suggested, we could use such technologies to build a world that is abundant and secure for all. ...

    --
    A 21st century issue: the irony of technologies of abundance in the hands of those still thinking in terms of scarcity.
  28. Easy to stop killer robots by clovis · · Score: 1

    You simply present them with a paradox, and they'll melt down or blow up trying to solve it. I saw Captain Kirk do it once.

  29. Rise of the machines. by hoboroadie · · Score: 1

    Read TFA, found an easier-to-read, more informative page.

    --
    They feared that it could be used to suppress protest or support unpopular rule.
  30. Time to get an instance plan that covers robots by djrobxx · · Score: 1

    Old Glory Insurance. "For when the metal ones decide to come for you. And they will."

    https://screen.yahoo.com/old-g...

  31. Defining autonomous weapons by Bruce66423 · · Score: 1

    A mine in the earth or at sea is an autonomous weapon on one possible definition. So is a proximity triggered automatic rifle, as used on the Berlin Wall. The ship has sailed; the question is what parameters can be introduced.

  32. Killer Robots are so messed up... by allcoolnameswheretak · · Score: 1

    Yeah, let's ban killer robots. Better let humans do the killing. I'm sure they have a much better track record at discriminating hostiles from innocent civilians.
    After the war, when we bring our killer heroes back home to rejoin their families, everything will be just dandy. Because after daddy has shot three Extremistanis in the face and seen his buddy's leg torn off by an IED, the first thing he wants to is hug his little girl and tell her he loves her.
    Killer robots would just be so immoral.

  33. We Need Killer Bots by JimSadler · · Score: 1

    You can bet that China will protest martial robots. After all when it comes to flesh and blood soldiers China has a huge advantage due to their excessive population levels. But with dedication and planing smaller nations like Norway or Switzerland could invest heavily in reserves of very potent martial robots capable of resisting invasion by much larger nations. Think about it. Russia is doing an expansion right now. If the Ukraine and others had a few thousand really good nuclear equipped cruise missiles I seriously doubt that Russia would have dared to tread on them. Most of the nations of the world seem to take any perceived weakness in another nation as an invitation to invade and slaughter and it is so convoluted that the aggressor will claim that their victims deserved their fate as they did not keep strength and readiness sharpened enough to not tempt others to invade.

  34. Killer robots could be a good thing... by tekrat · · Score: 1

    Because an army of robots is less likely to rape civilians after taking over and occupying a city. As a result there's actually less collateral damage.

    --
    If telephones are outlawed, then only outlaws will have telephones.
  35. Simple Solution by LifesABeach · · Score: 1

    Start developing Robots that are "3 Laws Safe," before you wish you had.

    1. Re:Simple Solution by smithmc · · Score: 1

      Start developing Robots that are "3 Laws Safe," before you wish you had.

      Nice thought, but I'm not sure how you'd do such a thing. The laws would have to coded in software, and software can be changed...?

      --
      Downmodding is the refuge of the weak. Don't downmod, make a better argument!
    2. Re:Simple Solution by LifesABeach · · Score: 1

      I got to start somewhere. Maybe use AIML to evaluate the different ways physical harm could come to someone?

  36. human in the OODA loop! by schlachter · · Score: 1

    HUMAN OODA LOOP:
    1. Orient
    2. Observe
    BOOOOOM!!!!

    --
    My God can beat up your God. Just kidding...don't take offense. I know there's no God.
  37. Sure, ban the robots... by smithmc · · Score: 1

    ...but not till I've got one of my own!

    --
    Downmodding is the refuge of the weak. Don't downmod, make a better argument!
  38. What's wrong - can't sell your freeware? by mmell · · Score: 1
    Are you this guy? The Start64 malware site shows the following:

    Company: Panisz Peter

    Address: Kossuth Lajos u. 51 Dunabogdany 2023 HU

    Phone: +36.203367173

    Fax: +36.203367173

    But I think he's living at his mother Jan Kowalski's basement at:

    Alexander Peter Kowalski

    903 East Division Street

    Syracuse, N.Y. 13208

    Apartment #1, Lower Level

    At least, that's where he wants users of his hostfile manager to send him money.

  39. What's wrong - nobody wants your malware? by mmell · · Score: 1
    Are you this guy? The Start64 malware site shows the following:

    Company: Panisz Peter

    Address: Kossuth Lajos u. 51 Dunabogdany 2023 HU

    Phone: +36.203367173

    Fax: +36.203367173

    But I think he's living at his mother Jan Kowalski's basement at:

    Alexander Peter Kowalski

    903 East Division Street

    Syracuse, N.Y. 13208

    Apartment #1, Lower Level

    At least, that's where he wants users of his hostfile manager to send him money.

  40. Must be hard selling malware . . . by mmell · · Score: 1
    Are you this guy? The Start64 malware site shows the following:

    Company: Panisz Peter

    Address: Kossuth Lajos u. 51 Dunabogdany 2023 HU

    Phone: +36.203367173

    Fax: +36.203367173

    But I think he's living at his mother Jan Kowalski's basement at:

    Alexander Peter Kowalski

    903 East Division Street

    Syracuse, N.Y. 13208

    Apartment #1, Lower Level

    At least, that's where he wants users of his hostfile manager to send him money.

  41. What's wrong, Allie? by mmell · · Score: 1
    You haven't threatened to sue me for calling your hostfile manager the malware that it is. I'm beginning to suspect that you don't like me.

    Are you this guy? The Start64 malware site shows the following:

    Company: Panisz Peter

    Address: Kossuth Lajos u. 51 Dunabogdany 2023 HU

    Phone: +36.203367173

    Fax: +36.203367173

    But I think he's living at his mother Jan Kowalski's basement at:

    Alexander Peter Kowalski

    903 East Division Street

    Syracuse, N.Y. 13208

    Apartment #1, Lower Level

    At least, that's where he wants users of his hostfile manager to send him money.

  42. We all know where this leads by steeleyeball · · Score: 1

    Once they ban killer robots then they'll work on taking away your Roomba, and the self autoclaving toilet washing robots so you have to clean your own floors and, worse yet, toilets.