Slashdot Mirror


UN to Debate Use of Fully Autonomous Weapons, New Report Released

concertina226 (2447056) writes "The United Nations will debate the use of killer robots for the first time at the UN Convention on Certain Conventional Weapons (CCW) this week, but human rights activists are calling for the robots to be banned. Human Rights Watch and Harvard Law School's International Human Rights Clinic have published a new report entitled 'Shaking the Foundations: The Human Rights Implications of Killer Robots', which calls for killer robots to be banned to prevent a potential arms race between countries. Killer robots, or fully autonomous weapons, do not yet exist but would be the next step after remote-controlled armed drones used by the US military today. Fully autonomous weapons would have the ability to identify and fire on targets without human intervention, putting compliance with international humanitarian laws in doubt. Among the problems with killer robots highlighted in the report is the risk of criminal liability for a military officer, programmer or weapons manufacturer who created or used an autonomous weapon with intent to kill. If a robot killed arbitrarily, it would be difficult to hold anyone accountable."

180 comments

  1. Thou shalt not kill. by Anonymous Coward · · Score: 1

    Like humans killing by remote is better. Michael Hayden: "We kill people based on metadata".

    1. Re:Thou shalt not kill. by supertrooper · · Score: 1

      I do agree with what you're saying, but at the same time I'm thinking that maybe, just maybe, someone killing an innocent person based on metadata can be held responsible. This also creates much worse system for exploitation.

    2. Re:Thou shalt not kill. by ShieldW0lf · · Score: 2

      I like killer robots. Know why? Cause I know how to make them, muthafuckers! Mwhahahahahahha!!!

      --
      -1 Uncomfortable Truth
    3. Re:Thou shalt not kill. by boristdog · · Score: 1

      Will these killbot have pre-set kill limits?

    4. Re:Thou shalt not kill. by ShieldW0lf · · Score: 2

      Will these killbot have pre-set kill limits?

      No, but if you stay off my lawn, you should be safe

      --
      -1 Uncomfortable Truth
    5. Re:Thou shalt not kill. by sethradio · · Score: 1

      Collected from the NSA's PRISM program I presume? Which does not collect any personal information at all...

      --
      "Nationalism is an infantile sickness. It is the measles of the human race." -Albert Einstein
    6. Re:Thou shalt not kill. by davester666 · · Score: 1

      yes, it is the supply of available ammo, followed by when their battery runs out so they can't catch and crush you anymore.

      --
      Sleep your way to a whiter smile...date a dentist!
    7. Re:Thou shalt not kill. by Anonymous Coward · · Score: 0

      .... until SkyNet becomes self-aware, and all those fully autonomous weapons are carrying out it's 'plan' for the future (or lack thereof) of humankind. :-P

  2. "Do not yet exist"? by srussia · · Score: 4, Insightful

    Don't mines qualify as "autonomous weapons"?

    --
    Set your phasers on "funky"!
    1. Re:"Do not yet exist"? by kruach+aum · · Score: 5, Informative

      Not according to the definition used in the summary, which specifies that fully autonomous weapons have the ability to identify targets. Mines fire indiscriminately whenever they're triggered, whether they're stepped on, something falls on them, they fall on something else, whatever.

    2. Re:"Do not yet exist"? by barlevg · · Score: 1

      What if you attached an IFF system to the mine?

    3. Re:"Do not yet exist"? by Anonymous Coward · · Score: 1

      That's a quantitative difference, not a qualitative difference. Mines are just not very good at identifying their targets (they do it mostly based on weight). Early autonomous killer robots will also be much better at killing than at identifying: If it moves and doesn't have an adequate friend-or-foe transponder, shoot at it.

    4. Re:"Do not yet exist"? by Drethon · · Score: 1

      They identify targets just fine, it move == target.

      Not how they define it I'm sure but whatever.

    5. Re:"Do not yet exist"? by Anonymous Coward · · Score: 1

      Mines can be arbitrarily intelligent. Simple persons identify persons vs vehicles. More complex mines can have whatever you want as the trigger algorithm.

    6. Re:"Do not yet exist"? by ShanghaiBill · · Score: 4, Informative

      Don't mines qualify as "autonomous weapons"?

      Most countries have already agreed to ban landmines, by signing the Ottawa Treaty.

    7. Re:"Do not yet exist"? by Anonymous Coward · · Score: 0

      I was thinking the same thing.

    8. Re:"Do not yet exist"? by kruach+aum · · Score: 1

      Then they would have the ability to discriminate, but I would still hesitate to call them robots, because they don't exhibit agency. They passively trigger, they don't actively kill the way RoboCop does.

    9. Re:"Do not yet exist"? by Sockatume · · Score: 1

      They have some autonomy, but no more than barbed wire or a cloud of mustard gas, and we have legal frameworks for those sort of autonomous weapons. The autonomy at issue lately is in target acquisition. Ironically the sort of thing that previous autonomous weapons lacked - the ability to distinguish a target from a non-target - is exactly the thing that raises ethical questions.

      --
      No kidding!!! What do you say at this point?
    10. Re:"Do not yet exist"? by kruach+aum · · Score: 1

      That's not identification. Identification entails a differentiated response to a stimulus (in the case of mines, the pressure plate being triggered). When a mine is triggered, it can only explode, it cannot differentially not explode.

    11. Re:"Do not yet exist"? by Anonymous Coward · · Score: 1

      Then they would have the ability to discriminate, but I would still hesitate to call them robots, because they don't exhibit agency. They passively trigger, they don't actively kill the way RoboCop does.

      I have no idea what use of the word "agency" is that you are attempting here.

      Anyway, it appears that many people here have never heard of CAPTOR mines.

    12. Re:"Do not yet exist"? by Anonymous Coward · · Score: 0

      They have some autonomy, but no more than barbed wire or a cloud of mustard gas, and we have legal frameworks for those sort of autonomous weapons. The autonomy at issue lately is in target acquisition. Ironically the sort of thing that previous autonomous weapons lacked - the ability to distinguish a target from a non-target - is exactly the thing that raises ethical questions.

      Naval mines distinguish targets from non-targets. CAPTOR mines come to mind... only existed for 35 years old...!

    13. Re:"Do not yet exist"? by Anonymous Coward · · Score: 1

      What about anti-aircraft or missile defense systems? Once armed, those are fully autonomous, and have been killing humans for decades.

    14. Re:"Do not yet exist"? by Entropius · · Score: 4, Informative

      There are mines that have a lot more autonomy than that: there are anti-submarine mines called CAPTOR mines that contain a torpedo and a sonar unit; the sonar unit will launch the torpedo at submarines, but not at ships.

    15. Re:"Do not yet exist"? by Shakrai · · Score: 1

      Most countries have already agreed to ban landmines, by signing the Ottawa Treaty [wikipedia.org].

      Historically such agreements have been discarded when an actual shooting war starts. See unrestricted submarine warfare and the bombing of cities during WW2. The Ottawa Treaty is a feel good piece of paper that will just as quickly be discarded in the event of a major conflict. It won't even really delay the production of landmines in such a conflict, because it takes very little know-how and industrial capacity to build them.

      Arms control treaties are useful for complicated weapons that require a major industrial complex and years of investment (the Washington Naval Treaty is the classical example, the Chemical Weapons Convention is a more recent one) to produce. Landmines? Not so much.

      --
      I want peace on earth and goodwill toward man.
      We are the United States Government! We don't do that sort of thing.
    16. Re:"Do not yet exist"? by jfengel · · Score: 1

      Except, of course, for the countries that make huge sums of money producing land mines, and the countries (and non-country actors) with a grudge against somebody and a disposition to not care who else it blows up.

      So according to this site, land mine usage is nearly flat despite the treaty.

      It would be great to get the US to give up making land mines, but unfortunately China and Russia would almost certainly ramp up production to fill any shortfall. That's not a good enough reason for us to keep doing it, but it also wouldn't save many lives. (Worse, it deprives us of a negotiating point to try to force reductions from other top producers, but since those negotiations are largely nonexistent anyway that too is a bad reason.)

    17. Re:"Do not yet exist"? by Anonymous Coward · · Score: 1

      That's a comparison operator. You want something like:

      if(this->moved)
      {
                this->target = true;
      }

      It's a pretty easy oversight to make.

    18. Re:"Do not yet exist"? by davester666 · · Score: 3, Insightful

      Just like civil liberties are ignored after pretty much any "event" within the US.

      --
      Sleep your way to a whiter smile...date a dentist!
    19. Re:"Do not yet exist"? by lister+king+of+smeg · · Score: 1

      Don't mines qualify as "autonomous weapons"?

      Most countries have already agreed to ban landmines, by signing the Ottawa Treaty.

      Yes. But any country likely to start a big war(USA, China, Russia, Iran, Isreal, India, Saudi Arabia Etc) did not sign the treaty. The ones that did reserved the right to keep them around for "training purposes". And the treaty did not ban anti-vehicle mines, claymores, cluster munistions or pretty much anything that a lay person would call a mine.

      --
      ---Saying gnome 3 is better than windows 8 not so much a compliment as it is damning with light praise.
    20. Re:"Do not yet exist"? by Drethon · · Score: 1

      I define my own pseudo code thanks, keeps me from having other people figure out what I mean.

    21. Re:"Do not yet exist"? by ShanghaiBill · · Score: 1

      It would be great to get the US to give up making land mines, but unfortunately China and Russia would almost certainly ramp up production to fill any shortfall.

      That is a misleading statement. America has not sold or exported landmines since 1992. America also has not used any landmines during the wars in Iraq and Afghanistan (although American troops have been killed by landmines in both wars). The vast majority of landmines placed by the US are along the DMZ in Korea. I believe the only other place in the world where the US currently uses landmines are on the perimeter of Guantanamo Bay.

    22. Re:"Do not yet exist"? by Anonymous Coward · · Score: 0

      China and Russia would almost certainly what? Remind me for a second, who destroyed Dresden, Nagasaki and Hiroshima?

    23. Re:"Do not yet exist"? by Anonymous Coward · · Score: 0

      Maybe an anti-personnel landmine which explodes only at the 60 + 25 to 50 kg of load could be said to having differentiated response to discriminate between a child and a soldier with his or hers pack on.

    24. Re:"Do not yet exist"? by jfengel · · Score: 1

      Good point, though I note that the moratorium expires in July. I am not aware of the status of any attempt to extend it.

    25. Re:"Do not yet exist"? by Dr+Max · · Score: 1

      I thought south Korea had installed autonomous killing sentry robots in the demilitarized zone. http://singularityhub.com/2010... . Samsung made I believe.

      --
      Rocket Surgeon.
    26. Re:"Do not yet exist"? by gzuckier · · Score: 1

      Autonomous weapons that identify threats and neutralize them, without human intervention? We used to call those dogs.

      --
      Star Trek transporters are just 3d printers.
  3. Ban them all you want by EmagGeek · · Score: 4, Insightful

    Bans will not only not prevent them being developed, probably even by a technologically advanced State that is a signatory to the treaty, but it will also not prevent them being used by rogue or puppet states who don't care about bans, or who use them at the behest of a signatory state that is just using them to do their dirty work.

    1. Re:Ban them all you want by MozeeToby · · Score: 4, Insightful

      What will happen is that the defense contractors will develop autonomous less-lethal robots that can scout, identify targets, and engage with less lethal weapons. But you know... for flexibility purposes... we'll just make sure the weapon hardpoints are as modular as possible. Hey! I know! We'll make them be adaptable to any standard infantry fir... errrrr, less-lethal weapon.

    2. Re:Ban them all you want by Anonymous Coward · · Score: 0

      Or by "secret" or "black" ops in signatories to the treaty.

    3. Re:Ban them all you want by buchner.johannes · · Score: 3, Insightful

      Bans will not only not prevent them being developed, probably even by a technologically advanced State that is a signatory to the treaty, but it will also not prevent them being used by rogue or puppet states who don't care about bans, or who use them at the behest of a signatory state that is just using them to do their dirty work.

      Any state today is dependent on trade from the international community. If the US and the EU (or any other large fraction of the international community) decide not to trade with a country, and not grant bank transfers to that country, that has a huge effect on their economy. The countries able to withstand this are countable on one hand. Of course, trade sanctions are not a plan, but the lack of a plan.

      It is always better though to help the particular country address their actual problems rather than supporting their approach. For example, perceived threats can be thwarted by establishing a neutral buffer zone controlled by a third party.

      So no, contrary to the common opinion on Slashdot, I think collectively agreeing to not use a certain, dangerous technology can be useful, and is also enforceable.

      --
      NB: The message above might reflect my opinion right now, but not necessarily tomorrow or next year.
    4. Re:Ban them all you want by bluefoxlucid · · Score: 1

      That's okay. I'll just defeat the killbots by sending wave after wave of my own men into battle. Killbots have a preset kill maximum before they shut down.

    5. Re:Ban them all you want by Anonymous Coward · · Score: 0

      Yes, so let's remove the ban on chemical and biological warfare too.

    6. Re:Ban them all you want by thedonger · · Score: 2

      Yes, so let's remove the ban on chemical and biological warfare too.

      Right, because that stops people from using them. Oh wait, no it doesn't. And "Gun Free Zone" stops people from bringing guns into them. Nope.

      --
      Help fight poverty: Punch a poor person.
    7. Re:Ban them all you want by Anonymous Coward · · Score: 0

      You think so? It's not like America will sign up for this or if it does actually very honour \ implement it. Your nation is founded on not honouring treaty obligations.

    8. Re:Ban them all you want by thedonger · · Score: 1

      So no, contrary to the common opinion on Slashdot, I think collectively agreeing to not use a certain, dangerous technology can be useful, and is also enforceable.

      Last I checked, the Slashdot community was more likely to be on the side of supporting a ban. Regardless, how enforceable is such a ban? We can look for signs that a country is developing nuclear capability because of the unique nature of the technology involved. Autonomous, lethal robots, however, are made up of relatively benign or not suspicious parts, so we would have to rely on direct observation to determine if a country were developing such technology.

      --
      Help fight poverty: Punch a poor person.
    9. Re:Ban them all you want by Sockatume · · Score: 1

      That doesn't eliminate the moral imperative for those nations that actually do want to act humanely.

      --
      No kidding!!! What do you say at this point?
    10. Re:Ban them all you want by Anonymous Coward · · Score: 1

      we'll just make sure the weapon hardpoints are as modular as possible.

      Omni slots? Kick ass.

      I'll take a rack of LRM20s and a Clan LBX-20.

    11. Re:Ban them all you want by CreatureComfort · · Score: 1

      Because it's working so well against North Korea, Iran, Cuba, Syria, Russia...

      --
      "Unheard of means only it's undreamed of yet,
      Impossible means not yet done." ~~ Julia Ecklar
    12. Re:Ban them all you want by misexistentialist · · Score: 1

      Which will be bad enough in itself since the police will get them, and you'll be tased for jaywalking

    13. Re:Ban them all you want by Anonymous Coward · · Score: 0

      Yeah, pity nobody can sanction the US-EU "international community"

    14. Re:Ban them all you want by njnnja · · Score: 1

      It is always better though to help the particular country address their actual problems rather than supporting their approach

      What if a country's "actual problem" is that the head of the country wants the land, money, resources, or extermination of a neighbor? It seems like these have been much more common reasons for war throughout history than perceived threats or misunderstandings

    15. Re:Ban them all you want by bitt3n · · Score: 1

      What will happen is that the defense contractors will develop autonomous less-lethal robots that can scout, identify targets, and engage with less lethal weapons. But you know... for flexibility purposes... we'll just make sure the weapon hardpoints are as modular as possible. Hey! I know! We'll make them be adaptable to any standard infantry fir... errrrr, less-lethal weapon.

      They'll just install a remote attack-authorization button so the thing isn't technically autonomous, and then someone at Quantico will put his coffee cup on top of the button. Problem solved.

    16. Re:Ban them all you want by LordLimecat · · Score: 1

      How did our red lines on chemical weapon usage work out in syria? How bout those redlines in crimea?

    17. Re:Ban them all you want by cusco · · Score: 1

      And hold in reserve a firmware update that will reconfigure the device in a few second. I suspect that this treaty, if the US bothers to even consider (much less sign, much less ratify) it, will be treated in much the same manner as the chemical weapons and biological weapons treaty. "We need to develop this capability to practice defending against it, but it's only for training purposes! Honest!"

      --
      "Think about how stupid the average person is. Now, realise that half of them are dumber than that." - George Carlin
    18. Re:Ban them all you want by cusco · · Score: 1

      The problem in Syria is that it was our al Qaeda allies who used the chemical weapons. Whoops.

      --
      "Think about how stupid the average person is. Now, realise that half of them are dumber than that." - George Carlin
    19. Re:Ban them all you want by fustakrakich · · Score: 1

      The countries able to withstand this are countable on one hand.

      So, there you go.

      --
      “He’s not deformed, he’s just drunk!”
    20. Re:Ban them all you want by Anonymous Coward · · Score: 0

      Those countries are not liekly to use killbots. They simply don't have the tech, except for Russia. And Russia don't need killbots; when they go to war, they send soldiers. Dictators don't have to worry about the fact that some soldiers will come back in coffins. If they acheive total victory while loosing 5% of the troops, they still WIN. Not so for a true democracy . . .

    21. Re:Ban them all you want by Anonymous Coward · · Score: 0

      Bans won't help much, because:

      1) The countries most likely to develop these weapons are the powers that can veto UNSC resolutions, or be an unattractive target for sanctions anyway (like Russia is now, due to its gas exports to the EU), and
      2) Based on their past record, I doubt the US will ratify such a treaty (e.g. http://www.hrw.org/news/2009/0...), and rivals won't exactly line up to disadvantage themselves.

      Sad to say, but if the weapons are deemed useful, they will be developed and used.

  4. "There is a problem with the law, so ban scientifi by kruach+aum · · Score: 2

    c development!"

    When I read things like this I wonder how these people even function in daily life without eating pebbles and glue sandwiches. The fact that the law is not currently equipped to assign guilt in the case of the malfunction of an autonomous robot is not a good enough incentive to stop scientific progress. First of all, robots can't kill arbitrarily, they can only kill who their programming specifies they should kill, even if that programming encounters a bug or operates in a manner unforeseen by its programmers. Arbitrarily would be without reference to a standard, randomly, like an earthquake or lightning. Second, banning killer robots will not prevent an arms race. It will simply hamper the combat effectiveness of the side who holds itself to the treaty. Third, it would be much more effective if the money spent on ethicists worrying about how scary science is to them went to the scientists instead, so that it could go into development and research of the very thing the ethicists are so afraid of, to make it better understood and less scary.

  5. 3 laws deleted by BlazingATrail · · Score: 1

    Since it has to kill enemies, they have already deleted the 3 laws. The robot has firewall to any outside control and runs on nuclear power, requiring no recharging. What could possibly go wrong?

    1. Re:3 laws deleted by kruach+aum · · Score: 1

      The three laws of robotics are something Asimov thought up once to present a reasonable system of non-humanoid governance in, and this is key, a fictional world. We shouldn't hold the world we actually live in to standards developed for something meant to entertain, and thus referring to Asimov's three laws of robotics as if they're some authoritative source of "should-be" is unproductive in any discussion involving how we should interact with robots in the real world.

    2. Re:3 laws deleted by RobinH · · Score: 4, Insightful

      Stop with the "3 laws" nonsense. Asimov's "laws" were never intended as actual laws, they were a plot device, and they're certainly not something you "delete" because they were never there in the first place. We already have regulations about machine safety (I work with them every day). The laws govern the control of hazardous energy in a system, with various guarding and interlocks being required to protect humans from injury when they interact with the system, and design constraints determined by how likely certain safety critical component failure is, and redundancy, etc.

      Nobody building a killer robot is going to be worrying about any laws, pretend or otherwise. They're worried about how many units they can sell.

      --
      "I have never let my schooling interfere with my education." - Mark Twain
    3. Re:3 laws deleted by nine-times · · Score: 1

      Yeah, I always find it funny when people cite the "3 laws" as though they were brilliant fail-safe mechanisms that we should of course put into robots in reality. Did nobody actually read Asimov's stories? They're a catalog of examples of how the 3 laws would fail, or at least of how they'd be too ambiguous.

    4. Re:3 laws deleted by MozeeToby · · Score: 2

      Actually, part of the purpose of the 3 laws stories was to show that even if you built robots from the ground up to not harm humans, you can still end up in situations where robots are dangerous to humans. Almost every 3 laws story revolves around trying to determine why the three laws failed. This becomes more and more true as the robots become more and more sophisticated; primitive robots cause minor hassles, more advanced robots risk death and serious injury, more advanced yet take over the planet to reduce the total harm to humanity in general (yes, the stupid movie plot is, in fact, based (loosely) on one Asimov's stories, though in Asimov's story the takeover was completely non-violent).

    5. Re:3 laws deleted by GameboyRMH · · Score: 1

      Not sure if Evangelion reference was intentional...

      --
      "When information is power, privacy is freedom" - Jah-Wren Ryel
    6. Re:3 laws deleted by LordLimecat · · Score: 2

      Anyone citing them also has a serious lack of understanding in how programming works.

      Hey I know we should create 3 laws of software to be implemented in all code thats written:

      • No software may perform an operation that is not intended by its writer.
      • Software must be able to deal with all inputs in a reliable and predictable manner.
      • No software may operate in an unexpected fashion

      I think I just solved the problem of software bugs!

    7. Re:3 laws deleted by badbart · · Score: 1

      I also wonder if anyone quoting the "3 laws" has actually read Asmiov. He explicitly states in several stories that the actual 3 Laws are mathematical formulae encoded in the paths of the robots positronic brains. The oft-quoted English versions are handy paraphrases at best.

    8. Re:3 laws deleted by vivian · · Score: 1

      As a software engineer that daily works on developing robot control software and algorithms for industrial robots, (yes, I love my job) I can assure you that we are very far indeed from even having robots that know they are scratching their own arses, let alone having anything like the reasoning capacity embodied in the three laws.
      Robots of today are dumb - sure, there are clever planning algorithms that make them flexible enough to work in a relatively predictable dynamic environment, but we are no where near the point of having robots implement the first law.
      As for the second law - wel computers (and by extension robots) are infamous for doing exactly what they are instructed - even if the result is garbage. Part two of that law is problematic given we can't really do part 1.
      For the third law, actually that's almost the oppsite of what we try to achieve - we try our hardest to make sure that the robot will flat out refuse to do something that will harm it, even if told to do so by a human. if the robot gets given an instruction to start plasma cutting it's tracks or the cabinet containing it's drive controllers, it damn well better ignore that order. At bese, we can do collision avoidance of stuff in the environment to prevent harm, but I don't see us any time soon have them having behaviour programmed in to ufulfil the 'inaction" clause - for example, rush over and stop me cutting myself on broken glass, or recognising I am in danger from a falling beam and catching it (or even beeping a warning) , or something like that.

    9. Re:3 laws deleted by Devoidoid · · Score: 1

      The Three Laws of Robotics IIRC were actually something John W. Campbell thought up on the fly in a meeting with the young Asimov, giving them to him as a story challenge. It is interesting how what was basically a quick and dirty plot device has become so firmly entrenched in the general consciousness that so many people think they're real.

  6. What is there to debate? by Anonymous Coward · · Score: 2, Interesting

    Auto-targeting weapons are only a matter of time. If a college student can make a gun that spits out paintballs with high accuracy, then the best and brightest likely have items far superior.

    Yes, the UN will debate it, but it will be like the debate on land mines. A lot of hand wringing, but nothing really getting done, and the belligerent parties will still make them.

    Right now, it is only a matter of perfecting manufacturing. I wouldn't be surprised to see in 5-10 years that sentry robots, which shoot at anything that doesn't have some form of friendly transponder, will become the norm on not any military post, be it Russian, Chinese, Saudi Arabian, or any other place that needs area denial.

    Lets be real here... a couple independently active robots with high RPM machine guns are a lot more reliable than soldiers/guards, have no moral issues, have no morale issues, and will "just work". Someone takes one out with a rocket, another can easily return fire.

    Add sentry UACVs to the mix, and a rocket attack would be responded in kind.

    I wouldn't be surprised to see even civilian warehouses (a data center in a rural area) protected by autonomous firing machines soon. Might makes right, and SCOTUS has shown that money is speech, so any casualties from these would have no criminal/civil consequences ("there was a warning sign".) I would also not be surprised to see this on train tracks and other places, where there isn't a need for it, but the fear of being gunned down by a robot will keep kids from putting pennies on tracks.

    Look how tasers are overused. Expect the same thing with these.

    1. Re:What is there to debate? by meta-monkey · · Score: 1

      To be honest, civilian sentry robots with non-lethal weapons would be cool. Rubber bullets, bean bags, paintballs, whatever.

      --
      We don't have a state-run media we have a media-run state.
    2. Re:What is there to debate? by Sockatume · · Score: 1

      The preferred term is "less-lethal".

      --
      No kidding!!! What do you say at this point?
    3. Re:What is there to debate? by Electricity+Likes+Me · · Score: 1

      The real goal is to build a robot which can outrun a human and then just holds onto them until the authorities arrive. The magic of robotics is really going to be the ability to let the robot take the first, second and subsequent shots and keep going.

    4. Re:What is there to debate? by gurps_npc · · Score: 1

      As I posted earlier, they are not a matter of time, they are a matter of already built. The USA may have no desire to build or use them, but South Korea sits on the border with North Korea and has built them and installed Super Aegis II armed robots on the border.

      --
      excitingthingstodo.blogspot.com
    5. Re:What is there to debate? by GameboyRMH · · Score: 1

      I know at least rubber bullets and paintballs can still maim the shit out of you.

      --
      "When information is power, privacy is freedom" - Jah-Wren Ryel
    6. Re:What is there to debate? by LordLimecat · · Score: 1

      Auto-targetting weapons exist and have for some time. CIWS and Phalanx, for starters.

  7. Nothing will happen by Anonymous Coward · · Score: 0

    This is a pointless debate, the US sits on the security council and will veto any resolution against the use of their new, yet to be developed, toys.

  8. Why would anyone want killer robots? by Anonymous Coward · · Score: 0

    Didn't they ever watch that documentary starring John Conner and Sarah Conner?

  9. If the goal is to prevent the robot apocalypse... by Anonymous Coward · · Score: 0
  10. Arms race by Anonymous Coward · · Score: 0

    You're right. Clearly having any regulation of war whatsoever is foolish because "rogue" states will not abide by them anyway.

    Now explain the holocaust, please.

    1. Re:Arms race by CreatureComfort · · Score: 4, Interesting

      Well, you make his point eloquently.

      The holocaust was conducted clearly by an advanced state, signatory to many treaties and international obligations and "laws", none of which served to make any difference whatsoever, when that state decided they didn't care what the rest of the world thought.

      But why stop there? Rwanda, Stalin's purges, China's Cultural Revolution, Kashmir, Iraq-Iran, until the U.S. got actively involved, all the U.S. wars against brown people, etc., etc., etc. When has international law, regulations, or even opinion, ever changed the conduct of an aggressor nation when they decided to go to war? The reason nukes haven't been used since Nagasaki is only because everyone who has them is afraid if they used them in aggression, it would trigger a much higher escalation, and has nothing to do with any treaties, laws, or world opinions.

      --
      "Unheard of means only it's undreamed of yet,
      Impossible means not yet done." ~~ Julia Ecklar
    2. Re:Arms race by Anonymous Coward · · Score: 0

      Mr. President, we must not allow a Halocaust gap!

    3. Re:Arms race by micahraleigh · · Score: 1

      "all the U.S. wars against brown people"

      There has never been a war where the US considered all people with brown skin to be enemy combatants.

      If you are intending to say certain wars a lot people in our enemies nations had brown skin, you are looking at a problem very superficially.

    4. Re:Arms race by Anonymous Coward · · Score: 0

      Not all. Only sub-human ones.

  11. Re:"There is a problem with the law, so ban scient by Anonymous Coward · · Score: 1

    The fact that the law is not currently equipped to assign guilt in the case of the malfunction of an autonomous robot

    But it is. In the case where an autonomous industrial robot kills someone it is possible to assign guilt. In those cases the paper trail is followed until a step can be found where the safety standards for industrial robots where violated. The blame will be put on the developer that didn't take necessary safety precautions. If no such flaw can be found the guilt is put on the person that disconnected or sidestepped the safety critical components. (Most of the time, but not always, this is the person that got hurt.)

    Those standards naturally doesn't apply to weapons that were designed to kill people.

  12. Robot soldiers more civilian friendly than humans? by swb · · Score: 4, Insightful

    I don't know how robot soldiers identify targets, but presuming they have some mechanism whereby they only kill armed combatants it's not hard to see some advantages over human soldiers at least with respect to civilian noncombatants.

    More accurate fire -- ability to use the minimal firepower to engage a target due to superior capabilities. Fire back only when fired upon -- presumably robots would be able to withstand some small arms fire and thus wouldn't necessarily need to shoot first and wouldn't shoot civilians.

    Emotionally detached -- they wouldn't get upset when Unit #266478 is disabled by sniper fire from a village and decide to kill the villagers and burn the village. You don't see robots engaging in a My Lai-type massacre.

    They also wouldn't commit atrocities against civilians, wonton destruction, killing livestock, rape, beatings, etc. Robots won't rape and pillage.

  13. Sad but true by slashmydots · · Score: 1

    I hate to be the pessimistic voice of reality here but terrorists and bad governments like N Korea and Syria would use them if they had them. They would use nuclear weapons, radiation bombs, chemical warfare, etc if they had them. Some already have. So hit them with robots now. This is the same stupidity as putting up a sign outside a theater that says no guns allowed inside. What's the result? Criminals and crazy people carry guns in and regular people don't have them. My point is, a ban will do nothing to people who won't follow the rules anyway.

  14. Now that is a problem, but soon will be a feature. by rallycellie · · Score: 1

    "......If a robot killed arbitrarily, it would be difficult to hold anyone accountable."
    That is the golden goose...

  15. Assume only responsible for wilful acts? by redelm · · Score: 1

    The difficulties are only in people's minds -- especially those who seek justification to push projects. If someone deploys a weapon, they are responsible for all foreseeable consequences. Whether that weapon is a slug of dumb lead, smart missile or robot.

    Even if the weaponeer did not intend the effects they are still responsible, perhaps as manslaughter rather than murder. The capabilities and risks are hardly concealed. OTOH, if they were careless nor negligent, then their responsibility increases. Nothing new here, just salesmen trying to assuage and belay responsibility of the buyers.

  16. Ottawa Treaty, Part Deux by xxxJonBoyxxx · · Score: 4, Informative

    I expect this will be as successful as the UN's 1990-era anti-mine treaty (the Ottawa Treaty - http://en.wikipedia.org/wiki/O...), with over a hundred signatories, but not Russia, China or the United States. http://en.wikipedia.org/wiki/L...

    1. Re:Ottawa Treaty, Part Deux by silas_moeckel · · Score: 1

      Possibly because it's asinine? Mines are cheap and effective weapons. They would have been far better off requiring that mines have some form of self destruct when not used in a designated area.

      --
      No sir I dont like it.
    2. Re:Ottawa Treaty, Part Deux by Electricity+Likes+Me · · Score: 1

      The problem is the self-destruct on the mines was expected to have about a 3% failure rate (these were actually developed). Leaving 3% of your mines in the ground and potentially active after the conflict means you're still left with mindfields about as large as they were during the war.

    3. Re:Ottawa Treaty, Part Deux by Anonymous Coward · · Score: 0

      Which wouldn't help at all with cleanup. You need them to have a self-destruct mechanism by remote control so you can visit the location, clear the area of any people, then broadcast a destruct command.

      Technically it'll increase the cost but be entirely possible. The only issue is how to secure it, since it's pointless to have the enemy have the key and the manufacturer may well be on the enemy's side in future.

    4. Re:Ottawa Treaty, Part Deux by jittles · · Score: 1

      I expect this will be as successful as the UN's 1990-era anti-mine treaty (the Ottawa Treaty - http://en.wikipedia.org/wiki/O...), with over a hundred signatories, but not Russia, China or the United States. http://en.wikipedia.org/wiki/L...

      Don't worry. I've been playing Minesweeper almost every waking moment since the signing of the Ottawa Treaty. By my calculations, the earth should be mine free in another decade or two.

    5. Re:Ottawa Treaty, Part Deux by DougF · · Score: 1

      Maybe because 50,000 of them separate North from South Korea, are much cheaper than 50,000 soldiers in their place, and you don't have to send body bags and letters home to widows?

      --
      Impetuous! Homeric!
    6. Re:Ottawa Treaty, Part Deux by CanHasDIY · · Score: 1

      They would have been far better off requiring that mines have some form of self destruct when not used in a designated area.

      ... and it would be equally as effective as requiring that mines be made from rainbows and unicorn farts.

      Let's face reality here: The sort of people who start wars,plant mines, and want armies of automated killing machines don't really give a shit how many children they cripple over the next couple of decades, because they know it won't be their children getting crippled.

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
    7. Re:Ottawa Treaty, Part Deux by Anonymous Coward · · Score: 0

      It would be better to make them battery powered, once the battery dies they can't go boom.

    8. Re:Ottawa Treaty, Part Deux by silas_moeckel · · Score: 1

      Reducing the number of mines to be cleared by 97% is a huge improvement. There was research into biodegradable explosives as well.

      PS the treaty only covers antipersonnel mines, antitank mines are also dangerous post war to the civilian population.

      --
      No sir I dont like it.
    9. Re:Ottawa Treaty, Part Deux by Chris+Mattern · · Score: 2

      Reducing the number of mines to be cleared by 97% is a huge improvement.

      But you *haven't* reduced the number of mines to be cleared by 97%, because you can't tell which ones have failed to deactivate (until they explode). So you still have to clear all of them.

    10. Re:Ottawa Treaty, Part Deux by GameboyRMH · · Score: 1

      You know those are only virtual mines right? /reverseendersgame

      --
      "When information is power, privacy is freedom" - Jah-Wren Ryel
    11. Re:Ottawa Treaty, Part Deux by GameboyRMH · · Score: 1

      and you don't have to send body bags and letters home to widows?

      Yes you do, just later when the border is dissolved and civilians run across any mines that weren't removed (which, if the mines were deployed in a shithole, will be all of them).

      Well technically you could be sending the letters to parents or widowers, but you get the idea.

      --
      "When information is power, privacy is freedom" - Jah-Wren Ryel
    12. Re:Ottawa Treaty, Part Deux by silas_moeckel · · Score: 1

      Depends on how they deactivate. Detonating the mine does not leave much to question whether or not it's still active.

      --
      No sir I dont like it.
    13. Re:Ottawa Treaty, Part Deux by LordLimecat · · Score: 1

      Biodegradable mines are a red herring. Theyre almost certain to be more expensive and less reliable, and when you're in an armed conflict you tend not to care about such things as "biodegradable" or "what happens after the war".

    14. Re:Ottawa Treaty, Part Deux by lister+king+of+smeg · · Score: 1

      and you don't have to send body bags and letters home to widows?

      Yes you do, just later when the border is dissolved and civilians run across any mines that weren't removed (which, if the mines were deployed in a shithole, will be all of them).

      Well technically you could be sending the letters to parents or widowers, but you get the idea.

      my guess is by the time that boarder is dissovled many of them will have gone off already.

      --
      ---Saying gnome 3 is better than windows 8 not so much a compliment as it is damning with light praise.
  17. Re:Robot soldiers more civilian friendly than huma by Anonymous Coward · · Score: 0

    wonton destruction

    Leave my dumplings alone!

  18. Re:"There is a problem with the law, so ban scient by Anonymous Coward · · Score: 0

    c development!"

    When I read things like this I wonder how these people even function in daily life without eating pebbles and glue sandwiches. The fact that the law is not currently equipped to assign guilt in the case of the malfunction of an autonomous robot is not a good enough incentive to stop scientific progress.

    Well, I'm glad there's at least one of us here who thinks designing something for a singular purpose (killing) is somehow scientific "progress". Who would want to miss out on the next atom bomb, or anthrax. After all, we've had so many things to be proud of in this area of "advancement" as a race.

    First of all, robots can't kill arbitrarily, they can only kill who their programming specifies they should kill, even if that programming encounters a bug or operates in a manner unforeseen by its programmers.

    Speaking of arbitrary, ever heard of AI? Yeah, I guarantee those who are building these fucking things have.

    And I love how you dismiss a "bug" here as if lives didn't just end as a result of said bug. These are robots designed for a single purpose. When they fuck up, it's kind of huge. I'm fearful stepping into a car with seatbelts and air bags under automated control for fear of bugs, and you dismiss bugs in a killing machine as "oh well, Patch Tuesday is soon."

    I'm not sure what is scarier, the research itself, or mentalities like yours.

  19. It's not tricky by wyr_taliesin · · Score: 1

    Let states develop and use them, and make it legally binding that the responsibility for deploying them and for anything they do is the personal legal responsibility of the head of government, and with no 'sovereign immunity' get-outs.

    1. Re:It's not tricky by LordLimecat · · Score: 1

      Who holds that sovereign responsible? The "international court"? Good luck with that if its the US, Russia, or China.

  20. Fraught with danger... by GrpA · · Score: 2

    Taking such action really is a bad idea. An autonomous killing machine could be as complicated as as a military drone with hellfire missiles or as simple as a car loaded with autonomous weapons designed to engage any anything that move, with a GPS pre-determined route and self-driving capability, sitting like a mobile minefield in an abandoned house long after the occupants have left, waiting to be activated.

    I think the appropriate course of action would be to feed international condemnation of such tactics until they are treated with ruthlessness by the international community against any involved in use of such weapons, for any infraction. Just like the use of chemical weapons should have been...

    Autonomous weapons are far more frightening that WMDs... And nowhere is safe.

    Then again, I wrote a book on the creation of a universal standard for determining if an autonomous weapon could be trusted with the decision to kill, so perhaps I am somewhat hypocritical there.

    GrpA

    --
    Enjoy science fiction? "Turing Evolved" - AI, Mecha, Androids and rail-gun battles. What more could you want?
    1. Re:Fraught with danger... by Anonymous Coward · · Score: 0

      How about just not being an asshole? Then the target discriminators wouldn't lock on to you. Just a thought.

  21. Re:Robot soldiers more civilian friendly than huma by cortcomp · · Score: 1

    You don't see robots engaging in a My Lai-type massacre.

    They also wouldn't commit atrocities against civilians, wonton destruction, killing livestock, rape, beatings, etc. Robots won't rape and pillage.

    Of course they wouldn't, why would you release the whole feature set at once?! What kind of long term value are you giving to shareholders? V1 identifies targets and shoots, the 1.5 upgrade (which is really a bufix) is free to certain level customers but a small (50% of entire robot price) to everyone else. V2 will commit SOME atrocities, but there will be atrocity incompatibility with other models. No upgrade, just have to buy new. Robot Infinity (break away from model numbers for marketing, even though firmware says V3 all over the non-secure telnet command prompt with default password of 0000) will have coordinated atrocity mode (so it can work with drones and other automated craft to just atrocitize EVERYTHING! ALL NEW VERSION!!!) Finally, livestock killing (enemy supply elimination mode) and beatings (enemy non-lethal submission) and rape (enemy supporter kinetic repetition mode) all come after Robot version Infinity^2 fails and they hurry up and rush windows 7 errr Robot 7 out the door that finally does everything that previous robot versions have been promised they will do for years. Don't even get me started on Robot Server: "Robot Server makes administrating robots easy by making everything point and click GUI and no more scripts and command lines! That's why we're better than Robot *nix and competitor x!" Robot Server 2008+ "GUI is dumb, command shell robot administrating is the way to go! Scripts where one command updates a 2000 robots! No more selecting and clicking! No more security support for Robot XP, if those go off killing people from lack of security updates, hey, you should have upgraded, even if your robot did all the raping and pillaging you needed."

  22. Re:"There is a problem with the law, so ban scient by kruach+aum · · Score: 1

    The scientific progress lies in the identification of targets for energy transfer. That they can or will be used to kill people is completely irrelevant because pretty much every scientific advancement of the last hundred years can be used to kill people, whether that means flying a plane into a skyscraper or dying from chemo therapy and radiation before the cancer kills you.

  23. Re:"There is a problem with the law, so ban scient by Sockatume · · Score: 1

    AFAIK any mandate wouldn't restrict the development of these weapons, just the deployment. It's not like the complete irrelevance of a technology in a battlefield setting ever stopped DARPA before.

    --
    No kidding!!! What do you say at this point?
  24. Re:let me predict how this will go: by sTERNKERN · · Score: 1

    Homing missiles are fired by a person. We are talking about machines here which can have only a vague order like "protect this facility" or "advance to this point" and during the execution of these commands they can identify encountered people as hostile based on some criterias and can "decide" to eliminate them. That does not even come close to a homing missile.

  25. Autonomous weapons could be good by guytoronto · · Score: 1

    In a ground combat scenario, autonomous weapons could be a good thing. Right now, soldiers are tasked with protect others as well as themselves, and in most situations the safest resolution is to kill the antagonist. A machine or robot wouldn't suffer from emotional lapses in judgment (anger, hostility). A robot may have better weapons skills, so instead of a kill shot, may only need to wound. A robot would be more willing to put itself in harms way to protect a living person.

    The programming required for such a machine would be incredibly complex, but controllable with defined precision. A human soldier can't be controlled or programmed, and history shows that humans make a lot of bad decisions when it comes to the use of deadly force.

    1. Re:Autonomous weapons could be good by Anonymous Coward · · Score: 1

      Only problem is that it can be hacked... and with the fact that there are no US chip fabs (any CPU work is done overseas), even at the hardware die level, there can be backdoors. So, that autogunner with tank treads can be easily turned around if there is a Sino-European engagement.

      The issue of computer security will be even more of one with autonomous weapons... and I'm sorry, it doesn't seem that US and European companies are not up to snuff when it comes to actual security where lives are at stake. Hopefully I'll be proven wrong, but I do worry.

    2. Re:Autonomous weapons could be good by Anonymous Coward · · Score: 0

      with the fact that there are no US chip fabs (any CPU work is done overseas)

      Wrong.

      that autogunner with tank treads can be easily turned around [emphasis added]

      Easily? Via a backdoor hidden in the CPU? Sure, it'll be exactly like when Darth Sidious turned the clone troopers against the Jedi...

    3. Re:Autonomous weapons could be good by lister+king+of+smeg · · Score: 1

      Well Intel has fabs in Hillsboro Oregon, Chandler Arizona, Rio Rancho New Mexico, Hudson Massachusetts, Leixlip Ireland, Kiryat Gat Israel, Dalian China, so thats bullshit. As most of theirs are in the US.

      --
      ---Saying gnome 3 is better than windows 8 not so much a compliment as it is damning with light praise.
  26. Re:Robot soldiers more civilian friendly than huma by Anonymous Coward · · Score: 0

    They are like Unsullied?

  27. Re:"There is a problem with the law, so ban scient by thedonger · · Score: 1

    The scientific progress lies in the identification of targets for energy transfer. That they can or will be used to kill people is completely irrelevant because pretty much every scientific advancement of the last hundred years can be used to kill people, whether that means flying a plane into a skyscraper or dying from chemo therapy and radiation before the cancer kills you.

    Don't forget, "or taking Cialis and dying from (complications due to) a 6 hour erection."

    --
    Help fight poverty: Punch a poor person.
  28. Almost entirely valueless discussion... by argStyopa · · Score: 2

    ...as with most technological weapon issues, those with them, or with a reasonable chance of developing them will defend the idea.

    Those without will roundly condemn it using a great deal of moral and ethical language, but their base issue is that they cheerfully condemn the use of any weapons that they cannot yet field.

    The UN as a clearinghouse organization for multinational efforts does a massive amount of good that would otherwise be difficult to enable.
    The UN's general chambers are worthless talking shops where inconsequential states get to criticize significant, powerful states for acting in their own narrow self-interest ... for reasons based entirely on their OWN narrow self-interests. (Not to mention its main actual value: a way for the favored scions of grubby tinpot regimes to be prostitute-frequenting scofflaws in a place far nicer than their own pestilential capitals.)

    --
    -Styopa
  29. Re:"There is a problem with the law, so ban scient by Electricity+Likes+Me · · Score: 1

    Uh...what?

    I'm pretty sure everything DARPA works on has huge battlefield relevance. It's not like cold-fusion powered tanks wouldn't be a huge game-changer.

  30. Don't they already exist? by Kjella · · Score: 1

    Now if you were a kamikaze pilot and everybody was sleeping on the job and you went for a final dive against a modern battleship or aircraft carrier, wouldn't you already be blased to bits by an autonomous defense system? I imagine the same goes for tanks, planes, helicopters and even indivdual robot-soldiers, you'll never wait until you're blasted to bits to say "yup, that was an enemy". Even if they don't go on their own search & destroy missions I doubt they'll avoid being used as sentries, convoy escort and other defensive purposes. Or even "defensive on the offensive" weapons like if you point an RPG at a tank. Not to mention self-defense backups if the communication to the mothership is jammed, nobody will leave high tech military equipment stranded and defenseless by a simple communcations jammer. Not going to happen.

    --
    Live today, because you never know what tomorrow brings
  31. gas by AndyKron · · Score: 0

    Poison gas kills without human intervention too

  32. Re:Robot soldiers more civilian friendly than huma by Anonymous Coward · · Score: 0

    They also wouldn't commit atrocities against civilians, wonton destruction, killing livestock, rape, beatings, etc. Robots won't rape and pillage.

    Why not? Conflict throughout history has always used all of the above as weapons of war. If a robot is given the ability and programming to, it'll do all of the above. And an advanced AI could well decide they help towards its goals of winning a war, either through spreading terror among the enemy or destroying their food supply.

  33. Features by Ginger+Unicorn · · Score: 0

    Do they come with Lotus Notes and a machine gun?

    --
    (1.21 gigawatts) / (88 miles per hour) = 30 757 874 newtons
  34. If a robot killed arbitrarily, would it be any... by Anonymous Coward · · Score: 0

    more difficult to hold anyone responsible than it is now, when drone operators arbitrarily murder civilians based on flawed intelligence, via signature threat (oh, there's a couple people with guns, let's blow them up!) on the way to a target based on flawed intelligence, or just plain negligence on the part of the operator? How about firing on wounded civilians being evacuated? War crimes? Please. Amerika is so above reproach... Don't make me put you on a terrorist watch list and detain you indefinitely while I waterboard the truth out of you.

  35. South Korea has them SuperAegis II by gurps_npc · · Score: 2
    My understanding is that South Korea has robotic guns set up on the border with North Korea. While they can be human over-ridden, when fully activated, they fire at anything that attempts to cross the border.

    The Super Aegis II has a 12.7 mm machine gun and a grenade launcher. laser and infrared sensors that see 3 km in the day, 2 at night. But the gun probably can't shoot that far - it just sees that far.

    --
    excitingthingstodo.blogspot.com
  36. Re:"There is a problem with the law, so ban scient by nine-times · · Score: 2

    Beyond that, I see another problem with the idea of banning development of autonomous weapons: most of the technology involved would probably be developed anyway because it would be widely applicable.

    Think about it. If you were going to make a killer robotic soldier, what technology would be hard to develop? It's difficult to make a robot that can easily traverse diverse terrain, but we'll work on that for other reasons. Making an AI that can accurately identify people by facial features, clothing, and speech patterns would be hard. We'd also do that for other reasons. There are a million reasons to develop and intelligent free-roaming robot who can identify people and interact with them.

    Once you have a robot that can do those kinds of things, turning the "interaction" into "fire a weapon at that person" is easy. It's not hard for a computer to aim once it has its target. It's not hard for a computer to trigger the weapon itself.

  37. Vicious Cycle by Pollux · · Score: 1

    Killer robots, or fully autonomous weapons, do not yet exist but would be the next step after remote-controlled armed drones used by the US military today.

    Weapons contractors make their living imagining new weapons, sharing their visions with the public, then advocating that the US Military develop those weapons to avoid "the enemy" from making them first. Then once the weapon is invented, new weapons need to be created to defend against the weapon that already exists. Wash, rinse, repeat.

    And people wonder why so much money is spent on defense spending.

    1. Re:Vicious Cycle by Anonymous Coward · · Score: 0

      I know what you're doing. You're trying to stir up class warfare with your always attacking the the job creators.

  38. Why? by Mike+Frett · · Score: 1

    We need all of this why? Wanting Weapons and Wars just shows how non-advanced and uncivilized Humans are and how we haven't even moved out of our caves yet.

    If we are to survive well into the future, we need to learn to disregard our primitive ways and start thinking about others instead of only ourselves. The whole idea of separate Countries and separate people disgust me deeply. People, we are not separate, we all live on a tiny Blue Planet in the middle of an unexplored ocean of awesomeness. If we can't rid ourselves of our primitive nature, maybe we are long overdue for extinction.

    1. Re:Why? by clovis · · Score: 1

      We need all of this why? Wanting Weapons and Wars just shows how non-advanced and uncivilized Humans are and how we haven't even moved out of our caves yet.

      If we are to survive well into the future, we need to learn to disregard our primitive ways and start thinking about others instead of only ourselves. The whole idea of separate Countries and separate people disgust me deeply. People, we are not separate, we all live on a tiny Blue Planet in the middle of an unexplored ocean of awesomeness. If we can't rid ourselves of our primitive nature, maybe we are long overdue for extinction.

      Well said.
      All we need to do is put everyone who refuses to disregard their primitive ways into re-education camps where they can grow into rational modern humans.
      But, in the past this has caused some hostility between the people being rounded up and those who have been tasked with finding them.
      But, it has a simple solution. All we need to do is make numbers of autonomous robots to do the gathering.
      It will be easy to identify the primitive humans, because they'll be the ones trying to resist re-education. Sadly, it may require that the autonomous robots be armed.

    2. Re:Why? by xtal · · Score: 1

      If you do not have men with guns to protect your freedom, money, women, *insert thing here, other (bad) men with guns will come take it from you.

      That's human nature, and I have no problem with my way of life being protected under threat of planetary annihilation.

      Forget that lesson at your peril.

      --
      ..don't panic
  39. Why the condemnation? by Entropius · · Score: 1

    People condemn autonomous killing robots because they might screw up and kill something that shouldn't be killed.

    How is this any different from what humans in charge of deciding who to kill do? (exhibit A: the Iraq war)

  40. Soldiers with no human faults? by penguinoid · · Score: 1

    I'm outraged that anyone is even considering building soldiers that have no intrinsic sense of self-preservation, adrenaline, aggression, revenge. Imagine a soldier that would allow itself to be destroyed rather than fire when ordered not to, eg if there would be civilian casualties or if the target is not definitively identified. Obviously that sort of thing can't be allowed, because if we don't kill innocent bystanders how can we spawn new enemies to fight? Sadly, I suspect that robot soldiers won't actually be built with the goal of avoiding human faults.

    --
    Don't waste your vote! Vote for whoever you want, unless you live in a swing state it won't matter anyways
  41. Not accountable? Bullshit. by UnknownSoldier · · Score: 1

    > it would be difficult to hold anyone accountable.

    Whoever built the hardware, and programmed the software would be accountable.

    In shootings we hold the shooter responsible because it was a human who committed the crime. Since there is no human on the end, we can simply go back up the "chain" to find the people who ARE responsible.

    This isn't rocket science.

    1. Re:Not accountable? Bullshit. by Anonymous Coward · · Score: 0

      > it would be difficult to hold anyone accountable.

      Whoever built the hardware, and programmed the software would be accountable.

      In shootings we hold the shooter responsible because it was a human who committed the crime. Since there is no human on the end, we can simply go back up the "chain" to find the people who ARE responsible.

      This isn't rocket science.

      Like all those innocent women and children killed by US drone strikes on wedding parties and such in foreign countries, and then the emergency responders that get the 'double tap' when they show up to help the victims of the first strike? I'm having a hard time finding references to all the trials of humans we've done "simply going back up the 'chain' to find the people who are responsible", can you point me to some links/info on all the prosecutions we've done against them?

  42. explaining the holocaust by Anonymous Coward · · Score: 1

    Now explain the holocaust, please

    That was the planned crime-against-humanity that was considered by the Nazis, but then right before they did it, one of Hitler's lawyers said, "Hey wait. According to this, the proposed action will be against the law." Since Hitler was top dog, he realized that he would have to prosecute himself, and that opened up such terrifying vistas of self-reference and paradox, that he was totally horrified. So he hastily abandoned the plan. Unfortunately, the memo cancelling the operation had typoes in the return address ("hitlOR" at "naTzi" dot gov), and the receiving servers (upon checking SPF and DKIM (I can't remember which)) thought it was spam, so it got filtered, so lots of innocent people got killed anyway. But that was a failure of anti-spam tech, not a failure to try to abide by law.

  43. Knee Jerk Yo Yo by JimSadler · · Score: 1

    Think about the size of an army that China can deploy. We have zero ability to even dream of a one on one combat situation with a traditional Chinese army. Fielding mechanical warriors of various types would be our real hope other than using nuclear bombs are other weapons of mass destruction. Or the US could put two million soldiers on the line and watch them be swarmed over as a trivially, small force. Then there is the problem of cost. And it is not just for the full military responses. An effective border control is an economic back breaker. We could easily put automated devices on our border with Mexico which would shout out a freeze until a custodial officer arrives and if movement continues simply execute the target. We could make it next to impossible to violate our border and save millions in patrol costs continually. The same could be done at sea to protect restricted waters from foreign exploitation by whaling or fishing vessels. And then there is the drive by shooter issue so common in parts of California. Imagine punks firing into a home when suddenly a robotic warrior pops up with a very good weapon blazing at the offenders car. I know, all you who whine about guns, I repeat the problem is only that the wrong people are getting shot. Anything that gets the right people shot is a blessing.

    1. Re:Knee Jerk Yo Yo by HBI · · Score: 1

      The Russians thought this way during WWI and WW2. So did the Chinese during the Korean War. They suffered casualty rates that ran to 10:1. Human steamroller tactics produce a lot of bodies but not a lot of results.

      --
      HBI's Law: Frequency of calling others Nazis is directly correlated with the likelihood of the accuser being Communist.
    2. Re:Knee Jerk Yo Yo by cusco · · Score: 1

      We have zero ability to even dream of a one on one combat situation with a traditional Chinese army.

      OK, I'll bite . . . Why the hell would we even WANT to? Are you actually frightened that the Chinese are going to swim across the Pacific and invade? Or maybe they'll wander through Russia and build a bridge across the Bering Straight, marching through Alaska? Sorry, but the entire scenario of a direct China/US war is absurd, there isn't even any reason to pretend to prepare for such a thing.

      --
      "Think about how stupid the average person is. Now, realise that half of them are dumber than that." - George Carlin
  44. Re:"There is a problem with the law, so ban scient by FrozenToothbrush · · Score: 1

    Human beings need to understand themselves better; the machines will only be as good as their creators. We have no right and absolutely no need to build killer robots at this time. This further disconnects people from the reality of life and death.

  45. Re:Robot soldiers more civilian friendly than huma by Sibko · · Score: 2

    You don't see robots engaging in a My Lai-type massacre.

    They also wouldn't commit atrocities against civilians, wonton destruction, killing livestock, rape, beatings, etc. Robots won't rape and pillage.

    Well... You won't see them independently decide to do something like that. But orders are literally orders to a robot. You tell them to burn a city to the ground, shoot anyone who tries to flee, and they will burn that city to the ground and shoot everyone who flees. Without remorse, without second guessing orders, without a moment of any hesitation.

    Which frankly, worries me a bit more. Because the upper levels of command in just about every model of human hierarchy always seems to have worrying numbers of psychopaths/sociopaths beyond what you'd expect in a normal pool of the population. On top of that - they're physically removed from the carnage. It's a lot easier to order the leveling of a rebel-occupied village when you will never personally see the slaughter of innocents that result.

    That's not to say humans never do these things. Just that, humans are capable of refusing to do these things. Robots aren't.

  46. Re:Robot soldiers more civilian friendly than huma by bmajik · · Score: 1

    Well, for the specific case of rape, its hard to see what would be politically gained by a society advanced enough to deploy these. I view some atrocities as a by product of turning real humans into killers in a war setting.

    The discussion is about fully autonomous devices. It makes no sense to program an autonomous device to project power as sexual violence instead of just violence.

    Now, if we're talking about remote controlled machines..i fear we replace one kind of dynamic with another. We protect women from sexual violence from predatory men who are in theater, but introduce to the problem invincible machines being remotely controlled by guys who shoot the prostitutes in grand theft auto.

    Almost nothing could be worse than to let humans control these machines remotely with live audio/video feeds. If that happens, You WILL see women stripping for the machines like cam girls, under threat, in fear....before being killed anyway after the operator has caused enough humiliation and anguish.

    --
    My opinions are my own, and do not necessarily represent those of my employer.
  47. The Navy has been using them for years. by technosaurus · · Score: 1

    The are called CWIS aka r2d2.  http://en.wikipedia.org/wiki/Phalanx_CIWS

  48. Re:"There is a problem with the law, so ban scient by pr0fessor · · Score: 1

    I would rather have an autonomous lawn mower for less than $1k than cylons.

  49. Re:Robot soldiers more civilian friendly than huma by Anonymous Coward · · Score: 0

    Its not the ones that shoot the prostitutes you need to worry about, Its the ones that use bats.

  50. Slippery slope by OpenSourced · · Score: 1

    If a robot killed arbitrarily, it would be difficult to hold anyone accountable.

    Not like now, when every time that an Afghan peasant is killed in error, heads roll.

    --
    Rome taught me patience and assiduous application to detail. Virtues which temper the boldness of great, general views.
  51. With restrictions by gman003 · · Score: 2

    Automated weapons are already deployed - the Korean DMZ is guarded, in part, by autonomous sentry drones. If it moves, they shoot it - and they're armed with machine guns or automatic grenade launchers.

    That's a good model. Don't try to make a drone that can distinguish targets from non-targets - make something that treats everything as a target, and deploy it only when you don't have non-targets to worry about. Or, to allow your own forces to operate in the area, provide an IFF transmitter to designate them as non-targets (civilians are still fucked though - so don't use it anywhere near civilians). Works fine for air, land and sea - we already have an established concept of "shoot to kill zones", this just replaces the soldiers under orders to shoot anything that moves with robots under programming to shoot anything that moves.

    For automated weapons deployed outside such areas (or even ones within), I would say that a human still has to give the fire order. The automated system can identify targets, track them, pursue them, prioritize targets, do basically everything but pull the trigger, but it has to request permission to fire from a human operator. And for all legal and ethical purposes, that human operator can be considered the one who pulled the trigger. It's still some massive force multiplication even compared to modern drones, so I don't see why the military would have much problem with it.

    Let's wait until after we get true AI before we try to give machines the responsibility to decide whether or not to kill someone.

    1. Re:With restrictions by kogut · · Score: 1

      > The automated system can identify targets, track them, pursue them, prioritize targets, do basically everything but pull the trigger, but it has to request permission >to fire from a human operator I believe the Phalanx CIWS has a mode where it'll basically go to town on anything in the air that doesn't have IFF. The response time required is too short for human operator confirmation. I believe the AEGIS defense system has similar capabilities, though maybe more human operator oversight on that one. I'm not sure.

  52. Re:Robot soldiers more civilian friendly than huma by Anonymous Coward · · Score: 0

    Let's make war as gentle and kind as possible!

    No, perhaps war should be brutal and painful, and fewer people would be so willing to hop-skip into countries to free them.

  53. Accountability by Captain_Chaos · · Score: 1

    If a robot killed arbitrarily, it would be difficult to hold anyone accountable.

    Whereas currently there is no indiscriminate killing with drones going on without any accountability whatsoever? What's the current body count for innocent civilians murdered by the US and its allies in Iraq, Pakistan, Afghanistan, etc.? A few tens of thousands to hundreds of thousands?

    I doubt it would make much difference in practice...

  54. World Leader should duke it out by Anonymous Coward · · Score: 0

    What problem are these robots meant to solve? If we're determined to resolve disputes with violence, then whenever there is a dispute, put the two leaders in a boxing ring and let them fight it out. That will save us the lives of thousands of soldiers, hundreds of civilians, and billions of dollars.

  55. Debate the use of killer robots... by Anonymous Coward · · Score: 1

    You have 20 seconds to comply.

  56. Re: "There is a problem with the law, so ban scien by BlueKitties · · Score: 1

    Better to have robots fight than people. Also once we have a lot of machine control APIs it won't be hard to make killer robots. I can make a paintball gun that shoots everyone but myself using a computer, a couple of high powered servos, a linear actuator, two cameras, and IBM's machine vision API. The fundamental technology just needs to be repurposed, so you're never going to stop the threat of killer machines.

    --
    "Sorrow is better than laughter, for by sadness of face the heart is made glad." [Ecclesiastes 7:3]
  57. wow the UN! Yawn, can't they just go away by marcgvky · · Score: 1

    At what point will we all admit that the UN is an experiment, with results that indicate the need to stop pumping cash into this failed debating body? Can anyone site a single, positive accomplishment for which the UN was/is responsible? Not really. Even if you want to point to the "climate change studies".... that was simply a compendium of other peoples (flawed) work on the subject. Is it time to admit that the UN is useless? Iran on the human rights council? Seriously?

  58. Re:Robot soldiers more civilian friendly than huma by Anonymous Coward · · Score: 0

    What if the atrocity was commanded? Soldiers are expected to be able to refuse an obviously immoral order. Non-sentient robots would not have that ability since they would be programmed to follow orders. I assert that "My Lai-type" stuff is exceedingly rare compared to immoral behavior ordered by commanders. Commanders don't see the immediate graphic result of their commands.

  59. Re:If a robot killed arbitrarily, would it be any. by GameboyRMH · · Score: 1

    Good point. The drone war is bordering on what amounts to tele-genocide and nobody gives a shit. But the US isn't alone, nobody gives a shit about Syria's war crimes or NK's human rights violations either.

    --
    "When information is power, privacy is freedom" - Jah-Wren Ryel
  60. Re:Robot soldiers more civilian friendly than huma by Anonymous Coward · · Score: 0

    Sure they won't. Until either there's a bug in the programming, or unintended consequences of multiple goals.

  61. Shields Project Insight - comes to mind by Anonymous Coward · · Score: 0

    Why fully autonomous robots should disallowed on the battlefield - we don't have the Avengers assembled yet.

  62. Re:Robot soldiers more civilian friendly than huma by LordLimecat · · Score: 1

    Someone completely skipped the day in school where they went over how the rational actor model works. Luckily, it tends to hold up pretty well in day to day life.

    TL;DR your scenario is ridiculously contrived and implausible.

  63. Re:Robot soldiers more civilian friendly than huma by LordLimecat · · Score: 2

    The point is that massacres like Mai Lai are caused when soldiers go a bit nutty due to the emotional stress of seeing their friends cut down by an insurgent resistance. That stress isnt going to be there if you're a remote operator, and youre generally going to be much better supervised by pencil-pushers as a drone operator than as an infantryman in a hostile country.

    Just that, humans are capable of refusing to do these things. Robots aren't.

    And as history shows us, humans dont. Forget about the holocaust, the cultural revolution, the soviet purges? Humans go with the crowd, especially in emotionally charged situations. Anything that brings down the emotion and brings some sanity to combat situations is a good thing.

  64. im hungry by MossStan · · Score: 1

    a good portion of the population is starving. our planet chokes under endless waste while the people in charge focus on killer robots. when i have a lot of things to do i make a list and prioritize.

    --
    It is what it is.
  65. Re:Now that is a problem, but soon will be a featu by LordLimecat · · Score: 1

    Generally its easier to audit who was using a computerized drone control system than it is to figure out what, exactly, happened in the front lines of a war zone. I say "generally", which is to say "always".

  66. how much is a life worth? by dlt074 · · Score: 1

    "It would be great to get the US to give up making land mines, but unfortunately China and Russia would almost certainly ramp up production to fill any shortfall. That's not a good enough reason for us to keep doing it"

    how about, we keep making/using them because they work? they are a very effective, low cost solution that saves the lives of those using them.

    i love land mines. much better then throwing soldiers at the problem.

    1. Re:how much is a life worth? by Anonymous Coward · · Score: 1

      how about, we keep making/using them because they work? they are a very effective, low cost solution that saves the lives of those using them.

      i love land mines. much better then throwing soldiers at the problem.

      Soldiers go away when the war is over, landmines do not. Getting rid of them is very expensive, both in terms of work and unnecessary civilian deaths.

  67. Wahy debate? by Anonymous Coward · · Score: 0

    Why is this even up for debate? It's crazy talk. Machines should NEVER be allowed to make a life or death decision--period. Target selection should only be in the hands of humans. This way we have someone to take to Nuremberg afterwards.

  68. Re:"There is a problem with the law, so ban scient by radtea · · Score: 1

    most of the technology involved would probably be developed anyway because it would be widely applicable.

    Furthermore, most of the tech has already been developed. It just hasn't been packaged conveniently (yet.) This has been the case for some years now, and the only thing that's surprising is that no one has deployed this kind of thing for domestic purposes, which is to say: assassination.

    There are two canonical limits on assassination as a means of political expression: retaliation and the death of the assassin. Retaliation (if you assassinate our leader we'll assassinate yours) doesn't apply to terrorist groups, but presumably the ability of suicide bombers to get close to political leaders is poor enough that for the most part we see them being deployed against soft targets. That is, there are crazy people willing to blow themselves up to kill innocents, but not very many crazy people willing to bet on long odds to kill political leaders. The average political assassin will die (or get caught) without killing their victim, and apparently even nutjobs don't think that's a good trade-off.

    Killer robots change all that. The ability to build a fully autonomous cruise missile has been around for years now, up to and including the terminal phase guidance system. It's actually really weird that no one has done it yet... Donald Kingsbury was writing about the possibility back in the '80's, and things have only got worse since.

    As to the "problem" of accountability: to the average person in charge of killing people, that sounds like a feature, not a bug. It's hard enough to hold humans accountable for their actions. When its a machine, you can just scrub the logs, scrap the device, and claim that an unpredictable hardware failure resulted in the peaceful protestors being gunned down.

    Killer robots, like machines that kill generally, are a stupid idea, and engineers who work on them should be ashamed of themselves. Killing is almost always the worst possible solution to any problem, and investing in killing machines is a lousy way to spend time and money if you're interested in making the world a better place by any reasonable standard.

    --
    Blasphemy is a human right. Blasphemophobia kills.
  69. It's easy. by Anonymous Coward · · Score: 0

    The decision makers are accountable. That includes the legislatures and President. They are to be helad directly responsible for any actions these "terminators" take.

    No excuses!

    As soon as one kills an American on American soil, then the family and friends of the victim are justified in retaliation against those decision makers.

  70. Re:If a robot killed arbitrarily, would it be any. by Anonymous Coward · · Score: 0

    Good point. The drone war is bordering on what amounts to tele-genocide and nobody gives a shit. But the US isn't alone, nobody gives a shit about Syria's war crimes or NK's human rights violations either.

    Tele-genocide? Seriously? I'm concerned about U.S. abuse of drones, but what racial, ethnic, religious or national group is being systematically destroyed? "Genocide" has a specific meaning, back off on the hyperbole.

  71. Re:If a robot killed arbitrarily, would it be any. by GameboyRMH · · Score: 1

    No I've thought about this and discussed it with others before. If you count the Afghanistan/Pakistan border region as a national group...it is at least a regional group...what does that look like?

    --
    "When information is power, privacy is freedom" - Jah-Wren Ryel
  72. Re:"There is a problem with the law, so ban scient by nine-times · · Score: 1

    I'd imagine that nobody has come up with an assassination robot because of the need for stealth. It'd be hard enough to have a robot target a specific individual, but to do it without alerting anyone ahead of time would be much trickier. I would think that poison or a bomb would be easier.

    Now if you're talking about a cruise missile, then I'm not sure what's gained by having it be completely autonomous. You may as well have someone sitting in a bunker someplace selecting the target and deciding whether to fire it, and then having appropriate computerized guidance.

  73. Re:"There is a problem with the law, so ban scient by cusco · · Score: 1

    You forget, politics is run by lawyers, and lawyers think that passing a law (or in this case a treaty) will magically fix everything. My dad, a remodeler, actually had a lawyer tell him that almost all the houses destroyed by hurricanes and tornadoes could be saveed if the law required that houses be built with hurricane clips on the roof trusses. For a lot of these bozos the law is their religion, which is one of the reasons why groups like the Innocence Project run into so much obstructionism.

    --
    "Think about how stupid the average person is. Now, realise that half of them are dumber than that." - George Carlin
  74. War SEO? by TheNarrator · · Score: 1

    2004: Why is that website URL at the top of Google for that keyword? Answer: "The algorithm"

    2019: Why did that fully autonomous weapon kill that person? Answer: "The algorithm"

  75. Re:Robot soldiers more civilian friendly than huma by number17 · · Score: 1

    The point is that massacres like Mai Lai are caused when soldiers go a bit nutty due to the emotional stress of seeing their friends cut down by an insurgent resistance.

    The point wasn't about Mai Lai type disasters. It was about the guys at the top saying the bad guys have weapons of mass destruction, send in the terminators and kill em all.

  76. Re:Robot soldiers more civilian friendly than huma by Anonymous Coward · · Score: 0

    That stress isnt going to be there if you're a remote operator

    I don't know if that's really the case. Apparently drone pilots are experiencing PTSD. It seems like the disconnect between 9-5 warfare and evening and weekend civilian life makes it even harder for them to cope.

    I don't know if that has any impact on the risk of someone attacking civilians, but it seems that the stress is still there, even when the soldiers aren't (physically).

  77. Re:"There is a problem with the law, so ban scient by mysidia · · Score: 1

    I'd imagine that nobody has come up with an assassination robot because of the need for stealth.

    Sounds like a job for a mosquito-sized drone carrying a microsyringe holding a severe biotoxin.

  78. It is true by SeanQuaint · · Score: 1

    that laws do not always prevent people from breaking them. However, without the law (or let's say "agreed upon norm") in place, it is impossible for others to say "hey, you aren't supposed to do that," which then makes reprisals tough to justify. We can all point our fingers at North Korea for example and call them crazy because we've agreed that you are not supposed to starve your people for instance. So, while those treaties may be imperfect, they do help to provide a framework within which we as a civilization can operate. Besides, what does it hurt to have them?

  79. You will be safe by CmdrTamale · · Score: 1

    Watchbird will protect you.

    Watchbird knows no borders, no limits.

    Watchbird learns to protect you better.

    Read Sheckley and weep.
    --
    This Time It's Different! Every time is different, right? Isn't that what they always tell us??