Slashdot Mirror


Weapons Systems That Kill According To Algorithms Are Coming. What To Do?

Lasrick writes "Mark Gubrud has another great piece exploring the slippery slope we seem to be traveling down when it comes to autonomous weapons systems: Quote: 'Autonomous weapons are robotic systems that, once activated, can select and engage targets without further intervention by a human operator. Advances in computer technology, artificial intelligence, and robotics may lead to a vast expansion in the development and use of such weapons in the near future. Public opinion runs strongly against killer robots. But many of the same claims that propelled the Cold War are being recycled to justify the pursuit of a nascent robotic arms race. Autonomous weapons could be militarily potent and therefore pose a great threat.'"

25 of 514 comments (clear)

  1. Skynet by ackthpt · · Score: 5, Insightful

    Yet another predictor.

    Bring on the Terminators.

    --

    A feeling of having made the same mistake before: Deja Foobar
    1. Re:Skynet by farble1670 · · Score: 3, Insightful

      These are only a problem if they are built and used.

      how do you know that smart weapons won't result in fewer deaths, and fewer deaths of non-combatants?

      humans have a pretty poor track record and it wouldn't take much to approve upon. if you think the man in the trenches is making good judgments about when and who to kill, you should talk to a vietnam vet.

    2. Re:Skynet by YttriumOxide · · Score: 4, Insightful

      because all evidence shows that the weak point always lies with the soldier that has to pull the trigger and decide to kill a fellow human being.

      All evidence that I've seen shows that a large number - possibly even the majority - of soldiers have been brainwashed in to following orders unconditionally and will commit the most horrendous crimes against humanity when ordered to do so. And - even when not ordered - that same brainwashing includes training in not thinking of 'the enemy' as human, because that causes you to delay in the critical moment. So they dehumanise the enemy to the point that further atrocities can be committed even when not under orders to do so.

      Note that I don't blame the soldiers themselves in a lot of these situations - they are often good people who given time to think and reason it through would not behave that way, but their training has so messed with them that some actions they'll take don't reflect on the person they are.

      Also note that I did say "a large number of soldiers" and not all. There are plenty of cases you can find of soldiers going against orders they believe to be morally reprehensible, but the fact that OTHER soldiers then do it is a testament for the argument and not against it.

      --
      My book about LSD and Self-Discovery
      Also on facebook as: DroppingAcidDaleBewan
  2. We could not make them by jjeffries · · Score: 4, Insightful

    They're not "coming" as if from space. We just need to choose for them not to exist and they won't. These things will (or won't) be made by individuals who can make moral decisions.

    Don't be a terrible individual; don't make or participate in the making of terrible things.

    1. Re:We could not make them by geekoid · · Score: 2, Insightful

      Except looking at history, they will probable lead to fewer soldier deaths, fewer bystander deaths, more accurate targeting.

      I don't know why people think they are bad.

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    2. Re:We could not make them by Opportunist · · Score: 4, Insightful

      We have more accurate weapons than ever. Compare the average cruise missile to the average arrow and tell me:

      1. Which one is more accurate?
      2. Which one causes more deaths?

      You will notice that they are NOT mutually exclusive. Quite the opposite.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    3. Re:We could not make them by Anonymous Coward · · Score: 5, Insightful

      Except looking at history, they will probable lead to fewer soldier deaths, fewer bystander deaths, more accurate targeting.

      I don't know why people think they are bad.

      Extra-judicial killings of US citizens.

    4. Re:We could not make them by Charliemopps · · Score: 5, Insightful

      Or... and I know this sounds crazy... we could just not kill people anymore. I know we like to be the super heroes of the world, running around fighting everyones wars and everything... hell, I used to think that way to. But at a certain point you just have to stand back and say "you know what? Fuck it. I'm done blowing 1/3rd of our budget dropping bombs on people I don't know for a cause I barely understand just to have any and all progress erased in a few years because the real problems in other parts of the world have little to do with their totalitarian leaderships."

    5. Re:We could not make them by zaft · · Score: 5, Insightful

      Except looking at history, they will probable lead to fewer soldier deaths, fewer bystander deaths, more accurate targeting.

      I don't know why people think they are bad.

      Extra-judicial killings of US citizens.

      Let's call it what is is: murder of innocent US citizens.

      (don't think they are innocent? They are innocent until proven guilty!)

    6. Re:We could not make them by Hatta · · Score: 5, Insightful

      No. These things *will* be made, by people who make immoral decisions. The people who get to make those sorts of decisions are already mostly terrible people.

      --
      Give me Classic Slashdot or give me death!
    7. Re:We could not make them by Anonymous Coward · · Score: 2, Insightful

      Useless comment.

      If you live in certain countries and pay taxes in certain countries, one day you WILL participate in making of terrible things.

    8. Re:We could not make them by sjames · · Score: 3, Insightful

      Far too easy for all humans involved to disavow any responsibility when the thing shoots up a busload of children. No ability to decide the CO has gone nutsy cuckoo and report up the chain of command. No ability to decide the CO's order is just plain illegal and refuse.

      Nobody to report back home about how ugly and unnecessary it all is. Killing people, especially lots of people should NOT be cost effective.

      Other than that, it's just great.

    9. Re:We could not make them by Anonymous Coward · · Score: 5, Insightful

      How about: Murder of innocent citizens.

      95% of them aren't americans (me included). Why would the distinction be important?

    10. Re:We could not make them by dryeo · · Score: 4, Insightful

      How about: Murder of innocent citizens.

      95% of them aren't americans (me included). Why would the distinction be important?

      Americans don't seem to think that non-Americans are people, therefore not deserving of rights

      --
      https://en.wikipedia.org/wiki/Inverted_totalitarianism
    11. Re:We could not make them by Charliemopps · · Score: 5, Insightful

      Yea, but they CANT destroy the US. It's not possible. It's like we live in a mansion and a rat ran in and shit on our floor. So now we have the entire staff chopping up the floorboards and taring the plaster off the walls looking for the fucking thing. We're doing far more damage than the stupid rat ever could. Some pests just don't go away, so you have to keep the cheese in the fridge, put out some traps and deal with it. Don't burn the house down around you just to win.

  3. Sci-Fi to watch... by Anonymous Coward · · Score: 2, Insightful

    Terminator

    ST TNG: Arsenal of Freedom

    Etc...

  4. How do human soldiers kill? by mi · · Score: 3, Insightful

    Weapons Systems That Kill According To Algorithms Are Coming

    I don't get this... Aren't human soldiers killing based on something other than algorithms? Or is it that the implementations are coded in vague human languages, that makes them feel somehow warm and fuzzy? Well, Pentagon's Ada may be considered similar, but only in jest...

    I'd say, whether such systems are bad or good is still up to the algorithms, not the hardware (nor pinkware), that executes them.

    --
    In Soviet Washington the swamp drains you.
    1. Re:How do human soldiers kill? by sociocapitalist · · Score: 3, Insightful

      Weapons Systems That Kill According To Algorithms Are Coming

      I don't get this... Aren't human soldiers killing based on something other than algorithms? Or is it that the implementations are coded in vague human languages, that makes them feel somehow warm and fuzzy? Well, Pentagon's Ada may be considered similar, but only in jest...

      I'd say, whether such systems are bad or good is still up to the algorithms, not the hardware (nor pinkware), that executes them.

      For me the big difference is that if you activate the military to suppress their own populace when it demonstrates that the soldiers can at least choose not to follow orders.

      The idea of the US (for example) with the ever increasing trend of the suppression of constitutional rights having robots that kill whoever they're activated against is terrifying.

      --
      blindly antisocialist = antisocial
  5. You won't even know if you're helping make them. by ron_ivi · · Score: 5, Insightful
    One guy'll be making a computer vision system to recognize faces "to make it easier to log in to your cellphone".

    Another guy'll be making a robot painting system that aims it's cars "so make a more profitable assembly line".

    Yet another'll make a self-driving car "so you won't have to worry about drunk drivers anymore".

    Once those pieces are all there (hint, today), it doesn't take much for the last guy to glue the 3 together; hand it a gun instead of spraypaint; and load it with a databases of faces you don't like.

  6. It seems a poor comparison. by TiggertheMad · · Score: 4, Insightful

    I think that there is a difference, though. It is one thing to create unrelated technology that when linked together is dangerous. It is another thing to just create technology that doesn't have an application outside of killing people. By your argument, every invention all they way back to using flint and tinder to create fire is nothing but a weapon, and why should we even have bothered?

    My prediction is that this technology will float about the edge of popular awareness, until an unbalanced individual sets up a KILLMAX(tm) brand 'smartgun perimeter defense turret' in an elementary school and murders a bunch of children and escapes because he didn't have to be on the scene. Then national outrage will lead to mass bans on such weapons.

    Should we be making such weapons? I don't know, I suppose that the argument can be made that they fill the same role as land mines, but have the upside that there is less problem with getting rid of them when the fighting stops. I find the glee we as a species have in building better was of killing each other to be really depressing on the whole.

    --

    HA! I just wasted some of your bandwidth with a frivolous sig!
  7. Dearest engineers... by Anonymous Coward · · Score: 3, Insightful

    To all the engineers working on this: you're responsible. You are doing this. You are a terrible person.

  8. Re:Where have I heard this before? by ozmanjusri · · Score: 5, Insightful

    We still rely on chemical energy to power our weapons and as such they all have the ultimate fail safe system.

    Brace yourself before clicking the link. This may come as a surprise to you.

    http://en.wikipedia.org/wiki/Nuclear_weapon

    --
    "I've got more toys than Teruhisa Kitahara."
  9. Blame Canada by Anonymous Coward · · Score: 2, Insightful

    Failsafe system will be contracted out to the people who profited by writing and then fixing the Affordable Healthcare websites.

    So the Canadians will be responsible for SkyNet?

  10. Human soldiers are already beign desensitized by GodfatherofSoul · · Score: 3, Insightful

    I can't remember the documentary; maybe Fog of War starring Satan's favorite child Robert McNamara. But, they figured out that in combat 25% of of soldiers weren't actually shooting at other people. They were intentionally shooting up in the air to avoid killing. So, part of the Army's training post WWII was to get soldiers to fire without thinking. The outcome was soldiers were more effective in battle. The consequence was soldiers weren't evaluating the act of taking lives until AFTER they'd done it which contributed to the increased mental issues Vietnam-era soldiers endure.

    --
    I swear to God...I swear to God! That is NOT how you treat your human!
  11. Re:Guns don't kill people by MtHuurne · · Score: 4, Insightful

    To kill someone with a knife, you have to stand very close to them and thrust the weapon into their body. To kill them with a gun, they have to be in line of sight and pull the trigger. To kill them with a drone, you need them on live camera and push a button. To kill them with an autonomous robot, you need to have a description of what they look like and what area they are located in and program that into the robot. Every step becomes more indirect, more emotionally detached.

    "Guns don't kill people" is just a slogan. A gun is a tool. For killing people. The real questions include "Do guns deter crime or make it more violent?" and "Does home gun ownership help prevent a government from turning on its own people?", but those have no simple answers, so they are not as useful in propaganda.