Slashdot Mirror


U.S. Army Robots Break Asimov's First Law

buanzo writes "The US Army is deploying armed robots in Iraq that are capable of breaking Asmov's first law that they should not harm a human. SWORDS (Special Weapons Observation Reconnaissance Detection Systems) robots are equipped with either the M249, machine gun which fires 5.56-millimeter rounds at 750 rounds per minute or the M240, which fires 7.62-millimeter rounds at up to 1,000 per minute. " update this story refers to this article from 2005. But com'on, robots with machine guns! I don't get to think about that most days!

25 of 821 comments (clear)

  1. Not really... by jargoone · · Score: 5, Insightful

    From TFA:

    They are still connected by radio to a human operator who verifies that a suitable target is within sight and orders it to fire.

    While they are harming a human, it's ultimately a human that makes the decision to fire. And who cares about fictional "laws", anyway?

    1. Re:Not really... by Anonymous Coward · · Score: 5, Insightful

      And who cares about fictional "laws", anyway?

      I think it's this point that is the most salient. Asimov's laws are interesting, and make for good "debate over your adult beverage of choice" fodder, but they are just one persons take on a single use case for a particular technology. Those laws might make sense for industrial and domestic helper robots, but wouldn't apply for military (obviously) or law enforcement roles. Certainly a law enforcement robot could be trained to limit the amount of harm it inflicts on a perp to neutralize him, but some amount of harm may be necessary.

      Bottom line is that as robots actually do start entering more into our mainstream lives, some "real" thought needs to be given to how to make them as non harming to humans as possible. These laws, while laudible, can't be "programmed" as is, making the task much more complex.

    2. Re:Not really... by Philip+K+Dickhead · · Score: 5, Funny
      Awww. That's too bad. I was thinking it would be really Kewl if these were powered by Linux!
      <SATIRE>
      "Lean, mean, Debian killiing machines! They can turn Al Qaida women and children into gooey, red paste by violating Asimov's Robots Rules of Order, and still not violate GPL!"
      </SATIRE>
      What have we come to?
      --
      "Speaking the Truth in times of universal deceit is a revolutionary act." -- George Orwell
    3. Re:Not really... by I_Strahd · · Score: 5, Funny

      I heard that they have this really sweet keyboard that they can create macros on to build their characters/robots strength up by fighting lower level mobs automatically. This requires little to no interaction on the soldiers part.

    4. Re:Not really... by Daniel+Dvorkin · · Score: 5, Insightful

      Besides, the average marine has about a high school education, no morals and a low threshold for the sanctity of life. They might as well be robots anyways. :-)

      Sorry folks there ain't no draft and it isn't a mystery that the US war machine is a "tad" corrupt. you sign up for the military because you want to profit from the misery of others. That is unless you sign up for the military to do something outside of being a grunt [e.g. doctor, engineer, etc]. Then you're ok.


      These people you so casually dismiss as "robots" sign up, generally speaking, when they're eighteen or nineteen years old; they believe, almost without exception, that they are doing so to serve their country, to protect the Constitution and the flag and Mom and apple pie. And you know what? At most times throughout our country's history, they've been right.

      Just a few years later, if they're unlucky enough to have enlisted at a time like the current one, they're old men, scarred by things no human being should ever have to see. That's what war (any war, including the "good" ones) does to people. That doesn't happen to robots.

      I started out as one of those nineteen-year-old grunts; a couple of years later, dimly sensing what was coming down the pike, I cross-trained as a medic, in which capacity I served in Desert Storm. I had no desire whatsoever to "profit from the misery of others" -- I wanted to serve, and I was, relatively speaking, one of the lucky ones. I don't have anyone's death on my conscience. I do have memories of things that will give me nightmares and flashbacks for the rest of my life ... and mine was a very, very short war. What those kids over there are going through now is so much worse I can't quite get my mind around it.

      They're not robots. They're your son, your niece, your little brother, caught up in a horrible situation not of their own making. Don't take your anger out on them. Save it for the evil old men who never exposed themselves to that kind of horror, who would never allow their own children to go through it, who casually, thoughtlessly, cheerfully send other people's kids off to hell.

      --
      The correlation between ignorance of statistics and using "correlation is not causation" as an argument is close to 1.
    5. Re:Not really... by troll+-1 · · Score: 5, Funny

      Lean, mean, Debian killiing machines!

      Yeah, you just put "rm -rf /bin/laden" in a cron job.

    6. Re:Not really... by rk · · Score: 5, Insightful

      I thought the point of Asimov's stories was that they always obeyed the laws, but not necessarily in ways humans would. Most stories in "I, Robot" show that these seemingly excellent and fault-tolerant laws could have unexpected and sometimes dangerous consequences of their own, and that the real-world is too complicated to ever be dealt with only hard and fast rules.

      You're right though, I never understood why people took Asimov's laws as a great thing to use as a reference for robot behavior when the same author who created them proceeds to point out their flaws for an entire book's worth of short stories.

    7. Re:Not really... by Frazbin · · Score: 5, Funny

      Sci fi writer? Pfft! Next you'll tell me we don't have advanced humanoid robots with positronic brains, and that U.S. Robotics is just a shitty winmodem manufacturer!

    8. Re:Not really... by AlterTick · · Score: 5, Insightful
      A lot of people think Asimov's laws are real, and don't get it that he was a sci-fi writer, not a scientist in the field of robotics. He was even asked to speak at universities as an expert on robotics when all he had done was write some stories. If they had read the robot novels, they would have noticed that even Asimov's robots did not always obey the laws.

      Indeed, I think anyone who reads "I, Robot" and comes away with the notion that the Three Laws are a good idea should be barred from working in robotics entirely. Asimov's short robot stories drive home again and again how those hard-coded, inviolable laws are a very, very bad thing, and taken to their ultimate end, could result in the human race basically being reduced to animals in a robot zoo! Seriously, I think too many people read "I, Robot" when they were too young to grasp the serious philosophical point behind it, and haven't bothered to re-read it since.

      The book uses robots as an analogy for a very serious philosophical point about humanity: codified rules are not a suitable replacement for people educated in ethics, science, and rational thinking. No set of laws, commandments, edicts, or mandates passed from On High will ever match every situation. Knowledge is the only way forward.

      --
      Conclusion: the Empire squashes the Federation like a bug. Accept it.
    9. Re:Not really... by conJunk · · Score: 5, Funny

      alright buddy, take your common sense and your accurate reading and go somehwere else, okay! i've got a fantasy to live in here

    10. Re:Not really... by NetFu · · Score: 5, Informative

      Obviously, you know nothing about the real military.

      I was in the U.S. Army, and we do not do whatever we're told by our superiors "give or take". There's no give or take involved since the Vietnam War. I know you said "Professional soldiers", but we are talking about the U.S. military, not just any merc.

      The U.S. Armed Forces Code of Conduct is taken very, very seriously by all of the members of the U.S. military. All U.S. soldiers are required to know it BY HEART and to understand every word of it, and it's impact on them as a modern soldier.

      Read every word of it, since you obviously never have:

      http://www.armystudyguide.com/content/army_board_s tudy_guide_topics/code_of_conduct/the-code-of-cond uct.shtml

      Pay close attention to article 6: "I will never forget that I am an American, fighting for freedom, responsible for my actions, and dedicated to the principles which made my country free."

      Every U.S. soldier is responsible for his own actions, not his superior who ordered him to do something illegal. A soldier who follows an order that is illegal or just plain wrong according to that soldier's morals is just as guilty as his superior who gave him that order.

      The bottom line: Any U.S. soldier can refuse to carry out an order if he believes it is illegal, and that soldier's judgement of whether an order is illegal is governed by his own morals.

      A robot has no morals, but if this Army robot is just a machine remote controlled by a U.S. soldier, then that soldier will be held accountable for any action by the robot, which is just an extension of him.

      Given that freedom that every U.S. soldier has to evaluate the orders they are given, there will still be incidents where soldiers with bad or no morals do horrible things when carrying out their orders.

      But, how is it any different when a U.S. citizen decides to take an automatic weapon to a school to gun down a couple of dozen kids?

      It all comes down to the morals of the indvidual, regardless of whether the person is a U.S. citizen or soldier. U.S. soldiers are no better or worse than the average U.S. citizen.

  2. Phalanx... by JDSalinger · · Score: 5, Informative

    I guess it depends what you consider to be a robot? And under what conditions it could kill another human? The Phalanx defense system, currentlly employed on U.S. Warships, would allow itself to shoot down an enemy aircraft if it were attempting to crash into the ship. The Phalanx uses radar to detect incoming missiles and shoot them out of the sky by unleashing an insane amount of bullets in direction of the target. Pictures and info here. -C

  3. Fluff Piece by AKAImBatman · · Score: 5, Informative
    Don't bother with the Inquirer story. It's practically a verbatim copy of the source story here. The only difference is that the source story adds the following comments:
    As I pointed out in the article (and the comments), these devices are not autonomous. For some, this would disqualify them from being true robots. However, the military and the manufacturer both refer to the SWORDS device as a robot, and it certainly fits common usage. The word "robot" comes from the Czech robota (from Capek's play R.U.R.) meaning "forced labor" or "drudgery." This device surely does an unpleasant task usually done by a person. Also, consider that, strictly speaking, an autonomous cruise missile is a self-guided machine, and is therefore a "robot" although most people wouldn't think of it that way.

    These are actually robots, but they're not the fully-autonomous solutions that Asimov was suggesting that mankind needed protection from. Thus the "laws" of robotics don't apply here, because it's still a human who's doing the thinking for the machine.

    In effect, this is a safe way for ground troops to line up a kill zone, then cause lots 'o bad guys to get torn to shreds. Prior to this, troops needed to use a vehicle-mounted machine gun to get this sort of rate of fire. This was extremely limited in close quarters, where a Humvee or Tank might not fit. While it was theoretically possible to carry a machine gun to the combat zone, such weapons are difficult to transport, setup, and use in close quarters.
  4. Asmov's (sic) first "law"... by daveschroeder · · Score: 5, Funny

    ...is no "law" at all.

    If the submitter wants to troll about the military, the least he could do is spell Asimov's name correctly.

    What makes a "robot"? Progressively more complex machinery has been able to inflict bodily harm, and kill, for quite some time.

  5. A few things: by TripMaster+Monkey · · Score: 5, Funny

    THE US Army is deploying armed robots in Iraq that are capable of breaking Asmov's first law that they should not harm a human.

    Sorry to break it to the folks over at the Inquirer, but Asimov's Laws do not actually exist....any more than his 'positronic brain' does. It's fiction.
    Next week on the Inquirer: Computers Built That Break The Orange Catholic Bible's Commandment of 'Thou shalt not make a machine in the likenes of a human mind'.
    Sheesh.

    They are still connected by radio to a human operator who verifies that a suitable target is within sight and orders it to fire.

    OK....so the're not even robots, then. They're telepresence devices.

    Then the robot has the job of making sure lots of bullets are sent towards the target.

    Statement from the Iraqi forces regarding the use of these 'robots':
    OMFG! u r fukn gay! u hack, i know it! fucking aimbot! tak ur aimbot bs to nothr country, asshats!


    Nice to know we can take what we've learned in FPSs and apply them to the real world.

    Later the US plans to replace the control system of the bots with a "Gameboy" type of controller hooked up to virtual reality goggles.

    Yes! Finally, all my training has paid off! I can be a soldier from the comfort of my basement! Where do I sign?
    --
    ____

    ~ |rip/\/\aster /\/\onkey

  6. Not to worry by whyrat · · Score: 5, Funny

    These robots will have a pre-set kill limit.

    The enemy must merely send wave after wave of men until that limit is reached and they will shut down.

  7. Comment removed by account_deleted · · Score: 5, Informative

    Comment removed based on user account deletion

  8. Oh no! by gEvil+(beta) · · Score: 5, Funny

    Oh no! Robots are breaking fictitious laws!!! Someone call the Fiction Police!

    --
    This guy's the limit!
  9. Yeah, Just like Guantanamo Bay by PIPBoy3000 · · Score: 5, Funny

    . . . a place where Asimov's Laws, like the US Constitution or the Geneva conventions, don't really apply.

  10. Ridiculous Laws by Illserve · · Score: 5, Insightful

    The very idea of a rule against hurting humans implies that a robot knows:

    1. What hurting means
    is it pain? death? financial impact? what about indirect effects? If I help human 1 build a better mousetrap, I am indirectly harming some other human's way of life.

    2. What people are

    3. Where they are

    These are highly non trivial problems. In fact, they're unsolvable to any degree of certainty. They only make sense in a *science fiction* book in which a highly talented author is telling you a story. In the real world, they are meaningless because of their computational intractibility.

    In the real world, we use codes of ethics and/or morality. Such codes recognize the fact that there are no absolutes and sometimes making a decision that will ultimately cause harm to someone is inevitable.

    So can we please stop with these damned laws already?

  11. gameboy wars by freg · · Score: 5, Funny

    So what this really shows us is that the winner of future wars will be determined by the country who has the most skilled gamers. I think I like the direction things are headed. Let's be sure to stay friends with the Japanese tho.

    1. Re:gameboy wars by mikeee · · Score: 5, Funny

      Obviously, North Korea doesn't need nukes to defend against the US, but against a zergling rush from the South...

  12. Re:Am I the only one... by jcr · · Score: 5, Insightful

    I firmly believe in the right to bear arms -- all arms.

    Sorry, have to differ with you there. I don't want a tac nuke in private hands, because I don't believe you're capable of only hitting those who are actually posing a threat to you personally. I also wouldn't let you have land mines, pursuant to the common law principle of prohibiting reckless endangerment.

    -jcr

    --
    The only title of honor that a tyrant can grant is "Enemy of the State."
  13. Robotics, Identity, and Universes by Alien54 · · Score: 5, Interesting
    And who cares about fictional "laws", anyway?

    Many researchers are spending lots of time researching AI, and the problems for which the Laws of Robotics are a an attempted solution; Namely how do you keep the robotis from taking over and/or indiscriminately killing mere humans, as seen in so many hollywood movies. So fictional laws are important as experiments in looking at potential solutions to a real problem.

    As I see it, the main problem consists of two factors. One factor develops as a result of the first.

    The first factor is consciousness, also known as self awareness. The second factor sounds like it is the first, but it includes other areas.

    The second factor is Identity. Identity is not restricted to Self Awareness, but also includes group awareness, etc in expanding circles to include universes, subjective and otherwise. When someone else is considered part of a group identity, as "one of us", then you tend not to act against yourself. When the other person is seen as being "one of the Not Us but Them" then you tend to get an opposition, etc.

    In wars, it is more a universe thing, the Hitler Universe vs the Churchill Universe, for example. Or Religious Figure One (tm) vs Religious Figure Two (tm). Or a religious universe vs a scientific universe.

    Part of the problem of psychopaths, sociopaths, etc. is that they tend to group their victims into the "One of the Not Us/Not Me" category. No sense of being or identity is allowed or granted to the other person, and so, to one degree or another, this rationalizes pigeon-holing people into things that can be abused one way or another. Or else the identity given is some other alteration of reality that legitimizes criminal activity.

    This is difficult enough to deal with in humans. Psychologists and psychiatrists have no cure for psychopaths, since it is seen as being in the genes. You can't make a pill for it, and no psychopath would take it as they do not have the luxury of seeing that anything is wrong with themselves.

    Now we try to apply this to Robotics. Probably the only real solution for the problem is to redefine Human as self aware creatures from earth, and incorporate this awareness somehow into robots, to some slight degree, so that Robots see Humans as "One of Us".

    It is a little touchy on how you would do this. It exposes some of the potential hypocrisy of humans in actions towards other potentially self aware creatures on earth, as well as each other. A self aware robot could see the hypocrisy without the emotional justification people exhibit. At this point, we could be in trouble.

    --
    "It is a greater offense to steal men's labor, than their clothes"
  14. A few thoughts.... by Savage-Rabbit · · Score: 5, Insightful

    First: two observations:

    1) SWORD is remote controlled it is not autonomous like I always thought a true robot in the Asimovian sense had to be.
    2) Since we are now including remotely operated vehicles in the definition of a true robot, SWORD is not that different from a Paveway bomb or a Hellfire missile except SWORD doesn't self destruct when it destroys the target.

    This begs the question wasn't Asimov's first law broken decades ago, perhaps even by the V1 which was strictly speaking a remote operated vehicle?

    Personally I won't begin to worry about Asimovs laws as long as Humans are on the other end. apons.

    --
    Only to idiots, are orders laws.
    -- Henning von Tresckow