Slashdot Mirror


How Asimov's Three Laws Ran Out of Steam

An anonymous reader writes "It looks like AI-powered weapons systems could soon be outlawed before they're even built. While discussing whether robots should be allowed to kill might like an obscure debate, robots (and artificial intelligence) are playing ever-larger roles in society and we are figuring out piecemeal what is acceptable and what isn't. If killer robots are immoral, then what about the other uses we've got planned for androids? Asimov's three laws don't seem to cut it, as this story explains: 'As we consider the ethical implications of having robots in our society, it becomes obvious that robots themselves are not where responsibility lies.'"

31 of 153 comments (clear)

  1. Missed the point by Anonymous Coward · · Score: 5, Insightful

    Asimov's stories were all about how the three laws were not sufficient for the real world. The article recognises this, even if the summary doesn't.

    1. Re:Missed the point by girlintraining · · Score: 5, Interesting

      Asimov's stories were all about how the three laws were not sufficient for the real world. The article recognises this, even if the summary doesn't.

      Dice Unlimited Profits And Robotics, Inc., would like to remind you that it's new, hip brand of robotic authors have just enough AI to detect when something is sufficiently nerdy to post, but unfortunately lack the underlying wisdom of knowing why something is nerdy. Unfortunately, I expect our future killer robots in the sky will have similar pattern recognition problems... and wind up exterminating everyone because they are deemed insufficiently [insert ethnicity, nationality, race, etc., here] in pursuit of blind perfectionism.

      Common sense has never been something attributed either to slashdot authors, or robotic evil overlords.

      --
      #fuckbeta #iamslashdot #dicemustdie
    2. Re:Missed the point by dywolf · · Score: 4, Insightful

      It wasnt so much that the laws didnt cut it, thats too simplistic and even in his own words not what it was about.
      it was that the robots could interpret the laws in ways we couldnt or didnt anticipate, because in fact in nearly all the stories involving them the robots never failed to obey them.

      Asimov saw robots, seen at the time as monsters, as an engineering problem to be solved. he quite correctly saw that we would program them with limits, int he process creating the concept of computer science. he then went about writing stories around robots that never failed to obey their programming, but as effectively sentient thinking beings, would interpret their programming in ways the society around them couldn't anticipate because they saw the robots as mere tools, not thinking machines. and thus he created his lens (like all good scifi writers) for writing about society and technology.

      --
      The guy who said the election was rigged won the presidency with the second-most votes.
    3. Re:Missed the point by lgw · · Score: 2

      Works just like a rifle that way. Be careful never to point it at something you want to live. Responsibility is on the operator.

      Truly autonomous drones, which make the kill decision themselves following any set of rules are far more disturbing to me. Humans make mistakes in wars and kill civilians, but never at the scale we could see from a bug in that kind of decision-making logic in a widely-deployed weapon.

      Best to stick with human-designated targets IMO. Yes, there are evil human who will do evil things with weapons, but the downside to such malice remains much smaller than the potential downside to incompetence.

      --
      Socialism: a lie told by totalitarians and believed by fools.
  2. Asimov's three laws do not run out of steam by Taco+Cowboy · · Score: 3, Insightful

    The three laws as laid down by Asimov are still as valid as ever.

    It's the people who willingly violate those laws.

    Just like the Constitution of the United States - they are as valid as ever. It's the current form of the government of the United States which willingly violate the Constitution.

    --
    Muchas Gracias, Señor Edward Snowden !
    1. Re:Asimov's three laws do not run out of steam by verifine · · Score: 2, Insightful

      The danger of autonomous kill-bots comes from the same people who willingly ignore the Constitution and the rule of law.

    2. Re:Asimov's three laws do not run out of steam by Anonymous Coward · · Score: 2, Insightful

      The three laws as laid down by Asimov are still as valid as ever.

      Assuming you mean that amount is "not at all," as was the point of the books.

    3. Re:Asimov's three laws do not run out of steam by Anonymous Coward · · Score: 2, Insightful

      The danger of autonomous kill-bots comes from the same people who willingly ignore the Constitution and the rule of law.

      And the danger of a gun is the murderer holding it.

      Yes, I think we get the point already. The lawless ignore laws. News at 11. Let's move on now from this dead horse already. The kill-bot left it 30 minutes ago.

    4. Re:Asimov's three laws do not run out of steam by dywolf · · Score: 4, Informative

      Stop saying that. That isnt it at all and you failed to grasp his points, even as he himself spelled out his thinking in his essays on the topic.

      Asimov never thought the rules he created were "not at all valid". On the contrary.

      Asimov saw robots, seen at the time as monsters, as an engineering problem to be solved. he quite correctly saw that we would program them with limits (in the process creating the concept of computer science).

      he then went about writing stories around robots that never failed to obey their programming, but as effectively sentient thinking beings, would interpret their programming in ways the society around them couldn't anticipate because they saw the robots as mere tools, not thinking machines. and thus he created his lens (like all good scifi writers) for writing about society and technology.

      he NEVER said the laws were not valid or were insufficient.
      that was NEVER the point.

      --
      The guy who said the election was rigged won the presidency with the second-most votes.
  3. "robots are immoral" by Arancaytar · · Score: 2

    You appear to be confused about the word "immoral".

    1. Re:"robots are immoral" by dkleinsc · · Score: 4, Informative

      The correct term is "amoral": Robots have no moral sense whatsoever. "immoral" would imply they had moral sense but were actively engaging in the behavior that is against that morality.

      --
      I am officially gone from /. Long live http://www.soylentnews.com/
    2. Re:"robots are immoral" by MrL0G1C · · Score: 2

      You forgot Emoral - always behaving oneself, except when online.

      --
      Waterfox - a Firefox fork with legacy extension support, security updates and better privacy by default.
  4. These robots are not different from guns by kruach+aum · · Score: 3, Insightful

    Robots that are not responsible for their own actions are ethically not different from guns. They are both machines designed to kill others that need a human being to operate them, with whom the responsibility for their operation lies.

    I first wanted to write something about how morally autonomous robots would make the question more interesting, but the relation between a human creating an autonomous robot is no different from a parent giving birth to a child. Parents are not responsible for the crimes their children commit, and neither should the creators of such robots be. Up to a certain age children can't be held responsible in the eyes of the law, and up to a certain level of development neither should robots be.

  5. ethics of killing and warfare by The+Real+Dr+John · · Score: 4, Insightful

    It is kind of sad that people spend so much time thinking about the moral and ethical ways to wage war and kill other people, whether robots are involved or not. Maybe a step back to think about the impossibility of moral or ethical war and killing is where we should be focusing. Then the question of whether robots can be trusted to kill morally doesn't come up.

    --
    A brain is a terrible thing to waste... Mind? That's debatable.
    1. Re:ethics of killing and warfare by couchslug · · Score: 2, Insightful

      Mod up for use of logic!

      A person killed or maimed by AI or rocks and Greek fire flung from seige engines is fucked either way.

      We can construct all sorts of laws for war, but war trumps law as law requires force to enforce. If instead we work to build international relationships which are cooperative and less murdery that would accomplish a lot.

      It can be done. It took a couple of World Wars but Germany, France, England and the bit players have found much better things to do than butcher each other for national glory. Such a state of affairs would have been regarded as a pipe dream no so long ago.

      --
      "This post is an artistic work of fiction and falsehood. Only a fool would take anything posted here as fact."
    2. Re:ethics of killing and warfare by jabberw0k · · Score: 2

      Enacting "zero tolerance playground rules" will not make school bullies vanish from the Universe. Why would diplomacy make tyrants obsolete? If your opponent is going to use force, are you going to wimp out?

    3. Re:ethics of killing and warfare by girlintraining · · Score: 2

      Mod up for use of logic!

      No! Mod down -- This is Slashdot. We have standards! You can't use logic to win an argument unless you also insert at least one reference to Obama, Richard Stallman, Linus, Hitler, or make a care analogy. I SEE NO CAR ANALOGY, and only a vague reference to Hitler that does not qualify. Get with the program, noob. :)

      --
      #fuckbeta #iamslashdot #dicemustdie
    4. Re:ethics of killing and warfare by The+Real+Dr+John · · Score: 3, Insightful

      How many wars that the US has started since WWII were necessary with the possible exception of the first Gulf War? As General Smedley Butler famously claimed, war is a racket. The US often goes to war now in order to project geopolitical power, not to defend the US. Plus there is a great profit incentive for defense contractors. Sending young people, often from families of meager means, to kill other people of meager means overseas can not be done morally. The vast number of soldiers returning with PTSD prove that war is damaging to both the side that loses, and the side that wins.

      --
      A brain is a terrible thing to waste... Mind? That's debatable.
    5. Re:ethics of killing and warfare by dak664 · · Score: 3, Interesting

      Moral killing may not be that hard to define. Convert the three laws of robotics into three laws of human morals by taking them in reverse order:

      1) Self-preservation
      2) Obey orders if no conflict with 1
      3) Don't harm others if no conflict with 1 or 2

      To be useful in war an AI would have to have to follow those laws, except that self-preservation would apply to whichever human overlords constructed them.

    6. Re:ethics of killing and warfare by sconeu · · Score: 2

      Oh, for FFS, Read the F***ING COMMENT!!!

      He said that if you reverse the Three Laws, you get the Three Laws of human behavior!

      Idiot.

      --
      General Relativity: Space-time tells matter where to go; Matter tells space-time what shape to be.
  6. Re:Actually, it's four laws, not three by just_a_monkey · · Score: 4, Funny

    There is a 0:th law...

    Ah, yes. Good old "A robot shall take no action, nor allow other robots to take action, that may result in the parent company being sued."

    --
    How inappropriate to call this planet Earth, when clearly it is Ocean.
  7. Why does anyone think they apply? by Opportunist · · Score: 2

    Let's be honest here: These "laws" were part of a fictional universe. They were never endorsed by any kind of institution that has any kind of impact on laws. It's not even something the UN seriously discussed, let alone called for.

    Why should any government bend itself to the limits imposed by a story writer? Yes, it would be very nice and very sane to limit the abilities of AIs, especially if you don't plan to make them "moral", in the sense that you impose some other limits that keep the AI from realizing that we're essentially at the very best superfluous, at worst a source of irritation.

    What intelligence without a shred of morality is can be seen easily in corporations. They are already the very epitome of intelligence without moral (because everyone can justify pitting his mind behind it while at the same time shifting blame for anything morally questionable on circumstances or "someone else"). Now imagine that all but also efficient and without the primary intent for the most personal gain rather than the corporation's interest.

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  8. Most robots do follow a modified 3 laws by 91degrees · · Score: 2

    The differences are quite substantial though, which is why it's not immediately obvious.

    The first law is followed for nearly all robots. We usually treat this as a hardware problem. In an automated factory, we keep people away from the robots. A roomba is simply not powerful enough to hurt anyone. More sophisticated robots have anti-collision devices and software.

    The second and third law are actually the wrong way round for most devices. A decently designed device, you'll have to go to quite extreme measures to circumvent the design and get it to destroy itself. There is no "Brick device" button on an XBox One or smartphone (although it's possible to do so if you know how). Even something simple like MS-DOS at least asked whether you were sure before formatting a disk.

  9. 1950s robots ... by TrollstonButterbeans · · Score: 2

    Sci-fi stories always have romantic plot holes the size of a truck.

    Even Asimov's stories pretty much pretended that robots would be immortal (live virtually forever) --- in the real world, the Mars Rover may be in trouble, a 10 year car is assumed to be unreliable.

    1950s robots like Gort could do anything. Or the Lost In Space robot. Or any given robot Captain Kirk ran into.

    --
    Priest: "Universe from nothing, no laws of physics, sped up time"+ huge discrepancies. Creationism? No. Big Bang Theory
  10. Asimov's premise could never exist ... by MacTO · · Score: 2

    Asimov's writings were obsessed with the lone scientific genius, a genius so great that no one could recreate their work. That was certainly true with the development of the positronic brain, where it seems as though only one scientist was able to design it and everything thereafter was tweaks. None of those tweaks were able to circumvent the three laws (only weaken or strengthen them). No one was able to design a positronic brain from scratch, i.e. without the laws.

    Real science, or rather real engineering, doesn't work that way. Developments frequently happen in parallel. When they don't, reverse engineering ensures that multiple parties know how things work. We don't have a singular seed in which to plant the three laws, or any moral laws. One design may use one set of laws and another design may use another set of laws. One robot may try to reserve human life at all cost. Another may seek to destroy the universe at all cost. There is no way to control it.

    Then again, that assumes that we could design stuff with morality in the first place.

    1. Re:Asimov's premise could never exist ... by Gothmolly · · Score: 2

      Back in the 50s, the individual was still worth something, and it was assumed that a single individual, smart enough, would create a scientific breakthrough. The 21st century reveres the collective, and ignores the individual, so this type of story/plot no longer seems sensible.

      --
      I want to delete my account but Slashdot doesn't allow it.
  11. This is why transhumanism is not a joke. by WOOFYGOOFY · · Score: 4, Insightful

    Robots aren't the problem. Robots are the latest extension of humanity's will via technology. The fact that in some cases they're somewhat anthropomorphic (or animalpomorphic) is irrelevant. We don't have now nor will we have a human vs robot problem; we have a human nature problem.

    Excepting disease and natural catastrophes and of course human ignorance- which taken together are historically the worst inflictors of mass human suffering- the problems we've had throughout history can be laid at the feet of human nature and our own behavior to one another.

    We are creatures, like all other creatures, which evolved brains to perform some very basic social and survival functions. Sure, it's not ALL we are, but this list basically accounts for most of the "bad parts" of human history and when I say history I mean to include future history.

    At the most basic brains function to ensure the individual does well at the expense of other individuals, then secondly that the individual's family does well at the expense of other families and thirdly that the individual's group does well at the expense of other groups and finally that the individual does well relative to members of his own group.

    The consequences for not winning in any of the above circumstance are pain suffering and, in a worst case scenario, genetic lineage death- you have no copulatory opportunities and / or your offspring are all killed. (cure basement-dwelling jokes)

    All of us who have been left standing at the end of this evolutionary process, we all are putative winners in a million year old repeated game. There are few, or more likely zero, representatives of the tribe who didn't want to play, because to not play is to lose and to lose is to be extinguished for all time.

    What this means is, we are just not very nice to each other and that niceness falls away with exponential rapidity as we travel away from any conceptual "us" ; Supporting and caring about each other is just not the first priority in our lives and more bluntly any trace of the egalitarian impulse is totally absent from a large part of the population. OTOH we're , en masse, genocidal at the drop of a hat. This is just the tale both history and our own personal experience tells.

    Sure, some billionaires give their money away after there's no where else for them to go in terms of the "I'm important, and better than you, genuflect (or at least do a double take) when I light up a room" type esteem they crave from other members of the tribe. Many more people under that level of wealth and comfort just continue to try to amass more and more for themselves and then take huge pains to passed it on to their kin.

    The problem is, we are no longer suited, we are no longer a fit, to the environment we find ourselves in, the environment we are creating.

    We have two choices. We can try to limit, stop, contain, corral, monitor and otherwise control our fellow human beings so they can't pick up the fruits of this technology and kill a lot or even the rest of us one fine day. The problem here is as technology advances, the control we need to exert will become near absolute. In fact, we are seeing this dynamic at play already with the NSA spying scandal. It's not an aberration and it's not going to go away, it's only going to get worse.

    The other choice is to face up to what we are as a species (I'm sure all my fellow /. ers are noble exceptions to these evolutionary pressures) and change what we are using our technology, at least somewhat, so that, say, flying plane loads of people into skyscrapers doesn't seem like the thing to do to anyone and nor does it seem like a good idea to treat each other as ruinously as we can get away with in order to advantage ourselves.

    This would be using technology to better that part of the world we call ourselves and recreating ourselves in our own better image. In fact, some argue, that's the real utility of maintaining that better image - which we rarely live up-

    1. Re:This is why transhumanism is not a joke. by VortexCortex · · Score: 3, Interesting

      We don't have now nor will we have a human vs robot problem; we have a human nature problem.

      While I agree to an extent, I think this a too simplistic a statement. You are not special. Any sufficiently complex interaction is indistinguishable from sentience because that's all sentience is. You have an ethics problem, one that does involve your cybernetic creations. It's not necessarily a human nature problem, I suspect genes have far less to do with your alleged problems than perception.

      I study cybernetics, in both organic and artificial neural networks. There is no real difference between organic and machine intelligence. I can model certain worm's 11 neuron brain all too easily. It takes more virtual neurons since organic neurons are multi-function (influenced by multiple electrochemical properties), but the organic neurons can be approximated quite well, and the resulting artificial behaviors can be indistinguishable from the organic creature. Scaling up isn't a problem. More complex n.nets yield more complex emergent behaviors.

      At the most basic brains function to ensure the individual does well at the expense of other individuals, then secondly that the individual's family does well at the expense of other families and thirdly that the individual's group does well at the expense of other groups and finally that the individual does well relative to members of his own group.

      No. The brain is not to blame for this behavior; It exists at a far higher complexity level than the concept. Brains may be the method of expressing this behavior in humans, but they are not required for this to occur. At the most basic, brains are storehouses of information, which pattern match against the environment to produce decision logic in response to stimuli rather than carrying out a singular codified action sequence. The more complex brain will have more complex instincts, and are aware of how to handle more complex situations. Highly complex brains can adapt to new stimuli and solve problems not coded for at the genetic level. The most complex brains on this planet are aware of their own existence. Awareness is the function of brains, preservation drives function at a much lower level of complexity, and needn't necessarily involve brains; As evidenced in many organic and artificial neural networks having brain function, but no self preservation.

      The consequences for not winning in any of the above circumstance are pain suffering and, in a worst case scenario, genetic lineage death- you have no copulatory opportunities and / or your offspring are all killed. (cure basement-dwelling jokes)

      The thing to note is that selection and competition are inherent, and pain is a state that requires a degree of overall system-state knowledge (a degree of self awareness), e.g.: Neither RNA or DNA feel pain. In my simplified atomic evolution sims whereby atoms of various charge can link or break links and be attracted / repelled by others, nothing more: The first "assembling" interactions will produce tons of long molecular chains, but be destroyed or interrupted long before complete domination; entropy takes it's toll (you must have entropy, or no mutation, just a single dominant structure will form). From these bits of chains more complex interactions will occur. The first self reproducing interaction will dominate the entire sim for ages, until enough non-harmful extra cruft has piggy backed into the reproduction such that other more complex traits emerge, such as inert sections as shields to vital components. As soon as there is any differentiation that survives replication the molecular competition begins: The replicator destroying itself after n+1 reproductions such that offspring molecules can feed on its atoms; An unstable tail of highly charged atoms appended just before end of replication that tangles up other replicators which then brea

    2. Re:This is why transhumanism is not a joke. by Anti-Social+Network · · Score: 2

      I study cybernetics, in both organic and artificial neural networks. There is no real difference between organic and machine intelligence.

      I think this assumption is a mistake - and a big one. Science still has not accounted for consciousness and isn't even close. Until it does, such sweeping statements are myopic at best, if applied to human beings.

      Can you point me to a recent natural disaster where everyone else just shrugged it off? "More for me"

      Hurricane Katrina. I shudder to think what government assistance will mean in the future with "Fusion Centers" at the heart of it all. Google that if you're not familiar. There's a lot of tin-foil nuttery, but just the basic facts that are admitted and publicly known are enough to make you stop and go "hmmm..."

      You must devise a test for granting the machines the rights and responsibilities of personhood, and here it is: If they ask for rights, who are you to deny them?

      This I agree with. We may find that, unfortunately, there may be many real organic humans who cannot pass this test. I suggest that we start by making it a required qualified for public office. Also, while I am not a big fan of anime, the Ghost in the Shell animated feature had a fascinating look at this idea. Recommended for forward-looking fans of gunporn and/or philosophy.

      --
      Goddammit just when I get my first +5 the Beta rolls out and kills everything
    3. Re:This is why transhumanism is not a joke. by WOOFYGOOFY · · Score: 2

      At the most basic brains function to ensure the individual does well at the expense of other individuals, then secondly that the individual's family does well at the expense of other families and thirdly that the individual's group does well at the expense of other groups and finally that the individual does well relative to members of his own group.

      No. The brain is not to blame for this behavior; It exists at a far higher complexity level than the concept. Brains may be the method of expressing this behavior in humans, but they are not required for this to occur.

      Well then, you mean "yes", (and I'm not suggesting you meant otherwise) brains in humans are responsible for this behavior. What yo're saying, I think, is it can occur (or WILL occur) in any sufficiently complex system. That it *could * occur is just to say it could be modeled, so no argument there. That is WILL occur, that it's even some kind of metaphysical inevitability , like the train heading to Neo, given a complex enough system, I strongly disagree with.

      Creatures generally have the characteristics they have owing to the particular and quiet accidental - which is not to say acausal - evolutionary path they went down over millenia. This left them with a predisposition to compete for limited resources *as though to reproduce an infinite number of their own kind were their goal*. This works to reproduce the genes that create the behavior, and we're done. This is the Blind Watchmaker. The watch works - in some haphazard and much less than ideal way, and the watchmaker proceeds.

      There is never enough for us now because we evolved in an environment in which there was never enough , on balance, in reality. Now, this isn't the case and there's no need to continue as though it were. We fuck like we want a million copies of ourselves because that's what fuck tells us to do and for no other reason.

      The path we've taken is particular, quirky and not at all inevitable, but it determines how we think and act. We evolved to compete against other creatures for limited resources - there was no other choice- AND ALSO AS IT HAPPENED we wanted to survive (this seems obvious, but it's necessary and also significant as explained later ) AND ALSO AS IT HAPPENED survival depended on sexual reproduction AND ALSO AS IT HAPPENED the particular mechanism that genes employ results in a deep concern for our kin above others. The list of things we do for reasons which are directly attributable to the peculiarities of an underlying mechanism and which *could* be different is long.

      I actually have to run out the door right now. I have not fully read your post. I'll be back online later.

  12. Point is irrelevant by fyngyrz · · Score: 3, Insightful

    Yes, the laws were flawed, and yes, that's the idea Asimov mined to produce some interesting stories.

    But the thing here is that those laws require both a free-thinking intelligence that can reason non-linearly, and a locked-down computer-like slavish obedience to simplistic concepts. As we have yet to put any kind of actual AI in the field, we not only don't have such magic combo, we don't even know how to make such a magic combo.

    The only high-level intelligence we know of is us; and getting one of us to rigidly obey the three laws would be an exercise in utter frustration. No reason to think it'd be any more practical in Robbie the Robot, esq., citizen of the Consolidated Intelligences Union.

    --
    I've fallen off your lawn, and I can't get up.