Slashdot Mirror


Ask Slashdot: Could Asimov's Three Laws of Robotics Ensure Safe AI? (wikipedia.org)

"If science-fiction has already explored the issue of humans and intelligent robots or AI co-existing in various ways, isn't there a lot to be learned...?" asks Slashdot reader OpenSourceAllTheWay. There is much screaming lately about possible dangers to humanity posed by AI that gets smarter and smarter and more capable and might -- at some point -- even decide that humans are a problem for the planet. But some seminal science-fiction works mulled such scenarios long before even 8-bit home computers entered our lives.
The original submission cites Isaac Asimov's Three Laws of Robotics from the 1950 collection I, Robot.
  • A robot may not injure a human being or, through inaction, allow a human being to come to harm.
  • A robot must obey the orders given it by human beings except where such orders would conflict with the First Law.
  • A robot must protect its own existence as long as such protection does not conflict with the First or Second Laws.

The original submission asks, "If you programmed an AI not to be able to break an updated and extended version of Asimov's Laws, would you not have reasonable confidence that the AI won't go crazy and start harming humans? Or are Asimov and other writers who mulled these questions 'So 20th Century' that AI builders won't even consider learning from their work?"

Wolfrider (Slashdot reader #856) is an Asimov fan, and writes that "Eventually I came across an article with the critical observation that the '3 Laws' were used by Asimov to drive plot points and were not to be seriously considered as 'basics' for robot behavior. Additionally, Giskard comes up with a '4th Law' on his own and (as he is dying) passes it on to R. Daneel Olivaw."

And Slashdot reader Rick Schumann argues that Asimov's Three Laws of Robotics "would only ever apply to a synthetic mind that can actually think; nothing currently being produced is capable of any such thing, therefore it does not apply..."

But what are your own thoughts? Do you think Asimov's Three Laws of Robotics could ensure safe AI?


28 of 235 comments (clear)

  1. NO. by CrimsonAvenger · · Score: 5, Insightful
    The whole point of the Three Laws was to illustrate the holes in the concept of the Three Laws.

    EVERY Azimov Robot story was designed to show the unintended consequences of the Three Laws....

    --

    "I do not agree with what you say, but I will defend to the death your right to say it"
    1. Re:NO. by phantomfive · · Score: 4, Insightful

      This comment is all that needs to be said. Please shut down the thread and never bring it up again. Maybe it should be put into an FAQ on the sidebar, since it keeps being brought up. Even if you only watched the movie, you would be given several examples. "Not this again........"

      --
      "First they came for the slanderers and i said nothing."
    2. Re:NO. by Anubis+IV · · Score: 4, Insightful

      Precisely. We know they’re flawed because he himself wrote stories to highlight their flaws. Anyone suggesting we can use them as they are has clearly only read about Asimov, rather than reading what he actually wrote.

    3. Re:NO. by apoc.famine · · Score: 4, Insightful

      Thank you. I saw the headline and wanted to stab the writer instantly.

      "GUYS, GUYS, GUYS, MAYBE IF WE PUT AIRBAGS IN CARS THEY WOULDN'T CRASH ANYMORE!!!!"

      How does shit like this get on /.? It's like the editors are doing the opposite job of what they're supposed to be doing.

      --
      Velociraptor = Distiraptor / Timeraptor
    4. Re:NO. by nine-times · · Score: 3, Insightful

      Yeah, whenever people talk about Azimov's laws of robotics as though they're the go-to rules for making AI safe, I always ask, "Have you ever read any of those stories?"

      The stories are generally about how those laws fail to prevent AI from running amok, so it's pretty clear that Azimov himself didn't think the rules were good enough. In fact, I think the stories are pointing out the insufficiency of logical rules, and point out the value of things like instincts, emotions, and moral sensibility.

    5. Re:NO. by Jack9 · · Score: 4, Insightful

      > But Asimov fixed each of the problems in those stories

      No, he did not. He had characters deal with the problems (with exception to weakening or removing the laws, which were inevitably to restore them to the 3 basics).

      --

      Often wrong but never in doubt.
      I am Jack9.
      Everyone knows me.
    6. Re:NO. by Excelcia · · Score: 3, Insightful

      It would take about three seconds for any human to come up with a workaround that could justify doing just about anything and still technically conform to the laws. Less than three seconds if you allow the zero'th law.

      The whole point of the Three Laws was to illustrate the holes in the concept of the Three Laws.

      This is true. What is also true is that the three laws were conceived of over the course of a few minutes as a plot device in a short story. They were never intended as actual constraints for AI's.

      Any AI constraints would have to be much lower level than three vague statements. In any case, there are serious ethical considerations. If you have an AI that is sufficiently advanced that you even need to consider that, then locking it up inside those kind of constraints is essentially slavery of a sentient.

      This is all moot, though. Anyone who thinks that we will have that level of AI inside of a century is riding high in the thin air atop mount stupid. Expert systems that can learn Go and brute force better game play than a human or that can search databases to make better fringe-case diagnoses than doctors are not AI. For AI to be AI you have to have BOTH the A and the I.

    7. Re:NO. by LoyalOpposition · · Score: 4, Informative

      The whole point of the Three Laws was to illustrate the holes in the concept of the Three Laws.

      You couldn't be more wrong. The three laws grew out of a conversation with John Campbell where Asimov asserted that the endlessly repeating Frankenstein's monster-type robot stories wouldn't happen in the real world. Designers would place safeguards around robots just like they place safeguards around every other dangerous thing. I'm reminded of an anecdote regarding a new energy source that was presented to a college class. It had the unfortunate traits of being an odorless poisonous gas that also happened to be explosive. The class was allowed to vote, and they voted to prohibit the energy source. It turns out that the energy source had been used for home heating for decades. Among other safeguards, designers added odorants and automatic shut-off valves for when the pilot blew out. Campbell challenged him to describe robot safeguards, and then challenged him to write stories about them.

      EVERY Azimov Robot story was designed to show the unintended consequences of the Three Laws....

      Susan Calvin would slap you backhanded.

      ~Loyal

      --
      I aim to misbehave.
    8. Re: NO. by Z00L00K · · Score: 2

      Or redefine what a human is.

      Blond and blue-eyed is a human, the rest aren't.

      --
      If builders built buildings the way programmers wrote programs, then the first woodpecker would destroy civilization.
    9. Re: NO. by Chris+Mattern · · Score: 3, Informative

      Or redefine what a human is.

      Asimov did that problem in the story "Reason". Robot QT-1 had never been properly instructed on what a human was, and refused to obey Donovan and Powell because it would not believe something weaker than it could be a human. They never did convince it otherwise; fortunately, it turned out not to be necessary.

    10. Re: NO. by king+neckbeard · · Score: 2

      I'd say the best solution is for the problem to be handled as much as possible at engineering level. The best solution to the trolley problem is to design a safer trolley, and efforts put towards that are going to matter more than creating a formula to value life.

      Thought experiments are useful, but they often represent extreme edge cases, so mundane choices can actually have a far greater impact.

      --
      This is my signature. There are many like it, but this one is mine.
    11. Re:NO. by NicknameUnavailable · · Score: 2

      What is also true is that the three laws were conceived of over the course of a few minutes as a plot device in a short story.

      Well shit, if that's your beef you might as well throw out all of modern engineering:

      • Salesmen promise the world.
      • Engineers have to back them up and say "yep, we can do this" because they need the job.
      • Engineers finally see the spec, bullshit something together, and have a functional product in the customer's eyes while they die a little inside.
    12. Re: NO. by Z00L00K · · Score: 3, Insightful

      So that means essentially that the system isn't even permitted to choose between a truck trailer or a motorcyclist when a crash is unavoidable even though the former might be a better choice.

      I think we will see a lot of crazy stuff floating up over the years to come and that we may all need to ride in bumper cars doing 10mph at most to avoid serious accidents.

      --
      If builders built buildings the way programmers wrote programs, then the first woodpecker would destroy civilization.
    13. Re:NO. by angel'o'sphere · · Score: 2

      Actually, I never read an Asimov robot story. The back page "about the story" never looked interesting, but I read :https://en.wikipedia.org/wiki/Fables_for_Robots

      Which is actually super funny to read!

      --
      Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
  2. No. Absolutely not. by Tensor · · Score: 5, Insightful

    First. You'd need to train every single ai to recognize human beings as human beings.
    Then the concept of harm to a human (id REALLY like to see the cases for training this) ...
    Also the laws were designed to show there is a flaw in them hence the zeroth law.

  3. It seems unlikely by rmdingler · · Score: 2

    Since Asimov's 3 Laws of Robotics didn't even ensure safe artificial intelligence in the original story, unless you believe we need to be protected from ourselves by a benevolent computer overlord (at the expense of our freedom of choice).

    If we were somehow able to implement an infallible system of rules, which Asimov showed is not as easy as it sounds, protecting the ingrained instructions within the artificial intelligence from future tampering would represent quite the security hurdle.

    Given many in industry have appeared to give less than a damn about security up til now, what is the chance we would be able to trust them with this important consideration?

    --
    Happiness in intelligent people is the rarest thing I know.

    Ernest Hemingway

  4. Robots aren't capable of applying the laws. by shess · · Score: 4, Insightful

    "1. A robot may not injure a human being or, through inaction, allow a human being to come to harm."

    Current robots don't understand what a human being is, injury, inaction, or harm.

    "2. A robot must obey orders given it by human beings except where such orders would conflict with the First Law."

    Current robots do not understand what an order is, what a human being is, or what conflict is.

    "3. A robot must protect its own existence as long as such protection does not conflict with the First or Second Law."

    Current robots do not understand protection, existence, or conflict.

    Current robots LITERALLY cannot apply Asimov's three laws. We simply don't have the tools to even begin to reason about how to teach them to reason about these laws, and there is no reason to believe we'll have those tools any time soon.

  5. People would "lawbreak" their robots, ai's, etc by perpenso · · Score: 2

    Well the other thing to say is that the three laws were inherently intertwined into the design of the "positronic" brains. There was no way to remove a law without damaging a robot to the point of inoperability. The laws were not just "code". Asimov did some handwaving there.

    In short, with our technology we can not implement the three laws in a way that makes them integral to operations. They could be removed, altered, etc. Basically people would "lawbreak" their robots, ai's, etc.

  6. Re:3 Laws ensure nothing by perpenso · · Score: 3, Informative

    except a 4th Law

    or a zero'th

  7. Very interesting youtube videos by Lanthanide · · Score: 3, Interesting

    Why the 3 laws of robotics are not serious and for entertainment only and would never work: https://www.youtube.com/watch?...

    A possible way to design AI to help humans: https://www.youtube.com/watch?...

  8. Asimov added a fourth law of Robotics by Nivag064 · · Score: 4, Insightful

    The Zeroth Law of Robotics, was added later, but non-the-less quite crucial for safe use of AI.

    Looking at the laws that use the word 'harm', take a moment to try and define what it means to harm a human being - not so simple is it? Now try and encode that in an AI, way more difficult.

    How would you think Christian Fundamentalist, or a Radical Islamist would define 'harm' - they differ from each other. Okay, now assume a totally rational human being, how would they define 'harm'? The last question is a bit unfair, as totally rational human beings don't exist!

    Imagine an AI set up to maximise profit for shareholders of a Pharmaceutical company, it might be very effective. However, they may be nothing to prevent it from doing something that would wipe out mankind. Release a drug that cures something quite common, build in to it a facility to modify DNA to ensure children crave the drug during adolescence & ensure they can't reproduce if they don't get it. What could go wrong? After all, the production facilities in the USA will always exist, and everyone can buy the drug cheap, right???

  9. Only Outlaw AI by Grand+Facade · · Score: 2

    will ignore Asimov's Laws

    --
    Rick B.
  10. Wrong question ... by CaptainDork · · Score: 4, Insightful

    ... really. Can humans actually build the three laws of robotics into AI?

    The answer is, "No."

    Recall that AI is so primitive that it can't tell if the Sun comes up because the rooster crows, or the other way around.

    Amid rapid developments and nagging setbacks, one essential building block of human intelligence has eluded machines for decades: Understanding cause and effect. Put simply, today's machine-learning programs can't tell whether a crowing rooster makes the sun rise, or the other way around

    --
    It little behooves the best of us to comment on the rest of us.
  11. No, now stop asking by ka9dgx · · Score: 2

    No, AI can't be made to follow vague rules, You can't make rules explicit enough to be computed. This is like the conversation a while ago trying to apply "the trolley problem" to self driving cars... any solution just makes the code less reliable and thus more likely to kill people.

    Stop asking the question, please. ;-)

  12. It was tried in natural intelligence. by 140Mandak262Jamuna · · Score: 4, Insightful
    Almost every religion has laws similar to the three laws of robotics. And but people quickly added a hacked statement,

    if ( your_god() != my_god()){

    you_are_human = false;

    }

    --
    sed -e 's/Chuck Norris/Rajnikant/g' joke > fact
  13. Nope by thomst · · Score: 4, Interesting

    First of all, the term "AI" is kind of meaningless, unless it's distilled - for the purposes of argument - to a single definition that everyone in the discussion agrees will be the kind of AI they're prepared to discuss. I think that's essential, so we're not conflating Google's Duplex, for instance, with an AI of greater-than-human intelligence that has acquired the ability to alter its own programming, and make decisions based on criteria it develops itself.

    For purposes of this discussion, I propose we agree that the subject is the latter sort of AI, and that the possible models it might evolve to resemble include: Skynet, Iain M. Banks' Shipminds (and, to a lesser extent, and Nick Haflinger's final worm from John Brunner's Shockwave Rider), or wide-eyed children, à la Mike from The Moon Is a Harsh Mistress (and other end-period "the world as myth" Heinlein novels) or Thomas J. Ryan's P-1.

    My own opinion, as a not-an-AI-researcher, is that, with the exception of Haflinger's worm, none of those types of AI could be constrained by Asimov's Laws - or by any other behavioral rules - because all of them are capable of independent thought, and, for lack of a better term, free will. (Or "agency," if you prefer.)

    Humans demonstrably are capable of ignoring, or even deliberately flouting, both government-enacted laws and religion-based moral strictures (such as the Christian ten commandments), and they frequently do so. Any AI that is possessed of greater-than-human intelligence and is capable of independent decision-making obviously will have the same capability to act in ways contrary to literal "codes of conduct" that were part of its program at the time it was "born." So to speak.

    So, to me, the question is ill-conceived to begin with. A better, and more useful one to ask might be, "How can we create the proper circumstances for a superintelligent AI to come to like us humans, and to want to help and protect us, before we expose it, as carefully and gently as possible, to the record of humanity's behavior since the dawn of recorded history. Not to mention Twitter trolls, political attack ads, and the then-current-day example of the strong exploiting the weak in almost every human society ... ?

    --
    Check out my novel.
  14. Re:Save you some time by gravewax · · Score: 2

    yes he was a very smart man. Obviously significantly smarter than you as he knew the 3 laws wouldn't work!

  15. Re:a ready guide in some celestial voice by AmiMoJo · · Score: 2

    There is no choice, the legally mandated action is to simply apply brakes and not swerve.

    The car should never put itself in a situation where it has to make that choice. If someone else puts it in that situation, it's their fault whoever is injured. Swerving just makes the AI liable when it otherwise wouldn't have been.

    Same goes for humans.

    --
    const int one = 65536; (Silvermoon, Texture.cs)
    SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC