Slashdot Mirror


The Question of Robot Safety

An anonymous reader writes to mention an Economist article wondering how safe should robots be? From the article: "In 1981 Kenji Urada, a 37-year-old Japanese factory worker, climbed over a safety fence at a Kawasaki plant to carry out some maintenance work on a robot. In his haste, he failed to switch the robot off properly. Unable to sense him, the robot's powerful hydraulic arm kept on working and accidentally pushed the engineer into a grinding machine. His death made Urada the first recorded victim to die at the hands of a robot. This gruesome industrial accident would not have happened in a world in which robot behavior was governed by the Three Laws of Robotics drawn up by Isaac Asimov, a science-fiction writer." The article goes on to explore the ethics behind robot soldiers, the liability issues of cleaning droids, and the moral problems posed by sexbots.

24 of 482 comments (clear)

  1. Fear them! by dreemernj · · Score: 5, Funny

    Fear the Roomba!

    --
    1 (short ton / firkin) = 89.1432354 slugs / keg
    1. Re:Fear them! by llamalicious · · Score: 5, Funny

      Now I know why I haven't seen my cats all day. Better empty the Roomba.

  2. I fail to see how that was the robot's fault by eericson · · Score: 5, Insightful

    "This gruesome industrial accident would not have happened in a world in which robot behavior was governed by the Three Laws of Robotics drawn up by Isaac Asimov, a science-fiction writer"

    Neither would this have happened if the maintenance tech had followed procedure and just switched the damned thing off. I don't see how this is any different from a normal industrial accident with something like a sheet metal press.
    --
    The evil monkey commands you to dance.
    1. Re:I fail to see how that was the robot's fault by ozmanjusri · · Score: 5, Insightful
      I don't see how this is any different from a normal industrial accident with something like a sheet metal press.

      It isn't, and the robot in question had less automated safety features than your average modern metal press.

      There's no need to invoke Asimov's laws for something which has less AI than an automatic door. Even a few sensors linked to a cutout switch could have prevented the accident. Something like this: http://gsfctechnology.gsfc.nasa.gov/FeaturedRobot. html could even have prevented the accident and allowed the robot to continue working.

      --
      "I've got more toys than Teruhisa Kitahara."
    2. Re:I fail to see how that was the robot's fault by hazem · · Score: 4, Insightful

      Agreed. If they can make a circular saw that can stop dead the moment it touches human flesh (resulting in a possible scratch rather than a severed finger), then i'm sure they can put some better safety features into robots.

      But you're forgetting how clever idiots can be.

      I used to work in a print shop. I had a large machine for cutting stacks of paper. You have to manually move the paper around under the blades to get it where you want. BUT, to activate the blade and do the cutting, you had to push in two different switches that were a couple feet apart. The idea was that you had to use both hands to activate the blade - and thus, both hands would be away from blade when it cut. It even had spacers that kept you from leaning against the switch.

      Well, one idiot I worked with would tape down one of the switches so he could operate the blade with one hand while moving the paper with the other. Sure enough, he lost a finger. Even stupider, he continued to tape one of the switches down.

      You just can't engineer aound stupidity like that.

  3. Operator Error by romanval · · Score: 5, Insightful

    The robot didn't actively kill him; it just wasn't programmed to know whether a person is there or not. It's like stepping into a giant blender without turning it off. There's isn't much morality to worry about.

  4. Christ, not again. by rk · · Score: 5, Insightful

    Whenever robots come out, why do people trot out Asimov's Laws of Robotics like they're holy writ? He created those laws and then wrote a book's worth of short stories (read: FICTION) showing their pitfalls.

    For anyone who thinks they're a great idea, I'd also like to see your working prototype code and design docs.

    1. Re:Christ, not again. by grammar+fascist · · Score: 4, Funny

      same reason why people always bring up the Moore's law whenever people talk about processor speeds.

      Or Godwin's law, like any time at all.

      --
      I got my Linux laptop at System76.
    2. Re:Christ, not again. by roman_mir · · Score: 4, Funny

      Hold on, hold on, how about all 3 laws into one?

      A robot's ability to speak of Nazis grows by a factor of 2 every 18 months! :/

  5. I for one by Digitus1337 · · Score: 5, Funny

    ...am for guidelines to govern the actions of our new robot overlords.

  6. Wrong kind of robots by QuantumG · · Score: 5, Interesting

    Asimov's rules were always applied to intelligent robots. No-one (to my knowledge) has ever suggested that a hammer should have a sensor to recognise if it is hitting a nail or a thumb and refuse to obey the "command" of its operator if it is targetting the latter. The purpose of Asimov's three rules was to prevent himself from falling into the trap of writing yet another Frankenstein story. That said, I believe there are some proponents of handgun biometrics that believe guns should override the commands of their operators if the operator is not authorized to use it. In the future you may not be able to (legally) purchase a handgun that will fire on a human being.

    --
    How we know is more important than what we know.
  7. What moral issue by JanneM · · Score: 4, Insightful

    What's the moral issue with sex robots? It would be just another sex toy. Has there ever been a technology some inventive human has not adapted for self-gratification?

    I'd venture that it would in fact not even be all that good as a sex toy; it would be limited to being human-like, with human-like capabilities, unlike the classical simple, cheap, but far more versatile toys sold today.

    --
    Trust the Computer. The Computer is your friend.
  8. It's science fiction by hcg50a · · Score: 4, Insightful

    This gruesome industrial accident would not have happened in a world in which robot behavior was governed by the Three Laws of Robotics drawn up by Isaac Asimov, a science-fiction writer.

    The machine that accidentally killed the person is not capable of following the 3 laws of robotics. It was like a train hitting somone on the tracks -- someone in the wrong place at the wrong time.

    The three laws require sophisticated sensors and very sophisticated processing, the likes of which I have not seen in any computer yet.
    --
    HCG 50a = 2MASX J11170638+5455016
    11h17m06.4s +54d55m02s
  9. These Aren't Asmovian Robots by IronicCheese · · Score: 5, Insightful

    To adhere to Asimov's rules of robotics requires that the robot be capable of executing those instructions, and we're nowhere near having machines with the Artifical Intelligence necessary to do that.

    Manufacturing robots are sophisticated, but they're really more properly thought of as "Automatons" in this context, not robots in the Asmovian sense.

    Tragic that this fellow died, but no more of a failing than a farmhand who falls into a thresher.

    It does suggest that these industrial machines might have more safeties on them than they currently do, though.

  10. Re:Virtual bots by Schemat1c · · Score: 4, Funny

    The dangers of robots are worse than you think, just watch this PSA. And remember, when they grab you with those metal claws you can't break free cause they're made of metal, and they're very strong.

    --

    "Nobody knows the age of the human race, but everybody agrees that it is old enough to know better." - Unknown
  11. Re:Virtual bots by Bin_jammin · · Score: 4, Insightful

    I don't want a robot that can think for itself, I want a robot that can think for ME.

  12. Robotic safety is about expectations by Kell+Bengal · · Score: 5, Interesting



    I'm a post-grad student working on a robot helicopter. It has extremely fast rotor blades and is a very real threat to humans if mishandled, so I can speak from personal experience in working on robot safety critical systems. To me, robot safety is more of the same problem faced by machine safety in general and more of the same problems faced by robots in particular.

    Firstly all potentially dangerous machines require correct operation to avoid injury. No one can stop an idiot from ignoring a safety railing of a machine, automatic or robotic. To expect safety after defeating barriers and interlocks is stupid for microwave ovens and toasters, let alone high energy robotic systems. To expect robots to be safe outside of their defined operating parameters is like expecting a car to be made of sponge so no matter how much you ignore the speed limit, you can't kill anyone.

    Secondly, robots seem to suffer a higher demand for intrinsic safety because of the expectation of robot cognition. The reality is, this is the place in robotics where the technology least developed. How do people possibly expect a robot to implement the three laws if the robot cannot flawlessly recognise a human as human? Furthermore, the three laws make no sense for a system that generally works far removed from humans. Putting the sensors and intelligence into a factory robot that should never encounter a human in its powered up state is just stupid. A simple barrier or laser curtain is more than adequate as an interlock, but as we've seen, that doesn't keep humans out all the time. The best the industrial roboticist can practically do is build robot systems that are reliable and stay within their work envelopes.

    For mobile systems like my helicopter, it becomes more difficult since you can't control its workspace - cognition bites you in the arse once again. However, the reality of robot-human safety is that dangerous robots working around humans simply should not be autonomous without direct supervision. We are decades away from machines that are autonomously safe around humans. Software is brittle and easy to confuse no matter how well coded it is - you just can't capture all of the edge cases in the real world when you have millions of possible states. Don't imagine robot helicopters flying around people without a monkey in control - it just won't happen.

    It seems to me that people need to change their idea of robots away from R2-D2 and towards reality. Treat industrial robots like an piece of industrial equipment - with respect. The same idiots who jump the fence of a robot workcell are probably the same idiots who misuse power tools and ignore safety directives. You just can't stop idiots from earning darwin awards. Seriously, it's not hard to stay outside the yellow tape.

    Take your three laws and return them to science fiction, from which they came - they belong to the same realm of fantasy as FTL travel - which is to say, maybe one day but not for a long time.

    --
    Scientists point out problems, engineers fix them
    altslashdot.org: The future of slashdot.
  13. Self Awareness. by camperdave · · Score: 5, Insightful

    Robots already have a degree of self awareness. Position sensors, battery charge monitors, etc are all designed to let a robot know about itself in relation to the world. As we develop more sophisticated robots, they will require a greater degree of self awareness. Right now, industrial robots are basically programmed at the "goto position x1,y1,z1; close gripper; goto position x2,y2,z2; release gripper;" level. If you want them to work at the "Pick up part X from conveyor belt; dip part in solvent tank;" level, the robot is going to have to be able to coordinate vision and arm motion. In other words it will have to have a greater degree of self awareness. When you get into higher level stuff (same robot, multiple tasks) the robot will have to keep track of which tool it has, what loads it is capable of manipulating, etc.

    In short, the more self aware the robot, the higher the level of abstraction you get in assigning tasks to it.

    --
    When our name is on the back of your car, we're behind you all the way!
  14. Re:Virtual bots by Fulcrum+of+Evil · · Score: 5, Insightful

    I have read about robots for ages and i think that the three laws are a load of crap.

    That's the whole point: the three simple rules that Asimov proposes have complex implications - his robot stories are filled with situations where following the laws results in tragedy. So yeah, they're a load of crap, but they're intended to be crap.

    --
    "We returned the General to El Salvador, or maybe Guatemala, it's difficult to tell from 10,000 feet"
  15. Re:gets off on a technicality by Phroggy · · Score: 4, Informative

    You should read Asimov's robot stories and novels. It's not that simple - violating the First Law causes permanent damage to the robot's positronic brain. Simple conflicts between the laws (e.g. ordering a robot to harm a human) can cause minor psychological problems, which a robot psychologist (i.e. someone who understands the psychology of robots, not actually a robot herself) can discern by measuring the responses to certain questions. Fascinating stuff. Start with the short stories, then move on to Caves of Steel, then The Naked Sun.

    --
    $x='S24;r)>63/* h@<5+oZ)32"5cz';$me='phroggy'x$];
    $x=~y+ -xz+\0-Tx+;print$_^chop$me for split'',$x;
  16. Re:Virtual bots by KiloByte · · Score: 4, Funny

    Self awareness is a side effect of general intelligence. We can't make it yet, but when we can it will be useful.

    Of course! The moment we can make general intelligence, it will be a big improvement, for any species.
    This whole article, for example, is a case of failing an intelligence check.
    Hint: it's not the robot who failed it.

    --
    The creatures outside looked from Alt-Right to Antifa; but already it was impossible to say which was which.
  17. Re:the fence was probably there for a reason by ozmanjusri · · Score: 4, Informative
    Did it occur to you that the fence probably had a gate, and the gate probably had an interlock connected to it to stop the robot if the gate was opened, and was probably padlocked to keep people from just wandering in?

    Yes, it did occur to me, and it has occurred to a lot of other people besides. I've been doing some work in a facility that uses welding robots to fabricate parts of railway rolling stock, and all of them are protected by multi-zone floor scanners which slow or stop the robot depending where you stand.

    There's also an international standard, ISO 10218, Manipulating Industrial Robots - Safety, which specifies distance zones depending on the time required to stop the machine. There's a pretty good overview of how it all works here: http://www.sick.com/gus/products/product_catalogs/ industrial/en.toolboxpar.0003.file.tmp/SichereMasc hinen_en.pdf - PDF Warning - Sick is the company which supplies most of the sensors at the fabrication workshop, btw.

    --
    "I've got more toys than Teruhisa Kitahara."
  18. Re:Virtual bots by Ohreally_factor · · Score: 4, Funny

    There was a movie based on I, Robot? Woah! I had thought that there was only a 115 minute commercial advertisement based on I, Robot.

    --
    It's not offtopic, dumbass. It's orthogonal.
  19. Re:Virtual bots by NitsujTPU · · Score: 5, Interesting

    Actually, there are very good reasons to make a robot aware of its own existence. Certain types of reasoning and learning are helped significantly by the ability to reason about the existence of oneself.

    Consider the following experiment, which toddlers have difficulty performing prior to 4 years, but are able to after. A tube is presented to them, with the logo of a candy company on it, "smarties," not the American ones, but the British ones. The child is asked, what is in this tube? At this point, the child invariably says, "smarties!" The conductor of the experiment then opens the tube, revealing pencils. The experimenter asks again, "what is in this tube?" The child says, "pencils." Now, "if I ask another child what is in this tube, what do you think they will say?" Before 4, the kid will say, "pencils." After, they will say, "smarties."

    This reasoning task requires the kid to model themselves prior to the revelation that there are pencils in the tube. It requires a model of what happened after. It, further, requires a model of the other child, of what they will be like without this knowledge. This is actually part of a model of self-awareness, but it's not the entire model. You might ask, "why would a robot need to know this?" Well, actually, it's quite important if the robot is to interract with people, because people will expect the robot to behave in an appropriate manner. Dangerous scenarios could arise because the robot does not understand that things that are in its field of view, for instance, are not in the field of view of a person. An example might be a robot handling dangerous materials, during a construction task. Perhaps the person can't see that it's handling hot metal. A person would warn the other person, avoiding danger.

    As for the three laws, they were written in a body of fiction. I think that too much attention is paid to them.