Developing the First Law of Robotics

wabrandsma sends this article from New Scientist: In an experiment, Alan Winfield and his colleagues programmed a robot to prevent other automatons – acting as proxies for humans – from falling into a hole. This is a simplified version of Isaac Asimov's fictional First Law of Robotics – a robot must not allow a human being to come to harm. At first, the robot was successful in its task. As a human proxy moved towards the hole, the robot rushed in to push it out of the path of danger. But when the team added a second human proxy rolling toward the hole at the same time, the robot was forced to choose. Sometimes, it managed to save one human while letting the other perish; a few times it even managed to save both. But in 14 out of 33 trials, the robot wasted so much time fretting over its decision that both humans fell into the hole. Winfield describes his robot as an "ethical zombie" that has no choice but to behave as it does. Though it may save others according to a programmed code of conduct, it doesn't understand the reasoning behind its actions.

Comments

Re:I, Robot from a programmers perspective

[thewolfkin]

to be fair I thought the whole point of the book was a series of edge cases which would be hard to think of that cause all the "malfunction". The whole point of the book wasn't that the three laws were perfect but that they SEEMED perfect until we put them in the real world and suddenly they would appear to "malfunction"