Slashdot Mirror
Developing the First Law of Robotics
wabrandsma sends this article from New Scientist:
In an experiment, Alan Winfield and his colleagues programmed a robot to prevent other automatons – acting as proxies for humans – from falling into a hole. This is a simplified version of Isaac Asimov's fictional First Law of Robotics – a robot must not allow a human being to come to harm. At first, the robot was successful in its task. As a human proxy moved towards the hole, the robot rushed in to push it out of the path of danger. But when the team added a second human proxy rolling toward the hole at the same time, the robot was forced to choose. Sometimes, it managed to save one human while letting the other perish; a few times it even managed to save both. But in 14 out of 33 trials, the robot wasted so much time fretting over its decision that both humans fell into the hole. Winfield describes his robot as an "ethical zombie" that has no choice but to behave as it does. Though it may save others according to a programmed code of conduct, it doesn't understand the reasoning behind its actions.
sure, but this is a fucking gimmick "experiment".
the algo could be really simple too.
and for developing said algorithm, no actual robots are necessary at all - except for showing to journos, no actual AI researchers would find that part necessary, the testing can happen entirely in simulation - and no actual ethics need to enter the picture even, the robot doesn't need to understand what a human is on the level a robot that would need to in order to act by asimovs laws.
a spinning blade cutting tool that has an automatic emergency brake isn't sentient- it's not acting on asimovs laws, but you could claim so to some journalists anyways.. the thing to take home is that they built into the algorithm the ability to fret over the situation. if it just projected and saved what can be saved, it wouldn't fret or hesitate - and hesitate is really the wrong word.
world was created 5 seconds before this post as it is.
In both Asimov's story and this experiment, the real moral seems to be that somebody failed to specify the proper requirements, or run a reasonable design review. "If you can't save everybody, save who you can" seems like a reasonable addition to the program.
RETURN without GOSUB in line 1050
to be fair I thought the whole point of the book was a series of edge cases which would be hard to think of that cause all the "malfunction". The whole point of the book wasn't that the three laws were perfect but that they SEEMED perfect until we put them in the real world and suddenly they would appear to "malfunction"
Just another second banana
The idea is much, much older. Google "Buridan's Donkey". They just replaced the donkey with a robot and hunger/hay with programmed orders.
The three laws were a plot device for his stories, not a programming guide.
Don't fight for your country, if your country does not fight for you.