Drivers Prefer Autonomous Cars That Don't Kill Them (hothardware.com)

"A new study shows that most people prefer that self-driving cars be programmed to save the most people in the event of an accident, even if it kills the driver," reports Information Week. "Unless they are the drivers." Slashdot reader MojoKid quotes an article from Hot Hardware about the new study, which was published by Science magazine. So if there is just one passenger aboard a car, and the lives of 10 pedestrians are at stake, the survey participants were perfectly fine with a self-driving car "killing" its passenger to save many more lives in return. But on the flip side, these same participants said that if they were shopping for a car to purchase or were a passenger, they would prefer to be within a vehicle that would protect their lives by any means necessary. Participants also balked at the notion of the government stepping in to regulate the "morality brain" of self-driving cars.
The article warns about a future where "a harsh AI reality may whittle the worth of our very existence down to simple, unemotional percentages in a computer's brain." MIT's Media Lab is now letting users judge for themselves, in a free online game called "Moral Machine" simulating the difficult decisions that might someday have to be made by an autonomous self-driving car.

Comments

Re:News at 5...

[Rei]

Sigh... this issue is so bloody simple to resolve.

1. Default to a default set of morals, which include a reasonable (but not excessive) degree of self-sacrifice - based around the sort of decisions a "typical" driver would make.

2. Make a straightforward procedure for people to customize the vehicle's morals. Just run them through a series of scenarios on the screen to see where their cutoff is. Is this a person who would mow through a couple toddlers to avoid having to drive off the road, or a person who would rather drive off a certain-death cliff than risk hitting a single individual carelessly picnicking in the road?

If they start telling the car to make legally questionable decisions, warn them about this, and let them know that they'll be liable if the car has to make such a decision - but let them choose it anyway. Blatantly illegal things, like "mowing through a preschool playground at high speed to save some time on your daily commute", shouldn't be options. Questionable, legally debatable things should be options.

Re:It Doesn't Matter; It Won't Ever Happen

[mysidia]

Except that's an unavoidable situation. Sometimes there is no option where everybody ends up fine.

It's not necessary for the vehicle to make a decision here.

It can simply attempt to avoid a crash by utilizing only normal means which a human would use, such as braking, or safe swerving within the confines of the road.

Not "Erratic behavior" such as attempting to self-run-off-the-road-into-the-ditch or other self-sacrificial strategies.

The car should just take steps to avoid or mitigate crashes, not to make a tradeoff where other actions are used that further-endanger the driver or passengers.

Extreme avoidance strategies might be considered, but only for the benefit of making sure there is no crash at all and making people in the car more likely to survive or escape serious injury

Re:As someone with a brain who has lived life

[mysidia]

where everyone's car knows when every toddler on Earth decided to wander onto a road?

No.... if a Toddler wanders onto the highway, then that toddler's parents just committed a homicide.

What do you think is going to happen?

Replacing human-driven cars for self-driving ones doesn't change that.

And no, the self-driving car should not facilitate endangerment of more people in the event that a toddler wanders into the road.

Also, in a world where that happens, parents become more careless (If they think autonomous cars will self-sacrifice to protect their toddler), and more toddlers wander into the road, and more people die as a consequence.

It's a liability issue

[duckintheface]

Self driving cars will transfer the liability from the owner of the car to the manufacturer of the car. This is already happening. Otherwise, they could never sell a car to anyone. But if the liability is held by the manufacturer, you can be sure the crash algorithm will be one that minimizes total casualties (and thus total liability).

And notice that this is the same issue behind the Will Smith film, "I, Robot". Will's character is rescued from drowning by a robot that lets a little girl drown instead. The robot had calculated the chances of saving each and Will won the AI lottery.

Re: It's a liability issue

[hey!]

Ultimately the Three Laws were a literary device. Asimov was tired of stories where robots run amok, so he made up rules that would, on the face of it, make robots running amok seem impossible. He then used these rules to make superior robots-run-amok stories.

What makes those stories interesting is that they're all about how our simplistic reasoning leads us to dismiss real possibilities too quickly. Most people simply assume things work they way they were designed to work, but smart people realize that purposes can be gamed as long as the letter of the rules aren't broken. It is true that Asimov introduced a 0th Law, but the other laws remain in effect; robots in his stories are conflicted. In Jeff Vintar's screenplay the 0th law simply overrides the other laws; the lower priority rules are in effect nullified, which doesn't happen in Asimov's stories. The screenplay was a bog-standard robots run amok story with a little Asimovian window dressing thrown in, nowhere as good as anything Asimov did. Because Jeff Vintar isn't anywhere near as smart as Isaac Asimov.

But then again, neither am I, and probably not you either.

I very much doubt Asimov thought that people would ever build something like the Three Laws into technology in such a fundamental way; that was just a literary device that enabled him to display his astounding cleverness. I don't think it'll ever happen either, for the simple reason that killing people will be a driving for in the adoption of autonomous robot technology.