Slashdot Mirror


In a Crash, Should Self-Driving Cars Save Passengers or Pedestrians? 2 Million People Weigh In (pbs.org)

In what is referred to as the "Moral Machine Experiment", a survey of more than two million people from nearly every country on the planet, people preferred to save humans over animals, young over old, and more people over fewer. From a report: Since 2016, scientists have posed this scenario to folks around the world through the "Moral Machine," an online platform hosted by the Massachusetts Institute of Technology that gauges how humans respond to ethical decisions made by artificial intelligence. On Wednesday, the team behind the Moral Machine released responses from more than two million people spanning 233 countries, dependencies and territories. They found a few universal decisions -- for instance, respondents preferred to save a person over an animal, and young people over older people -- but other responses differed by regional cultures and economic status.

The study's findings offer clues on how to ethically program driverless vehicles based on regional preferences, but the study also highlights underlying diversity issues in the tech industry -- namely that it leaves out voices in the developing world. The Moral Machine uses a quiz to give participants randomly generated sets of 13 questions. Each scenario has two choices: You save the car's passengers or you save the pedestrians. However, the characteristics of the passengers and pedestrians varied randomly -- including by gender, age, social status and physical fitness. What they found: The researchers identified three relatively universal preferences. On average, people wanted: to spare human lives over animals, save more lives over fewer, prioritize young people over old ones. When respondents' preferences did differ, they were highly correlated to cultural and economic differences between countries. For instance, people who were more tolerant of illegal jaywalking tended to be from countries with weaker governance, nations who had a large cultural distance from the U.S. and places that do not value individualism as highly. These distinct cultural preferences could dictate whether a jaywalking pedestrian deserves the same protection as pedestrians crossing the road legally in the event they're hit by a self-driving car.
Further reading: The study; and MIT Technology Review.

13 of 535 comments (clear)

  1. Passengers... by Bert64 · · Score: 5, Insightful

    A self driving car should protect its passengers first or they wouldn't sell. Who would willingly ride in a vehicle that would intentionally sacrifice their life for any reason?

    --
    http://spamdecoy.net - free throwaway anonymous email - avoid spam!
    1. Re:Passengers... by Aighearach · · Score: 5, Insightful

      A self driving car should protect its passengers first or they wouldn't sell. Who would willingly ride in a vehicle that would intentionally sacrifice their life for any reason?

      No, actually, we're going to let the traffic engineers at the Department of Transportation set the rules, which will be the same as for humans (stay in lane, stop as fast as you can, DO NOT SWERVE) and the engineers won't even ask the public.

    2. Re:Passengers... by ShanghaiBill · · Score: 5, Interesting

      The passengers have seatbelts, air bags, and crumple zones to lessen their injuries

      The question is usually framed to already take that into account. They way I have heard it is:

      Choice 1: Hit pedestrian.
      Choice 2: Drive off a cliff and kill the passenger.

      It may be an interesting philosophical question, but it has little to do with reality. A scenario like that is almost never going to happen, and even if it did, a human driver would be faced with the same split second dilemma and be no more likely to make the "correct" decision (whatever that is).

      Far more important is that the SDC would have much better reaction time, more braking distance, better control of steering, more situational awareness of other traffic, and thus better able to kill no one.

    3. Re:Passengers... by b0s0z0ku · · Score: 4, Insightful

      I prioritized jaywalkers over legal walkers. Why? Because the world needs more people who think outside the rules and aren't knee-jerk authoritarians ;)

    4. Re:Passengers... by mark-t · · Score: 5, Insightful

      Choice 1: Hit pedestrian.
      Choice 2: Drive off a cliff and kill the passenger.

      While this is an interesting hypothetical scenario, I might suggest that the number of times that this sort of thing has actually been any kind of real choice to have to make, particularly in a situation that was not preventable by paying enough attention to the road in the first place, is probably countable on one hand in the entire history of automobiles, if not actually entirely non-existent.

      The ideal is that the self-driving car would be paying enough attention (tirelessly, I might add) to the road and what lies ahead that this sort of "kill the driver or kill the pedestrian" situation that people like to dream up wouldn't ever arise in practice... an automated car that is genuinely designed for safety would simply not drive so fast in any sort of hypothetically reduced visibility situation that there would not be enough time to stop safely in the first place.

    5. Re: Passengers... by fluffernutter · · Score: 4, Insightful

      That's why you're supposed to be watching for people who look like they're about to jump into the road and drive at a reasonable speed so you can stop. If you can't see around an obstacle, you assume a person could walk out from there and drive at a reasonable speed so you can stop. An automated car will need to anticipate the same type of situations "those two people on the sidewalk are.an adult who is holding a child's hand, therefore the child is not likely to run out", or "the adult is not holding the child's hand and he is running everywhere, he may run onto the road".

      --
      Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
    6. Re:Passengers... by ShanghaiBill · · Score: 5, Insightful

      This, in a nutshell, is everything wrong with our society. We have way too many people who think that jaywalking and prison rape are equivalent.

      In most countries, jaywalking is not even a crime. In America, it is mostly used by the police to target young people and minorities.

    7. Re:Passengers... by war4peace · · Score: 4, Interesting

      In most countries, jaywalking is not even a crime.

      Citation needed.
      Anyway...
      Jaywalking is only called as such if it's a crime. Otherwise it's called "crossing the road". So let's focus on where it indeed is illegal to cross the road wherever you feel like.
      Jaywalking was always a tricky thing. There are many variables to consider.
      Is it okay to cross a road through an unmarked location, if the road is empty for hundreds of yards either way or with no car in sight?
      Is it okay to play IRL Frogger in a busy intersection in the middle of the city?

      Personally, I am a strong supporter of (enforcing) heavy fines in case of jaywalking anywhere within a city or town's borders, with the exception of single-lane, one-way streets with speed bumpers or speed limit below 15 mph. The reason for this is my belief that a civilized society is based on respecting the "small rules": no littering, no jaywalking, no unruly behavior, no making a lot of noise, you know, common sense things.
      I'm from a country where jaywalking is punished... in theory. In practice, nobody gives a flying fuck, and as a result I stay at the red light with my little kids and everyone else just jaywalks, so I struggle to properly educate my kids to be civilized because everyone else shows them, through their apish behavior, that their dad is an idiot for following simple common sense rules. Am I an idiot for teaching my kids a civilized rule?
      In the past I used to work as a camera man for a local branch of a country-wide private TV channel. One of my tasks was to document all major incidents for the local police, as at the time they did not have their own camera man. I have documented car accidents, fires, demolitions gone wrong, suicides, homicides, pretty much anything with victims (be they wounded or killed). I've seen fatal effects of jaywalking, very closely and from a wide variety of angles. People who jaywalk have no fucking clue. I know exactly what I am keeping my kids away from, and I cringe every time I see parents dragging their kids across the road, in a hurry, because cars are coming with 30-40 mph. There was a case from back then where a parent with two kids jaywalked, one of the kids dropped his toy and pulled his hand from his father's, ran back to pick it up and was run over by a car. The other kid go scared and ran the other way, across the middle of the road and got hit by another car. The parent was unscathed but ended up with one dead child and another crippled for life. All because he decided not to wait for 30 more seconds.

      So yeah, it doesn't matter if jaywalking is a crime. Before it being a crime, it's a common sense rule. It became a crime because people lack common sense, so it needs to be hammered into their thick skulls with fines and such.

      --
      ...gis sdrawkcab (usually not responding to ACs; don't bother posting as AC)
  2. Stupid False Question by crow · · Score: 4, Insightful

    You never know for certain that a given course of action will cause a fatality. When you're driving, you try to avoid accident. Self-driving cars will do the same. They'll compute the odds of an accident for all options and select the one with the lowest odds. It may be just a fraction of a percent less likely, but it will take that.

  3. NYC, glad to know by b0s0z0ku · · Score: 4, Insightful

    Glad to know that NYC (and Boston, probably) has a large cultural distance from the rest of the US. Any place that's not tolerant of jaywalking isn't worth living in, since it puts the needs of steel sensory deprivation bubbles ahead of human needs...

    "For instance, people who were more tolerant of illegal jaywalking tended to be from countries with weaker governance, nations who had a large cultural distance from the U.S. and places that do not value individualism as highly."

  4. A modest proposal by Bobrick · · Score: 5, Insightful

    How about making sure the only person in harm's way is the one that chose to let a computer drive in their place?

  5. Moral philosophers are so cute by NicBenjamin · · Score: 4, Insightful

    We all know that whether the car decides to hit a jaywalker or not will depend on several variables:

    1) Who is more likely to win a multi-million verdict in a Civil Suit: a jay-walker or the passenger?

    2) Will drivers buy the AI software if it will decide to kill their entire families?

    3) How well the engineers work on a feature (deciding whether to hit jaywalker or kill passenger by driving off cliff?) that is much less likely to be used in the real world then every other feature of the AI?

    And variable 4) Moral philosophers have written a paper on this based on millions of data points from an online quiz, is not on the list.

  6. Jaywalking = Weak governance? FFS. by TechyImmigrant · · Score: 4, Insightful

    Jaywalking is not a crime in most countries. Pedestrians typically have right of way over cars. That may sound odd to Americans who haven't traveled, but most countries don't have a word for jaywalking because it is just walking.

    So tolerance of jaywalking comes from it being fine in most places.

    --
    I should use this sig to advertise my book ISBN-13 : 978-1501515132.