Slashdot Mirror


In a Crash, Should Self-Driving Cars Save Passengers or Pedestrians? 2 Million People Weigh In (pbs.org)

In what is referred to as the "Moral Machine Experiment", a survey of more than two million people from nearly every country on the planet, people preferred to save humans over animals, young over old, and more people over fewer. From a report: Since 2016, scientists have posed this scenario to folks around the world through the "Moral Machine," an online platform hosted by the Massachusetts Institute of Technology that gauges how humans respond to ethical decisions made by artificial intelligence. On Wednesday, the team behind the Moral Machine released responses from more than two million people spanning 233 countries, dependencies and territories. They found a few universal decisions -- for instance, respondents preferred to save a person over an animal, and young people over older people -- but other responses differed by regional cultures and economic status.

The study's findings offer clues on how to ethically program driverless vehicles based on regional preferences, but the study also highlights underlying diversity issues in the tech industry -- namely that it leaves out voices in the developing world. The Moral Machine uses a quiz to give participants randomly generated sets of 13 questions. Each scenario has two choices: You save the car's passengers or you save the pedestrians. However, the characteristics of the passengers and pedestrians varied randomly -- including by gender, age, social status and physical fitness. What they found: The researchers identified three relatively universal preferences. On average, people wanted: to spare human lives over animals, save more lives over fewer, prioritize young people over old ones. When respondents' preferences did differ, they were highly correlated to cultural and economic differences between countries. For instance, people who were more tolerant of illegal jaywalking tended to be from countries with weaker governance, nations who had a large cultural distance from the U.S. and places that do not value individualism as highly. These distinct cultural preferences could dictate whether a jaywalking pedestrian deserves the same protection as pedestrians crossing the road legally in the event they're hit by a self-driving car.
Further reading: The study; and MIT Technology Review.

16 of 535 comments (clear)

  1. Passengers... by Bert64 · · Score: 5, Insightful

    A self driving car should protect its passengers first or they wouldn't sell. Who would willingly ride in a vehicle that would intentionally sacrifice their life for any reason?

    --
    http://spamdecoy.net - free throwaway anonymous email - avoid spam!
    1. Re:Passengers... by SeaFox · · Score: 2, Insightful

      The passengers have seatbelts, air bags, and crumple zones to lessen their injuries, though. Pedestrians might as well be naked.

    2. Re:Passengers... by Aighearach · · Score: 5, Insightful

      A self driving car should protect its passengers first or they wouldn't sell. Who would willingly ride in a vehicle that would intentionally sacrifice their life for any reason?

      No, actually, we're going to let the traffic engineers at the Department of Transportation set the rules, which will be the same as for humans (stay in lane, stop as fast as you can, DO NOT SWERVE) and the engineers won't even ask the public.

    3. Re:Passengers... by Anonymous Coward · · Score: 1, Insightful

      Pedestrians. The passengers need to grow some, and accept the risk they took. The pedestrians have no duty to bear any risk. The reverse in fact, they can sue the passengers and car manufacturer into oblivion.

    4. Re:Passengers... by b0s0z0ku · · Score: 4, Insightful

      I prioritized jaywalkers over legal walkers. Why? Because the world needs more people who think outside the rules and aren't knee-jerk authoritarians ;)

    5. Re:Passengers... by mark-t · · Score: 5, Insightful

      Choice 1: Hit pedestrian.
      Choice 2: Drive off a cliff and kill the passenger.

      While this is an interesting hypothetical scenario, I might suggest that the number of times that this sort of thing has actually been any kind of real choice to have to make, particularly in a situation that was not preventable by paying enough attention to the road in the first place, is probably countable on one hand in the entire history of automobiles, if not actually entirely non-existent.

      The ideal is that the self-driving car would be paying enough attention (tirelessly, I might add) to the road and what lies ahead that this sort of "kill the driver or kill the pedestrian" situation that people like to dream up wouldn't ever arise in practice... an automated car that is genuinely designed for safety would simply not drive so fast in any sort of hypothetically reduced visibility situation that there would not be enough time to stop safely in the first place.

    6. Re: Passengers... by fluffernutter · · Score: 4, Insightful

      That's why you're supposed to be watching for people who look like they're about to jump into the road and drive at a reasonable speed so you can stop. If you can't see around an obstacle, you assume a person could walk out from there and drive at a reasonable speed so you can stop. An automated car will need to anticipate the same type of situations "those two people on the sidewalk are.an adult who is holding a child's hand, therefore the child is not likely to run out", or "the adult is not holding the child's hand and he is running everywhere, he may run onto the road".

      --
      Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
    7. Re:Passengers... by ShanghaiBill · · Score: 5, Insightful

      This, in a nutshell, is everything wrong with our society. We have way too many people who think that jaywalking and prison rape are equivalent.

      In most countries, jaywalking is not even a crime. In America, it is mostly used by the police to target young people and minorities.

    8. Re: Passengers... by c6gunner · · Score: 2, Insightful

      In most countries, jaywalking is not even a crime.

      In the country I'm currently in traffic laws in general seem to be little more than suggestions, and right-of-way is a foreign concept. So what? They also have one of the highest vehicle fatality rates in the world. What kind of idiot thinks that "it's legal in other places" is a good argument?

      In America, it is mostly used by the police to target young people and minorities.

      Ah. That kind of idiot.

  2. Stupid False Question by crow · · Score: 4, Insightful

    You never know for certain that a given course of action will cause a fatality. When you're driving, you try to avoid accident. Self-driving cars will do the same. They'll compute the odds of an accident for all options and select the one with the lowest odds. It may be just a fraction of a percent less likely, but it will take that.

  3. NYC, glad to know by b0s0z0ku · · Score: 4, Insightful

    Glad to know that NYC (and Boston, probably) has a large cultural distance from the rest of the US. Any place that's not tolerant of jaywalking isn't worth living in, since it puts the needs of steel sensory deprivation bubbles ahead of human needs...

    "For instance, people who were more tolerant of illegal jaywalking tended to be from countries with weaker governance, nations who had a large cultural distance from the U.S. and places that do not value individualism as highly."

  4. A modest proposal by Bobrick · · Score: 5, Insightful

    How about making sure the only person in harm's way is the one that chose to let a computer drive in their place?

  5. Re:Only Americans are selfish, according to resear by uncqual · · Score: 3, Insightful

    The US is a nation composed largely of immigrants and their offspring, many who have arrived comparatively recently. In many cases they came not because it was convenient (getting to the US from Poland or Italy, for example, was not "convenient" before air travel - esp. for poor people) or because it was easy or because it was low risk. They subjected themselves to substantial risk, expense, and inconvenience to make the trip and survive in the US.

    These immigrants, of course, left behind those that didn't have the same drive or interest in creating a better situation for themselves and their families. It would not be surprising that those who had the gumption to better themselves rather than sacrifice themselves for the "common good" would be looking out for themselves and their families more strongly than those that lacked such gumption and remained behind.

    As well, the US has historically been one of the most diverse populations in the world (due to the source of our population) so the tribal "common good" notion is probably unsurprisingly much stronger than in monocultures like Japan or most of the Nordic countries.

    The US seems to have done pretty well - esp. in light of having to deal with its very diverse population.

    --
    Why is there an "insightful" mod and why isn't it "-1"? If I wanted insight, I wouldn't be reading /.
  6. Moral philosophers are so cute by NicBenjamin · · Score: 4, Insightful

    We all know that whether the car decides to hit a jaywalker or not will depend on several variables:

    1) Who is more likely to win a multi-million verdict in a Civil Suit: a jay-walker or the passenger?

    2) Will drivers buy the AI software if it will decide to kill their entire families?

    3) How well the engineers work on a feature (deciding whether to hit jaywalker or kill passenger by driving off cliff?) that is much less likely to be used in the real world then every other feature of the AI?

    And variable 4) Moral philosophers have written a paper on this based on millions of data points from an online quiz, is not on the list.

  7. I don't think Jefferson was evil, but ACs are by DanDD · · Score: 3, Insightful

    From the very foundation that manages the estate of Thomas Jefferson at the home he built, Monticello, including his descendants, both black and white:

    “Though enslaved, Sally Hemings helped shape her life and the lives of her children, who got an almost 50-year head start on emancipation, escaping the system that had engulfed their ancestors and millions of others. Whatever we may feel about it today, this was important to her.”

    Pulitzer Prize-winning historian Annette Gordon-Reed, 2017

    I don't think Thomas Jefferson was quite as evil as you make him out to be. He seems to have been more interested in keeping his relationship with Sally Hemings secret, rather than in keeping anyone a slave. I also challenge you to produce a record of Jefferson selling any of his children with Sally Hemings, or a record of any of Sally's children being abused. Jefferson went out of his way to provide Sally with a private adjoining bedroom with his own. This woman had unfettered access to Jefferson. She could have easily killed him in his sleep, for decades, but she didn't. They also fell in love while in France, where mixed race relationships where no big deal.

    It's also not fair to use modern values to judge those from a different culture and era. If you have references to paint a clear picture of Jefferson as someone who was truly evil, rather than someone who was trying to avoid persecution for a forbidden love, I'd love to see them.

    Jefferson did leave clear instructions that all his slaves were to be freed, but I don't think this happened until after he died. I do love history, but I do not claim to be knowledgeable about Jefferson, although I have visited his home.

    If you want an example of evil in the founding fathers of US history - look at Alexander Hamilton. That SOB used anonymous news articles and stories to libel and belittle Aaron Burr for decades, a rather competent military man who went on to become vice president. Both Burr and Jefferson were not terribly fond of Hamilton's Federalist agenda, which has issues reverberating in American politics to this day.

    Burr eventually got tired of Hamilton's shit and challenged him to a duel, which was accepted. Hamilton, being inept with a pistol, his few competencies being running his mouth and flinging ink with his pen, lost the duel and died. A fitting end for an Anonymous Coward.

    --
    "Every time I see an adult on a bicycle, I no longer despair for the future of the human race." - H. G. Wells
  8. Jaywalking = Weak governance? FFS. by TechyImmigrant · · Score: 4, Insightful

    Jaywalking is not a crime in most countries. Pedestrians typically have right of way over cars. That may sound odd to Americans who haven't traveled, but most countries don't have a word for jaywalking because it is just walking.

    So tolerance of jaywalking comes from it being fine in most places.

    --
    I should use this sig to advertise my book ISBN-13 : 978-1501515132.