Slashdot Mirror


Selectable Ethics For Robotic Cars and the Possibility of a Robot Car Bomb

Rick Zeman writes Wired has an interesting article on the possibility of selectable ethical choices in robotic autonomous cars. From the article: "The way this would work is one customer may set the car (which he paid for) to jealously value his life over all others; another user may prefer that the car values all lives the same and minimizes harm overall; yet another may want to minimize legal liability and costs for herself; and other settings are possible. Philosophically, this opens up an interesting debate about the oft-clashing ideas of morality vs. liability." Meanwhile, others are thinking about the potential large scale damage a robot car could do.

Lasrick writes Patrick Lin writes about a recent FBI report that warns of the use of robot cars as terrorist and criminal threats, calling the use of weaponized robot cars "game changing." Lin explores the many ways in which robot cars could be exploited for nefarious purposes, including the fear that they could help terrorist organizations based in the Middle East carry out attacks on US soil. "And earlier this year, jihadists were calling for more car bombs in America. Thus, popular concerns about car bombs seem all too real." But Lin isn't too worried about these threats, and points out that there are far easier ways for terrorists to wreak havoc in the US.

45 of 239 comments (clear)

  1. Hi welcome to Jonny Cab by garlicbready · · Score: 4, Funny

    Hope you enjoyed the ride ha ha

  2. easier ways for terrorists to wreak havoc by fustakrakich · · Score: 2

    Yeah, run for office...

    --
    “He’s not deformed, he’s just drunk!”
  3. Insurance rates by olsmeister · · Score: 3, Interesting

    I wonder whether your insurance company would demand to know how you have set your car, and adjust your rates accordingly?

    1. Re:Insurance rates by Twinbee · · Score: 2, Insightful

      Car insurance companies will die off when car AI becomes mainstream.

      --
      Why OpalCalc is the best Windows calc
    2. Re:Insurance rates by Lunix+Nutcase · · Score: 4, Insightful

      Hahahahahahahahaha. No, they won't. They will keep themselves around through lobbying efforts.

    3. Re:Insurance rates by ColdWetDog · · Score: 2

      Insurance is a highly competitive industry. If accident rates go down competition will force rates close to $0.

      You perhaps might see collision rates go down but there are many other liabilities that one typically insures a vehicle for - weather related damage, medical, liability and others (usually bundled under the rubric of 'comprehensive').

      You are also assuming, without any data, that the future Johnny Cab will never get itself into an accident. I'm not so sure I would make such a bold claim.

      --
      Faster! Faster! Faster would be better!
    4. Re:Insurance rates by Twinbee · · Score: 2

      Yeah, just like dealers will lobby hard against companies like Tesla. It won't be enough, they'll die off too.

      --
      Why OpalCalc is the best Windows calc
    5. Re:Insurance rates by grahamsz · · Score: 4, Interesting

      More likely that your insurance company would enforce the settings on your car and require that you pay them extra if you'd like the car to value your life over other lives.

      With fast networks it's even possible that the insurance companies could bid on outcomes as the accident was happening. Theoretically my insurer could throw my car into a ditch to avoid damage to a bmw coming the other way.

    6. Re:Insurance rates by Jason+Levine · · Score: 3, Insightful

      You will still be required to have car insurance (whether because of some actual need or because of lobbying from the insurance industry). Your rates might lower a bit to give you an incentive to get a car that drives itself, but they won't plummet. Less accidents/claims will just mean that the insurance companies will wind up with more profits. Which means more money to spend lobbying the government to require auto insurance and robot cars which means more profits. Rinse. Repeat.

      --
      My sci-fi novel, Ghost Thief, is now available from Amazon.com.
    7. Re:Insurance rates by pla · · Score: 4, Informative

      There in principle cannot be a car insurance market if cars don't crash anymore.

      In the past 15 years, I have invoked my car insurance three times, and haven't had a single accident in that time.

      Insurance covers more than just liability - It covers a small rock falling from a dump-truck and breaking your windshield; it covers your car getting stolen; some policies even act as a sort of extended warranty, covering repair or replacement costs in the event of a breakdown.

      And, even with a hypothetically "perfect" driver, some accidents will still happen - Front tire blowout at 75MPH in dense traffic, deer running from the woods into the road 10ft in front of you, construction debris falling from an overpass, etc. Driverless cars will probably handle these events better than live humans do, but such events will still happen.

      All of that said, I would love for you to have it 100% correct, because I fucking loathe insurance companies, and deeply resent the government forcing me to pay them in order to drive. I just don't realistically see it happening.

  4. Blue Screen of Death... by bobbied · · Score: 4, Funny

    BSOD starts to take on a whole new meaning..

    As does, crash dump, interrupt trigger, dirty block and System Panic...

    --
    "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
    1. Re:Blue Screen of Death... by jpvlsmv · · Score: 4, Funny
      You're right, officer, Clippy should not have been driving.

      Now, what to do when my Explorer crashes...

      Click on the Start button, go to "All Programs", then go to "Brakes", right-click on the "Apply Brakes" button, and choose "Run as Administrator". After the 15-second splash screen (now with Ads by Bing), choose "Decelerate Safely".

  5. Re:Drivers already have variable ethics by kruach+aum · · Score: 4, Insightful

    Because ethicists like making work for themselves -- it's unethical to wait for another disaster or human rights violation just so you can do more work!

  6. Scare of the day by Iamthecheese · · Score: 4, Insightful

    Dear government, Please shut up bout terrorism and get out of the way of innovation. sincerely, informed citizen

    --
    If video games influenced behavior the Pac Man generation would be eating pills and running away from their problems.
    1. Re:Scare of the day by Opportunist · · Score: 2

      Ffft. Where's the kickback in that?

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  7. Been discussed before by gurps_npc · · Score: 2, Insightful
    Not news, not interesting.

    1) The cars will most likely be set by the company that sold it - with few if any modifications legally allowable by the owner.

    2) Most likely ALL cars will be told to be mostly selfish, on the principle that they can not predict what someone else will do, and in an attempt to save an innocent pedestrian might in fact end up killing them. The article has the gall to believe the cars will have FAR greater predictive power than they will most likely have.

    3) A human drivable car with a bomb and a timer in it is almost as deadly as a car that can drive into x location and explode is. The capability of moving the car another 10 feet or so into the crowd, as opposed to exploding on the street is NOT a significant difference, given a large explosion.

    4) The cars will be so trackable and with the kind of active, real time security monitoring, that we will know who programmed it and when, probably before the bomb goes off. These are expensive, large devices that by their very nature will be wired into a complex network. It is more likely the cars will turn around and follow the idiot, all the time it's speakers screaming out "ARREST THAT GUY HE PUT A BOMB IN ME!"

    --
    excitingthingstodo.blogspot.com
    1. Re:Been discussed before by Anonymous Coward · · Score: 2, Informative

      2) Most likely ALL cars will be told to be mostly selfish, on the principle that they can not predict what someone else will do, and in an attempt to save an innocent pedestrian might in fact end up killing them. The article has the gall to believe the cars will have FAR greater predictive power than they will most likely have.

      This is a thing that is starting to irritate me. This is a piece from the director of the "Ethics + Emerging Sciences Group"
      Recently we have seen writeups about the ethics of automate from psychologists and philosophers that are completely clueless to what laws are already in place and what best practices are when it comes to automation.
      They go in with the assumption that a machine is conscious and will make conscious decisions, ignoring that it it impossible to get anything remotely resembling an AI through the certification process needed for safety critical machinery.

    2. Re:Been discussed before by bluefoxlucid · · Score: 2

      Point 4 will never happen. A little duct tape over the security sensor. Sealed briefcase bomb.

      The rest of this is stupid. We have already put RC receivers into regular cars and used a Radio Shack car controller to drive. They did that on Blues Brothers 2000, and probably The Simpsons. We have real RC car races. You just need a Pringles can, a wire, and a car.

  8. Automation, remote controls already exist by i+kan+reed · · Score: 5, Insightful

    Let's skip "car" because I can, in theory, attach enough explosives(and shrapnel) to kill a large number of people to a simple homemade quadrotor, run with open source software, give it a dead-reckoning path and fire and forget from a relatively inconspicuous location. Multiple simultaneously, if I have the amount of resources a car bomb would require.

    Automation is here. Being paranoid about one particular application of it won't help anyone.

    1. Re:Automation, remote controls already exist by i+kan+reed · · Score: 2

      This is your reminder that anyone with a post-highschool grounding in chemistry could make pipebombs with no difficulty. The ingredients for a self-oxidizing agent could be gotten at a hardware store. They aren't common in the US in spite of that.

      There won't be an "epidemic" of automated bombings, because being a bomber takes a cause you personally see as being more important than not being a murderer. The right mixture of basically competent, ideologically dedicated, and morally flexible just isn't that common.

      That's part of why suicide attacks are practically synonymous with terrorism: people have to be amazingly deep into an ideology to consider it.

  9. Not so fast by Moof123 · · Score: 2

    It sure seems like such selectable ethics concerns are kind of jumping the gun. Regulatory behavior is going to clamp down on such options faster than you can utter "Engage!". Personally I would want my autonomous car to be designed with the most basic "don't get in a crash" goal only, as I suspect regulators will as well.

    Far more important is the idea that we will have at least an order of magnitude or two increase in the amount of code running a car. If Toyota had trouble with the darn throttle (replacing the function of a cable with a few sensors and a bunch of code), how can we trust that car companies will be able to manage a code base this big without frequent catastrophe? Adding extra complexity to tweak the "ethics" of the car just sounds like guilding the lilly, which increases the opportunities for bugs to creep in.

  10. Philosophy Settings by timrod · · Score: 5, Funny

    I, for one, cannot wait for the day when I can set my car's logic system to different ethical settings, sorted by philosopher. For instance, you can set your car to "Jeremy Bentham", which will automatically choose whoever looks less useful to ram into when in a crash situation. You could also set it to "Plato", which will cause the car to ram into whoever appears less educated (just hope it doesn't happen to be you).

    Just make sure you don't set the car to "Nietzsche".

    1. Re:Philosophy Settings by Rob+Riggs · · Score: 3, Funny

      I'm looking forward to the Ayn Rand setting. "Me first!!"

      --
      the growth in cynicism and rebellion has not been without cause
    2. Re:Philosophy Settings by d34thm0nk3y · · Score: 3, Informative

      I, for one, cannot wait for the day when I can set my car's logic system to different ethical settings, sorted by philosopher.

      I just tried the Plato setting and now I'm stuck in a cave. Thanks Joe!

  11. MUCH easier. by khasim · · Score: 3, Interesting

    From TFA:

    Do you remember that day when you lost your mind? You aimed your car at five random people down the road.

    WTF?!? That makes no sense.

    Thankfully, your autonomous car saved their lives by grabbing the wheel from you and swerving to the right.

    Again, WTF?!? Who would design a machine that would take control away from a person TO HIT AN OBSTACLE? That's a mess of legal responsibility.

    This scene, of course, is based on the infamous "trolley problem" that many folks are now talking about in AI ethics.

    No. No they are not. The only "many folks" who are talking about it are people who have no concept of what it takes to program a car.

    Or legal liability.

    Itâ(TM)s a plausible scene, since even cars today have crash-avoidance features: some can brake by themselves to avoid collisions, and others can change lanes too.

    No, it is not "plausible". Not at all. You are speculating on a system that would be able to correctly identify ALL THE OBJECTS IN THE AREA and that is never going to happen.

    Wired is being stupid in TFA.

    1. Re:MUCH easier. by Qzukk · · Score: 4, Insightful

      You are speculating on a system that would be able to correctly identify ALL THE OBJECTS IN THE AREA and that is never going to happen.

      It doesn't have to identify all the objects in the area, it simply has to not hit them.

      --
      If I have been able to see further than others, it is because I bought a pair of binoculars.
    2. Re:MUCH easier. by khasim · · Score: 2

      It doesn't have to identify all the objects in the area, it simply has to not hit them.

      Which is an order of magnitude EASIER TO PROGRAM.

      And computers can recognize an obstacle and brake faster than a person can.

      And that is why autonomous cars will NEVER be programmed with a "choice" to hit person X in order to avoid hitting person A.

      So the premise of TFA is flawed.

    3. Re:MUCH easier. by Shoten · · Score: 3, Insightful

      You are speculating on a system that would be able to correctly identify ALL THE OBJECTS IN THE AREA and that is never going to happen.

      It doesn't have to identify all the objects in the area, it simply has to not hit them.

      Actually, since the whole question of TFA is about ethical choices, it does have to identify them. It can't view a trash can as being equal to a child pedestrian, for example. It will have to see the difference between a dumpster (hit it, nobody inside dies) and another car (hit it, someone inside it may die). It may even need to weigh the potential occupancy of other vehicles...a bus is likely to hold more people than a scooter.

      The question at its heart is not about object avoidance in the article...it's about choices between objects. And that requires identification.

      --

      For your security, this post has been encrypted with ROT-13, twice.
    4. Re:MUCH easier. by khasim · · Score: 3, Insightful

      Given a choice, I think autonomous cars at some point WILL be programmed with such a choice. For example, hitting an elderly person in order to avoid hitting a small child.

      Congratulations. Your product just injured Senator Somebody in order to avoid hitting a Betsy-wetsy doll.

      Senator Somebody has filed "lawsuit" against your company. It is super-effective. All your assets are belong to him.

  12. FBI: 1, Ethics: 0 by some+old+guy · · Score: 4, Insightful

    So, the FBI is already making the case for, "We need full monitoring and control intervention capability for everybody's new cars, because terrorists."

    --
    Scruting the inscrutable for over 50 years.
  13. Re:Drivers already have variable ethics by maliqua · · Score: 4, Informative

    I'm not really sure why they call it 'ethics of the car' not ethics of the owner or programmer, or administrator of the car.

    If you put a bomb in a robot car and had tell it to drive to a statium, the car didn't fail to make an ethical choice. I doubt the car would even be aware of the bomb, or what a bomb is, or why its bad.

  14. Re:Fuck people! by Opportunist · · Score: 4, Funny

    Judging from Monday morning traffic in my town, a lot of people already set their cars to that setting.

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  15. Re:"Philosophically, this opens up an interesting by Rob+Riggs · · Score: 3, Interesting

    Just wait until the AI has to keep track of liability awards so that it can make the correct decision regarding minimizing liability. At some point you are going to have a stupid jury award and all the cars are just going to refuse to go anywhere because the AI's cost benefit analysis says "just stay in park".

    --
    the growth in cynicism and rebellion has not been without cause
  16. Re:"Philosophically, this opens up an interesting by Opportunist · · Score: 4, Insightful

    No. To minimize damage, you'd have to brake when approaching a child. To minimize liability, you have to accelerate when you notice that you can't stop in time to avoid severe injury, i.e. to ensure death which is cheaper than a lifetime cripple.

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  17. Re:"Philosophically, this opens up an interesting by canadiannomad · · Score: 2

    Can I program mine to always claim to other vehicles that I have 7 babies on board?

    --
    Hmm, the humour and sarcasm seem to have been be lost on you.
  18. Stupid scaremongering by aepervius · · Score: 2

    "Patrick Lin writes about a recent FBI report that warns of the use of robot cars as terrorist and criminal threats, calling the use of weaponized robot cars "game changing." "

    Only if the potential terrorist have never learned to drive. Because otherwise :
    1) for criminal you will be far better off with a car which do not respect speed limit/red lights/stops if you want to run away
    2) a terrorist can simply drive the bomb somewhere then set it to explode one minute later and go away. What is the difference if he drove it himself or not ?

    Terrorism is the least worry with robot car.


    As for point 1 , laws and insurance will be setting your car "ethics" and not you personally.

    --
    C. Sagan : A demon haunted world:
    http://www.amazon.com/gp/product/0345409469/
    visit randi.org
  19. Will not matter. by khasim · · Score: 4, Insightful

    I wonder whether your insurance company would demand to know how you have set your car, and adjust your rates accordingly?

    That does not matter because it won't be an option.

    That is because "A.I." cars will never exist.

    They will not exist because they will have to start out as less-than-100%-perfect than TFA requires. And that imperfection will lead to mistakes.

    Those mistakes will lead to lawsuits. You were injured when a vehicle manufactured by "Artificially Intelligent Motors, inc (AIM, inc)" hit you by "choice". That "choice" was programmed into that vehicle at the demand of "AIM, inc" management.

    So no. No company would take that risk. And anyone stupid enough to try would not write perfect code and would be sued out of existence after their first patch.

    1. Re:Will not matter. by CanHasDIY · · Score: 2

      Those mistakes will lead to lawsuits. You were injured when a vehicle manufactured by "Artificially Intelligent Motors, inc (AIM, inc)" hit you by "choice". That "choice" was programmed into that vehicle at the demand of "AIM, inc" management.

      So no. No company would take that risk. And anyone stupid enough to try would not write perfect code and would be sued out of existence after their first patch.

      Considering how bloody obvious that outcome seems to be, it amazes me how some educated people just flat out don't get it.

      Or rather, it would amaze me, if I weren't fully aware of the human mind's ability to perform complex mental gymnastics in order to come to a predetermined conclusion, level of education notwithstanding.

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
  20. Re:Labor costs by canadiannomad · · Score: 2

    You get less human rights complaints when you let the children(or entire populations) stave by using robots for your cheap labour instead of paying them a pittance. :(

    --
    Hmm, the humour and sarcasm seem to have been be lost on you.
  21. Re:Fuck people! by GameboyRMH · · Score: 3, Funny

    First you'd need to root the car and run "echo 1 > /dev/morality/evil"

    --
    "When information is power, privacy is freedom" - Jah-Wren Ryel
  22. Re:Will a robo car be able to break the law to sav by Cro+Magnon · · Score: 2

    It will, if it's an Asimov car. The law should only be Second Rule. No death to humans is the First.

    --
    Slow down, cowboy! It has been 4 hours since you last posted. You must wait another few hours.
  23. Mental Masturbation by brunes69 · · Score: 2

    This discussion is pointless mental masturbation because none of these things will be real problems with autonomous cars. The people dreaming up these scenarios do not understand the fundamental paradigm shift that comes with autonomous vehicles

    - Firstly, any thoroughfare staffed with autonomous cars should never have pedestrian access, because the cars will all be travelling at maximum safe speed constantly, like 110K+ even on city streets. These streets should be fenced not allowing pedestrians.

    - Secondly, In situations where pedestrians are involved, which are inherently unpredictable, the car will never drive faster than it would be able to stop and not hit ANY pedestrian... thus, this whole "choose 1 or 5" scenario is not possible.

    - Finally, you won't be able to manually point the car at people and then later have the car "take over". You will not have any ability to drive the car manually, period. At least I bloody well hope not... once autonomous cars are standard, people should not be allowed to drive any more.

    -

  24. Re:Fuck people! by JWSmythe · · Score: 3, Funny


    echo "chaotic_evil" > /proc/morality

    That's why it hasn't been working for you.

    There's also a kernel patch on evil.org to change the default setting. With the standard kernel, it is set to "lawful_neutral". In that mode, it will honk and swerve for a little old lady crossing the street.

    lawful_good would stop, and offer her a ride.

    chaotic_evil will run her over, back up and do it again, and the lower loot collection hook will deploy to take her purse.

    --
    Serious? Seriousness is well above my pay grade.
  25. Re:Not really game changing by JaredOfEuropa · · Score: 2

    Modded "flamebait", but you're sort of right. The hard part of blowing something up is getting the cash together, obtaining enough explosives, and finding the right target and opportunity, all that without having some security agency get wind of your plans. Finding some poor deluded soul willing to blow himself up for a crappy cause is actually the easy part, especially if you can draw from a pool of religious nuts. And islam has plenty of those, sad to say.

    --
    If construction was anything like programming, an incorrectly fitted lock would bring down the entire building...
  26. Re:Fuck people! by bluegutang · · Score: 2

    That wouldn't work either, because you forgot to set the evil bit.