Slashdot Mirror


Selectable Ethics For Robotic Cars and the Possibility of a Robot Car Bomb

Rick Zeman writes Wired has an interesting article on the possibility of selectable ethical choices in robotic autonomous cars. From the article: "The way this would work is one customer may set the car (which he paid for) to jealously value his life over all others; another user may prefer that the car values all lives the same and minimizes harm overall; yet another may want to minimize legal liability and costs for herself; and other settings are possible. Philosophically, this opens up an interesting debate about the oft-clashing ideas of morality vs. liability." Meanwhile, others are thinking about the potential large scale damage a robot car could do.

Lasrick writes Patrick Lin writes about a recent FBI report that warns of the use of robot cars as terrorist and criminal threats, calling the use of weaponized robot cars "game changing." Lin explores the many ways in which robot cars could be exploited for nefarious purposes, including the fear that they could help terrorist organizations based in the Middle East carry out attacks on US soil. "And earlier this year, jihadists were calling for more car bombs in America. Thus, popular concerns about car bombs seem all too real." But Lin isn't too worried about these threats, and points out that there are far easier ways for terrorists to wreak havoc in the US.

239 comments

  1. Hi welcome to Jonny Cab by garlicbready · · Score: 4, Funny

    Hope you enjoyed the ride ha ha

    1. Re:Hi welcome to Jonny Cab by Anonymous Coward · · Score: 0

      I'm not familiar with that address. Would you please repeat the destination?

    2. Re:Hi welcome to Jonny Cab by Anonymous Coward · · Score: 0

      Next stop Graveyard on Lexington Avenue and Yankee Boulevard.

  2. Fuck people! by Anonymous Coward · · Score: 0

    Can I set my car to kill as many people as possible? Add chariot spikes, etc.?

    1. Re:Fuck people! by Opportunist · · Score: 4, Funny

      Judging from Monday morning traffic in my town, a lot of people already set their cars to that setting.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    2. Re:Fuck people! by GameboyRMH · · Score: 3, Funny

      First you'd need to root the car and run "echo 1 > /dev/morality/evil"

      --
      "When information is power, privacy is freedom" - Jah-Wren Ryel
    3. Re:Fuck people! by JWSmythe · · Score: 3, Funny


      echo "chaotic_evil" > /proc/morality

      That's why it hasn't been working for you.

      There's also a kernel patch on evil.org to change the default setting. With the standard kernel, it is set to "lawful_neutral". In that mode, it will honk and swerve for a little old lady crossing the street.

      lawful_good would stop, and offer her a ride.

      chaotic_evil will run her over, back up and do it again, and the lower loot collection hook will deploy to take her purse.

      --
      Serious? Seriousness is well above my pay grade.
    4. Re:Fuck people! by bluegutang · · Score: 2

      That wouldn't work either, because you forgot to set the evil bit.

    5. Re:Fuck people! by JWSmythe · · Score: 1

      chaotic_evil supersedes the evil bit, being chaos and all. :)

      --
      Serious? Seriousness is well above my pay grade.
  3. easier ways for terrorists to wreak havoc by fustakrakich · · Score: 2

    Yeah, run for office...

    --
    “He’s not deformed, he’s just drunk!”
  4. Drivers already have variable ethics by Anonymous Coward · · Score: 1

    Not sure why the "ethics" of a robot driver are such a big deal.

    1. Re:Drivers already have variable ethics by kruach+aum · · Score: 4, Insightful

      Because ethicists like making work for themselves -- it's unethical to wait for another disaster or human rights violation just so you can do more work!

    2. Re:Drivers already have variable ethics by Anonymous Coward · · Score: 0

      One word: Battlebots.

    3. Re:Drivers already have variable ethics by maliqua · · Score: 4, Informative

      I'm not really sure why they call it 'ethics of the car' not ethics of the owner or programmer, or administrator of the car.

      If you put a bomb in a robot car and had tell it to drive to a statium, the car didn't fail to make an ethical choice. I doubt the car would even be aware of the bomb, or what a bomb is, or why its bad.

    4. Re:Drivers already have variable ethics by Anonymous Coward · · Score: 1

      In fact, it's all bullshit. Safety systems are deliberately designed simply so that they can validated. No system that could have variable ethics will make it through the regulators, no should they.

    5. Re:Drivers already have variable ethics by Anonymous Coward · · Score: 0

      Bombs are shit logic.

      Even today if any terrorist really wants, he can watch a person's routine and stick a packet on the underside of the car and time the explosive to go off at the stadium or whatever. It is a move shown in many Hollywood movies. So even the dumbest of the potential terrorists already know this.

      Now you could make a definite case for shutting down Hollywood because they are the ones actually giving ideas in detail to potential terrorists. But the FBI does not object to violent action movies or ones with new plots.

      FBI Y U NO SOO HOLLYWOOD ?!?!

  5. Insurance rates by olsmeister · · Score: 3, Interesting

    I wonder whether your insurance company would demand to know how you have set your car, and adjust your rates accordingly?

    1. Re:Insurance rates by Twinbee · · Score: 2, Insightful

      Car insurance companies will die off when car AI becomes mainstream.

      --
      Why OpalCalc is the best Windows calc
    2. Re:Insurance rates by Anonymous Coward · · Score: 1

      Not as long as your finance company requires that you insure it.

    3. Re:Insurance rates by Anonymous Coward · · Score: 0

      +5 funny. One of the funniest jokes I've seen all day.

    4. Re:Insurance rates by Lunix+Nutcase · · Score: 4, Insightful

      Hahahahahahahahaha. No, they won't. They will keep themselves around through lobbying efforts.

    5. Re:Insurance rates by Lunix+Nutcase · · Score: 1

      And the government requires it to be on the road.

    6. Re:Insurance rates by Anonymous Coward · · Score: 0

      Insurance is a highly competitive industry. If accident rates go down competition will force rates close to $0.

    7. Re:Insurance rates by king+neckbeard · · Score: 1

      Is it? It's probably more competitive than the ISP market, but it seems like there are mostly just a few consolidated companies that handle most everything.

      --
      This is my signature. There are many like it, but this one is mine.
    8. Re:Insurance rates by Lunix+Nutcase · · Score: 1

      Do unicorns and flying pigs exist in that fantasy world, too?

    9. Re:Insurance rates by Shimbo · · Score: 1

      Isn't that much the same as the ISP market then? Lots of choice but lots of consolidation happening behind the scenes.

    10. Re:Insurance rates by Twinbee · · Score: 1

      I'm so sorry that there will be hardly any accidents, and so the number of claims will nose-dive. It's tragic, but you can't stop progress.

      --
      Why OpalCalc is the best Windows calc
    11. Re:Insurance rates by ColdWetDog · · Score: 2

      Insurance is a highly competitive industry. If accident rates go down competition will force rates close to $0.

      You perhaps might see collision rates go down but there are many other liabilities that one typically insures a vehicle for - weather related damage, medical, liability and others (usually bundled under the rubric of 'comprehensive').

      You are also assuming, without any data, that the future Johnny Cab will never get itself into an accident. I'm not so sure I would make such a bold claim.

      --
      Faster! Faster! Faster would be better!
    12. Re:Insurance rates by Twinbee · · Score: 2

      Yeah, just like dealers will lobby hard against companies like Tesla. It won't be enough, they'll die off too.

      --
      Why OpalCalc is the best Windows calc
    13. Re:Insurance rates by Lunix+Nutcase · · Score: 1

      Accidents and injuries have been decreasing for more than a decade. And yet you're still required to have insurance both by financing companies and state governments.

      There is absolutely zero reason to believe that finance companies and state governments will not still require insurance even when cars are automated.

    14. Re:Insurance rates by CanHasDIY · · Score: 1, Insightful

      Car insurance companies will die off when car AI becomes mainstream.

      Kind of like how representative democracy died off when we all got smart phones, right?

      No, dude, sadly middlemen will always exist, adding no value to things but taking your money anyway.

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
    15. Re:Insurance rates by CanHasDIY · · Score: 1

      Do unicorns and flying pigs exist in that fantasy world, too?

      I'm so sorry that there will be hardly any accidents, and so the number of claims will nose-dive. It's tragic, but you can't stop progress.

      So... yes, then.

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
    16. Re:Insurance rates by Lunix+Nutcase · · Score: 1

      Why would finance companies and state governments not still require you to carry insurance? No finance company is going to give you a car loan and not require you to insure it. Your post is hilariously naïve.

      Oh and the insurance companies are hugely greater in size than car dealerships. Car dealers are chumps in comparison.

    17. Re:Insurance rates by Twinbee · · Score: 1

      If it still exists, it will be next to nothing. Being next to nothing means that there's no benefit to anyone, unless you like doing unnecessary paperwork. Which granted, most business seem to love a lot.

      --
      Why OpalCalc is the best Windows calc
    18. Re:Insurance rates by grahamsz · · Score: 4, Interesting

      More likely that your insurance company would enforce the settings on your car and require that you pay them extra if you'd like the car to value your life over other lives.

      With fast networks it's even possible that the insurance companies could bid on outcomes as the accident was happening. Theoretically my insurer could throw my car into a ditch to avoid damage to a bmw coming the other way.

    19. Re:Insurance rates by Lunix+Nutcase · · Score: 1

      If you were financing car loans would you do so without requiring it be insured? That would be an extremely dumb thing not to do.

    20. Re:Insurance rates by Twinbee · · Score: 1

      Send my best wishes then to the middlemen who WON'T exist when Tesla Motors and companies like them eventually sell direct.

      --
      Why OpalCalc is the best Windows calc
    21. Re:Insurance rates by Lunix+Nutcase · · Score: 1

      Way to not address my points. You've simply repeated your assertion. Why would any bank finance a car loan without insurance? That would be monumentally stupid.

    22. Re:Insurance rates by Jason+Levine · · Score: 3, Insightful

      You will still be required to have car insurance (whether because of some actual need or because of lobbying from the insurance industry). Your rates might lower a bit to give you an incentive to get a car that drives itself, but they won't plummet. Less accidents/claims will just mean that the insurance companies will wind up with more profits. Which means more money to spend lobbying the government to require auto insurance and robot cars which means more profits. Rinse. Repeat.

      --
      My sci-fi novel, Ghost Thief, is now available from Amazon.com.
    23. Re:Insurance rates by Twinbee · · Score: 1

      Maybe you've been ripped off so much by the car insurance companies that you're missing the obvious. There in principle cannot be a car insurance market if cars don't crash anymore. If the reduction in accidents is one tenth of the what is was before, then the insurance premium will be about one tenth too (all else being equal, with maximum automation). At that point, the sheer paperwork will more than cancel out any benefit gained to anyone.

      --
      Why OpalCalc is the best Windows calc
    24. Re:Insurance rates by Twinbee · · Score: 1

      Because it wouldn't be a liability to anyone anymore. Imagine zero crashes. That's an extreme, but let's assume that for the sake of argument.

      Insurance at that point would be seen as pointless, and so the government would not require insurance like the 'good ol days' (read "bad old days").

      --
      Why OpalCalc is the best Windows calc
    25. Re:Insurance rates by GameboyRMH · · Score: 1

      With fast networks it's even possible that the insurance companies could bid on outcomes as the accident was happening. Theoretically my insurer could throw my car into a ditch to avoid damage to a bmw coming the other way.

      I might get to see the first car get diverted into a schoolbus to avoid a 50-million-dollar superduperhypercar. I'll have to dress for the occasion with my best fingerless gloves and head-worn goggles.

      --
      "When information is power, privacy is freedom" - Jah-Wren Ryel
    26. Re:Insurance rates by Anonymous Coward · · Score: 0

      Not likely, rates MAY drop as self driving cars become prevalent but most states have laws forcing people to buy insurance and I'm sure that insurance companies will fight to the last to keep those laws on the books thereby guaranteeing them revenue with little risk.

    27. Re:Insurance rates by pla · · Score: 4, Informative

      There in principle cannot be a car insurance market if cars don't crash anymore.

      In the past 15 years, I have invoked my car insurance three times, and haven't had a single accident in that time.

      Insurance covers more than just liability - It covers a small rock falling from a dump-truck and breaking your windshield; it covers your car getting stolen; some policies even act as a sort of extended warranty, covering repair or replacement costs in the event of a breakdown.

      And, even with a hypothetically "perfect" driver, some accidents will still happen - Front tire blowout at 75MPH in dense traffic, deer running from the woods into the road 10ft in front of you, construction debris falling from an overpass, etc. Driverless cars will probably handle these events better than live humans do, but such events will still happen.

      All of that said, I would love for you to have it 100% correct, because I fucking loathe insurance companies, and deeply resent the government forcing me to pay them in order to drive. I just don't realistically see it happening.

    28. Re:Insurance rates by geekoid · · Score: 1

      There is more then accident insurance.

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    29. Re:Insurance rates by Twinbee · · Score: 1

      All of that said, I would love for you to have it 100% correct, because I fucking loathe insurance companies

      The vast majority of accidents are caused by bad judgment from the driver, and to a lesser extent - poorly maintained vehicles (which will be mostly resolved when EVs are mainstream anyway). It was probably originally enforced due to potentially wrecking an innocent's car (as you decide if you want to risk things if it was just your car at stake).

      Yes, okay, car insurance will still exist (contrary to my initial post), but it will be like say, buildings insurance - very low, and non-forced (people won't have to insure if they don't want to).

      --
      Why OpalCalc is the best Windows calc
    30. Re:Insurance rates by Anonymous Coward · · Score: 0

      You realize car insurance is about more than accidents, right?

    31. Re:Insurance rates by Anonymous Coward · · Score: 0

      I've never crashed my house into anyone. My mortgage still requires homeowners insurance. Solve that one, Mr. Wizard.

    32. Re:Insurance rates by CanHasDIY · · Score: 1

      Send my best wishes then to the middlemen who WON'T exist when Tesla Motors and companies like them eventually sell direct.

      Equally, send my regards to Carnac the Magnificent, since you seem capable of channeling him.

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
    33. Re:Insurance rates by Anonymous Coward · · Score: 0

      Tell that to the insurance adjuster that totalled my parked car because the parking brake cable of a truck parked overnight at the top of a hill was defective. It rolled downhill for nearly a block before slamming into my car.

      I guess in this magical land where roads aren't shit and everyone can afford a robotic car, all maintenance issues will also be a thing of the past. So, no more insurance and no more auto mechanics! Truly, the glory days are here..

    34. Re:Insurance rates by geekmux · · Score: 1

      More likely that your insurance company would enforce the settings on your car and require that you pay them extra if you'd like the car to value your life over other lives.

      With fast networks it's even possible that the insurance companies could bid on outcomes as the accident was happening. Theoretically my insurer could throw my car into a ditch to avoid damage to a bmw coming the other way.

      OK, I really don't like where this concept is going. Consider what will happen when your insurance company values the property they're insuring over the life controlling it inside. Talk about an ethical nightmare, especially when those systems are deemed exempt from any legal liability.

    35. Re:Insurance rates by linuxgurugamer · · Score: 1

      So you would rather have to have paid out-of-pocket the three times in the past 15 years for whatever happened? I noticed that you didn't say what you had claims for. Hopefully it wasn't too bad, but what would you have done if you had a huge medical bill. Let's use your example of a deer running in front of your car, while you are driving on a highway at highway speeds. First, your car would be totaled. No if's, and's or but's about it. The cost to replace all the airbags by itself would cause the car to be totaled. Now, what if in spite of the airbags, you lost control of the car and impacted something pretty immovable, say, an overpass. We will assume you will survive, but have huge medical bills. Over 6 months, you could concievable incur medical bills of over $400,000, depending on the extent of injuries. Now, do you have/want to pay all that money, or have the insurance company pay that money? If you are paying $1000/year for the insurance, it would take you 400 years to recoup what the insurance company will be paying out. Plug in your own numbers. I do not like driving in states which don't require insurance. You may consider me stupid, but I'd rather share the risk with the other insured people/cars rather than risk the financial loss myself.

    36. Re:Insurance rates by amorsen · · Score: 1

      Why would any bank finance a car loan without insurance? That would be monumentally stupid.

      The bank can just insure the car themselves and add the cost to the interest rate they charge. However, most banks are likely large enough that self-insurance is the best option for them.

      --
      Finally! A year of moderation! Ready for 2019?
    37. Re:Insurance rates by CanHasDIY · · Score: 1

      Because it wouldn't be a liability to anyone anymore. Imagine zero crashes. That's an extreme, but let's assume that for the sake of argument.

      Sure, and next we can talk about economics assuming that there really is such a thing as a free market.

      Or, let's not, since "most unlikely circumstance possible" is a really shitty basis for the sake of any argument.

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
    38. Re:Insurance rates by Anonymous Coward · · Score: 0

      Get a Lawyer and sue the guy who didnt maintain his vehicle.

    39. Re:Insurance rates by Richy_T · · Score: 1

      Here's the problem with mandated insurance... People still drive without it anyway. Now your insurance still has to cover uninsured drivers but because it's mandated, the insurance companies have you (the law-abiding driver) by the short and curlies and your rates go up. Happens every time and is a fine example of perverse incentives.

      Of course, automated cars that won't even get moving unless they can check they're insured might fix that. But there may be other problems that arise from that.

    40. Re:Insurance rates by Anonymous Coward · · Score: 0

      I am so glad driverless cars will eliminate hail, lightning, bridge collapse, vandalism, and everything else that could possibly damage a car that is not the direct fault of the driver of that car.

    41. Re:Insurance rates by geekoid · · Score: 1

      Fewer people drive without insurance when its mandatory.

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    42. Re:Insurance rates by pla · · Score: 1

      So you would rather have to have paid out-of-pocket the three times in the past 15 years for whatever happened?

      In that 15 years, I paid somewhere on the order of $14-15k for insurance that paid me back less than $4k total. Worst investment ever. Hell, until I replaced my previous car recently, I paid more per year than the total KBB value of my car.


      Now, do you have/want to pay all that money, or have the insurance company pay that money?

      I would, grudgingly, put medical insurance in a different category than car insurance. Not to say I approve of mandatory medical insurance, and I still loathe the the insurance companies (if for a different reason, for having created an artificially hyperinflated market thanks to most people having a complete mental disconnect between the idea of treatment actually costing $400k vs paying $3000 or so out-of-pocket). I will accept, though, that we all eventually die and our last few years cost a small fortune in healthcare. We do not, however, all eventually get into car accidents with damages adding up to dozens of times the price of my car.

      Or as you so aptly put it, "it would take you 400 years to recoup what the insurance company will be paying out" - The flip side of which means that such an accident happens at most once every ten driving lifetimes, and realistically far less than that (since that would assume 100% of all premiums paid went solely to that rare huge medical bill). Big scary numbers look big and scary, but that doesn't make it any more rational to live as though it will happen to me.

      As for the potential liability issues, consider me a biiiig fan of "no fault" states - For that matter, the real topic at hand (driverless cars) will likely eventually force every state to go no-fault, since the question of who bears responsibility for an accident becomes effectively a battle between auto manufacturers, not passengers.


      I do not like driving in states which don't require insurance

      No worries! Your insurance company already charges you for "uninsured motorist" coverage, even though such things shouldn't theoretically exist in states that mandate insurance. How thoughtful of them to make sure you can rest easy!

    43. Re:Insurance rates by mjwx · · Score: 1

      All of that said, I would love for you to have it 100% correct, because I fucking loathe insurance companies

      poorly maintained vehicles (which will be mostly resolved when EVs are mainstream anyway).

      EV's still have bad tyres, brake pads, callipers, rotors, wheels, CV Joints, suspension, drive trains and so forth. Very few accidents are a caused by bad engines. The saying that EV's only have one moving part is a misnomer, they have one moving part in the engine, the most of the car is still the same as an ICE powered version.

      Bad tyres (bald and/or low quality) and brakes (worn pads/rotors) are the biggest cause of accidents outside of driver error. Inside of driver error they help to make it worse. So todays Top Tip, dont cheap out on tyres and brakes.

      --
      Calling someone a "hater" only means you can not rationally rebut their argument.
    44. Re:Insurance rates by TubeSteak · · Score: 1

      I fucking loathe insurance companies, and deeply resent the government forcing me to pay them in order to drive.

      In some states you can self insure by posting cash or a bond.
      But if anything happens, you have unlimited personal liability.

      Insurance isn't about you, it's about the people you might hurt.
      It's a necessary evil, though I'd support an Obamacare style mandate for auto insurance companies to pay out a minimum of premiums or rebate the balance back to their customers.

      --
      [Fuck Beta]
      o0t!
    45. Re:Insurance rates by sl149q · · Score: 1

      It may end up with government run no fault insurance, possibly funded by (for example) fuel taxes (drive more, higher risk, pay more.)

      If you are in an accident, you are covered. Since, in theory (if all the vehicles are autonomous) there IS no fault, this makes a lot of sense.

      The usual complaint is that no fault insurance (especially government run) usually also means capped settlements. Especially from the legal industry who make their living pursuing big payouts.

    46. Re:Insurance rates by Twinbee · · Score: 1

      You hardly ever have to worry about brakes/pads because the Model S's regen is used most of the time for braking.

      --
      Why OpalCalc is the best Windows calc
    47. Re:Insurance rates by Anonymous Coward · · Score: 0

      You're right. A few people drive without insurance even when mandated. But the vast majority of people are law-abiding and will have the insurance.

      If someone is driving without insurance when required, they risk losing their car if pulled over, if not even more dire punishment

    48. Re:Insurance rates by Richy_T · · Score: 1

      And yet still your costs go up. That's the point. Sure you get the warm fuzzies but objectively, you're worse off.

    49. Re:Insurance rates by Richy_T · · Score: 1

      And yet still they do and still your costs go up.

    50. Re:Insurance rates by david_thornley · · Score: 1

      If accident rates go down, so will rates. That's true.

      However, there is always a risk when a vehicle is moving. It may suffer from mechanical failure, for example. The "driver" causes this risk by having the car go somewhere. There will be requirements for insurance, but it'll be a lot cheaper.

      --
      "When you have eliminated the unacceptable, whatever is left, however improbable, must be the truthiness" - Holmes
    51. Re:Insurance rates by david_thornley · · Score: 1

      Okay, if we take an impossible hypothetical situation, we can arrive at a solution that doesn't apply to the real world. Since crashes are not going to vanish, and there will still be damage and injuries, the need for insurance will not go away.

      --
      "When you have eliminated the unacceptable, whatever is left, however improbable, must be the truthiness" - Holmes
    52. Re:Insurance rates by david_thornley · · Score: 1

      The guy who didn't maintain his vehicle likely doesn't have enough money to replace your car which he totaled, and would spend what money he does have defending the lawsuit. Lawsuits are not the answer for everything.

      --
      "When you have eliminated the unacceptable, whatever is left, however improbable, must be the truthiness" - Holmes
    53. Re:Insurance rates by Twinbee · · Score: 1

      But crashes will get to a point so low, that it may as well be zero. Yes people will steal cars, and random rocks may destroy windscreens and tires, but insurance will be much lower - and here's the important bit - optional - unlike today.

      --
      Why OpalCalc is the best Windows calc
    54. Re:Insurance rates by david_thornley · · Score: 1

      There will be very few crashes. I really, really doubt there will be none, due to bad maintenance or unexpected bad road conditions and such. Whenever you've got even a small chance of crashing into another car or even a pedestrian and messing up people's lives, the state will require insurance. At that point, it won't be expensive.

      --
      "When you have eliminated the unacceptable, whatever is left, however improbable, must be the truthiness" - Holmes
    55. Re:Insurance rates by RyoShin · · Score: 1

      Once self-driving cars reach critical mass, I think that it will become uncommon to actually own a vehicle (why own something and deal with maintenance/insurance/etc. when it will sit around doing nothing for 10-20 hours a day?). Instead you'll be part of some sort of "Auto Club" or other, where you pay a monthly fee and are able to summon a car (the number of times and priority you get will depend on the level of service you purchase). Insurance companies will then charge these guys, who will pass on the cost to members. If someone manually controls their rented car (if even possible), the car would log this and they would likely pay an extra fee due to insurance premiums.

      Until that point we'll have a lot of schisms with insurance and self-driving cars. This will probably be much like the early 20th century when cars were gaining broad adoption and were sharing the road 50/50 with horse-drawn wagons and so forth. Was there horse or auto insurance back then? If so, does anyone know how the companies reacted to the changing road?

  6. "Philosophically, this opens up an interesting deb by kruach+aum · · Score: 0

    ate" -- Not at all! In fact, it does the exact opposite. By implementing every possible position on the software level and allowing the vehicle's owner to choose, no one needs to debate anything. A utilitarian can choose "minimize overall damage", a randroid "protect me at all costs", and a lawyer "minimize liability", without any of them having to agree about anything. I wish all philosophical debates were this easy to solve.

  7. Blue Screen of Death... by bobbied · · Score: 4, Funny

    BSOD starts to take on a whole new meaning..

    As does, crash dump, interrupt trigger, dirty block and System Panic...

    --
    "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
    1. Re:Blue Screen of Death... by canadiannomad · · Score: 1
      --
      Hmm, the humour and sarcasm seem to have been be lost on you.
    2. Re:Blue Screen of Death... by jpvlsmv · · Score: 4, Funny
      You're right, officer, Clippy should not have been driving.

      Now, what to do when my Explorer crashes...

      Click on the Start button, go to "All Programs", then go to "Brakes", right-click on the "Apply Brakes" button, and choose "Run as Administrator". After the 15-second splash screen (now with Ads by Bing), choose "Decelerate Safely".

  8. "oft-clashing ideas of morality vs. liability." by Anonymous Coward · · Score: 1

    Am I the only one who expected it to read "oft-clashing ideas of morality vs. legality" ?

  9. Labor costs by Anonymous Coward · · Score: 0

    Right now, impressionable youth from 3rd world countries are cheaper than robots. There won't be much worry about this for a while. A rust-bucket Honda and some dumb kid are going to be a lot cheaper than the latest Google-Tesla joint venture product.

    We have plenty of time to think about it before Is-lame-oh terrorists are using them.

    1. Re:Labor costs by ColdWetDog · · Score: 1

      Right now, impressionable youth from 3rd world countries are cheaper than robots. There won't be much worry about this for a while. A rust-bucket Honda and some dumb kid are going to be a lot cheaper than the latest Google-Tesla joint venture product.

      We have plenty of time to think about it before Is-lame-oh terrorists are using them.

      Except that one limiting factor in the jihad is the ability to get the starry eye idealist soon-to-be-martyr over on this side of the pond. Blowing oneself to tiny bits appears to be a hard sell to westernized folk. The concern here would be that an autonomous vehicle could alleviate that problem.

      Of course, it's not a perfect solution. You have to purchase or steal the thing which now are in rather short supply. An autonomous vehicle is going to be fairly tightly regulated once let out into the wild - one of the basic tenets is that it communicates with other vehicles and presumably some sort of central command. Driving into a crowd or a chemical factory might be frowned upon.

      Much easier to just blow up a chemical factory somewhere in New Jersey. Or start a forest fire near LA.

      But it's the FBI's task to get all paranoid and look at all potential possibilities to ensure our ultimate freedom. USA! USA!

      --
      Faster! Faster! Faster would be better!
    2. Re:Labor costs by canadiannomad · · Score: 2

      You get less human rights complaints when you let the children(or entire populations) stave by using robots for your cheap labour instead of paying them a pittance. :(

      --
      Hmm, the humour and sarcasm seem to have been be lost on you.
    3. Re:Labor costs by Anonymous Coward · · Score: 0

      Except that one limiting factor in the jihad is the ability to get the starry eye idealist soon-to-be-martyr over on this side of the pond. Blowing oneself to tiny bits appears to be a hard sell to westernized folk. The concern here would be that an autonomous vehicle could alleviate that problem

      Ummm.... I seem to recall a certain incident concerning 19 such people. They weren't even kids, and they were here long enough to go through flight training. They told us not to forget that incident. Do you remember it?

  10. We will need liability laws before we let them hit by Joe_Dragon · · Score: 1

    We will need liability laws before we let them hit the road without any robot drivers.

    We can't let them use EULA's even if there are some it will very hard to say that an car crash victim said yes to one much less them standing up in a criminal court.

  11. Scare of the day by Iamthecheese · · Score: 4, Insightful

    Dear government, Please shut up bout terrorism and get out of the way of innovation. sincerely, informed citizen

    --
    If video games influenced behavior the Pac Man generation would be eating pills and running away from their problems.
    1. Re:Scare of the day by jellomizer · · Score: 1

      Exactly,
      Technology can be used for good or for evil.

      That rock that Ugg used to start a fire to keep his family warm, also worked really good at throwing at his rivals to kill them.

      --
      If something is so important that you feel the need to post it on the internet... It probably isn't that important.
    2. Re:Scare of the day by Opportunist · · Score: 2

      Ffft. Where's the kickback in that?

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    3. Re:Scare of the day by mjwalshe · · Score: 1

      Err you know that car bombs are an all American invention :-)

    4. Re:Scare of the day by geekoid · · Score: 1

      It's these agency job to look at this sort of thing. They aren't stopping innovation. They make plans, and a lot of this stuff will be inevitable.
      Autonomous cars doing driver by shooting will happen. What do we do about that? Should we have a plan? There will be people who use them to deliver bombs. Maybe we should thing about what to do? Start getting a plan together?

      You aren't informed at all. You're just a knee jerk hater.

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    5. Re:Scare of the day by geekoid · · Score: 1

      So if the came lord said: 'Lets figure out how to protect ourselves when the other cave people start throwing rocks at us' that would be bad?

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    6. Re:Scare of the day by russotto · · Score: 1

      It's a BOMB (known to antiquity) in a CAR (a German invention). You can't just put the two together and claim it's a new invention... what is this, the patent office?

    7. Re:Scare of the day by mjwalshe · · Score: 1

      but the use of vehicle born bombs is American goto to wall street and you can se the evidence of that as the NYSE still has the marks from an attack in the 20's

  12. ohnonotagain by cellocgw · · Score: 1

    This exact topic has been on /. several times. I will not be in the least surprised to see the exact same collection of wildass FUD claims in the comments.

    --
    https://app.box.com/WitthoftResume Code: https://github.com/cellocgw
  13. Been discussed before by gurps_npc · · Score: 2, Insightful
    Not news, not interesting.

    1) The cars will most likely be set by the company that sold it - with few if any modifications legally allowable by the owner.

    2) Most likely ALL cars will be told to be mostly selfish, on the principle that they can not predict what someone else will do, and in an attempt to save an innocent pedestrian might in fact end up killing them. The article has the gall to believe the cars will have FAR greater predictive power than they will most likely have.

    3) A human drivable car with a bomb and a timer in it is almost as deadly as a car that can drive into x location and explode is. The capability of moving the car another 10 feet or so into the crowd, as opposed to exploding on the street is NOT a significant difference, given a large explosion.

    4) The cars will be so trackable and with the kind of active, real time security monitoring, that we will know who programmed it and when, probably before the bomb goes off. These are expensive, large devices that by their very nature will be wired into a complex network. It is more likely the cars will turn around and follow the idiot, all the time it's speakers screaming out "ARREST THAT GUY HE PUT A BOMB IN ME!"

    --
    excitingthingstodo.blogspot.com
    1. Re:Been discussed before by Iamthecheese · · Score: 1

      I agree that the article is a waste of time but you're a little off with point number 3: There are places one can drive but not park where a bomb would be more secure. That said it's not a large change to simply disallow driverless and passengerless cars where security is a problem.

      --
      If video games influenced behavior the Pac Man generation would be eating pills and running away from their problems.
    2. Re:Been discussed before by Anonymous Coward · · Score: 2, Informative

      2) Most likely ALL cars will be told to be mostly selfish, on the principle that they can not predict what someone else will do, and in an attempt to save an innocent pedestrian might in fact end up killing them. The article has the gall to believe the cars will have FAR greater predictive power than they will most likely have.

      This is a thing that is starting to irritate me. This is a piece from the director of the "Ethics + Emerging Sciences Group"
      Recently we have seen writeups about the ethics of automate from psychologists and philosophers that are completely clueless to what laws are already in place and what best practices are when it comes to automation.
      They go in with the assumption that a machine is conscious and will make conscious decisions, ignoring that it it impossible to get anything remotely resembling an AI through the certification process needed for safety critical machinery.

    3. Re:Been discussed before by RobinH · · Score: 1

      However, what's particularly weird, when I hear about software-based automotive recalls like the Toyota accelerator stack overflow bug, is that automotive companies don't seem to have to be certified to anything near the machine safeguarding standards we use to certify factory-floor automation. Nowadays a piece of equipment on the plant floor is pretty much provably safe to operate assuming you don't start disassembling it with a screwdriver. I don't see any such methodology being applied to vehicle control systems.

      --
      "I have never let my schooling interfere with my education." - Mark Twain
    4. Re:Been discussed before by bluefoxlucid · · Score: 2

      Point 4 will never happen. A little duct tape over the security sensor. Sealed briefcase bomb.

      The rest of this is stupid. We have already put RC receivers into regular cars and used a Radio Shack car controller to drive. They did that on Blues Brothers 2000, and probably The Simpsons. We have real RC car races. You just need a Pringles can, a wire, and a car.

    5. Re:Been discussed before by HornWumpus · · Score: 1

      What? An idiot can always reach around safety gates. A slightly less stupid one can disable the gate switch and get himself killed.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    6. Re:Been discussed before by gurps_npc · · Score: 1
      Sealing the briefcase doesn't stop drug sniffing dogs.

      Nor will it stop a simple chemical sensor designed to both detect carbon monoxide, explosive residue and the absence of a flow of fresh air.

      Besides, I really like the idea of some hapless idiot wandering around being followed by a car screaming "HE PUT A BOMB IN ME! It's enough to make me ROFL

      --
      excitingthingstodo.blogspot.com
    7. Re:Been discussed before by funwithBSD · · Score: 1

      Too complicated.

      The more the car costs, the more evil it can do... after all, you can afford it.

      --
      Never answer an anonymous letter. - Yogi Berra
    8. Re:Been discussed before by bluefoxlucid · · Score: 1

      Sealed briefcase stops drug sniffing dog noses. Sealed polypropylene bags stop permeation of marijuana and cocaine; the residue on the outside from your handling of the bags, however....

      Also, a detector to detect that a certain object should have airflow, but doesn't? Without holding every object up for screening?

    9. Re:Been discussed before by DM9290 · · Score: 1

      However, what's particularly weird, when I hear about software-based automotive recalls like the Toyota accelerator stack overflow bug, is that automotive companies don't seem to have to be certified to anything near the machine safeguarding standards we use to certify factory-floor automation. Nowadays a piece of equipment on the plant floor is pretty much provably safe to operate assuming you don't start disassembling it with a screwdriver. I don't see any such methodology being applied to vehicle control systems.

      google : Motor Industry Software Reliability Association

      --
      No one has a right to their *own* opinion. They have a right to the TRUTH.
  14. Drones and robotic cars by Anonymous Coward · · Score: 1

    Well, now soon everybody is going to have access to drones and robotic cars as the new guns the same as the middle ages crossbows were a game changer.

    May be they should have considered of the consequences of their extrajudicial drone assasinations, tortures and such kind of petty things.

  15. What about maintenance settings? by Joe_Dragon · · Score: 1

    What about maintenance settings?

    We can't let the car makers set them to only go to the dealer for any and all work.

    We can't can't jet jacks low cost auto cars push the limits of maintenance to being unsafe.

    1. Re:What about maintenance settings? by GrumpySteen · · Score: 1

      We can't can't jet jacks low cost auto cars push the limits of maintenance to being unsafe.

      That made lots of sense.

  16. Automation, remote controls already exist by i+kan+reed · · Score: 5, Insightful

    Let's skip "car" because I can, in theory, attach enough explosives(and shrapnel) to kill a large number of people to a simple homemade quadrotor, run with open source software, give it a dead-reckoning path and fire and forget from a relatively inconspicuous location. Multiple simultaneously, if I have the amount of resources a car bomb would require.

    Automation is here. Being paranoid about one particular application of it won't help anyone.

    1. Re:Automation, remote controls already exist by bobbied · · Score: 1

      Automation is here. Being paranoid about one particular application of it won't help anyone.

      Yea, what you say is true, but it really doesn't make good news to talk about things that way. At least until somebody actually does it, then we get weeks of wall to wall "breaking news" and "Alert" coverage and the hosts of MSNBC will pontificate about how we should have known this was going to happen and stopped it.

      --
      "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
    2. Re:Automation, remote controls already exist by idontgno · · Score: 1

      Yea, what you say is true, but it really doesn't make good news to talk about things that way. At least until somebody actually does it, then we get weeks of wall to wall "breaking news" and "Alert" coverage and the hosts of MSNBC will pontificate about how we should have known this was going to happen and stopped it.

      If your point is that the talking heads always talk about everything but the threat which will actually materialize, true. Not a deep insight, but true.

      OMG ROBOT BOMB CARZ is what's playing up on stage on tonight's episode of Security Masterpiece Theatre.

      Quadcopter grenade bombers is what will actually happen. Unless it's something even more lo-tek, like moar pressure cookers.

      --
      Welcome to the Panopticon. Used to be a prison, now it's your home.
    3. Re:Automation, remote controls already exist by i+kan+reed · · Score: 2

      This is your reminder that anyone with a post-highschool grounding in chemistry could make pipebombs with no difficulty. The ingredients for a self-oxidizing agent could be gotten at a hardware store. They aren't common in the US in spite of that.

      There won't be an "epidemic" of automated bombings, because being a bomber takes a cause you personally see as being more important than not being a murderer. The right mixture of basically competent, ideologically dedicated, and morally flexible just isn't that common.

      That's part of why suicide attacks are practically synonymous with terrorism: people have to be amazingly deep into an ideology to consider it.

    4. Re:Automation, remote controls already exist by houghi · · Score: 1

      Or they can just park the car somewhere and blow up whatever they want. Or just watch the news and see that you can blow up busses, trains, metros and a lot more with a backpack.

      Why maker it complicated if easy is possible as well?

      And terrorizing the public, which is the goal of terrorism, ther governement is doing a great job. No need to outsource that.

      --
      Don't fight for your country, if your country does not fight for you.
    5. Re:Automation, remote controls already exist by funwithBSD · · Score: 1

      And it exploding from above, aka "air-burst" and will do far more damage pound for pound

      Although, at this time the lift capacity of even a small fleet of quad rotors would not be more than you could stuff in an SUV or box van.

      --
      Never answer an anonymous letter. - Yogi Berra
    6. Re:Automation, remote controls already exist by drinkypoo · · Score: 1

      Automation is here. Being paranoid about one particular application of it won't help anyone.

      It's scary because cars are already deadly and already everywhere. If you give them inadequate security (got) and an internet connection (some have, some are getting) and oh, also make them self-driving (on the way) then their very ubiquity makes the threat realistic. There's not that many people out there with a nice quadcopter capable of long-range flight who also have possession of explosives or even skill to credibly make same without blowing themselves up and you can bet that most of them are being monitored. But self-driving cars will soon be absolutely everywhere...

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    7. Re:Automation, remote controls already exist by sl149q · · Score: 1

      We'll need some new laws that make using unmanned vehicles (cars, planes, quadracopters) to commit any crime an extra N years in jail.

  17. Re:"Philosophically, this opens up an interesting by medv4380 · · Score: 1

    Isn't minimize overall damage, and minimize liability usually equal. I can't think of one where they wouldn't be off hand. Anything greater than minimized damage would be increased liability.

  18. Will a robo car be able to break the law to save by Joe_Dragon · · Score: 1

    Will a robo car be able to break the law to save some one from death / injury?

  19. Not so fast by Moof123 · · Score: 2

    It sure seems like such selectable ethics concerns are kind of jumping the gun. Regulatory behavior is going to clamp down on such options faster than you can utter "Engage!". Personally I would want my autonomous car to be designed with the most basic "don't get in a crash" goal only, as I suspect regulators will as well.

    Far more important is the idea that we will have at least an order of magnitude or two increase in the amount of code running a car. If Toyota had trouble with the darn throttle (replacing the function of a cable with a few sensors and a bunch of code), how can we trust that car companies will be able to manage a code base this big without frequent catastrophe? Adding extra complexity to tweak the "ethics" of the car just sounds like guilding the lilly, which increases the opportunities for bugs to creep in.

    1. Re:Not so fast by Joe_Dragon · · Score: 1

      even in a big Regulatory system with most basic "don't get in a crash" you may end up in a place where it needs to pick from a choice of crash choices even ones like may do damage but low chance of injury vs say try a move that may have a 5% chance of being crash free.

    2. Re:Not so fast by jopsen · · Score: 1

      even in a big Regulatory system with most basic "don't get in a crash" you may end up in a place where it needs to pick from a choice of crash choices even ones like may do damage but low chance of injury vs say try a move that may have a 5% chance of being crash free.

      This is not going to happen if the first or second generation car... And then, if you set your car to "save my life above all else", then you'll probably get on hell of beating in court when your car put the other guy in a wheelchair to avoid you getting a little scratch...

      Either way, this is not going to happen, and if it does, let's deal with it then, for now this is just American paranoia as usual.

  20. Philosophy Settings by timrod · · Score: 5, Funny

    I, for one, cannot wait for the day when I can set my car's logic system to different ethical settings, sorted by philosopher. For instance, you can set your car to "Jeremy Bentham", which will automatically choose whoever looks less useful to ram into when in a crash situation. You could also set it to "Plato", which will cause the car to ram into whoever appears less educated (just hope it doesn't happen to be you).

    Just make sure you don't set the car to "Nietzsche".

    1. Re:Philosophy Settings by Rob+Riggs · · Score: 3, Funny

      I'm looking forward to the Ayn Rand setting. "Me first!!"

      --
      the growth in cynicism and rebellion has not been without cause
    2. Re:Philosophy Settings by AmiMoJo · · Score: 1

      You will never get these options I'm afraid. All manufacturers will simply program their cars to avoid accidents as far as possible, and in the event that one is unavoidable simply try to stop moving as quickly as possible. No selecting targets, no deciding who to save, just brake as hard as possible if there is no other option.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    3. Re:Philosophy Settings by Anonymous Coward · · Score: 0

      IJust make sure you don't set the car to "Nietzsche".

      Why not? sounds like the best seting...

    4. Re:Philosophy Settings by Anonymous Coward · · Score: 0

      Yep. These ethics discussions are kind of fun, but unrelated to how autonomous vehicles actually work.

    5. Re:Philosophy Settings by d34thm0nk3y · · Score: 3, Informative

      I, for one, cannot wait for the day when I can set my car's logic system to different ethical settings, sorted by philosopher.

      I just tried the Plato setting and now I'm stuck in a cave. Thanks Joe!

  21. MUCH easier. by khasim · · Score: 3, Interesting

    From TFA:

    Do you remember that day when you lost your mind? You aimed your car at five random people down the road.

    WTF?!? That makes no sense.

    Thankfully, your autonomous car saved their lives by grabbing the wheel from you and swerving to the right.

    Again, WTF?!? Who would design a machine that would take control away from a person TO HIT AN OBSTACLE? That's a mess of legal responsibility.

    This scene, of course, is based on the infamous "trolley problem" that many folks are now talking about in AI ethics.

    No. No they are not. The only "many folks" who are talking about it are people who have no concept of what it takes to program a car.

    Or legal liability.

    Itâ(TM)s a plausible scene, since even cars today have crash-avoidance features: some can brake by themselves to avoid collisions, and others can change lanes too.

    No, it is not "plausible". Not at all. You are speculating on a system that would be able to correctly identify ALL THE OBJECTS IN THE AREA and that is never going to happen.

    Wired is being stupid in TFA.

    1. Re:MUCH easier. by Qzukk · · Score: 4, Insightful

      You are speculating on a system that would be able to correctly identify ALL THE OBJECTS IN THE AREA and that is never going to happen.

      It doesn't have to identify all the objects in the area, it simply has to not hit them.

      --
      If I have been able to see further than others, it is because I bought a pair of binoculars.
    2. Re:MUCH easier. by khasim · · Score: 2

      It doesn't have to identify all the objects in the area, it simply has to not hit them.

      Which is an order of magnitude EASIER TO PROGRAM.

      And computers can recognize an obstacle and brake faster than a person can.

      And that is why autonomous cars will NEVER be programmed with a "choice" to hit person X in order to avoid hitting person A.

      So the premise of TFA is flawed.

    3. Re:MUCH easier. by Anonymous Coward · · Score: 0

      The car should be able to determine that, at its present speed, performance, and local conditions will not permit stopping safely, and slow the BEEP down to where it falls within safe stopping distance to everything. If there is no safe escape route, it should not be moving. People sorta kinda do this, but can easily get distracted etc.

    4. Re:MUCH easier. by Shoten · · Score: 3, Insightful

      You are speculating on a system that would be able to correctly identify ALL THE OBJECTS IN THE AREA and that is never going to happen.

      It doesn't have to identify all the objects in the area, it simply has to not hit them.

      Actually, since the whole question of TFA is about ethical choices, it does have to identify them. It can't view a trash can as being equal to a child pedestrian, for example. It will have to see the difference between a dumpster (hit it, nobody inside dies) and another car (hit it, someone inside it may die). It may even need to weigh the potential occupancy of other vehicles...a bus is likely to hold more people than a scooter.

      The question at its heart is not about object avoidance in the article...it's about choices between objects. And that requires identification.

      --

      For your security, this post has been encrypted with ROT-13, twice.
    5. Re:MUCH easier. by Anonymous Coward · · Score: 1

      The car is going down a bridge with no railing.
      Foot traffic is not permitted on the bridge with signs posted.
      The bridge is so narrow that the car takes up 100% of the road.
      The bridge is one-way.
      The surface is slick and you're unable to break in time.
      Some pedestrians are illegally trespassing on the bridge.
      Should the vehicle hit the pedestrians, which will no doubt kill them, or should the vehicle go off the edge killing the "driver"?

    6. Re:MUCH easier. by Anonymous Coward · · Score: 0

      I meant brake.

    7. Re:MUCH easier. by Anonymous Coward · · Score: 1

      It's still a false question. Suppose the car is in such a trolley situation and makes the ethically wrong choice, according to your favorite ethical system. An engineer is tasked with fixing the problem. The engineer fixes it by making sure the car takes steps to avoid even being placed in the position in the first place. Essentially, the car had already made the ethically wrong choice by getting into such a position. Even if it's a child unexpectedly jaywalking, a car can recognize that objects on the side of the road may move into its path at a reasonable speed and make sure that it has an acceptable path, even if that means slowing down. That's why self-driving cars drive in the most boring manner possible.

    8. Re:MUCH easier. by flargleblarg · · Score: 1

      And that is why autonomous cars will NEVER be programmed with a "choice" to hit person X in order to avoid hitting person A.

      I completely, totally, utterly, and vehemently disagree with you on that.

      Given a choice, I think autonomous cars at some point WILL be programmed with such a choice. For example, hitting an elderly person in order to avoid hitting a small child.

    9. Re:MUCH easier. by khasim · · Score: 3, Insightful

      Given a choice, I think autonomous cars at some point WILL be programmed with such a choice. For example, hitting an elderly person in order to avoid hitting a small child.

      Congratulations. Your product just injured Senator Somebody in order to avoid hitting a Betsy-wetsy doll.

      Senator Somebody has filed "lawsuit" against your company. It is super-effective. All your assets are belong to him.

    10. Re:MUCH easier. by FrozenToothbrush · · Score: 1

      Thank you for this post. These silly stories by news agencies are simply meant to drum up sales. These "moral delima" articles are written by people who have no idea about programming or ai. An ai will never encounter a moral delima in the same way a human does, it simply operates too fast and is aware of so much more. It is also capable of much more simultaneously - with the only limit being the processing power and sensory input. The thing people should concern themselves with is a HUMAN taking control of the computer and causing accidents.

    11. Re:MUCH easier. by FrozenToothbrush · · Score: 1

      The computer would simply choose option C - slam the brakes and steer into an immobile object in a way that protects the people in the car. Everyone lives.

    12. Re:MUCH easier. by Anonymous Coward · · Score: 0

      It doesn't have to identify all the objects in the area, it simply has to not hit them.

      Which is an order of magnitude EASIER TO PROGRAM.

      And computers can recognize an obstacle and brake faster than a person can.

      And that is why autonomous cars will NEVER be programmed with a "choice" to hit person X in order to avoid hitting person A.

      So the premise of TFA is flawed.

      Hydraulics can do amazing things to that fragile egg we call a person inside. We seem to forget the entire purpose of AI in this sense is to protect the people inside the car. Therefore, the programming has limitations to the extent that any human body does. A futuristic car that has the capability of stopping on a dime and firing those brake actuators in milliseconds doesn't do us mortals much good when we suffer a concussion or broken neck because of it.

    13. Re:MUCH easier. by Flavianoep · · Score: 1

      The car is going down a bridge with no railing. Foot traffic is not permitted on the bridge with signs posted. The bridge is so narrow that the car takes up 100% of the road. The bridge is one-way. The surface is slick and you're unable to break in time. Some pedestrians are illegally trespassing on the bridge. Should the vehicle hit the pedestrians, which will no doubt kill them, or should the vehicle go off the edge killing the "driver"?

      A bridge so narrow is the result bad engineering, it is the kind of thing we should get rid out before endeavoring further. Moreover, in this kind of situation, the robot car shall pace down because there is no guarantee that the bridge, which is proven to be so wrongly built will not get any narrower. Therefore, is this hypothetical situation there will be enough time and space to brake before hitting any pedestrian.

      Even if all of that don't follows, going off the edge is a more stupid option than braking and hitting the people, in which case braking will be the "ethical" programmed solution, and hitting the people will be a consequence of a technical inadequacy.

      --
      Linux is for people who don't mind RTFM.
    14. Re:MUCH easier. by Anonymous Coward · · Score: 0

      I'd say being pre-emptive enough to hit NOTHING is a hell of a lot more achievable than identifying N objects, determining if said objects are or contain people or objects of high value or volatility, simulating all manner of crashes with each, taking the durability of everything into account, and making a decision of which one to run into in what has already been a point of no return situation... oops. While processing, you've already slammed into something.

      I'd guess that the processing time would match or exceed human response time. Not only that, in a point of no return situation, even if the car's AI was smart enough and fast enough to pick the least significant thing to hit, somebody's probably still going to try to sue. The AI team will be chasing unicorns forever.

      If you can find a wizard who can make it work perfectly so everybody's happy, hooray... but maybe don't let it take focus away from the early avoidance tech. Fuck the ethics. Don't even let it get to the point where they are necessary. If it gets to that point anyway, still fuck the ethics, it's going to be a calamity regardless.

    15. Re:MUCH easier. by CanHasDIY · · Score: 1

      And that is why autonomous cars will NEVER be programmed with a "choice" to hit person X in order to avoid hitting person A.

      I completely, totally, utterly, and vehemently disagree with you on that.

      Given a choice, I think autonomous cars at some point WILL be programmed with such a choice. For example, hitting an elderly person in order to avoid hitting a small child.

      Which creates liability for the company that wrote the code, because it can and will be construed that the car was designed to intentionally harm someone, and it doesn't matter that it was intentionally avoiding someone else.

      Which is why I agree with OP that such a system is never going to be implemented. Not by anyone who doesn't want to be sued into oblivion.

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
    16. Re:MUCH easier. by Tuidjy · · Score: 1

      Your idea sound great on first glance, but less so on second.

      " If there is no safe escape route, it should not be moving"

      This would not work, for the simple reason that there is no way to safely move on most roads, if you assume that everyone else is a malevolent actor, waiting to slam into you as soon as you place yourself in a position from which you cannot avoid him.

      We all try not to get into situations where someone else's mistake will doom us. But we assume that most people are sane and will try to avoid accidents. Sometimes, we see that a particular car behaves dangerously, and we start planning our moves with the assumption that this particular actor may create problems. You cannot do that for everyone, or you will be paralyzed.

      An automated car will assume that the car driving in the opposite direction on that two lane road will NOT swerve at the precise wrong moment when collision will be unavoidable. And most times, it will be a good assumptions, especially if the other car is also automated, and in good working order.

      But some times, the other car will blow a left tire, or the other driver will have a heart attack and lean on the wheel. And an accident will be about to happen.

      At this point, the automated car will have to do something. It will have very little time to react - more than a human, maybe, but it will have a lot less information.

      I know that the huge object at the corner of my exit is an inflatable truck advertising for the Ford dealership, and that it is sitting on flimsy tubing frame covered with a plastic shroud. My automated car would not know that, and for it, it will be just an immobile object that it has to avoid.

      With an automated car, all objects would be of three types - immobile objects, moving objects controlled by an known automated driver, all other moving objects. (It would be nice to have a category "Safe to hit", but there would be one in the foreseeable future, unless it is mandated by law that things get labeled that way)

      When a collision is imminent, the car should try to avoid hitting anything. If it cannot, it will have a fail mode, which I bet dollars to donuts will be "Maintain heading and reduce speed". Why? Because that is the safest setting in many situations, because it is what you want everyone else to do, and because it is easy to mandate it by law. Car manufacturers and insurance companies will both want it, and guess what? They are the one who will be able to afford politicians, not the navel gazing ignoramuses like the author of the damn article.

      --
      No good deed goes unpunished...
    17. Re:MUCH easier. by Anonymous Coward · · Score: 0

      Given a choice, I think autonomous cars at some point WILL be programmed with such a choice. For example, hitting an elderly person in order to avoid hitting a small child.

      Congratulations. Your product just injured Senator Somebody in order to avoid hitting a Betsy-wetsy doll.

      Senator Somebody has filed "lawsuit" against your company. It is super-effective. All your assets are belong to him.

      Don't underestimate the sympathy a child can engender. Clearly the most balanced choice is to find a way to hit them both.

    18. Re:MUCH easier. by Lost+Race · · Score: 1

      Well said. You saved me the trouble of writing a comment not half so clear and complete.

      Ask professional drivers. These "ethical" questions are ridiculous. Avoid obstacles if possible; if not, slow down. It's better to crash into something you can't avoid as slowly as possible. It's also best to maintain control just in case the situation changes.

    19. Re:MUCH easier. by Anonymous Coward · · Score: 0

      Let's start a discussion based on the assumption that your premise is correct. The car can't identify the type of object it is dealing with, but can accurately detect where they are. The scene includes the following objects:
      A) an adult
      B) a child on a tricycle
      C) a dog
      D) an unoccupied, wind-blown object
      E) a school bus full of children
      F) an empty school bus
      G) a tanker truck full of volatile chemicals
      H) a tree
      I) a street light
      J) a concrete barrier

      The car will never be programed with the choice of which *person* to hit. But it most certainly *will* be programmed with logic to determine which 'object' or 'obstacle' to hit when avoiding them all is impossible.

      Now, let's pretend that the car detects a scenario where it can avoid N-1 of those detected objects, but no more. How do you program it to decide which object to hit when it cannot avoid them all? Remember, in this scenario, the car knows *where* the objects are, but not *what* they are.

      If the human were in control, and chose to hit the child on the trike in order to avoid causing too much damage to the car, then we'd (rightly) describe that person as despicable. But who is at fault when the self-driving car decides that it will hit objects B in order to avoid hitting obstacles A, C, D, E, F, G, H, I, & J?

      What if it's the choice between hitting obstacle B, or forcing 'object' E to make the same decision on a narrow bridge, where it might be forced to hit you, or swerve and plunge over the edge into an icy river, or a rocky chasm?

    20. Re:MUCH easier. by geekoid · · Score: 1

      The whole premise is just an attempt to make philosophy seem relevant.

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    21. Re:MUCH easier. by Jeremi · · Score: 1

      Given a choice, I think autonomous cars at some point WILL be programmed with such a choice. For example, hitting an elderly person in order to avoid hitting a small child.

      I doubt it. Any company that wants to stay in business will instead concentrate on making sure the car does not get into a position like that in the first place -- because once the car is in a "no-win" situation like that, it doesn't really matter what choice it makes, the company is going to be hit with a big lawsuit either way.

      --


      I don't care if it's 90,000 hectares. That lake was not my doing.
    22. Re:MUCH easier. by geekoid · · Score: 1

      This would not work, for the simple reason that there is no way to safely move on most roads

      their could be with autonomous cars. They will all be talking to each other so the can position so everyone one has an escape. Granted it may very well be an escape route that will only work for the computer driver. Humans being slow and unreliable meat bags.

      Also, you don't have nearly as much information as you think you do when some thing sudden happens. Most of the detail informaiton is added after the fact by your brain.

      You scenarios will be irrelevant once autonomous cars hit saturation point.

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    23. Re:MUCH easier. by Anonymous Coward · · Score: 0

      Its a plausible scene, since even cars today have crash-avoidance features: some can brake by themselves to avoid collisions, and others can change lanes too.

      No, it is not "plausible". Not at all. You are speculating on a system that would be able to correctly identify ALL THE OBJECTS IN THE AREA and that is never going to happen.

      Wired is being stupid in TFA.

      You are not mentioning the remote operation capabilities in your response to the above comment. These nightmarish robotic vehicles will be unwelcome as far as the public that won't reap the profits these companies must be wildly interested in. It is another vicious slap in the face of reasonable people like seeing the dangerous texters behind the wheels of moving vehicles. Crazily irresponsible technology.

    24. Re:MUCH easier. by Anonymous Coward · · Score: 0

      But the cars don't do that. If an obstacle is in their way they change lanes or break, nothing else. There's no run off the road to avoid someone standing in the street. It's break as soon as something might be getting in the way. They can break faster and more efficiently than humans and that is where their value is, not in swerving around things.

      Seriously, can someone point me to any video, reference, or comment from one of the companies that are actually making automatic cars that indicates they're planning on doing anything more than breaking.

      People should stop spreading this crap. The cars don't care about ethics, they just care about when to halt, when to go, and when to turn.

    25. Re:MUCH easier. by TubeSteak · · Score: 1

      Senator Somebody has filed "lawsuit" against your company. It is super-effective. All your assets are belong to him.

      Ideally you would have a shell company that owns the vehicles and leases them to you.
      It's how a lot of companies avoid liability.

      If anything happens, the shell company declares bankruptcy and moves the assets to another shell.

      --
      [Fuck Beta]
      o0t!
    26. Re:MUCH easier. by Qzukk · · Score: 1

      For example, hitting an elderly person in order to avoid hitting a small child.

      Or maybe it will just note the existence of an object moving at x m/s to the right towards the current lane while the obstacle is y meters away while establishing a list of the smoothest paths out of the infinitely many paths that would prevent the vehicle from striking any of the obstacles.

      Definitely easier than trying to determine whether the first obstacle is a baby carriage and the second obstacle is granny. Believe it or not, that light pole did NOT just "jump out in front of you" no matter how drunk you insist you aren't. Neither did granny and/or the baby.

      --
      If I have been able to see further than others, it is because I bought a pair of binoculars.
    27. Re:MUCH easier. by Qzukk · · Score: 1

      but can accurately detect where they are.

      From what range, 2 inches? Maybe if you lined up A-J across the road edge-to-edge it would have a hard time getting around them, but I'd like to believe that the sensors would be able to observe an obstruction from far enough ahead that it would be able to stop safely in this event. So instead you have A-J moving about. The laws of physics mean that nothing can simply teleport in front of us, nor can anything attain infinite acceleration, so we can detect the vehicle, child and/or dog that is moving towards our current path well before it cuts us off.

      D) would probably be the worst hazard of the lot, since being light-weight it would be able to accelerate and change direction much faster than most of the other obstacles. Worst case, having come to a complete stop to wait for it to cross the road, the vehicle is blocking the breeze that was pushing it in the first place, leaving us at a standstill.

      --
      If I have been able to see further than others, it is because I bought a pair of binoculars.
    28. Re:MUCH easier. by Anonymous Coward · · Score: 0

      it's about choices between objects.

      Or choosing to twitch the wheel hard while applying the handbreak, causing the car to spin as the chase cam kicks in and we watch in awe as the car narrowly misses the blind granny that fell off the overpass 6 feet in front of us. The camera switches to the dog's eye view as the car comes straight towards him only to suddenly flip, the dog looks up as the roof of the car passes overhead, the wheels making contact on the other side. As the wheels contact the ground the car settles back onto its suspension, kissing the baby carriage with juuuust enough force to push it back up the handicapped ramp and onto the sidewalk, then continues on it's way as everyone rejoices.

      What were we talking about again? Oh right, an arbitrary scenario where the car is somehow prevented from making any choices except for two arbitrary choices.

    29. Re:MUCH easier. by fustakrakich · · Score: 1

      Well, maybe the idea is that the vehicle can determine which obstacle is the softest and aim for that one, preserving the safety of the occupants, which should be its primary purpose, I guess.

      --
      “He’s not deformed, he’s just drunk!”
    30. Re:MUCH easier. by Anonymous Coward · · Score: 0

      This is a "NEVER" that means "not in the next few years". People are a bit dumb like that.

    31. Re:MUCH easier. by AK+Marc · · Score: 1

      This would not work, for the simple reason that there is no way to safely move on most roads, if you assume that everyone else is a malevolent actor, waiting to slam into you as soon as you place yourself in a position from which you cannot avoid him.

      You can assume rational actors. They aren't, but it's a valid assumption.

      But some times, the other car will blow a left tire, or the other driver will have a heart attack and lean on the wheel. And an accident will be about to happen.

      Unless you are on a narrow road with barriers on both sides and all lanes full, with no emergency lanes or available space at all, then your "worst case" is still trivial.

      If I were programming it, I'd program it to minimize damage. That means avoiding a head-on, and not avoiding traffic with a small speed differential. If the person beside you swerves into you, that's trivial. You hold speed and steer into them, both cars traveling foreward, and nobody injured. The human response is to swerve away from them when not safe to do so, and kill themselves by hitting a tree or wall, while the heart attack victim kills themselves on another tree ahead.

      But, for some reason, saving multiple lives and minimizing damage is undesireable because "OMFG, the autonomous car deliberately hit the other car!!!!"

      When a collision is imminent, the car should try to avoid hitting anything. If it cannot, it will have a fail mode, which I bet dollars to donuts will be "Maintain heading and reduce speed". Why? Because that is the safest setting in many situations, because it is what you want everyone else to do, and because it is easy to mandate it by law.

      It's also better than the human response in almost all situations. I know of multiple people who killed themselves avoiding animals on the road. I know of nobody who died from hitting one. The statistics aren't kept in a manner that makes it easy to see if my experience is typical or atypical.

    32. Re:MUCH easier. by david_thornley · · Score: 1

      We're looking at ethics and liability here, and in this context it is safe to assume reasonably rational actors. If I'm happily driving in my lane, and you swerve in front of me, and I can't avoid a collision, that's your fault legally and (mostly) morally. (There might have been something I could have done to reduce the damage if I were more alert, for example.)

      So, it's not just the case that the car will have to do something, but that there are ways it can operate that do not incur liability. We don't have to pass laws to create such things, because they already exist.

      --
      "When you have eliminated the unacceptable, whatever is left, however improbable, must be the truthiness" - Holmes
    33. Re:MUCH easier. by david_thornley · · Score: 1

      Not to mention that, in virtually all the situations people come up with, I'm going to hit and possibly kill somebody. I'm not superhuman. My thought processes are good enough to keep me employed in a good job, but not lightning-fast. (There are a few exceptions where I might do better. I remember once picking up on somebody's erratic movements on a corner and correctly predicting he'd dash across the street in front of me. I might notice dangerous things happening on an overpass that a car would miss. These are almost nonexistent compared to the situations I'd do worse in.) There are laws and moral principles that accept that I'm not perfect and won't always react properly to highly unusual events.

      --
      "When you have eliminated the unacceptable, whatever is left, however improbable, must be the truthiness" - Holmes
    34. Re:MUCH easier. by wikdwarlock · · Score: 1

      Even more to the point, if the car has to take into account death vs injury, it may actually "prefer" to hit people in safer vehicles. If the safe car is hit, it's 10% likely the occupants will die, whereas if the unsafe car is hit, it's 90% likely the occupant will die. Aim for the safe car to minimize the risk of killing people...

      It's like a penalty for owning a safer vehicle.

      --

      "I must not fear. Fear is the mind killer." -Bene Gesserit Litany Against Fear
    35. Re:MUCH easier. by AK+Marc · · Score: 1

      The question at its heart is not about object avoidance in the article...it's about choices between objects. And that requires identification.

      Such dichotomies are not realistic. When defined they are always spelled out like "The car is going 300 mph in a 30 mph zone, with lines of parked cars on both sides, and low visibility. A passing plane looses a set of seats, unoccupied, landing facing away from the car at a distance of 50 foot. At the same time, a kid runs out from between parked cars. The road is completely blocked by the child and the seats. What do you hit?"

      Yeah, it takes magical couches appearing from nowhere and impossible starting parameters of overly unsafe driving and such. Any "realistic" scenario leaves one clear point of action that is best for all. For 99.9%, braking within your lane is the best action. That last 0.1% could always be the wrong answer and the sum total would be much better than leaving humans in control.

    36. Re:MUCH easier. by Anonymous Coward · · Score: 0

      Dumpster divers the world over - BEWARE!

  22. Re:"Philosophically, this opens up an interesting by kruach+aum · · Score: 1

    Whoops, I should have written "harm". Read damage as "damage to human beings." I can imagine scenarios where those diverge, as can the article's summary's author.

  23. FBI: 1, Ethics: 0 by some+old+guy · · Score: 4, Insightful

    So, the FBI is already making the case for, "We need full monitoring and control intervention capability for everybody's new cars, because terrorists."

    --
    Scruting the inscrutable for over 50 years.
    1. Re:FBI: 1, Ethics: 0 by jopsen · · Score: 0

      So, the FBI is already making the case for, "We need full monitoring and control intervention capability for everybody's new cars, because terrorists."

      They can either take away your guns and high explosives... or put a dead-switch in your robot car... What is crazy Americans going to pick?

  24. Since when are people philosophically consistent? by eyelikepi · · Score: 1

    These questions really shouldn't be answered by techies.

  25. Re:"Philosophically, this opens up an interesting by Anonymous Coward · · Score: 0

    Increased harm to yourself would not increase your liability.

  26. Re:"Philosophically, this opens up an interesting by jellomizer · · Score: 1

    Being that the autonomous automobile (the Auto-Auto) will probably be released when its safety ability exceeds that of a person, and each generation will get better. Being that the algorithm may be designed to Protect Passenger, vs. Max Insurance liability, or save most amount of people. In essence really doesn't matter as they all try to avoid accidents all together. And these algorithms will only come up in a world of decreasing rare possibilities.

    I would expect protect passenger algorithm is the easier one to maintain as it has the most information available. The Insurance Calculation may be the next best, but how do you know if there are a lot of people in the bus or is it empty?

    --
    If something is so important that you feel the need to post it on the internet... It probably isn't that important.
  27. Too early for this discussion by Lose · · Score: 1

    Until a proposed system to make automated vehicles feasible on public roads in mass is proposed, developed, protocols and legal procedures released related to this come about, this is nothing but a scare topic making vague assumptions about things that aren't even a topic for development yet.

  28. Because terrorists don't blow themselves up now... by Anonymous Coward · · Score: 0

    Obviously written by an ass that has not interaction with reality. There can and will be ways to counter this... and if it was such an issue it would already be occurring. Instead, terrorists find that if they blow themselves up they get several handfuls of virgins. Hence, it's a detriment to that mentality to use a car bomb or such.

    Granted, terrorists that don't actually believe what they espouse (the higher ups who have created excuses not to blammie for Allah) might get some use out of it. Again, there will be ways to counter this then going forward. Fortunately, with driverless cars come other forms of robotic technology that will allow reduce risk to military installations, etc.

  29. Not that difficult by nine-times · · Score: 1

    Wired has an interesting article on the possibility of selectable ethical choices in robotic autonomous cars. From the article: "The way this would work is one customer may set the car (which he paid for) to jealously value his life over all others; another user may prefer that the car values all lives the same and minimizes harm overall; yet another may want to minimize legal liability and costs for herself; and other settings are possible. Philosophically, this opens up an interesting debate about the oft-clashing ideas of morality vs. liability."

    Before we allow AI on the road, we'll need to have some kind of regulation on how the AI works, and who has what level of liability. This is a debate that will need to happen, and laws will need to be made. For example, if an avoidable crash occurs due to a fault in the AI, I would assume that the manufacturer would have some level of liability. It doesn't make sense to put that responsibility on a human passenger who was using the car as directed. On the other hand, if the same crash is caused by tampering performed by the owner of the car, then it seems that the owner would be liable.

    As far as I know, even these simple laws don't explicitly exist yet.

    Patrick Lin writes about a recent FBI report that warns of the use of robot cars as terrorist and criminal threats, calling the use of weaponized robot cars "game changing." Lin explores the many ways in which robot cars could be exploited for nefarious purposes, including the fear that they could help terrorist organizations based in the Middle East carry out attacks on US soil. "And earlier this year, jihadists were calling for more car bombs in America. Thus, popular concerns about car bombs seem all too real." But Lin isn't too worried about these threats, and points out that there are far easier ways for terrorists to wreak havoc in the US.

    Normal cars also make it easier to commit terrorist acts and other crimes. So what? I mean, yes, let's consider whether we want to take special safeguards and regulations regarding AI cars, but this shouldn't be something to go crazy worrying about.

  30. Re:"Philosophically, this opens up an interesting by Rob+Riggs · · Score: 3, Interesting

    Just wait until the AI has to keep track of liability awards so that it can make the correct decision regarding minimizing liability. At some point you are going to have a stupid jury award and all the cars are just going to refuse to go anywhere because the AI's cost benefit analysis says "just stay in park".

    --
    the growth in cynicism and rebellion has not been without cause
  31. Slashdot = Gizmodo / Gawker Media by Lumpy · · Score: 0

    Oh dear god, can this be more full of wild speculation?
    They have been possible for well over 4 decades, mythbusters build them on a regular basis, one blew up so massively that it spread the car across the desert after it hit the ramp.

    Honestly I really wish the sensationalism would go away and DICE would hire people that actually knew something about the technology.

    Lastly it is a LOT easier to convince someone to blow themselves up in the name of their god than it is to build a remote control/ robotic car. This is a non-issue designed only to scare people about technology.

    --
    Do not look at laser with remaining good eye.
  32. Re:"Philosophically, this opens up an interesting by Opportunist · · Score: 4, Insightful

    No. To minimize damage, you'd have to brake when approaching a child. To minimize liability, you have to accelerate when you notice that you can't stop in time to avoid severe injury, i.e. to ensure death which is cheaper than a lifetime cripple.

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  33. Re:Will a robo car be able to break the law to sav by i+kan+reed · · Score: 1

    You seem to think that a self-driving car is a self-aware, subjective, thinking thing.

    Within this particular field, the application of "AI" algorithms gives fuzzy answers to difficult questions, but only as inputs to boring, more traditionally algorithmic processes. Laws, conveniently, are codified in much the same way as those traditional algorithms(though, again, with fuzzy inputs).

    Any company even remotely trying to engage this would encode the laws at that level, not as something some AI tries to reason out.

  34. Re:"Philosophically, this opens up an interesting by orgelspieler · · Score: 1

    "minimize liability" = "If I have to hit a human, make sure I kill him instead of maim him."

  35. Re:"Philosophically, this opens up an interesting by canadiannomad · · Score: 2

    Can I program mine to always claim to other vehicles that I have 7 babies on board?

    --
    Hmm, the humour and sarcasm seem to have been be lost on you.
  36. Stupid scaremongering by aepervius · · Score: 2

    "Patrick Lin writes about a recent FBI report that warns of the use of robot cars as terrorist and criminal threats, calling the use of weaponized robot cars "game changing." "

    Only if the potential terrorist have never learned to drive. Because otherwise :
    1) for criminal you will be far better off with a car which do not respect speed limit/red lights/stops if you want to run away
    2) a terrorist can simply drive the bomb somewhere then set it to explode one minute later and go away. What is the difference if he drove it himself or not ?

    Terrorism is the least worry with robot car.


    As for point 1 , laws and insurance will be setting your car "ethics" and not you personally.

    --
    C. Sagan : A demon haunted world:
    http://www.amazon.com/gp/product/0345409469/
    visit randi.org
    1. Re:Stupid scaremongering by Anonymous Coward · · Score: 0

      Devil's advocate here, as per point 2: you describe a situation where a witness or camera may capture some evidence of the person who placed the car bomb, yet a driverless car (as per definition) could reach its destination from a thousand miles away (or at least as far as it could get without refueling) without the murderer being anywhere in sight. Kind of hard to catch someone when you don't know where they are or what they look like, allowing them to rinse and repeat. I don't see a scenario where that kind of attack would go on forever but I could picture a good few years where law enforcement would be scrambling to find a way to deal with it.

      It might be the case where a passenger car eventually couldn't be driven legally without a person inside the vehicle I imagine.

  37. If I were a terrorist hacker by Anonymous Coward · · Score: 0

    How are laws or programming restrictions going to stop me? As a terrorist, I'm already ignoring your law by killing people (this has already been outlawed). If I'm a hacker, I'm already ignoring the restrictions you've built into the software by using it in a way it wasn't intended (by bypassing existing restrictions). How is anything you're going to do with either going to stop someone who intends to do harm?

  38. Will not matter. by khasim · · Score: 4, Insightful

    I wonder whether your insurance company would demand to know how you have set your car, and adjust your rates accordingly?

    That does not matter because it won't be an option.

    That is because "A.I." cars will never exist.

    They will not exist because they will have to start out as less-than-100%-perfect than TFA requires. And that imperfection will lead to mistakes.

    Those mistakes will lead to lawsuits. You were injured when a vehicle manufactured by "Artificially Intelligent Motors, inc (AIM, inc)" hit you by "choice". That "choice" was programmed into that vehicle at the demand of "AIM, inc" management.

    So no. No company would take that risk. And anyone stupid enough to try would not write perfect code and would be sued out of existence after their first patch.

    1. Re:Will not matter. by CanHasDIY · · Score: 2

      Those mistakes will lead to lawsuits. You were injured when a vehicle manufactured by "Artificially Intelligent Motors, inc (AIM, inc)" hit you by "choice". That "choice" was programmed into that vehicle at the demand of "AIM, inc" management.

      So no. No company would take that risk. And anyone stupid enough to try would not write perfect code and would be sued out of existence after their first patch.

      Considering how bloody obvious that outcome seems to be, it amazes me how some educated people just flat out don't get it.

      Or rather, it would amaze me, if I weren't fully aware of the human mind's ability to perform complex mental gymnastics in order to come to a predetermined conclusion, level of education notwithstanding.

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
    2. Re:Will not matter. by hawkinspeter · · Score: 1

      I just can't see that autonomous/AI cars will be any worse than human drivers and I think they'll be at least an order of magnitude safer.

      With unusual situations, the AI car should be programmed to find a safe (don't hit anything) route and if that's not possible, it should reduce speed/stop in a straight line as that will allow the speed to be reduced quicker and safer than by swerving. I can't see how stopping in a straight line would lead to increased liability for the manufacturer unless the vehicle was really badly made.

      It's possible to think of situations where stopping in a straight line isn't necessarily the best course of action, but then human drivers make really bad choices all the time and they don't generally have trouble getting insured.

      --
      You're a temporary arrangement of matter sliding towards oblivion in a cold, uncaring universe
    3. Re:Will not matter. by Zordak · · Score: 1

      Those mistakes will lead to lawsuits. You were injured when a vehicle manufactured by "Artificially Intelligent Motors, inc (AIM, inc)" hit you by "choice". That "choice" was programmed into that vehicle at the demand of "AIM, inc" management. So no. No company would take that risk. And anyone stupid enough to try would not write perfect code and would be sued out of existence after their first patch.

      What will happen is that the manufacturers will lobby for a statutory "safe harbor." The legislature will make the ethical decisions in advance, or provide a menu of "safe" ethical options. And the manufacturer will be statutorily immune from lawsuits as long as they have followed those safe harbor guidelines. This is a good thing in theory, as it permits the technology to progress, where lawsuits would otherwise eliminate it. So don't worry about the manufacturers. What you should worry about is that those clowns in Washington, D.C.* will be selling off their "ethics" decisions under the table in exchange for cushy corner-office jobs with AIM, Inc. after they retire from public office.

      *Yes, it will inevitably be a federal law, though just as inevitably, California will have some granola-munching variant that requires autonomous cars operating in California to place a super-premium on the lives of endangered salamanders or something.

      --

      Today's Sesame Street was brought to you by the number e.
    4. Re:Will not matter. by geekoid · · Score: 1

      Because the common perception of lawsuit is wrong. People discussing this know that.
      If it's such a problem, then why do they design cars to pull to one side when the brakes are hit hard?

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    5. Re:Will not matter. by Anonymous Coward · · Score: 0

      The car company will make more than enough money to pay off the lawsuits or bribe new laws into place. Companies already do that now with far less.

    6. Re:Will not matter. by mirix · · Score: 1

      No one designs cars to do that.

      --
      Sent from my PDP-11
    7. Re:Will not matter. by sl149q · · Score: 1

      "So no. No company would take that risk. And anyone stupid enough to try would not write perfect code and would be sued out of existence after their first patch."

      There are two options. Do it here (where here is wherever you live...) by convincing YOUR government to set up the appropriate legal standards. Or let it get done elsewhere (hmm, Singapore, China, Taiwan, Korea) where the government will simply make a decision and mandate that as long as the cars have insurance there WILL BE NO LAWSUITS...

      With option A, your town, city, state/province may reap some of the early benefits (aka jobs, profitable local businesses, safer roads sooner). With option B, you'll end up buying cars designed, tested and built elsewhere once they have proved to be reliable and useful (so fewer local jobs and businesses and you get to live with unsafe vehicles longer so more people dead or injured.)

      It will happen. It might not happen where you live until somebody else has figured out how to profitably do it.

    8. Re:Will not matter. by sl149q · · Score: 1

      And you would think that /. readers would understand the ramifications of Moores law (the general version...)

      Current efforts are about the equivalent of the original iPhone. Sort of nice compared to what it replaced at the time. Laughable compared to what is available seven years later. But even today the current efforts are pretty good.

      Get something into production and deployed, then five to eight years of scaling (software and hardware) and the cars of 2020 will be about as different from the current cars as the iPhone 6 is (will be in a month) from the original iPhone (both for hardware and software.)

    9. Re:Will not matter. by jwhitener · · Score: 1

      I hope you are young enough to see "A.I" cars happen.

      All this "never ever, under no circumstances, no way, not possible" talk is a bit annoying on a tech site. There are probably hundreds of things that were inconceivable 30 years ago that exist now in modern life. If you are still around in 30 years I hope you can look back at your posts and realize how short sighted they were.

  39. Re:"Philosophically, this opens up an interesting by Jason+Levine · · Score: 1

    Scary thought. What if the liability the car sought to minimize was for the insurance companies?

    "Upcoming crash detected. Liability analysis pending. If the crash is fatal, typical payout is $N. If the crash is non-fatal, initial payout will be lower, but long-term repeated payments will increase until they are greater than $N. Minimizing liability demands a fatal crash. Initiating termination of car's occupants."

    --
    My sci-fi novel, Ghost Thief, is now available from Amazon.com.
  40. Never. Going. To. Happen... by Anonymous Coward · · Score: 1

    There is absolutely no chance of mass manufactured cars/trucks having user controllable ethics. They will be decided by a panel of company lawyers & government regulators. At most owners might have options like fuel efficiency, get me there fast, most direct route and/or drive like an old granny modes. The only way you'll be able to get at the ethics are after market mods, and that will probably be either made illegal or driven underground by lawsuits. As far as the whole t3rr0r1sts angle, grow up FBI. I'm sure someone will misuse it at some point, people have figured out ways to misuse virtually every, single, solitary thing in human history. But calling it a "game changer" is disingenuous at best. So a car can drive somewhere without a human at the wheel, get me within few hundred yards of somewhere and I can do the same thing with a bungee cord and a brick, give me 10 minutes and a few simple items and I can probably put the brick on a timer so that I can get miles away before anyone's the wiser.

  41. umm... by Anonymous Coward · · Score: 0

    We can already make a driverless RC car, could do that for years... on the cheap. So just because the car will now drive itself doesn't change much.

  42. Roadside EMP's. by Anonymous Coward · · Score: 0

    Daily cause accidents on the highways causing misery for people getting to work and truckers supplying consumables.

  43. Remote Control Cars? by Jason+Levine · · Score: 1

    My first thought upon reading this summary? What about the Mythbusters?

    In many episodes, they've rigged up a remote control setup to a car. Many times, it has been because testing a particular car myth would be too risky with a person actually inside driving the car. They've even gone so far as to have a camera setup so they could see where they were driving.

    I'm sure there's a learning curve here - not everyone could stop by their local hobby shop and remote control enable their car in an afternoon - but learning curves aren't a hindrance to people who are motivated enough. (i.e. People who want to commit acts of terrorism.) They could even put some sort of dummy in the car to keep people from realizing that the car was driving itself. Then again, they are "motivated" enough to not care if they kill themselves in the process so they could easily just load a car up and drive it where they want it to be.

    Self-driving cars aren't any more of a threat than any other piece of new technology. Yes, some people will use it for bad purposes, but many more people will use it for good purposes. If we banned any technology that anyone ever used to harm another person, we wouldn't have any technology left at all.

    --
    My sci-fi novel, Ghost Thief, is now available from Amazon.com.
  44. Re:"Philosophically, this opens up an interesting by Opportunist · · Score: 1

    Well, it's unlikely that occupants would be killed off (unless so specified by the driver), it would be kinda bad for the sales if it got out. And such things have a way to get out.

    Though I could fully see, at the very least modifications to the software (which will probably be outlawed soon), is logic that ensures an unavoidable crash with physical harm to another person is as fatal as possible while at the same time leaving the proper skid marks that suggest trying to avoid it.

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  45. FBI failed the grade by Anonymous Coward · · Score: 0

    They can wish for it, but if they get it, all it does is prove how clueless both law enforcement and law making really is.

    Simply this: Consider the suicide bomber.

    And that's just one side of the whole thing. The other is similarly flawed.

  46. Car bomb? Whatever... by HalAtWork · · Score: 1

    There are kits that turn cars into remote controlled vehicles already. It would have already been possible. Meanwhile, self-driving cars still need someone in the seat and still require heavy modification to perform the task. It is not any more attainable with those than is already possible. Stop giving idiots ideas in news headlines, and stop pissing your pants every time there's new tech.

  47. Re:Will a robo car be able to break the law to sav by Cro+Magnon · · Score: 2

    It will, if it's an Asimov car. The law should only be Second Rule. No death to humans is the First.

    --
    Slow down, cowboy! It has been 4 hours since you last posted. You must wait another few hours.
  48. Prioritizing my own life is "jealousy" now? by Anonymous Coward · · Score: 0

    This must have been written by the same liberal minds that insist that self-defense is selfish because criminals have more rights to live than their victims.

    1. Re:Prioritizing my own life is "jealousy" now? by hey! · · Score: 1

      You need to buy a dictionary.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
  49. Tinfoil Hats, Only taken seriously if its the Govt by Anonymous Coward · · Score: 0

    i remember when people started contemplating autonomous cars, some predicted the same thing, that they could be used for nefarious purposes. We were labeled as conspiracy theorists, and that the industry would make sure that this couldn't happen.

    Now the FBI says it and people all of a sudden are up in arms about it..

  50. Timely discussion. by Etherwalk · · Score: 1

    Until a proposed system to make automated vehicles feasible on public roads in mass is proposed, developed, protocols and legal procedures released related to this come about, this is nothing but a scare topic making vague assumptions about things that aren't even a topic for development yet.

    Not really. We already have self-driving cars, and we have a lot of data about traffic accidents and mortality. The cars aren't available at retail yet, but they exist. Teaching them to drive in a way that makes the right safety tradeoffs is appropriate. (E.g. driving slowly through a stoplight might cause more accidents and fewer deaths; that's a hunch, but we have lots of data so there's a moral calculation that should be made based on the data and desired outcomes.)

  51. Re:"Philosophically, this opens up an interesting by geekoid · · Score: 1

    It's a debate because in the case you stated it impacts people who were not involved in the choice.

    --
    The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
  52. Robbie the Robot by DarthVain · · Score: 1

    Select OS:
    1) Crush!
    2) Kill!
    3) Destroy!

  53. Ethics implies knowledge of outcome by Overzeetop · · Score: 1

    While it's possible that a computer could be allowed to evaluate ethical limits - to play a version of Lifeboat - the lack of information will doom such optimization. The number of wild or unpredictable maneuvers are more likely to be limited, with only simple avoidance options available (stop, avoid within legal lanes of travel). The use of a standard model is preferable, or you would have to know all possible outcomes as well as all possible settings on nearby vehicles.

    --
    Is it just my observation, or are there way too many stupid people in the world?
  54. The ROAD will make these choices by spire3661 · · Score: 1

    Autonomous cars will be slaves, they wont be making choices for themselves. They will follow the ruleset the Road Computer sets for them. Cars will be in constant contact with the road with beacons giving them differing rulesets (speed, school nearby etc). No person is going to have selectable ethics.

    --
    Good-bye
    1. Re:The ROAD will make these choices by mjwx · · Score: 1

      Autonomous cars will be slaves, they wont be making choices for themselves. They will follow the ruleset the Road Computer sets for them. Cars will be in constant contact with the road with beacons giving them differing rulesets (speed, school nearby etc). No person is going to have selectable ethics.

      Because no-one will hack or mod their car?

      5 minutes before autonomous cars become mainstream after-market CPU's and software will be available. Besides this, autonomous cars will have manual controls for a long time, selectable ethics just means taking the wheel.

      --
      Calling someone a "hater" only means you can not rationally rebut their argument.
    2. Re:The ROAD will make these choices by spire3661 · · Score: 1

      Any modified car wont be allowed on the autonomous lanes at all. Getting caught operating a modified car on the 'no human operator' sections will induce heavy fines, loss of use of private vehicle, etc.. In short no, your cyberpunk dreams arent going to happen. The whole point of autonomous cars is to remove human-drive ability altogether.

      --
      Good-bye
    3. Re:The ROAD will make these choices by mjwx · · Score: 1

      Any modified car wont be allowed on the autonomous lanes at all. Getting caught operating a modified car on the 'no human operator' sections will induce heavy fines, loss of use of private vehicle, etc.. In short no, your cyberpunk dreams arent going to happen. The whole point of autonomous cars is to remove human-drive ability altogether.

      LoL.

      There will be a long time before there's a no-human operator lane.

      And you demonstrate you dont know much about people or modding cars. Do you think if carriers blocked all Iphones that have been modded by their owners that these mods will go away, hell no, they'll just find a way to hide it by finding the correct response to the carrier and for a long time laws are going to require people to sit in the drivers seat for driverless cars.

      Beyond this, there are a lot of places that ban or restrict car mods already, it hasn't stopped it one iota. I have a modified car (springs, BOV and aftermarket tail lights), the original parts are in my garage. If I get pulled over (the Blow Off Valve is a legal grey area) and pulled for it, I'll just put the originals back on before I take it over the pits (for inspection). This is the standard operating procedure for modders in Oz.

      As long as people have a desire to go faster, there will be a demand for modifications (legal or otherwise). Doubly so if they find a way to give priority to certain autonomous cars.

      --
      Calling someone a "hater" only means you can not rationally rebut their argument.
    4. Re:The ROAD will make these choices by spire3661 · · Score: 1

      We dont lose 30,000+ people a year to cellphones (U.S).... Your analogy is bad. The main purpose of autonomous cars will be to remove human ego and error from the equation. No modified cars will be able to even run on the autonomous roads in the not too distant future. You might not even be able to own a private car that operates on them, but only use them as a form of individualized mass transit wit ha standard issue vehicle.

      --
      Good-bye
  55. This is very old news. by sugarmatic · · Score: 1

    To date, there are literally dozens of groups of hobbyists who compete with FPV vehicles (both ground and air) to deliver large pyrotechnical devices to "goals", from over 4 km away. It's not even expensive or difficult...it is off the shelf and an amazon.com click away.

    To date, there are at least a dozen people who have equipped a vehicle with FPV transceivers and the simple servos required to navigate through actual city streets while miles away themselves. Latency is not the issue that some people who haven't actually tried it might argue. To be fair, the videos I've witnessed were done at night with minimal traffic present.

    These things are relatively cheap, not very difficult, and are completely available to anyone with some time and motivation.

    This has been the case for a very, very long time. This is no game changer.

    The game changer would be the sudden appearance of legions of people with a little money and a lot of motivation to use these things for nefarious purposes.

    So, the question is this:

    Why isn't this happening all the time?

    1) Either people just don't know how easy, accessible, and cheap these things are, or

    2) All the luggage searches, border security, and spying on private citizens is batting 100% for effectiveness in preventing the legions of terrierist attacks that must be attempted every day, or

    3) These nefarious people simply don't exist in any number great enough to worry about.

    Hypothesis (1) is naive and silly. These ideas are the first thing to occur to any casual 14 year old pyromaniac nerd. They aren't the last to occur to occur to a determined, capable theoretical "terrierist".

    Hypothesis (2) is what comprises the confidence game we willingly pay trillions to every year.

    We live in a world where hypothesis (2) is the only likely scenario, and should be considered "theory" by now given the ridiculousness of (1) and (2).

  56. How big is your monkeyspace? by Overzeetop · · Score: 1

    You can die from the impact of the impending head-on collision, or you can veer off and save your life, but in doing so you'll be accelerating out of the way of the oncoming vehicle and into a group of 40 kindergartners (including your twin son and daughter), their 3 pregnant teachers, and 3 elderly chaperons (one of whom is carrying a kitten, another a puppy) who were waiting for a bus after a field trip.

    Don't worry, your decision to kill them to save your own life was made months ago, right after you bought the car and selected "preserve my life at all costs" as your autopilot setting.

    --
    Is it just my observation, or are there way too many stupid people in the world?
  57. Mental Masturbation by brunes69 · · Score: 2

    This discussion is pointless mental masturbation because none of these things will be real problems with autonomous cars. The people dreaming up these scenarios do not understand the fundamental paradigm shift that comes with autonomous vehicles

    - Firstly, any thoroughfare staffed with autonomous cars should never have pedestrian access, because the cars will all be travelling at maximum safe speed constantly, like 110K+ even on city streets. These streets should be fenced not allowing pedestrians.

    - Secondly, In situations where pedestrians are involved, which are inherently unpredictable, the car will never drive faster than it would be able to stop and not hit ANY pedestrian... thus, this whole "choose 1 or 5" scenario is not possible.

    - Finally, you won't be able to manually point the car at people and then later have the car "take over". You will not have any ability to drive the car manually, period. At least I bloody well hope not... once autonomous cars are standard, people should not be allowed to drive any more.

    -

    1. Re:Mental Masturbation by phorm · · Score: 1

      Unfortunately, an alternatively likely scenario might be.
      Very few cars, because gas has reached a point where it's unaffordable to the average person and alternative energy/transportation sources have been prevented by powerful lobbying and government hubris.

    2. Re:Mental Masturbation by Kjella · · Score: 1

      Mental Masturbation

      Someone is, yes. Building overpasses or tunnels for pedestrians on every street is not nearly realistic. If you sprint out a doorway you'll cross the sidewalk and hit traffic in less than 0.5 seconds, even with zero reaction time physics won't let a car stop that fast or they'd have to drive a lot slower than cars today. And while their might be auto-only cars, for most the autopilot will be the new cruise control. It will have an off switch. So yes, somebody here is detached from reality.

      --
      Live today, because you never know what tomorrow brings
    3. Re:Mental Masturbation by iggymanz · · Score: 1

      gas is hardly "unaffordable to average person", even the burger mashers where I live drive to work

    4. Re:Mental Masturbation by phorm · · Score: 1

      Yes. Thus far. Gas is also generally lower than up here (Canada, about $1.32/L or $5/gallon), but it's certainly not going down in the long-run...

    5. Re:Mental Masturbation by Anonymous Coward · · Score: 0

      But I don't want a semi-automated car. What good is a vehicle that gives control back to the driver at the worst possible time? You're in the middle of typing an email when your car beeps that the autopilot has shut off because you are 0.5 seconds from impact? No thanks!

  58. Are you sure it was jihadists? by Anonymous Coward · · Score: 0

    And not just FBI agents cold-calling disaffected people, trying to get someone to deliver one of their "bombs"?

  59. Fear, FTW! Re:FBI: 1, Ethics: 0 by Anonymous Coward · · Score: 0

    Exactly, why stop at remote controlled cars? They need to be able to override every single motorized vehicle on the road or in the air, because, potentially, anyone can be a terrorist. Heck, many are willing to die for their cause, they could be anywhere inside the US now, driving on the highway to their destination. We're left with one option: nuke Amerika from orbit, it's the only way to be sure.

  60. Multiple quadrotor submunitions! by Anonymous Coward · · Score: 0

    Your ideas are intriguing to me and I wish to subscribe to your newsletter.

  61. Re:Not really game changing by JaredOfEuropa · · Score: 2

    Modded "flamebait", but you're sort of right. The hard part of blowing something up is getting the cash together, obtaining enough explosives, and finding the right target and opportunity, all that without having some security agency get wind of your plans. Finding some poor deluded soul willing to blow himself up for a crappy cause is actually the easy part, especially if you can draw from a pool of religious nuts. And islam has plenty of those, sad to say.

    --
    If construction was anything like programming, an incorrectly fitted lock would bring down the entire building...
  62. Do I Have To Give Up My Invalid Scooter by Anonymous Coward · · Score: 0

    I've wondered for a while how someone could militarize my invalid scooter.
    It wouldn't be too hard to hack it.
    Have I said too much?

  63. Who needs a bomb? by hsthompson69 · · Score: 0

    Frankly, if the terrorists were at all organized, they could shut down traffic in a major city like los angeles just by doing one high speed kamikaze ram into a starbucks every hour for a day.

    24 one day rentals, 24 jihadis, and maybe another 48 jihadis to video tape and youtube the carnage, and you'd have a city in utter panic for less than a few thousand bucks.

    Terror is *easy*.

  64. Re:Car bomb? Whatever... by jopsen · · Score: 1

    Agree... Also it's probably more sane for restrict access to high explosives, as oppose to consider availability for self-driving cars a problem :)

  65. Will not matter. by Anonymous Coward · · Score: 0

    Yes, just like human flight will never exist, and going to space will never exist..

    If you study your history, you'll learn that people who say "never" are pretty much always fools.

  66. So the computer has more ethical responsibility by Anonymous Coward · · Score: 0

    RE: it simply operates too fast and is aware of so much more.

    So the computer has more power and with more power comes more (ethical) responsibility. [A nerd truism.]

  67. Re:"Philosophically, this opens up an interesting by bluegutang · · Score: 1

    This, and most similar issues, can be solved with proper legal incentives. For example, a mandatory payment when someone dies which is higher than the cost of caring for a lifetime cripple.

  68. It's a gamble by phorm · · Score: 1

    It's basic a gamble in the reverse sense of the lottery. Instead of a big win, the insurance covers you against a big loss. Given the state of the court system, it's not even just in case you're really at fault. There was a case where a kid was biking with no reflectors/lights on a foggy night, he cut in front of a car and got hit. Of course it's a terrible thing, but given the situation there wasn't anything the driver could have done to avoid the accident.
    However, a jury hears "young kid hit by car, crippled for life, medical expenses etc." Are you willing to gamble against paying some number that has a *lot* of zeroes behind it?

  69. Terrorists consider suicide a sacrament by Applehu+Akbar · · Score: 1

    So why would they bother waiting for driverless cars to hit the road before acting? Just rent a Hertz to carry a bomb anywhere they wish.

  70. Re:"Philosophically, this opens up an interesting by Opportunist · · Score: 1

    Payment to whom? The state?

    Ponder for a moment and I guess it becomes very obvious why this is a REALLY BAD idea.

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  71. We need to fix the common ethical dilemma by PuckSR · · Score: 1

    The common dilemma is mentioned in the wired article. It is known as the "trolley problem". It essentially creates a scenario where you need to make a binary choice: kill 5 people through inaction or kill 1 person through action.

    If we are going to discuss autonomous cars, I really think we should expand the scenario:
    1. You are driving directly at a large concrete barrier at 70mph.(kills 1 person-YOU)
    2. Swerve left and you strike a pedestrian(kills 1 person-OTHER)
    3. Swerve right and strike a car head-on(potentially kills >1 person)

    Why this alternative? It presents a risk to the occupant, which is always going to be a concern for a driverless car. It it less simple than a binary choice, but it illustrates almost all of the ethical issues. Do you value the occupant over others? Do you take a 50% chance of killing 2 people or a 100% chance of killing 1?

    1. Re:We need to fix the common ethical dilemma by david_thornley · · Score: 1

      The trolley problem, like most other such, is much more important in theoretical ethics than in practice. All such problems I've seen specify two possible courses of action, while in reality there's always alternatives. (They may not be good alternatives, but the idea with these problems is that there is no good solution.)

      However, why would my car being headed towards a large concrete barrier at 70mph? That's the exact thing they're not supposed to do. Large concrete barriers do not typically appear suddenly in the road.

      --
      "When you have eliminated the unacceptable, whatever is left, however improbable, must be the truthiness" - Holmes
  72. No suicide bombers! by gelfling · · Score: 1

    The perfect white middle class faux Marxist angry anarchist Hamas loving machine.

  73. Just hit the break. by DrYak · · Score: 1

    For example, hitting an elderly person in order to avoid hitting a small child.

    A not even that much intelligent car would have notice a long time ago that there two object on the street (no need to identify them. There are just 2 big masses on the road), and the if car is kept on the same trajectory it is set for a collision course.

    the would already have started pre-braking, sounding some imminent collision alarm, blinking lights on the dashboard

    By the time you reach the situation where a human would need to steer some way or another, a car with anti-collision system would have slowed down and stop at rest (unless the driver has overridden the system by voluntarily smashing down the accelerator against all car's alarms).

    No need for complex recognition and identification of pedestrian. Just plain simple recognition that there are 2 masses of significat size.
    No need for complex ethics engine evaluation, just being able to notice that said masses currently occupy a place that is intersected by the current trajectory of the car.
    No need to aim for one while sparing the other, just slow down and brake well enough in advance (and cars electronics are much faster at noticing and reacting as human's slow reflexes and limited attention (or lack of) ).

    I'm not speaking about some potential futuristic technology. I'm speaking about car that are street legal and currently circulating on a road near you. They're not even self driving, but they are already able to efficiently avoid collisions.

    We haven't already started producing self-driving car beyond a few prototypes at google's lab, and we already have the necessary technology to avoid both deaths.

    All these "ethics in robotic cars" are nice though experiments for a highschool's philosophy classes, but they are completely out of touch with technology. For any of these though experiment, the technology will reach a development level where casualities can be avoided a long time before a car's A.I begin to be able to have an ethics discussion with the philosophy teacher about the value of life.

    --
    "Sufficiently advanced satire is indistinguishable from reality." - [Tips: 1DrYakQDKCQ6y52z6QbnkxHXAocMZJE61o ]
  74. automatic brakes by DrYak · · Score: 1

    Yup, all the while current cars that won't even qualify as "A.I." but simply as auto-brake / collision-avoidance functions already have the ability to slow down, sound an alarm, and in worst situation slam the brakes to avoid colliding with big object (i.e.: avoid killing people without even being able to recognize people or even have the concept of "people" in their code).

    We haven't already started bringing automated vehicles out of google labs, and we already have technology to avoid killing people, by using much simpler technology.

    These etchics/philosophy discussion indeed look a bit pointless.

    --
    "Sufficiently advanced satire is indistinguishable from reality." - [Tips: 1DrYakQDKCQ6y52z6QbnkxHXAocMZJE61o ]
  75. Like US drones? by Anonymous Coward · · Score: 0

    You mean Afghanis would finally be able to retaliate to US drones by send self-driving cars (or remote controlled one) to kill US civilians like the US drones are killing? How dare they respond???

  76. Everythings a Threat by JimSadler · · Score: 1

    There is almost nothing that can not be used as a weapon by a dedicated enemy. It doesn't have to be a new invention or high tech for that matter. And lots and lots of seemingly trivial actions can make for worse problems than something like a car bomb. What we need to do is learn to interpret and spot people who operate with bad motives. Usually the public fears an attack that can be seen to have radical and easily seen consequences. But many attacks could be hardly noticeable at all. For example the French used a gimmick that would slice a tire that could be easily tossed onto a street during WWII. Not only did the Germans have trouble dealing with ruined tires but businesses were severely effected as were factories that needed workers and deliveries to be on time. It was a small attack but it was ongoing. Any bright person could dream up numerous attacks that would be next to impossible to detect and could be done over and over again. We can surely spot people likely to do harm and then study them in depth to see what they are up to. Even selling small amounts of dope of any kind attacks a nations ability to survive as dose selling illegal guns on the street.