Slashdot Mirror


Self-Driving Cars' Shortcomings Revealed in DMV Reports (mercurynews.com)

A demand from the California DMV of eight companies testing self-driving cars has highlighted a number of areas where the technology falls short of being safe to operate with no human backup. From a report: All companies testing autonomous vehicles on the state's public roads must provide annual reports to the DMV about "disengagements" that occur when a human backup driver has to take over from the robotic system. The DMV told eight companies with testing permits to provide clarification about their reports. More than 50 companies have permits to test autonomous vehicles with backup drivers on California roads but not all of them have deployed vehicles.

It turns out that a number of the issues reported are shared across technology from different companies. Some of the problems had to do with the way the cars sense the environment around them. Others had to do with how the vehicles maneuver on the road. And some had to do with what you might expect from systems made up of networked gadgets: hardware and software failures. The disengagement reports themselves identify other problems some self-driving vehicles struggle with, for example heavy pedestrian traffic or poorly marked lanes.

181 comments

  1. Re:what's the plan for moral choice? by Mr+D+from+63 · · Score: 3, Insightful

    Reliability will become ever more important as full AD becomes standard and humans' driving skills deteriorate (or never develop)

  2. Holy shit ... by Anonymous Coward · · Score: 5, Insightful

    Baidu, a Chinese internet-search giant, reported a case in which driver had to take over because of a faulty steering maneuver by the robot car; several cases of âoemisclassifiedâ traffic lights; a failure to yield for cross traffic; delayed braking behind a car that cut quickly in front; drifting out of a lane; and delayed perception of a pedestrian walking into the street.

    Automotive supplier Delphi noted that its autonomous system âoeencountered difficulty identifying a particular traffic light,â and also said a GPS problem meant a vehicle didnâ(TM)t know where it was. Delphiâ(TM)s system also had issues with unexpected - usually illegal - behavior by other drivers, the company said in its report to the DMV.

    Drive.ai - which makes artificial intelligence software for self-driving vehicles - cited reasons for disengagement that included the swerving of a vehicle within a lane and "jerky or uncomfortable braking." The firm also noted a "localization error" that meant a vehicle was uncertain of its location, and a discrepancy in data from different sensors on a vehicle.

    Holy shit, they've just described, you know ... driving.

    This shit is what happens pretty much daily, and for which the act of driving requires you to have a high degree of situational awareness.

    Just this morning as I was driving into work, some clown turning off a street into the road I was driving on ... he hesitated, then apparently said "fuck it" and went anyway. Unfortunately he didn't seem to be aware enough or intelligent enough to have noticed me. The end result was I had to pretty much do a panic stop behind some idiot who unsafely pulled out into oncoming traffic, and was pretty much suddenly in front of me and driving at half my speed (which was the posted limit).

    Why the hell are these companies acting like they have self-driving cars when they clearly can't handle driving in the real world.

    This shit is never going to work if it can't handle random, illegal, and stupid behaviour from the humans on the road. And if they think the world is going to replace all cars with autonomous vehicles, then clearly they expect the rest of us to pay for that future.

    This is just hubris from the tech industry who are pretending they're closer to solutions that work in the real world than they really are. The fact of the matter is, we're not all going to run out and buy new cars to allow this awesome future as envisioned by corporations to actually ever happen.

    Sorry, but all of the stuff in the above quote is pretty much mandatory for driving a car.

    1. Re:Holy shit ... by fluffernutter · · Score: 1

      My wife was taking care of the neighbors dog and it bolted out the door, down the driveway, and out to the road. The dog could not be seen by the car because of snow banks by the side of the road. The accident was avoided because the car saw my wife jumping up and down back in front of the house and waving so it stopped.

      --
      Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
    2. Re:Holy shit ... by Anonymous Coward · · Score: 0

      I'm not sure the point of your story. So the driver saw your wife jumping and the driver stopped? It damn well better have not been a self driving car going through your neighborhood. Putting experimental systems through residential areas would be the stupidest things one could do. They're probably the most likely place to have unexpected situations that the car couldn't handle while giving the least amount of time for a backup to intervene. My neighborhood has a lot of young children in it, rules of the road go straight out the window. 25 MPH speed limit? Hell no, more like 5 MPH. Drive on the correct side of the road? No way, in the center to give myself the most reaction time if something bolts out.

    3. Re:Holy shit ... by fluffernutter · · Score: 1

      My point is that these things can happen at any time, in many varying situations, and autonomous cars will need to deal with them to be equivalent to a human. It doesn't really matter where they are driving.

      --
      Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
    4. Re: Holy shit ... by Anonymous Coward · · Score: 0

      That's fortunate, since it was your wife's fault.

    5. Re: Holy shit ... by fluffernutter · · Score: 1

      Entirely.. but the point is that pets can easily become a casualty if automated driving isn't done right.

      --
      Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
    6. Re: Holy shit ... by goose-incarnated · · Score: 1

      That's fortunate, since it was your wife's fault.

      Human drivers routinely avoid accidents that aren't their fault.

      --
      I'm a minority race. Save your vitriol for white people.
    7. Re:Holy shit ... by Aighearach · · Score: 1

      At legal speeds in residential neighborhoods, a self-driving car that detected the dog promptly would have a very high likelihood of stopping in time. Brands with crappy sensors would hit the dog, but ones with good sensors you're not going really be able to jump out that fast when the vehicle is going that slow. Brakes are too good at stopping at low speed.

    8. Re:Holy shit ... by be951 · · Score: 1

      This shit is never going to work if it can't handle random, illegal, and stupid behaviour from the humans on the road.

      Yeah, it's too bad they've stopped trying to improve them and are claiming they're ready for the road now. Oh wait, that's exactly the opposite of what's happening, as cited specifically in the article:

      As Telenav [representative of others] put it, “Our autonomous system is still being developed and we are working on improvement cycles. At this stage we expect that (the) driver will be taking over the car control from time to time due to the fact that it is new technology.”

      It's easy (also stupid and pointless) to say that if they never improve, they'll never be good enough, because none of them claim they're ready today and all are focused entirely on improving performance.

      This is just hubris from the tech industry who are pretending they're closer to solutions that work in the real world than they really are.

      I'm aware of at least one company for which that seems to be true. As for the more than 50 other companies doing or preparing for road tests, it's likely that you're not listening to or not understanding their claims (for the ones that have even made any claims at all) or sourcing your expectations/beliefs from somewhere other than where the actual work is being done.

    9. Re: Holy shit ... by Anonymous Coward · · Score: 0

      Entirely.. but the point is that pets can easily become a casualty if automated driving isn't done right.

      It's too bad nobody who makes autonomous cars is allowed to have pets or they might understand the situation as well as you do.

    10. Re: Holy shit ... by Anonymous Coward · · Score: 0

      so much this. As others have said, this is routine and necessary.

      I was wondering about self-driving cars that can't deal without lane markings. Where I live there are many roads lacking lane markings. There are spots that are awkward for human drivers that can apply sense (narrow road with sharp 90 degree turn and parking on both sides of the street and frequent pedestrian crossing from between cars; a road that is wide enough for four or five lanes without any markings until the last twenty feet or so at the intersection; intersections with high accident rates where lanes are painted to help, but quickly worn away due to constant traffic crossing the line; roads with lane markings that are quickly worn away due to constant traffic crossing the line; etc.)

      You could blame a lot of this on urban planning (or the lack thereof) or traffic engineers or ... but unfortunately for self-driving car aficionados this is the real world. It is frequently messy and just because it is theoretically "someone else's fault" doesn't absolve you (e.g., killing a child). Its the driver's responsibility to avoid accidents.

  3. Who could have guessed? by Carewolf · · Score: 1, Insightful

    It is not like anyone knowning anything about AI could have told them it isn't ready for general roads, and only for special roads. It is not like allowing them on special roads first is exactly the plan in Europe where government listens to experts.

    1. Re:Who could have guessed? by Anonymous Coward · · Score: 0

      If the system is confused by poorly marked lanes, I don't see how it operate on anything other than an interstate.

  4. Re:what's the plan for moral choice? by rogoshen1 · · Score: 1

    It would be like the donkey which dies of thirst AND hunger when placed equal distance between food and water.

  5. new era of Test Driven Development TDD by kiviQr · · Score: 0

    Add a failing test, add code to fix failing test, deploy to all vehicles - fixed. Humans rearly learn in that fashion.

    1. Re:new era of Test Driven Development TDD by Anonymous Coward · · Score: 0

      Add a failing test, add code to fix failing test, deploy to all vehicles

      Create new problem with supposed fix.

    2. Re:new era of Test Driven Development TDD by KiloByte · · Score: 1

      The test suite can be... fun.

      --
      The creatures outside looked from Alt-Right to Antifa; but already it was impossible to say which was which.
    3. Re:new era of Test Driven Development TDD by Anonymous Coward · · Score: 0

      That's what regression tests are for.

    4. Re:new era of Test Driven Development TDD by fluffernutter · · Score: 1

      ....humans rarely break in that fashion.

      --
      Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
    5. Re:new era of Test Driven Development TDD by fluffernutter · · Score: 1

      Oh yes by all means, go regression test THE ENTIRE WORLD.

      --
      Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
    6. Re:new era of Test Driven Development TDD by Anonymous Coward · · Score: 0

      There’s no test for this new problem. The problem is only discovered after a massive number of people were killed.

    7. Re:new era of Test Driven Development TDD by fluffernutter · · Score: 1

      The thing I don't understand is, how do the self driving companies not know about these flaws? So far the scenarios with people killed seem so easy to test in a closed environment.

      --
      Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
    8. Re:new era of Test Driven Development TDD by viperidaenz · · Score: 1

      They just need to kill more people in their test environments.

    9. Re:new era of Test Driven Development TDD by hazardPPP · · Score: 1

      Add a failing test, add code to fix failing test, deploy to all vehicles - fixed. Humans rearly learn in that fashion.

      Indeed, humans rarely learn in that fashion...and that's you know, an advantage. Humans operate in a highly non-linear and unpredictable environment, and they developed, after millions of years of evolution, ways to deal with that. One way is a large variety among humans, so that they do not all have the same flaw (nor the same "fix"). It's really hubris to think that software, with its 60 or so years of development, could more robustly handle the world than humans, in situations that humans have evolved for (while humans have not been driving for millions of years, driving is very similar to age-old human activities, like, you know, just running and wandering about).

  6. Moral choice and the free market by OrangeTide · · Score: 4, Insightful

    A self-driving car's software has the priority to minimize litigation of its creating company.

    --
    “Common sense is not so common.” — Voltaire
    1. Re:Moral choice and the free market by Anonymous Coward · · Score: 0

      A self-driving car's software has the priority to minimize litigation of its creating company.

      That's also true for the rest of car, and is the reason they have as many safety systems as they do.

  7. start with freeway point to points by smoothnorman · · Score: 4, Insightful

    Seldom (if ever) is there the rather obvious suggestion to limit autonomous vehicles to simple point to point 'highway' trips; but that's exactly where and how it should be done for the foreseeable future, if it happens at all. That is, the (literally) lethal mistake is to introduce autonomous vehicles into the complex and chaotic world of city driving. The next time you drive in the city consider how many of your decisions are predicated on understanding subtleties (some might occasion "stupidities") of human nature: "Is that guy looking at the person as they're talking on the corner? If so, they aren't as likely to start across the street" "Is that a child's toy which just bumped a bit into the road (to be chased by a child) or just a blown leaf?" "OK ...four way stop: it's that guys turn, but, he's got a cell phone in his hand he's consulting" ...etc. So, start out with truck loads from freeway exit 113 to 114, then if that works, exit 117...

    1. Re:start with freeway point to points by HornWumpus · · Score: 2

      That's exactly how GM does it: If the GPS sees your not on on a divided highway, no lane assist for you.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    2. Re:start with freeway point to points by Miamicanes · · Score: 1

      There's one edge case in "city" driving where allowing autonomy on normal streets makes sense and still works: bumper-to-bumper stop & go gridlock where nobody is moving faster than 10mph anyway, and having AI pay attention to the traffic is probably a net improvement over the 90% of drivers who are only halfway paying attention and watching cat videos on their phone in their lap ANYWAY.

      One big area for improvement... two-way communication between highway networks and vehicles. It's common for an accident to create ripples that persist for HOURS afterwards. You know... those times when you're creeping ahead, foot by foot... then suddenly, the road in front of you just clears up & you can go 80mph, and you're left wondering WTF you were stopping for (and the time it takes you to notice is why those ripples persist for so long after they have any active REASON to persist). With better communication between cars and highway networks, traffic engineers could attenuate those ripples by letting cars know they're approaching one, and inducing each car that reaches the point to begin accelerating a few milliseconds earlier than the previous car did. Individually, it wouldn't make much difference to either safety or drive time for one of the slowed-down drivers... but the payback would come for the drivers stuck in traffic BEHIND them. Within 10-20 minutes, they could eliminate the ripple and have cars flowing at full speed as if the ripple had never even happened.

    3. Re:start with freeway point to points by Kjella · · Score: 1

      The next time you drive in the city consider how many of your decisions are predicated on understanding subtleties (some might occasion "stupidities") of human nature

      Well, I can't say for certain how many accidents I've avoided through the human perspective. But if I'm tallying the accidents I and those I know have had driving they're almost exclusively caused by glitches in how we drive, like things you almost always pay attention to but then for some reason we had a lapse of concentration or was tired or got distracted or was emotionally on tilt. If not massive errors in judgement passing other cars that almost lead to head on collisions. In fact, I can't really say I remember a single "pat myself on the back" incident where my above-and-beyond response saved the day.

      Usually what you're talking about is a means to drive more aggressively, like if I can tell they're not crossing the street I can drive by faster. But if I didn't I'd just drive by slower so I could stop if they crossed the street, it maximizes my goal to get to where I'm going as fast as possible but it's probably not avoiding accidents. I don't think self-driving cars will be perfect, but I think they'll be a lot more consistent and always keep reasonable safety margins. Combined with always paying attention it won't get into much of the trouble we humans use our brains to get out of. Unless it's made by Uber...

      --
      Live today, because you never know what tomorrow brings
    4. Re:start with freeway point to points by CrimsonAvenger · · Score: 1

      If the GPS sees your not

      Your knot?

      You're not?

      Something else entirely? Enquiring minds want to know...

      --

      "I do not agree with what you say, but I will defend to the death your right to say it"
    5. Re:start with freeway point to points by HornWumpus · · Score: 2

      I love to trigger grammer nazis. it good fun.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    6. Re:start with freeway point to points by gurps_npc · · Score: 1

      Most logical place to start is in a city.

      Specifically, bus and garbage trucks.

      They are:

      ]1) Low speed
      2) Set routes
      3) Perfect for early morning/late night shift. Restrict them to the 2 am to 5 am shift.
      4) No need to worry about the state complaining as the state would be the people setting up the rules. They can set everything up with a focus on safety rather than performance.

      --
      excitingthingstodo.blogspot.com
    7. Re:start with freeway point to points by Dog-Cow · · Score: 1

      its good fun.

      FTFY

    8. Re:start with freeway point to points by CaffeinatedBacon · · Score: 1

      If the person is talking on the corner I'd do the opposite and expect him to be distracted /not paying attention to the road and be more likely to just walk out into it, compared to a person looking at the traffic obviously aware of the situation.

    9. Re:start with freeway point to points by Anonymous Coward · · Score: 0

      No you just have shitty English.

    10. Re:start with freeway point to points by Anonymous Coward · · Score: 0

      it's good fun.

      Fixed THAT for you.

    11. Re:start with freeway point to points by Darkling-MHCN · · Score: 1

      Uber is already doing it.

      https://www.youtube.com/watch?...

      They're using human drivers to move freight within cities and autonomous vehicles to transport them between cities to depots at the out skirts of the city where human drivers pick them up.

    12. Re:start with freeway point to points by Aighearach · · Score: 1

      I was just trying to figure out what a "not on" was, and why it would be visible to the GPS. Maybe it is a type of jamming device.

      If it was a really a "knot on" "on a divided highway," in my State you end up having to register your address on a list for the rest of your life if you get caught doing that.

    13. Re:start with freeway point to points by Aighearach · · Score: 1

      True, that; the only thing slower than a bus truck is a house truck.

    14. Re:start with freeway point to points by Anonymous Coward · · Score: 0

      No they're not, they're just pretending they are to make the investors believe their technology works.

    15. Re:start with freeway point to points by hazardPPP · · Score: 1

      Seldom (if ever) is there the rather obvious suggestion to limit autonomous vehicles to simple point to point 'highway' trips; but that's exactly where and how it should be done for the foreseeable future, if it happens at all. That is, the (literally) lethal mistake is to introduce autonomous vehicles into the complex and chaotic world of city driving.

      Absolutely, self-driving cars should at first be limited only to freeways...not only for the very important reasons you mention, but also because freeways open up an easy (and relatively low-cost) avenue for installing autonomous-vehicle-specific infrastructure along them, which would make them much safer.

      However, the companies most pushing autonomous vehicle development don't want to do that, and it's clear why. Use on freeways only would just effectively make autonomous driving a fancier version of cruise control. Sure, some people would pay for it, especially those that take long intercity trips; but it wouldn't be a killer application that would make everyone want to go out and a buy a new car. A car that drives you around everywhere by itself and is basically a personal taxi service (you don't have to worry where it's parked, etc.) might be such a killer app.

      Furthermore, autonomous cars that don't drive in the cities are not going to help Uber and Lyft eliminate their human drivers, delivery companies and the like eliminate their human drivers, allow Waymo to launch a driverless taxi service, and allow the car companies to keeping making a steady stream of revenue in a world where car ownership and usage rates may steeply decline due to various factors.

    16. Re:start with freeway point to points by hazardPPP · · Score: 1

      I don't think self-driving cars will be perfect, but I think they'll be a lot more consistent and always keep reasonable safety margins.

      Probably. However, on the flip-side, they will all consistently fail in the same way if they have the same bug (and bug-free software is impossible), unlike humans, whose errors are a lot more randomized. Sure, not all cars will run the same software, but the market in any given country is bound to be dominated by a single-digit number of manufacturers, compared to millions of human drivers (or a lot more). From a systemic perspective, human variation and imperfection is not a bug, it's a feature.

      The other problem here is that with the in-vogue neural network based AI, finding flaws and bugs is even more difficult...since it is very difficult to understand why a complex neural network has "decided" to do something. With standard, "non-AI" software code, you can always follow the logic of the programmer (even if it takes a long while to figure it out).

    17. Re:start with freeway point to points by apoc.famine · · Score: 1

      However, on the flip-side, they will all consistently fail in the same way if they have the same bug

      You say this like it's a bad thing. Once that bug is discovered and fixed, it's fixed in all of the cars. Yes, everyone is going to OTA software updates, like it or not.

      Unless it's a hardware issue, of course. I suspect that self-driving cars will get regular updates of "don't do this or you'll crash" warnings that nobody will read. Next model year will have that fixed, recalls might have to happen to update the hardware, etc. But we already do that shit for all of the other parts of the car, so there are systems in place to deal with systematic self-driving issues in a model of car.

      Fixing a flaw in all of the cars at once is a huge step forward for safety. We can't even get most people to stop playing on their phones while driving.

      --
      Velociraptor = Distiraptor / Timeraptor
    18. Re:start with freeway point to points by Anonymous Coward · · Score: 0

      Oh, you're a jackass. I thought you were just stupid.

    19. Re:start with freeway point to points by hazardPPP · · Score: 1

      However, on the flip-side, they will all consistently fail in the same way if they have the same bug

      You say this like it's a bad thing.

      Of course it could be a very bad thing. Assume it's a fatal flaw - you could have a lot of people dying or getting injured in a very short period of time (the time between the bug manifesting itself and being fixed). If the bugs were more random (like a human driver's errors), the bug would only affect a person or two.

    20. Re:start with freeway point to points by GruntMan · · Score: 1

      ^This^

      My argument is that self-driving cars need to have the same sort of "general intelligence" to handle all the edge cases that humans usuallly handle so well. This is the same "general intelligence" that AI needs to get beyond expert systems and deep learning, to get to what I believe is called an AGI (Artificial General Intelligence).

      Note that I have no training or education in AI. And I may have read the argument above somewhere else and just think I came up with it. :)

      --
      Too cool to live, too smart to die!
  8. Re:But by OrangeTide · · Score: 4, Insightful

    Humans are unlikely to improve at driving. Software can potentially be improved on. That's not the same as saying today's software is safer than a human though.

    --
    “Common sense is not so common.” — Voltaire
  9. Re:what's the plan for moral choice? by Calydor · · Score: 1

    It is going to run a damned lot of steering scenarios, pick the one with the smallest projected casualty, and save a log of its calculations for the inevitable trial.

    Trust me, the car is perfectly capable of seeing options you as a driver cannot, simply because a CPU runs faster than a human brain for mathematical computations.

    --
    -=This sig has nothing to do with my comment. Move along now=-
  10. Who watches the watchmen by OrangeTide · · Score: 2

    In the US we define experts as those who are paid by industry leaders to say the things we like to hear.

    --
    “Common sense is not so common.” — Voltaire
    1. Re:Who watches the watchmen by Anonymous Coward · · Score: 0

      How do you think people become experts? I'll tell you since you clearly don't understand how the system works. By working in a job that someone pays you to do within an industry. Where else do you think your going to find these experts?

    2. Re:Who watches the watchmen by HornWumpus · · Score: 1

      In Europe, they define experts as those who are paid by government leaders to say the things the leaders like to hear.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    3. Re:Who watches the watchmen by Anonymous Coward · · Score: 0

      How are you surprised that someone who has dedicated their life to a field will advocate for it?

      I mean really, is this where we're at? Here of all places?

    4. Re:Who watches the watchmen by OrangeTide · · Score: 1

      I'll tell you since you clearly don't understand how the system works.

      I'm either bad at satire or you don't understand how it works.

      --
      “Common sense is not so common.” — Voltaire
    5. Re:Who watches the watchmen by Anonymous Coward · · Score: 0

      So... same, same.

    6. Re: Who watches the watchmen by Anonymous Coward · · Score: 0

      I'm going to go with the latter.

      Those aren't really mutually exclusive either. You just told the truth and called it satire so that is at least poor effort if not bad satire.
      Then that AC came along and acted intentionally dense.

      You know what? I am going to change my answer to both.

    7. Re:Who watches the watchmen by Carewolf · · Score: 1

      In Europe, they define experts as those who are paid by government leaders to say the things the leaders like to hear.

      Possibly, but fortunately we then have whole lot of governments with different idea, leading to a lot of different experts in debating field.

    8. Re: Who watches the watchmen by OrangeTide · · Score: 1

      Not much I can do if people choose to ignore the little "say the things we like to hear." part.

      --
      “Common sense is not so common.” — Voltaire
    9. Re:Who watches the watchmen by HornWumpus · · Score: 1

      So, like the sib says. Same, same.

      Northern European governments aren't exactly a diverse group. Capitalist welfare states as far as the eye can see.

      Southern European governments are similar, but more corrupt and less functional.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
  11. Re:what's the plan for moral choice? by The+Grim+Reefer · · Score: 5, Funny

    so if I'm a self driving car with no backup operator, do I prioritize the safety of my passengers? if I have to run down 5 people to keep my rider safe, do I do that?

    The car should run over the 5 pedestrians, then the litter of puppies across the street and finally drive off of a bridge. Bonus points if the horn sounds like a maniacal laugh or plays Dixie.

    what if I have to do the whole run over your mother / a baby / a nun or run over a bunch of assholes? how are they ever going to solve for this, because whatever it chooses will be wrong

    Run over my mother, sideswipe the baby so it goes airborne into a dumpster, and back over the 5 assholes. Preferably spinning the tires on their dismembered corpses. The nun is difficult. I'm not sure if it will piss off more people to hit the nun, or avoid her after all of the other carnage.

    You're right, some situations are difficult. Oh wait, avoid the nun and run a bus full of orphans off of a cliff. That will probably piss the nun off to. Problem solved.

  12. Re:what's the plan for moral choice? by Ichijo · · Score: 1

    Reducing your kinetic energy should be your first priority.

    --
    Any sufficiently unpopular but cohesive argument is indistinguishable from trolling.
  13. Chip off the old block by Drunkulus · · Score: 4, Funny

    So the self driving cars act just like an inexperienced millennial who can't drive a stick or read a map, and texts constantly?

    1. Re:Chip off the old block by greenwow · · Score: 0, Flamebait

      My second job is working for a guy that owns several McDonald's. The illegals he employees just don't grok food safety so I imagine Chipotle has it even worse since they don't require a basic ESL test.

  14. Re:what's the plan for moral choice? by mark-t · · Score: 1

    Please describe how, in any kind of physically plausible scenario where one is travelling at a lawful speeds that are actually commensurate with any reduced visibility they may have, one would actually be faced with being unable to stop for five people on the road.

  15. New feature by Anonymous Coward · · Score: 0

    After a passenger eats at Chipotle, the vehicle will automatically set course for the nearest hospital, notify the CDC, and engage biowarfare protection protocols.

    1. Re:New feature by greenwow · · Score: 1

      After a passenger eats at Chipotle, the vehicle will automatically set course for the nearest hospital, ...

      No. They typically only need the nearest toilet.

    2. Re:New feature by Anonymous Coward · · Score: 0

      You mean where Chipotle mixes their taco sauce?

    3. Re:New feature by Anonymous Coward · · Score: 0

      Wrong. I spent three days mostly in the bathroom after E. coli O26 infection from Chipotle. Many of us can't take that much time off of work. My local Chiptole hired too man illegals that can't speak English and don't understand our food safety laws.

    4. Re:New feature by Anonymous Coward · · Score: 0

      He said "typically". I've eaten there 100's of times and never gotten sick, and I'm aware of the E. coli outbreak linked there, it's hardly "typical".

    5. Re:New feature by Anonymous Coward · · Score: 0

      Chipotle hires a lot of Mexicans that can't understand food safety rules. That's why they're so bad while the chain of restaurants I work for have never been in trouble since we require employees to understand English.

  16. Direct link to DMV reports by Anonymous Coward · · Score: 3, Informative

    https://www.dmv.ca.gov/portal/dmv/detail/vr/autonomous/testing

  17. Re:what's the plan for moral choice? by Anonymous Coward · · Score: 0

    What if increasing it would avoid the accident entirely?

    It's odd to me how so many people think the brakes are always the answer. I guess being a guy who rides motorcycles, I understand better than most how getting the hell out of the way is just as important as stopping.

  18. Just to say by Catbeller · · Score: 1

    I told you so.

    1. Re:Just to say by Anonymous Coward · · Score: 0

      I know. Funny how so many things ridiculed here two years ago are being defended now by those same posters after they've turned out exactly as predicted.

  19. Re:what's the plan for moral choice? by fluffernutter · · Score: 4, Insightful

    Trust me, the car is perfectly capable of seeing options you as a driver cannot

    That's the opposite of what the problem is. The backing up truck in Vegas, the woman cyclist, the concrete barrier... why can they NOT see things that people can clearly see? Don't use the excuse that *sometimes* people don't see them either; because people can be distracted, and these cars aren't supposed to be.

    --
    Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
  20. Re:what's the plan for moral choice? by Ichijo · · Score: 1

    Self-driving motorcycles will operate under a different set of rules.

    --
    Any sufficiently unpopular but cohesive argument is indistinguishable from trolling.
  21. GASP by fluffernutter · · Score: 1

    GASP... who would have thought driving was actually hard for a computer to do? Maybe they can keep paying attention EXCEPT when it comes to concrete barriers, or backing up trucks, or pedestrians in the street. But millions of cycles a second means nothing if they're not successfully driving with them.

    --
    Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
  22. Re: APK: pedo or not? by Anonymous Coward · · Score: 0

    No, because no trial ever took place.

    APK is a fine upstanding citizen and a beloved, trusted member of society and this community. Why are you trying to tarnish that good manâ(TM)s reputation? You need to look deep inside of yourself and confront your inner monster lest you become one.

  23. Re:what's the plan for moral choice? by quantaman · · Score: 1

    so if I'm a self driving car with no backup operator, do I prioritize the safety of my passengers? if I have to run down 5 people to keep my rider safe, do I do that? what if I have to do the whole run over your mother / a baby / a nun or run over a bunch of assholes? how are they ever going to solve for this, because whatever it chooses will be wrong

    I don't think it counts. I think it's a simple set of tradeoffs, health > property, life > health, occupants > bystanders.

    Ie, if given a choice between damaging the car or hurting a bystander it will damage the car.

    If given the choice between smoking a pedestrian or a dangerous swerve into the ditch it chooses the ditch.

    But if a pedestrian materializes in the middle of a bridge with no guardrails, well goodbye pedestrian.

    Of course, that's a choice 1 or 2 generations down the line, right now it's a challenge just to keep them from killing people for no reason whatsoever.

    --
    I stole this Sig
  24. Self driving cars will work great... by Anonymous Coward · · Score: 1

    They will work great until some prankster repaints the lines and leads them off the road.

    1. Re:Self driving cars will work great... by taustin · · Score: 1

      My "land departure warning" system goes nuts at sunset, driving west, when there has been tar poured into the cracks in the pavement. The reflections look - to it - just like lane markers.

    2. Re:Self driving cars will work great... by viperidaenz · · Score: 1

      You'll need land departure warning systems when the repainted lines lead your self-driving car off a cliff

    3. Re:Self driving cars will work great... by HornWumpus · · Score: 1

      Acme makes self driving cars?

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    4. Re:Self driving cars will work great... by viperidaenz · · Score: 1

      If they did, maybe the Coyote would have won.

    5. Re:Self driving cars will work great... by Aighearach · · Score: 1

      I saw that cartoon; the self-driving line painting truck ended up chasing its tail right off the cliff, and then a bird on drugs flew past in a Tesla and said something smart.

    6. Re:Self driving cars will work great... by Anonymous Coward · · Score: 0

      Well, clearly he has a flying car - very futuristic.

  25. Re: what's the plan for moral choice? by Anonymous Coward · · Score: 0

    Because mv^2? Velocity is squared to mass in energy tranference. Also breaking will deescalate. During an incident you should already be slowing down to preserve options. There are few exceptions such as rail tracks, but speed is not safety increasing in the first place!

  26. Re:But by Kristoph · · Score: 2

    In their last month of reported testing ( November 2017 ) Waymo only had 1 disengagement, in 30+k miles of driving, because the car couldn't understand the behaviour of another car.

    I am pretty sure I've never driven a stretch of more then 2k miles where I didn't encounter at least one instance of 'unexpected' behavior by another driver.

    I'd say that - even today - there at least some companies which have autonomous vehicles that are safer then most, if not all, drivers. I think it's not an exageration to think that, within 36 months, there will be autonomous cars better then all drivers in most situations.

  27. Re:what's the plan for moral choice? by Anonymous Coward · · Score: 0

    "Trust me..."

    You do realize that's the lead in every single con man in the world uses right? Why should I trust you?

  28. Re:what's the plan for moral choice? by Anonymous Coward · · Score: 1

    Also remember- these cars are solely being tested in some of the BEST conditions for these systems. In real world driving they will be ABYSMAL!!!!

  29. Re: what's the plan for moral choice? by Anonymous Coward · · Score: 0

    Except that the ability to actually comprehend that what is being computed, in your example math, is beyond that of a CPU. It has no comprehension of anything it computes, it just does it. They inherent value of those computations lie in the in the moral fabric of humanity. To choose one scenario over another is not always something that is best decides by a computer devoid of morality.
     

  30. statistics question by Anonymous Coward · · Score: 0

    I am wondering if self driving cars take into account probabilities when making decisions? it seems to me that you can never be 100% safe when driving, and are constantly weighing probabilities constantly in your head. like something similar to a 3d markov chain?? i dunno

  31. Re:what's the plan for moral choice? by Krishnoid · · Score: 2

    I'm curious what your results on the self-driving car quiz would be. Hey, if you do well enough, they could use you to program the next generation of self-driving algorithms! Probably on the 'criminally insane' setting.

  32. Re:what's the plan for moral choice? by JaredOfEuropa · · Score: 2

    Brake as hard as you can, and keep your lane unless an adjacent lane is clear and safe to swerve into. A simple strategy that requires no moral choice and is also fair towards other road users: any other rash action increases the chance you won't hit whatever you were going to hit and probably had no business being in the road in the first place (otherwise you weren't going to collide with it), and increases the chance of hitting an innocent bystander who had nothing to do with you or the obstacle.

    --
    If construction was anything like programming, an incorrectly fitted lock would bring down the entire building...
  33. Re:what's the plan for moral choice? by mark-t · · Score: 1

    I'm not familiar with all of the cases you mentioned, but for the one that I am, it's my understanding that the sensors that were used on the self-driving automobile were inferior to LIDAR, which I suspect may have prevented the accident.

    But modern sensors, despite being superior to human senses, still have some technological limitations. You can't blame the software for what the hardware doesn't see.... at least we know that hardware exists with better acuity than human senses which, when it used correctly, should reduce accidents considerably.

  34. Re:But by Anonymous Coward · · Score: 0

    But, less safe than any driver in the 10^30 situations it hasn't encountered before. Meatbag drivers handle that shit casual, avoid the worst and get on with their business.

  35. SUPPOSE by gDLL · · Score: 1

    .... ever written any piece of code ? Bugs are not suppose to happen... and yet....

  36. Really by Anonymous Coward · · Score: 0

    We will probably never have streets filled with fully autonomous vehicles. It isn't a technology that can realistically be applied to something like driving a car. Isn't going to happen. It was a cool and very expensive tech demo, that's it. We may see them for specialized uses in controlled environments, maybe. People in the Valley really, really need to grow up and join the rest of us in reality.

  37. Sounds like they have the same problems I have by RhettLivingston · · Score: 4, Insightful

    There are times that they can't see the faded lines in the road or the stop lights? Well, yeh. I agree. Same here. And I don't consider that safe either. There are many different inherently unsafe intersections near me. The only difference is that the self-driving vehicle can avoid taking the chance by turning it over to me to take the chance. I honestly don't know if it would be better if it kept control and tried it than handing control to me. But, the buck is passed.

    The biggest problem that autonomous vehicles have to overcome is that they expose the faults in a very bad system through extensive data collection. Exposing faults in something people depend on is never an easy road. The messenger often becomes the victim.

    Like most who have lived more than half a century, I've been in a number of accidents including:

    • During a light drizzling rain, an oncoming vehicle veered into my lane on a sharp turn (cutting the corner). I tried to turn even sharper to run into a yard and avoid the vehicle. My car broke loose and slid semi-sideways into the oncoming vehicle's driver side door. Contact was in my lane. I would not expect an autonomous vehicle to avoid this accident though if the other vehicle with a teenage driver (first year of driving) headed to school had been one of the new self-driving ones, I am confident it would have been avoided.
    • I was stopped in a two-lane highway with blinker on awaiting the passage of oncoming traffic before making a left turn. A vehicle rear ended my vehicle at full highway speed. The driver was a railroad engineer driving five hours to his home after having driven his train route. The collision woke him up. I am pretty sure that if he had been in a self-driving vehicle, that accident would have been avoided.
    • While driving into the sun through a parking lot, I drove down a lane that was not a "thru" lane. The only reason it wasn't was because eight inch high concrete stops had been placed across the lane to prevent thru traffic. I suspect a self-driving vehicle would have detected the barriers across the road and that single car accident would have been avoided. If it didn't, it would do no worse than what I did.
    • While driving through a construction zone at night on a two-lane road with the lanes separated by barrels, a driver from the opposing lanes suddenly attempted an illegal U-turn between the barrels in front of me. I barely had time to even move my foot from the gas to the brake much less stop before swiping across the drivers front end at about 40 mph. Both vehicles were totaled and the mark on my arm from the airbag deployment appears permanent. It is possible that if I had been in a self-driving vehicle that it might have seen her insane turn before I did, but I doubt it. On the other hand, if the distraught grandmother on the way to see her grandchild in the hospital who suddenly realized she had taken the wrong turn off the interstate had been in a self-driving vehicle, she likely would not have even been on that road, much less making an illegal turn.

    Driving is dangerous. Four out of four of the accidents above were because of driving while impaired in some fashion - a teenager unprepared to drive in rain, driving while tired, blinded by the sun while driving (should have stopped or greatly slowed), and driving while distraught. And there are numerous other incidents that didn't rise to the level that I would term an accident that would be reported by these self-driving vehicle regulations.

    Road maintenance is also atrocious in this country and human drivers die because of it every day. Human drivers are also prone to complain that others shouldn't drive while impaired and then make exceptions for their own needs.

    Maybe we should start this conversion by just shining a very bright light on reality - require every new car to be equipped with the sensors to record the reality and disclose every bit of it to the DMV - every solid line crossed, every rolling stop, every time the light is red and we're stil

    1. Re:Sounds like they have the same problems I have by hazardPPP · · Score: 2

      The only difference is that the self-driving vehicle can avoid taking the chance by turning it over to me to take the chance. I honestly don't know if it would be better if it kept control and tried it than handing control to me. But, the buck is passed.

      Herein lies another important problem which is seldom discussed. "Disengagement" only works as an effective safety backstop if you have an experienced driver at the wheel..

      In other words, it only makes sense for the first massively deployed generation of autonomous vehicles, where you can be sure that almost everyone behind the wheel has already spent years driving on their own. However, once you have a generation of people growing up used to being driven around rather than driving, and being driven by the autonomous cars 95% of the time, they will all be bad, inexperienced drivers...and forcing them to take control in situations where a computer doesn't know what to do will probably make things worse. So, beyond the first wave of massively deployed self-driving cars, the car has to be able to handle 100% of the situations or it ain't good for nothing at all. That's why I like the designs without a steering wheel: you either make it all work without a driver in all situations or you don't make it work at all.

    2. Re:Sounds like they have the same problems I have by RhettLivingston · · Score: 1

      True. I'd go a bit further though. When I was a kid and teenager, I rode my bike everywhere and was of course very good at bike riding. After college, I stopped. Twenty years later I got a nice bike for exercise and found that, though I could stay up with my hands on the handlebars, I could no longer ride a bike at all like I did as a teen. I didn't forget the totality of how to ride a bike, but I did forget a lot. How long that really took, I don't know.

      I would bet there is a measurable decrease in responsiveness as a driver in a short time period of not driving - probably less than a year.

      Yes, the cars need to be able to handle everything ASAP. I suspect this means the AI actually needs to be constrained some to force abstraction but inputs need to be increased. It can't learn every situation, so it must learn to recognize situations that are a danger to the vehicle or others according to the nature of the situation - using a deep understanding of physics and potentials. It's the potentials that are difficult. What is the potential of a deer at the edge of the trees 20 feet from the road? Very different from a dog or cow? What is the potential of a plane descending toward the road in the distance? A visible tornado a mile away?

      I have actually encountered a small twin tornado crossing I-70 in St. Louis on 4/14/98. One funnel passed in front of my vehicle and the other behind it at nearly the same time - perhaps a couple hundred yards apart. I saw them when they were perhaps 100 yards from the road and moving fast. I braked a bit to thread my way between them. They went on to trash a furniture store a short distance away. What does LIDAR see with a tornado? A self-driving car might have just stopped in which case the one that passed behind me would have hit me (if not the vehicles behind me).

      As far as inputs go, I have noticed that heavily shaded driver's side windows really bother me because I can't see the driver's face at intersections. This led to a realization that drivers routinely intentionally or unintentionally signal intentions or requests. This needs to be processed and everyone should know it is processed through some sort of feedback, otherwise they may not give the signals to self-driving cars. The same is true with pedestrians. There are many ways in which we sense or they signal their intentions.

      Also, I believe sound input is vital. I think I first noticed the tornadoes mentioned above by sound. A good 3D microphone array should be one of the inputs. This is vital for detecting emergency vehicles in the distance and comparing to the vehicle's knowledge of the map to detect when it might be necessary to switch lanes in preparation for the possibility of needing to give way to an emergency vehicle.

    3. Re:Sounds like they have the same problems I have by Anonymous Coward · · Score: 0

      Most who have live more than half a century? Dude, you're a shitty driver, period. 52. No accidents ever. How do the younguns say it? Git Gud.

  38. Re:what's the plan for moral choice? by fluffernutter · · Score: 3, Insightful

    Well, you can blame the autonomous vehicle company for not using hardware that will give the software enough data to process so that it results in a safe driver. That is the equivalence of allowing grandma to drive after she can no longer see properly from cataracts. You can also blame the company for not correctly interpreting the data from the hardware, which is the equivalent of allowing grandma to drive after she develops serious Alzheimer's.

    It would be one thing if these companies didn't already know their cars have certain flaws. But the fact is, they know they have vast weaknesses and put them out on the road anyway.

    --
    Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
  39. Self-driving cars are going to fail by viperidaenz · · Score: 0

    Facebook just trained their image recognition "AI" with over 3 billion instagram images

    They then only scored 85% in a test.

    Self-driving cars aren't going to be able to recognise what they're looking at. Is it a person crossing the road wearing a big raincoat, or is it a newspaper being blown around in the wind?

    1. Re:Self-driving cars are going to fail by LetterRip · · Score: 1

      Facebook just trained their image recognition "AI" with over 3 billion instagram images

      They then only scored 85% in a test.

      That is "top 1" accuracy. A label of a close up of a car might be labeled "fender" but the AI's first guess is car. Or a picture might have a girl holding a cat, and the guess of the AI is cat, but the picture is labeled girl. Or a picture of a racoon, but the AI guesses cat.

      These are usually either not actual "wrong" guesses, or their wrogness is fairly minor.

      See this article comparing human performance to computer performance for "Top 5".

      http://karpathy.github.io/2014...

    2. Re:Self-driving cars are going to fail by Carewolf · · Score: 1

      Well, the idea many people have of what a self-driving car is, will have to take a fall, but self-driving cars are coming, they will just not be self-driving all the time, but instead either need constant supervision (bad), or only be self-driving on registered road (most likely highways) where the road is up to spec for the computer to navigate it faster and safer than humans.

    3. Re:Self-driving cars are going to fail by swilver · · Score: 1

      ..or a big raincoat with newspaper print on it...

  40. Re:what's the plan for moral choice? by brantondaveperson · · Score: 1

    What if increasing it would avoid the accident entirely?

    A common response from people who think they're a better driver than everyone else. Just drive (ride, whatever) safely, and not at excessive speed. It's not that hard, and you're not in a rush.

  41. Re:what's the plan for moral choice? by Skuld-Chan · · Score: 1

    One of the more recent google self-driving car accidents where they ran into a city bus - the car pulled from a right turn only lane into a traffic lane and didn't see a 30 ton city bus traveling normal speeds.

    While I admit I do have blind spots - busses usually don't hide in them - especially when performing what is essentially an illegal moving violation (if I'm going to try to pull off something that dumb I'm usually a bit more alert about what I'm going to hit).

  42. Re:what's the plan for moral choice? by viperidaenz · · Score: 1

    Until all the cars on the road have LIDAR, and they start interfering with each other. That's going to be a problem with all types of active sensors - LIDAR, RADAR, ultrasonic. etc.
    They all work by sending out a signal and measuring the reflections. That works until there is too much other noise because all the cars around you are also shining their lasers on to the same things you're measuring. Or the laser projections from other cars directly hit the image sensor and throw out the signal to noise ratio it can work with. Or the sun is shining on it, also flooding it with a similar wavelength to the infrared lasers they use.

  43. Get off my non-existent lawn by Anonymous Coward · · Score: 0

    So the self driving cars act just like an inexperienced millennial who can't drive a stick or read a map, and texts constantly?

    I was born in 1991, which makes me Gen Y or "millennial" (uggghhhhhhh). I've been married for 6 years and I have a mortgage. I think you mean Gen-Z. Now get off my non-existent lawn.

  44. Re:what's the plan for moral choice? by The+Grim+Reefer · · Score: 1

    I'm curious what your results on the self-driving car quiz would be. Hey, if you do well enough, they could use you to program the next generation of self-driving algorithms!

    That was a stupid quiz. I wasn't once offered any of the following:

    C. Kill everyone

    D. Set off a dirty bomb

    E. spread Anthrax through the tailpipe of the car

    Probably on the 'criminally insane' setting.

    I'm looking at it as population control a la Death Race 2000.

  45. Re:what's the plan for moral choice? by Loki_1929 · · Score: 1

    Preservation of human life should be your first priority; whatever is required for that (which, admittedly, is typically going to involve reduction in kinetic energy, but will also often involve modification of the path of said kinetic energy). This brings up a really interesting possibility for self-driving cars as the technology improves: the ability for the car to take into account its own safety features (crumple zones, airbags, etc) and the safety features of various things it could crash into in the event of an unavoidable wreck when deciding how to proceed. For example, a direct head-on collision is vastly less dangerous for human occupants than offset head-on collisions, so two autonomous vehicles could potentially negotiate with one another to steer directly into each other (totally counter-intuitive) if circumstances made that the option most likely to preserve life.

    Where might this come into play? Every been on a fairly narrow, windy mountain road? (think coastal mountain highways in California as an example) What happens when an object (be it falling rocks or a reckless cyclist) suddenly drops into the roadway in a completely unpredictable way and there's no guardrail or shoulder on the cliff side of the road? Humans will typically panic in such a situation and react in unpredictable ways, potentially sending someone off the road into an uncontrolled rollover situation or even running over the cyclist. Two autonomous vehicles may mutually decide and communicate to one another in a fraction of a second that by braking to just below the steerable friction threshold while turning directly into one another, odds are extreme high that a simple fender-bender will be the extent of the damage, both vehicles will remain fully operational, and no human beings will sustain any serious injuries. Still an accident, but a nice, controlled wreck where everyone leaves unharmed. Should those circumstance be between a car and a motorcycle, perhaps the autonomous car decides that braking hard while steering slightly into the cliff wall best preserves human life.

    In any case, whatever the challenges are that exist today, the naysayers will inevitably lose in the end because humans are incredibly poorly adapted for operating motor vehicles. I say this as someone who loves to drive and will probably continue to drive manually so long as it's legal to do so. But if computers aren't already better overall drivers than humans, they absolutely will be within a decade or less.

    --
    -- "Government is the great fiction through which everybody endeavors to live at the expense of everybody else."
  46. Re:what's the plan for moral choice? by Anonymous Coward · · Score: 0

    I am not going to trust you. Sure, a computer can do the math faster, but a human brain is not evaluating the problem as a series of calculations. Both require training to know what options are possible, good and what the side effects are. From what I have seen, Humans are better at making leaps of logic between them (and sometime logic leaps off the proverbial cliff).

  47. Re:But by Anonymous Coward · · Score: 0

    It must be nice to be this optimistic. The numbers will inevitably prove you wrong, of course. The companies who are working on autonomous vehicles think this will just require a certain amount of engineering know-how to make it work, without taking into account how much effort already goes into making roads and highways safe for human drivers. The companies are developing a technology for a system that relies on constant road maintenance and repair, lane markings, car safety regulations, driver training, complex right-of-way rules, and constant policing. Of course you say "a solution is only 36 months away", because billions of dollars are spent every year keeping the roads as safe as they currently are.

    The research is only possible because of the externalized costs of the research environment, but the safety of that environment will be built into the technology, ensuring that it does not actually work in those pesky situations where it really matters. And as the number of people killed by autonomous goes up, the justifications for the technology will become more difficult to swallow.

  48. Re:But by Anonymous Coward · · Score: 0

    I think I have seen this account name before. You are that guy who loves AI, aren't you?

  49. Re:what's the plan for moral choice? by mark-t · · Score: 1

    One laser can intersect another, and they don't interfere with eachother. They can each have their own modulation and so can be detected individually, regardless of other vehicles using the same technology. Current technology can do millions of these per second.

    If car is mistaking sunlight for its own LIDAR signal, then the software is at fault, not the hardware.

  50. Triangle by Anonymous Coward · · Score: 0

    Back in 86 at Michigan State I took an experimental c++ course. We were given a bunch of data points and required to drive a car around a course with obstacles etc. I was so proud of my work. I settled in for my demo. The professor said your course is a triangle. Oh god my car flipped out and just did a hard right off the track. I didn't code for that. Ugh!!! Not sure my point. But it was awful.

  51. Re:what's the plan for moral choice? by fluffernutter · · Score: 1

    In this situation it was a failure of the AI to understand what a bus is and how it inherently behaves. The SDC assumed the bus would stop quickly to allow right of way, but of course buses can't just stop like that because of the riders inside; something humans inherently know.

    --
    Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
  52. Re:what's the plan for moral choice? by fluffernutter · · Score: 1

    Every kind of sensor has a weakness. Lidar doesn't work in fog, heavy snow and rain or if there is dirt on the sensor. Cameras don't work if they are dirty. The question is whether a few different types of sensors will ever be put together in a way that works all the time and is still affordable to a consumer.

    --
    Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
  53. Re:what's the plan for moral choice? by Anonymous Coward · · Score: 0

    In a swerve / recover situation, the part of the correct response is to use the accelerator.

    So yes actually, you just proved you, not the OP are one of those that doesnt know about driving.

  54. Re:what's the plan for moral choice? by CaffeinatedBacon · · Score: 1

    No, it's like putting a perfectly competent driver in a car when, for only lots of added expense, you could put in two like planes or driver training cars.
    It's the equivalent of complaining when something is 5x better that it's not 6x better.

  55. Re:what's the plan for moral choice? by MoaDweeb · · Score: 1

    If the cyclist qualifies as a MAMIL* then run him down. You are doing us all a favour.

    *Middle aged man in lycra.

    --
    New Zealanders are well balanced with a chip on each shoulder. One represents Australia, the other the rest of the world
  56. Re:what's the plan for moral choice? by Anonymous Coward · · Score: 0

    You are already in a bad situation that you have lost control of. By definition you don't know all the variables/outcomes. Making quick decisions without all the data is the most likely way to cause an accident, and you are already in one.
    What could possibly go wrong.... Yes instead of slowing down and having a minor collision with a subcompact, try speeding up and going around it, and totalling yourself on that semi you didn't notice until too late.

  57. Re:But by goose-incarnated · · Score: 1

    Humans are unlikely to improve at driving. Software can potentially be improved on.

    And the halting problem can potentially be solved too.

    Tell you what, lets wait until the potential is achieved before assuming that it will be achieved.

    --
    I'm a minority race. Save your vitriol for white people.
  58. Re:But by Anonymous Coward · · Score: 0

    Humans can easily improve at driving, but no politicians want to be kicked out of office when they attempt to mandate additional drivers license requirements. Have you taken a defense driving class? Been able to practice swerves, tire blowouts, etc... in controlled environments? Did your tester walk around your car to ensure all your mirrors were aligned correctly? Do gas stations require you to check all tires before pumping gas? There are tons of room for improvements.

    Software can making driving near perfect. It'll take a while, but it could do it. It would be easier if we modified road ways to help it.

  59. Re:But by goose-incarnated · · Score: 1

    In their last month of reported testing ( November 2017 ) Waymo only had 1 disengagement, in 30+k miles of driving, because the car couldn't understand the behaviour of another car.

    The average driver averages 1 accident every 250000km and 500000km, not 1 accident every 30000 miles. This includes the pool of all drivers, by the way: those who are drunk, speeding, texting, phoning, etc while driving.

    I'm waiting for SDCs performance to be as good as the average driver.

    --
    I'm a minority race. Save your vitriol for white people.
  60. Exactly this! by Anonymous Coward · · Score: 0

    A company would have to be run by complete and absolute morons to ever even suggest trying to make the AI perform "moral choices." In nearly 100% of situations, you slow down, and, maybe if possible without hitting another detected object, swerve around the obstacle if it is completely stationary or already moving in the opposite direction of the potential swerve. If there's nowhere to easily and safely swerve, you just reduce your speed as much as possible before the likely collision to limit kinetic energy (and hence damage/loss of life) as much as possible. At no point should a self driving car ever make any "moral choice" period (and frankly, people probably shouldn't try to either. Thinking about it WILL cause you to hesitate, and that moment of hesitation could easily make the difference between avoiding a collision entirely and failing to avoid one).

  61. Re:But by Gavagai80 · · Score: 1

    A disengagement is not necessarily a would-be-accident.

    --
    This space intentionally left blank
  62. We're 50 years away from this level of AI by slashmydots · · Score: 1

    Driving into the sun, any kind of snow, hydroplaning, hard to identify objects in the road, road construction, pedestrians doing stupid stuff, other drivers not following predictable actions or laws, driving in the rain, sensors failing due to age and wear, and about 100 other items are unsolvable problems that our level of technology, especially AI, is nowhere near yet. This is like all those "before their time" inventions in the 50's. The technology just wasn't there to make it real no matter how convincingly they presented it. AI would have to be at human 3D and visual processing level or better and the best AI in the world is around cockroach level intelligence currently, with the best measurement estimate.

  63. Re:what's the plan for moral choice? by Aighearach · · Score: 1

    Too.

  64. Re:what's the plan for moral choice? by Anonymous Coward · · Score: 0

    I'm not familiar with all of the cases you mentioned

    The truck in Vegas was a case of a self driving bus stopping in the blind spot of a truck as it could not pass. The truck was slowly backing out of a driveway (illegally) and the bus just stood there waiting, not taking any measure to evade or signal the truck driver. Basically it was hit in a situation that any human driver could have easily avoided.

    the woman cyclist

    That is the case were people believe that Uber wasn't using LIDAR.

    the concrete barrier

    A Tesla driver trusting the Autopilot feature to just work on the same road it worked flawlessly in the past. I think they issued a software update the day before and his car made a beeline for the barrier. It basically boils down to another Tesla driver trusting the hype, ignoring the "keep your hands on the wheel" requirement that Tesla doesn't seem to enforce.

  65. Re:But by Aighearach · · Score: 1

    A disengagement is the equivalent of my wife warning me about an approaching object before I see it, even though I keep my eyes glued to the task at hand even on a long trip.

    Yes, I see the bicycle, thank you. Yes, I see the pedestrian, thank you. Yes, I see that person in front of us driving like an idiot; there's one behind us, too! Eventually we get to, oh yes, thank you, I didn't see that goat on the shoulder. That's the equivalent of a disengagement. But a goat is unlikely to jump in the street.

    If you look at the reports, some companies the disengagements are situations where they almost killed somebody. Waymo disengagements are more like the goat on the shoulder. Eventually the government will figure the testing out, and then the wheat will be separated from the chaff.

  66. Re:But by Anonymous Coward · · Score: 0

    Some humans are probably very unlikely to improve. I took at Tesla Model S taxi to the Airport yesterday, some 20 km. The driver drove like a car thief and almost got into two collisions with equally reckless drivers. If the driver hade left the car in autopilot mode with oranges on the wheel, I would probably have been safer.

    The sooner we can have self-driving cars, the better.

  67. Re:But by hazardPPP · · Score: 2, Informative

    Humans are unlikely to improve at driving.

    Which human drivers, though?

    Looking at road death statistics would seem to suggest that German drivers are a lot better than American drivers, while for instance Russian drivers are a lot worse. Now it's not all due to quality of driving (but also quality of roads, law enforcement, car safety standards, etc.) and the quality of driving itself is impacted by many factors, but we can safely say for instance that drunk driving is a huge problem in Russia that contributes a lot to their death rate being higher than America's, while the far more stringent process of driver training and driver certification in Germany contributes a lot to their death rate being lower.

    The companies developing self-driving cars, being either American or doing most of their testing in America, seem to take American drivers as the baseline. However, looking around the world one can conclude that American drivers could indeed improve quite a bit. Not to mention that historically, drivers have improved...most places in North America, any moron can easily get a driver's license. Even that's an improvement based on the situation several decades ago, surely it can be improved still.

  68. Re:what's the plan for moral choice? by Torvac · · Score: 1

    well what would be your plan ?

  69. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion

  70. Re:what's the plan for moral choice? by Anonymous Coward · · Score: 0

    If you can drive in fog, rain or snow where LIDAR fails, then you won't need it in fair weather at all and there is no need for it.

    Why? Driving in adverse conditions is harder than driving on a sunny day. So if you can manage that without LIDAR, why install it at all?

    On the other hand, if you can't drive without LIDAR, the idea of autonomous cars is already dead since people will not buy/use a car that is unable to drive in rainy weather.

    So in short, LIDAR is not necessary.

  71. Re:what's the plan for moral choice? by thegarbz · · Score: 2

    I'm sorry but autonomous cars should never need a connection to an Active Directory server.

  72. Re:what's the plan for moral choice? by thegarbz · · Score: 1

    how are they ever going to solve for this, because whatever it chooses will be wrong

    Do what humans do. Step on the brake and hope for the best. The goal of self driving cars is not to solve moral question that don't actually apply in the real world anyway.

  73. Re:what's the plan for moral choice? by thegarbz · · Score: 1

    Oh wait, avoid the nun and run a bus full of orphans off of a cliff.

    Yep, username checks out.

  74. But can they drive in HIGH WINDs? by Anonymous Coward · · Score: 0

    If you've ever driven in high wind situations, you know that they require a constant battle to stay on course.
    Also, especially for higher profile vehicles, one must drive extra cautiously. Furthermore, the cruise-control
    will require constant adjustment especially in variable winds. I would like to know if they can do all of
    that.

  75. Re:what's the plan for moral choice? by jeremyp · · Score: 1

    I'm British so I am not fully cognisant of US driving rules. Why would a car in a right turn only lane have right of way over a bus in a lane to its left? In the UK, if you change lanes, you have to give way to traffic already in that lane.

    It seems to me more likely that the self driving car simply did not detect the bus. Either that or it didn't understand the rules of the road.

    --
    All I want is a secure system where it's easy to do anything I want. Is that too much to ask ~~ Randall Munroe
  76. Re:what's the plan for moral choice? by Anonymous Coward · · Score: 0

    Those weren't autonomous cars. Those were incidents of stupid drivers mis-using cruise control.

  77. Re:But by coofercat · · Score: 1

    So if a self-driving car can work in America, it'll probably do just fine in Germany. It'll probably struggle in Russia though.

  78. Reason says... by jbmartin6 · · Score: 1

    Even if there are failure cases for autonomous cars, if the overall safety is significantly less than human drivers reason says we should implement post haste. But the reality is humans are emotional thinkers, and we likely won't accept that. The first time a self-driving car runs over a kid we will be pulling them all off the road even though ten other kids were run over by humans the same day.

    --
    This posting is provided 'AS IS' without warranty of any kind, implied or otherwise.
    1. Re:Reason says... by fluffernutter · · Score: 1

      If there were ten million automated cars on the road and everyone saw them driving around successfully all the time, but then they hit one kid, it wouldn't be that much of a problem. But the fact of the matter is, there are only a handful of these on the road running in places that are carefully selected as being perfect conditions for them to drive in and they are still killing people. That's what the problem is, and in this case, emotional response is the correct one.

      --
      Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
  79. Re:But by rtb61 · · Score: 1

    It can be a whole lot safer and Elon was on the right track with the Boring company, just not on target. That is an underground system, in tunnels, a controlled environment, where you would catch a vehicle much like a turbolift and it will take you where you want to go. You could even own your own lift and have a parking spot, would not be cheap. So replace, taxis, public and private transport in major metropolitan areas, every current road would have an underground tunnel system, proving that controlled automated transport environment. It would not necessarily have to be magnetic suspension but could be wheels in enclosed tracks, with track switching to change direction.

    Far more sensible than trying to make roads work under increasing traffic loads.

    --
    Chaos - everything, everywhere, everywhen
  80. Re:what's the plan for moral choice? by mjwx · · Score: 3, Funny

    I'm sorry but autonomous cars should never need a connection to an Active Directory server.

    How else will cars know who is and isn't an authorised user? Are you honestly suggesting we use OpenLDAP instead... what's next, Sendmail to replace the CANBUS?

    --
    Calling someone a "hater" only means you can not rationally rebut their argument.
  81. Re:what's the plan for moral choice? by fluffernutter · · Score: 1

    The lane markings were murky, because it was a parking lane that the automated car was partly in. The automated car had to steer around a sandbag by the curb though. The automated car thought it was already in the same lane as the bus (not merging into a lane) and so had right of way since it was in front. Or, it could not have seen the bus at all... possible. I would really hope it saw the bus.

    --
    Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
  82. Trees and pedestrians the death of auto-cars? by omfglearntoplay · · Score: 1

    Trees block traffic lights and GPS signals. Pedestrians aren't always seen by the bot-cars. So unless you live in a desert, once in a while your car is going to try to kill you or a pedestrian.

    There is no way all traffic lights are going to be networked to talk to vehicles in the US. I predict "bot-car friendly roads" will be marked as such, and cars will have to shut down autopilot type driving in all other areas.

  83. Re:But by Anonymous Coward · · Score: 0

    But we all know that autonomous driving is safer than humans. The tech companies have told us that. They even have whitepapers and actual numbers based on tens of thousands of logged miles. Don't you trust them?

    None of what you have said is inconsistent with there being issues to work on with autonomous driving.

  84. Re:But by Anonymous Coward · · Score: 0

    Streets and roads are a huge factor as well.

    Streets and roads in the US are designed to be very forgiving to drivers, and tries to optimize for automobile speed and minimize stopping. To use one local example, pedestrians complained about drivers at an intersection, so the city put in a small concrete median - then when too many cars were hitting the median, they removed it. Think about that for a moment - the city put in a safety device and then when drivers couldn't stop hitting it, the solution was to remove the safety device and revert the street back to how it was before.

  85. Re:what's the plan for moral choice? by Anonymous Coward · · Score: 0

    can LIDAR read expressions? Can it tell that the pedestrian is turning head left right in an obvious posture preceding stepping out into the street? Can it tell that the pedestrians head is tracking a vehicle and infer what that implies? Can it observe that the driver in front of you is texting or otherwise behaving dangerously and back off to increase safety distance? Can it avoid leaving too much safety distance to avoid enticing a driver with different risk tolerance from abruptly cutting them off?

    This sort of overall situational awareness is not just "there's an object at position x,y moving with velocity i in direction j."

    It would be one thing if all road conditions were fixed and all vehicles became self-driving at a single instant. Having to share the road with human drivers means they have to have the same degree of flexibility -- which at present seems vanishingly unlikely.

    Comments about interstate only driving miss the problems with rush hour traffic -- don't expect interstate driving to be safe for a self-driving car anywhere near a significant urban center during certain times.

  86. Re:what's the plan for moral choice? by fluffernutter · · Score: 1

    Your argument would make sense if we hadn't already seen many accidents that are clearly due to the vehicle not seeing or interpreting things as well as a human.

    --
    Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
  87. Re:what's the plan for moral choice? by CaffeinatedBacon · · Score: 1

    Your argument would make more sense if people didn't crash every single day.

  88. I vote we give up by ausekilis · · Score: 1

    Lets start building the vacuum-powered hamster tubes from Futurama.

  89. Re:what's the plan for moral choice? by cascadingstylesheet · · Score: 1

    so if I'm a self driving car with no backup operator, do I prioritize the safety of my passengers? if I have to run down 5 people to keep my rider safe, do I do that? what if I have to do the whole run over your mother / a baby / a nun or run over a bunch of assholes? how are they ever going to solve for this, because whatever it chooses will be wrong

    No need for moral choices (and no capability for it anyway with machines) ... how about just don't hit stuff?

    I think that pretty much covers it? ;)

  90. Re:what's the plan for moral choice? by fluffernutter · · Score: 1

    People crash once every 57,000 miles. No automation can touch that.

    --
    Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
  91. Re:what's the plan for moral choice? by CaffeinatedBacon · · Score: 1

    And how many of those crashes would be avoided if the car also had better sensors or simply more competent drivers?

  92. Re:what's the plan for moral choice? by fluffernutter · · Score: 1

    I don't see what this has to do with the fact that automated cars aren't really ready to be on the road yet.

    --
    Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
  93. Re:But by goose-incarnated · · Score: 1

    A disengagement is the equivalent of my wife warning me about an approaching object before I see it

    No. A disengagement is when the car has to be actively prevented from killing someone.

    (What makes you think your characterisation is the correct one? A disengagement is basically the car saying "I dunno").

    --
    I'm a minority race. Save your vitriol for white people.
  94. Re:But by OrangeTide · · Score: 1

    And the halting problem can potentially be solved too.

    I believe it has been proven not to be solvable for general cases. As there is a simple example where halting is indeterminate so we know that the general solution doesn't exist.

    Tell you what, lets wait until the potential is achieved before assuming that it will be achieved.

    You overlooked the hedge word in my statement. Words like potentially, maybe, or might, indicate a lack of commitment by the speaker. In this case it because I feel there is a lack of concrete proof, and not because I'm trying to use weasel words to make vague statements.

    --
    “Common sense is not so common.” — Voltaire
  95. Re:what's the plan for moral choice? by nasch · · Score: 1

    According to some research, automated cars crash less than human drivers. 1.6 compared to 2.5 crashes per million miles for the most severe category of accidents, and 5.6 compared to 14.4 for the least. The problem is those miles are not really comparable to the entire set of miles driven by humans. I would say the answer is nobody really knows how safe they are compared to people.

    https://www.vtti.vt.edu/featur...

  96. Re:what's the plan for moral choice? by david_thornley · · Score: 1

    I've accelerated to successfully avoid an accident before, although not all that frequently. If there's an accident waiting to happen in one place, and I'm somewhere else by then, no problem.

    --
    "When you have eliminated the unacceptable, whatever is left, however improbable, must be the truthiness" - Holmes
  97. Re:what's the plan for moral choice? by nasch · · Score: 1

    I'm not sure that's the best strategy. Consider traveling on a highway at 65 mph. The (human driven) car ahead swerves aside to reveal a nearly stationary vehicle or other large object. Both lanes to the sides are occupied. Is it better to hit the vehicle ahead at whatever speed you'll be traveling after max braking, or gently sideswipe one of the cars to the side? Maybe the car to the side can get over into an empty lane or shoulder and it will be a very mild accident.

  98. The good and bad by Anonymous Coward · · Score: 0

    The good thing about this is that there are tons of poorly engineered roads, intersections, and road signs all over. When you complain about one of these, the city traffic engineers tell you to go fuck yourself. However, Google and its buddies have enough clout to get these things fixed. Currently, Calif is making freeway stripes wider to be more visible to self-driving cars.

    Unfortunately, there are going to be plenty of issues that bother ONLY self-driving cars. Google and its buddies also have the clout to get those things fixed. But, guess who is going to be paying for that. Not Google, my friend; the bell tolls for thee.

  99. Wait 10 years and problem solved by Anonymous Coward · · Score: 0

    ......global warming

  100. Re:what's the plan for moral choice? by mark-t · · Score: 1

    LIDAR's primary advantage over human senses is its ability to see things in the dark. It can be combined with other types of imaging technologies in other situations to create an impression of the surrounding environment that,while it might be technically more limited than what is ordinarily capable of by any extant adverse conditions, will still generally be superior to what a human being is capable of in the exact same conditions.

  101. Re:what's the plan for moral choice? by JaredOfEuropa · · Score: 1

    There's always going to be exceptions and unforeseeable consequences. Maybe you'll squeeze by, or just maybe you'll gently nudge the car next to you into an oncoming bus full of nuns. If the adjacent lanes are not clear and there's no room to squeeze by (something the car should be able to determine in microseconds), attempting to slow down as much as you can might still be the best strategy even in this scenario.

    --
    If construction was anything like programming, an incorrectly fitted lock would bring down the entire building...
  102. Hand signals? by Anonymous Coward · · Score: 0

    I've been wondering - is there a single autonomous vehicle out there that recognises hand signals from cyclists?

  103. Re:what's the plan for moral choice? by nasch · · Score: 1

    attempting to slow down as much as you can might still be the best strategy even in this scenario.

    It certainly might, and clearly often will be. But it won't always be the best strategy, which is what it sounded like you were saying.

  104. Re:what's the plan for moral choice? by CaffeinatedBacon · · Score: 1

    You were complaining that they weren't perfect, they are still closer to perfect than people. (In the situations they are being used in) They aren't ready yet to take over.

  105. Re:what's the plan for moral choice? by Anonymous Coward · · Score: 0

    >automated cars crash less than human drivers. 1.6 compared to 2.5

    they drive in IDEAL circumstances and are BARELY 50% better.

  106. Re:what's the plan for moral choice? by Skuld-Chan · · Score: 1

    Its the same rules in the US (except reversed) - if you watch the video:

    https://www.youtube.com/watch?...

    The car is in a right turn only lane - the bus didn't have to yield at all - however there aren't clear lane markings. Also the bus was only going 15 mph. Very clearly a moving violation.

    Even if it was a parking lane like others have suggested (which its also illegal to be parked so close to an intersection) - the person parked has to yield to moving traffic.

  107. Re:what's the plan for moral choice? by CaffeinatedBacon · · Score: 1

    Yes, so they are better, tell fluffy nuts.
    And since when is 50% more of anything barely, in all caps even...