Slashdot Mirror


There's Growing Evidence Tesla's Autopilot Handles Lane Dividers Poorly (arstechnica.com)

An anonymous reader writes: Within the past week, two Tesla crashes have been reported while Autopilot was engaged, and both involved a Tesla vehicle slamming into a highway divider. One of the crashes resulted in the death of Walter Huang, a Tesla customer with a Model X. The other crash resulted in minor injuries to the driver, thanks largely to a working highway safety barrier in front of the concrete divider. Ars Technica reports on the growing evidence that Tesla's Autopilot handles lane dividers poorly: "The September crash isn't the only evidence that has emerged that Tesla's Autopilot feature doesn't deal well with highway lane dividers. At least two people have uploaded videos to YouTube showing their Tesla vehicles steering toward concrete barriers. One driver grabbed the wheel to prevent a collision, while the other slammed on the brakes. Tesla argues that this issue doesn't necessarily mean that Autopilot is unsafe. 'Autopilot is intended for use only with a fully attentive driver,' a Tesla spokesperson told KGO-TV. Tesla argues that Autopilot can't prevent all accidents but that it makes accidents less likely. There's some data to back this up. A 2017 study by the National Highway Transportation Safety Administration (NHTSA) found that the rate of accidents dropped by 40 percent after the introduction of Autopilot. And Tesla argues that Autopilot-equipped Tesla cars have gone 320 million miles per fatality, much better than the 86 million miles for the average car. These figures don't necessarily settle the debate. That NHTSA figure doesn't break down the severity of crashes -- it's possible that Autopilot prevents relatively minor crashes but is less effective at preventing the most serious crashes. And as some Ars commenters have pointed out, luxury cars generally have fewer fatalities than the average vehicle. So it's possible that Tesla cars' low crash rates have more to do with its wealthy customer base than its Autopilot technology. What we can say, at a minimum, is that there's little evidence that Autopilot makes Tesla drivers less safe. And we can expect Tesla to steadily improve the car's capabilities over time."

34 of 238 comments (clear)

  1. wrong statistic by phantomfive · · Score: 5, Interesting

    You don't want to know how many accidents there were in cars with autopilot, that doesn't matter. What you want to know is miles per accident *with autopilot engaged.* Using the other number is highly misleading.

    --
    "First they came for the slanderers and i said nothing."
    1. Re:wrong statistic by RhettLivingston · · Score: 2

      I agree. Given that the average incident rate is much lower and assuming that the accident rate without autopilot engaged is likely the same, the incidents with autopilot engaged has to be much, much lower to bring the overall average down that much.

    2. Re:wrong statistic by viperidaenz · · Score: 4, Insightful

      Given that all cars in the 320 million miles/fatality are modern 5 star safety rated and the cars in the 86 million miles/fatality are average cars, you can't make the the assumption that the correlation between incidents and fatalities are the same for both groups.

      If you want to compare Autopilot cars with non-autopilot cars, the cars you compare it to also should have the same standard safety features:
      automatic emergency braking
      a dozen or so air bags
      stability control
      abs
      5 star impact rating
      front and side collision warnings

      All features that are available on other new vehicles.
      Then it's a fair comparison.

    3. Re:wrong statistic by dmpot · · Score: 4, Interesting

      Also you should compare cars under the similar driving conditions. Currently, autopilots refuse to function in difficult road conditions, while human drivers do.

    4. Re:wrong statistic by larryjoe · · Score: 2

      You don't want to know how many accidents there were in cars with autopilot, that doesn't matter. What you want to know is miles per accident *with autopilot engaged.* Using the other number is highly misleading.

      Exactly. Furthermore, it's very likely that Tesla knows the number of number miles and accidents with Autopilot on and off. So, they could trot out the comparative mean miles between accidents/fatalities if it were in their favor. That they don't implies that the comparative numbers are either similar or worse with Autopilot.

    5. Re:wrong statistic by AmiMoJo · · Score: 3, Insightful

      It's not a like-for-like comparison though.

      Tesla cars are expensive. You have to be well off to own one, which means you are much less likely to be taking risks like driving drunk or on drugs. Having spent all that money on a car, you are probably going to look after it and not take the same risks you would in a $1000 banger. You are also likely travelling very different roads, better maintained and at less congested times of the day. Your car is likely to be well maintained.

      So comparing to the average, especially in the US where regulations are relatively lax, is misleading. A fair comparison would be with accident rates among luxury cars in a similar price bracket. Audi, Lexus, Mercedes.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
  2. Sigh, I just don't get it by zippo01 · · Score: 4, Insightful

    What is the point to an autopilot if I have to be fully attentive and ready to take over? I would rather just drive then worry about missing something. This and the are still have to much uncertainty to waist my time with it. Also dammit if i'm going to die in a car, I want it to be my fault and freaking awesome. "He almost made it, if it hadn't been for that ...."

    1. Re:Sigh, I just don't get it by jschultz410 · · Score: 2

      What is the point to an autopilot if I have to be fully attentive and ready to take over?

      Mainly, that is just unfortunate lawyer CYA language so they have an easy cop out for situations like this.

      "Oh, our ridiculously named system soiled the bed? That's YOUR fault."

    2. Re:Sigh, I just don't get it by Anonymous Coward · · Score: 4, Insightful

      If you have to pay attention then autopilot is less than useless. The fact it is in control makes it much more likely you will not be paying attention.

    3. Re:Sigh, I just don't get it by Mr+D+from+63 · · Score: 5, Insightful

      1. Safety. Despite the alarmism in TFA, you are safer using Autopilot than driving yourself.

      Why do people keep claiming this as some kind of fact when they don't have any data to back it up? We've been through the flaws of using the "40%" study, which was supposed to compare before AP vs after AP but 2/3 of the cars in the study didn't have any 'before AP' miles. Not to mention other control features were never accounted for such as Auto Steer.

      Tesla with AP may be a lot safer, but we don't have the data to make that declaration. So please stop abusing statistics.

    4. Re:Sigh, I just don't get it by Obfuscant · · Score: 2

      1. Safety. Despite the alarmism in TFA, you are safer using Autopilot than driving yourself.

      You might think so, but there are often unintended consequences.

      It was either anti-lock brakes or all wheel drive that was supposed to decrease accident rates but actually increased them, at least for a while. It was because drivers expected them to work in situations where they weren't going to and they took greater risks because they were "safer".

      I would expect that "autopilot" has the same consequence. "I've put it in autopilot mode, I can now safely text everyone about my wonderful experience while riding in a Tesla 8(@%} NO CARRIER...

      If nothing else, drivers may be lulled into doing what the driver in an Allstate insurance commercial does: look down below his seat to find his buzzing cell phone. After all, "autopilot" and "automatic braking" will keep him from running into the back end of the car stopped at a red light ahead of him -- which is what happens to the Allstate driver.

      Progress requires guinea pigs.

      I think this is one of the few times I've seen an AV supporter admit that human beings are going to be sacrificial test animals in the search for AV safety.

    5. Re:Sigh, I just don't get it by Junta · · Score: 2

      Additionally, they assert safety of AP relative to *all other vehicles* in *all conditions*. It is in fact highly likely that systems with auto braking and lane alarms (without just doing all the steering for you) are safer than autopilot. Such systems don't really allow for a driver to stop paying attention compared to autopilot's system (there's nagging and then there's "your car simply doesn't go unless you actively are steering it").

      This is one of the things that royally aggravates me about Tesla, they are so smug about their belief that autopilot is unambiguously the most safe answer, and are dangerously reckless in that belief.

      --
      XML is like violence. If it doesn't solve the problem, use more.
    6. Re:Sigh, I just don't get it by Type44Q · · Score: 2

      What is the point to an autopilot if I have to be fully attentive and ready to take over?

      Kansas. No, really; ever had to drive across that shit??

    7. Re:Sigh, I just don't get it by dgatwood · · Score: 2

      What is the point to an autopilot if I have to be fully attentive and ready to take over?

      Simple: If you fall asleep behind the wheel of a Tesla with Autosteer engaged, odds are good that you will survive the experience. If you fall asleep behind the wheel of a car without Autosteer, you probably won't.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    8. Re:Sigh, I just don't get it by BasilBrush · · Score: 2

      Fatigue. If you're driving a long distance, you will arrive less fatigued it your hands haven't spent hours doing micro-management of steering wheel position. Just as existing cruise control and adaptive cruise control gave that benefit to your right foot. And it's not just muscular fatigue, it's the mental fatigue of micromanaging.

      Autopilot lets you take one step back. You are acting as the manager of the drive, not the worker doing the driving.

  3. Sounds like a philosophy 101 question by RightwingNutjob · · Score: 5, Interesting

    The intentionally misnamed "autopilot" may reduce the likelihood of wandering out of your well-marked lane in clear conditions at highways speed but every once in a while it'll drive you right into an obstacle. Reminds me of those "push this button and ten people with terminal cancer get cured but two other random people die from a meteor strike" questions taught in philosophy classes with the intent of humbling people who might otherwise believe they can quantify their way through every obstacle.

    1. Re:Sounds like a philosophy 101 question by DatbeDank · · Score: 5, Insightful

      The intentionally misnamed "autopilot"

      I don't know why you think it is misnamed. It is named exactly the same way that aircraft autopilots are. Aircraft autopilots also require an attentive pilot ready to take over, because aircraft autopilots will happily fly the airplane into obstructions, or can fail in a large number of other ways. In fact, "can disable autopilot" is a standard pilot checklist item, and it can be done in half a dozen different ways.

      Seems like the Tesla "autopilot" is named just right.

      I take it you've never flown as a pilot before. No really, it's ok because most people aren't pilots :P

      My roadway is as big as the horizon. My fellow pilots in other planes are several hundred meters if not kilometers away.
      In my car, my fellow drivers are 1.5-2 meters away and my roadway is as big as the city planners decide to make it.

      On larger jets, they have systems that monitor you with transponders and much more. If you're aiming to the ground, the system will shout at you in a Skybus or Boeing jet.

      A few seconds of inattentiveness with autopilot on in a plane won't hurt anyone. Heck I read a book sometimes.
      A few seconds of inattentive in a passenger car (with or without Tesla autopilit) will at best cause a crash or worse kill you.

      Call it cruise control assist and save a few live or call it MuskSense if you want something sexy and to achieve the same thing. Autopilot is just a terrible misnomer for what it really is.

    2. Re:Sounds like a philosophy 101 question by jschultz410 · · Score: 2

      You can certainly make the questions progressively more difficult to answer until it basically becomes a six of one, half a dozen of the other situation. My point was that the first question as posed was a no brainer.

      To your specific question, no, I would not save 3 80 year olds (smokers or non-smokers) to kill 2 children. The 80 year olds have already lived full lives and are near death regardless due to natural causes. Collectively, the 2 children probably have much more life ahead of them than the 3 80 year olds.

    3. Re:Sounds like a philosophy 101 question by Junta · · Score: 5, Insightful

      This all misses the point: the vast majority of people are not pilots, everything they think about 'autopilot' comes from tv shows and media and every thing they deal with that is 'auto' in their lives meaning not having to worry about it.

      Pilots can debate the accuracy of the term given the reality of the situation, but what matters is the lay man's perspective (which is precisely what Tesla is trying to take advantage of).

      --
      XML is like violence. If it doesn't solve the problem, use more.
    4. Re:Sounds like a philosophy 101 question by jschultz410 · · Score: 2

      You are being purposely obtuse.

      Allow me to rephrase: the problem of implementing a safe autopilot for a plane is VASTLY, HUGELY easier than implementing a safe autopilot for a car.

      There are very good reasons why autopilots for planes have existed for over a century while the first tentative forays into building autopilots for cars have just now begun after many enormous advances in computation, radar, computer vision, sensing, AI, etc., etc., etc.

      Most importantly, in a plane if the autopilot can simply maintain altitude and direction, then the vast majority of the time that will be safe for a long period of time. Try to simply go straight in a car for more than 10 seconds and you will likely end up in a ditch at best on all but the biggest and straightest highways.

      Do you remember Payne Stewart's death? His plane flew on autopilot across most of central USA and only crashed because it ran out of fuel.

      You are comparing apples to Godzilla and saying "yeah, they sound about the same."

    5. Re:Sounds like a philosophy 101 question by froggyjojodaddy · · Score: 2

      I think the root of the problem might actually be the fact that most people confuse 'autopilot' with 'autonomous driving'.

      The former is just a series of cameras, logic, sensors, and software designed to identify and navigate around fairly obvious things like a truck or large vehicle in front of you. The latter lets you take your hands off the wheel and not pay real attention to what's going on. Think of it as being similar to a train. You take your seat and the train gets you to your destination with zero input from you. You don't need to worry about a cow on the tracks because something/someone else is monitoring that.

      I have a 2017 Ford Fusion with lane assist and adaptive cruise control. It's a neat trick to show my passengers how the car will auto-steer itself back to it's lane if I let it wander across the line. Of course, this is done when the road is empty, doing around 40 km/h, and with my hands barely lifted off the wheel. Even if the road sweeps gently to the left or right, I can let the system essentially drive itself down the road. Tesla's autopilot is a much more enhanced version of that but it still relies on cameras etc. to make decisions and any driver should know a car-mounted camera just isn't as good as the human eye. My car comes with auto reverse parallel parking and let me assure you, that works maybe 30% of the time. It's nothing more than a gimmick really.

      Think of all the times you're driving down the road and there's some random hazard that is hard to make out. Maybe an errant cone in the road, some separated truck tire, a bunch of broken glass from the last accident, a temporary narrowing of the road due to contruction but with only orange markers poorly marked on the road. It's unreasonable to expect a camera (or multiple cameras) to pick up those tiny details and make safe decisions. A human driver can process all that in a millisecond because they have experience and can quickly assess the immediate vicinity and make a decision. I just don't think we're quite there from a tech perspective.

    6. Re:Sounds like a philosophy 101 question by BasilBrush · · Score: 2

      a) Autopilot gives an ergonomic improvement so you don't have to be constantly applying pressure to the steering wheel to micromanage your course. Yes, you have to touch the wheel with one hand. But you don't need to apply any forces.
      b) Autopilot allows the user to spend less time looking at the lane markings and translating that into steering wheel position, and more time scannign ahead for obstacles.
      c) Autopilot isn't as good at maintaining lane as a human yet. But it will be. It's a technology in progress.

  4. Inherently unsafe by Anonymous Coward · · Score: 2, Insightful

    It seems even worse than regular driving if you have to continuously be on the look out to prevent the steering wheel suddenly sending you into a wall.

    Maybe Tesla should focus on automatic braking, parallel parking, and things like that until using their Autopilot is no longer the same as playing the Russian roulette. At some point, these accidents will damage their reputation badly...

  5. Re:"autopilot" is the wrong name by jschultz410 · · Score: 2

    Agreed, and their stupid marketing ploy is killing people.

  6. If they can't spot a narrow divider... by greenwow · · Score: 4, Interesting

    what about motorcycles? I know BMW's Traffic Jam Assistant doesn't do well with that since I had a BMW 750 rear-end me at about 10 MPH. The guy that hit me says it usually does a great job of going the correct speed in 0-30 MPH traffic here on I-5 in Seattle. I think it didn't see me, but instead saw the dump truck in front of me and then tried to drive through me.

    1. Re:If they can't spot a narrow divider... by 93+Escort+Wagon · · Score: 3, Insightful

      I call shenanigans. It's been quite a while since I hit 30mph in a vehicle anywhere in Seattle.

      --
      #DeleteChrome
  7. Re:FFS change the name! by jschultz410 · · Score: 2

    What the hell does any of that have to do with purposely naming a feature in such a way that it lulls people into a false sense of security???

  8. Re:FFS change the name! by jschultz410 · · Score: 2

    I'm not saying it is a bad feature that should be removed. I'm saying their purposely chosen name for the feature is needlessly dangerous. I guess "Driver Assist" just wasn't sexy enough?

  9. Re:To be fair... by Rei · · Score: 4, Informative

    And the driver who destroyed said barrier was not on autopilot. Normal human error.

    Check out the intersection on Google Maps and you can see what went wrong, both for the human, and for autopilot. The left line is quite distinct. The right line is rather worn. There is no visible crosshatching at all between them. Once a vehicle crosses the fading line, what looks like a "lane" forms around them, seemingly reinforcing that this is an acceptable place to drive. This happens only seconds before the barrier is hit, so there's not that much time to react to the situation. There are no overhead signs, just the road-level sign. In dense traffic, it's not visible until you're in the invalid "lane".

    Any driver, paying attention, will of course not do this. But human drivers' attentions lapse, and that's a mistake that humans can - and recently did - make.

    Concerning Autopilot, there's a big question as to what versions people are running. Walter Huang, at the very least, was almost certainly running the old AP. It's not clear what versions the YouTubers were running. There was a massive AP update that just started rolling out recently that makes a huge difference in quality. To the degree that I'm actually rather concerned about it. The more imperfect the system, the more attention you pay to it. I have worries that with the new system, it's gotten good enough that it's going to cause peoples' attention to lapse. Having to touch (with torque) the wheel at regular intervals helps, but I hope Tesla gets eye tracking in place soon.

    --
    "99 dead duelists of Dios on the wall. 99 dead duelists of Dios! Take one's ring, pass it around..."
  10. Re:Tesla: Stop calling it "Auto-Pilot" by jschultz410 · · Score: 2

    HA! I suggested the exact same name up above! Obviously, that name isn't sexy enough to sell more vehicles so it got nixed.

  11. Dirty little secret of statistics by WoodstockJeff · · Score: 2

    Statistics are only as valid as the data they're based on, and the assumptions made about the data that isn't there.

    Most transportation statistics are missing a LOT of base data. Things like "miles driven per year" are guesses.

    Except in the case of cars like the Tesla, where there is a black box collecting statistics. How does Tesla know that auto pilot was on or off? It's recorded. How many miles are driven with AP on or off is recorded.

    Many of the details are tossed out after an interval, but Tesla can collect a whole lot of data that other manufacturers cannot.

    Now, the particular problem with dividing lanes is probably tied to trying to stay between the lines, when the lines are spreading out. If you don't stick to one line or the other, you're target is what is in the middle, and it is going to hurt.

  12. Re:To be fair... by fluffernutter · · Score: 2

    Holy crap, why do people think lane markings will EVER be 100% accurate? That's a total fucking dream; and self driving cars have better damn well work with every possibility.

    --
    Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
  13. U folks are Crazy by wolfheart111 · · Score: 2

    For stuffing yourself in a metal can, then propelling it at great speeds just barely passing other metal cans (within inches). Ludacris you folks are...

    --
    [($)]
  14. Re:If by "poorly" they mean "catastrophically" by Junta · · Score: 2

    Also, how many of those 86 million miles *could have been autopilot (since autopilot can opt out of conditions the driver cannot)* and how many of those if you remove cars that mechanically break (old cars, Tesla's aren't old enough yet to exhibit this), and adjust for various safety technologies (from anti-lock brakes, to airbags, to just having braking, to competitor systems that do have some sort of lane keep assist, but only for accident avoidance and otherwise doesn't help someone drive with their hands off the steering wheel).

    --
    XML is like violence. If it doesn't solve the problem, use more.