Slashdot Mirror


Tesla Issues Strongest Statement Yet Blaming Driver For Deadly Autopilot Crash (abc7news.com)

Tesla has released its strongest statement yet blaming the driver of a Tesla Model X that crashed on Autopilot almost three weeks ago. The driver, Walter Huang, died March 23rd in Mountain View when his Model X on Autopilot crashed headfirst into the safety barrier section of a divider that separates the carpool lane from the off-ramp to the left. Huang was an Apple engineer and former EA Games employee. ABC7News reports: Tesla confirmed its data shows Walter Huang was using Autopilot at the time of the crash, but that his hands were off the wheel for six seconds right before impact. Tesla sent Dan Noyes a statement Tuesday night that reads in part, "Autopilot requires the driver to be alert and have hands on the wheel... the crash happened on a clear day with several hundred feet of visibility ahead, which means that the only way for this accident to have occurred is if Mr. Huang was not paying attention to the road." The family's lawyer believes Tesla is blaming Huang to distract from the family's concern about the car's Autopilot.
Here is the full statement from Tesla: "We are very sorry for the family's loss. According to the family, Mr. Huang was well aware that Autopilot was not perfect and, specifically, he told them it was not reliable in that exact location, yet he nonetheless engaged Autopilot at that location. The crash happened on a clear day with several hundred feet of visibility ahead, which means that the only way for this accident to have occurred is if Mr. Huang was not paying attention to the road, despite the car providing multiple warnings to do so. The fundamental premise of both moral and legal liability is a broken promise, and there was none here. Tesla is extremely clear that Autopilot requires the driver to be alert and have hands on the wheel. This reminder is made every single time Autopilot is engaged. If the system detects that hands are not on, it provides visual and auditory alerts. This happened several times on Mr. Huang's drive that day. We empathize with Mr. Huang's family, who are understandably facing loss and grief, but the false impression that Autopilot is unsafe will cause harm to others on the road. NHTSA found that even the early version of Tesla Autopilot resulted in 40% fewer crashes and it has improved substantially since then. The reason that other families are not on TV is because their loved ones are still alive."

58 of 467 comments (clear)

  1. Sounds like a CYA distraction statement by Anonymous Coward · · Score: 3, Insightful

    If it was a clear day with several hundred feet of visibility, there is no reason for Autopilot to steer the vehicle into a concrete divider. What good is it even if they say you need to keep your hands on the steering wheel? It doesn't sound very auto to me.

    1. Re:Sounds like a CYA distraction statement by MightyYar · · Score: 4, Funny

      I'm just thrilled that these millionaires are doing the beta test for us. In a few years, they'll have most of the bugs worked out and the tech will be a commodity. They are true martyrs for the little man.

      --
      W..w..W - Willy Waterloo washes Warren Wiggins who is washing Waldo Woo.
    2. Re: Sounds like a CYA distraction statement by c6gunner · · Score: 5, Insightful

      What good is it even if they say you need to keep your hands on the steering wheel? It doesn't sound very auto to me.

      I turned on cruise control and it drove right into a stopped car. What good is cruise control if I have to manually slow down? It doesn't sound very "in control" to me.

    3. Re:Sounds like a CYA distraction statement by alvinrod · · Score: 5, Insightful

      The moral of the story is that when the AI self-driving system starts giving your warning messages about its inability to cope with the current road conditions that you should pay attention to it.

      Tesla should know better though. People are fucking idiots and the vehicle should not assume they'll act responsibly. If the AI system doesn't think it can manage things anymore and the user is not responding to input, it should throw the hazard lights on and make an emergency stop. Systems like this should always be able to fail gracefully. If this is a repeated problem, the system should disable the auto-pilot feature and refuse to let the driver use it. If they want it turned back on, they can write to Tesla and explain why they think that they should be allowed to be a colossal moron with a quarter million joules of kinetic energy.

    4. Re: Sounds like a CYA distraction statement by djinn6 · · Score: 3, Insightful

      Comparing it to cruise control is stupid. Cruise control maintains your speed extremely well and doesn't ever fail catastrophically. In hilly terrain it might go slightly too slow or too fast, but it doesn't put you in a dangerous situation. Autopilot on the other hand is supposed to keep you in the lane, but as this case demonstrates, it's actually not very good at it, and when it fails, you're in a life-and-death situation.

    5. Re: Sounds like a CYA distraction statement by c6gunner · · Score: 5, Insightful

      Autopilot on the other hand is supposed to keep you in the lane

      No, it's not. It's supposed to do a whole bunch of things to assist you, but only if you're paying attention. It was never advertised as a "go to sleep and I'll drive for you" system, any more than cruise control was.

    6. Re:Sounds like a CYA distraction statement by lhunath · · Score: 4, Interesting

      I think it's important to be mindful with your terminology. Tesla's Autopilot is not a self-driving system. It is cruise control. Conflating terminology causes nothing but confusion and undue misconceptions about emerging technologies.

      If people stop thinking about Autopilot as self-driving and start thinking about it as cruise control, it becomes immediately obvious that this is not a conversation about why the car did not dodge the obstacle, but rather a conversation about why the human looked away from the road while hurtling forward at great speed in a metal basket, long enough to travel at least 200 meters in distance.

      --
      ``OK, so ten out of ten for style, but minus several million for good thinking, yeah?''
    7. Re:Sounds like a CYA distraction statement by aaarrrgggh · · Score: 5, Interesting

      More fundamentally to me is the issue that said car should not drive straight into a wall at full speed without trying to slow down.

      There is plenty of blame to go around-- victim, Tesla, Caltrans for starters. Each of them screwed up on at least two levels. Tesla likely needs some kind of way for drivers to flag a spot where the autopilot screwed up, so they can gather data and investigate, because the victim was aware of issues at this location and tried to address it with Tesla in (apparently) multiple occasions to no avail.

      What blows my frigging mind though is that the car will drive into a stationary object with high contrast safety striping without attempting to brake. Are they trying to determine approach speed based on visual sensors only that were blinded? Their "neural net" doesn't seem to be learning some important lessons quickly enough.

    8. Re:Sounds like a CYA distraction statement by thinkwaitfast · · Score: 2
      This has been known for decades which is why it's heavily regulated in industries where it's relevant. I remember saying this 5 years ago and was modded as a troll.

      See Human Factors Engineering

    9. Re:Sounds like a CYA distraction statement by ewibble · · Score: 4, Insightful

      Perhaps they shouldn't call it autopilot? The term is clearly a marketing term that makes you think it is going to automatically pilot the car. Call it advanced cruise control, or lane assistance.

      Also if the car can detect your hands are off the wheel, and it is not capable of guiding itself when your hands are off the wheel then shouldn't it immediately warn you when you do so and come to a safe stop? At what point when the car is moving and you are driving safely are your hands off the wheel.

    10. Re:Sounds like a CYA distraction statement by asdfman2000 · · Score: 2

      I think it's important to be mindful with your terminology. Tesla's Autopilot is not a self-driving system. It is cruise control. Conflating terminology causes nothing but confusion and undue misconceptions about emerging technologies.

      That's literally what autopilot is though.

      An autopilot is a system used to control the trajectory of an aircraft without constant 'hands-on' control by a human operator being required. Autopilots do not replace human operators, but instead they assist them in controlling the aircraft. This allows them to focus on broader aspects of operations such as monitoring the trajectory, weather and systems.[1]

      No (sane) person thinks autopilot is supposed to take a plan through an obstacle course of other aircraft. It's merely to assist a pilot to keep a heading, altitude, etc.

    11. Re: Sounds like a CYA distraction statement by stabiesoft · · Score: 2, Interesting

      The difference is cruise does exactly what is advertised. It maintains speed. Autopilot is advertised to stay in the lane and maintain speed like adaptive cruise does. In this case, it did not do what was advertised and someone died. Tesla is trying to shape public opinion on this because unlike AZ, it was not some homeless person whose family probably settled for peanuts. This is likely to become a 7 or 8 figure payout due to the earnings potential of an apple engineer if it goes to trial.

    12. Re: Sounds like a CYA distraction statement by superdave80 · · Score: 4, Insightful

      ...at what we believe will be a probability of safety at least twice as good as the average human driver.

      The crash happened on a clear day with several hundred feet of visibility ahead, which means that the only way for this accident to have occurred is if Mr. Huang was not paying attention to the road,

      So, it was an easily avoidable accident for a human driver... but we have an autopilot that couldn't do it, even though we claim it's twice as safe? Sounds like they are talking out of their asses from both ends here.

    13. Re: Sounds like a CYA distraction statement by blindseer · · Score: 5, Interesting

      Cruise control maintains your speed extremely well and doesn't ever fail catastrophically.

      Actually it can and does. Cruise control in slippery conditions can put a car into a dangerous condition.

      Here's one citation, I'm sure anyone can find more:
      https://www.theglobeandmail.co...

      Early cruise control systems were sometimes quite dangerous, not always to the passengers but could cause damage to the engine or transmission. I remember cars having a hardwired switch on the dash to disable them, in addition to the software button on the steering wheel, because people learned not to trust them. They got "smarter" and today most will detect wheel slippage and not gun the engine if it hits a slippery spot in the road.

      Cruise control is especially dangerous with rear wheel drive and powerful engines, like on a sports car or light truck. One wheel on a slick patch will cause the cruise control to open up the throttle and get the wheels spinning, when they finally find traction the vehicle might no longer be pointed in the desired direction of travel and the front wheels could still be on a slick surface which can send the vehicle flying uncontrolled.

      Cruise control is very safe, especially newer ones that integrate with a traction control, but a claim that they never fail catastrophically is provably false.

      --
      I am armed because I am free. I am free because I am armed.
    14. Re:Sounds like a CYA distraction statement by thegarbz · · Score: 3, Insightful

      In any other scenario I agree with you, but the single person to blame for the death in this case is the driver.
      Not only did the driver know it was buggy, he apparently knew that the car steered towards THAT SPECIFIC DIVIDER, and even attempted to demonstrate it to his wife by her own admission.

      If I do something that I know is going to get me killed, in a place that is going to get me killed, and ignore warnings telling me that what I'm doing is about to get me killed then there's two possible explainations for that: attempted suicide, or Darwin award.

    15. Re:Sounds like a CYA distraction statement by dgatwood · · Score: 4, Informative

      Perhaps they shouldn't call it autopilot? The term is clearly a marketing term that makes you think it is going to automatically pilot the car. Call it advanced cruise control, or lane assistance.

      The terminology issue is a red herring. The reality is that partial self-driving capabilities lull users into a false sense of security because they usually work well. The rare failures are often catastrophic precisely because people have gotten used to the technology working, and end up surprised when it doesn't.

      That's what made this recent software update such a problem. It made major changes to the way autosteer works on (at least) AP2-based Tesla cars. One of the big changes was "wide lane" handling, which changed the way vehicles behaved when they encounter a wide lane, such as an exit lane. This has resulted in a number of unexpected behaviors, up to and including cars driving straight towards gore points.

      I don't know whether that change was in any way a factor in the autosteer malfunction that led to Mr. Huang's death, because I have no way to know what firmware version that car was running. However, the fact that this major update was in the process of being rolled out to users at the time of the accident is suspicious.

      To be fair, a lot of other driving situations got significantly better with that software update. However, Tesla AP's tendency to ignore solid white lines has been an ongoing problem that might well have been made worse by that update; if that is the case, then the problem needs to be corrected ASAP, and they probably should NOT have continued the rollout of that update. Either way, I'm not convinced that Tesla did enough to warn drivers that autosteer might behave very differently, and to be particularly alert after that update.

      Also, I would add that, speaking as a Tesla owner, it bothers me to see the amount of spin they're spewing after this accident. I realize that they don't want to let their users get scared into not using AP, because on average, it does significantly reduce accidents. And if there are videos out there showing AP malfunctions that they feel are not genuine, they can and should comment. But they should really stop trying to convince the public that the driver was solely to blame, because IMO, that just isn't the case.

      First, the fact remains that autosteer obviously DID malfunction, and that malfunction DID result in a fatality that would NOT have occurred if the vehicle had not been equipped with autosteer functionality (because no sane driver would have looked away from the road for 5+ seconds without that functionality).

      Second, the situation was entirely predictable. For at least a decade, people have warned that humans are likely to zone out in partial self-driving situations, and that it isn't really possible to change that innate human tendency. Tesla ignored those warnings and pushed forward anyway, and someone died. They blamed the driver, and the crash investigators tentatively agreed, and they kept pushing forward. And then a second person died. And now a third. IIRC, product liability law hinges in large part on whether user errors are reasonably predictable, and no "I agree to pay attention" can change that fact, which means this is little more than a legal smokescreen, IMO.

      Third, the fact also remains that Caltrans failed to reset the safety barrier that was designed to slow down a car before impacting the gore point, after the barrier was collapsed in a wreck nearly two weeks earlier. And the fact remains that had the barrier been reset properly (as is required by law), it is unlikely that Mr. Huang would have died.

      In other words, there are three parties, any one of whom/which could have prevented the fatality, and the deceased driver was only one of those three. So it is entirely disingenuous to try to pin this on the driver in the court of public opinion. IMO, it really isn't a question of who is at fault; they all are. Rather, it's a question of wh

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    16. Re:Sounds like a CYA distraction statement by Viol8 · · Score: 5, Informative

      "Victim blame much?"

      In this case perfectly justified since the "victim" was an adult with a driving license who was legally REQUIRED to keep his eyes on the road ahead regardless of any self driving capabilities of the car when in charge of a vehicle. Clearly he didn't and he paid the price.

      The guy was supposedly smart, and a programmer not some joe sixpack, and was certainly aware that autopilot is not 100% reliable. The only person to blame here is the driver through incorrect operation of the vehicle. If an airliners autopilot made a mistake that the pilot had plenty of time to correct but didn't bother we'd be blaming the pilot, not the automation. Same here.

    17. Re:Sounds like a CYA distraction statement by Keick · · Score: 2

      Perhaps they shouldn't call it autopilot?

      I really get tired of this argument. Do you even know where the term Autopilot comes from or what it means?

      From Wikipedia emphasis mine:

      An autopilot is a system used to control the trajectory of an aircraft without constant 'hands-on' control by a human operator being required. Autopilots do not replace human operators, but instead they assist them in controlling the aircraft. This allows them to focus on broader aspects of operations such as monitoring the trajectory, weather and systems.

      The autopilot in every fucking definition of the word, is an assist device for the pilot, not a replacement. It handles speed, heading, and in some cases altitude. It doesn't monitor other aircraft, it doesn't avoid collisions, it doesn't (endless list of pilot tasks).

    18. Re: Sounds like a CYA distraction statement by fgouget · · Score: 2

      Cruise control maintains your speed extremely well and doesn't ever fail catastrophically.

      In the same situation cruise control would have sent the car straight into the obstacle without ever breaking. In fact that's exactly what it did. The only case where cruise control "doesn't fail catastrophically" is when the driver pays attention to the road and takes over when necessary. Precisely what would have saved this driver.

    19. Re:Sounds like a CYA distraction statement by ausekilis · · Score: 2

      Perhaps they shouldn't call it autopilot? The term is clearly a marketing term that makes you think it is going to automatically pilot the car. Call it advanced cruise control, or lane assistance.

      The terminology issue is a red herring.

      No, it isn't. People have a conception that "autopilot" for aircraft means the computer takes over for the pilot, who can then take a nap or wander around the cabin. We as a society have used the prefix "auto-" to mean that a computer handles the whole process.

      Second, the situation was entirely predictable. For at least a decade, people have warned that humans are likely to zone out in partial self-driving situations ... and someone died.

      No amount of PR can fix dumb people and their misinterpretations of reality and Tesla has made it a big point to sell how "safe" their combination of technology they call "auotpilot" while not addressing any shortcomings. A car that can keep you in a lane and even follow curves, automatically brake for traffic/obstructions, and speed back up to follow traffic sure sounds like I don't have much to do behind the wheel.

      I agree with you otherwise. Caltrans has some blame for failing to reset a safety barrier - they could have at least put up some water barrels or something. The driver is an idiot for trusting a system to do more than it can reasonably be asked to do (even if those shortcomings aren't well published). My biggest gripe is Tesla has made themselves the *only* place to get crash data. The fact that *every* crash involving one of their cars means having to trust their log data just doesn't sit will with me. Especially since they seem to have issues with build quality and upholding promises with their 3 series.

  2. Blame game engaged! by Entrope · · Score: 3, Insightful

    Tesla blames dead driver. Dead driver's family blames Tesla. Who is really at fault here?

    I think the four-year-old girl is right: Why not both?

    1. Re:Blame game engaged! by drinkypoo · · Score: 3, Informative

      All they said was that there multiple warnings that day, but not specifically in the six seconds before the crash when he had his hands off the wheel. It's a classic misleading statement.

      Your objection is wholly irrelevant. He had to sign a paper saying he understood that he had to remain alert with his hands on the wheel to even get the feature turned on, and he was reminded of that obligation several times during the trip. It completely and totally does not matter whether the vehicle warned him in the six seconds prior to the collision. He was warned repeatedly, and before he even used the feature once he agreed that he understood his responsibilities.

      Tesla is actually less at fault here than when some old guy puts on cruise control in his RV and goes back to make a sandwich. That guy hasn't had to sign a paper saying he understands that cruise control is not a replacement for a driver.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  3. Suicide by Autopilot by Anonymous Coward · · Score: 5, Informative
    Very strange. Specifically that

    Mr. Huang was well aware that Autopilot was not perfect and, specifically, he told them it was not reliable in that exact location

    [Emphasis mine] Hands not on the wheel, a clear day with plenty of warnings to pay attention it's like he purposely wanted to crash.

    1. Re:Suicide by Autopilot by Entrope · · Score: 4, Insightful

      More likely, he had a false impression that something really bad could never happen to him -- that bad luck is something that happens to other people. It's the same reason that people text while driving. They are confident in their own situation and their own ability to handle dangerous conditions, and sometimes they end up being wrong.

  4. Re:Is it just me or is this just not an autopilot? by whoever57 · · Score: 5, Informative

    People die while driving to work. Using your argument, no one would ever get into a car.

    Yes, Tesla's Autopilot isn't perfect, and its capabilities may be exaggerated, but I believe that, overall, drivers using Autopilot are less likely to get into an accident. Isn't that the real measure?

    Tesla's crash rate dropped 40 percent after Autopilot was installed, Feds say

    Don't let the perfect be the enemy of the good.

    --
    The real "Libtards" are the Libertarians!
  5. Re:Is it just me or is this just not an autopilot? by FFOMelchior · · Score: 5, Insightful

    I don't know, I've seen Telsa autopilot reaction videos on youtube (https://www.youtube.com/watch?v=RjGe0GiiFzw), and when they're right, they're dead on right. Their instant reaction is so fast, to human perception it's as if they're predicting the future. I'm positive there are already cases where autopilot has prevented deaths. Unfortunately, I do see the argument that -- both legally and morally -- if you save 100 lives but are at fault for 1, you're still at fault for 1. Tricky situation.

  6. Why it can't check driver alertness? by 140Mandak262Jamuna · · Score: 5, Interesting
    We know if 100 years since the days of steam locomotives. Drivers, if they don't have to steer. They miss signals, fall asleep. They invented a variety of deadman switches to check for driver alertness. They do it even now in diesel and electric locomotives.

    Tesla should be issuing challenges and driver should respond correctly, if not it should pull the car over and stop.

    If alert driver is a necessary requirement for safety, the system should check for alertness and stop the car safely if the driver is not alert. It is weaseling out if it allows the car to stay on auto pilot even after its request for manual take over is not honoured. But it knows the appeal of auto pilot will be greatly reduced if it enforces alertness rules

    This is why I did not order autopilot when my Model 3 offer came through last Sunday. I am a great supporter of Tesla but the auto pilot is misnamed, and promotion of its use is not correct.

    --
    sed -e 's/Chuck Norris/Rajnikant/g' joke > fact
    1. Re:Why it can't check driver alertness? by pezpunk · · Score: 2, Informative

      i own a Tesla. it bings at you if you're not holding the wheel, and WILL eventually shut off autopilot, but bringing the car to a stop is inherently dangerous.

      ultimately, the driver of any vehicle is responsible for following the instructions for operating that vehicle.

      --
      i could live a little longer in this prison
    2. Re:Why it can't check driver alertness? by Anonymous Coward · · Score: 2, Interesting

      It should never be dangerous to slowly come to a complete stop unless you stop on train tracks. If someone hits you, it'd be their fault for driving dangerously.

      Tesla knows the driver isn't paying attention and knows autopilot isn't good enough to control the car by itself. Shutting off autopilot while it's known the driver is distracted is the worse possible option. They should be slowing and stopping sooner rather than later. When the driver isn't paying attention a critical component of autopilot isn't functioning so Tesla should take approach action. They don't, so for that they should be held at partial fault for all such crashes.

      For a feature which is supposed to keep you in the lane and not hit the car in front of you, you'd expect it to not leave the lane and run straight into a solid object. That's the complete opposite of what it's supposed to do. The guy was an idiot for not paying attention while driving, but so it Tesla.

    3. Re:Why it can't check driver alertness? by drinkypoo · · Score: 2

      It should never be dangerous to slowly come to a complete stop unless you stop on train tracks. If someone hits you, it'd be their fault for driving dangerously.

      I can see why you didn't log in. Highways and freeways have minimum speed limits for a good reason, and that reason is that if traffic is moving too slowly, it presents a hazard to traffic which is moving at legal speeds. You are obligated to exit the roadway if your vehicle should experience a failure. You are also obligated to exit the roadway if you plan to take a nap.

      For a feature which is supposed to keep you in the lane and not hit the car in front of you, you'd expect it to not leave the lane and run straight into a solid object.

      That's not what it's supposed to do. It's supposed to help you stay in the lane and not hit the car in front of you. You still have responsibility for not doing those things. The car will help you, not do it for you. Just like the autopilot on a plane or a boat, it will run you into an obstacle if you use it incorrectly. That's why it's a perfectly descriptive name for the feature. Before autopilot is even made available to drivers, they have to attend a safety lecture and sign an acknowledgement that they have certain responsibilities.

      The driver in this incident knew beyond any reasonable doubt that he was responsible for keeping his hands on the wheel and staying alert. Case closed.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    4. Re:Why it can't check driver alertness? by Entrope · · Score: 2

      Tesla's software is what steered the car into the barrier. Case closed.

      CalDOT did not repair a crash barrier as required by law, causing a probably unnecessary fatality. Case closed.

      If the driver is not attentive or interacting enough, the car could have turned the driver assistance features off. If Tesla didn't want to do that because it wanted to look high-tech and smart, the car could decelerate to the minimum of the posted speed limit or 40 mph -- most drivers will re-engage pretty quickly if they're going that slowly on a highway.

      There are a lot of ways the car could have reacted safely in these conditions. It carried out what was probably the least safe practical option.

  7. Summary by quantaman · · Score: 2, Insightful

    Tesla blames driver for using the Autopilot in exactly the way you'd expect 90% of Autopilot users to use it.

    --
    I stole this Sig
  8. Re: Tesla autopilot unable to autopilot by Kristoph · · Score: 3, Informative

    I own an Tesla S. I use autopilot daily, itâ(TM)s awesome.

    However you do have to know what it is and what it is not capable of and you do have to be attentive because it can get itself into trouble ( today, for example, it didnâ(TM)t want to let a bus into my lane - the bus came in anyway )

    All that said calling the thing autopilot is what gets Tesla in trouble. Itâ(TM)s more of a âco-pilotâ(TM)

  9. If hands-on is a requirement then... by NewtonsLaw · · Score: 2

    Surely if Tesla demands that drivers keep their hands on the wheel at all times that the autopilot is engaged then they should have a sensor for this and disengage the autopilot whenever the driver releases the wheel -- as a safety measure.

    The fact that they don't do this is a clear indication that they really do expect people to take their hands off the wheel and use autopilot as if it were perfect. Stop passing the buck Tesla!

  10. AutoPR? by quantaman · · Score: 2

    Does anyone know if Tesla is using a bot to write their Press Releases as well?

    The following:
    The reason that other families are not on TV is because their loved ones are still alive.

    Does not sound like something a human PR Professional would write.

    --
    I stole this Sig
  11. Re: Is it just me or is this just not an autopilot by c6gunner · · Score: 4, Insightful

    It seems to me that the only point of having an autopilot would be so that you could take your hands off the wheel and not pay attention to the road. This is sorta-kinda-an-almost-but-not-quite autopilot that works ok most of the time but has failure modes involving death and / or dismemberment. Who the hell would sell a half-assed, half-baked "feature" like this?

    It seems to me that the only point of having cruise control would be so that you could take your feet off the pedals and not pay attention to your speed. This is sorta-kinda-an-almost-but-not-quite cruise control that works ok most of the time but has failure modes involving death and / or dismemberment. Who the hell would sell a half-assed, half-baked "feature" like this?

  12. I'm a pilot, and have a real autopilot by DanDD · · Score: 5, Insightful

    I'm a pilot, been flying for 30 years, and I've flown with other pilots with varying skill and experience levels.

    The most experienced pilot I've flown with never took his left hand off the control yoke. I watched him for hours while I was in the co-pilot and jump seats. He'd visit, configure radios, adjust power, but if his left hand ever came off that yoke it went right back on it as soon as the immediate task was done.

    I'll drive my Tesla autopilot the same way that gray haired old pilot flew an autopilot, and with any luck I'll live to be just as old.

    --
    "Every time I see an adult on a bicycle, I no longer despair for the future of the human race." - H. G. Wells
    1. Re:I'm a pilot, and have a real autopilot by CRC'99 · · Score: 2

      I've got a CPL - and in all my training - one thing that always stood out is that I never fully trusted the autopilot.

      There's a great video that was done in 1997 called "Children of the Magenta" that seems to ring true with everything I hear about Telsa issues like this.

      Youtube link:
      https://www.youtube.com/watch?...

      Aircraft, cars, the lessons are the same.

      --
      Sendmail is like emacs: A nice operating system, but missing an editor and a MTA.
    2. Re:I'm a pilot, and have a real autopilot by CRC'99 · · Score: 2

      The most experienced pilot I've flown with never took his left hand off the control yoke.

      That's the exact work reduction autopilots are designed to enable.
      Your so called "most experienced pilot" (*cough* MORON) had just defeated the exact purpose of autopilots.
      This guy might as well fly with the autopilot off.

      You are the kind of guy I do not want to be my captain or co-pilot.

      --
      Sendmail is like emacs: A nice operating system, but missing an editor and a MTA.
  13. Re: Then they should stop calling it "AUTOPILOT" by c6gunner · · Score: 4, Informative

    All "AUTOPILOT" does is conjure up images of planes flying themselves while pilots LEAVE THE FUCKING COCKPIT to go to the bathroom.

    No pilot would ever do that exactly because the autopilot is just a simple program which only controls speed and heading. In the sky, with very few aircraft around you, it would be much safer to leave the controls than it would be in a car, on a highway, and yet aircrew always make sure that there is at least one pilot monitoring the controls at all times. If you hear "autopilot" and think "well, no humans required!" then you are badly misinformed.

  14. Re: Tesla autopilot unable to autopilot by fluffernutter · · Score: 3, Insightful

    That sounds stressful to me, not awesome.

    --
    Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
  15. Re: Is it just me or is this just not an autopilot by bestweasel · · Score: 2

    I pointed out the problems with the name Autopilot at the time of some previous crash. If a geek like poor Mr Huang can be fatally wrong about its limitations (assuming that geeks are less likely to blindly trust technology) what chance do mere mortals have?

    Totally agree that Autopilot is broken if it ignores a lane divider. If I had a Tesla I'd keep my hands on the wheel, my feet over the pedals and my eyes on the road.

    Then after 10,000 miles I'd think, "Hey this Autopilot is pretty good" and trust it more and more until one day I'm doing 50, looking in the glovebox for my favourite Barry Manilow CD, well we all know what happens then.

  16. Re:Is it just me or is this just not an autopilot? by slack_justyb · · Score: 3, Interesting

    Yeah the name autopilot is one of the things that kills me about what they are truly selling. Tesla's cars are at best a level two self driving car, that is hands off only. You have to have eyes on and you have to give continual input to the system. It is adaptive cruse control, lane keeping, and auto parking. It has some guidance from GPS and on-board software, but the production car that you buy is nowhere near this crap. That video is clearly showing a level three car and the car is handling cleared intersections easily, something the current level twos would be suicide if you tried.

    The autopilot is anything but. I'm totally pro-self driving cars, but folks need to know what they are buying and not have a hyped up product sold to them and they think it will do something it won't. Tesla cars are a hands off only car, period, the end. You have to keep eyes up, no matter what. Additionally, you need to know the absolute limits of camera/radar combos, that's right Teslas do not have LiDAR. Radar requires a calculation between differences in order to work. If traffic is stopping up ahead and the car in front of you that your Tesla is tracking suddenly pulls out of the lane to expose a car up ahead at a complete stop, your Tesla is going to ram full speed into that stopped car if you don't do something. That's because radar was tracking something and now it's not there. So the machine needs to recalculate everything, which if you're going highway speeds, you're going to end up dead before the car figures it out.

    The cars need to see lines on the road. If the lines are iffy, you're going to end up dead. Traffic needs to follow a pace, it doesn't matter if it is start and stop, or if cars gracefully merge in and out of your lane. It just needs to follow a smooth flow to things and you slowly build up a feel for what's gradual enough and what isn't. If you don't pay attention to that, you're going to end up dead. If you are coming up on a change in the road's shape, like where two highways split off and you're in the lane closest to the split, you need to turn off autopilot and handle it yourself. Most of these kinds of things have really crappy indicators on the road that a split is happening and if you don't, you are going to end up like that dude. Dead.

    Now if you think that level two automation is a half baked idea, that's cool. It sort of is, which is why everyone is aiming for that holy grail of level five. So perhaps maybe sit the sidelines till we get there? If what you are comparing to is level five, you're right, this shit is beta-level crap on crap. If you're talking about actual level two automation, the Tesla and all the other cars that offer level two are pretty solid. But people need to understand what they are getting themselves into and if that's not what you were expecting, then yeah, you shouldn't buy one. However, I also fault Tesla, since they post up videos like that one I linked and people buy their cars thinking, that's what they are getting which it isn't.

  17. Re:several hundred feet of visibility ahead by HornWumpus · · Score: 2

    Teslas don't have lidar. Your thinking of Google cars.

    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
  18. Re:Is it just me or is this just not an autopilot? by Mistlefoot · · Score: 2

    The quote from Musk and the graph both reference accident reductions with Autosteer. Neither call it Autopilot.

    Tesla offers, per their manual:

    Autopilot Tech Package:
    • Traffic-Aware Cruise Control
    • Autosteer
    • Auto Lane Change
    • Autopark
    • Auto High Beam

    Why is Musk and the graph specifically referencing Autosteer? I never trust data fully when specific and unexpected words are used. The omission of the word Autopilot implies......

  19. What's the point? by superdave80 · · Score: 2

    Tesla is extremely clear that Autopilot requires the driver to be alert and have hands on the wheel.

    I already have to do that. What's the point of buying this autopilot-that-isn't-really-an-autopilot?

  20. Re:Clear day by arth1 · · Score: 2

    Tesla's autopilot doesn't use human eyes. If I understand it correctly, it has a monochrome camera and a forward facing radar. If there is not enough monochromatic contrast between an object and its surrounding, the camera won't detect it, and if the object is at an angle and composition where it cannot return radar signals directly back to the car, the radar won't detect it.
    How good the visibility is only affects the human, who is the one with the driver's license and the responsibility that goes with it.

  21. Re:Is it just me or is this just not an autopilot? by Tom · · Score: 2

    That is the point.

    1.25 million people die on the road every year, world wide (number from 2013, had it in my head due to unrelated research).

    If Tesla has one millionth of the car market, expect on death per year. That would be statistical normality.

    --
    Assorted stuff I do sometimes: Lemuria.org
  22. The lawsuit is likely doomed by family's own words by catchblue22 · · Score: 4, Informative

    The family admits that the driver had had issues at that exact location. Why on earth would he use it there then? Why wasn't he paying attention near that spot? Why did he ignore the warnings? He was a programmer. He should have known.

    --
    This and no other is the root from which a tyrant springs; when first he appears as a protector - Plato (423 to 327 BC)
  23. Tesla need to change the name. by bonedonut · · Score: 2

    Too many people take 'Autopilot' literally.

  24. Re: Is it just me or is this just not an autopilo by peppepz · · Score: 2

    Not an appropriate analogy. Cruise control does the one thing you command it to do, that is to keep the speed constant, and it will do it perfectly and with no exceptions, because that function is well-defined and is better done by a machine than a human. You needn't worry about maintaining the speed when cruise control is engaged.
    On the other hand, you command the "autopilot" to take full control of the car without causing accidents, which is an undefined problem (and Tesla is very careful about not defining explicit boundaries), and then it might fail to do that even in the most favourable conditions, such as a straight motorway with perfect visibility. When the "autopilot" is engaged, you need to be constantly wary about the possibility of it doing an abrupt and incomprehensible manouver that might result in your death and the passengers' (this is what Tesla themselves are stating in their public statement when they blame the driver). It's not even remotely in the same domain of dangerousness as cruise control.

  25. Re:What's the point of semi-autonomous driving? by pezpunk · · Score: 2

    it's statistically safer than non-autonamous driving.

    --
    i could live a little longer in this prison
  26. Re:In other words. by OrangeTide · · Score: 2

    In the movies the pilot flips a switch, a red light comes on, and he goes to the back of the plane to fight hijackers or have a smoke.

    I think it's a poor choice of terminology because there are so many misconceptions about what autopilot is for aircrafts that it's difficult to shift the metaphor to a car.

    Having to hold the wheel and pay attention is less useful than cruise control. At least with cruise control I can take my foot off the gas pedal.

    --
    “Common sense is not so common.” — Voltaire
  27. Re: Clear day by Entrope · · Score: 2

    It is very clearly an AI. Just not a good attempt, at least not yet.

  28. Ability to self assess by DrYak · · Score: 2

    If the AI system doesn't think it can manage things anymore and the user is not responding to input, it should throw the hazard lights on and make an emergency stop.

    The first problem is at the "if".
    Seems that in some cases, the "Autopilot" is completely persuaded that it is on the correct course.
    It genuinely thinks that "straight ahead" is the 100% correct answer to the problem.
    In that case it will never fail the driver "Hey, I need help".

    Again, it's an "autopilot" (see planes, boats, etc.) just a thing that automatizes some low-level work. The captain of the aiplane/boat/tesla should still keep focus and check that everything goes as it should (it's a "level 2" autonomy. The human is still constantly in charge 100% of the time. Simply the human doesn't *need* to actually interact with the controls 100% of the time. Most of the time, the vehicle could control itself on it own, BUT NOT unattended, human overwatch is mandatory).

    And that's what Tesla is arguing.
    Not paying attention "just because" autopilot is on, is almost Darwin-award-worthy (just as in a plane or a boat).

    Though one might argue that Tesla isn't insisting clearly enough in their marketing material (cue in Elon making a presentation about dreaming that within a coujple of year you could summon your car to come to you)
    and/or people make wrong assumption when they see the word "autopilot" (they don't think plane / boat with a captain still in charge, but somewhat think Knight Rider or other Sci-Fi setting).

    Then the second problem :
    Why the fuck didn't the car see the a huge block of concrete on its course ?
    This thing should (probably have) a nice radar signature.
    Most of the much more primitive FCAS currently on the street would probably see it and slowdown/stop or ring alarm/hit the break.

    Some weird interaction is happening.
    Some filtering gone wrong ? (radar system ignoring objects not moving relative to the street, in order to not over-react on each single guardrail ?)
    Some precedence conflict ? (the camera system not seeing the lane diverging and overriding "No it's safe, I don't see an obstacle" ?)
    That's an error on Tesla's side.

    If this is a repeated problem, the system should disable the auto-pilot feature and refuse to let the driver use it. If they want it turned back on, they can write to Tesla and explain why they think that they should be allowed to be a colossal moron with a quarter million joules of kinetic energy.

    At some point in time, we might see tiered driving license appearing, with a separate module to train drivers how to use driving assistance tools properly.

    --
    "Sufficiently advanced satire is indistinguishable from reality." - [Tips: 1DrYakQDKCQ6y52z6QbnkxHXAocMZJE61o ]
  29. Re:The lawsuit is likely doomed by family's own wo by mjwx · · Score: 2

    The family admits that the driver had had issues at that exact location. Why on earth would he use it there then? Why wasn't he paying attention near that spot? Why did he ignore the warnings? He was a programmer. He should have known.

    The car was on Autopilot... You know A-U-T-O-Pilot. The car should have driven itself whilst the attendant sat back watching movies on their phone.

    That is the logic you can expect from end users. Warnings are just something to be ignored or at the very worst summarily dismissed. Autonomous cars are something that has been sold to them as a magic bullet to their driving woes. The end user fully believes that their time having to pay minimal attention to the road is at an end and that the car will automatically handle everything for them. Also it's going to eliminate congestion because they can go eleventy bajillion leptons per microfortnight whilst bumper to bumper and there will never, ever be any collisions.

    --
    Calling someone a "hater" only means you can not rationally rebut their argument.
  30. Re: The lawsuit is likely doomed by family's own w by saloomy · · Score: 2

    No! Your the fucking asswipes that don't get it. It's got AUTOPILOT, not Chauffeur. When you go into an airplane, the pilots sit in front, don't sleep, and watch the skies, the instrumentation, and the aircraft handling, the pilots are paying attention! That is how you operate with autopilot, you don't see the pilots both taking a nap or coming back to schmooze with the flight attendants.

  31. Re: The lawsuit is likely doomed by family's own w by mlyle · · Score: 2

    Look, human beings suck at vigilance tasks. "This is almost always OK, detect the one time in an hour that it's not"-- no one can muster the attention. X-ray screeners use something called the "Threat Image Protection System" which shows them pictures of bombs and guns and keeps them alert (it lets them know it's a test, but helps keep their mind in the "where's the gun in THIS one?" mode instead of "oh, look, another suitcase probably without a gun"). Even S&R dogs find trainers even in the middle of a search else they grow bored with the task.

    Autopilots in transport aircraft come with a big master warning and caution system that lets you know about most of the classes of developing problems and are loud about it instead of relying on a flight crew to spot them, because even highly trained, professional flight crews are shitty at detecting changes in something that almost never ever changes. Having a system that avoids steering for the guardrail 99.99% of the time is a recipe for disaster, because it will build confidence and train people not to pay attention.