Newest Tesla Autopilot Data Shows A 40% Drop in Crashes (bloomberg.com)
There's a surprise in the data from an investigation into Tesla safety by the U.S. National Highway Traffic Safety Administration.
An anonymous reader quotes Bloomberg:
[W]hile all Tesla vehicles come with the hardware necessary for Autopilot, you need a software upgrade that costs thousands of dollars to make it work. Since buyers can add Autopilot features after purchase, this provides a perfect before-and-after comparison. It turns out that, according to the data Tesla gave investigators, installing Autopilot prevents crashes -- by an astonishing 40 percent...
Now -- thanks to an investigation that initially hurt the company -- there is finally some real data, and it's good news for Tesla... As the software matures to match the new hardware, Musk said on Thursday via a Tweet, Tesla is targeting a 90 percent reduction in car crashes.
UPDATE (5/4/18): The NHTSA has now clarified that their study "did not assess the effectiveness of this technology.
UPDATE (2/16/19): The study's underlying data reveals serious flaws in the methodology that undermine its credibility, according to new analysis from a research and consulting firm.
Now -- thanks to an investigation that initially hurt the company -- there is finally some real data, and it's good news for Tesla... As the software matures to match the new hardware, Musk said on Thursday via a Tweet, Tesla is targeting a 90 percent reduction in car crashes.
UPDATE (5/4/18): The NHTSA has now clarified that their study "did not assess the effectiveness of this technology.
UPDATE (2/16/19): The study's underlying data reveals serious flaws in the methodology that undermine its credibility, according to new analysis from a research and consulting firm.
I think the technology is a good idea, but they've picked a terrible name for it. To someone who is uninformed, it makes it sound as though the feature enables automated driving for the vehicle, and while that may be the end goal, it's currently not at that level and may give a false sense of capability. They should refer to it as "Driver Assist" or something that doesn't leave anyone with a false impression of the capabilities of what it does.
If you just dont ever leave your house.
Correlation vs Causation anyone?
Could it be, with the crash history of "autopilot", people are now using it more as it was intended? As DRIVER ASSIST, rather than turning it on and dozing off behind the wheel?
I mean, THAT couldn't affect numbers at ALL, right?
Chas - The one, the only.
THANK GOD!!!
A crash rate of 1.3/ million miles and having 130 million miles of data means that there has been about 170 crashes.
I'm guessing accidents range from minor fender-benders (although with cars of today, a "minor" fender bender costs $2k+) to the fatal accident.
I would like to know where this 40% reduction takes place in the accident spectrum ? Does this mean that there are much fewer fender benders or fewer accidents which resulted in personal injuries?
If it's at the lower end of the range then big whoopdie fucking do - if it results in fewer injuries (and I would guess this would be significantly more than 40%) then it's something to look into and see if this improvement can be brought to other manufacturer's cars (and trucks).
Mimetics Inc. Twitter
One would expect that. Even a bad computer program with a dozen eyes is likely to be better than a bag of meat with only two.
I'm more concerned about the long-term secondary effects. Do drivers who get used to this technology become dependent on it, and thus have higher accident rates when driving rental cars that lack this technology?
Additionally, I'm less than convinced by the use of a single number here. To be meaningful, you need at least two numbers: the number of crashes avoided because of software intervention and the number of crashes caused by driver inattention. After all, if the system saves a bunch of lives because of things that a human driver couldn't have predicted, but costs a small number of lives because some humans depended too much on the vehicle to drive for them, then it is great from a statistical perspective, but that's little comfort for the families of people who died because the autopilot lulled them into a false sense of security.
Check out my sci-fi/humor trilogy at PatriotsBooks.
Why don't they target a 100% reduction in crashes?
I can't completely wrap my head around how they could do this study and how the statistics were calculated.. The article states this is a before/after test so presumably involves comparing the the crash rate before auto pilot with that after. But it is somewhat difficult to do because did they really include drivers that crashed (before getting into AutoPilot) to see if they would crash again (after AutoPilot)? I would imagine many people might even stop driving after a crash or at least have gotten a new car which might not be a Tesla. In other words, it seems that from the point on where AutoPilot is bought then the group is already suffering from self-selection bias since many of those who suffered accidents (reflecting a prone-ness to accidents) were selected out in the pre-AutoPilot phase, thus only getting to count for the pre-AutoPilot data. And they can't know how many, of those who crashed, who would have bought AutoPilot, had they not crashed, and what their accident rate would have been. It seems this would tend to make it seem as if AutoPilot increased safety eve if it didn't.
Another way of comparison could be to compare drivers buying AutoPilot vs not buying it from a given point in time. But that causes another problem namely that those buying the AutoPilot might not have the same risk/accident-rate as those not buying it. It could be they are richer, older, more careful etc.
The only fair way to do such a study would be to, at some point in time, randomly select a group of drivers who will get AutoPilot for free and another group who won't be able to use it. Then you can study exactly what is the safety effect of giving a driver AutoPilot.
I'll bet the sample size is in the dozens, and autopilot had only been it for a few years. There isn't enough data for me to believe anything. If I cause a wreck and I'm behind the wheel, it's my fault. If I die, I'm fine with that, I could have prevented it. If a computer kills me because some idiot programmer forgot a semicolon, I'll be pissed.
>> installing Autopilot prevents crashes -- by an astonishing 40 percent...you need a software upgrade that costs thousands of dollars to make it work
This kind of read like: "So...you want the software that shuts off your fuel value during a crash or the one that opens it full on impact. It's a $5K option...your choice, really."
If it's really just a software option, doesn't this sound a lot like the VW software "option" that cheated on emissions tests?
Could someone paint fake road markings and cause a Tesla to crash? Perhaps into a wall with a fake/painted tunnel?
Someone needs to try this out.
And, frankly, someone that dumb was going to crash sooner or later anyway, so this at least delays the inevitable.
Story after story? List them, with the dates. Lets check it off against the number of people dying after putting "cruise control" on and taking a nap, hmm?
But the AutoPilot in an aircraft and and in this case the Tesla do the same thing. They assist in control of the aircraft. AutoPilots do not replace the pilot or relegate his/her duties to that of a passenger, you still have to have a pilot or you aren't going anywhere. The name is appropriate.
The Tesla Autopilot is pretty good for how early in car automation we are. It would be a terrible inconvenience to require you to put your hands on the wheel when you are driving thru some stretches of the American south-west, like going between Phoenix and LA on i10. Just like it would be a terrible inconvenience to expect the auto-pilot of a passenger jet liner to require input every three seconds before it disengages between Heathrow and JFK. There is no reason for it. There is no need for a law.
Will accidents happen? Sure. Just like aircraft accidents still happen. The goal of the technology is to reduce the chance of an accident happening, not eliminate it altogether, while providing some amount of relief for the pilot / driver. It is pretty hard to keep at attention for many hours on end when the task is so mundane. As the technology gets better and better, and more wide-spread, we will see more and more benefits from this technology, like reduced energy consumption by drafting closely to the car infant of you, or reduced traffic congestion by synchronized acceleration, intersection control, etc.. etc..
Wouldn't disengaging the autopilot when the driver's hands are off the wheel cause more crashes? It sounds like that would be negligent in the extreme. The autopilot should not disengage until the driver's hands are ON the wheel to assure continuous control of the vehicle through the transition.
Just a reminder,
Expect media outlets whose owners will benefit financially from Tesla's success to report this in a positive light and pimp it hard.
Expect media outlets whose owners will benefit financially from Tesla's failure to report this in a negative light, bury it, or begin advertising sponsored competitor's autopilot as being superior.
Does anyone have a working link to the actual report? It was supposed to be at static.nhtsa.gov/odi/inv/2016/INCLA-PE16007-7876.PDF
when I got creamed out on my road bike, assuming it can detect pedestrians. I was carrying the damn thing across a cross walk (with the little green walky man no less) and somebody ran the light. They clipped the wheel of my bike or I wouldn't be here right now. The lady stopped. It as broad daylight but somehow she didn't "see" me. Folks tune out when driving. That light almost never turns red so it didn't occur to her to stop. Put another way they're driving with their lizard brains. I'd rather they do it with an electronic brain instead.
Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
People keep making this argument about the analogy between Tesla's feature and the autopilot feature of airplanes, but how many normal people know an airplane's autopilot works? It's a pointless comparison unless it's a widely known fact among the general public, which I'd argue it is not. I'll bet most people have the same mis-impression of an airline's autopilot feature.
Even so, I think we're just in a collective learning curve regarding semi-autonomous vehicles. Eventually, the cars will become fully autonomous anyhow, so I'm not terrible concerned. The fact that collisions are down by 40% validates what many of us long believed, which is that computers are going to be much safer drivers than humans. And this is just a very early and flawed first iteration of the technology to come.
Irony: Agile development has too much intertia to be abandoned now.
How do we define a "crash", and how do we know that for example major crashes increased in frequency but minor ones decreased?
Maybe you need to find out first, eh?
I laugh at you.
Ha ha ha ha ha ha.
I see a hard lack of list off you, yet you were thinking "story after story", seems that is the only story you got, cupcake.
I don't understand why you are comparing pilot terminology to everyday person terminology. 99% of the population doesn't speak pilot-ese.
installing Autopilot prevents crashes -- by an astonishing 40 percent...
I think everybody knew that a solid autopilot system was going to be better than human drivers on average. Why is the author astonished by this?
But I'm willing to bet 100% of Tesla owners have flown SOMEWHERE before, where an AutoPilot was used, but never without a PILOT. The fact that it's industry jargon doesn't matter. It's becoming closer and closer to our natural understanding every day. The vehicle warns you anyhow, and even if you thought "well there wasn't a pilot in the airplane who flew me to LAX last time I traveled, this car must be able to run sans-driver!", the car tells you strait up that you must keep at attention.
If a car tells you "5 star safety rating!" and you elect not to strap the car seat in properly *despite* all the warning labels and instructions, does that mean you can sue the auto manufacturer, or fault them because "5 star means perfect"? No. Of course not. Implying otherwise is obtuse.
People keep making this argument about the analogy between Tesla's feature and the autopilot feature of airplanes, but how many normal people know an airplane's autopilot works?
That doesn't matter. The car specifically tells you to pay attention. So even if your perception was "The one time I flew, I didn't see a pilot or hear an announcement." You are still told that you have to maintain control of your car. Warning label argument still applies.
It's a pointless comparison unless it's a widely known fact among the general public, which I'd argue it is not.
But the general public doesn't matter. Its the segment of the public that can afford $80,000 on a car. I'd make the argument they tend to fly quite a bit and notice the $150,000/year employee the airlines keep on staff who sit at the front.
I'll bet most people have the same mis-impression of an airline's autopilot feature.
They have that warning label again, and anyone who has purchased one of these vehicles knows pretty fast the features and limits of its "autopilot".
Even so, I think we're just in a collective learning curve regarding semi-autonomous vehicles. Eventually, the cars will become fully autonomous anyhow, so I'm not terrible concerned. The fact that collisions are down by 40% validates what many of us long believed, which is that computers are going to be much safer drivers than humans. And this is just a very early and flawed first iteration of the technology to come.
Here I absolutely agree with you, 100%.
Wouldn't disengaging the autopilot when the driver's hands are off the wheel cause more crashes?
Well, they can do a forced transition back to driver control by having the system refuse to maintain speed and start applying brakes, until either the vehicle reaches a complete stop and remains stopped, or the driver puts their hands back on the wheel, and transition is then completed.
I've been on a plane for more hours than you have been alive, most of that in the seats at the front, yet I have not seen in detail how pilot and autopilot interact. Especially since your Saudi allies toppled a few buildings im NYC 16 years ago.
If an airplane autopilot goes bad it would take many tens of seconds if not minutes for disaster to ensue. They are basically dumb things that maintain direction and altitude. If the pilot looks out the window, it takes many seconds for an on coming plane to arrive. More likely they rely on TCAS, the transponder based alerting. But it all happens quite slowly during a cruise, which is why pilots can study a map while flying.
Cars on the other hand are often only a second or two from disaster. Swerve into oncoming traffic and things happen very fast indeed.
Just to chime in about the "Autopilot" name: The name is irrelevant. You're the one driving the car, and you alone are assuming the responsibility to know how it operates AND when to use it properly to both the limits of yourself and the system, nomenclature be damned. But if you ask me, "Autopilot" is just a bit aspirational. Does one "pilot" a car, or "drive" it? I've always "driven" cars and "piloted" airplanes. But YMMV, naturally. I'm not mad about it, just sayin'.
What I actually came here to ask is whether there is any data separating out airline pilots using these Tesla systems to see if mandatory training for proper use of appropriate levels of automation in varying conditions has any outcome on the incidence of crashes. What I'd wager is that this training and experience might carry over from one area to the other, seeing reduced incidences of crashes by airplane-autopilot trained drivers. This could mean that until we get to truly autonomous cars, it'd be wise to at least have some sort of minimum training requirement before enabling levels of automation on an individual driver basis.
Your post makes so little sense that it's worth removing your head from your neck so we can take a peak at what's going on inside.
If your trying something like a auto pilot system. Wouldn't you as a human be more cautious and aware? You can't program the auto pilot to drive aggressively or make foolish moves on the highway. Its whole purpose is to drive conservatively and with caution. I do not think we have anywhere near enough auto pilot like vehicles on the road compared to human drivers to make a claim that they are safer. Only that we can safely create technology that is trying to prove that. For example, let's put a autonomous race car on the track and see how it does against human drivers?
Thanks for the chuckle! Mod this guy up!
I cant do what you did.. i dont have the patience so i applaud you because i would have said "YOURE A FUCKING MORON BUT YOURE KINDOF RIGHT ON ONE PARRT!! RARWWW! lol. either way hopefully one day i will learn to be diplomatic
Wish i had mod points +2 Funny!
I'm sure after one or two 'Impeding Traffic' Tickets they will learn. Sounds like a lovely idea, I believe they already do something like this though. seeing as they have buzzers that tell you to put your hands on the wheel. there has to be some kind of a time limit where after X seconds decelerate
And you'd be yelling obscenities at someone who probably agrees with you in most aspects on this topic. All I'm saying is that comparing Tesla's 'autopilot' it to it's original moniker isn't a very compelling argument - nothing more, nothing less.
Contrary to what you and saloomy probably believe (based on the vociferous rebuttals) I don't actually believe that Tesla needs to change it's 'autopilot' name. Even if they called it "minor driver assist but please still pay attention to the road", stupid people are stupid, and will do stupid things regardless, while most people will use it responsibly after learning how it works. Of all the people driving Teslas, how many people were honestly confused by the name? I'm guessing not a lot, if any. So, the entire argument seems sort of silly to me.
See, that's why it's not a bad thing to remain civil.
Irony: Agile development has too much intertia to be abandoned now.
I actually agree 100% with that. I don't feel everything I do should be regulated due to a few stupid people that don't care enough to read or learn something.
Maybe you would care more if a stupid person killed someone close to you.
But the average traffic a plane encounters isn't at all like the average traffic a car encounters.
I'm talking about warning label stupid. Them drinking a gallon of bleach isn't going to kill anybody in my family unless they were one of the dumb ones. We have tampered with natural selection with our regulations and safety labels. And now we have an overpopulated mess of a world. I wasn't talking about the "I wonder if this gun can really kill somebody" stupid. Those people should be killed and their parents jailed for child abuse.
"there has to be some kind of a time limit where after X seconds decelerate"
It seems like it takes from 1 to 5 minutes for a warning depending on road conditions, and then a series of 3 warnings every 15 seconds after that.
"I'm talking about warning label stupid"
That is very common, even in higher iq people, and anyone with an iq of 70 can drive a car. So if you don't want to get hit by a car driven by a 'stupid' person it's good to tone down the 'autopilot' analogy.
"We have tampered with natural selection with our regulations and safety labels"
Some low iq people are more intelligent than some high iq people in many situations. Natural selection seems to prefer a large spread of iq. Human's are part of the process of natural selection, we can't step out of it, i.e. in a general sense, if we tamper, the tampering has been naturally selected.
but now kind of slowing of the vehicle? that seems stupid.
you went from we have to do something, to "in a general sense, if we tamper, the tampering has been naturally selected." Basically saying whatever is done is fate. so in that case why do anything? right?
"so in that case why do anything? right?"
If one thinks natural selection implies we can't choose or our choices are meaningless, maybe, but I don't, and natural selection doesn't imply it.
My point second point was directed towards arguments in general that use the idea that x is wrong because it is tampering with natural selection, which I disagree with for the reasons I wrote.
But I'm willing to bet 100% of Tesla owners have flown SOMEWHERE before, where an AutoPilot was used, but never without a PILOT.
Well, no shit. Why would you think there wouldn't be a pilot, even if there was some form of 'autopilot' in use? Even if there was a point A to point B, fully autonomous airplane autopilot, there is still going to be a pilot on board. A pilot still being on board tells us NOTHING about the level of autonomy of the plane.
So the 40% claim is deceiving.... Let's be clear about this: Let's say for example last year there were 2 crashes and this year there was 1.... that doesn't mean it's a 50% drop... the percentage is only high because the number of total incidents is low.
... there are 2 ratings: 1x5stars and 1x1star.... this averages to 3 stars... that doesn't mean anything until there's more ratings.
Now if last year had 200 crashes and this year 100.... I will DEFINITELY believe it's a 50% drop....
Similar to how a product is newly rated