Newest Tesla Autopilot Data Shows A 40% Drop in Crashes (bloomberg.com)
There's a surprise in the data from an investigation into Tesla safety by the U.S. National Highway Traffic Safety Administration.
An anonymous reader quotes Bloomberg:
[W]hile all Tesla vehicles come with the hardware necessary for Autopilot, you need a software upgrade that costs thousands of dollars to make it work. Since buyers can add Autopilot features after purchase, this provides a perfect before-and-after comparison. It turns out that, according to the data Tesla gave investigators, installing Autopilot prevents crashes -- by an astonishing 40 percent...
Now -- thanks to an investigation that initially hurt the company -- there is finally some real data, and it's good news for Tesla... As the software matures to match the new hardware, Musk said on Thursday via a Tweet, Tesla is targeting a 90 percent reduction in car crashes.
UPDATE (5/4/18): The NHTSA has now clarified that their study "did not assess the effectiveness of this technology.
UPDATE (2/16/19): The study's underlying data reveals serious flaws in the methodology that undermine its credibility, according to new analysis from a research and consulting firm.
Now -- thanks to an investigation that initially hurt the company -- there is finally some real data, and it's good news for Tesla... As the software matures to match the new hardware, Musk said on Thursday via a Tweet, Tesla is targeting a 90 percent reduction in car crashes.
UPDATE (5/4/18): The NHTSA has now clarified that their study "did not assess the effectiveness of this technology.
UPDATE (2/16/19): The study's underlying data reveals serious flaws in the methodology that undermine its credibility, according to new analysis from a research and consulting firm.
I think the technology is a good idea, but they've picked a terrible name for it. To someone who is uninformed, it makes it sound as though the feature enables automated driving for the vehicle, and while that may be the end goal, it's currently not at that level and may give a false sense of capability. They should refer to it as "Driver Assist" or something that doesn't leave anyone with a false impression of the capabilities of what it does.
If you just dont ever leave your house.
Correlation vs Causation anyone?
Could it be, with the crash history of "autopilot", people are now using it more as it was intended? As DRIVER ASSIST, rather than turning it on and dozing off behind the wheel?
I mean, THAT couldn't affect numbers at ALL, right?
Chas - The one, the only.
THANK GOD!!!
A crash rate of 1.3/ million miles and having 130 million miles of data means that there has been about 170 crashes.
I'm guessing accidents range from minor fender-benders (although with cars of today, a "minor" fender bender costs $2k+) to the fatal accident.
I would like to know where this 40% reduction takes place in the accident spectrum ? Does this mean that there are much fewer fender benders or fewer accidents which resulted in personal injuries?
If it's at the lower end of the range then big whoopdie fucking do - if it results in fewer injuries (and I would guess this would be significantly more than 40%) then it's something to look into and see if this improvement can be brought to other manufacturer's cars (and trucks).
Mimetics Inc. Twitter
One would expect that. Even a bad computer program with a dozen eyes is likely to be better than a bag of meat with only two.
I'm more concerned about the long-term secondary effects. Do drivers who get used to this technology become dependent on it, and thus have higher accident rates when driving rental cars that lack this technology?
Additionally, I'm less than convinced by the use of a single number here. To be meaningful, you need at least two numbers: the number of crashes avoided because of software intervention and the number of crashes caused by driver inattention. After all, if the system saves a bunch of lives because of things that a human driver couldn't have predicted, but costs a small number of lives because some humans depended too much on the vehicle to drive for them, then it is great from a statistical perspective, but that's little comfort for the families of people who died because the autopilot lulled them into a false sense of security.
Check out my sci-fi/humor trilogy at PatriotsBooks.
Why don't they target a 100% reduction in crashes?
I can't completely wrap my head around how they could do this study and how the statistics were calculated.. The article states this is a before/after test so presumably involves comparing the the crash rate before auto pilot with that after. But it is somewhat difficult to do because did they really include drivers that crashed (before getting into AutoPilot) to see if they would crash again (after AutoPilot)? I would imagine many people might even stop driving after a crash or at least have gotten a new car which might not be a Tesla. In other words, it seems that from the point on where AutoPilot is bought then the group is already suffering from self-selection bias since many of those who suffered accidents (reflecting a prone-ness to accidents) were selected out in the pre-AutoPilot phase, thus only getting to count for the pre-AutoPilot data. And they can't know how many, of those who crashed, who would have bought AutoPilot, had they not crashed, and what their accident rate would have been. It seems this would tend to make it seem as if AutoPilot increased safety eve if it didn't.
Another way of comparison could be to compare drivers buying AutoPilot vs not buying it from a given point in time. But that causes another problem namely that those buying the AutoPilot might not have the same risk/accident-rate as those not buying it. It could be they are richer, older, more careful etc.
The only fair way to do such a study would be to, at some point in time, randomly select a group of drivers who will get AutoPilot for free and another group who won't be able to use it. Then you can study exactly what is the safety effect of giving a driver AutoPilot.
I'll bet the sample size is in the dozens, and autopilot had only been it for a few years. There isn't enough data for me to believe anything. If I cause a wreck and I'm behind the wheel, it's my fault. If I die, I'm fine with that, I could have prevented it. If a computer kills me because some idiot programmer forgot a semicolon, I'll be pissed.
>> installing Autopilot prevents crashes -- by an astonishing 40 percent...you need a software upgrade that costs thousands of dollars to make it work
This kind of read like: "So...you want the software that shuts off your fuel value during a crash or the one that opens it full on impact. It's a $5K option...your choice, really."
If it's really just a software option, doesn't this sound a lot like the VW software "option" that cheated on emissions tests?
In fact, the regulatory solution is obvious. Require the damn autopilot to disengage graciously if hands are off the wheel for more than 3 seconds. Seriously, lane assist on the damn Toyota does the same. Hell, in the 1970's, the autopilot on the 747 was designed adequately to demand a pilot input every so often, though 30 minutes when oceanic is about reasonable.
Could someone paint fake road markings and cause a Tesla to crash? Perhaps into a wall with a fake/painted tunnel?
Someone needs to try this out.
And, frankly, someone that dumb was going to crash sooner or later anyway, so this at least delays the inevitable.
Story after story? List them, with the dates. Lets check it off against the number of people dying after putting "cruise control" on and taking a nap, hmm?
Just a reminder,
Expect media outlets whose owners will benefit financially from Tesla's success to report this in a positive light and pimp it hard.
Expect media outlets whose owners will benefit financially from Tesla's failure to report this in a negative light, bury it, or begin advertising sponsored competitor's autopilot as being superior.
Does anyone have a working link to the actual report? It was supposed to be at static.nhtsa.gov/odi/inv/2016/INCLA-PE16007-7876.PDF
when I got creamed out on my road bike, assuming it can detect pedestrians. I was carrying the damn thing across a cross walk (with the little green walky man no less) and somebody ran the light. They clipped the wheel of my bike or I wouldn't be here right now. The lady stopped. It as broad daylight but somehow she didn't "see" me. Folks tune out when driving. That light almost never turns red so it didn't occur to her to stop. Put another way they're driving with their lizard brains. I'd rather they do it with an electronic brain instead.
Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
How do we define a "crash", and how do we know that for example major crashes increased in frequency but minor ones decreased?
Maybe you need to find out first, eh?
I laugh at you.
Ha ha ha ha ha ha.
I see a hard lack of list off you, yet you were thinking "story after story", seems that is the only story you got, cupcake.
installing Autopilot prevents crashes -- by an astonishing 40 percent...
I think everybody knew that a solid autopilot system was going to be better than human drivers on average. Why is the author astonished by this?
If an airplane autopilot goes bad it would take many tens of seconds if not minutes for disaster to ensue. They are basically dumb things that maintain direction and altitude. If the pilot looks out the window, it takes many seconds for an on coming plane to arrive. More likely they rely on TCAS, the transponder based alerting. But it all happens quite slowly during a cruise, which is why pilots can study a map while flying.
Cars on the other hand are often only a second or two from disaster. Swerve into oncoming traffic and things happen very fast indeed.
Just to chime in about the "Autopilot" name: The name is irrelevant. You're the one driving the car, and you alone are assuming the responsibility to know how it operates AND when to use it properly to both the limits of yourself and the system, nomenclature be damned. But if you ask me, "Autopilot" is just a bit aspirational. Does one "pilot" a car, or "drive" it? I've always "driven" cars and "piloted" airplanes. But YMMV, naturally. I'm not mad about it, just sayin'.
What I actually came here to ask is whether there is any data separating out airline pilots using these Tesla systems to see if mandatory training for proper use of appropriate levels of automation in varying conditions has any outcome on the incidence of crashes. What I'd wager is that this training and experience might carry over from one area to the other, seeing reduced incidences of crashes by airplane-autopilot trained drivers. This could mean that until we get to truly autonomous cars, it'd be wise to at least have some sort of minimum training requirement before enabling levels of automation on an individual driver basis.
If your trying something like a auto pilot system. Wouldn't you as a human be more cautious and aware? You can't program the auto pilot to drive aggressively or make foolish moves on the highway. Its whole purpose is to drive conservatively and with caution. I do not think we have anywhere near enough auto pilot like vehicles on the road compared to human drivers to make a claim that they are safer. Only that we can safely create technology that is trying to prove that. For example, let's put a autonomous race car on the track and see how it does against human drivers?
So the 40% claim is deceiving.... Let's be clear about this: Let's say for example last year there were 2 crashes and this year there was 1.... that doesn't mean it's a 50% drop... the percentage is only high because the number of total incidents is low.
... there are 2 ratings: 1x5stars and 1x1star.... this averages to 3 stars... that doesn't mean anything until there's more ratings.
Now if last year had 200 crashes and this year 100.... I will DEFINITELY believe it's a 50% drop....
Similar to how a product is newly rated