Slashdot Mirror


NHTSA Tells Tesla To Stop Exaggerating Model S Safety Rating

cartechboy writes "There's always that kid in the class that ruins it for everyone when being graded on a curve. At the moment, that kid is Tesla and Elon Musk. Tesla's been proudly claiming the Model S is one of the safest cars in the word despite the recent fire controversy. And while it may be just that, claiming it earned 5.4 stars from NHTSA isn't pleasing the safety agency as there is no such thing as a rating higher than five. While NHTSA already released a statement indirectly to Tesla saying it doesn't release ratings higher than 5, Tesla continued to promote this fictitious rating. Now NHTSA has updated its guidelines explicitly stating safety ratings are whole numbers only and that 5 stars is the maximum advertisers can claim. If advertisers and automakers decide to disregard these rules NHTSA is threatening removal from the program or referral to state authorities for appropriate action. Basically, hey Tesla, stop making false claims."

30 of 284 comments (clear)

  1. He'll love that by Joce640k · · Score: 4, Funny

    My car's rating is higher than the maximum rating allowed by the NHTSA.

    --
    No sig today...
    1. Re:He'll love that by omnichad · · Score: 4, Funny

      Mine goes to 11.

    2. Re:He'll love that by LordLimecat · · Score: 5, Informative

      From Tesla's website, the actual claim:

      NHTSA does not publish a star rating above 5, however safety levels better than 5 stars are captured in the overall Vehicle Safety Score (VSS) provided to manufacturers, where the Model S achieved a new combined record of 5.4 stars

      --Source

      I can understand the NHTSA complaint (Tesla's claims could be misleading out of context), but its not like Tesla is making any false claims.

      Also, I recall this claim / story being about 3 months old at this point, and I believe NHTSA complained around the same time. Is slashdot seriously that far behind, or (as I suspect) is this an attempt to generate additional controversy and angst due to the other Tesla stories in the news?

    3. Re:He'll love that by jrumney · · Score: 4, Interesting

      It reminds me of when the laboratories that rated sunscreens could only rate them up to SPF 15, and pretty much every sunblock on the market was exceeding that. At some point, at least in New Zealand and Australia, the government stepped in and said they couldn't advertise higher than 15, so they all became SPF15+ for a while.

  2. I wonder what Elon's rebuttal to this will be... by Midnight_Falcon · · Score: 5, Funny

    Stay tuned for Elon Musk's critique of the NHTSA and long blog post detailing why the NHTSA is a bunch of corrupt scumbags and how Tesla is so awesome that it is able to get ratings above a perfect score.

  3. Misleading by gabeman-o · · Score: 5, Informative

    It got a 5.4 rating, but the NHTSA guidelines only allow them to advertise a whole number.

    1. Re:Misleading by harvestsun · · Score: 5, Informative
      I don't know why this was modded as funny, it's right out of the article:

      NHTSA does not publish a star rating above 5, however safety levels better than 5 stars are captured in the overall Vehicle Safety Score (VSS) provided to manufacturers, where the Model S achieved a new combined record of 5.4 stars.

    2. Re:Misleading by Tailhook · · Score: 5, Insightful

      Yet that's the actual, accurate score. I don't see why the actual score can't be reported?

      There is no analytical basis to explain exactly how 5.1 is less safe than 5.4 and the analysis makes no such claim. If the NHTSA allowed manufacturers to abuse the figures by claiming these fractions are meaningful then the rating system would lose credibility. Ultimately manufacturers might game the system to amplify a meaningless fraction.

      Tesla had this explained to them and Tesla ignored it. Now the NHTSA has had to get official on their asses and tell them to stop. This is Tesla's own fault, whether the fanbois like it or not.

      --
      Maw! Fire up the karma burner!
    3. Re:Misleading by SecurityTheatre · · Score: 4, Informative

      Cars today are much better than they were in 1990 when they developed this system.

      3-star ratings weren't uncommon back then.

      http://www.safercar.gov/Vehicle+Shoppers/5-Star+Safety+Ratings/1990-2010+Vehicles/Vehicle-Detail?vehicleId=3098

      There are still some cars that get 4-stars, but this particular model (RAV4) got several 4-star ratings, prompting newspaper articles about "failing" safety tests. People clearly expect perfect security and safety all the time at all costs. (See: Patriot Act)

      http://www.safercar.gov/Vehicle+Shoppers/5-Star+Safety+Ratings/2011-Newer+Vehicles/Vehicle-Detail?vehicleId=8143

    4. Re:Misleading by Anonymous Coward · · Score: 5, Funny

      Not... Sure .. if I should take the advice from a 93 Escort wagon when it comes to car safety.

    5. Re:Misleading by mysidia · · Score: 4, Interesting

      There is no analytical basis to explain exactly how 5.1 is less safe than 5.4 and the analysis makes no such claim. If the NHTSA allowed manufacturers to abuse the figures by claiming these fractions are meaningful then the rating system would lose credibility.

      If that's true, then there's also no analytical basis to explain how exactly 4.4 (Which you rounded down to 4) is less safe than 4.6 (Which you rounded up to 5).

      The fact of the matter is, if such is your degree of error, then You have to make distinctions for which there is no analytical basis;At some point, if you are truncating the number: you have to choose which whole number you will truncate it too, AND another figure that is only 0.1 different, will appear as a whole POINT less safe or more safe than the other --- while other numbers that differ by 0.4 or more, will be truncated to the same value.

      Listing the more detailed figure is not per-se an abuse, then.

      There is false precision there; and there is also false precision truncating the number+fractional part to one of the surrounding whole numbers.

      Conveying the decimal point conveys false precision, BUT at the advantage of eliminating bias and haphazard truncation.

      You can actually see that one car got 4.4, and another got 4.6; instead of seeing "4 and 5"; Off by a whole star ------ there is something to hand you a relative showing, that they're really rather close, maybe the same.

    6. Re:Misleading by FatLittleMonkey · · Score: 5, Insightful

      The NHTSA doesn't want manufacturers to optimise for the particular suite of sample accident scenarios to gain an extra 0.1 score and beat their rivals, because that would not mean that the real-world safety was improved and might even mean that safety declined slightly in non-tested accident scenarios. By rounding the scores it eliminates the motivation for this pointless effort,

      If that were true, they wouldn't give the precise VSS scores to the manufacturers, just a "where you failed" review for individual tests. In the scenario Mysidia described (4.4 versus 4.6), there's every reason for a manufacturer to want to sneak above that .5 mark, in order to get a "NHTSA 5-Star Rating! * * * * *". If you were a manufacturer, wouldn't you give up a few percent of real-world safety for that extra star (by sneaking from 4.4 to 4.6)? Say by enlarging the rear pillars to cheaply improve your inverted-drop roof-crush score (your area of lowest performance) in spite of loss of visibility it causes (and thus increased real-world accidents), rather than actually improving roof-crush performance through proper structural changes. Or sacrificing your top score in roll-over stability by adding or removing elements to improve your very low-scoring rear collision survival test. Whereas if you weren't given a VSS score for each test, you would only know that the review says your rear-collision survivability sucks, and you'd have to work to improve it without reducing safety in other areas (because you wouldn't know where you exceeded the tests and thus have margin to sacrifice.) The current system clearly encourages manufacturers to "build to the test" at the expense of real-world safety.

      --
      Science is all about firing a drunk pig out of a cannon just to see what happens.
  4. neener neener neener by spirit_fingers · · Score: 5, Funny

    Liar liar car on fire!

    1. Re:neener neener neener by CanHasDIY · · Score: 4, Insightful

      Liar liar car on fire!

      Paid shill?

      Person with a sense of humor. You should go find one yourself.

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
  5. (preparing to duck my head) by Tablizer · · Score: 5, Funny

    If you like your Tesla safety rating, you can keep your Tesla safety rating.

  6. Bad title by PureRain · · Score: 5, Informative

    Just to clarify, the NHTSA hasn't said anything to Tesla like the summary states. It has clarified its rating system. That is all.

    That article is written like a high schooler's blog.

  7. Three month old dupe by kaleth · · Score: 4, Informative
  8. Genius and insanity go hand in hand by Dega704 · · Score: 4, Interesting

    Elon Musk would never have accomplished what he has if it wasn't for his rabid passion and forceful, egotistical personality. He is trying to change the status quo in an industry where many have tried and failed, and where many want Tesla to fail as well. He had best try to temper himself, though; lest he become our generation's Nikola Tesla/Howard Hughes in more ways than one.....

    1. Re:Genius and insanity go hand in hand by Anonymous Coward · · Score: 4, Insightful

      I am glad he has fire and passion. He is fighting against a lobby that spans centuries, so even if his claims might be a bit over the top, the people who want to seem him out of business are many, and are THE richest people out there.

      He is competing against the most powerful people on this planet, so it is pretty darn amazing he has done this well. He also has showed the auto industry is stagnant -- his first commercial vehicle faster than most sports cars except the high end Italian makes? Impressive. Same car using a completely new drivetrain? More impressive. Same car with zero deaths? Still more impressive.

      Elon Musk may be a bit of a blowhard, but he is actually effecting change.

      Compared to Teslas, what other electric vehicles out there can smoke even an average sports car like a Corvette? A Leaf? Maybe in free fall. A Prius. Nope. Elon Musk has made a completely new car category, something not seen since the soccer moms wanted station wagons back, but didn't want them called station wagons, so they were named crossovers.

  9. Re:Rounding is stupid by BitZtream · · Score: 4, Insightful

    Because the rating system isn't accurate enough to say for sure that .1 difference is accurate. The ratings are subjective enough that whole numbers are as accurate as you can get reliably.

    --
    Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
  10. Other manufacturers are jealous by Imagix · · Score: 5, Insightful

    Apparently people aren't reading what's been said. Tesla's press release says: "National Highway Traffic Safety Administration (NHTSA) has awarded the Tesla Model S a 5-star safety rating", and "NHTSA does not publish a star rating above 5". Thus Tesla is not claiming that they were assigned a 5.4 since they outright acknowledge that NHTSA doesn't publish a rating above 5. What Tesla did say is that if one were to take the individual scores that were provided by the NHTSA (which apparently includes ratings above 5, and possibly decimal as well) and average those, the resultant number would be a 5.4.
    Now what is probably getting the other manufacturers upset is that the clipping of the results at 5 means that the vehicles that just squeaked into the 5 look the same as vehicles which may have blown past the 5. If they didn't like that, why aren't the individual scores also integral and clipped at 5? Then one could not possibly claim (or even appear to claim) a number higher than 5.
    So, this whole release is trying to beat up Tesla for something they didn't say. They didn't say that the NHTSA awarded them a 5.4 rating (see the first quote). They did say: "achieved a new combined record of 5.4 stars.".

  11. Re:I wonder what Elon's rebuttal to this will be.. by FlyHelicopters · · Score: 4, Insightful
    Musk might even be correct, but one must always be careful around government types, they'll use your own tax dollars to smack you down and have nothing better to do.

    Sometimes you have to know when to hold 'em, know when to fold 'em, and know when to walk away.

  12. Re:Sorry NHTSA by ElectricTurtle · · Score: 4, Funny

    Pfffff...... his sound system goes to 11 .4 , bitch!

    --
    I support the Slashcott and will not be reading or commenting from 2/10/14 to 2/17/14. Beta is steaming pile of dog shit
  13. Re:False? by QuasiSteve · · Score: 4, Insightful

    As far as I can tell, Tesla claims - as do several news outlets - that the NHTSA also releases some other raw numbers to the manufacturers which Tesla then decided to 'combine' (whether that's adding or averaging or whatever - who knows.) to give a 5.4 .

    Really, the issue is lack of transparency - since we, the public, don't get to see those numbers. Thus we can't really give a good opinion other than "NHTSA says 5 is the maximum. THE MAXIMUM!" and all nod in agreement at the overlord's words apparently for fear of getting booted out.

    This in turn leads to gems like this:
    "No matter what, you can't say it's the safest car ever tested, just that it had the best overall test score of any vehicle tested by NHTSA." - NHTSA ( http://abcnews.go.com/Technology/tesla-crash-test-rating-high-maker-claimed/story?id=20024779 )

    So it had the best overall test score .. but is not necessarily the safest. But the test is on safety. So it's the best in safety.. but not necessarily the best in safety.

    Maybe while they're quibbling they could come up with a system that makes sense to themselves, the manufacturers and, most importantly, the public. If in the end that means Tesla does get a 5.4 and they want to hang on to 5 stars - well I guess they'll just have to lower the rating on a bunch of other cars.

  14. Re:I wonder what Elon's rebuttal to this will be.. by MiniMike · · Score: 4, Funny

    The next Tesla ad will claim a safety rating of 11.0 stars from the NHTSA (small print: National Highway Tesla Sales Association).

  15. Re:I wonder what Elon's rebuttal to this will be.. by bluefoxlucid · · Score: 4, Insightful

    About 80% of the comments already seem to be talk about how the NHTSA actually did give them a 5.4, but only allows them to advertise whole numbers and nothing above 5. So... it's a technical dispute over bureaucratic assholery.

  16. Re:Up next: "Zero Emissions" claim by NoImNotNineVolt · · Score: 5, Insightful

    The Tesla, a vehicle, does not generate emissions.

    If you charge it with carbon-sourced electricity, the Tesla, a vehicle, still doesn't generate emissions.
    If you strap a diesel generator to the roof to run your personal electronics, the Tesla, a vehicle, still doesn't generate emissions.
    If you load up the trunk with flatulent cattle, the Tesla, a vehicle, still doesn't generate emissions.

    That some people have trouble parsing natural language is not Elon's problem.

    --
    Chuuch. Preach. Tabernacle.
  17. What a piece of Junk! by freeze128 · · Score: 4, Funny

    "She'll make .5 past light."
    "She may not look like much, but she's got it where it counts."

  18. Re:I wonder what Elon's rebuttal to this will be.. by EvanED · · Score: 4, Insightful

    So... it's a technical dispute over bureaucratic assholery.

    To play devil's advocate for a second, measurements like the safety ratings inherently have error to them. For something like car safety, is a 5.4 really better than a 5.3, or was that just a quirk of the particular tests they did, and the 5.3 would be safer on the road?

    Look at it from the NHTSA's perspective: if you think that Tesla's advertising is making claims that aren't particularly supportable because of margins of error like that and they're using your data to do it (and in the process saying essentially "NHTSA says we're the safest car on the road" when you don't want to make that claim), I think you'd be well within the realm of reasonableness to make them stop it.

  19. Re:I wonder what Elon's rebuttal to this will be.. by tlhIngan · · Score: 5, Informative

    To play devil's advocate for a second, measurements like the safety ratings inherently have error to them. For something like car safety, is a 5.4 really better than a 5.3, or was that just a quirk of the particular tests they did, and the 5.3 would be safer on the road?

    Not really.

    What happens is cars are rated to the current safety rating - the reason you can score above 5 is because the number is based on the raw figures and the current weightings.

    The NHTSA records down in its database the raw numbers, then uses those numbers to calculate the safety rating based on the current weightings (from empirical data). This lets them recalculate the safety rating as need be - yesteryear's 5 stars may be this year's 3 stars, for example. Or, depending on how cars individually perform, it's possible two 5 star cars with the old rating may become a 3-star and a 4-star car.

    So you cannot compare "stars" between model years, but you can compare them with historical vehicles recalculated to new standards. After all, many old 5 star vehicles may lack the safety features present on today's modern vehicles, so they won't be 5 stars anymore in the current rating.

    The rating will go down as new model years and new tests are introduced - after all, we'd have hit 5 stars 50 years ago if the tests didn't change. The NHTSA updates its tests and ratings when too many cars are pegged - and there's a new test that apparently reflect the more common crashes that many "5 star" cars now fare poorly on.

    Next year, the 2013 Tesla Model S may drop from 5.4 to 4.3. But the 2014 Tesla Model S may still get a full 5 stars because Tesla anticipated the new tests and built the cars to withstand them appropriately.