Slashdot Mirror


Why Standard Deviation Should Be Retired From Scientific Use

An anonymous reader writes "Statistician and author Nassim Taleb has a suggestion for scientific researchers: stop trying to use standard deviations in your work. He says it's misunderstood more often than not, and also not the best tool for its purpose. Taleb thinks researchers should use mean deviation instead. 'It is all due to a historical accident: in 1893, the great Karl Pearson introduced the term "standard deviation" for what had been known as "root mean square error." The confusion started then: people thought it meant mean deviation. The idea stuck: every time a newspaper has attempted to clarify the concept of market "volatility", it defined it verbally as mean deviation yet produced the numerical measure of the (higher) standard deviation. But it is not just journalists who fall for the mistake: I recall seeing official documents from the department of commerce and the Federal Reserve partaking of the conflation, even regulators in statements on market volatility. What is worse, Goldstein and I found that a high number of data scientists (many with PhDs) also get confused in real life.'"

8 of 312 comments (clear)

  1. Re:Basic Statistics by Mr+D+from+63 · · Score: 5, Funny

    We should not ask statisticians to change their terms because people are too stupid to understand them.

    But doesn't that give an unfair advantage to statisticians? You have to give everyone a chance!

  2. Re:response by flibbajobber · · Score: 5, Funny

    First!

    ... to within 0.5 standard deviations.

    Actually, the more posts this story attracts, the more accurate your statement is, and the fewer standard deviations you are away from true first. Response times not being distributed in a Gaussian curve perhaps complicates things.

  3. Re:Basic Statistics by gninnor · · Score: 5, Funny

    Then it would be the same as pi, and that would just be silly.

  4. Re:The big picture by boristhespider · · Score: 4, Funny

    I often change CSensiblyNamedClassThatDescribesItsFunctionWell to bTrue throughout the code for precisely this reason and no-one ever appreciates it :(

  5. Re:Basic Statistics by camperdave · · Score: 5, Funny

    The phrase "orbital process" means entirely different things to brain surgeons and rocket scientists.

    --
    When our name is on the back of your car, we're behind you all the way!
  6. Re:So you want to decertify a management degree... by rwa2 · · Score: 4, Funny

    ...and besides... JUST THINK of all the rigorous Lean Management courses that will have to re-certify all of their "Six-Sigma Black Belts" to some kind of "Half-Dozen of the Other" degrees!

    PANDEMONIUM!!!

  7. Re:Basic Statistics by Ford+Prefect · · Score: 4, Funny

    Nuclear Resonance Imaging (NMR) was changed because people were afraid of word Nuclear despite it describing the process, unlike its replacement term.

    Also, if you arrived at a hospital saying you were there for an NMR, you might have received something other than what you were expecting.

    --
    Tedious Bloggy Stuff - hooray?
  8. Re:The big picture by Jamu · · Score: 3, Funny

    pnWhat vIs nWrong cWith aHungarian nNotation?

    --
    Who ordered that?