Slashdot Mirror


Scientists Acknowledge Key Errors in Study of How Fast the Oceans Are Warming (washingtonpost.com)

A major study claimed the oceans were warming much faster than previously thought. But researchers now say they can't necessarily make that claim. From a report: Two weeks after the high-profile study was published in the journal Nature, its authors have submitted corrections to the publication. The Scripps Institution of Oceanography, home to several of the researchers involved, also noted the problems in the scientists' work and corrected a news release on its website, which previously had asserted that the study detailed how the Earth's oceans "have absorbed 60 percent more heat than previously thought."

"Unfortunately, we made mistakes here," said Ralph Keeling, a climate scientist at Scripps, who was a co-author of the study. "I think the main lesson is that you work as fast as you can to fix mistakes when you find them." The central problem, according to Keeling, came in how the researchers dealt with the uncertainty in their measurements. As a result, the findings suffer from too much doubt to definitively support the paper's conclusion about how much heat the oceans have absorbed over time.

The central conclusion of the study -- that oceans are retaining ever more energy as more heat is being trapped within Earth's climate system each year -- is in line with other studies that have drawn similar conclusions. And it hasn't changed much despite the errors. But Keeling said the authors' miscalculations mean there is a much larger margin of error in the findings, which means researchers can weigh in with less certainty than they thought.

6 of 280 comments (clear)

  1. Re:It's Called Science by Bender0x7D1 · · Score: 3, Informative

    Nature is a peer reviewed publication. So, there were multiple, independent levels of error. That's not how it's supposed to work.

    Ideally it works that way. However, it often fails in one way or another (skipped reviews, for profit models, no one wants to say a leader in a field is wrong, etc.) Which is why publication to a wide audience is, essentially, the final fail safe.

    --
    Reading code is like reading the dictionary - you have to read half of it before you can go back and understand it.
  2. that's not what peer review does by goombah99 · · Score: 5, Informative

    If you think Peer review catches mistakes then you need to learn more about peer review because that's not what it does.

    Peer review looks to see if the methods are reasonable to the task, if the authors show an awareness of the literature on the topic and by consequence know the pitfalls and problems others have overcome. It looks to see if the finding support the strength of the conclusions. And when possible it looks for gaps or alternative hypotheses that would have been reasonable to rule out given the strength of the conclusions.

    it does not check the work in detail that's essentially impossible except for glaring errors. Many peers won't even fully understand the topic but are experience enough to know how to check reasonableness of the approach and support for conclusions.

    In this case the retraction is not of the main finding. Their data are still fully consistent with the stated mean energy absorption. What they are retracting is the error bars on that analysis. It's the difference between saying the mean of a set of data is wrong, and the probability the mean of the data is different by 30% than the actual mean. They got the probability wrong. So their findings are less certain in strength.

    --
    Some drink at the fountain of knowledge. Others just gargle.
    1. Re:that's not what peer review does by msauve · · Score: 4, Informative

      "If you think Peer review catches mistakes..."

      It obviously doesn't always. I said it's supposed to, which is true. Nature's peer review policy specifically calls for reviewers to assess the "Appropriate use of statistics and treatment of uncertainties...Referees are expected to identify flaws..." You should have your posts peer reviewed to try and avoid further mistakes.

      --
      "National Security is the chief cause of national insecurity." - Celine's First Law
    2. Re:that's not what peer review does by Anonymous Coward · · Score: 3, Informative

      Disclaimer: I have done vast amounts of peer review in my field (physics) but did not review this paper.

      You've missed the point of what peer review actually does. It identifies errors of logic, and checks for feasibility. It does NOT redo calculations. In this case, the stats and uncertainties were treated appropriately, but calculated wrong. Peer review is NOT designed to catch that kind of error. If it were, it would take me as long to review a paper as many authors take to write it, or even longer as they'll be better at the calculations than I am.

      A mistake is akin to making a slip in some algebra, or adding together thousands of numbers and missing one. We don't catch that. A flaw is saying something like "Apples are red. This item is red. Therefore this item must be an apple". An error of logic, or an infeasible conclusion.

  3. Re:It's Called Science by Anonymous Coward · · Score: 1, Informative

    This is the issue with the "subtle nuances". The authors have acknowledged the error in uncertainty. However, they have not explicitly addressed the other issue Nic found, which that their central estimate is biased high. Those that are interested should really read both posts from Nic.

    And for those that are defending peer review, you should understand the method Nic used to find that the paper might contain as error. The claim was that a change of 23.2 over a 25 year period yielded a trend of 1.16 per year, instead of something closer to 0.9.

  4. Re:So what? So the claim was wrong! by HornWumpus · · Score: 3, Informative

    No. You're just repeating the claim again.

    People with 'physics and math' backgrounds are routinely told to shut up about climate and dismissed by 'climate scientists'.

    Also it's _not_ just about error bars, the mean value is also wrong. Read TFA.

    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'