Slashdot Mirror


Second Inquiry Exonerates Climatic Research Unit

mvdwege writes "After being cleared of charges of misconduct by a parliamentary committee, now the CRU has the results of the inquiry (PDF) by a panel of scientists into their scientific methods. Here is the CRU press release. Criticisms: The statistical methods used, though arriving at correct results, are not optimal, and it is recommended future studies involve professional statisticians if possible; and the CRU scientists are lacking somewhat in organization. A very far cry from the widespread allegations of fraud. It seems 'Climategate' is ending with a whimper."

20 of 764 comments (clear)

  1. Doesn't matter. by Gerafix · · Score: 5, Insightful

    All the skeptics are just going to cry cover up. All the people who accepted climate change will just go on accepting it. And nobody will do anything about anything because apathy rules.

    1. Re:Doesn't matter. by phantomfive · · Score: 5, Insightful

      My problem with these scientists (as revealed in the leaked emails) was two things:

      1) It showed that the scientists have a very real agenda. While I understand that everyone feels strongly about things sometimes and scientists are only human, when a good scientist notices that he favors a hypothesis, he will test it more rigorously, to make sure it is not his feelings that are distorting his view. This seems to be the opposite approach to what these scientists are taking: they are happy when people who disagree with them die. They show a willingness to try to suppress contrary evidence, even if it means changing the peer review process. Not good stuff, and it makes it hard to trust them.

      2) The presentation to the general public is different than the presentation to scientists. When they publish in peer reviewed publications, they are careful to qualify their statements and not make unsupported conjectures (at least according to the review mentioned here, which I have no reason to doubt). When they speak to the public, the statements are often more dire, and not necessarily supported by the science. You see the results of this kind of stuff a lot, like with the Himalayan glaciers melting completely within the next 30 years (which turned out to be false) or if you talk to the average person about global warming, they will think that New York is going to be submerged, which is not supported by any peer reviewed research.

      In essence, these scientists have lost my trust, even if they have not crossed the line into fraud (which I am happy they didn't: this field of science would have been a real mess if they had).

      --
      Qxe4
    2. Re:Doesn't matter. by gtbritishskull · · Score: 5, Insightful

      Your response makes it obvious that you are an academic. Academics don't have to produce anything (besides words). I am an Engineer at a private company. I have to put a product out that works. There are time limits. If I am not sure how it works, I can't say "well, lets just look at this for another 30 years and make sure we get the math correct". I have to take the facts that I do know, make assumptions, and act on them.

      The science is never going to be good enough for you, because everything is based on assumptions. The "Theory of Gravity" is wrong. It breaks down at very small distances. But, in the real world, I have to assume that it is good enough and use it to get my work done. Other people have told me, "Well, we can't prove global warming correct, so we should just wait another 30 years until the science works itself out." This is very convenient because you don't have to do anything. If in 30 years the earth is screwed, you can just say that now we have the science. If it is not, you can say you are right. But I will not accept that. Don't tell me why I am wrong, tell me why you are right. What is your alternate theory, and where is your supporting evidence. PROVE that my theory is worse than yours. But, you can't. All you are is an obstructionist. You don't have a proposal that you are willing to put anything behind (your career, your reputation, your future). All you have is your proposal that we don't know anything, so we shouldn't do anything. That proposal I do not accept.

      This is also apparent from your comment about the big bang. You just say it is wrong. What is your alternative? It is not so easy when you have to support something instead of just sitting back and telling everyone else why they are wrong.

      I am going to modify an age old adage...

      "Those who can, do. Those who can't, teach. And then tell the people who are 'doing' why they are wrong."

  2. Here is how you do science. by dbc · · Score: 5, Insightful

    1. Make all your data available to anybody.
    2. Make all your analysis software available to anybody.

    The point of science is to let other try to replicate your experiments and analysis to see if they get they same answer. When CRU starts doing these things, wake me up. I'm not really interested in what blue-ribbon committees of politicians think of their science.

    1. Re:Here is how you do science. by Anonymous Coward · · Score: 5, Informative

      blue-ribbon committees of politicians

      From page 7 of TFA:

      APPENDIX A
      PANEL MEMBERSHIP
      Chair: Prof Ron Oxburgh FRS (Lord Oxburgh of Liverpool)
      Prof Huw Davies, ETH Zürich
      Prof Kerry Emanuel, Massachusetts Institute of Technology
      Prof Lisa Graumlich, University of Arizona.
      Prof David Hand FBA, Imperial College, London.
      Prof Herbert Huppert FRS, University of Cambridge
      Prof Michael Kelly FRS, University of Cambridge

    2. Re:Here is how you do science. by Sarten-X · · Score: 5, Insightful

      Meanwhile, that smart kid at a competing lab who has the intelligence to make an even better discovery doesn't see the data and can't run the experiment/analysis until it's far too late, and the world has committed itself to bad policies based on bad science. Fifty years later, they correct the mistake at great expense, and say it was all based on the best we could do at the time.

      Closed research considered harmful.

      I'm not going to comment on whether this specific case is valid or not, but openness is requisite!

      --
      You do not have a moral or legal right to do absolutely anything you want.
    3. Re:Here is how you do science. by phantomfive · · Score: 5, Informative

      In case anyone is wondering about these people (because I was, and thus checked):

      * Prof Ron Oxburgh FRS: a geophysicist, strongly worried about climate change. Worked with Shell and has ties to a number of alternate energy companies.
      * Prof. Huw C. Davies: Works in the Institute of Atmosphere and Climate, is a climate modeler. Couldn't find any industry links for him.
      * Prof Kerry Emanuel: Professor of Atmospheric Science, is extremely interested in hurricanes and cyclones. Seems to disagree with the IPCC position that hurricanes are increasing because of global warming.
      * Prof Lisa Graumlich: Director of the school of Natural Resources and the Environment. Doesn't seem particularly an expert on global warming, but if you want to know what effect a changing climate would have on agriculture, ask her.
      * Prof David Hand: a statistician. He's done statistic work for a lot of companies. Doesn't seem to know much about climatology, but he knows more about statistics than I even dreamed existed.
      * Prof David Hand: Professor of Theoretical Geophysics. Has publicly criticized the Mann Hockey Stick graph. Also really likes math.
      * Prof Michael Kelly: spent a lot of time researching semiconductors. Seems to have no relation to climate science at all, but he is the part-time Chief Scientific Advisor to the Department for Communities and Local Government, whatever that is.

      Seems they chose a good variety of people, and the chances of these guys being part of a conspiracy are low. Also, they are a smart group, and I would not try to trick them.

      --
      Qxe4
    4. Re:Here is how you do science. by quokkaZ · · Score: 5, Informative

      It seems some "skeptics" have (finally) got off their arses and made an honest attempt to make their own global temperature reconstruction using the NCDC dataset. Which is a great improvement over the morons who think filling in form letters for vexatious FOI requests has something to do with science.

      And what a surprise! They find that their record pretty much agrees with the CRU compiled record. If anything it shows a little more warming.

      It is discussed here http://noconsensus.wordpress.com/2010/04/29/global-land-temps-cru-style/

    5. Re:Here is how you do science. by Daniel+Dvorkin · · Score: 5, Insightful

      We're lucky in biology to have funding agencies which regularly kick out rather large amounts of money specifically for the purpose of building and maintaining public data repositories. Most other branches of science, including climatology, don't have that. Now, you'd think that with all the billions of dollars that the deniers insist environmentalists are making on climate change, someone could find a few bucks here and there for a server farm, but so far it doesn't seem to be happening.

      --
      The correlation between ignorance of statistics and using "correlation is not causation" as an argument is close to 1.
  3. Sadly... by sonicmerlin · · Score: 5, Insightful

    No matter how much evidence you provide for the innocence of these researchers, the paranoid will simply decry the people conducting the investigation as "part of the conspiracy".

    That's the major problem with the anti-AGW group. If they could point to any legitimate research that was submitted to peer review and survived dissection by experts which punched holes in AGW, they would have done so by now. Instead they rely on simply muddying the waters with screams of deceit and conspiracies, essentially propaganda to confuse the laymen. And unfortunately those who are simply inclined to not want to spend any more money, whether it be to save the environment or provide for the health of the poor, will lap up the lies and spit them out as if they were gospel.

    I see the same ridiculous, already debunked arguments used by anti-AGW people on this forum every time one of these articles comes up. They don't read for information. They post and run away. There are many moderators who simply mod informative posts down just because the science completely disagrees with what they want reality to be. There's no pleasing them.

    1. Re:Sadly... by hsthompson69 · · Score: 5, Insightful

      The real problem here is that the pro-AGW group is going about science all wrong -> they're trying to prove their point with more data that buttresses their theory. They look around, find scads of data that fits their model, and with enough data, declare the "debate is over".

      Except that's not science. It's not even bad science, it's just simply not science. You don't prove your point by finding more data that agrees with you, you prove your point by looking hard for data that does *not* agree with you, and not finding it. It's a subtle point, but one that is profoundly misunderstood by the masses. You can always find more data to support your theory, if you're willing to ignore data that does not support it.

      So the anti-AGW folk have it easy -> they just need to "cherry pick" data that refutes the AGW theory. Their search for data has a much, much lower bar because they don't need to have 10,000 refutations, or a million refutations, they just need one refutation. Just one bit of data that breaks the model, and the model must be changed, or abandoned.

      The bigger problem of all this is that when it comes right down to it, the pro-AGW folks haven't really stated a falsifiable theory. They have in fact scrupulously avoided a falsifiable theory (warm winter? Global warming! cold winter? Global warming!), and have instead created a political movement rather than a scientific discussion.

      For those pro-AGWers who want to mod down, fine. But do me a favor and come up with a falsifiable hypothesis while you're at it.

    2. Re:Sadly... by phantomfive · · Score: 5, Interesting

      They have come up with a falsifiable theory. The problem is it is presented differently to scientists and to the general public.

      To scientists, the theory is this: adding CO2 to the atmosphere will somewhat warm the atmosphere. This may cause some minor changes in the earth's climate system. This hypothesis is fairly well accepted by every scientist, even the anti-AGW ones.

      To the public, the hypothesis is presented as: DISASTER!!!!!!!!!!!! Polar bears dying, glaciers melting, millions dying, wars, catastrophe!!

      This disconnect between the science world and the general public world reminds me of Y2K, which was treated in journals with studies about how much fixing it would cost, and boring things like that. Whereas in mainstream press it was represented as literally the end of the world. I had someone ask me at the time if all the power plants were going to explode. That wasn't even in the realm of reasonability in the scientific press.

      --
      Qxe4
    3. Re:Sadly... by quokkaZ · · Score: 5, Informative

      You want some falsifiable predictions from mainstream climate science. Try these:

      1. The global temperature will increase - predicted by Hansen's model from early eighties. There is an observed increase in temperature.

      2. Arctic and antarctic to warm faster than rest of the planet - predicted by all models. Observed.

      3. Troposphere to warm and stratosphere to cool - predicted by all models. Observed.

      4. Increasing signature of CO2 in long wave spectrum form top of atmosphere. Observed by satellite spectrographically.

      5. Increasing acidification of the oceans. Observed.

      and plenty more where those came from. Please cut the crap about climate science not being falsifiable. Try looking at the evidence, the science and the facts for a change.

    4. Re:Sadly... by DKalkin · · Score: 5, Insightful

      The real problem here is that the pro-AGW group is going about science all wrong -> they're trying to prove their point with more data that buttresses their theory. They look around, find scads of data that fits their model, and with enough data, declare the "debate is over".

      Except that's not science. It's not even bad science, it's just simply not science. You don't prove your point by finding more data that agrees with you, you prove your point by looking hard for data that does *not* agree with you, and not finding it...

      The bigger problem of all this is that when it comes right down to it, the pro-AGW folks haven't really stated a falsifiable theory. They have in fact scrupulously avoided a falsifiable theory (warm winter? Global warming! cold winter? Global warming!), and have instead created a political movement rather than a scientific discussion.

      For those pro-AGWers who want to mod down, fine. But do me a favor and come up with a falsifiable hypothesis while you're at it.

      I really wish Slashdotters would stop making arguments premised on a mish-mash of different "definitions" of science half-remembered from one source or another. Defining the scientific method in general terms is actually a really hard problem, which philosophers of science, and practicing scientists with an interest in philosophy, have struggled with for a century without coming to any sort of consensus. (It's known as the "demarcation problem", meaning the demarcation of science and pseudo-science.) There are no easy applications.

      The parent - like many people - refers to Popper's "falsifiability" criterion, but nobody who specializes in the subject accepts this criterion anymore in any simple fashion (Popper himself was more complex than most of his internet would-be followers). These are the problems: Every real scientific theory, from physics to biology, has to deal with one or more falsifiers throughout its existence; there are always unresolved problems, apparent pieces of counter-evidence, inexplicable observations, mathematical inconsistencies or unwarranted assumptions. But on the other hand, for any given falsifier, someone can always come up with some sort of explanation which preserves the original theory, in the worst case by either dismissing the evidence as necessarily instrument error, or by modifying the theory in an ad-hoc, one-off way. And more careful, less idealized studies of actual scientific practice have shown all kinds of complications; for example, for a century after Copernicus the Ptolemaic model fit observations better.

      So the assertion that climate modeling is "not science", because, given the unsupported assertion that climate modelers don't look for counter-evidence, it doesn't fit some abstract idea of what science should be, is worth pretty much nothing. In general, anyone who writes that they can dismiss some field of study practiced in research universities and published in peer-reviewed journals as "not really science" on the basis of a one-paragraph description of what science really is, is talking out of their ass.

      On the specific question of anthropogenic global warming. As anyone who pays any attention to what climate researchers actually write knows, neither "warm winter" nor "cold winter" is a claimed prediction of the models. The predictions take the form of an average global temperature rise over a period of years, or a set of possible average temperatures given various possible levels of carbon dioxide emissions. And James Hansen's models from the 1980s are looking pretty good today.

  4. Let's go ahead and quote from the report: by symbolset · · Score: 5, Insightful

    The Panel was not concerned with the question of whether the conclusions of the published research were correct. Rather it was asked to come to a view on the integrity of the Unit's research and whether as far as could be determined the conclusions represented an honest and scientifically justified interpretation of the data. The Panel worked by examining representative publications by members of the Unit and subsequently by making two visits to the University and interviewing and questioning members of the Unit. Not all the panel were present on both occasions but two members were present on both occasions to maintain continuity. About fifteen person/days were spent at the University discussing the Unit's work.

    So... we didn't look into whether their numbers were right. We looked over their published papers and chatted with them a couple of times and they seem like forthright folks. We won't tell you who was there each time - that would be too much disclosure.

    No whitewash here. Oh, no. Further:

    We have not exhaustively reviewed the external criticism of the dendroclimatological work, but it seems that some of these criticisms show a rather selective and uncharitable approach to information made available by CRU.

    So people who want hard numbers, underlying datasets and provenance of data are being "uncharitable".

    In the latter part of the 20th century CRU pioneered the methods for taking into account a wide range of local influences that can make instrumental records from different locations hard to compare. These methods were very labour intensive and were somewhat subjective.

    The methods were subjective? This is science? Maybe it's me. Maybe I don't understand the term "science".

    We cannot help remarking that it is very surprising that research in an area that depends so heavily on statistical methods has not been carried out in close collaboration with professional statisticians.

    Here we go. That's an axe to the groin there.

    We agree with the CRU view that the authority for releasing unpublished raw data to third parties should stay with those who collected it.

    Ah, but then they don't need to provide provenance or data. That's so comforting.

    I am so mollified by this report I'm left without speech. It seems perfectly reasonable, rational and diligent to me. Let's close this case and begin the Cap&Trade.

    --
    Help stamp out iliturcy.
    1. Re:Let's go ahead and quote from the report: by hsthompson69 · · Score: 5, Insightful

      Mod parent up. Claiming exoneration at this point, or insisting that with enough context one can possibly explain the malfeasance behind the climategate emails, is wishful thinking and simply talking points handed out by realclimate.org.

      Look, if all the CRU well wishers would just read the code itself (http://www.anenglishmanscastle.com/HARRY_READ_ME.txt), maybe your inner geek can overcome your outer AGW supporter. These guys have been cooking the numbers with crappy code for years, period. I've got more faith in the code quality of Duke Nuke'm Forever than the garbage these guys have been spewing.

      Anyway, mod this troll/flamebait/whatever, but the parent deserves at least informative for quoting TFR.

    2. Re:Let's go ahead and quote from the report: by jeff4747 · · Score: 5, Informative

      So... we didn't look into whether their numbers were right.

      Their numbers are the records of temperature measurements. They literally came from a book. How, exactly, do you propose we determine if the numbers were right? Check for massive transcription errors that all happen to go one way?

      The entire "climategate" scandal was about their ANALYSIS of the data, not the data.

      As a less snarky answer, if you want to see the data go look at their journal papers.

      The methods were subjective? This is science? Maybe it's me. Maybe I don't understand the term "science".

      Well, if you understood science, perhaps you'd have looked into the problems here.

      First, we didn't have thermometers 5000 years ago, so there's no accurate data. So we have to look for other ways to measure temperature after-the-fact. Tree rings and ice cores seem to correlate well, with tree rings having higher fidelity than ice cores. And for most of the time period where we do have thermometers, tree rings correlate well with the thermometers from the 1800s until the 1960s.

      Starting in the 60's, tree rings are showing a colder temperature than we measure with thermometers. Why? Nobody knows. Best guess is pollution, but it's a problem for the biologists, not the climatologists.

      Should we then treat the pre-1800 tree-rings as accurate? Well, that's going to be subjective. Since we don't know what's causing the slowdown for the last 50 years, an argument could be made that tree ring data is unreliable. On the other hand, our other source of pre-1800s data (ice cores) match the pre-1800 tree rings and we have a hypothesis whereby the slowdown is a new phenomenon.

      In addition, we have this habit of placing the thermometers where people are. Since the thermometer is in a city, we know there will be a heat island effect. For modern readings, we've placed thermometers outside cities so that we can measure that effect. But that won't help for old readings. So we have to compensate for heat island effects without being able to accurately measure them and their change over time (small city = smaller effect). This correction, by definition, has to be subjective.

      If you really were interested in the science here, you'd go fire up Google Scholar and read their papers where they explain all this. On the other hand you are moving the goalposts from "look! Bad analysis!!!" at the beginning of "climategate" to "look! Bad data!!". That kinda indicates you aren't actually interested in the science.

  5. Re: you have a a strange way of reading reports by Cochonou · · Score: 5, Informative

    Fraud you say ? Don't you think your view lacks a bit of perspective ?

    From the report, on dendroclimatology:
    "Although inappropriate statistical tools with the potential for producing misleading results have been used by some other groups, presumably by accident rather than design, in the CRU papers that we examined we did not come across any inappropriate usage although the methods they used may not have been the best for the purpose. It is not clear, however, that better methods would have produced significantly different results. "
    "With very noisy data sets a great deal of judgement has to be used. Decisions have to be made on whether to omit pieces of data that appear to be aberrant. These are all matters of experience and judgement. The potential for misleading results arising from selection bias is very great in this area. It is regrettable that so few professional statisticians have been involved in this work because it is fundamentally statistical."
    "After reading publications and interviewing the senior staff of CRU in depth, we are satisfied that the CRU tree-ring work has been carried out with integrity, and that allegations of deliberate misrepresentation and unjustified selection of data are not valid. In the event CRU scientists were able to give convincing answers to our detailed questions about data choice, data handling and statistical methodology. The Unit freely admits that many data analyses they made in the past are superseded and they would not do things that way today."

    On historical instruments reports:
    "Like the work on tree rings this work is strongly dependent on statistical analysis and our comments are essentially the same. Although there are certainly different ways of handling the data, some of which might be superior, as far as we can judge the methods which CRU has employed are fair and satisfactory. Particular attention was given to records that seemed anomalous and to establishing whether the anomaly was an artefact or the result of some natural process."
    "The Unit has demonstrated that at a global and hemispheric scale temperature results are surprisingly insensitive to adjustments made to the data and the number of series included. "
    "Recent public discussion of climate change and summaries and popularizations of the work of CRU and others often contain over-simplifications that omit serious discussion of uncertainties emphasized by the original authors."

    In the conclusions:
    "We saw no evidence of any deliberate scientific malpractice in any of the work of the Climatic Research Unit and had it been there we believe that it is likely that we would have detected it."

  6. Scientific rigor in debates about scientific rigor by Fractal+Dice · · Score: 5, Insightful

    After wading through a hundred posts I can't help but suspect that if we are honest with ourselves, the vast majority of opinions here are merely expressions of confirmation bias: the majority of people posting or moderating are being skeptical or accepting based entirely on whether or not it agreed with their pre-existing model of the universe.

  7. Re:The unanswerable questions by jcupitt65 · · Score: 5, Insightful

    I can answer some of your points:

    1) The panel did not say the CRU's conclusions were correct, it said it could find no evidence of deliberate fraud and believed it would have found it if it existed.

    2) Yes, they are saying that no clearly inappropriate methods were used, but that in some cases more appropriate methods were available. Repeating the analysis would be unlikely to change the result but might improve confidence.

    4) FoI obstruction is not scientific fraud (the main charge that was being investigated), technically anyway, heh.

    5) The CRU are supposed to be working towards release of their data. A lot of it comes from other organisations and rights need to be negotiated, apparently. In the meantime, a great deal of climate data is available from many sources.

    6) You select a statistical tool based on the type of data and the sort of answer you need rather than on the data itself. The committee could make a fair judgement without seeing all the numbers.

    Finally, the CRU's reconstructions broadly agree with other reconstructions (eg. the NASA data) which gives at least some validation of their results.