Slashdot Mirror
Climategate and the Need For Greater Scientific Openness
The Guardian follows up on the recent news that CRU climate scientists were cleared of scientific misconduct with an article that focuses on how the controversy could have been avoided, and public trust retained, had the scientists made more of an effort to be open about their research. You may recall our discussion of a report from Pennsylvania State University; that was followed by another review with similar conclusions. Quoting:
"The review, led by Sir Muir Russell, does not mention the media. Instead, it examines the reaction of the scientists at the UEA's Climatic Research Unit (CRU) to the pressure exerted by bloggers: 'An important feature of the blogosphere is the extent to which it demands openness and access to data. A failure to recognize this and to act appropriately can lead to immense reputational damage by feeding allegations of cover-up.' The review adds: 'We found a lack of recognition of the extent to which earlier action to release information might have minimized the problems.' Pressure on the scientists, whose once esoteric work creating records of past temperatures had gained global significance, was intense. In 2005, CRU head Phil Jones replied to a request: 'We have 25 or so years invested in the work. Why should I make the data available to you, when your aim is to try and find something wrong with it?' But, the review implies, the more they blocked, the more the Freedom of Information requests flooded in."
I think this demonstrates that the idealized version of the scientific method isn't always followed.
"Why should I make the data available to you, when your aim is to try and find something wrong with it?"
Because that is how science works. Any decent scientist would rather say "here is my data, please help me find something wrong with it."
Hey, I've got a response for you: Fuck the blogosphere.
There is sufficient transparency in the scientific community, but you know what? People have opinions in the community as well. They don't claim its science, they argue, they piss each other off behind closed doors, and they deserve to have their personal e-mails kept private. They aren't politicians -- they aren't accountable to the public, though they often do perform public services. But then they set it all aside, they publish their work to peer reviewed journals, and move towards some kind of consensus using common criterion. Demanding greater transparency (ie reduced privacy) because a small number of people from a much, much larger community made a poor judgement call (at best) is uncalled for.
And the blogosphere is not exactly what I would call a bastion of unbiased requests! For shame...
#fuckbeta #iamslashdot #dicemustdie
Um, that is precisely why. Do you even know how to spell the word "science", Phil?
It was only a big deal to the paid US shills, there was no "loss of public trust".
Reasonable people listen to scientific consensus.
Of course there's the problem of those private emails revealing naked attempts to massage what qualifies for peer review and who qualifies as a peer to do the reviewing.
You're aware that the papers that Jones was referring to when he said he would "keep them out somehow" from the IPCC report were, in fact, not kept out, and did appear in the report?
This was, basically, a frustrated scientist blowing off steam in a private conversation. Out of a thousand stolen e-mail messages, one of them was frustrated and hot-tempered. Turns out, scientists actually are human.
http://www.geoffreylandis.com
Or even worse, amateurs who do not know how to read the data using it to 'prove' nonsense.
As opposed to those using the data for public reports with an amateur understanding of statistics doing statistical analysis of data?
Why is that OK with you? And why is it NOT OK to lat "amateurs" like Richard Feynman who may not be amateur at all in some tangentially related field access to the data? Because that is who you are blocking along with the rest of the "amateurs".
People like you are going to have to get used to true experts who simply lack a degree in the field in question. The small blip of time where the presence of a degree is the end-all of understanding of a topic is a historical aberration. And it's not even like "climatologists" as a degree has been around very long at all.
"There is more worth loving than we have strength to love." - Brian Jay Stanley
.
Another feature of the blogsphere is that it gives a loud megaphone to anyone who has the intelligence to type, and many who do not.
It takes a fair amount of funding to research something from scratch and make some intelligent conclusions. Taking a report already available and picking it apart by cherrypicking the data is cheap. In more than one sense.
When I read the summary, I was wondering just how in the comments those who have been making excuses for the "scientists" who would not let anyone review data. I mean, with a quote so plain, bold and absurd how could anyone possibly make excuses for the "scientists" who would not let real peer-review happen?
Well thanks to your post, now we know. It's apparently because only the "right" kind of peer can see the data. I can see a mind like yours, a century prior, arguing that the data shouldn't be released because women might try to look at it and get all confused.
And as a side note, "Fuck You" is never a valid response to any question covering scientific study. Lest the students here be confused and a new era of obscenity in response to criticism is tolerated or becomes the new norm.
"There is more worth loving than we have strength to love." - Brian Jay Stanley
The blogosphere needs to stuff it. If they really think they can understand anything in the world without subject-specific training and education, if they think their arguments should be taken as seriously and responded to with the same frequency as in-channel discussion, and if they think reputation in their sphere is the most important kind of reputation, they're deluded. You find the same idiots digging out a law book, arguing about terms of art as if they were common-speak versions of the term, ignoring the weight of history and legal philosophy that governs the sphere, and thinking they have some great insight. It's a good thing they don't crack medical books, or we'd have the geeks following the homeopaths into placebo-land.
In academia, science is open. It's not perfect, but it works, and the fringe science is kept roughly at the right distance where on the one time in ten thousand they have a good idea, it can be tested by the mainstream and maybe eventually join the broad scientific consensus. If you want a publication, you can get it. If you want data, you can probably get that too. If you don't think a study is valid, reproduce it under the same or slightly different circumstances. You have to know what you're doing or the journals will weed you out.
People outside of the research community should tone down their hubris and get comfortable with the fact that to be qualified to talk about something, they should become educated about it first and be prepared to deal with the way the scientific community works. Until then, they're best off relying on the broadest scientific consensus they can find on whatever topic is at hand.
For every problem, there is at least one solution that is simple, neat, and wrong.
Science isn't a priesthood where you must reach a certain level of trust, experience, or whatever to be allowed in. It is open to all, and all have the potential to contribute. My favorite story along those lines is a 9 year old girl that debunked aura readers. The people said "I can feel your aura!" She said "Ok then you stuck your hands through this partition and I'll put my hand over one of yours, you tell me which." Results were taken and tabulated, readers couldn't do it (did a bit worse than chance actually). It was a complete, valid, experiment, has been referenced later and retested, and an elementary student came up with it.
Now that doesn't mean anyone will have USEFUL commentary, but it doesn't mean that people should be excluded just because they aren't an "expert".
In particular, someone may not be an expert at the given science, but might be an expert at something related that is important. So you have a document on climate and a mathematician wants to examine it. He knows jack and shit about climate, he usually doesn't even know what the weather is. However he knows math inside and out. He goes, examines your research and says "Wait a sec, this is wrong. The math here doesn't work. These numbers do not come out right." He can't analyze the climactic theories, but found out that the conclusion was incorrect because the data had been processed wrong. Or perhaps a philosopher who is very skilled at formal logic and analyzing arguments reads the research and says "Ok hang on, you have a gap in your logic. The conclusion does not follow the premises as stated here." Again he not an expert in the field, but he's an expert in logic.
It is highly important that people of different disciplines be allowed to look at research, in particular when said research is very complex. When you are talking about something that is based off of a lot of math conducted on thousands of points of raw data, that is the sort of thing that is ideal to being in "non-experts" on. Get mathematicians, statisticians, probably some cryptography experts (recognizing patterns in randomness is their thing) to look at the data. They might not be able to understand the climate science, but they can analyze the data and the math and say "This calculation is solid," or "This calculation is incorrect." Looking at the parts of the whose with their given expertise can be as or more valuable than trying to look at the whole thing. The climate scientist might look at the whole thing and say "Ya, all the science fits," but only because they assume all the math is right. If the math is wrong then they might say "Oh, well this no longer shows what it says it does."