Slashdot Mirror


Research Data: Share Early, Share Often

Shipud writes "Holland was recently in the news when a psychology professor in Tilburg University was found to have committed large-scale fraud over several years. Now, another Dutch psychologist is suggesting a way to avert these sort of problems, namely by 'sharing early and sharing often,' since fraud may start with small indiscretions due to career-related pressure to publish. In Wilchert's study, he requested raw data from the authors of some 49 papers. He found that the authors' reluctance to share data was associated with 'more errors in the reporting of statistical results and with relatively weaker evidence (against the null hypothesis). The documented errors are arguably the tip of the iceberg of potential errors and biases in statistical analyses and the reporting of statistical results. It is rather disconcerting that roughly 50% of published papers in psychology contain reporting errors and that the unwillingness to share data was most pronounced when the errors concerned statistical significance.'"

4 of 138 comments (clear)

  1. Science is like any other job/craft in that... by Urthas · · Score: 5, Insightful

    ...most people who do it are downright bad at it. That they might take more time and care to be good at it without the perpetual axe of publish-publish-publish and grants funding hanging over their heads is another issue all together.

  2. Re:You Mean... by Anonymous Coward · · Score: 5, Funny

    Did you know that you can just BUY labcoats?

  3. Incentives and disincentives by br00tus · · Score: 5, Insightful

    Einstein was unable to find a teaching post, and was working in a patent office when he published his annus mirabilis papers. Things have changed over the years though. John Dewey discovered a century ago how children best learned - let the child direct his own learning, and have an adult to facilitate this. This, of course, is not how children are taught. Things nowadays are very test-heavy, and becoming even more so, not as a means to help students in seeing what their deficiencies are, but as a punishment system - and the teachers, and the administrators are under the same punishment system. The carrot of reward is very vague and ill-defined and far-off. It is a system designed to try to squelch the curiosity of those handful of students who had been curious and wanted to learn. Businesses want to get into the education gravy train, and all this charter school stuff is being embraced by both parties, which isn't surprising if you look at the funding behind it.

    At the university, the financial incentives are all aligned so that publishing is a necessity. If one does not publish, they do not get tenure, and then all those years of work were for naught as the academic career is over. And what gets published? An average series of experiments done by the scientific method would usually lead to either inconclusive data and results, or just wind up in a dead end. And what journal wants to publish those results after months of work? One of the most popular Phd comics is this one. It seems fairly obvious to me - the more financial incentives are tied to getting published, the more that bogus studies are going to be published. As far as the idea of honesty, integrity or whatever, these things will gradually subside for most people when they come into conflict with keeping a roof over one's head and food on the table.

  4. Re:Psychology by sstamps · · Score: 5, Informative

    No. Those who requested the data requested that if all the data couldn't be provided, then the freely available data should be provided. They were refused.

    Bzzt. Wrong. Try again.

    30.First, in answer to the question of whether the raw data are accessible and verifiable, Professor Jones told us that:
    The simple answer is yes, most of the same basic data are available in the United States in something called the Global Historical Climatology Network. They have been downloadable there for a number of years so people have been able to take the data, do whatever method of assessment of the quality of the data and derive their own gridded product and compare that with other workers.

    31.In addition, of course, there are the sources of the data, the weather stations, to which any individual is free to go and collect the data in the same way that CRU did. This is feasible because the list of stations that CRU used was published in 2008.

    41. Professor Jones contested these claims. According to him, “The methods are published in the scientific papers; they are relatively simple and there is nothing that is rocket science in them”. He also noted: “We have made all the adjustments we have made to the data available in these reports; they are 25 years old now”. He added that the programme that produced the global temperature average had been available from the Met Office since December 2009.

    51. Even if the data that CRU used were not publicly available—which they mostly are—or the methods not published—which they have been—its published results would still be credible: the results from CRU agree with those drawn from other international data sets; in other words, the analyses have been repeated and the conclusions have been verified.

    When asked for a list of what data was used, but not the data itself, they refused. Even if the data is available for free on the net, how can the results be replicated if they will not say which data was used?

    Jones PERSONALLY refused. The information about what data was used has been available since the original papers and research were performed! IT'S IN THE RESEARCH, DURRRR. Have you ever read any of it?

    It has only been replicated by his buddies.

    Bzzt! Wrong. Try again.

    BEST was funded by the Koch brothers, owners of a giant oil/petrochemical company. Most DEFINITELY NOT "buddies" with Mann. Even still, being "buddies" in science doesn't mean diddly-squat; it's not about WHO you know, but WHAT you know, and HOW WELL you know it. So far, Mann's work has been REPEATEDLY vindicated.

    There can be no vindication for trying to "hide the decline".

    Ya know, for a minute there, I thought you might be trying to be genuinely serious and skeptical. Then you trot THAT out. /facepalm

    It is a well established rule of science that you don't leave out data that casts doubt on your conclusion.

    You are correct, it is, and the vast majority of climate scientists and their research faithfully follow that rule, no matter how many intellectually dishonest, ignorant, and gullible idiots falling for charlatans and snake oil salesmen lke Watts, Michaels, Singer, et cetera ad nauseum, try to spin otherwise.

    You've fallen for their story.

    No, I've fallen for the FACTS of the matter. I've done my homework; I've looked beyond anyone's story; what's YOUR excuse?

    Many of us used to think the alarmists were good willed, and we assumed they were honest. I still think they are good

    --
    -SS "Teach the ignorant, care for the dumb, and punish the stupid."