Slashdot Mirror


Misconduct, Not Error, Is the Main Cause of Scientific Retractions

ananyo writes "One of the largest-ever studies of retractions has found that two-thirds of retracted life-sciences papers were stricken from the scientific record because of misconduct such as fraud or suspected fraud — and that journals sometimes soft-pedal the reason. The study contradicts the conventional view that most retractions of papers in scientific journals are triggered by unintentional errors. The survey examined all 2,047 articles in the PubMed database that had been marked as retracted by 3 May this year. But rather than taking journals' retraction notices at face value, as previous analyses have done, the study used secondary sources to pin down the reasons for retraction if the notices were incomplete or vague. The analysis revealed that fraud or suspected fraud was responsible for 43% of the retractions. Other types of misconduct — duplicate publication and plagiarism — accounted for 14% and 10% of retractions, respectively. Only 21% of the papers were retracted because of error (abstract)."

38 of 123 comments (clear)

  1. Publish or perish by i+kan+reed · · Score: 5, Interesting

    "Get only positive results or never get tenure" is a policy that dooms us to this exact course. Publishing is no longer a consequence of having a brilliant idea, but rather a means to an ends(keeping your job). The academic community needs to find another metric for researcher quality other than papers published. It's costing everyone the truth.

    1. Re:Publish or perish by spikenerd · · Score: 3, Insightful

      ...The academic community needs to find another metric for researcher quality other than papers published...

      such as?

      Number of citations? No, it would take a 30-year probationary period before the trend was reliable.
      Have experts evaluate your efforts? No, that would require extra effort on the part of expensive tenured experts.
      Roll some dice? Hmm, maybe that could work.

    2. Re:Publish or perish by raydobbs · · Score: 3, Interesting

      With the public retreat from education, universities have to take their funding from more private sources. As a result, there is outside pressure to do research to favor these outside sources of funding, and you get a recipe for fraud and misconduct. Of course, the universities won't admit that they have had to make a deal with the devil to keep the doors open - and a large part of our (United States) political system is dead-set on taking us backward in terms of scientific progress to appease their less-than-sophisticated backers; and the problem is set to only get worse unless we as a people do something to stop it.

    3. Re:Publish or perish by jamesmusik · · Score: 2, Interesting

      Journals don't only publish papers reporting "positive results," whatever that may be. Even if your study comes out a way you didn't expect, if you did it right, you should still be able to get it published. There's something beyond publish or perish that is at work here.

    4. Re:Publish or perish by blueg3 · · Score: 4, Insightful

      Journals don't only publish papers reporting "positive results," whatever that may be. Even if your study comes out a way you didn't expect, if you did it right, you should still be able to get it published. There's something beyond publish or perish that is at work here.

      That's what you might think, but getting (most) journals to publish negative results is very difficult.

    5. Re:Publish or perish by Anonymous Coward · · Score: 5, Insightful

      Journals don't only publish papers reporting "positive results," whatever that may be

      HAHAHAHAHAHAHAHAhahahaha... ha... oh, oh I'm sorry, but that's funny.

      Yes. Journals have a very long history of not publishing 'negative results'. (id est: "We tested to see if X happened under situation Y, but no it doesn't.") Mostly because it's not 'interesting'.

      If you want a good example of this, check out the medical field, where the studies which don't pan out aren't published, the ones which do are, leading to severely misleading clinical data, and it leads to problematic results.

    6. Re:Publish or perish by js33 · · Score: 5, Interesting

      A positive result is the rejection of a null hypothesis. In the frequentist statistical paradigm, a failure to reject the null hypothesis is simply not significant. Insignificant results are not usually considered worthy of publication. "If your study comes out a way you didn't expect," then the way you expected your study to come out is a null hypothesis which can supposedly be rejected with some measurable degree of significance. This way you can explain the significance of what you learned from the "failure" of your experiment, and there is no reason you should not be able to publish it.

      That's the statistical paradigm. Results just aren't significant unless you can state them in a positive way.

    7. Re:Publish or perish by scamper_22 · · Score: 2, Interesting

      It's not the academic community that is at fault. It is our society.

      I've long held the view that science only gained the credibility it has because it was free from politics and power.

      But since science has gained such credibility, people think we should now *trust* with power. Which of course destroys the very thing that gave it that trust. Ye old saying 'power corrupts and absolute power corrupts absolutely'.

      For one thing, we now have government funding for science. Sounds like a good idea... except of course. That means funding for universities... which need to hire faculty. So whom do they hire and how much do they pay them? Why did they hire Bob and not Alice? Alice would like a job too. The whole question of fairness comes up.

      Then of course there's the issue of funding projects. Which projects get funded? Which lobbyists and politicians and special interest groups matter? What policies will be impacted?

      It all sounds very neat to have a special scientific class able to deliver *the truth*. It's just completely unscientific and contrary to all empirical evidence in history to think it possible. There has never been a group of wise people in power outside of politics.

      Plato envisioned the Philosopher Kings on a group of wise societal leaders. It is said this actually that this was the foundation of the Islamic Republic in Iran... a group of wise religious people given power in Iran. Not unlike people who wish for rational administration or scientific experts in position in Western society to make decision outside of democracy. It's all too common to hear people wishing for transit policy to be decided by transit experts in 'independent panels'. Or healthcare policy...

      It's a very dangerous road.

      In short... despite all the technology, education, and the internet and accessibility to information... the *truth* remains as elusive as ever.

    8. Re:Publish or perish by frosty_tsm · · Score: 2

      "Get only positive results or never get tenure" is a policy that dooms us to this exact course. Publishing is no longer a consequence of having a brilliant idea, but rather a means to an ends(keeping your job). The academic community needs to find another metric for researcher quality other than papers published. It's costing everyone the truth.

      I think the issue is not that they need a new metric for researcher quality but to realize that not every professor needs to be an active researcher their whole career.

    9. Re:Publish or perish by Whole+Stuffed+Camel · · Score: 2

      It's not just tenure, even getting a good faculty position is dependent on publication of research in high impact journals. I think that the major conflict of interest in my field, basic biomedical research, rather than funding by pharma etc, is the necessity to generate data suitable for publishing in big journal to get/keep jobs. I'm pretty sure this is going to get very messy if something isn't done to address the problem.

    10. Re:Publish or perish by FrangoAssado · · Score: 2

      then the way you expected your study to come out is a null hypothesis which can supposedly be rejected with some measurable degree of significance.

      You have to be very careful here. In serious studies, you don't get to choose your null hypothesis or how you're going to analyse the data after collecting it. That's a textbook example of introducing confirmation bias.

    11. Re:Publish or perish by js33 · · Score: 2

      You have to be very careful here.

      Yes you do.

      In serious studies, you don't get to choose your null hypothesis or how you're going to analyse the data after collecting it. That's a textbook example of introducing confirmation bias.

      There is also the danger of making an unjustified assumption of objectivity. In preliminary studies, scientists will have gathered data, analyzed it, looked for patterns, and tried to come up with all kinds of hypotheses that could be tested. Even the most final, definitively objective experiment is not designed in a cleanroom with complete objective naivete, and often enough the scientist will have a pretty good idea of the expected nature of the data to be collected. So how significant is a failure to reject a null hypothesis? We cannot say without a full application of Bayes' theorem to interchange the roles of statistical power and degree of confidence.

    12. Re:Publish or perish by interkin3tic · · Score: 3, Insightful

      How about calculated gross earnings of the students you have taught? Of course that puts a value on teaching, which is something being discouraged for tenured faculty (which I obviously don't agree with).

      That would also make it in new professors' best interests to not teach the intro level courses where much of the class will change majors and doesn't want to be there in the first place. They'll instead focus on the upper level courses where the weak links have been weeded out.

      Guess which courses new faculty get stuck doing now? That would be rewarding the really weaselly ones who were able to skip the hard work.

      Furthermore, the students don't care about quality teachers, or else they'd be going to smaller schools known more for teaching than for research grants. They're voting with their wallets for schools where research is valued more than instruction. So your solution is lacking a problem, at least according to the teachers and students of such schools.

    13. Re:Publish or perish by Daniel+Dvorkin · · Score: 2

      In biomed, there are not models to invalidate.

      That statement is one of the stupidest things I've ever read on Slashdot ... which is pretty impressive.

      Okay, I'm going back to building models of developmental gene regulation now. You're welcome.

      --
      The correlation between ignorance of statistics and using "correlation is not causation" as an argument is close to 1.
    14. Re:Publish or perish by khallow · · Score: 2

      Where did you get the idea that a good reseach faculty means a good teaching faculty?

      Note the use of the phrase, "selling point" in my original post. Where does anyone get that impression that research means better teaching and/or better education? From research schools marketing that angle.

      Fundamentally, your assertion that "the students don't care about quality teachers" is based on flawed premises. Prospective college students aren't well known for understanding the nuances of a college and an education. So why expect them to "know" that "smaller schools known more for teaching" have better teachers (maybe)?

      Even if the student doesn't care about the outcome of their education (which is a peculiar assertion to make, given that the average student puts something like five years of their life into such an education), there's no reason for the college to not care as well.

    15. Re:Publish or perish by khallow · · Score: 2

      With the public retreat from education, universities have to take their funding from more private sources.

      Last I checked, there was no such retreat from education. There's been a remarkable decline in the quality of education and what public funds buy. But it's a dangerous illusion to claim that there has been a retreat from education when the problem is elsewhere.

  2. The numbers by somaTh · · Score: 2

    I've read the abstract and several stories that cite it, and I haven't seen some specific numbers that would make this story more relevant. They talk about the number of retractions being up sharply, and the number of those pulled for "misconduct" being up as well. The abstract and other sources have yet to put either number in relative terms. Of the number of papers published, is the percentage of those papers that are retracted up? Of those retracted, is the percentage of retractions due to misconduct up?

    --
    Nostalgia isn't what it used to be.
    1. Re:The numbers by ceoyoyo · · Score: 2

      That's not the point. The point is that journals need to be clearer about why a paper is retracted. Fraudsters shouldn't be able to hide behind the assumption that a vague retraction notice means someone made an honest error. The authors specifically state that they cannot make statements about the fraud rate because they don't have a good measure of the total number of papers published.

    2. Re:The numbers by Joe+Torres · · Score: 2

      The first figure of the PNAS paper shows that less than 0.01% (maybe 0.008%) of all published papers are retracted for fraud or suspected fraud and it has been increasing since 1975 (maybe around 0.001%). The authors state that the current number is probably under-reporting because not all fraud is detected and retracted. It is possible that the 1975 numbers are less representative, since fraud might have been harder to detect (at least for duplicate publication and plagiarism).

  3. large "culture of cheating" in school now by peter303 · · Score: 2

    I dont know if more students cheat now than when I attended grade school in pre-internet days. But the ease and temptation with the web is greater now. Surveys I read suggest at least half of students cheat.
    The mystery has been how one progresses from a cheating culture in grade school, then lose it by the time you reach grad school and professorship. Apparently fewer dont escape this culture. Significant science will be attempted to be replicated and fraud discovered.

  4. Just stupid by UnresolvedExternal · · Score: 3, Insightful

    What surprises me is that these scientists actually weigh the risk reward in favour of damn lies. Fifteen minutes of fame then a dead career.

    1. Re:Just stupid by UnresolvedExternal · · Score: 2

      Fair point - but where are these peer reviewers hiding?

    2. Re:Just stupid by Penguinisto · · Score: 2

      Well, FWIW, if Hendrik Schön hadn't gotten stupid and made some pretty massive (and physics-defying) claims in his paper, and stuck with semi-muddy results that looked pretty (as opposed to sexy), but were harder to replicate? His career would have likely lasted years, if not decades, before he got caught.

      It all depends, from the fraudster's point-of-view, whether he wants rockstar status, or to make a comfortable living...

      --
      Quo usque tandem abutere, Nimbus, patientia nostra?
  5. Hoping to not see a retraction of this by Anonymous Coward · · Score: 2, Funny

    That would be too ironic.

  6. Misconduct! Fraud! Please ... by jabberwock · · Score: 5, Informative
    I think that the article implicitly misrepresents the level of misconduct by leaving out some relevant statistics. ... More than 2,000 scientific articles, retracted! And ... fraud! ... plagiarism!

    In context -- PubMed has more than 22 million documents and accepts 500,000 a year, according to Wikipedia.

    So, to do the math: Number of fraudulent articles, total, = vanishingly small percentage of the total articles.

    1. Re:Misconduct! Fraud! Please ... by Anonymous Coward · · Score: 2, Interesting

      Yep. That's a very important, and very *missing* bit of information. Even if *ALL* of the retracted articles were for *blatant* and *intentional* misconduct (not duplicate publication), and all of them were published in the same year, and all of them were in PubMed, that would be a whopping 0.4% fraud rate.

      It boggles my mind that this number wasn't asked for by the article's author.

      Well, it *should*, but instead I'm just getting more cynical and assuming either incompetence (the author is writing about something he has absolutely no clue about, and therefore doesn't even know to ask for the information to put it into context), or malice (the author is trying to paint modern science as intentionally fraudulent).

    2. Re:Misconduct! Fraud! Please ... by Anonymous Coward · · Score: 2, Informative

      > So, to do the math: Number of fraudulent articles, total, = vanishingly small percentage of the total articles.

      Those are only the ones that get discovered. I roll my eyes often when I read medical papers. The statistics are frequently hopelessly muddled (and occasionally just plain wrong on their face), the studies are set up poorly (as in, I would expect better study designs from first year students), or they are obvious cases of plagarism.

      EX: does early fertility predict future fertility. "We divide the population into two groups: women aged 20 to 30, and women aged 20 to 40. We find that fertility in the first group predicts fertility in the second group with R^2=.46" Well no shit, because the second group includes the first group, so of course they correlate. If you redo the stats correctly, you find that R=0.001. This paper still stands...

      EX: "we found that eating walnuts increases male fertility." No shit. Walnuts are known to be high in Arginine. Arginine is known to increase male fertility (multiple studies already on this). Next, the same group will publish a breakthrough study on male fertility and pumpkin seeds (hint:pumpkin seeds have twice the Arginie concentration as walnuts). The study authors try hard to hide their plagarism though, not once mentioning Arginie. They hypothesize that it is from the ALA in the walnuts... which is BS because they could have tested an ALA hypothesis using flax-seed oil. Oh, and I forgot to mention that this study was not even done single-blind. No placebos were used. One group was given walnuts (not in concealed form, just plain walnuts), the other was given nothing. This paper also still stands...

    3. Re:Misconduct! Fraud! Please ... by jabberwock · · Score: 2
      Respectfully, you're compounding the error by referring to "all fraudsters" and the "situation of medical science," implying, by language, that this is a much larger problem than statistics show when considering the enormous volume of scientific articles. I'm not a scientist but I'm very good at interpreting numbers.

      I didn't say that fraud does not exist, or that there isn't pressure to produce publishable results that might affect accuracy or ethics (on occasion.) I said that this is a much smaller problem than the article implies. Only the retractions were analyzed; the retractions are a vanishingly small percentage of the total. If you want to argue that the retractions are the tip of an iceberg of falsified scientific data, let me know.

    4. Re:Misconduct! Fraud! Please ... by khallow · · Score: 2

      It boggles my mind that this number wasn't asked for by the article's author.

      Not me. There's a blatant and obvious movement going on to discredit science in general. No one mentions how much different medical science is from physical science when they talk about this either. Find one bad scientist and they think they've won. Guilt by association.

      Here's a case in point. Someone does research on fraud in science and the first thing that you and the parent poster think, "What is the ulterior motive?" That's just another anti-scientific attitude.

  7. And that's why.... by roc97007 · · Score: 3, Insightful

    this is a bad idea.

    --
    Oliver's law of assumed responsibility: If you're seen fixing it, you will be blamed for breaking it.
  8. FTFY by drerwk · · Score: 2

    Misconduct, Not Error, Is the Main Cause of Medical Scientific Retractions

    Other than Hendrik Schön are there some in Math or Physics that are as likely to commit misconduct?
    http://www.nature.com/nature/journal/v418/n6894/full/418120a.html

  9. Re:Obviously by Sarten-X · · Score: 2, Funny

    You've discovered representative traits of different societies. In many Asian societies, individual achievement is valued highly, so each individual must work the hardest to be outstanding. In many Indian societies, the collective effort is what's valued, so a team gathering bits and pieces from myriad sources and reassembling them into a new product is the respectable path to success. In many European and American societies, slacking off and blaming others for the consequences is a venerated tradition.

    --
    You do not have a moral or legal right to do absolutely anything you want.
  10. Because ordinary errors don't lead to retractions by Jimmy_B · · Score: 4, Informative

    You might be tempted to think that this means ordinary errors aren't as common as we thought. Lots of papers - actually most papers, at least in medicine - are wrong for reasons like the author being confused, doing the statistics wrong, or using a type of experiment that can't support the conclusions drawn. But merely publishing a paper that's bullshit? That usually isn't enough to trigger a retraction, because retracting papers looks bad for the journals. Only an accusation of Serious Willful Misconduct can reliably force a retraction.

  11. We apologize for the misconduct. by Ichijo · · Score: 2

    The papers responsible have been retracted.

    We apologize again for the misconduct. The papers responsible for retracting the papers that have been retracted, have been retracted.

    The researchers hired to write papers after the other papers had been retracted, wish it to be known that their papers have just been retracted.

    The new papers have been completed in an entirely different style at great expense and at the last minute.

    ---

    Mynd you, m00se bites Kan be pretty nasti ...

    --
    Any sufficiently unpopular but cohesive argument is indistinguishable from trolling.
  12. Re:academic tenure is an elitist system by Aardpig · · Score: 3, Insightful

    The REAL peers are the folks doing work in the profession day in and day out.

    As an astrophysicist in a research University, I'd like to know where these REAL peers are. I thought I was the expert, but now you tell me there's someone working hard at an astrophysics day job — so hard, in fact, they're too busy to review the papers I write while quaffing champagne by the bucket-load in the penthouse suite of my ivory tower.

    I'm all ears.

    --
    Tubal-Cain smokes the white owl.
  13. Re:Bloodsport by SomeKDEUser · · Score: 2

    This implies that an extra -5 scientists entered.

  14. Re:academic tenure is an elitist system by Daniel+Dvorkin · · Score: 2

    The REAL peers are the folks doing work in the profession day in and day out. As a rule most peer reviews are conducted by people with a decidedly academic focus - the experts in the field are working day jobs that don't afford them time to participate in silly self congratulatory exercises.

    And in most scientific fields, those folks are overwhelmingly to be found at academic institutions, and most of those who aren't in academia are in government. Corporate R&D is almost all "D" these days. There used to be a lot more research and publication, and peer review, by people outside academia--in light of your username, you might want to consider the history of Bell Labs, and how sad that history's been in recent years.

    --
    The correlation between ignorance of statistics and using "correlation is not causation" as an argument is close to 1.
  15. Re:Because ordinary errors don't lead to retractio by goodmanj · · Score: 2

    Parent is right. Small errors which don't affect the outcome are published as short "correction" notes. Larger, more subtle errors are corrected by the author and/or whoever noticed he was wrong writing a new paper which critiques the old one. But the original paper remains, because it's a useful part of the dialogue.

    (And *that* is why you should always do a reverse bibliography search on any paper you read.)