Journal Published Flawed Stem Cell Papers Despite Serious Misgivings About Work

sciencehabit writes: As two discredited, and now retracted, stem cell papers have produced an almost unimaginable fallout — a national hero accused of scientific fraud, the revamping of one of Japan's major research institutes, and the suicide of a respected cell biologist — researchers have privately and publicly asked how Nature could have published work that, in retrospect, seems so obviously flawed. Another piece of the puzzle has now come to light. The Science news team received a copy of email correspondence between a Nature editor and Haruko Obokata, the lead author of the papers, which indicates the work initially received as rocky a reception there as at two other journals, Cell and Science, that had rejected the work previously. The email, dated 4 April 2013, includes detailed separate criticisms of the two papers and suggestions for new data to support the authors' claims of a simple and novel way to make stem cells that could form the myriad cell types within a body. The Nature editor rejected the papers, but left open a window, writing, "Should further experimental data allow you to address these criticisms, we would be happy to look at a revised manuscript." The two papers were published 10 months later.

Comments

peer review is a low bar

[phantomfive]

Peer review filters out the stuff that is obvious crap, stuff that doesn't even fit the form of a proper scientific article. The purpose is not to say that articles are true, but rather to get rid of articles that are obviously wrong.

If the scientists are lying about their data, it's hard for peer review to catch that. That's why reproducibility is important. If it's a result you care about, you can reproduce it.

Re:peer review is a low bar

[LateArthurDent]

Peer review filters out the stuff that is obvious crap, stuff that doesn't even fit the form of a proper scientific article. The purpose is not to say that articles are true, but rather to get rid of articles that are obviously wrong.

  If the scientists are lying about their data, it's hard for peer review to catch that. That's why reproducibility is important. If it's a result you care about, you can reproduce it.

Well, reproducibility is part of peer review. If anyone is making decisions based on the results of one paper, they're idiots. Even if the research methodology was flawless, and the researchers are brilliant and honest with all their data, certain results can still come about as a result of chance. Obligatory xkcd

I wish we'd put more emphasis on reproducing published results, though. I've mentioned this before, but I feel like this would be the ideal work for grad students during their first few years, before they're deep in their own research. They need to get papers published, there should be journals devoted to publishing data from reproducing results. Students get experience writing papers and conducting research and everyone gets stronger peer review in their fields.

Re:Not so schocking

[ColdWetDog]

Human beings are flawed, even scientists. People pursue agendas and that which will make them both money and garner attention. The problem is that group think impacts scientists every bit as much as any other profession. The question is, how can we verify science when most of the population don't even understand it? Much like politicians and covert policy, the public has to trust experts in their fields. With so little oversight what can we do?

Science is, eventually, self correcting. It may take months (in this case), decades (cf, Plate Tectonics) or hundreds of years (the nonsense spouted by Pliny and Aristotle). There are probably large swaths of what we take for scientific understanding that are still wrong (or not even wrong). But there is a self correcting mechanism. In this, Science is rather unique among human endeavors.