Slashdot Mirror
How Common Is Scientific Misconduct?
Hugh Pickens writes "The image of scientists as objective seekers of truth is periodically jeopardized by the discovery of a major scientific fraud. Recent scandals like Hwang Woo-Suk's fake stem-cell lines or Jan Hendrik Schön's duplicated graphs showed how easy it can be for a scientist to publish fabricated data in the most prestigious journals. Daniele Fanelli has an interesting paper on PLoS ONE where she performs a meta-analysis synthesizing previous surveys to determine the frequency with which scientists fabricate and falsify data, or commit other forms of scientific misconduct. A pooled, weighted average of 1.97% of scientists admitted to having fabricated, falsified or modified data or results at least once — a serious form of misconduct by any standard — and up to 33.7% admitted other questionable research practices. In surveys asking about the behavior of colleagues, admission rates were 14.12% for falsification, and up to 72% for other questionable research practices. Misconduct was reported more frequently by medical/pharmacological researchers than others. 'Considering that these surveys ask sensitive questions and have other limitations, it appears likely that this is a conservative estimate of the true prevalence of scientific misconduct,' writes Fanelli. 'It is likely that, if on average 2% of scientists admit to have falsified research at least once and up to 34% admit other questionable research practices, the actual frequencies of misconduct could be higher than this.'"
Scientists are humans too and a job won't change some humans from being cheats.
It's quite common. A number of my friends are scientists and some have told me they bodge the results now and again to match what they were expecting.
Of all scientific articles I have read there are no apparent copy-cat actions I could even think of. However, pure ignorance and clumsiness are very very frequent. I can live with typos and errors, if they don't change the big picture.
However, cheating is another thing. I am aware of people presenting facts technically correct, but in deceitful manners which give the impression the background research is well done. However, scrutinze what was actually done, it falls apart. Yet, what can you do about that. If do you call attention to it, you risk becomining a whiner. And, who wants to be that?
It is often cited that crappy, broken or incomplete code is often shoved out the door by business in order to meet deadlines. Quality or even truth are sacrificed for business reasons.
Why would R&D be any different? Big business often exhibit quota and other incentives for patent filing and the like. Outside funding sources pressure even pure research activities so that they can get their hands on new technology or even for silly things like a name being recorded as "first to" do something.
I am actually a bit surprised that the numbers aren't a bit higher.
If we accept that scientists are human like anyone else, we accept that scientists, like others, will make mistakes that get bigger and go more wrong than they anticipated. Some may intentionally commit fraud.
How common is scientific misconduct relative to other types of misconduct seems a more relevant question.
Also: What can we do to decrease it and how can we lessen its impact.
But if there are so many examples of scientists providing fake data how do i know the results of the survey in the FA are correct?
corrupt police officer ? corrupt politician ? cooking book finance people ? manager breaking some rules or "making up data" to justify their projects ? And I padd many others. Is it above or below average ? If below average then the reputation is earned.
C. Sagan : A demon haunted world:
http://www.amazon.com/gp/product/0345409469/
visit randi.org
And how exactly are we supposed to believe her study?
The television will not be revolutionized.
and up to 33.7% admitted other questionable research practices.
I wonder if this refers to shortcuts taken because its common knowledge, Such as, if you use water as a control lubricant, you might test its wetness, density, purity, viscosity, etc, to compare against water with a slippery polymer in it. I wonder if these "questionable" practices involved taking distilled water, making sure its pure distilled water, and then pulling the other factors off of charts for distilled water or if "Questionable" means something far worse.
The reason i bring this up is because hindsight is 20/20 and everybody knows every mistake that they've made, if they're smart and that's what they're fessing up to.
Is it sad that I am more likely to recognize you and your posts by your sig than your name or UID?
... and 78% of the surveys are made up on the spot.
Disclaimer: I'm a scientist.
Scientist will behave much better as soon as society (or perhaps the government at least) understands that if you want reliable information, you actually have to treat your scientist well.
Now, do not got me wrong, some countries, especially the US, invest quite a lot in science. But the problem is that the whole system is rotten to the core. It makes almost no sense at all for a young graduate to stay in a University/Institute. Pay will be low, and you have (in most countries) no job security. In Europe you either get a nice job at a company, or you go around taking post-docs for 5-10 years, hoping to get lucky. Working crazy hours with no holidays. For most, in the end, they go to a company anyway (having lost quite a lot of money in the process).
Often you are expected to go abroad, and unless you are lucky this leaves you with no good way to take care of your pension. Then if you want to return, somebody else took your place at university.
There is 2 ways to stay in the system: either you are lucky or you lie like hell.
Now, people may say that if your good you do not need luck. But remember that for high impact publications you need a lot more then good ideas and good skills. In research it is perfectly normal to conclude after 2 years that your hypothesis is false. This is great science, it also is hardly publishable in a good journal. People like positive results, and the reviewer system actually encourages you to confirm generally accepted ideas, not to falsify them.
Well, I could go on but I am sure others will.
To be honest, I do not even get angry anymore when I suspect someone may have done something "questionable". It's just sad.
To compare to similar statistics for bankers, realtors, politicians, and car salesmen.
Yes, scientists are human and there's always room for improvement of their conduct. That's what the honest scientists are for -- to check the results from their other colleagues.
More news at 11.
i was working for a bullying ar5eh0le who threatened to ruin my PhD chances if i didnt do all this work for him in triplicate in an impossible amount of time with old reagents and second rate kit. guess what. he got his results. but they weren't all from the experiments. i worked for another guy who regularly had pathogens, pathogenic materials and infected tissue in a freezer at a facility with a secure (ie disease-free) animal unit. he didnt give a sh1t and threatened me to keep quiet when i found out. that cost me ajob.
not all scientists are the sweet honest tweed and pipe types off the telly. some are horrible, selfish wankers. whoc will stop at nothing - N.O.T.H.I.N.G - to further their own careers. any amateur psychologist could pick them out a mile off. journals can't because all the correspondence is done in writing. i think a psych evaluation should be part of the submission process, i really do.
The truth is the way that scientific institutions are set up isn't very scientific. There is definitely an attempt at oversight and impartiality but it's very easily corrupted by a wide variety of people with a wide variety of interests and ulterior motives. There aren't nearly enough checks and balances.
There are many things wrong with the system. Some include:
- Almost anyone can commission a study, write a book etc. and it's left to the scientific community to place value on that work. Viewed on it's own, without knowledge of the scientific community's opinion it can be difficult to tell how valid the work is. For example Wolfram's "New Science" has been largely debunked as mostly a rehash of old ideas (minus accreditation) but it took some time for this to become clear and in the meantime it was popularized in the press as a breakthrough work.
- The only real form of moderation is whether or not work has made it into a respected journal. Other scientists are then expected to publish corroborating work etc. However, until this is done, it is very difficult to judge the validity of the work, and papers get published that are later discredited. (Cold fusion anyone?) Likewise, work that should be published is often initially rejected. The primary motivation of a lot of the scientific journals is financial gain. In fact the entire publishing system is an antiquated remnant of the last 2 centuries and doesn't belong in an Internet connected world, yet publication is still the primary tool by which a scientist's work gets recognized.
- Speaking of antiquated the institutions, committees and governing bodies of science are about as scientific as a mother's group - it's all professional bitching and posturing for status. Real monkey hierarchy stuff. A lot of decisions get made on the basis of status. It's particularly bad for applied science professions like the medical profession where you hear stories about doctors who should have been prevented from practicing continuing for many years before being disciplined or quietly removed. At the senior level, scientists are often more politician than anything else as then need to secure funding and approval from political bodies. Then you see students who have to work their way up in status being treated like crap "paying their dues" as noted in a story posted a few days ago about a student who died in a chemical fire.
- Speaking of status, there is an emphasis on using scientific jargon to exclude the community at large. Some scientific ideas require complex specialized language and university post graduate mathematics to understand, and so require such specialized language. However even simple concepts must be described in overly complex specialized language to be accepted for journal publication. This is absolutely backward. We should have a system that requires simplified language where possible and a layman's overview attached early in the document. Instead, reading a scientific paper if you're not a specialist in the field is an art that you learn when you do post graduate work. If you assess a published article for readability you'll find the statistics you generate tell you that it's dense and difficult to understand. There are journals and subjects that allow simpler and informal
language but they are the exception rather than the rule and usually apply as addendum publications for applied fields. (Again I'm thinking of medicine. My own post grad work is in astronomy so I'm very much a lay reader when it comes to medicine, and when I've tried to read medical papers it's usually been an interesting excercise). Any real simplified content seems to get presented in slide form at conferences and presentations are often a better way of getting an overview.
I could go on about the shortcomings of various scientific institutions but I won't.
My point is that when you have a system that is so open to corruption, with so few checks and balances, and so much baggage inherited from institutions that began in the dark ages, it's no surprise that you end up with science that's much less than perfect.
These posts express my own personal views, not those of my employer
Definitely they sometimes fudge their data so that it will support their theories. Scientists are human and not perfect, it's part of human nature. That is where peer review comes in. A true scientist s work has to stand up to peer review and this is where the fudging of data is often uncovered. The problem is that much of the research going on is cloaked in secrecy by governments and corporations and proper peer review doesn't happen.
This brings to mind an incident in history where the scientist was right but his data was just too good. I'm talking about Gregor Mendel and his work on genetics. Later statistical analysis of his data indicates that it was very unlikely that he got that data. He probably got very close to the experiment result that he predicted but it was not good enough so he fudged his results. It wasn't until long after that this inconsistency in the data was uncovered. Was he right? Absolutely he was but his data is suspect nonetheless.
Every profession has its share of people who cheat. When you raise the stakes, and when their is a perception that many of the top competitors are cheating (as in professional and top amateur sports, for example), then even some of the "honest" people might start cheating.
Someone has to provide the adult supervision, particularly in research areas that attract sensational publicity, such as animal cloning. That responsibility starts with the editors of the journals. They need to ask more questions, demand more documentation, and keep records of their dialogs with authors. They are the counterparts of the commissioners of pro sports leagues and officials of the Olympics.
2% - one in 50 - committing fraud to get ahead (or simply to keep their job) in a very competitive, volatile career environment. Sounds like it's in the right ballpark, and probably comparable to other professions. Some people are so career and status driven, and so unconcerned with the effects of their actions on other people, that they will break rules and cut corners no matter what the field.
I do question the other figures though, simply because "questionable research conduct" is such a very nebulous kind of categorization. You can delimit it in very different ways, all perfectly reasonable. You could even effectively decide which number you want then define the term in such a way that you reach it (a practice that would most likely be included in the term). Notably, the author excludes plagiarism, even though that is a serious offense in research for good reason, and one that I'd expect most surveys to include, not drop.
Also, the numbers for incidents by colleagues is rather pointless, since there is no indication of how many those colleagues are. If each participant has had a minimum total of eight colleagues altogether in their career up until this point, then the 14% rate fits very well with the self-reported 2% above. But of course, the participants do not know how many incidents they missed, and the number of times the mistakenly thought fraud was taking place is unknown. I would be very hesitant in trying to read anything at all into the numbers about witnessed incidents.
Trust the Computer. The Computer is your friend.
You don't have to go very far to find major misconduct in allegedly scientific circles.
The biggest example by far is still ongoing, and because of the high profile of global warming, it even has a popular name, the Hockey Stick Scam.
In a nutshell, a bunch of corrupt scientists led by James Hansen tried to rewrite climate history to make it match their theories. Pretty sad.
(Whether their theories are right or wrong isn't the issue, their scientific misconduct is.)
Scientists are humans, just like anyone else. Frankly, I think 1.97% is pretty low considering it is the combined total of all "fabricated, falsified or modified data or results". Notice that all of those aren't quite equal either. "Tweaking" results to tease out the answer you want (while still unethical and damaging to scholarship) is not as bad as outright falsification. Especially since it is not always clear where the line is between "modifying data", and doing valid statistical analysis like throwing away outliers. Yes, there are standards for outliers, but they are not universal, and confounding factors can occur during the experiment that make ethical decisions more difficult (i.e. the tester didn't read part of the script right, test subject's cell phone went off during test, survey answer was ambiguous and hard to read, the list goes on.)
The reality is that no one study should be taken as fact in isolation. It should either be corroborated by existing evidence (i.e. - it shines a new light on existing theories without contradiction), or by similar studies validating the results, or both.
Nutrition is a perfect example. How many studies have come out in the past 20 years that directly contradict (or seem to) prior studies done in that area? If someone followed each new "discovery" intently, they'd be so screwed up in their eating habits they'd probably end up being malnourished. However, looking back over a series of seemingly contradictory studies, we can see patterns which we've been able to make more sense of. We now have a greater understanding of "good" vs. "bad" cholesterol and the idea that fats aren't necessarily the root of all evil, and many similar findings. We still don't know all the answers, but we know lots more than any one study told us. This is how research works. It is also why graduate students writing dissertations are required to include a large section on "related work" so that they can get the full appreciation for where their research fits into the big picture, rather than basing their entire hypothesis on just one study or finding which might be contradicted in the next conference.
They all lie, Earth is flat i tell you!
We all live on top of a tortoise.
It starts while you are graduating.
A big chunk, quite a huge piece of graduation diploms, certificates etc. (depends on each country) are based in the most rabid form of falsifications - "copy/past". They are presented as something new, at least as a "new" variation of a well known theme, however there is nothing new on it. Just the same stufff written in different words.
The sad fact is that faculties and science departments accept it.
The good thing is that the large majority of these graduates will stay well away from science. Yes, they still will make damage, ex. CEO I had to deal with. He claimed in every possible corner he finished Oxford in finances (he did study in Oxford) but was unable to calculate an average. The guy sent the company 2 million dollars directly under the bottom and we had a great time, full of all sorts of fun, to recover the damage.
But some of these people do enter science! And that's where things start to go boost. I saw some people getting high positions on faculties just for one fact - they write too much and speak a lot. Really, nothing else. A seminar costs money, you send this bla-bla-bla over there. It is not a big matter that he hasn't found nothing new except a new way to describe gravity in words and funny pics. He goes there, makes his new discovery a literature best-seller, puts everyone wondering about his colorful PowerPoint diagrams. That's all folks! Seminar's monny is in the safe. And your bla-bla-bla will be published in the next Annals. So, more monny-monny may come.
Really I think that analysis are terribly skewed. My belief is that we have a lot more crap going around, desguised in small and very specific publications that no ones take into account. Why? Because it's crap from the very start! So why to take the task to read it? But such attitude hides the real dimension of the problem.
I see plenty of comments here of folk expecting some scientists will do bad things for gain/fame/award. However, science demands reproducible results and peer review. That's a safety net that catches a lot of bad science.
Take a look at anthropology and the educational system with respect to "Lucy". She was finally admitted to be completely fraudulent because the group needed results. However, instead of these results being thrown out by both the scientific and educational system "Lucy" is being used to teach evolution. "Lucy" was still being taught as truth at the college level as she was included in text books on anthropology after she was admitted to be fraudulent.
So, scientists being corrupt/dishonest? Why not? It's well with the possibilities of human nature to be corrupt. In fact it's probably more likely than not that in today's society that any person chosen at random is corrupt/dishonest.
I find it odd that this is all based on Meta Analysis, which itself is still highly suspect.
Sig Battery depleted. Reverting to safe mode.
4 days ago on that same forum was a post about "Mars robots may have destroyed evidence of life". Scientists didn't fabricate false proofs there but simply made an unconcious mistake to prove their own preconceptions...
The funding for the "research" is provided by an entity with an agenda other than pure research, e.g. having a vested interest in a particular outcome or finding. Nowhere is this more common that in the U.S. pharmaceutical industry, where entire ersatz journals have been published to provide the appearance of well-documented and peer-reviewed research.
Beyond jailing those involved in such grand misconduct, I don't know where to draw the line, but I believe that separating profit from research, as far as possible, is a good first step. And yes, I am indeed advocating that medical research be "socialized". I have nothing against corporate profits, but when truth, not to mention the public good, takes a back seat to profits, the system is broken when viewed from any impartial perspective.
nt
I am surprised it is this small. I am sure part of the liars (which is what they are) are doing it for fame and to be the one. Others (liars too) are doing it to keep their jobs, whether that be to get money to do science, or just to cling on. And forget turning someone in. It will ruin your career.
Can we please put a stop to all these people citing peer review as a sort of wonder cure?
I peer review a lot of papers. And yes, it catches a lot of bad science. But most of that is just, bad experimental design, bad writing skills, wrong conclusions, uninteresting stuff, etc.
There is nothing I can do against some smart guy who makes up all the numbers, but knows enough of statistics to make it look plausible. It is often not feasible, or even impossible to redo the experiments. I never heard anybody do that anyway (maybe because you get 2-3 weeks to do your review, whereas the work would take half a year at least).
There's a big gray area. For instance, the Millikan oil drop experiment, which established quantization of charge, was arguably fraudulent. Millikan threw out all the data he didn't like, and then stated in his paper that he had never thrown out any data. His result was correct, but the way he went about proving it was ethically suspect.
Find free books.
Of course, there is a chronic lack of ability in science to find the bad ideas...
In the physical sciences it should be possible. Except under conditions of woolly thinking. The whole point of the scientific method is to make your best attempt to experimentally DISPROVE your hypothesis. You can never prove it, but you can hedge it about with so many conditions that it can be accepted as being true.
Obviously this isn't (I think) necessarily all that helpful in "pure" mathematics, but my maths education is only 1st-year Uni level, so I'm not qualified to expound on this.
From:
http://www.its.caltech.edu/~dg/crunch_art.html
"""
The crises that face science are not limited to jobs and research funds. Those are bad enough, but they are just the beginning. Under stress from those problems, other parts of the scientific enterprise have started showing signs of distress. One of the most essential is the matter of honesty and ethical behavior among scientists.
The public and the scientific community have both been shocked in recent years by an increasing number of cases of fraud committed by scientists. There is little doubt that the perpetrators in these cases felt themselves under intense pressure to compete for scarce resources, even by cheating if necessary. As the pressure increases, this kind of dishonesty is almost sure to become more common.
Other kinds of dishonesty will also become more common. For example, peer review, one of the crucial pillars of the whole edifice, is in critical danger. Peer review is used by scientific journals to decide what papers to publish, and by granting agencies such as the National Science Foundation to decide what research to support. Journals in most cases, and agencies in some cases operate by sending manuscripts or research proposals to referees who are recognized experts on the scientific issues in question, and whose identity will not be revealed to the authors of the papers or proposals. Obviously, good decisions on what research should be supported and what results should be published are crucial to the proper functioning of science.
Peer review is usually quite a good way to identify valid science. Of course, a referee will occasionally fail to appreciate a truly visionary or revolutionary idea, but by and large, peer review works pretty well so long as scientific validity is the only issue at stake. However, it is not at all suited to arbitrate an intense competition for research funds or for editorial space in prestigious journals. There are many reasons for this, not the least being the fact that the referees have an obvious conflict of interest, since they are themselves competitors for the same resources. This point seems to be another one of those relativistic anomalies, obvious to any outside observer, but invisible to those of us who are falling into the black hole. It would take impossibly high ethical standards for referees to avoid taking advantage of their privileged anonymity to advance their own interests, but as time goes on, more and more referees have their ethical standards eroded as a consequence of having themselves been victimized by unfair reviews when they were authors. Peer review is thus one among many examples of practices that were well suited to the time of exponential expansion, but will become increasingly dysfunctional in the difficult future we face.
We must find a radically different social structure to organize research and education in science after The Big Crunch. That is not meant to be an exhortation. It is meant simply to be a statement of a fact known to be true with mathematical certainty, if science is to survive at all. The new structure will come about by evolution rather than design, because, for one thing, neither I nor anyone else has the faintest idea of what it will turn out to be, and for another, even if we did know where we are going to end up, we scientists have never been very good at guiding our own destiny. Only this much is sure: the era of exponential expansion will be replaced by an era of constraint. Because it will be unplanned, the transition is likely to be messy and painful for the participants. In fact, as we have seen, it already is. Ignoring the pain for the moment, however, I would like to look ahead and speculate on some conditions that must be met if science is to have a future as well as a past.
"""
A 21st century issue: the irony of technologies of abundance in the hands of those still thinking in terms of scarcity.
It is possible. But in many occasions it takes a ridiculously long time. Aether, geocentric solar system, aristotles belief in the four elements... the list goes on.
#Computers do not appreciate sarcasm
in agreement on Global Warming being caused by humans. Gee for a topic that actually isn't agreed on by all scientists, and that apparently could be riddled with faked or misinterpreted data we get told all day long that we are heathens if we don't believe the empirical scientific evidence. In fact if we don't tow the scientific line we must be dolts and shoved to the side as nutcases. Matter of fact we are about to make trillion dollar "Green" Cap and Trade laws all based on this Scientific Evidence, the heck with the evidence to the contrary.
According to a rigorous scientific study I just conducted, 7.
The survey percentages given are obviously fabricated
you actually have to treat your scientist well.
Dude, you have are crazy. You have no idea how cushy you have it and your whining is an insult to everyone else that pays taxes to support you guys - on everything from student loan guarantees, federal grants, and more. How much does NSF get a year? Plus the right to patent the stuff the gov't pays you to research.
If you think being a scientist sucks, try working on a factory floor. Everyone works crazy hours with no holidays, scientist or no. You talk about having a pension problem with the university? Man, people get no pensions at all. We got worthless 401ks and bogus T-Bills on our end! You talk about working two years on an experiment to find out your hypothesis is wrong? Cry me a river. There's tons of people that work for two years, five years, ten years, pitching in to build up a business, and then they'll get bumped out on the street because some jackass guy in bufukistan can do it cheaper.
To be honest, I do not even get angry anymore when I suspect someone may have done something "questionable". It's just sad
Then you are part of the problem. If you get angry at why the public has lost its faith in science, there's your answer.
This is my sig.
I am an experimental physicist in solid state physics. I think this subject in low to medium-prone to misconduct. Lets analyze the different aspects of it:
a) Motivation: getting your thesis/paper finished quicker/better, getting research money
b) Control Is there a control actually considering scientific behavior to be a fundamental good or is it just important that nothing is uncovered?
c) Ways of misbehaviour (i only write down what happened in the range of what i have seen/recognized(e.g. in other groups papers) or friends told me what they saw. I exclude friends of friends stories): Unclear formulation of experimental hypotheses *before* the experiment ("fishing in the dark"), not noting all people involved as authors, mentioning people not involved as authors, post-selection of experimental data supporting a hypothesis. incorrect labeling of data (e.g. different sample of same type etc), sabotage of co-workers experiments, beautification of data (the line between nonlinear filtering and faking is a thin one).
d) Ways of reporting without shooting yourself in your foot: ????? None?
e) Education towards it: negative (if you report results in lab courses which dont match the supervisors expectation, you get in trouble instead of turning the device on an measuring again. This educates people to copy last years results.
So let me summarize: the subtleness of some ways of manipulation coming together with a lack of control, education, and ways of reporting without getting damaged while seeing a good expected reward for bending the rules of science a little has turned many good people bad. Imagine a Bank where the money in the evening is not counted, the people are eductaed to just take a little bit, nobody is interested if some money is missing.
How many researchers are having sex with the lab chimps?
Have gnu, will travel.
Nintendo Game Shark. If your taught to cheat and bypass games (a tool for developing ethics) you will cheat in life.
Hugh Pickens unfortunately did not know that Daniele is not a girl's name.
http://www.issti.ed.ac.uk/people/person/126
So, how many years of training do you need to work on a factory floor?
Obviously a lot more than the academic or managerial world gives credit for, as those companies that work on creating a positive and empowering culture for those so called drones tend to be the ones that succeed.
This is my sig.
The problem with a career in science is that it is like a career in acting. Sure, there's the super stars at the top who are doing extremely well for themselves but then pretty much everyone else is struggling just to feed their families.
Salaries for Chemists
Geology
You've got chemists coming out of the gate making almost 70k a year, moving up to 120k a year as their career progresses. Oh, and by the way, physicists and materials people would probably be making more in the USA if there was more domestic manufacturing. Don't need too many physicists if your economy is based on bad banking and real estate. Think about that, when you decide which car to buy. [hint buy made-in-usa]
This is my sig.
Oh yeah? Well, I'm going to do a meta-meta-analysis to see how common meta-analyses are fraudulently conducted.
For example what are they trying to say here:
A pooled, weighted average of 1.97% of scientists admitted to having fabricated, falsified or modified data or results at least once â" a serious form of misconduct by any standard â" and up to 33.7% admitted other questionable research practices. In surveys asking about the behavior of colleagues, admission rates were 14.12% for falsification, and up to 72% for other questionable research practices.
All this depends on how they defined the questions. A narrow question "Have you fabricated data?" will result in a low number. A broad question "Have you ever done an experiment that you now think was not properly controlled?" will give a close to a 100% positive answers.
Is it surprising that if 2% of scientist falsify data 72% will now about that?
Not having done their own ground work the only think they can do is to tweak the statistics. Is anyone surprised that it didn't make it to a peer reviewed journal ??
Having said that i don't claim that scientific misconduct does not take place. Most of the research (I am talking about the academic biomedical field) is done by underpaid and overworked grad students and postdocs on tight schedules. They are under pressure to move on with their carriers and get some resemblance of normal life. Their supervisors are on tight schedules to produce results for grant reports and publications so they can get funded. Many universities (I would say most) even have goals of achieving external funding defined as dollars per square foot of lab space. If you don't look like you can bring money at the desired rate you are not hired as a PI, no matter how sound, innovative and important your work may be.
This pressure naturally makes people to take shortcuts. But all this is built into the system and there are safeguards. Poor quality research is harder to push into higher impact journals. Good data is reproduced by different groups using different methods and the predictions based on it are experimentally confirmed. So the bad stuff get's sifted out and the sound research gets incorporated into the base knowledge on which future work is built upon.
If anyone wants to reorganize the current system, they should first have a good plan on how to make it better. Preferably it will be tested on a small scale and shown to work as expected.
But in many occasions it takes a ridiculously long time. Aether
Einstein went from disproving the existance of Aether to, well, proving that that "nothing" is really "something." If only we'd had some term for "that thing that's there when we move all the rest of the stuff out."
If your incentives are aligned wrongly, policing will only go so far: it's like trying to destroy black markets by hiring more cops.
Most people don't go into science because they want to fabricate data. Sure, people want to be famous, but most of this data being fabricated isn't even anything that would make you famous (only a handful of high-profile examples are). You need a culture that neither encourages nor rewards attempts to meta-game the academic system, and a system that does not encourage gaming it, by for example judging scientists on some quantitative measure of their publication count multiplied by impact factor and citation count.
It's hard enough to answer difficult questions when everyone in question is acting in good faith, self-examining their own work before publishing it, and generally trying their best to do a good job. It's impossible if you're making some number of people feel they have no choice but to grit their teeth and publish papers they know are somewhat spun or not as good as they could've been. Let the scientists do their damn job, and stop the ranking/numbers game.
Of course, you can't just give everyone a big salary and free reign to spend the next 20 years doing whatever they want. But I would argue that you really need an evaluation of the quality of a scientist, not the quality of their output. Is this person insightful, knowledgeable, committed to doing good research, plugged in to what the real questions in their field are, has a plausible approach to answering them, etc.? If so, leave them the hell alone and let them decide how to best communicate their results, whether that be a flurry of 10 papers a year or one every 2 years.
In short, academic publishing is supposed to be about communication: you legitimately have something you think other people would want to read. Adding incentives based on the amount and type of that communication leads to people basically forcing themselves to communicate when they wouldn't have chosen to otherwise, because they need the lines on their CV; this does not improve the quality of the academic literature.
10 PRINT CHR$(205.5+RND(1)); : GOTO 10
"Our scientific systems and institutions should have better checks and balances. Many jobs/professions including monitoring and auditing to prevent corruption as standard."
checks = independent repeatability
balance = independent peer review
"We can do better!"
If any anyone has a more robust system with a better track record than science, I'm all ears.
And did you exchange a walk on part in the war for a lead role in a cage? - Pink Floyd.
With the cheating level of undergraduates rumored to be around half, I wonder have this declines to only two percent by the time you got your PhD? Two answers: (1) Science cheating is under-reported, or (2) scientists check each other results especially if they are important. I'm in computational physics where its fairly straight-forward to replicate another's results. Cheaters are discovered quickly. Other lab-based fields may not be as easy to get caught.
HTML never fails, it is I who failed to set the right conditions for HTML to cooperate. ;)
And did you exchange a walk on part in the war for a lead role in a cage? - Pink Floyd.
I don't know what the specifics are for other countries, but here in Australia, a law is being drafted that any research that is done that in some way receives government money (grant, paper, etc), must retain all data (both non-simulated and simulated) *forever* and be publicly available. The time between publication and release of data is what is taking time to draft.
It will be a little while yet before it becomes mandatory. Clearly we are talking about major infrastructure as well as significant cultural change.
.
Option 3: Those students that need to cheat in order to do well by and large don't go to graduate school, either because they're not smart enough or because they simply don't care.
If one does not show the validity of (many different) measurement instruments such as the surveys (re-)examined in TFA, it is fairly impossible to draw any valid conclusions in any meta-analysis. The alternative is to assume the validity of the originals. In this case, we are to assume that that the responses provided by people who are saying that they have not been honest are true, as well as assuming that the person(s) who created the instruments and/or reports derived from them and not just fabricating the results in part or in whole. And now with this meta-analysis we have to add another layer of unsupportable assumption of validity. Cripes, what a mess. But once you ask the question you have to ask it all the way down, and the question has to be asked.
One solution is to do independent replication. But for replications to be used to test the original results, enough of them have to be done to give an adequate statistical test of the comparison. It's tough enough just to get a decent experiment funded -- getting a replication funded is nigh impossible. And multiple replications? Forget it. Plus, in the publish-or-perish climate, damn few are willing to devote their time and energy to extensive work that gets little to no publishing credit. It's amazing we get anything done, much less further the progress of the science.
"I may be synthetic, but I'm not stupid." -- Bishop 341-B
What do you get when scientific research is tied to money? Science that is slanted to make it look more like what the people who are paying you want it to. While no one ever asks a scientist to cook the results the corporation can just never use that scientist again if they don't give the results they want. When the scientist knows this they tend to slant the research so they can get paid.
Business is about money and Science is about truth. Business people are willing to do unethical things to get what they want. When this spills over into the Science community truth goes out the window.
What? No reference to global warming research here? Is this thing on?
Have you got any idea how difficult it is to refute an experimental outcome, at least in the less exact sciences?
That's the difference between science and pseudo science. There is vast amounts of pseudo science out there. Much of it looks very respectable too.
Deleted
Wben it comes to "fudging" data, the Hight Priest of the National Snow and Ice Data Center is Par Excellance.
Every bit of the data regarding second hand smoke has been contrived. The Robert Wood Johnson Foundation paid just through 2005 over 446 MILLION DOLLARS for tobacco control. 99 million to the ACS, ALA, AHA for bans. 84 million to create/fund Tobacco-Free Kids. RWJF was created by the founder of Johnson & Johnson. RWJF owns tens of millions of shares of J&J stock. J&J sells Nicotine Replacement Therapy products (CESSATION). With that kind of money any real data proving second hand smoke as a non-issue was hidden away! Only false "science" is used for this kind of social engineering.
It seems scientific misconduct is perfectly acceptable, in fact, condoned, when it comes to tobacco control. In PLoS Medicine, I attempted to get Stanton Glantz to declare his competing interests. He has received 1.5 million dollars in grants and UCSF has received 36 million dollars from the Robert Wood Johnson Foundation. There aren't many who don't know who the RJWF is but for those who do not, they were created by the founder of Johnson & Johnson. RWJF owns tens of millions of shares of J&J stock. Who sells the NRT products? J&J. In fact, RWJF paid, just through 2005, 446 million dollars in tobacco control grants. Some grants to ACS had Medicare pay for NRT. An RWJF national program director was involved in writing the federal guidelines that tells doctors they have to push the drugs, that the patient should NOT try to quit cold turkey. NRT has a 98.4% failure rate for quitting 1 year or longer. The former CEO of RWJF heads a 10 million dollar grant at UCSF, Center for Smoking Cessation Leadership Center (compliments of RWJF). Glantz and UCSF stand to gain a ton more grant money from RWJF and should have to declare competing interests. http://www.plosmedicine.org/annotation/getCommentary.action?target=info%3Adoi%2F10.1371%2Fjournal.pmed.0050178 Then you have the University of Minnesota and Elizabeth Klein from Ohio State University passing a recent tobacco control study off. The abstract states that exemptions from smoking bans for standalone bars have been considered to ease the economic burden for bars...so she collects employment data for bars...AND RESTAURANTS. She figures nothing in for lack of compliance to the law (in Ohio, year 2 after the ban there were over 7,000 complaints and investigations-HIGH compliance?). She does not say how many businesses were bars. In Minnesota, bars are outnumbered by restaurants 3 to 1. ClearWay Minnesota paid for this study and in the grant prosal it states "We believe that this research will provide public health officials and tobacco control advocates with information that can help shape adoption and implementation of CIA policies, and prevent their repeal." and "The proposed study ⦠will contribute to MPAAT's (now ClearWay) overall mission by providing information that enables adoption and successful implementation of policies to protect employees and the general public from secondhand smoke exposure." Think this study has no bias or stated outcomes desired? IT'S IN THE GRANT PROPOSAL!! And her article proclaiming no harm to bars and restaurants has been published everywhere with TV and the radio picking it up. This study has so many holes in it that if it were the Titanic, it wouldn't have made it out of the harbor. So...we issued a press release. http://news.prnewswire.com/DisplayReleaseContent.aspx?ACCT=104&STORY=/www/story/05-29-2009/0005034690&EDATE The problem is when "science" is bastardized to fit a social engineering scheme, science will never be trusted when it will need to be trusted. I'm disgusted with dung being passed off as valid. It has to stop.
in fact BS like that post yo just wrote is part of the problem.
having team work skills and social skills has --nothing-- to do with being a manipulative ass licking coward. . .. but the latter is often rewarded in modern american bureaucracies, including many universities and corporations.
peer review works but it can be subverted, and has... witness the recent 'peer review journals' that were in fact 'made up' by drug companies and published by elsevier. there have been numerous reports of people being payed for research results, and for lots and lots of 'ghostwriting' going on.
besides that, remember the guy that wrote a lot of shite and got it published in a postmodernist journal? people like to say 'oh thats the humanities'... as if it would never happen in 'the world of science'.
your response is typical of the enablers of the problem. you want to stick your head in the sand and somehow conflate being a good team worker with being a liar and a 'yes man' and a scammer. .. and pretend that there is no problem with the latter in academia or industry...
despite the worst financial destruction since the great depression, brought about by ivy league educated liars and scam artists. . . despite viox and lead paint in toys and baby milk poisoning and journals that are published by drug companies to boost their products, you want to pretend there is no issue.
being a good team-worker and being a liar and scammer... the two have nothing to do with each other, but of course the liars and scammers want you to believe that they do.
after being around smokers, and why do i want to vomit just from the smell on their clothing.
from 1992-2009 both parties have controlled the house and senate in varying degrees depending on the year. the cause of various problems is hard to place, but saying that the last two years of financial disaster were somehow caused by democrats controlling congress is just absolutely without evidence. the causal events that led to this particular financial crisis had been brewing for at least 10 years, probably more. for example the repeal of certain laws regulating credit default swaps and so forth is something that happened before bush was even in office IIRC.
There is this book, by Broad and Wade, "betrayers of the truth" that exposes some famous scientific misconducts and frauds.
What I realized from this book is that fraud is common in "mesure science". Physics, Chemistry, Biology. Science where no maths are involved but for showing your data is cool (of course, the cited sciences are not limited to that). Science with experiments.
I do maths and computer science. I may be too pure and naive, but I don't see how to fraud in my field. All my research is about *proving* things that I create correct. I reckon that in formal sciences (science based on theorems and proofs), these frauds are quite inexistant. But maybe I'm wrong. Or maybe those who say "this is not science" are right.
they have been getting funded for over 20 years with a theory that doesnt actually predict anything
It has been reported that several of the largest pharmaceutical companies setup fake technical journals in which papers written about their new (I ) wonder drugs, are pushed as being utopean. I wont give initials, but judicious search using Google or Yahoo will lead you further information. When the journal costs a million to setup and distribute, but profits are in the hundred's of millions (or billions), there is a great marketing justification. Doctors are being bamboozled.
Leslie Satenstein Montreal Quebec Canada
before they could be TESTED.
And why do you think they were testing it? Because there were many scientists who didn't believe in the aether.
They just had to wait until technology allowed them to make the experiment to prove (in the original sense of "test") the theory of the aether and find it lacking.
Not all areas have sufficient checks and balances. In fact, I hereby propound Business_Kid's law, that the effectiveness of the checks and balances in a scientific field are in inverse proportion to the media exposure in the public media. I think stem cell research is an exception to the above law, but it's good elsewhere. In my area (Electronics hardware) everything can be replicated, and very few headlines appear. Other areas are all headlines and very short on experimentally repeatable substance, for example Evolution. As for peer review: Galileo and Copernicus would have been silenced by peer review, as the ID movement is today in scientific journals. The real question is: How do you overcome bias?