Dysfunction In Modern Science?
eldavojohn writes "The editors of Infection and Immunity are sending a warning signal about modern science. Two editorials (1 and 2) published in the journal have given other biomedical researchers pause to ask if modern science is dysfunctional. Readers familiar with the state of academia may not be surprised but the claims have been presented today to the National Academy of Sciences (NAS) that level the following allegations: 'Incentives have evolved over the decades to encourage some behaviors that are detrimental to good science' and 'The surest ticket to getting a grant or job is getting published in a high profile journal, this is an unhealthy belief that can lead a scientist to engage in sensationalism and sometimes even dishonest behavior to salvage their career.' The data to back up such slanderous claims? 'In the past decade the number of retraction notices for scientific journals has increased more than 10-fold while the number of journals articles published has only increased by 44%.' At least a few of such retractions have been covered here."
When I was in grad school there were always grant-whore and PR scientists around. Everyone knew who they were. They were the Chicken Littles who were always proclaiming the end of the world if their pet project wasn't funded. They were always the first to run to the press with GREATLY exaggerated claims and alarmism if it served their purposes (especially when they were looking for political support with funding). Their "science" was far less about scientific method than their own financial self-interests (including getting the precious tenure that they all craved like little lapdogs).
Of course, I have a friend who still won't accept that this EVER happens. "Science would never allow that," he says. His naivete is so endearing.
What political party do you join when you don't like Bible-thumpers *or* hippies?
For some reason, people defend publish-or-perish and systems that evaluate researchers based on the quantity of work or the names of journals or conferences where they have presented their work.
Palm trees and 8
Well, the solution is pretty simple. Make sure that grants and jobs are not ridiculously hard to obtain. It is not uncommon at all to have 300 applicants for 1 tenure-track position. It is generally agreed upon that above a 3:1 pressure, things start to get messy. For grants we are closer to 5:1-10:1 and it has been increasing at an alarming rate over the last few years. And for jobs we are around 300:1 as i mentioned earlier. Incidently i have still not landed a tenure-track job.
Surely any competitive system to select people for desirable posts is going to encourage dubious behaviour? Those editorials don't seem to offer very significant changes, just new metrics for people to game. It's not just academia either - every career where your value is measured by some proxy metrics is going to see unethical behaviour from people near the cut-off.
Strange women lying in ponds distributing swords is no basis for a system of government.
...but people forget that "scientists" are not "science", they are simply people using the tools of science to seek the kind of knowledge that the scientific method and process can produce. As such they are subject to all of the same pressures, hopes, dreams, failures, etc. that the rest of us are.
But the process of science itself will always move forward, since science is only about reproducible experiments, so no matter how much bad (human) behavior might get involved, eventually the "truth" will win out. But the bad behavior can of course be extremely damaging to the process.
So there's nothing wrong with "science" or even its application I think. There are probably economic incentives that are promoting behaviors that affect the short-term reliability and the long-term costs of gaining useful scientific knowledge though, and hopefully we can come up with ways of improving the meta-processes.
G.
Read the part after the one everyone always quotes about the 'military-industrial complex'.
I'd love to see more real science and research done in the garage/basement rather than in environments which are prone to the "publish or perish" disease. Are there still basic concepts of the universe to be discovered that don't require a particle accelerator or electron microscope? I'd be willing to be there are. It also seems that current academia is so focused on such tiny details of a particular phenomenon that they can't see the forest through the trees...
A lot of the issues discussed here are only relevant in the life sciences, and especially in medicine. Retractions are not a big phenomenon in the physical sciences. Ditto for publication bias (refusal by journals to publish negative results or failed attempts to replicate published results). This is essentially just because the life sciences are harder than the physical sciences. The life sciences have much more intractable problems with complexity of systems and difficulty in controlling variables.
Some of the problems they discuss are clearly insoluble. The uncertain career prospects for young scientists are a straightforward matter of supply and demand. There are many, many very talented people who would like to spend their careers doing fundamental scientific research. The number of such people is 1 or 2 orders of magnitude greater than the number of jobs available. This isn't a new phenomenon, although in the past the problem may have been hidden more, because, e.g., up until about 1950, only white, affluent, European and American males were considered prospects for a career in science.
Find free books.
The high profile journals weed out sensationalist claims more often than not (part of being high-profile is having a finely tuned bullshit meter). The number of retractions are also a sign of strength, as the mechanisms forcing people to correct their errors are getting better. This isn't to claim that the process doesn't have room for improvement, but the cited examples are rubbish.
For every problem, there is at least one solution that is simple, neat, and wrong.
Capital = money. Much of the modern world is capitalism, so, we're all slaves to money and those who control it. What's not to understand here?
Could be that physical sciences have about two or three generations more experience with the concept of pounding the data set with computers for statistical analysis. Maybe give the soft sciences another generation or two?
A big factor might be that datasets are no longer handwritten in a lab notebook on the experimenters desk, but are living on flash drives, DVD-Rs, dropbox, ftp sites...
"Science flies us to the moon. Religion flies us into buildings." - Victor Stenger
How about we apply the Kickstarter model that is improving the gaming industry to Biomed research, all we need is a platform that connects people with various ailments to the researchers interested in developing treatments and doing basic science related to those particular illnesses.
There can be some mandatory requirements like not being able to patent the results ( or being able to patent shorter periods of time) of the research and making sure that it's published i in an open access journal like PlosONE. This way we eliminate the incentive for the researchers to gain advantages with unfair techniques and also encourage new talent to join the industry.
I'm sure there's lots of researchers with great leads and ideas that just don't get enough funding from the pharma companies because they won't bring revenues in the short term, this is especially true for drugs with patents that are expired but might have different new applications and treatments that use materials which are not patentable.
There's lots of similarities with the gaming industry if you draw analogies between big pharma and publishers, maybe the solution is the same, cut the middleman.
1. Create alarmist theory to get funded.
2. Create data to support theory
3. Profit!!!
We finally solved the ???? problem.
21st Century Renaissance Man
You can't expect journals to vrify the claims of a paper. That's the job of the scientific community, to try to replicate the results and see what happens. Of course, accepting unreplicated results as facts is a serious problem in some sciences.
Dishonesty has become a real problem in science. Some recent cases (Judy Mikovits, Luk Van Parijs, and Dipak K. Das (aka the red-wine researcher)) reveal some serious misconduct from high profile researchers. Certainly, part of this is due to the increased pressure on scientific researchers. The other part of this is generational. Cheating and misconduct are certainly more prevalent .in younger generations (or perhaps its always been this way and they are just not quite as clever).
Perhaps, but bioinfomatics is an up and coming field. The big, big problem is the inherent variability of biologic systems and our rather primitive understanding of same. The other problem is we're shotgunning science - we spend an enormous amount of money to study human biology (poorly, in general) whilst we should really be spending money on the back end - bugs and worms and the like that we might be able to understand better.
There are good reasons for this, of course, and 'science' doesn't really care. If we spend the next 100 years running around in the wrong direction, then figure it all out, well, that's science. Nobody said we had to understand life, the Universe and everything in our lifetimes.
Faster! Faster! Faster would be better!
The primary work of pseudo-scientist is to make faux-science for personal, religious, corporate, and government purposes. ..., RU ..., CN ....
Sort of like the Iran-science of tits-&-earthquake relativity, USA proof of poof Iraq-WMDs, EU
Highly certified people accept lies as personally essential. Highly qualified people accept proof/truth as life critical.
Unaccountable leaders are masters, and unrepresented people are slaves. How do US and EU fare?
The claims were written, so they can't be slander. They are unlikely to be libelous either, since they seem to have been made in good faith with a factual basis.
The problem is not with a the papers submitted. The problem is with the editorial board not taking time to peer review the articles and simply rubber stamping them for publication. Seems to me these journals wanted to jump on the sensationalism band wagon to get greater publicity.
"Could be that physical sciences have about two or three generations more experience with the concept of pounding the data set with computers for statistical analysis. Maybe give the soft sciences another generation or two?"
Student's t-test was invented in 1908 so that the Guinness brewery could monitor the quality of their stout. Food scientists have been doing statistics ever since. Statistics is old hat for biologists.
Considering how many misinformed people there are on the internet, there are lots of people who aren't even taking a basic science requirement in school at the time they post random bull in youtube comments, their blogs, their facebooks, etc. all of which, while not an influential public claim to scientific research, creates loads of other spout-off-the-mouth misinformed folk who read the ridiculous e-diatribes. Crap is made up on spot it seems, all reactionary and without an ounce of "I might be wrong..." added. Like I said, not someone from actual influence, but when you have a YT vid of an E! TV feature on Snooki turn into scientific debate, it gets scary. People just like to think "I'm RIGHT!" all the time and will turn opinion into fact (which, I admit, I sometimes fall victim to. :P).
A real scientist, homegrown, self-taught or MIT-learned needs to have a serious sense of humility, because so many conjectures made can turn out the exact opposite of what was theorized.
You want to know how to help your kids? LEAVE THEM THE F*&K ALONE. --George Carlin
You've just been Climate Scienced!
"Dissenters shall be silenced."
Breaking, life-altering, all-important news: People sometimes sensationalize things!
What baffles me is why aren't the authors of retracted articles punished in some way? At a research lab I worked at the prominent researcher proclaimed the discovery of a new particle that made a big splash in the news - when you looked at the details, he wasn't even the first guy to claim it, it is just that the original claim had marginal statistical significance, he just claimed he got a bigger signal - he got lots of citations, but no-one could repeat the experiment and when you looked closer at what he did to get the signal he just told some poor post-doc to keep refitting the data with different cuts until he found a signal. Well in any event the guy still runs his lab, and he pretty much tries to screw anyone who disagrees with him through his position on funding committees - so nobody fucks with him. Given that I think the funding process need to be reformed, with more reviewers and anonymous grant submissions - the funding system can be gamed to lock people out you have a grudge against and that keeps people in fear of people allowing them to get away with crappy sensationalist science.
"Science flies us to the moon. Religion flies us into buildings."
"Religion built Notre Dame. Science built Dachau."
The social sciences lead the pack in their elevation of academic and civic politics over actual scientific research. But it wasn't always so. IMO, everything went to shit around 1980.
Fried? :D
Ant(Dude) @ Quality Foraged Links (AQFL.net) & The Ant Farm (antfarm.ma.cx / antfarm.home.dhs.org).
Some of the problems they discuss are clearly insoluble. The uncertain career prospects for young scientists are a straightforward matter of supply and demand.
This is not insoluble. We can and should increase demand for talented young researchers. Basic science is the best investment we can as a society, in terms of ROI. The problem is that the returns are enormous but infrequent, and not just limited to the funding body.
If we understand just how valuable basic research is, then our scientists don't have to work as hard to justify their existence. Instead of spending time marketing themselves and their research, they can spend that time checking their work before publication. Nobody does good science when they are worried about being able to pay the mortgage.
In other words, you get what you pay for. If we decide we want a prosperous future, we need to invest in it now.
Give me Classic Slashdot or give me death!
Christianity has long had a heavy association with antisemitism. Adolf Hitler was an admirer of Martin Luther, author of "On the Jews and Their Lies", and referred him as an important reformer and antisemite in "Mein Kampf." Luther's work was the blueprint for Kristallnacht's murders, destruction of Jewish businesses, and burning of over 1,000 synagogues. It occurred on Luther's birthday. Whipping the majority christian German population, Lutheran and Catholic alike, into the murderous frenzy of the Holocaust was quite easy for Hitler and the Nazis. They used christianity to do it, and at the same time banned Darwin and works by other evolutionary biologists.
Science had nothing to do with Dachau. Religion, specifically christianity, did.
And what is "Science" (must capitalize correctly) without scientists? Including unscrupulous ones?
Way to posit "no true scientist.".
Science is a human artifact. Every human artifact is potentially susceptible to fraud, manipulation, trolling, marketing, and every other foible and evil humans are capable of. Almost any human intention and motive can be expressed through the manipulation and corruption of the scientific process. And scientific fraud is no less about science than financial fraud is about finance.
There is no great, glorious and impersonal "Science". Insisting otherwise is just another form of deism, one that gives rise to the criticism that science is just another religion. And I'm sure no one here wants that.
Wow, 12 mod points left, and I really wanted to mod you into oblivion. Instead, I'll just point out why you are wrong, and let some other mods go medieval on your ass. To answer your question, science is a process, not an artifact, so it doesn't matter if there are scientists around, unscrupulous or otherwise. It is a methodology, not a thing. If humans didn't exist, the process would still be there for some other species to discover and use. Since your premise is demonstrably false, your assertions founded on that premise are false, too -- including and especially your maladroit attempt to link science with religion via the deism argument.
Trolls shall be modded down.
FTFY.
So far as I know, apart from Lindzen & Choi (2009), there has not been a rush of retractions in climate science journals. Now I could be wrong, and OP is free to educate us. But to hijack a discussion to post his own fabulist anti-science rant, is surely the very definition of a troll.
This is essentially just because the life sciences are harder than the physical sciences. The life sciences have much more intractable problems with complexity of systems and difficulty in controlling variables.
That's certainly a possible contributing factor. I will grant you that.
Or, quite simply, they're not rigorously exercising the scientific method, as you have to in a more provable field such as hard science. (There's a reason why it's called hard science, you know.) It seems like every other week we read about some study 'proving' some new scientific principle which is plagued with logical and procedural fallacy.
~/ssh slashdot.org ssh: connect to host slashdot.org port 22: too many beers
>>Some of the problems they discuss are clearly insoluble. The uncertain career prospects for young scientists are a straightforward matter of supply and demand.
>This is not insoluble. We can and should increase demand for talented young researchers. Basic science is the best investment we can as a society, in terms of ROI. The problem is that the returns are enormous but infrequent, and not just limited to the funding body.
I disagree. One of the problems described in TFA is that there is a large number of researchers churning out papers that are either of low quality or simply unimportant. They're describing the life sciences, but this is also my experience in physics. There are already too many people scouring the same scientific hunting grounds at the same time.
The other reason I disagree is that I wasn't kidding about 1 or 2 orders of magnitude. Seriously. There are literally 10 to 100 times more people who would like these careers than there are jobs. It's simply not possible to scale up scientific research by a factor of 100. For example, the University of California system has 10 campuses. What are we going to do, build the UC system up to 1000 campuses?
Find free books.
"Science" doesn't exist in a vacuum. It is a product and a political statement.
If you don't already have an audience in mind for your research, who will pay for it? No one wants the truth -- we all want "truths" we can use.
If your sponsor is a Democrat, your science will be blue state science. If your sponsor is a pharmaceutical company, you may find yourself praising SSRIs. If you work for the government, torture = good. And so forth.
It's time we stopped pretending that science was anything but the work of humans, and funded by humans with different agendas. And as today's most interesting article shows us the effects are a polarization of the population from science.
There was a great thread about this on our forum which added another wrinkle. Science studies material. It's possible that not all of the universe is materiality. We may need to open our minds to keep our science from becoming controlled by only one voice in the debate.
Futurist Traditionalism