Slashdot Mirror


Dysfunction In Modern Science?

eldavojohn writes "The editors of Infection and Immunity are sending a warning signal about modern science. Two editorials (1 and 2) published in the journal have given other biomedical researchers pause to ask if modern science is dysfunctional. Readers familiar with the state of academia may not be surprised but the claims have been presented today to the National Academy of Sciences (NAS) that level the following allegations: 'Incentives have evolved over the decades to encourage some behaviors that are detrimental to good science' and 'The surest ticket to getting a grant or job is getting published in a high profile journal, this is an unhealthy belief that can lead a scientist to engage in sensationalism and sometimes even dishonest behavior to salvage their career.' The data to back up such slanderous claims? 'In the past decade the number of retraction notices for scientific journals has increased more than 10-fold while the number of journals articles published has only increased by 44%.' At least a few of such retractions have been covered here."

17 of 155 comments (clear)

  1. Grant whores and PR scientists by crazyjj · · Score: 5, Insightful

    When I was in grad school there were always grant-whore and PR scientists around. Everyone knew who they were. They were the Chicken Littles who were always proclaiming the end of the world if their pet project wasn't funded. They were always the first to run to the press with GREATLY exaggerated claims and alarmism if it served their purposes (especially when they were looking for political support with funding). Their "science" was far less about scientific method than their own financial self-interests (including getting the precious tenure that they all craved like little lapdogs).

    Of course, I have a friend who still won't accept that this EVER happens. "Science would never allow that," he says. His naivete is so endearing.

    --
    What political party do you join when you don't like Bible-thumpers *or* hippies?
    1. Re:Grant whores and PR scientists by Kenja · · Score: 4, Insightful

      Your fried is right, "science" wont allow that to happen, but people will. And when it happens, its not science.

      --

      "Have you ever thought about just turning off the TV, sitting down with your kids, and hitting them?"
    2. Re:Grant whores and PR scientists by magsol · · Score: 4, Insightful

      While it's disheartening to hear about such abuse of the scientific method, from a purely scientific perspective (meta!) this actually isn't all that surprising. Abuse exists in every system; there's always a distribution around the mean of those who are honest and trying to do the right thing, and the minority who are either malevolently trying to game the system or who are truly just competent enough to not get fired. I'm also a grad student and while I would love to agree with your friend--in theory, science shouldn't allow it, but as we know, theory and practice rarely align in practice--I have to acknowledge that science is just another system run by imperfect human beings and, implicitly, will have some imperfections.

      The problem arises when this distribution of participants skews and the "expected" minority (the quantity of which you still try to minimize!) grows. So the question becomes: is modern science suffering from a growing problem of bad scientists? It's hard to say. While I'm willing to accept the numbers, the title "is modern science dysfunctional" is, itself, a tad bit sensational, making the rest of the article difficult to take seriously.

      --
      "I'd just like to emphasise that taking a million years isn't a metaphor here..." -Rich Bradshaw
    3. Re:Grant whores and PR scientists by Electricity+Likes+Me · · Score: 4, Insightful

      Double edged blade. If you have tenure then you can hold off on publishing to make sure you're really, truly correct. If you don't, then you have no choice.

      To my mind the real issue is that the notion of "debate in the literature" is being rapidly killed by the increase in complexity and cost of some experiments, and to a greater extent the very terse manner in which journals like to have their experimental methods published: I'd much rather read a rambling journal or logbook then someone's - effectively "opinion" - on what they think their important experimental variables are, since accusing someone of publishing false information is ridiculously difficult (and not to be taken lightly) whereas people simply missing things is common and to be expected.

    4. Re:Grant whores and PR scientists by Pausanias · · Score: 4, Interesting

      You are either bitter, or were stuck in a bad department. While such sensationalist people certainly exist, few of them actually influence the broader debate. In my community such people are far outnumbered by brilliant and truly insightful researchers who work incredibly hard and whose contributions to our understanding of the universe are vastly undervalued by their pay. To think that some of the most brilliant minds in the world, working at the frontiers of science simply because they love it, are paid no more than a senior code monkeys, is the real travesty.

    5. Re:Grant whores and PR scientists by NeutronCowboy · · Score: 5, Insightful

      In other news, HR people find out that when people are judged against a specific metric, those people will work towards that metric and disregard their actual job. HR and management is particularly shocked, and wants to know what metrics they can use to make sure people don't game their system.

      --
      Those who can, do. Those who can't, sue.
    6. Re:Grant whores and PR scientists by Mindcontrolled · · Score: 4, Insightful

      The climate denialists' poisoning of the wells has worked out. Everyone believes by now that "they are only doing it for the grant money".

      --
      Ubi solitudinem faciunt, pacem appellant.
    7. Re:Grant whores and PR scientists by idontgno · · Score: 5, Insightful

      And what is "Science" (must capitalize correctly) without scientists? Including unscrupulous ones?

      Way to posit "no true scientist.".

      Science is a human artifact. Every human artifact is potentially susceptible to fraud, manipulation, trolling, marketing, and every other foible and evil humans are capable of. Almost any human intention and motive can be expressed through the manipulation and corruption of the scientific process. And scientific fraud is no less about science than financial fraud is about finance.

      There is no great, glorious and impersonal "Science". Insisting otherwise is just another form of deism, one that gives rise to the criticism that science is just another religion. And I'm sure no one here wants that.

      --
      Welcome to the Panopticon. Used to be a prison, now it's your home.
    8. Re:Grant whores and PR scientists by j-beda · · Score: 4, Informative

      >>> who are either malevolently trying to game the system

      Example: The Penn State guy who produced a temperature that resembles a hockey stick. It was later discovered he had altered his numbers to give the result desired (and thus become famous to the public & funded by the government).

      Or rather it was later *claimed* he had altered his numbers, etc. etc.

      My understanding is that while there have been many criticisms of this work (the 1998 Nature journal Mann, Bradley and Hughes multiproxy study on "Global-scale temperature patterns and climate forcing over the past six centuries"), the vast majority of subsequent work has supported the majority of their conclusions, and all investigated claims of improper conduct have come to naught.

      http://en.wikipedia.org/wiki/Hockey_stick_controversy

    9. Re:Grant whores and PR scientists by narcc · · Score: 5, Informative

      Science doesn't deal in truth -- and arguably, despite the name, deals only practically in knowledge -- science deals with understanding.

      From science we build models of the natural world that are explanatory, but need not be true in any meaningful sense of the word. To declare something "true" is to make an unscientific statement as such a declaration denies falsifiability.

      Consequently, science does not lead iteratively toward truth -- a popular misunderstanding. Such a goal is decidedly anti-science.

  2. Yet... by betterunixthanunix · · Score: 4, Insightful

    For some reason, people defend publish-or-perish and systems that evaluate researchers based on the quantity of work or the names of journals or conferences where they have presented their work.

    --
    Palm trees and 8
    1. Re:Yet... by ceoyoyo · · Score: 5, Insightful

      Publish or perish is good. As a scientist you MUST communicate your ideas or you're a failure. What's wrong is the use of simple metrics like paper count or journal "quality." As usual, if you want to properly evaluate someone's worth you need to use your brain, not your calculator.

  3. There's nothing wrong with science... by Gavin+Scott · · Score: 4, Insightful

    ...but people forget that "scientists" are not "science", they are simply people using the tools of science to seek the kind of knowledge that the scientific method and process can produce. As such they are subject to all of the same pressures, hopes, dreams, failures, etc. that the rest of us are.

    But the process of science itself will always move forward, since science is only about reproducible experiments, so no matter how much bad (human) behavior might get involved, eventually the "truth" will win out. But the bad behavior can of course be extremely damaging to the process.

    So there's nothing wrong with "science" or even its application I think. There are probably economic incentives that are promoting behaviors that affect the short-term reliability and the long-term costs of gaining useful scientific knowledge though, and hopefully we can come up with ways of improving the meta-processes.

    G.

  4. Eisenhower's farewell adress by 0123456 · · Score: 4, Interesting

    Read the part after the one everyone always quotes about the 'military-industrial complex'.

    1. Re:Eisenhower's farewell adress by wanzeo · · Score: 4, Informative

      Fascinating. For those who are curious:

      In this revolution, research has become central, it also becomes more formalized, complex, and costly. A steadily increasing share is conducted for, by, or at the direction of, the Federal government.

      Today, the solitary inventor, tinkering in his shop, has been overshadowed by task forces of scientists in laboratories and testing fields. In the same fashion, the free university, historically the fountainhead of free ideas and scientific discovery, has experienced a revolution in the conduct of research. Partly because of the huge costs involved, a government contract becomes virtually a substitute for intellectual curiosity. For every old blackboard there are now hundreds of new electronic computers.

      The prospect of domination of the nation's scholars by Federal employment, project allocations, and the power of money is ever present – and is gravely to be regarded.

  5. some issues only in life sciences, some insoluble by bcrowell · · Score: 4, Interesting

    A lot of the issues discussed here are only relevant in the life sciences, and especially in medicine. Retractions are not a big phenomenon in the physical sciences. Ditto for publication bias (refusal by journals to publish negative results or failed attempts to replicate published results). This is essentially just because the life sciences are harder than the physical sciences. The life sciences have much more intractable problems with complexity of systems and difficulty in controlling variables.

    Some of the problems they discuss are clearly insoluble. The uncertain career prospects for young scientists are a straightforward matter of supply and demand. There are many, many very talented people who would like to spend their careers doing fundamental scientific research. The number of such people is 1 or 2 orders of magnitude greater than the number of jobs available. This isn't a new phenomenon, although in the past the problem may have been hidden more, because, e.g., up until about 1950, only white, affluent, European and American males were considered prospects for a career in science.

  6. Re:Back to the Garage by Arrepiadd · · Score: 4, Interesting

    My view of it is that there aren't that many basic concepts to discover in the back of your garage. Particle accelerators, high-field NMR machines, electron or AFM microscopes, huge ground-based or orbital telescopes are needed to make the next discoveries in their respective fields because the easy stuff, that could be seen with bubble chambers, low-field magnets, optical microscopes and small telescopes was already discovered. It's a matter of diminishing returns.
    Scientists have been doing their jobs for hundreds of years, no one is going to discover an improved version of the laws of gravitation with a 100 dollar telescope. What may come out of observing dark matter was obtained with multi-million dollar equipment, collaborative effort and brilliant minds going over and over the same thing.

    Granted, there may be things to discover that can still be attained in a garage. In hindsight everything is easy, but if no one is looking, there may still be amazing things still to observe in your kitchen lab. But expecting the cure for problems of the world to come out of a bunch of semi-amateur scientists is betting on the wrong horse... it may happen in a field or two, but it won't be the future of science.