Slashdot Mirror


Bad Science Journalism Gets Schooled

TaeKwonDood writes "Biology post-doc Dr. Michael White takes a look at the '2007 Best American Science and Nature Writing' and doesn't like what he finds in an article called Bad Science Journalism and the Myth of the Oppressed Underdog. Turns out it's not just political writers who pick a position they want to advocate and then write stories to confirm it. Science journalism gets a scolding and it's been a long time coming."

22 of 212 comments (clear)

  1. Rather obvious by The+Ancients · · Score: 4, Insightful

    This is quite logical, as it's human nature to do so, and not a direct result of one's career field.

    Even simple background research on the authors of articles in many different fields reveal that yes, the majority of writers are biased, either consciously, or otherwise.

    1. Re:Rather obvious by ChameleonDave · · Score: 5, Insightful

      yes, the majority of writers are biased, either consciously, or otherwise.

      More than the majority. I'd say that everyone is necessarily biased about everything, because we can never avoid the fact that we approach every issue with some sort of background or perspective.

      However, there are those who are biased, and those who are biased and also throw all logic to the wind.

    2. Re:Rather obvious by CheshireCatCO · · Score: 4, Insightful

      This is quite logical, as it's human nature to do so, and not a direct result of one's career field. You're absolutely correct. Think of all the stories of some technological innovation you've heard that follow this same pattern. ("Everyone believed that building a kerbudle with transducing fleebs was impossible, but one lonely inventor decided to try it. [Story continues, ignoring that the inventor was paid to do the investigation, however long a shot it was deemed, by some well-known company, etc.]") Or even business: "Everyone said that Microsoft's/Apple's/Intel's/etc's hold on X market was unassailable, but this plucky [they're always plucky] little start-up set out to fight the Goliath." It's human nature and it's good story-telling, which is what sells science articles.

      Question is, is there another way to tell the stories that isn't so formulaic and that doesn't give such an incorrect impression?
  2. Par for the course by TheMeuge · · Score: 5, Interesting

    This is merely par for the course... and the observations made in the TFA are not new either. I encounter them every day on Slashdot!

    HIV not causing AIDS conspiracy, Fluoride in the water conspiracy, Cancer being cured but evil corporations in league with all scientists not releasing the cure... I have to endure this every single day.

    I think the more interesting subject to explore, is the psychology of why people are so eager to believe the improbable, and far more likely to accept an outrageous exaggeration, a halftruth, or an outright lie, merely to spite the establishment. As a scientist, that's a subject that interests me the most, because I would like to locate the part of the brain that will believe that the herbs in "Airborne" will miraculously prevent you from getting a disease, but will refuse to accept scientific principles and facts that have held firm under scrutiny for decades.

  3. obvious != right by More_Cowbell · · Score: 5, Insightful

    Science journalism would perhaps be the one area where you would expect the author to concisely go out of their way to be unbiased.

    --
    Experience teaches only the teachable. -AH
    1. Re:obvious != right by Rei · · Score: 4, Interesting

      And yet, you see it all the time. For example, the article about the cook/tax dodger/inventor who came up with a perpetual motion machine which was posted on Slashdot a month or so ago. Or Pimentel's annual widely publicized reports on ethanol being energy negative, despite everyone else's studies coming up with numbers of about 30% positive. Or pretty much every article about anyone who challenges anything about global warming. It's always the plucky renegade scientist who discovered some brilliant notion that everyone in the scientific community had missed but the other scientists are too jealous/blinded by hubris in their ivory towers to see and accept what should be so obviously true to everyone else.

      --
      Aptera: Most expensive Star Trek prop ever.
    2. Re:obvious != right by Anonymous Coward · · Score: 5, Funny

      scientists are too jealous/blinded by hubris in their ivory towers to see and accept what should be so obviously true to everyone else. If your job or grant pays well enough that you can afford to build a whole tower out of the tusks of poached exotic animals, it's not hubris to be defensive of your place in the world, it's your duty as a red blooded American.
  4. Politically Correct bias? by grassy_knoll · · Score: 4, Interesting
    Given the example in the article, and this quote:

    What gets lost is the scientific method, the idea that novel proposals need to be thoroughly vetted and tested, no matter how intuitively attractive they are.


    Perhaps the bias in reporting is due to the "intuitive attractiveness" of the conclusion?

    The opposite might be true as well. For instance, I didn't hear much about this study:

    In recent years, Putnam has been engaged in a comprehensive study of the relationship between trust within communities and their ethnic diversity. His conclusion based on over 40 cases and 30 000 people within the United States is that, other things being equal, more diversity in a community has a correlation [expressed as a beta equal to 0.04 in a multiple regression analysis (see Putnam, 2007)], to less trust both between and within ethnic groups. Although only a single study, limited to American data, and the Census tract Herfindahl Index of Ethnic Homogeneity only explaining 0.16 % of the variance in trust in neighbours in the regression model presented (Putnam, 2007) it claims to put into question both contact theory and conflict theory in inter-ethnic relations. According to conflict theory, distrust between the ethnic groups will rise with diversity, but not within a group. According to contact theory, distrust will decline as members of different ethnic groups get to know and interact with each other. Putnam describes people of all races, sex and ages as "hunkering down" and going into their shells like a turtle. For example, he did not find any significant difference between 90 year olds and 30 year olds.


    You'd think a Harvard professor saying in effect that diversity has a down side might be news worthy, unless that idea isn't attractive to the majority of the news media.
  5. what do you expect? by l2718 · · Score: 4, Insightful
    1. The people who have the qualifications to understand scientific papers (the ones with science education) can usually get better-paying jobs in science, rather than science journalism.
    2. Worse, our society as a whole is anti-intellectual and specifically anti-scientific. This does not only apply to the readers: many people who study journalism have a weak science background. As long as society can accept someone as "educated" who cannot explain how a refrigerator works, or accept some definitions and follow a mathematical proof based on them, it is hardly surprising that science writers and readers can't understand a scientific argument.
    3. Today's readers are trying to be entertained, not be informed. A piece that reinforces the reader's prejudices will make the reader feel good, and hence buy more copies of the publication.

    For an example for the second point, remember the "gravity-powered lamp" concept that was advertized last month? I saw several independent write-ups in newspapers all repeating the canard of "this will work if only we have better LED technology" when an elementary calculation shows that even with 100% efficient lighting elements the lamp will need to weigh about a ton.

  6. That's Not Kuhn by logicnazi · · Score: 4, Informative

    Kuhn is very very explicit about the normal state of science being the evolutionary expansion of the paradigm/work within the paradigm. It's only when the extremely rare paradigm shift occurs that there is an overturning of the established order. Even there Kuhn seems to think these shifts often occur because the strain on the previous paradigm grows too great to sustain, i.e., a wide variety of experiments taken together require such unsatisfying explanations that the paradigm is overthrown for a new one.

    I think it would be more appropriate to say that Kuhn is mostly rejecting the idea of science proceding via revolutions. The sort of view that preceded Kuhn was that science proceeds by formulating hypothesises which in turn are overthrown should they be contradicted by experiment. Thus Kuhn is actually arguing against the idea that science primarily progresses via the disproof of the prevailing view.

    In fact I think it's a fair interpretation to say that Kuhn does not even believe there is an objective fact of the matter of which paradigm is better. It's quite clear that Kuhn holds out evolutionary expansion of the paradigm to be the stereotypical example of progress in science.

    --

    If you liked this thought maybe you would find my blog nice too:

  7. Re:Science has always been biased by CheshireCatCO · · Score: 5, Insightful

    If you're a Phd who has spent your whole life researching and proving something then you're likely to opposed someone proving eactly the opposite. This is true to some extent, but it glosses over another even more important point: most newly proposed theories are wrong. (It's a lot like mutations in evolutionary biology.) Many of the theories are still-born, never making it past someone's blackboard before they're shot down, but quite a few get floated. Some get floated quite adamantly by their adherents. A few are better than the older models. After even a little while in science, you see the ratio and it's natural to want to stick to the tested theory until the new guy has been able to provide some strong evidence for itself.

    That's sort of the rub, though, isn't it? Only a few new theories which suplant the old model do so with a really compelling single test. We can think of a few of the exceptions: General Relativity and the 1919 eclipse, the Big Bang (which was already pretty widely accepted, but never mind) and the discovery of the CMB, the giant impact theory of the origin of the Moon and the numerical simulations of the 1980s, etc. But these *are* the exceptions. Most theories which will eventually take over do so by slow accumulation of evidence in their favor, not with any slam dunk. As a result, convincing scientists to abondon the older model is difficult and there's no magic cut-off where you can say, "Now the new theory is better than the old one." So are the scientists being bad at science? Sure, it's easy to spin the narrative that way, but I'd say no. They're at worst being conservative and not wanting to leap onto a new model until they see that it's really better.

    Anyone expecting unbiassed science to come out of that lot is just a misguided idealist. Now I feel like you're being insulting. Individual scientists are human, we have our flaws and our blind-spots. Some of us have real agendas and a few are even downright dishonest. But as a group, we're contradictory, curious, and anti-authority. As a result, science is pretty good at self-correcting. A single scientist can lie to himself or even lie to others. But that always gets caught eventually because someone starts asking questions and we collectively have no vested interest in covering up lies.

    (Any time you hear about scientists being involved in a massive conspiracy, like some anti-global warming fanatics will try to tell you, you can bet it's wrong. Any person who could prove evolution or GW conclusively incorrect would have just made a career and world-wide fame for herself.)
  8. Re:scientists aren't good at communicating by going_the_2Rpi_way · · Score: 4, Insightful

    I'm not so sure this is valid any more (and maybe it never was). Generations of scientist are trained to communicate from the earliest parts of their training -- believe it or not, lots of emphasis is placed on this. What scientists are not good at are sound-bites that fit nicely in on shows like Crossfire or Lou Dobbs where the 'we were attacked!' or 'we're losing jobs' or 'NAFTA!' 10 second catchphrases that feel awfully good but don't stand up to scrutiny generally prevail. But that's ok, science isn't meant to be good at that. It's meant to be able to say 'we're not sure', 'this is our best available knowledge' and, oh yeah, 'our previous best theory was wrong in several respects'. The public isn't good at listening to tempered, well-balanced arguments. And when 'luminous minds' DO speak up -- say, a bunch of nobel laureates put together a one page ad against economic folly (remember that one?) or Jared Diamond writes a book titled 'Collapse' -- who listens? And more importantly, who listens enough to suffer short term financial hardship because those minds tell them they'll lose more in the long run.

  9. Pity so few will see this. by Bo'Bob'O · · Score: 4, Insightful

    It's a pity so few will see this article. It reminds me of something I saw briefly on the discovery channel about discovering Atlantis or something. The point was brought up to the effect "We don't have a lot in the way of resources because the scientists are too afraid what we will find will shatter everything they believe." Now, I know that you can't take too much on TV seriously, even the so called educational channels, but this was downright absurd. Wouldn't any scientist with the slightest bit of passion about his work be -thrilled- to take part, or help a peer with work that would have that sort of impact? It's just sad to see the Discovery Channel airing these sorts of things that completly misrepresent what science is. It's not even the MythBusters sorts of shows that bother me, it's exactly these sort of underdog stories the author is talking about that I think does a huge amount of harm to the education of people watching. It's those sorts of shows that lead people so far astray on what science is that lets the "Intelligent Design" nonsense take
    root.

    Someone else summed it up much better, though:

    But the fact that some geniuses were laughed at does not imply that all who are laughed at are geniuses. They laughed at Columbus, they laughed at Fulton, they laughed at the Wright brothers. But they also laughed at Bozo the Clown.
        - Carl Sagan "

  10. Actually, there is way by Moraelin · · Score: 4, Insightful

    "Question is, is there another way to tell the stories that isn't so formulaic and that doesn't give such an incorrect impression?"

    Actually, there is a way: just stick to reporting, don't turn it into an entertaining story. We're talking science, FFS, not the Hero's Journey archetype. It's not about the everyman who discovers his calling and ends up single-handedly fighting the super-villain, it's about a more mundane process where basically they're all on the same side.

    But science is boring for most people. There's really two kinds of stories that you can make out of it, that anyone outside that profession will read. (And those inside that profession already have the relevant peer-reviewed journals instead.)

    A) It's a BREAKTHROUGH!!!

    B) The Hero's Journey in disguise. The lone maverick who slays the dragon. (Except sometimes the climactic confrontation hasn't happened yet, so you're left to infer it.)

    And unfortunately both end up used by the journos as ammo against the real science. TFA already thrashes B, so let's just say that bogus A is what PR carpet-bombs the media with.

    So other than banning science completely from the non-peer-reviewed media, I can't see how that's solvable.

    Or if you were merely asking if it's possible to make it entertaining without being a case of lone heroes versus tyrannical super-villains... well, maybe. But consider this: the current generation of storytellers can't even tell any story except the Hero's Journey. We could live without it very well until, IIRC, the 60's, but then all of a sudden everyone had to obey the monomyth to the letter. And if two movies are the same length, they have to have their first turning point in exactly the same minute.

    So incidentally for whole classes of movies, once you figured out who's protagonist, who's antagonist, etc, you can know in advance what will happen... and in exactly what minute of the movie.

    Unfortunately, ever since, that structure has been hammered into the heads of every single story teller or screenplay writer. There are course, workshops, and the knowledge that Hollywood will chuck your manuscript in the garbage bin if it doesn't fit the mold to the letter. Not many people still know how to write any other kinds of stories any more.

    --
    A polar bear is a cartesian bear after a coordinate transform.
  11. It's fake, everybody by Headcase88 · · Score: 4, Funny

    Not a single obvious spelling mistake.

    --
    "When the atomic bomb goes off there's devastation...but when the atomic bong goes off there's celebraaaaation!"
  12. Re:"experiment" with Global Warming? by 10101001+10101001 · · Score: 4, Informative

    Certain things, although treated as science, are not really open to an experiment...

    Certainly. It's very easy to think everything is covered under science. But, there are many things (mainly, philosophical questional) that some would try to group under science because they believe they can conjecture out an answer.

    And while disagreements over, say, some aspect of Cosmogony can be discussed in a friendly manner, issues like Global Warming tend to polarize people along their political persuasions...

    Perhaps you haven't heard of cosmology and WIMPs vs MACHOs? Seriously, though, people who tend to quickly polarize over Global Warming tend to do so because of the seemingly obvious ramifications of admitting whether Global Warming exists. In short, the issue has more to do with people unwilling, on both sides, to go over the evidence and accept the proof that's available and leave it at that. But, then it's the same issue that came up ages ago when discussing the racial relations (especially, any claimed superiority) of various ethnicities. And *that* issue is still unresolved because dogma can override common sense.

    Since academics' income depends greatly on the taxpayers' money, they tend to be Statist and/or rather Illiberal.

    Sorry to break it to you, but universities existed long before there were governments to fund them. And, they will continue to exist long after governments refuse to fund them. Academics, in general, are interested in their work above all else. Now, this may lead to dogma and pet theories without any evidence. But, that doesn't translate into trying to sustain a revenue stream (well, at least, it only does so in the sense of funding their research, not in padding the academic's pocketbook). And sure, there are academics who are in it for the money, just like there are charlatens in any field. But, there isn't any evidence (at least, none I'm aware of) to hint at some sort of inherent academic conspiracy, no matter how good such conjecturing looks good on paper.

    Hence the dominant "scientific" opinions about Global Warming predicting gloomy scenarios and demanding drastic actions mostly from "the rich" (citizens and nations), of course.

    Or, people with evidence they think will be helpful are trying to warn people of the potential risks of merrily continuing our current actions. Most, realizing they *don't* know the long-term consequences (at least for humanity) of what happens if we continue, urge those with the most power to effect change (citizens and through them, their nations) to effect change. Of course, they realize they can't do much (at least, not without advocating military force) to push "the poor" countries or dictatorships to do the right thing. So, the tend to focus on "the rich".

    Anybody disagreeing (or even questioning) is "anti-science" (even if burning at a stake is no longer practiced) even though no experiment could possibly be conducted on a planetary scale.

    We're already engaging in an experiment on a planetary scale (you know, burning all that oil, coal, etc). And it happens that people are constantly making predictions based on those fossil fuels burned and how that affects the global climate. And all those scientists with their measurements of ocean CO2 absorption, temperature stations, measurements of ice sheets, etc all provide the data to confirm or deny those predictions. The only real question, then, is if the people on either side are actually looking at the theories that repeatedly pass and the evidence collected (to verify that it does, in fact, not contradict the theory). And if one side, after seeing the evidence, dismisses it based upon their own beliefs without any proof, then they are being anti-science. But, that says nothing about Global Warming.

    Watch angry responses to this posting for more :-)

    I'll try to be more angry next time.

    --
    Eurohacker European paranoia, gun rights, and h
  13. You can blame that on the press too by Moraelin · · Score: 4, Insightful

    Well, ironically, a large part of that can be blamed on the press too. There's this whole bombardment of stories telling Joe Sixpack that science is a clique of self-appointed arse clowns. In no particular order:

    1. The lone researcher vs the evil establisment stories, like in TFA. Invariably the establishment is evil, you know. Well, these stories are just ammo then for the quacks, who are invariably all too eager to present themselves as that oppressed underdog.

    2. PR-sponsored and -wrote "breakthrough" stories, the sillier and more contradictory the better. "Chocolate is good for you! Cocoa beans have valuable enzymes!" (Yes, but they're no longer present in chocolate.) "Wine is even better!" "No it's not!" "Scientists prove: Beer is better than both!!!" Etc. If you can't distinguish those from real science, and Joe Sixpack can't, it looks like "science" is just a bunch of guys saying contradictory things and telling you one day that X is good, and the next that Y is bad. That what passes for bulletproof science one day, is disproved the next day, so you might as well ignore the whole clown posse.

    3. Probably the most damaging: the fucked-up idea of journalistic impartiality. See, the idea is that impartiality means presenting two conflicting views as equals, without taking sides. So if you run a story about, say, why vaccines are good, you have to also find a quack or two to go, "no they're not!!! They cause autism!!! They kill your immune system!!! Buy our 100% natural and hollistic snake oil instead!!!" And present the two as equal. It's not that one of them is bogus, it's that it's a "controversy", see. Taking sides and telling people which one is backed by solid evidence, well, that would violate that impartiality.

    This creates a false image of, well, everything being equal and equally unproved and dubious. Everything is a controversy. The Nobel prize winner in that corner of the ring is just about as likely to be right or wrong, as the quack with the fake diploma bought on the internet in the other corner. So you can take your own pick. If you want to believe the earth is flat, go ahead, even that is probably a controversy.

    --
    A polar bear is a cartesian bear after a coordinate transform.
  14. Can you cite these? by Anonymous Coward · · Score: 4, Interesting

    Can you cite these thousands of studies over one hundred of years? I am truly interested in them.

    1. Re:Can you cite these? by Geoffrey.landis · · Score: 5, Informative

      As a journalist myself, I, too, am most interested in seeing those thousands of studies, especially those dated more than 30 years in the past. I have done a lot of research (into extant literature) on climate change and never ran across any references to global warming that predated the 1990s. Well, turning to the bookshelf sitting immediately to the left of my desk, how about An Introduction to Atmospheric Radiation, Kuo-Nan Liou, Academic Press 1980. It's a relatively standard text about optical absorption and scattering processes in atmospheres. The greenhouse effect is brought up in chapter 4 (Infrared Radiation Transfer in the Atmosphere) and discussed further in chapter 8 (Radiation Climatology).

      Greenhouse-effect studies before the 1990s lacked the detailed numerical models that we have developed since the 1990s, since these depend on massive amounts of computer power, but the effect has been known for a long time, and it was definitely discussed before the 1990s.

      This isn't an exhaustive search of the literature-- this is the first book that I happen to have handy. If the very first atmospheric science book I put my hands on that predates the 1990s has the reference, yet you say you never ran across any references to greenhouse-effect induced global warming that predated the 1990s, this seems to be an indication that you are unfamiliar with the literature.

      --
      http://www.geoffreylandis.com
    2. Re:Can you cite these? by Anonymous Coward · · Score: 5, Informative

      TFG, I'm kinda suspecting you're trolling, but just in case...

      Climate Impact of Increasing Atmospheric Carbon Dioxide. J. Hansen, et. al., 1981.
      Carbon Dioxide and Climate: A Scientific Assessment. Charney, J.G., et al., 1979.
      A Terminal Mesozoic "Greenhouse": Lessons from the Past, Dewey M. McLean, 1978.
      Greenhouse effects due to man-made perturbations of trace gases. Wang, W. C., et al., 1976.
      The effects of doubling the CO2 concentration on the climate of a general circulation model, Manabe, S., and R.T. Wetherald, 1975.
      Climatic Change: Are We on the Brink of a Pronounced Global Warming?, Wallace S. Broecker, 1975.
      The concentration and isotopic abundances of carbon dioxide in rural and marine air, Keeling, C.D., 1961
      Carbon dioxide exchange between atmosphere and ocean and the question of an increase of atmospheric CO2 during the past decades. Revelle, R., and H.E. Suess, 1957.

      Or, going back a little further:

      Callendar, G.S., 1938: The artificial production of carbon dioxide and its influence on temperature. Q. J. R. Meteorol. Soc., 64, 223-237.

      Arrhenius, S., 1896: On the influence of carbonic acid in the air upon the temperature on the ground, Philos. Mag., 41, 237-276.

      The current IPCC report has a review of historical climate research, and is available at http://www.ipcc.ch/pdf/assessment-report/ar4/wg1/ar4-wg1-chapter1.pdf.

  15. great old column by ben goldacre by drfireman · · Score: 4, Informative

    Ben Goldacre, who writes a regular column on bad science for the Guardian on bad science wrote a great column about this once, in which he pointed out the obvious-in-retrospect: science journalists don't have science backgrounds. He regularly takes on both bad science and bad science reporting, and his blog/column is a lot of fun to read. Fun in a deeply disturbing way.

    The one startling regularity I have noticed across all science reporting is that the more I know about the subject area, the more misleading the article seems. It seems clear this pattern can't be completely limited to science reporting. I cut popular media a lot of slack in terms of glossing over details and simplifying for a popular audience. But the distortions I see are more often fundamentally misleading about the nature of the work and the details that are relevant to the story. Disturbingly, I'm still tempted to believe some of what I read in areas about which I know little. Even more disturbing, I find this mode of reporting seeping into the scientific articles I read and review. I guess this saves the reporters the trouble, but points out one of the many problems with science reporting done by people who have no ability to read science critically.

    The one time I was interviewed about my work, I had the sense the reporter already had a story outlined, based on a science-fiction-y reading of the press release, and was basically fishing for quotes to add meat to the story.

  16. Re:I expect the opposite.... by squiggleslash · · Score: 4, Informative

    Bollocks. "Global Cooling panic" is a myth, it's debunked virtually every time it's mentioned and yet it still keeps getting repeated as fact.

    --
    You are not alone. This is not normal. None of this is normal.