Slashdot Mirror


How a Scientist Fooled Millions With Bizarre Chocolate Diet Claims

__roo writes: Did you know chocolate helps you lose weight? You can read all about this great news for chocoholics in the Daily Star, Daily Express, Irish Examiner, and TV shows in Texas and Australia, and even the front page of Bild, Europe's largest daily newspaper. The problem is that it's not true. A researcher who previously worked with Science to do a sting operation on fee-charging open access journals ran a real—but obviously flawed—study rigged to generate false positives, paid €600 to get it published in a fee-charging open access journal, set up a website for a fake institute, and issued press releases to feed the ever-hungry pool of nutrition journalists. The doctor who ran the trial had the idea to use chocolate, because it's a favorite of the "whole food" fanatics. "Bitter chocolate tastes bad, therefore it must be good for you. It's like a religion."

44 of 260 comments (clear)

  1. Heh. by Aaron_Pike · · Score: 4, Funny

    Schadenfreude is the best freude.

    1. Re:Heh. by Penguinisto · · Score: 5, Insightful

      True, though it sadly proves P.T. Barnum's maxim, and says more about a gullible public, the lack of peer review in the field of nutrition (and worse, the sheer incompetence of so-called 'nutrition journalists' and 'specialists'), than it does about a science journal's shady/sloppy practices.

      Long story short, it exposes a hell of a lot more than just what the scientist initially wanted exposed.

      Maybe someone could do and publish a sociology study from it?
      (/me ducks and runs like hell...)

      --
      Quo usque tandem abutere, Nimbus, patientia nostra?
    2. Re:Heh. by Opportunist · · Score: 4, Insightful

      Mostly it exposes that people love to believe stories they like. And of course journalists love to publish stories that their readers like.

      I just don't think that qualifies as news, though.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    3. Re:Heh. by michelcolman · · Score: 5, Insightful

      The big problem is that everyone will now remember the fake study and continue to believe it, because the rectification doesn't get nearly as much coverage. People are still refusing to vaccinate children because they're afraid of autism even though the author of that study actually confessed having made the whole thing up.

    4. Re: Heh. by Anonymous Coward · · Score: 2, Insightful

      It's not that they aren't aware that the author confessed, it's that they love to hear about "secrets that 'they' don't want you to know about" because there's a giant global conspiracy by this 'they' to keep poor people poor and make people sick for profit.

      I don't personally know an anti vaxer, but I'd wager that most of them who heard about the author confessing to a fraud believe that he was coerced by 'they' to admit it, and it really does cause autism after all.

      It's really the same reason why Greenpeace thinks Patrick Moore was bribed by big oil just because he fell out of line with their radical views. Or why anybody who says that GMO food isn't actually bad and is indeed a good thing gets accused of shilling for Monsanto, even though they have nothing to do with Monsanto or the food industry.

    5. Re:Heh. by Jawnn · · Score: 2

      Mostly it exposes that people love to believe stories they like. And of course journalists love to publish stories that their readers like.

      I just don't think that qualifies as news, though.

      Perhaps not news, but as a topic worthy of consideration and discussion, you bet. Consider Fox News. It's veracity and accuracy are so poor that almost an entire industry has been built up around calling "bullshit" on so many of their "facts", and yet millions of viewers rely on it to help build their world-view every day. Those ratings wouldn't be there without Fox's heavy emphasis on "stories that people love to believe". Frankly, I find such phenomena fascinating, and often more than a little troubling. Before the chocolate hoax was the whole anti-vaxer phenomenon. To this day, otherwise reasonable people cling to the notion that routine childhood vaccinations are a bad idea, despite overwhelming credible evidence to the contrary and the plain fact that the notion itself was spawned by miscreant for personal gain. Why do they choose to believe bullshit in the face of plainly evident truth? What should we do about it? Can we do anything about it? Should we? It's excellent grist for the discussion mill, IMO.

    6. Re:Heh. by Curunir_wolf · · Score: 2, Informative

      People are still refusing to vaccinate children because they're afraid of autism even though the author of that study actually confessed having made the whole thing up.

      Ummm... no, he didn't. There were a couple of issues with the study, the primary one being that a temporal association between the administration of the vaccine and the onset of autistic enterocolitis should never have implied causality. The study was important because it identified the colon symptoms present in a subset of patients with ASD as a distinct disorder. But it was misinterpreted in the press, especially for a study where the primary findings involved only 12 patients.

      The main author never signed on to the minor retraction. There was nothing close to a confession of "making the whole thing up", but some (questionable) researchers from other institutions have made that accusation.

      --
      "Somebody has to do something. It's just incredibly pathetic it has to be us."
      --- Jerry Garcia
    7. Re:Heh. by RespekMyAthorati · · Score: 3, Insightful

      Andrew Wakefield was deliberately fraudulent, and that is why the paper was retracted and his medical license revoked.

  2. chocolate helped me lose weight by turkeydance · · Score: 4, Informative

    i just don't eat it.

  3. This was done by a journalist, not a scientist! by metageek · · Score: 3, Insightful

    The OP is wrong on this, the guy is a JOURNALIST not a scientist. (He may have a science degree but he acts as a journalist).

    If a scientist had done this they would be losing their job any minute. Any of the following would be enough to disgrace a practicing scientist (I am one):

    1- carrying out research on human subjects without approval of the study by an independent review board
    2- asking people to undergo a study that he knew before hand that was not beneficial to the subjects, in fact could likely be the opposite (this would mean he'd never get approval of the study)
    3- lying to people about his affiliation and credentials in the paper

    There are a lot of other problems with this "study", but it surely was not done by a scientist.

    What it does reveal is that people cannot rely on popular press stories about science as journalist pay no attention to the important details of publications and fall for any hype. Unlike what the guy says, journalist can never be "peer" reviewers of any science... their role is different and yet they are not doing it properly.

    --
    metageek
    1. Re:This was done by a journalist, not a scientist! by Anonymous Coward · · Score: 5, Insightful

      0) Oh, he's not a scientist? He's doing fucking SCIENCE here. He had a hypothesis, conducted an experiment, published the fucking result. He created new information about the state of scientific journalism. But maybe you're confusing academics with science.

      1) Get real. There was no potential for harm. Your "review board" requirement raises the bar high enough to render unethical every science fair project ever done.

      2) Exactly like, for example, every control group, ever?

      3) That was the basis. Of. The. Study.

    2. Re:This was done by a journalist, not a scientist! by captnjohnny1618 · · Score: 4, Insightful

      I think you misread the post (and/or the article).

      Yes, the author of the story is a science journalist. The "study" was intentionally bad to demonstrate the current sad state of "science journalism" (with an easy target like nutrition) where few of these journalists actually take the time to actually read the article, much less actually fact check on a critical, challenging or even marginally scientific level.

      So your final conclusion is exactly what he wanted to show: you can't blindly trust popsci journalism... but your methods for arriving there are a little roundabout.

    3. Re:This was done by a journalist, not a scientist! by captnjohnny1618 · · Score: 2

      Although, I see now that the original TITLE of the summary has been significantly change by "timothy" the editor to be a bullshitty clickbaity title that doesn't accurately represent the stories linked to. The summary is ok though, but still a little unclear. So it's easy to see where the confusion arises...

      I'm just going to start reading everything in the firehouse before timothy gets his sticky little fingers on it.

    4. Re:This was done by a journalist, not a scientist! by Headw1nd · · Score: 2

      Not all scientists work for universities, you know. Also a pet peeve, "Scientist" with a capital S is not a thing, stop treating it as though it were. Scientists are not paladins, there is no gold standard of purity for scientists, no science deity will strip them of their powers if they don't follow some moral code. There are thousands of amoral scientists out there right now doing far worse things, mostly at the behest of governments and corporations.

    5. Re:This was done by a journalist, not a scientist! by AthanasiusKircher · · Score: 4, Insightful

      You're absolutely correct that this story is mostly about how we should distrust science journalism, and the author of the "study" makes that clear.

      However...

      If a scientist had done this they would be losing their job any minute. Any of the following would be enough to disgrace a practicing scientist (I am one):

      Yes, all of that is true. But I think you're exaggerating quite a bit about the impact any of this would have had on whether a study like this could have been done by a reputable scientist (it certainly could have been), or whether it would have been published if that scientist had appropriate credentials (as noted in the article, there are plenty of places to publish bad research with little vetting).

      2- asking people to undergo a study that he knew before hand that was not beneficial to the subjects, in fact could likely be the opposite (this would mean he'd never get approval of the study)

      The details of methodology in this study might have been changed a bit to get it approved by a review board, and there's certainly nothing about the basic idea of this study that suggests it would NECESSARILY (or even likely) have significant detrimental effects for the subjects. And there is certainly at least a possibility of beneficial effects.

      I suggest you have a look at some of the research articles linked even in an article of Wikipedia on the subject. There have been dozens, and probably hundreds of studies that have tried to measure health effects of chocolate -- many of them have involved people eating small amounts of chocolate and observing effects, just as the study here did.

      So, the idea that an actual scientist, with the appropriate amount of time, could "never get approval of the study" is just ridiculous. As I said, there would probably be some more detailed methodological justification and tweaks, but lots of nutrition studies like this happen all the time.

      Unlike what the guy says, journalist can never be "peer" reviewers of any science... their role is different and yet they are not doing it properly.

      Yes, journalists have their own jobs to do, and there are certainly flaws in the system.

      But there are flaws in the science system too, which makes the job of journalists (and scientists trying to look at research out there and evaluate it) much harder. "P hacking" is not just something made up by this journalist -- it's a real thing, and it's a real problem. Yes, many reputable journals have tried to make review procedures better to avoid various statistical problems, but they often don't really fight them head-on (with a few notable exceptions of brave editors or boards). There are a LOT of problems with common statistical procedures followed by researchers -- even those who have proper credentials and have gotten independent reviews.

      Anyhow, most of your criticism boils down to "this guy wasn't credentialed to do what he did." That's great, but it doesn't address the larger flaws here -- not only in journalistic reporting, but in some aspects of scientific methodology. This study was clearly not rigorous, but I've seen worse studies published in reputable journals.

    6. Re:This was done by a journalist, not a scientist! by Anonymous Coward · · Score: 3, Funny


      Scientist: Lawful Neutral
      HD d4
        BaB Fort Ref Will Special 0 1st
      1st +0 +0 +0 +2 "Summon Assistant, Scribe Scroll" 3 1
      Incurs casting penaly when not wearing white robe
      If a Scientist fails its alignment check, it loses all special abilities.

    7. Re:This was done by a journalist, not a scientist! by taustin · · Score: 3, Insightful

      If a scientist had done this they would be losing their job any minute.

      Given that we're talking about the "nutrition" industry, if a scientist had done this, it would likely be his job. Specifically.

      That's the point.

    8. Re:This was done by a journalist, not a scientist! by narcc · · Score: 4, Insightful

      It wasn't a study, it was a publicity stunt.

  4. Bitter chocolate tastes bad? by HornWumpus · · Score: 2, Insightful

    WTF?

    Go eat your milk chocolate, fools. I'll take the 80% Madagascar coco bad bitter stuff, you can have the Cadbury/Hershies.

    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    1. Re:Bitter chocolate tastes bad? by ArchieBunker · · Score: 3, Insightful

      You guys are already ruining craft beer by flooding it with cheap IPA and ever increasing levels or bitter. Its not a pissing contest to see who can stand the most bitter chocolate or beer.

      --
      Only the State obtains its revenue by coercion. - Murray Rothbard
  5. Re:Scientists are generally trusted by CraigGlaser · · Score: 5, Insightful

    Anyone who trusts scientists has no idea how science works. You don't trust the person or title, you trust the chain of independent verification of the data. This is a critical thinking issue.

  6. Re:Scientists are generally trusted by Anonymous Coward · · Score: 3, Insightful

    I disagree.

    Scientists are widely distrusted.

    Except when they tell us what we want to hear.

  7. Re:Because I did not read the original article... by Ignacio · · Score: 4, Informative

    It was never science in the first place. He used known flaws in experimentation to prove that you can make the mainstream publish anything. Which was the point he was trying to make.

  8. This works 100% by bogaboga · · Score: 4, Insightful

    Forget all those so called diet plans.. The only thing I know that works is actually eating less. Many of my friends will not agree, but I wonder how one can gain weight by putting less calories in their system.

    1. Re:This works 100% by Opportunist · · Score: 2

      By your body going into starvation mode. C'mon, it's not that hard to look up how to lose weight sensibly, it's all over the web. Some of those tips are even good. Hint: It's the ones that don't want to sell you their miracle cure crap.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    2. Re:This works 100% by random+coward · · Score: 2

      There is a decided link to promoting eating more sugar and starch and the US population turning fat.

      But, but, but The Government told us to eat more starches! So did all the Registered Dietitians! And Michelle Obama! I mean just look at the food pyramid. How could they all be wrong? It would have to be some kind of conspiracy for all the authorities to be so wrong on this.

      Are you some kind of conspiracy theorist?

  9. Required reading: xkcd's "Significance" by dwheeler · · Score: 5, Informative
    --
    - David A. Wheeler (see my Secure Programming HOWTO)
  10. Re:Scientists are generally trusted by Penguinisto · · Score: 4, Insightful

    Here's the trick: You and I know this, but the average schlub out there does not.

    That distinction is kinda vital, and it's what I think GP was driving at.

    --
    Quo usque tandem abutere, Nimbus, patientia nostra?
  11. Re:Scientists are generally trusted by Anonymous Coward · · Score: 5, Insightful

    More to the point, it's impossible to independently (& personally) verify the data and claims of everything that you would like verified. There's not enough time in the world.

  12. Re:Could also work to get press for good science by Chris+Mattern · · Score: 2

    Because they also carefully pre-selected a result that would generate a desire in journalists to carry the story. Real science doesn't get to do that.

  13. Re:Scientists are generally trusted by ShanghaiBill · · Score: 3, Insightful

    Here's the trick: You and I know this, but the average schlub out there does not.

    Science journalists should be better than "average schlubs". They owe it to their readers to do at least a few minutes of fact checking before publishing.

  14. I trust Dr. Oz by Anonymous Coward · · Score: 2, Informative

    I trust Dr. Oz. He told me about this new miracle chocolate infused coffee bean oil that I could rub on my butt hole to make me loose weight. It's exclusively sold on his website and it really works. I mean, Dr. Oz wouldn't lie me, he's a Dr!

  15. Re:Logic by tomhath · · Score: 3, Insightful

    For most people, a diet of bitter chocolate covered broccoli would probably result in a weight loss. You read it here first.

  16. Seriously, BILD? by nospam007 · · Score: 3, Insightful

    "and even the front page of Bild, Europe's largest daily newspaper. "

    That's the yellowest yellow rag existing. If it's in there, it must be wrong.

  17. Re:This could never happen with global warming... by Holi · · Score: 2, Insightful

    Peer review hasn't killed AGW so whats your problem with it? Of the scientists who have expressed an opinion on AGW 97.2% endorse the consensus. only .7% reject it.

    Now I understand science is not a popularity contest, but what are your credentials compared to theirs? If you are not willing to accept peer reviewed science then why the hell are you bothering to post here.

    --
    Sorry, teleporters just kill you and then make a copy. A perfect, soul-less copy.
  18. best submission contest by steak · · Score: 3, Funny

    _roo wins best pun category with "and issued press releases to feed the ever-hungry pool of nutrition journalists."

  19. not true? by NostalgiaForInfinity · · Score: 2

    The problem is that it's not true.

    The fact that the study purporting for the hypothesis to be true was fake doesn't mean it's "not true", it means that we don't know whether it's true. In fact, the reason so many people believed it is that it's pretty plausible, at least if you stick to dark chocolate with little sugar content.

    People frequently make the same error even for valid scientific studies: "study X failed to show a difference between A and B" is not the same as "study X showed that there is no difference between A and B".

  20. Straw man arguments? by ChromaticDragon · · Score: 2

    This is a very strange article.

    I'm happy if folk are drawing attention to issues of statistics, flawed studies or ways one can inappropriately draw conclusions from relatively small data sets. Reminds me of the old adage "Figures don't lie... but liars do figure".

    But this seems to trivialize (or outright ignore) the actual purported benefits of cocoa. Why in the WORLD would it be acceptable to suggest "whole food" folk are fascinated with dark/bitter chocolate because of the weird idea that "since it tastes bad, it must be good for you". Is it really that hard to dig into the research, propaganda, whatever, in order to find out WHY folk are suggesting cocoa is good for you? Here's a clue. The dark/bitter chocolate is suggested not because it tastes bad (which is, of course an opinion - I like it dark) but because you have half-a-prayer of having more genuine cacao in such.

    Next, I must confess I was ignorant of any study or claim that eating chocolate would help one lose weight. Even if I heard of it, I almost certainly would have simply immediately discounted it because of a number of factors. It's just one study. Let peer review deal with it. It also smells too much like other factors predominate. You're on a low-carb, calorie controlled diet? If you ADHERE to those two requirements, you can probably eat whatever you want and lose weight. Caloric balance/control is within an order of magnitude all that matters.

    So, I may have an unwarranted perspective here. But it seems strange to get all excited about folk trouncing a study or argument I never heard of, nor would have respected to begin with. In essence, it seems like they're setting up a straw man to knock down.

  21. Re:Scientists are generally trusted by praxis · · Score: 2

    Yes, but good journalists cost money and most people have stopped wanting to pay for journalism. That said, there are still some publications out there that have a healthy body of paid readership willing to find actual non-sensational journalism.

  22. Re:This could never happen with global warming... by phantomfive · · Score: 2

    Anyone who claims that there is consensus of 97%, as if that means something, doesn't understand what the consensus is.

    You are one of those people.

    --
    "First they came for the slanderers and i said nothing."
  23. Re:Scientists are generally trusted by HiThere · · Score: 2

    The problem here is thinking of trust as a binary choice rather than as a probability (float). Everybody, when they stop to think about it, realize that trust isn't all or nothing, but somewhere intermediate. But people often take shortcuts, and one easy shortcut is deciding trust as binary.

    So, no, you shouldn't blindly trust an authority, but neither should you blindly distrust them. Each case needs to be evaluated separately based on the evidence you have on hand, and then given a temporary weight...which is subject to being changed when more evidence arrives. Unfortunately, this is not a good model for convincing people that you are correct, because you don't have the emotionally driving certainty. But even though that certainty is a great tool for convincing people, it's quite dangerous. You should immediately doubt whenever you hear someone being certain. This is a matter of self-protection, it's not that they are always wrong, or always malicious, often they aren't. But their goals are quite likely to differ from yours. And certainty is driven not be evidence, but rather by emotions, which are almost always self-serving in either a narrow or in an extended sense. (OTOH, life isn't a zero sum game, so their being self-serving doesn't mean that they are necessarily detrimental to you, your purposes, or your goals.)

    --

    I think we've pushed this "anyone can grow up to be president" thing too far.
  24. Re:Scientists are generally trusted by lgw · · Score: 2, Insightful

    More to the point, it's impossible to independently (& personally) verify the data and claims of everything that you would like verified. There's not enough time in the world.

    Very true. The rational man realizes this, and doesn't hold strong political opinions on the rest of it. We're all going to be ignorant of most science in the modern world - the time has long passed when the educated man could know all of the scientific knowledge there was. It's important to therefore set arrogance aside, and not try to tell others they're idiots, or force your uneducated opinion on others by law, unless you actually care enough to do the diligence first.

    Far too many people mistake fashion for education. If you're going to call others fools for trying to stop the teaching of "evolution" in schools, call them fools because you took the time to understand the science, the counter-arguments, and why a smart, ration person could somehow not believe in evolution. Until you understand the other side, and why it's wrong, stay out of the argument. For the evolution case: if you had a solid biology class, this takes just a few days of reading the talk.origins site. It's not an undue burden, and otherwise arrogance about your uninformed opinion is just idiocy.

    For newer fields like the climate change debate, it will take longer to dig up the details, as there isn't a handy website that collects all the pro and con arguments. For climate change, can read through the pro and con sites and understand where they're coming from, understand the Vostok ice core data for perspective, spend time pondering the satellite temperature data, and so on.

    For any such issue, treat both sides as intelligent people who are in earnest in their beliefs and not trolling, and read enough to understand how this can be true. When you understand how intelligent people can disagree on the issue, and see where both sides are coming from, then you can act out of knowledge instead of arrogance, and stop polluting the debate with idiocy. If your only basis for argument is "everyone knows the smart people believe X, and the losers believe not-X", well, that's fashion, not knowledge. This pretty much applies to anything being debated politically, BTW, not just the science stuff.

    --
    Socialism: a lie told by totalitarians and believed by fools.
  25. Scalzi's Schadenfreude Pie by billstewart · · Score: 3, Interesting

    There's really only one thing to eat while reading a story like this (other than Moar Chocolate, for Research Purposes.) It's Scalzi's Schadenfreude Pie. Dark, bitter, sticky, chocolately.

    --

    Bill Stewart
    New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
  26. Re:Logic by TranquilVoid · · Score: 2

    Are you referring to processed chocolate or the growing of the beans? My impression was that Central/South America don't do much processing of chocolate, and that the U.S. doesn't grow cocoa. Beans are generally roasted, blended and processed in first-world countries.

    So you'd want to say;

    "The best beans come from Central and South America rather than Africa", or

    "The best chocolate comes from France, Switzerland and Belgium"

    Correct me if I'm wrong, but that's my understanding.