Slashdot Mirror


Seven Rules For Spotting Bogus Science

keynet writes "Robert L. Park is a professor of physics at the University of Maryland at College Park and the director of public information for the American Physical Society, wrote a list of warning signs to help federal judges detect scientific nonsense. (OK, so it hasn't worked and the Patent Office sure hasn't got a copy.) As he says, 'There is no scientific claim so preposterous that a scientist cannot be found to vouch for it'. What he doesn't say is that there are plenty more who will invest in it or base legislation on it."

12 of 591 comments (clear)

  1. Huh Wha? by IWannaBeAnAC · · Score: 5, Informative
    Can the submitter not even read English?

    As he says, 'There is no scientific claim so preposterous that a scientist cannot be found to vouch for it'. What he doesn't say is that there are plenty more who will invest in it or base legislation on it."

    From the article, the full paragraph of the quote is:

    There is, alas, no scientific claim so preposterous that a scientist cannot be found to vouch for it. And many such claims end up in a court of law after they have cost some gullible person or corporation a lot of money. How are juries to evaluate them?

    The very next sentence indicates that there are very many people who are willing to invest or base laws on bad science!

  2. Re:Ancient folk wisdom can still trump modern scie by happyDave · · Score: 4, Informative
    Incorrect. John Vane discovered how aspirin works in the 1970's. He was a British pharmacalogist who discovered that aspirin inhibits the body's production of prostaglandins. These substances are what your body uses to promote swelling. Aspirin stops the prostaglandins, which reduces the swelling, which reduces the pain, in some instances. Nice try, though. By the way, I'm sure more people will be able to be more specific about how it works.

    You're right about one thing though: it did take a long time.

  3. Re:Like evolution you mean? by Daniel+Dvorkin · · Score: 5, Informative
    You're a troll, but your points deserve to be addressed, because they're such common myths.

    The "Darwin == Evolution" meme is so thoroughly imprinted in most people's brains that many creationist types seem to use it as evidence that Darwin produced the idea ex nihilo, and what had been a God-fearing, Creation-believing world suddenly turned atheist, evolutionist, and immoral as a result, leading over the next couple of centuries to world wars, eugenics, the Holocaust, and Bill Clinton. In fact, evolution was a theory that itself evolved, and continues to do so to this day; that's pretty much how scientific theories work. Darwin was an important step -- a major internal node in the phylogenetic tree, one might say -- but he wasn't the be-all and end-all, and has numerous "ancestors" and "descendants" in the history of the theory.

    Darwin proposed his "Theory of evolution" in a book. The equivalent of TV as far as popular media at the time goes. Proponents of this claim that it is always being supressed by religious groups, and local government officials.
    He did publish it in a book -- after several of the leading scientists of the day, with years of urging, persuaded him to do so. He was reluctant to do so both because he didn't want to be accused of stealing other people's ideas (kind of a Newton/Leibniz thing, only without the monstrous egos involved) and because he was well of the theological shitstorm he was going to unleash. In modern terms, his work was thoroughly peer-reviewed before On the Origin of Species came out.

    Science is suppressed by ideological forces, governments and churches not least among them. What marks that crank is when he claims that this suppression is being done in secret. Real suppression -- from the Catholic church and Galileo to fundamentalist Protestantism and Darwin to Stalin and anyone whose science case doubt on Communist ideology -- tends to be very blatant.

    Fortunately, they have chosen a theory that can't be proved, and only has anecdotal evidence. Animals 1 000 000 years ago were different, so we must have evolution
    Evolutionary biology is an observational science, not (in most cases, microbiology and some botany excepted) an experimental one. Do you consider the existence of other stars besides the Sun to be "anecdotal evidence" because no one can create a star in a lab? And yet we have just as much observational evidence for evolution, and in fact more laboratory evidence.

    The only way this could possibly be true is for Darwin to propose a new law of nature!
    Darwin was not proposing a new law of nature; the idea of evolution had been around for decades. What he did was to take the hypothesizing of others in the field (e.g. Lamarck) and give it rigorous theoretical underpinnings, much as Einstein took the results of Maxwell's equations to their logical conclusion and explained contradictions in Newtonian mechanics that had bothered generations of physicists before him.
    --
    The correlation between ignorance of statistics and using "correlation is not causation" as an argument is close to 1.
  4. Re:reduced to one line by dracken · · Score: 5, Informative

    A more humorous aricle, the Carl Sagan's baloney detection kit can be found here. It basically tells the same stuff, in a lot more humorous way. Also checkout the section where he points out subtle flaws in arguments that everybody uses (and falls for).

  5. Rules for judges by guacamolefoo · · Score: 4, Informative

    Judges and attorneys are quite cognizant of "junk science" in the courtroom. Keep in mind that there is (usually) an attorney on each side of a case. There is also a judge that doesn't want to look like a fool. To this end there is what is called the Daubert test for determining whether testimony of an expert witness is admissible in court. This, in a nutshell, looks essentially to whether the proposed expert testimony or opinion is based on good science.

    Five criteria are used:
    1. Is the expert qualified?
    2. Is the expert's opinion supported by scientific reasoning and methodology?
    3. Is the expert's opinion supported by reliable data?
    4. Does the expert's opinion fit the facts of the case (relevance)?
    5. Does the expert opinion qualify under general evidentiary rules of Federal Rule of Evidence 403?

    Criterion 2, above, relies on determinations as to whether a scientific theory can or has been tested; what the error rates are; whether a theory has been subjected to peer review and publication (these are not dispositive, but they are certainly considered by the court and if they are missing, hackles are raised); whether a theory is generally accepted in the scientific community or whether it i ssubject to debate still; and whether the details of the case "fit" the theory.

    A "Daubert" hearing is usually convened if any of the above are in question, and the judge rules on whether expert testimony should be permitted. The experts C.V. and the materials he relies upon in the case, as well as his expert report (prepared prior to trial) are all discoverable, so there are no surprises either at the Daubert hearing or at trial.

    If a case has enough at stake to require an expert to testify, generally there will be a competing expert. This gives you a dueling experts scenario (cue the music from "Deliverance") where bought and paid for experts contradict each other, in whole or in part.

    The primary issue usually then becomes credibility which unfortunately usually is not based on scientific validity, but is instead based on more subjective criteria. Qualifications also come into play -- the guy from Harvard usually beats the guy from Podunk State all else being equal. Fair? Not really, but it is reality.

    The problem with legal disputes and science is that you cannot set up special courts for every case in which science is a key issue. It would fracture jurisdiction even further. Besides, specialization doesn't really help because every case involves different science.

    There is no way a tribunal can be all-knowing. For some limited types of cases that recur frequently, there may be some benefit to setting up specialized courts. Unfortunately, after you get past the trial, at some point it is impossible to set up specialized appellate courts to hear appeals. Laymen will be involved in the process at some point.

    GF.

  6. Reduced to one book by Epeeist · · Score: 4, Informative
    A better set of rules is in Carl Sagan's book "The Demon Haunted World".

    Karl Popper has a hard nosed approach
    1. Is it testable (at least in principle)?
    2. Is it falsifiable?

    If either of these don't apply then it isn't science.
  7. Religion != Science by prof_bart · · Score: 5, Informative
    Young earthism and Intelligent Design need to be differentiated.

    Young Earthism attempts to make scientific statements, and fails the tests of observation. (ie, attempts to describe the history of the Universe, and is quite falsifiable). So Young Earthism is bad science, **not religion**.

    Intelligent Design says that a Designer is behind the behavior of the universe, but makes no scientific statements, and can not be falsified observationally, so it is not science: it is Religion, **not science**. For the beliver in Intelligent Design, scientific observations about the behavior and history of the Universe tell about God's nature (since, by presumption, God exists). For the non-beliver, they do not (since, by presumption, there is no God). But science can make no (firm) statement about which is true.

    Religious descisions (for both the believer and the non-believer) are descisions of faith and experience. No amount of science will (or can) ever change this.

    1. Re:Religion != Science by kris_lang · · Score: 4, Informative
      Exactly. ID proponents, a Mr. Johnson (a lawyer), and Michael Behe (a biochemist, author of Darwin's Black Box) try to use scientific precepts to bolster creationist ideas and to denigrate Darwin's theory of evolution.

      The basic concept behind irreducible complexity is an attack on Richard Dawkins' ideas in The Blind Watchmaker. Dawkins compares evolution to a blind watchmaker who puts together or creates a watch from a jumble of parts without knowing what they are. Behe presents certain systems (the visual system and the hemocoagulation cascade) and shows how there are interlocking and interdependent components within them. The eye needs both the lens and cornea and the retina. A retina without a lens and cornea does not get a focused image. A lens and cornea without a retina will focus an image, but there will be nothing there to receive it. Behe thus postulates that this is a chicken and egg problem: neither could have come first and neither has any reason to evolve without the simultaneous co-evolution of the other, thus he states that the only possible solution is that there must be a designer, an intelligent designer who created this interlocking system. Behe also presents the interlocking biochemical cascade of clotting factors in a similar argument. He is wrong.

      The examination of multiple species shows multiple conserved elements of the visual system: certain cratures have different types of lenses, others have no lenses at all and only have eyecups with physical depressions that concentrate reflected light. Starfish and molluscs have different types of photoreceptors, and plants and single celled organisms have simple photoreceptors that are very similar to the G-protein opsins that we humans have and which serve a similar function: to transduce light into a biochemical signal.

      Behe's arguments are testable and are becoming less relevent as more people become aware of them and of the arguments against them.

  8. Galileo by Johnny+Mnemonic · · Score: 4, Informative


    I'm not a scientfic historian, but couldn't points "2. The discoverer says that a powerful establishment is trying to suppress his or her work." and "7. The discoverer must propose new laws of nature to explain an observation" be used to discredit a scientist on the order of Galileo? Or, for that matter, couldn't 7 and "6. The discoverer has worked in isolation" be used against Einstein? I am sure to be corrected if wrong, but I always kinda thought Einstein worked pretty much in isolation.

    So these aren't a litmus test--just a leaning.

    --

    --
    $tar -xvf .sig.tar
  9. Re:Typical Slashdot by abigor · · Score: 4, Informative

    OK, you seem to be a little confused. What gets dated are the layers of deposition ON TOP of your cat, not the dirt under it. Geological deposition happens in layers of strata; go to the seaside and look at an eroded-out bank. You can see layers of clay, ash, sand, perhaps midden from some ancient group, and so forth.

    Agreed, dating by strata is a bit uncertain at times - in the absence of any other evidence, all you can really say is "this is older than that, because this is underneath that." But the presence of dateable bits in the strata itself, or of well-known events (a layer of ash may correspond to some well-known volcanic eruption, for example) allows scientists to more accurately assign an absolute date range to the item at hand (your cat).

    Read a first-year archeology textbook for more information, and then come to your own conclusion.

  10. Scientific Scrutiny by Angram · · Score: 4, Informative

    But science can make no (firm) statement about which is true.

    Not quite. One of the most important parts of any theory is parsimony. Creationism violates this, and therefore science can discount it.

    It boils down to a simple hypothetical conversation.

    Creationist: Where did the universe come from?
    Scientist: I can't say for certain.
    Creationist: God created the universe.
    Scientist: Where did God come from?
    Creationist: I can't say for certain.

    Basically, you add to the equation, but don't get any answers. The question of 'Where did X come from?' is posed, and saying 'X=Y' is unneccessary and unparsimonious. You can't bring 'Y' into the equation unless it will bring you closer to an answer. Creationists do so, with the claim that science cannot discount it, but science can, and does, say it is incorrect. True, science can't change your 'beliefs', but you can believe 2+2=5, but there's no reason for that to be taken seriously.

    Creationism isn't outside the realm of science, but claiming it is is the only way to keep it around.

    --

    GL
  11. Re:Typical Slashdot by abigor · · Score: 4, Informative

    No, you're still not getting it - the layers on top of your cat are known to be younger than the cat. Now, if the layer was formed by some known event - say, ash from Krakatoa - then we know the cat is older than that, but younger than the previous event. If there is biological material embedded in the sediment, then that is dateable. And so forth. PLEASE read an introductory text on sediment dating; very interesting stuff. And, to counter your arguements about what "evolutionists" (scientists) ignore, keep in mind that dating is a scientific process that uses techniques drawn from physics, biology and chemistry - "evolutionists", then, are scientists trained in these disciplines.

    Finally, we have excellent ideas about sediment deposition - there is an entire science dedicated to dirt and its formation. Just because you don't understand it, or it doesn't make sense to you/your church/your belief system, doesn't mean it's not a well-understood process. Please do some reading.