Slashdot Mirror
Jimmy Wales To 'Holistic Healers': Prove Your Claims the Old-Fashioned Way
Barence (1228440) writes with this excerpt from PC Pro: "Wikipedia founder Jimmy Wales has issued a sharp response to petitioners calling for his site to "allow for true scientific discourse" on holistic healing. The petition, currently running on the Change.org site, claims that much of the information on Wikipedia relating to holistic approaches to healing is "biased, misleading, out of date, or just plain wrong". It has attracted almost 8,000 supporters at the time of publication. Wales's response to the petition, posted on the same page, is far from conciliatory: 'No, you have to be kidding me,' he writes. 'Every single person who signed this petition needs to go back to check their premises and think harder about what it means to be honest, factual, truthful. What we won't do is pretend that the work of lunatic charlatans is the equivalent of 'true scientific discourse'. It isn't.'"
Once it's been proven to work?
Medicine.
Meh. That's not really true. There's a reason there's an entire field called evidence-based medicine, which from its very name makes it distinct from just plain-old normal "medicine."
There's plenty of hokum peddled by physicians, too. Lots of clinical decisions are based on "gut feelings" and tradition. And let's not even get into the multitude of embarrassing medical debates where various new drugs or foods or practices were widely accepted and then shown to be even more harmful than the things they replaced (which were originally thought to be harmful or unhealthy).
Spend some time sifting through all of the research on some medical topic at some point, and it quickly becomes clear that lots of medical conclusions are based on studies with serious flaws (either methodological or statistical), which is why you end up getting the "X is bad for you! Don't do/eat/use X!" one year and "X is good for you! Do it all the time!" the next year crap.
Don't get me wrong -- medical research is hard. Human bodies are very complex systems. And the kind of blind randomized studies necessary to evaluate medical practices (particularly "accepted" practices, which are assumed to already work) are often (1) expensive, (2) potentially unethical, since they might involve denying someone treatment that is assumed to be necessary for good health and/or exposing people to dangerous practices, (3) really difficult to control for all potential variables. And even if you managed to construct some sort of artificial laboratory situation where you could really isolate a variable, it may have questionable real-world applicability once the subjects head back out into the messiness of real life.
It doesn't mean we should throw up our hands and give up, but there is significant room for improvement in everyday "medicine," based on things that are ACTUALLY proven to work, hence "evidence-based" medicine.
NO they were NOT using scientific methods. Not at all.
What they used was called "Observational bias" with no null hypothesis, and no trials, nothing blinded, no taking the placebo effect into account.
The VAST MAJORITY of what they did, did nothing, A few times they got lucky.
The Kruger Dunning explains most post on
For example, I believe its generally accepted that acupuncture [nih.gov] does something, we're just not sure how and what.
The problem with acupuncture studies is that they can't be done double-blinded: that is, the acupuncturist always knows whether he is doing "real" acupuncture or "sham" acupuncture*. This then leads to a bias effect, in which the patient is unconsciously cued as to whether or not the treatment "should" work, and expectation effects are stronger than any purported acupuncture benefits (e.g., Bausell et al 2005, Eval Health Prof). I remember a study, which I cannot dig up at the moment, in which the researchers gave acting lessons to the acupuncturist to ensure that they behaved in exactly the same way with respect to the patients between real and sham treatments, and when they did so acupuncture did not outdo the placebo.
* You can, in theory, do double-blinded by randomly assigning patients to one of two technicians, both of which were naive to acupuncture treatment before the study's beginning. They are then trained equally on two different sets of acupuncture points, one valid and one invalid, with no knowledge of which one of them is which. However, objectively this isn't really a fair test of acupuncture: consider the case where you tried to tackle the effectiveness of heart surgery using the same model.