Princeton ESP Lab to Close
Nico M writes " The New York Times reports on the imminent closure of one of the most controversial research units at an ivy league School. The Princeton Engineering Anomalies Research laboratory is due to close, but not because of pressure from the outside. Lab founder Robert G. Jahn has declared, in the article, that they've essentially collected all the data they're going to. The laboratory has conducted studies on extrasensory perception and telekinesis from its cramped quarters in the basement of the university's engineering building since 1979. Its equipment is aging, its finances dwindling. Jahn points the finger at detractors as well: 'If people don't believe us after all the results we've produced, then they never will.'"
The methodology wasn't flawed, so much as the analysis and the conclusions drawn from it.
A PEAR experiment involved a participant attempting to influence a random number generator (essentially) in a pre-specified direction over a large number of trials. Because random events are, by nature, random, you can get streaks that are above or below the mean. If you analyze a large enough sample, these streaks can become statistically significant, even though they're essentially meaningless and practically insignificant -- it's similar to the fact that any deviation from the mean, no matter how small, is statistically significant if you measure the entire population. Additionally, while the probability of any particular streak is low (.5^n is the probability of any number of heads flipped in a row, which gets very small when you talk about enough of them), if you have enough random events, those streaks are pretty much guaranteed to appear.
So, that's the logic of the PEAR data analysis. Collect a huge corpus of random events, look for streaks, then call them statistically significant because of their low base probability of appearance and the fact that they deviated at all from the expected mean. Skeptic magazine has a good discussion of the PEAR lab inanity, and I believe James Randi's commentary addresses it a few times.
The claim that PEAR's research wouldn't be reviewed is probably false, by the way. It's most likely that the papers were rejected from mainstream journals for the very reasons I mentioned earlier, or because the PEAR lab had no theoretical explanation for the "results" they observed. Or, of course, it's because their papers seem rather dubious in their lack of data and explanations of how they've arrived at their stated probability values (which I say from having the experience of reading one in a, how shall we say, less than top tier journal). Additionally, the lab's been extremely difficult with regards to their raw data. Randi, for example, has never been able to get ahold of it.
The Freelance Wizard