Slashdot Mirror
The Neuroscience of Screwing Up
resistant writes "As the evocative title from Wired magazine implies, Kevin Dunbar of the University of Toronto has taken an in-depth and fascinating look at scientific error, the scientists who cope with it, and sometimes transcend it to find new lines of inquiry. From the article: 'Dunbar came away from his in vivo studies with an unsettling insight: Science is a deeply frustrating pursuit. Although the researchers were mostly using established techniques, more than 50 percent of their data was unexpected. (In some labs, the figure exceeded 75 percent.) "The scientists had these elaborate theories about what was supposed to happen," Dunbar says. "But the results kept contradicting their theories. It wasn't uncommon for someone to spend a month on a project and then just discard all their data because the data didn't make sense."'"
"It wasn't uncommon for someone to spend a month on a project and then just discard all their data because the data didn't make sense."
That doesn't mean the data is wrong, it means the /hypothesis/ was wrong, if not the theory, and needs to be modified.
If they're really throwing out date just because it 'doesn't make sense', they're doing religion, not science.
If the data don't make sense according to your theory, you don't discard the data, you discard the theory and work out a new one that fits the facts as you've observed them. TFA says that Dunbar was watching postdocs doing research, and if so, they should have known better. Alas, too many people who call themselves scientists are more interested in proving their pet theory true than in finding out what's actually going on.
Good, inexpensive web hosting
If problems occur as you postulate elaborate hypothesis, then stop piling up the elaborate hypothesis! But be sure and still make available your existing (complex) hypothesis, methodology and unexpected data - preventing others from going down the same path with the same methodology is still highly valuable!
Let's say you're looking at a production and consumption cycle involving neurotransmitters and neuroreceptors of some sort, and the various channels of input and output involved. Your starting presumption you base your hypothesis on is that there is a buildup which triggers an electrical signal to stop consumption and clear the channel. The only evidence you can realistically gather for now is protein density at a certain output channel - but others have worked to ensure this is a reliable approach specifically under these circumstances.
So, you do the specific experiment, trigger the signal, but you get a wildly different result - the stop in consumption occurs, but the protein density does not change at all in the output channel. What actually happened is still unknown, only you haven't verified any correlation with your hypothesis. You still have valuable data, but no mechanism to verify under the circumstances. Either your methodology failed, or you misunderstood what was happening - and the world of knowledge is made larger by either... even if your paymasters won't get happy about the result.
Science is often like throwing pebbles in complete darkness - it takes a lot of stones and close listening to make out a mental picture of the scene - especially when there's a lot of noise already around. Everyone would love it if we could just flip the lights on - but we have yet to invent a light that can see into the inner workings of the functioning brain very well. Gotta keep throwing those pebbles for now.
Ryan Fenton
The dirty little secret is that the Y is not always unexpected, just too politically incorrect and dangerous to be released to the public.
So, when reality is racist, you change it?
Or when the results you get aren't acceptable to the people responsible for continued funding.
Years ago, I worked for months trying to reproduce the Polywater research,
http://en.wikipedia.org/wiki/Polywater
and eventually reported that I was unable to do so.
The department considered my work a failure (as in, I must have been incompetent) and did not publish my findings. When, years later, the publications reporting successful discovery/creation of Polywater were shown to be fraudulent, and my results were correct, I did not even receive an apology.
Throwing out results is unethical as well as irresponsible. Many discoveries have come from re-evaluating what appears to be "bad" data. It might not be possible to use it now, but it should be at least stored.
For instance, it has been reported that the "bit of "scruff" on her chart-recorder papers that tracked across the sky with the stars"[1] looked like bad data to Jocelyn Bell Burnell's supervisors. Today we call the phenomenon a pulsar.
[1] Wikipedia
Really? Or is it that you are SO politically correct that you cannot see truth.
I happen to have mod points and my on-the-fly ranking went from insightful to interesting to troll and back to interesting.
I've lived long enough to understand that each of the 6 billion people on this earth is different than every other. Some are remarkably good and some are remarkably bad. Most of us are just average in our own interesting ways.
But still, I do believe that genetic differences affect what we are and that genetic differences can be attributed to where our genes came from.
Those who choose to never risk offending anyone are perhaps the most intellectually dishonest among us.
Should I post this or should I mod YOU the troll?
in my experienced - I'm a physical chemist doing atomic resolution condensed phase computer modeling. It's so common that I am troubled when the first analysis gives the answer I expected. I likely spend more time looking for errors when the answer makes sense the first go through. Really.
46 & 2
Here's the problem. If you can't order every single human into one race or another, your model is flawed. If you're forced to resort to mixes of races, well, then you don't have any distinct race left.
Race concepts fall apart once actual taxonomic principles are applied to them. Your examples actually illustrate the problem quite nicely: not nearly all asians have problems with milk - specifically the Japanese the do. Indians (from the Indian subcontinent in Asia) do not. Blacks do not have a higher tendency for sickle-cell anemia, a certain group of people in Africa do. Blacks in the US do not have that trait.
How much does it suck to be so wrong? Your cognitive dissonance must be at a record high.
Those who can, do. Those who can't, sue.
Which is why people who claim scientists only care about the truth are wrong. You only cared about the truth and were fired. Plenty of other people would have been looking out for their job first, and made sure their results confirmed what the department expected.
That said- the great thing about science is that eventually the truth will be discovered despite the pressure for money/jobs. It may not happen in a lifetime, but as long as science continues, it will happen.