Crowdsourcing and Scientific Truth

ygslash writes "In an opinion piece in the New York Times Sunday Review, Jack Hitt states that comments posted to on-line articles, and elsewhere on line, have de facto become an important factor in what is accepted as scientific truth. From the article: 'Any article, journalistic or scientific, that sparks a debate typically winds up looking more like a good manuscript 700 years ago than a magazine piece only 10 years ago. The truth is that every decent article now aspires to become the wiki of its own headline.'"

Comments

Re:Science as a social construct

[ApharmdB]

Is the article author aware of how pervasive astroturfing is in the comments sections? Perhaps if the article is about a subject that no one has a financial or political interest in, comments sections could serve this way. But as soon as someone's got an interest to protect, you can't trust the comments to be anything other than posts made by paid people creating fake personas to do so. Slashdot has had articles about this type of astroturfing before.

Re:"Scientific truth" vs "Popular perception", Etc

[nashv]

Comments are comments. Comments are not journal articles. Comments can be said to be peer reviewed, to some extent, but then again, comments are not journal articles, comments need not follow any specific format for reporting of questions and results, comments are just comments.

I did not RTFA. I second your point. But even if we were to take a more generous view of commenting sections, the problem of noise filtering remains. Comment sections are a perfect example of what Asimov said best :

“Anti-intellectualism has been a constant thread winding its way through our political and cultural life, nurtured by the false notion that democracy means that 'my ignorance is just as good as your knowledge.'”

The amount of effort required to parse through comments to find gems of significant value is enormous. I know that this is that age of the crowd and so on, but there are certain issues on which the opinion of the crowd has on average very little value because of the complexity of the topic and the years of experience required to make informed conclusions. The trade-off between expert opinion and open crowdsourcing varies widely depending on what is the topic under discussion, and the userbase of the particular site. Vaccines and autism on a Californian site, for example.