Slashdot Mirror


The Role of Experts In Wikipedia

Hugh Pickens writes "Episteme, a magazine about the social dimensions of knowledge, has a special issue on the epistemology of mass collaboration, with many of the articles focusing on Wikipedia. One of the most interesting articles is by Lawrence M. Sanger on the special role of experts in the age of Wikipedia. Sanger says the main reason that Wikipedia's articles are as good as they are is that they are edited by knowledgeable people to whom deference is paid, although voluntarily, but that some articles suffer precisely because there are so many aggressive people who 'guard' articles and drive off others (PDF), including people more expert than they are. 'Without granting experts any authority to overrule such people, there is no reason to think that Wikipedia'a articles are on a vector toward continual improvement,' writes Sanger. Wikipedia's success cannot be explained by its radical egalitarianism or its rejection of expert involvement, but instead by its freedom, openness, and bottom-up management and there is no doubt that many experts would, if left to their own devices, dismantle the openness that drives the success of Wikipedia. 'But the failure to take seriously the suggestion of any role of experts can only be considered a failure of imagination,' writes Sanger. 'One need only ask what an open, bottom-up system with a role for expert decision-making would be like.' The rest of the articles on the epistemology of mass collaboration are available online, free for now." Sanger was one of the founders of Wikipedia, and of its failed predecessor Nupedia, who left the fold because of differences over the question of the proper role of experts. Sanger forked Wikipedia to found Citizendium, which we have discussed on several occasions. After 2-1/2 years, Citizendium has a few tenths of a percent as many articles as Wikipedia.

8 of 266 comments (clear)

  1. Not learning from failure... apparently by Anonymous Coward · · Score: 4, Interesting

    "Sanger was one of the founders of Wikipedia, and of its failed predecessor Nupedia"

    There is a reason why he failed; "Without granting experts any authority to overrule such people, there is no reason to think that Wikipedia'a articles are on a vector toward continual improvement," writes Sanger

    And all I have to say is ... so what? Articles at wikipedia frequently link to great off site expert resources. Not only that you have a wealth of choices of where you can get your information from, you're not limited to just wikipedia. If wikipedia was the only encyclopedia on earth his point might make sense. But given the level of alternatives and 'competitors' and number of wikipedia's contributors, there's a point where an article is more then good enough as a starting point.

    The difference between experts and amateurs
    in many instances is not large and for the most part negligible in many area's of knowledge, in other areas not so much.

    Not only that, experts frequently get things wrong, the idea that experts are monolithically better then amateurs and other experts also has serious problems. Given that there has always been contention about certain areas of knowledge, take history for example: How much important stuff is/was and is possibly currently being omitted from history by "experts" for any number of reasons that might bias their testimony?

    Wikipedia works because it has information people want. Experts frequently cull information they deem 'unworthy' of documenting, there's a whole host of articles on wikipedia about culture and entertainment stuff that would not normally be in a regular encyclopedia.

    Truth be told, Wikipedia is an excellent study in the controversial nature of knowledge. Experts are frequently wrong, the history of mankind is one of the constant error in the expert world.

  2. The Wikipedia is getting better by Ex-Linux-Fanboy · · Score: 4, Interesting

    It is my feeling that the Wikipedia is getting better. The community has put rules and procedures in place that make the place more pleasant to edit. In the mid-2000s, there were some issues where people could edit their own biography, and people could be obnoxious, flame and stalk other editors.

    Since then, policies and procedures have been put in place. You can no longer get in to edits wars without [[WP:3RR]] stopping you. You can no longer belittle editors who disagree with you without getting blocked for [[WP:NPA]]. You can no longer edit the article about your small open-source project without getting slapped for [[WP:COI]]

    Yes, these policies are not perfect, and yes a lot of articles still have unverified claims, and yes, like any democracy, it sometimes takes time and insanely excessive discussion to get to consensus. But the process on Wiki works and the new policies minimize the problems with articles. Did I mention that it's against Wikipedia policy to control articles on the Wiki, as per [[WP:OWNERSHIP]]

  3. Re:Got a better way to do things? by Spy+Hunter · · Score: 4, Interesting

    Sanger has been saying stuff like this ever since he started Citizendium, but the proof of the pudding is in the eating, and Citizendium sucks.

    I think the problem is evident in his statement quoted in the summary: "Without granting experts any authority to overrule such people, there is no reason to think that Wikipedia'a articles are on a vector toward continual improvement". Well, unless you count the fact that collectively Wikipedia's articles have quite obviously been on a vector toward continual improvement since Wikipedia started. Wikipedia's article quality is not monotonic, but it is increasing. Under what metric is Wikipedia not getting better? Larry, stop speaking in generalities and point us to some actual evidence that Wikipedia articles are not increasing in quality.

    --
    main(c,r){for(r=32;r;) printf(++c>31?c=!r--,"\n":c<r?" ":~c&r?" `":" #");}
  4. Re:Got a better way to do things? by Darkness404 · · Score: 3, Interesting

    One of the main problems of Wikipedia is it has firm guidelines on what it is and what it is not. There is a ton of information that could be released on Wikipedia but isn't because it isn't 100% verifiable or contains "specialty information". Now, I see where the editors are coming from, but similarly, for the average person interested in something (say a video game) there isn't any one major source of information about each one other than Wikipedia. Sure, you can find loads of reviews, a few walkthroughs, all the gameshark codes you want, and perhaps even a ROM or two of it. But as for real information on the game, that goes beyond that, you have to sort through mountains of Google searches with no real way that you can easily find it. Stuff like that I believe belongs on Wikipedia but keeps getting taken down from editors.

    Sure, I have no objection to vandalism being taken down, but the biggest flaw I see in Wikipedia is a lot of content gets deleted for no reason (face it, storage and bandwidth is dirt cheap).

    --
    Taxation is legalized theft, no more, no less.
  5. How can Wikipedia be taken seriously... by pongo000 · · Score: 4, Interesting

    ...when articles are tagged with the dreaded "primary sources" tag? In case you're not familiar with this tag, it basically states that the integrity of an article is in question because there are not enough cites from secondary sources (no, not a typo) as opposed to primary sources!

    Anyone with an academic background will recognize this acceptance criteria as anathema, as primary sources are usually the only sources that count when it comes to rigorous research. That said, a comment earlier about Wikipedia articles striving for validity through consensus rather than rigorous research now makes it very clear to me what is going on. At the least, Jimmy should be honest and clearly indicate to users that Wikipedia is more a compendium of collective wisdom rather than factual content.

  6. Re:Got a better way to do things? by Hal_Porter · · Score: 3, Interesting

    The trouble is, lots of things can become controversial. Best example is "The Medieval Warm period". As far as I can tell everyone who looked for evidence of this in things like ice core temperature records found it. Unfortunately the fact that the average temperature of the Earth has been warmer in the past is awkward to people who claim that the current warming is unprecedented and an iminent disaster. So the Medieval Warm period article gets attacked by people trying to claim that the warming back then never happened.

    And if you look at the article today, it frankly doesn't make any sense. On the one hand the intro says that the MWP never happened. The if you look the "By Region" section it clearly did. And the talk page is a complete warzone with MWP believers quoting The Telegraph, MWP disbelievers quoting sites like realclimate. Unfortunately the MWP disbelievers have got arbcom to label all the sources that are hostile to them as unreliable sources.

    Frankly you're better off ignoring Wikipedia and looking at primary sources, i.e. people that actually looked for evidence.

    --
    echo -e 'global _start\n _start:\n mov eax, 2\n int 80h\n jmp _start' > a.asm; nasm a.asm -f elf; ld a.o -o a;
  7. Re:Experts are few and want to be paid. by DerekLyons · · Score: 3, Interesting

    Even leaving out the political issues, Experts are few ,and when well known, consider charging a lot for their work and would probably only devote time to getting published in a scholarly journal rather than some random website.

    Not true at all - I know many experts (keep in mind that expert and academic are not synonyms) that would love to edit the Wikipedia. But each and every one has ultimately been driven from Wikipedia by various forms of asshattery.
     
     

    It would be like running an open source project where the only people who are allowed to work on it are those people who hold a PHD or are certified to have 10 years experience programming with a major corporation.

    And that's a problem - how? It reduces the pool available for participation, sure. But the project is still open source and thus forkable by any individual who cares to do so.

  8. Re:Got a better way to do things? by Hal_Porter · · Score: 3, Interesting

    http://en.wikipedia.org/wiki/Medieval_Warm_Period

    Initial research

    The Medieval Warm Period was a time of warm weather around 800-1300 AD during the European Medieval period. Initial research on the MWP and the following Little Ice Age (LIA) was largely done in Europe, where the phenomenon was most obvious and clearly documented. It was initially believed that the temperature changes were global. However, this view has been questioned; the 2001 IPCC report summarises this research, saying "...current evidence does not support globally synchronous periods of anomalous cold or warmth over this time frame, and the conventional terms of 'Little Ice Age' and 'Medieval Warm Period' appear to have limited utility in describing trends in hemispheric or global mean temperature changes in past centuries". The National Oceanic and Atmospheric Administration (NOAA) states that the "idea of a global or hemispheric "Medieval Warm Period" that was warmer than today however, has turned out to be incorrect" and that what those "records that do exist show is that there was no multi-century periods when global or hemispheric temperatures were the same or warmer than in the 20th century". Indeed, global temperature records taken from ice cores, tree rings, and lake deposits, have shown that, taken globally, the Earth actually averaged slightly cooler (by 0.03 degrees Celsius) during the 'Medieval Warm Period' than in the early- and mid-20th century

    Of course if you scroll down you to the By World Region bit of the article you find

    North Atlantic

    The last written records of the Norse Greenlanders are from a 1408 marriage in the church of Hvalsey â" today the best-preserved of the Norse ruins.

    A radiocarbon-dated box core in the Sargasso Sea shows that the sea surface temperature was approximately 1 ÂC (1.8 ÂF) cooler than today approximately 400 years ago (the Little Ice Age) and 1700 years ago, and approximately 1 ÂC warmer than today 1000 years ago (the Medieval Warm Period).[6]

    During the MWP wine grapes were grown in Europe as far north as southern Britain

    i.e. the MWP seems to be quite real in the North Atlantic and Europe.

    North America

    The Vikings took advantage of ice-free seas to colonize Greenland and other outlying lands of the far north.[11] The MWP was followed by the Little Ice Age, a period of cooling that lasted until the 19th century, and the Viking settlements eventually died out. In the Chesapeake Bay, researchers found large temperature excursions during the Medieval Warm Period (about 800â"1300) and the Little Ice Age (about 1400â"1850), possibly related to changes in the strength of North Atlantic thermohaline circulation.[12] Sediments in Piermont Marsh of the lower Hudson Valley show a dry Medieval Warm period from AD 800â"1300.

    So the MWP and LIA seems quite real in North America.

    and if you read Other Regions, it seems to be real there in Africa, the Antarctic, Japan and the Pacific Ocean too. All of which disagrees with the IPCC/NOAA quotes in the summary.

    --
    echo -e 'global _start\n _start:\n mov eax, 2\n int 80h\n jmp _start' > a.asm; nasm a.asm -f elf; ld a.o -o a;