Slashdot Mirror


Wikipedia-Sponsored Pilot Study Lauds Wikipedia Accuracy

netbuzz writes "The Wikimedia Foundation today is releasing the results of a 'pilot study' it commissioned last year to assess the accuracy and quality of Wikipedia in such a way that it would provide a methodology blueprint for others do more thorough reviews of online encyclopedias. The results are in, and despite ready acknowledgment of the small sample size and paragraphs worth of other caveats, the parents of Wikipedia can't help but note that its baby was judged to have outperformed other online encyclopedias, including Encyclopedia Britannica, in three different languages. Britannica, which disputed the Wikipedia-friendly results of a much-cited Fortune comparison report back in 2005, has yet to offer a reply to this one."

17 of 125 comments (clear)

  1. In before... by pinkj · · Score: 4, Funny

    In before 'citation needed'!

    1. Re:In before... by chilvence · · Score: 3, Insightful

      Much as I love wikipedia, a study of the _innaccuracy_ of it would be more enlightening, rather than a study of its accuracy! No one must forget, the fact that the majority of people contribute truthfully to it just makes the minority of people that dont respect it that much more believable... paradoxically, the more faith you have in wikipedia, the more likely that it is to be co-opted... get your head around that! :)

      (that means, I love wikipedia, and I hate lying scumbags, in case you happen to be a lying scumbag and also reading this...)

  2. Oil industry report says oil industry great by crazyjj · · Score: 5, Funny

    And water wet.

    --
    What political party do you join when you don't like Bible-thumpers *or* hippies?
    1. Re:Oil industry report says oil industry great by KingSkippus · · Score: 3, Insightful

      That doesn't matter. The fact is that if someone approached me and paid a wad of cash for doing something, unless there were some really weird circumstances at work, I'd probably do my best to please them--or at least, to not piss them off--even if they paid me up front and there were "no strings attached." Plus, if you're the company performing this study, you'd have to consider the possibility that the Wikimedia Foundation might want more studies done in the future, if the results you come up with are beneficial to them.

      I've seen this in politics and in corporate studies as well. If at first you don't get a result you agree with, kill the messenger and find someone else to do another study that gives you more favorable results. Bury the first ones and hype the one you like.

      While I'm sure there are some organizations and/or corporations who genuinely want completely impartial results, and there are likewise some companies that generate only completely impartial results, I honestly think that it's the exception, not the rule. Any study should be considered extremely suspect that is directly funded by a company or organization it could benefit.

    2. Re:Oil industry report says oil industry great by bws111 · · Score: 3, Interesting

      If companies want an honest opinion about their product (whether it is for PR or for competitive analysis), they should hire a third party. This third party should go and hire the research firm, with the research firm not knowing who the customer is, and the customer not knowing who the researcher is.

    3. Re:Oil industry report says oil industry great by bws111 · · Score: 4, Insightful

      The 'direct funding' is the key. If you want to have someone do impartial research, hire a third party to hire a researcher for you. That way, you don't know who the researcher is, and the researcher doesn't know who the customer is.

  3. The quality and accuracy of some articles is great by Chrisq · · Score: 5, Informative

    The quality and accuracy of some articles is great. I would think that most "core" subjects that get a lot of viewers will tend to be of high quality. However look at the entry for so meting obscure, like the town I live in, and you might find something strange. At times there have been mistakes, now corrected - but there is still an odd balance. There is a lot of detail on railway lines that used to go to the station, and what destinations you could reach from the trains.There is a lack of detail on the current geography and economy. Things are driven by people's interests.

  4. Not Noteworthy by ohnocitizen · · Score: 4, Funny

    Unfortunately the study has been deemed Not Noteworthy by one of Wikipedia's editors and been removed.

  5. Re:The quality and accuracy of some articles is gr by CanHasDIY · · Score: 4, Informative

    The quality and accuracy of some articles is great. I would think that most "core" subjects that get a lot of viewers will tend to be of high quality. However look at the entry for so meting obscure, like the town I live in, and you might find something strange. At times there have been mistakes, now corrected - but there is still an odd balance. There is a lot of detail on railway lines that used to go to the station, and what destinations you could reach from the trains.There is a lack of detail on the current geography and economy. Things are driven by people's interests.

    Also, any subject (such as, say, Presidential candidates) that is/can be politicized is likely to be suspect

    --
    An enigma, wrapped in a riddle, shrouded in bacon and cheese
  6. Re:Smoking is good for your health* by crazyjj · · Score: 3, Funny

    Well, duh, of course they're going to make cigarettes safe. Think about it. Why would they want their best customers dying off?

    --
    What political party do you join when you don't like Bible-thumpers *or* hippies?
  7. Re:The quality and accuracy of some articles is gr by Trepidity · · Score: 3, Interesting

    Yeah, I would say that on articles that have attracted enough attention to have multiple knowledgeable editors, quality is quite good. Exceptions for some rough spots in very hot-button areas, like Israel-Palestine, where sometimes editors with the wrong motives are attracted.

    What I like compared to Britannica is that it's less likely there will be a whopper of an omission in a high-profile article. Some Britannica articles, especially on science/math topics, just have really puzzling stuff missing, or stated incorrectly, while those tend to get found on Wikipedia.

    Of course, they're a bit biased with their list, but a few smug Wikipedians actually maintain a list of Britannica errors that Wikipedia has fixed.

  8. Re:Very variable. by Trepidity · · Score: 4, Informative

    And of course if you make an edit, saying "I WAS THERE, I SPENT 3 YEARS working with that thingy, I HAVE SIX OF THEM IN MY ATTIC", your edit gets removed within an hour, time and again.

    That's what they should do, though! Wikipedia isn't a place to publish your own personal knowledge, but a place to publish information that can be cited, ideally to peer-reviewed articles or books. Half the point of a Wikipedia article is being able to look up the references for further reading, and citation where [3] resolves to "[3] Personal experience of Wikipedia user Ancient_Hacker" just isn't very helpful for that.

  9. Re:This is interesting because... by Trepidity · · Score: 3, Informative

    Here's a Wikipedia meta-page on that last problem you mention, which they call "fact laundering".

    (Incidentally, happens outside Wikipedia too, especially among circularly-referencing newspapers.)

  10. Re:Smoking is good for your health* by i+kan+reed · · Score: 4, Insightful

    Yep, because wikipedia makes so much money off of everyone using all their bandwidth with no ads.

  11. Re:Very variable. by LandDolphin · · Score: 3, Insightful

    No. They are arguing that verifiable information is better then "Take my word for it" information.

    In an ideal world, if the "take my word for it" information is true, then it should get tested, verified, and published somewhere so that it can move into the "verifiable" information category.

    --
    Spelling and Grammar errors have been added to this post for your enjoyment
  12. Re:Very variable. by Sique · · Score: 3, Insightful

    No, the theory is that it is OK, as long as there are people not in anyway connected or related to the author being able to continue the maintenance of the article. The problem with personal knowledge is that it gets lost as soon as the person loses interest in wikipedia or is run over by a bus (which in turn also causes a sudden loss of interest in maintaining wikipedia articles). That's the same reason original research is frowned upon - there should always be at least a second person being able to continue where the original author as left. And it helps if you can make yourself knowledgeable about the subject without being referred to Wikipedia articles, if you want to edit Wikipedia articles.

    --
    .sig: Sique *sigh*
  13. Re:Very variable. by IntlHarvester · · Score: 3, Insightful

    Think of it as the Bob Lazar rule. You can't have people adding their weird theories based on unverified personal experience.

    And, IMO people tend to over-value certain bits of information based on personal opinions founded at the time. You see this all the time on Slashdot where a poster tries to pull rank by saying stuff like "I was there, I worked at a computer shop in 1998!". They then proceed to get basic facts incorrect (common one: the order of Windows releases), or just parrot some conventional wisdom.

    --
    Business. Numbers. Money. People. Computer World.