Slashdot Mirror


Nitpicking Wikipedia's Vulnerabilities

tiltowait writes "A lot of Wikipedia critics point to hypothetical situations when giving reasons for not valuing the site. Wikipedia even has a 'Replies to common objections' article set up to field these. I'd rather look at some real examples of applying the same level of scrutiny to materials often held up as the Platonic ideal of 'scholarship,' such as peer-reviewed journals, conference papers, established journalism sources, monographs, and print encyclopedias. Even these have disclaimers because they can be can be vandalized or have their reliability and accuracy questioned. As dangerous as it is to trust unverified information, it can be just as bad to make prior judgments discounting information because the source happens to be anonymous. The above examples illustrate that all materials existing along a continuum of valuable information formats. Wikipedia articles can be useful for quickly obtaining factual overviews or as a starting point to further research. But that's just one librarian's opinion. How do tech-savvy people view Wikipedia?"

24 of 545 comments (clear)

  1. It's not about the encyclopedia by fishdan · · Score: 3, Insightful

    For me the best thing about wikipedia is the concept behind it. A collaboration of people, working to increase the sum of human knowledge, because the sum of accumulated knowledge is something that is greater than its parts. Everyone working together to maintain this knowledge for the betterment of all. Is that an idealistic view? Of course. But what's wrong with idealism and striving for it? Wikipedia is more that just an encyclopedia -- though it's very good at that. It's a hope that we actually can all work together on something -- something that embiggens us all.

    --
    Nothing great was ever achieved without enthusiasm
  2. Wikipedia rocks, BUT... by BandwidthHog · · Score: 4, Insightful

    I just had a similar discussion with my girlfriend this past weekend. She found some valuable information on Wikipedia for a paper she’s writing on Chinese culture. I told her she should use that as a springboard: that Wikipedia could provide her the facts and details she needs, and that she should then find independent citable sources for each individual facts. I told her that I was sure it couldn’t be cited because the information there is simply too fluid and couldn’t be counted on to remain unchanged over time. She checked with her professor who wasn’t terribly familiar with the details, but had at least heard of it. He looked into the matter and told her that it was perfectly acceptable as long as the citations were up to MLA standards. I told her that her professor would turn out to be wrong in the long run (yeah, modesty is part of my charm, why do you ask?).

    So I guess I agree with the story submittor (askor?) that Wikipedia rocks, but that their model simply doesn’t lend itself the the level of credibility needed for that sort of use. It’s great, and in many ways a more valuable resource than Google, and one hell of a social experiment. But at the end of the day, you simply don’t know if any given fact was contributed by a Princeton research librarian or Karl Rove.

    --

    Quantum materiae materietur marmota monax si marmota monax materiam possit materiari?
  3. Wikipedia is a great resource by totallygeek · · Score: 3, Insightful
    Regarding the things of which I have intimate knowledge, I have seen as many errors per page in Wikipedia as Newsweek, Encyclopedia Brittanica, National Geographic, IMDB, textbooks, etc. Information is only as good as its source. A writer gathers information, an editor picks over it, it is passed before panel reviews, and is published as true. At least with Wikipedia the editing process can pass before more people, and any one of them can do something to affect the publishing. If the informed decision is based on misinformation or misunderstanding, the outcome is a compounded error, and now is stamped with more credibility than the original articles.


    I use Wikipedia quite often, but I usually perform some secondary research.



  4. like a regular encyclopedia... by Chalex · · Score: 4, Insightful

    I view it as an excellent starting place to get some information. If I have a basic question, it'll probably be answered by the Wikipedia article. If it's a more advanced question, the article should point me to more in-depth references.

    So remember, if you're adding information, try to cite a source!

  5. Comment removed by account_deleted · · Score: 3, Insightful

    Comment removed based on user account deletion

  6. The Liberal Bias Remains by Nova+Express · · Score: 3, Insightful
    "Earlier on, we had a systemic bias toward liberal issues. However, as Wikipedia has grown, and become more mainstream, the liberal contingent has declined as a proportion of Wikipedia in general."

    Notice that they don't say that the liberal bias has disappeared. In fact, it has become rather distinctly entrenched at the administrator level.

    Notice how Accuracy in Media is called a conservative organization (which it is) time and time again, but the analagous organization on thee left is described thusly: "Media Matters monitors for and refutes identified and materially substantiated conservative misinformation found in media news reports, public affairs and talk radio shows from Fox News, Rush Limbaugh, Bill O'Reilly and others."

    So, in short your bias is "identified and materially substantiated misinformation," my bias is truth.

    You can find about a hudnred other examples, for example the breaking up of the article on Communism into theory and practice to avoid having to mention any of that nasty genocide in the main article.

    --
    Lawrence Person (lawrencepersonh@gmailh.com (remove all "h"s to mail)

    http://www.lawrenceperson.com/

  7. Re:Editorial control by Yahweh+Doesn't+Exist · · Score: 5, Insightful

    nice speech, but the truth is not democratically accountable.

  8. Encyclopedia != Community by cribcage · · Score: 3, Insightful

    Wikipedia isn't an encyclopedia. It's a community. Don't confuse the two.

    Your contributions were probably questioned for two reasons. First, because Wikipedia is governed by a policy called NPOV, or Neutral Point Of View, which is interpreted to mean that an encyclopedia must reflect all perspectives on any subject. There can be no "absolute right" or "absolute wrong." According to NPOV, your opinion just that. Expertise does not exist. All sides must be represented, no matter how loony.

    Second, you probably weren't taken seriously because you didn't contribute hundreds of edits over the course of a week. Wikipedia is dominated, literally, by those users who spend the most time editing. This, ultimately, is Wikipedia's greatest flaw: Its users are more interested in participating in a community than in building an encyclopedia. They call themselves "Wikipedians," and they stage meet-ups. Their reasons for participating are primarily social.

    The result is a project governed by losers. Sorry, but it's the truth: The people with the most free time to dedicate to an online encyclopedia will always be the people least-qualified to contribute, because those who are qualified spend their time earning and practicing those qualifications in the real world. If the project were coordinated somehow, maybe shared between several universities with each department contributing according to its own specialization...maybe it could work. But Wikipedia is doomed to mediocrity, simply because it's populated by nutjobs with no social skills who drive away qualified contributors who threaten their pretend authority.

    Knowledge is not democratic -- and expertise necessarily erodes equality. You cannot build a worthwhile encyclopedia based on the premise that everyone's contributions will be valuable.

    --

    Please don't read my journal
    1. Re:Encyclopedia != Community by John+Nowak · · Score: 5, Insightful

      This is just bullshit.

      First off, not all sides must be represented. The page on Earth doesn't talk about the "Is it flat?" controversy. Loony opinions are absolutely NOT represented on Wikipedia. That issue has come and gone many times. No one talks about Pat Robertson's side of the story on Wikipedia.

      Secondly, a lot of the edits on wikipedia are done by students and faculty of academic institutions. I don't consider these people "losers" because they're contributing to our base of information. I consider them an important asset to society.

  9. Re:Editorial control by nine-times · · Score: 5, Insightful
    The only thing is, who certifies? Who decides who's smart enough to be an authority, and who isn't? I've known professors who should have their work overwritten by college freshmen. Do we want those professors censoring smart people because they disagree?

    I do rather like the idea of having some sort of editorial process to the wikipedia. Whenever this issue of "trustworthiness" has come up, I've always had the same hesitating suggestion: branch the wikipedia so that there's something like a "stable branch". Keep the wikipedia as it is, but it'd be nice if there were some kind of designated "editors" that could integrate the changes better, make sure the work is coherent, correct, etc. and put out the edited version as the "stable" version which would lag a bit behind from the "unstable".

    Of course, such a thing would be a logistical nightmare, and it's damn near impossible. However, I think it would be appreciated by a lot of people if some editorial process could be worked in somehow.

  10. Liberal bias on Wikipedia by Dr+Kool,+PhD · · Score: 3, Insightful

    Wikipedia is the top hit on google for a lot of common searches, and I do agree that it is an okay source of information if you need info in a hurry. However I have noticed a clear liberal bias among many articles. Here are three examples I remember off the top of my head from searches in the last week --

    Little Saigon, CA -- the article gives a good overview of the landscape of Westminister and Garden Grove, but then out of nowhere he drops "The event also raised some controversial issues about constitutional free speech in the United States". No sir, the event didn't raise controversial issues. I suppose if you were a socialist then yes, maybe the issues would be controversial. But to 99.99% of America, someone flying the VC flag on American soil is a disgrace to those who gave their lives in Vietnam. The guy broke the law by selling pirated movies and he was arrested, end of story.

    Newt Gingrich -- In the TRIVIA section: "Candace Gingrich, his sister, works for the Human Rights Campaign (HRC), the nation's largest gay and lesbian organization. In years past she has headed up HRC's "National Coming Out Day" campaign." Gee, thanks for that "trivia". The author couldn't reasonably fit that line in an article on Newt himself, so he sneaks it into the "trivia" section. Clear liberal bias here.

    Ronald Reagan -- "It is frequently reported that Secret Service agents had to inform Reagan every morning that he was once the president". Really sir, since it's so "frequently" reported I guess you wouldn't mind providing a link? What business does this phrase have in an encyclopedia entry of Ronald Reagan other than to undermine his legacy??

  11. Good for casual use; not for serious research by Selanit · · Score: 4, Insightful

    I teach freshman composition at the U of Texas in Austin. My students are about to begin their second paper, which will involve a substantial research component, and Wikipedia was one of the first things I covered in discussing acceptable sources. I do not accept citations of Wikipedia articles, for two reasons:

    1) The articles are not stable. They change on a regular basis. If my students cite something, I need it to be static so that I can verify their citations easily. I am well aware that Wikipedia has a robust versioning system, but that is irrelevant to my purposes. If a student cites something and I cannot immediately locate it, I simply do not have the time to sort through the recent edits to find a version of the article that matches what my student quoted. This is particularly true of popular and frequently updated articles, where there can be dozens of recent edits to sort through. There just aren't enough hours in the day for that.

    2) The sources are all too frequently anonymous. Some Wikipedia articles contain excellently documented source information, it is true; but many others do not. There is no reliable way to separate solid, documentable information from personal crank theories. Sometimes they're obvious; sometimes they're not. Some will invoke the magic of "many eyeballs make shallow bugs" at this point, pointing out that errors tend to get corrected or reverted fairly rapidly. But once again, that is irrelevant. If my student cites an unfixed "bug" to support an argument, that's just as damaging to the student's paper as it would be if the bug never got fixed.

    So what I tell my students is this: Wikipedia is great for fast, informal definitions of unfamiliar material, but not for formal papers submitted for credit. You can use it as a starting point for further research -- I have used it as such a starting point myself. But every piece of information from the Wikipedia article needs to be verified against a static, identifiable source before it can be used in a paper, and then you need to cite the verifying source rather than Wikipedia.

    If it makes the Wikipedia people feel better, I also refuse to accept citations of the Encyclopedia Britannica -- or any encyclopedia, for that matter. Encyclopedias provide useful overviews; but I want my students to grapple with primary sources, not secondary summaries.

  12. Re:Editorial control by pbhj · · Score: 3, Insightful

    Is that post-post-modernity - "democratic truth"?

    Glad there's at least one person that realises the truth is static and not determined by our whims and fancies.

  13. I disagree. by Estanislao+Mart�nez · · Score: 4, Insightful
    Its not the curiosity of a six year old thats the problem. Its the twelve year old that decides to write 'penis' in the middle of the article for no reason.

    That's nowhere nearly as bad as the 20 year old college student who vastly overestimates his understanding of a topic, and the value of what he has to contribute.

    It's easy to notice the handiwork of the twelve-year old and revert it, and there's countless people who can do it. There's relatively few people who can understand why the 20-year old's contribution is very wrong; it takes them considerable effort to demonstrate the guy's errors to a layperson audience; and they're very much outnumbered by the 20 year olds.

    And nothing is worse than a mob of said 20 year olds, independently making small edits to a coherent, cohesive article in order to make small, local "improvements" (without any concern for the overall organization and narrative flow of the article), and thereby rendering the article into an unreadable random shopping list of distorted half-truths.

    1. Re:I disagree. by iocat · · Score: 3, Insightful
      Bingo. Wikipedia trends towards -- it isn't always -- but it trends towards the conventional net wisdom on subjects, and on subjects on which I am expert, I have seen it frequently misstate facts, include folklore as truth, etc. (I am too tired right now to site a lot of examples, so you'll either have to trust me or not)(but ok, for instance, in its entry on the ABC it is the garden variety UoI story on how John Atanasoff's computer was the first digital computer, blah blah blah, without at all referencing the fact that what we call a "computer" is typically a multipurpose, reprogrammable device, which the ABC wasn't, so while it was a digital device, it was a modern computer in the sense of the ENIAC, which thus has a much better claim to being the first digital computer. Blah blah blah boring boring nerd nerd argue argue.) Look my point is, and you UoI people can stop modding me down now, is that it's a really nuanced debate and issue, and on Wikipedia you not only fail to find the nuances, you don't even learn that the nuances exist. (By the way, for a fantastic and authoritative book on the subject, check out this . In this way maybe its similar to other encyclopaedias, which tend to be very broad and undetailed.

      Yes, I could edit these things, but a) the truth is less good in these instances than the folklore, so I expect it will just get changed back (in the specific instance I cited, ABC fans people probably troll that entry daily to protect their primacy...)and b) I don't have the six-year-old skills in place to be motivated. I like wikipedia as a general overview, but the love of Wiki-fans for "free" as in speech solutions somestimes can't make up for a good fact-checker.

      Note: I am on a flaky connect and posting this w/o previewing so apologies if the links are broken.

      --

      Dude, I think I can see my house from here.

  14. Comment removed by account_deleted · · Score: 4, Insightful

    Comment removed based on user account deletion

  15. Re:Editorial control by sdedeo · · Score: 5, Insightful

    I wonder which article this was. I've never had this problem at all, and I've contributed to dozens of articles, both in science (I'm a Ph.D. in astrophysics), and in politics (where I have worked on "hot button" topics like the ACLU.) I have certaintly had occasional issues with people, but it's actually quite rare. In general, contentious but well-sourced material that belongs in an article, stays in an article, and people who try to remove it are considered vandals by the community and dealt with accordingly.

    Reading between the lines of your post, it seems entirely possible that your edits, even if they were sourced by peer-reviewed journals, were inappropriate for the articles you edited. Wikipedia is not meant to be a series of technical review articles. The information you added may well have been considered at an inappropriately high level, it may have just been "too much" (articles are not supposed to grow without bounds) or, indeed, you may have added too much information about only one side of a contentious topic -- in the third case, people are likely to worry that you are subverting NPOV. (Adding detail to one side of an issue but not the other is probably the most tricky aspect of wikipedia -- I personally think it's OK, but it does, reasonably, set off people's NPOV alarms.)

    --
    Protect your liberties. Donate to the ACLU
  16. Dev and Stable by Agarax · · Score: 4, Insightful

    I've always had the same hesitating suggestion: branch the wikipedia so that there's something like a "stable branch".

    Of course, such a thing would be a logistical nightmare, and it's damn near impossible. However, I think it would be appreciated by a lot of people if some editorial process could be worked in somehow.


    This is actually a very good idea.

    A stub could start out as a beta, where it gets many edits. After a certain ammount of time/edits the entry could be forked into a RC and dev page. The RC could be locked and the dev maintained on a seperate tab (like the discussion or talk links are now). You could then put up a voting system where you can give a thumbs up or down.

    If it gets a number of yes votes it could then be called a stable page (1.0) More edits would still be made on the dev page until it reaches the limit where it goes up for a up/down vote again, and a snapshot of the dev would go up for review. If it passes you could then have a 1.1 version of the page and continue adnausium.

    This would provide a signifigant ammount of quality control on the page.

    --
    Remember folks, slashdot doesn't have a -1 "disagree" moderation!
  17. How could anyone possibly deface wikipedia? by floamy · · Score: 5, Insightful
  18. Re:Editorial control by Raul654 · · Score: 4, Insightful

    That's the stupidest statement I've ever seen here on slashdot, and that's saying something. Al Fraken said it best in his book - people complain that news sources are biased towards the left or the right, and that's really missing the point. Yes, the NY Times might have a very, very slight left bias; the Wall Street Journal might have a teensy bit of a right-wing view on it; however, these institutions do their best to make their stories accurate and neutral. Their job is to inform the reader.

    Then, you have the news that comes from other organizations like Fox News and the Washington Times. These are organizations which are so utterly, appallingly biased that it's clear their primary mission is to persuade. MediaWatch, a non-partisan media watchdog, actually found Fox viewers were MORE IGNORANT (that is, more likely to get current events questions wrong) than people WHO DID NOT WATCH THE NEWS. You actually become less informed by watching Fox!

    --


    To make laws that man cannot, and will not obey, serves to bring all law into contempt.
    --E.C. Stanton
  19. Re:Editorial control by neitzsche · · Score: 4, Insightful

    While it is true that this happens on a regular basis, admins and regular contributors revert such edits very quickly on average. I know I spend a lot more time these days watching [[Special:Recentchanges]] than I do reading slashdot. I'd almost forgotten I had an account here.

    --
    "God is dead." - Frederik Nietzsche
  20. Enter Adam Smith.... by Quadraginta · · Score: 5, Insightful

    The only thing is, who certifies?

    It's only top-down designers who face this perennial conundrum, you know. If you free yourself from the narrow confines of socialist thinking this problem is easy to solve: let a free market assign the appropriate value of Wikipedia information, just as it successfully assigns the appropriate value of bazillions of commodities from 1/8" copper tubing to expertise in brain surgery.

    How could that work? Simple, if Wikipedia could figure out a way to let users bid to pay for information, and let experts (or random wannabes) bid to sell information, and connect them up. The ol' invisible hand would rapidly solve the problem of assigning an appropriate value to every article and every author in the Wikipedia.

    Users for whom information is mission-critical, e.g. who will be testing the truth of that information most severely, would end up offering the highest price for it. So, information that consistently proves reliable and accurate in actual use (and not just in some academical opinion) would fetch the highest price. Similarly, experts who really are expert, who can easily provide the high quality information, are going to end up commanding the highest fees, fees which will encourage them to provide more of those tasty nuggets. Lonely groupies who merely browse and argue without actually using the information in the real world won't be paying high prices, so they will have little effect on the nature of the supply. Flamers who supply plausible-sounding but useless or misleading garbage will quickly find the price of their product falling to peanuts.

    In other words, I think the essential flaw in Wikipedia is that it is free, because in the real world things that are free usually end up being worth the price (i.e. nothing), because there is, indeed, as you point out, no clearly reliable way to ensure that noise and froth do not swamp what's actually valuable.

    That being said, it's hard to know how Wikipedia could change this. Aside from its philosophical blinders, which probably prevent it from understanding the nature of its dilemma and the solution, it is difficult to make appropriate micropayments. No Wikipedia article is worth, say, $2 for a look, or $50/year for a subscription. But would I pay a nickel for a look, if I could pay instantly with just a single mouse click? I might indeed. Especially if I knew that the price was set by market demand from people who had to put up their own money to get the information, which goes far to guarantee that the information has proven worth the price when actually used.

    1. Re:Enter Adam Smith.... by Jules+Bean · · Score: 3, Insightful
      In other words, I think the essential flaw in Wikipedia is that it is free, because in the real world things that are free usually end up being worth the price (i.e. nothing), because there is, indeed, as you point out, no clearly reliable way to ensure that noise and froth do not swamp what's actually valuable.
      Really? Ignoring the most obvious example to slashdot readers of something that is free but not worthless, I can also think of: google, public parks, church services, free music recitals, usenet... I'm sure other people can think of more. I think the suggestion that what is free must be worthless is a truly depressing point of view! Having said that, I do think the micropayment scheme is interesting. But I don't think you present compelling evidence that wikipedia needs or wants it.
      --
      -- Any sufficiently advanced technology is indistinguishable from a perl script.
  21. Re:Aye, a bit... by dwandy · · Score: 3, Insightful
    When I was younger I thought all the world's problems could be fixed by applying economic (monetary) pressures, and I still feel that there is some very string merit to this approach.
    Unfortunately there are some real probems with pure capitalism, and that reflects in a number of ares:
    -The UN puts Norway, Sweden, Australia and Canada as the top 4 (2004) in United Nation's Quality of Life survey. All these countries have strong social policies (i.e. far less capitalistic than the US)
    -Companies don't necessarily make what's best for the consumer: products are now more and more often made to be disposable. (how do I make more money: sell the best product once, or some minimum-standard product 1000x. Engineered Obsolesence is a capitalist phrase)
    -Capitalism doesn't take hidden costs into account (like social problems, environmental problems) but looks only at the costs/profits for the next quarter.

    I'm not sure I would find this acceptable for something like information. If I'm asking for an answer to some question, and I'm told the answer is '12', how can I verify this?
    I guess what I'm also questioning is the feedback loop...and compensation (in capitalism) is a big part of the feedback loop. I'm intrigued by the idea of hiding bits of information, and perhaps over time one could determine whether or not someone was an expert or not.
    I guess the real problems for me is that if I'm shopping for a car, I can look at each one before I buy - compare and contrast: why is the bimmer $65,000 and the hyundai only $10,000 ?
    What exactly is it about the one bit of information/expertise that makes it worth spending 6x as much to learn it? Unlike physical goods, information can't be previewed, since it can't be 'unlearned'.
    Since by definition I don't know the answer, it may be difficult to decide based purely on asking price which one I want or need to buy.

    To answer the original question: I use wikipedia as a "xyz for dummies" reference. I don't expect to walk away an expert, but I do expect to have an idea of what the word/phrase is all about. Really, phd's arguing over minor symantics that only another phd would care about means nothing to me. If someone needs that kind of detail they are at the wrong resource... Once you view wikipedia in that context, it becomes a very valuable resource, and ain't broke, so it don't need no fixin'.

    One last point that a previous poster aluded to: OSS is 100% free to me. I am 100% convinced that it not only has value today, but will have value to the human race into the forseable future and see no immediate threat to the current price model (free as beer and speach...) If that's not your vision of OSS you might be on the wrong forum ;)

    --
    If you think imaginary property and real property are the same, when does your house become public domain?