Slashdot Mirror


When Wikipedia Fails

PetManimal writes "Frank Ahrens of The Washington Post looks at how Wikipedia stumbles when entries for controversial people are altered by partisan observers. Case in point: Enron's Kenneth Lay, who died of natural causes last week, shortly after being sentenced to prison. His Wikipedia entry was altered repeatedly to include unfounded rumors that he had killed himself, or the stress from his trial had caused the heart attack. From the article: '... Here's the dread fear with Wikipedia: It combines the global reach and authoritative bearing of an Internet encyclopedia with the worst elements of radicalized bloggers. You step into a blog, you know what you're getting. But if you search an encyclopedia, it's fair to expect something else. Actual facts, say. At its worst, Wikipedia is an active deception, a powerful piece of agitprop, not information.'"

16 of 513 comments (clear)

  1. How much editorial oversight is enough? by gbulmash · · Score: 5, Interesting

    There are a number of sites that are based on user-submitted data. One that immediately comes to mind is the Internet Movie Database (imdb.com). Now, I'm not intimately familiar with the workings of Wikipedia, but based on TFA, the main difference I see between them and IMDb is that IMDb has a more restrictive additions policy. With IMDb, any registered user can submit information, but every iota of information (aside from some user reviews/comments, which are presented as such) must pass through an editorial review.

    Some will say that IMDb has the luxury of doing this, being owned by Amazon. But IMDb has been online since before there really was World Wide Web. It was started in the Usenet newsgroups back in 1990 and didn't get a web interface until a Welsh grad student built one in 1993. They have always exercised editorial oversight and did so even back when they were a loose group of volunteers with no funding to speak of.

    It used to be that IMDb's structure made it less than nimble in responding to breaking news because of an involved and complicated build process. But over the years, more modularization and granularity have been built into their systems. But even if they're right on the forefront of a news event, their editors and data managers are scrutinizing what becomes part of their "official" record.

    Now, people try to trick IMDb, flood them with wrong facts and bad info. Sometimes a bit gets by their editors. But the bits still have to go by an editor before they become publicly visible. AFAICT, this isn't the case with WikiPedia and that is its fatal flaw. And it's not just the wackos and those with an agenda that need to be guarded against. More damage can be done by a cadre of well-meaning fools than a handful of agitators. And it seems that even if they need to defend their systems against the axe grinders, they need to put double the effort into defending against fools.

    Maybe I'm comparing apples to oranges since IMDb is a lot more narrow in scope than WikiPedia. But they're both large repositories of user-submitted information, they both started as volunteer projects, and they're both widely regarded as great resources. The difference is that IMDb has always exercised more editorial oversight before letting user submissions go live, and IMO, that makes it more trustworthy. Perhaps Wikipedia should take a page from IMDb's book.

    - Greg

    1. Re:How much editorial oversight is enough? by Durrok · · Score: 5, Interesting

      I have a better idea, one that is easy for everyone to implement. Wikipedia is the encyclopedia that anyone can edit. Treat it as such.

      --
      I keep telling myself I'm not the desperate type.
    2. Re:How much editorial oversight is enough? by sbaker · · Score: 5, Insightful

      So look up pairs of movies in IMDB and Wikipedia and see which has the best coverage. I think Wikipedia wins every time...especially for new releases.

      Movies are easy to get right - it's politics and religion and controversial stuff that's hard to do well. You can't get the sheer volume of stuff that Wikipedia has by reviewing everything. Wikipedia is growing at a rate significantly faster than a human can read - no one person could read it all - much less review it.

      Wikipedia grows by 50,000 articles a month. If your hypothetical reviewer reviewed a couple of articles a day - Wikipedia would need over 1,000 reviewers - some of whom would have to be experts in extremely narrow fields. It's all very well to have a few movie buffs keep track of a few dozen movie facts per day - but the only way to handle a problem the size of Wikipedia is to have the general public do the reviewing as well as the writing - which is precisely what happens.

      --
      www.sjbaker.org
    3. Re:How much editorial oversight is enough? by sbaker · · Score: 5, Informative

      Does a group of editors systematically tag all the articles at some point.

      There is just too much stuff to do that methodically. 50,000 articles are added every month - just think about how many people would have be there to check them all!

      Instead there are a few parallel 'top-down' efforts to make an extra-high-quality core by picking the key articles in every major subject area and flagging the stable versions. One effort is thinking in terms of a printed paper version of Wikipedia - another is looking into doing a CD-ROM version. The articles that make it into these special collections are carefully vetted and tagged - so you know that there is a stable 'known good' version backing up the latest version. However, these barely scratch the surface of the problem.

      Additionally, there is a bottom-up process by which article authors can attempt to get their articles recognised for high quality. You first nominate your article for 'peer review' - reviewers monitor this list and come along to check your article. If you pass you can go on to request 'Good Article' status - another round of reviews. Next you can try for the coveted "Featured article" status (there are just over 1000 of these so far) - you get pummeled by English majors and pedants of every stripe - if you pass that then you can try to get your article into 'Article of the Day' - with yet another round of reviews.

      Yet another layer is the 'Portal' system. Check out 'Portal:Automobile' for example - it covers the subset of Wikipedia articles about cars. Many portals have their own quality assurance methods and standards enforcement groups.

      These quality processes work well - but there just aren't enough reviewers to effectively check the 1.2 million English language articles - let alone all of the ones written in French, Portugese...etc. Remember - English language Wikipedia is growing at a rate faster than any human can read. Nobody will ever be able to read all of it - even if they make it's their life's work.

      --
      www.sjbaker.org
    4. Re:How much editorial oversight is enough? by chandip · · Score: 5, Interesting

      But then don't complain when it isn't held as authoritative as Encyclopedia Britannica

      Authoritativeness of Britannica is more a perception than reality. Read the entries from the 80's on communism or from 70's on homosexuality. It was not as unbiased or authoritative as one might have expected. For all its failings, and there are many, with Wikipedia you get to know the other point of view and controversial topics are clearly highlighted (eg. LTTE, Taliban etc).

      --
      the sig
    5. Re:How much editorial oversight is enough? by The_Wilschon · · Score: 5, Insightful

      Ah yes... slashdot's moderation and karma system. It is excellent at producing . . . groupthink? Let's face it. There is a prevailing set of opinions on slashdot, and if you follow those opinions, then you get karma and mod points, thus reinforcing the groupthink, because only those who follow it can make their way into the (large) group of people who enforce it.

      Now, you could say that with a larger group of people, this is exactly what you want in an encyclopedia: the collective thought of humanity. However, slashdot's groupthink is by no means equal to the collective thought of slashdot. I would wager (now, I freely admit that I don't have good empirical evidence for this, so take it with several large grains of salt) that the karma+moderation system has a significant narrowing effect on the thought expressed by high scoring comments here. That's ok here, but not in an encyclopedia. The downside of widening the thought for wikipedia is that there is a lot of crap to trudge through.

      --
      SIGSEGV caught, terminating

      wait... not that kind of sig.
  2. Too recent & controversial for an encyclopedia by sbaker · · Score: 5, Interesting

    I would agree that Wikipedia is poor at reporting stories that are both recent AND controversial - but to be fair, I don't think those are the kinds of things you should be looking up in an encyclopedia anyway. Look back at this same article in six months and I guarantee it'll be correct and unbiassed. It just takes time for the community to settle on the right wording.

    Things that are NOT recent but ARE controversial ('Religion' or 'Area 51'for example) are generally well written, correct and take a carefully neutral stance. Things that are recent but NOT controversial (say "2006 World Cup Soccer") are well reported immediately and bang up to date with all the right facts.

    It's the intersection of recent and controversial that messes up the system because too many people are editing at once and a lot of them are nut jobs. Once the topic gets old or becomes uncontroversial, the lunatic fringe loses interest and good writing can take place.

    On the other hand, if you want to know the engine capacity of a 1963 Austin Min
    i or the number of casualties in the RAF Faulds explosion or the exact nature o
    f the student prank involving the Bridge of Sighs in Cambridge or the size of a
      litter of European Red Squirrels - things that I consult an encyclopedia for rather than a newspaper - then there is no other place (on the web or otherwise) to touch what Wikipedia has done.

    --
    www.sjbaker.org
  3. Square peg, round hole. by Short+Circuit · · Score: 5, Insightful

    You don't go to Wikipedia to learn things about actively controversial subjects. You go to Wikipedia to learn things that nobody cares to dispute. Like science, math and biology. Or even history.

    If there's significant controversey, it'll usually get its own section on a page.

  4. I'm not buying it. by mindstrm · · Score: 5, Insightful

    You step into Wikipedia, you understand what's up.
    You know it's not a peer-reviewed encyclopedia. It's a WIKIpedia.
    You know anyone, including you, can edit it.

    Whenever you read up on a controversial topic, you expect controversial results... would a traditional encyclopedia even HAVE information about some enron executive? I doubt it.

    Let's not make controversy where there is none.. wikipedia is a stunning example of what the internet is good at.

  5. WP is self-correcting by Dr.+Zowie · · Score: 5, Insightful

    The advantage of WP isn't that it's right all the time, it's that it is (through the tireless effort of zillions of people on five-minute breaks) self-correcting. When the AP screwed up their Ken Lay story, it took overnight before a retraction was posted. WP's story is screwed up for 5-20 minutes at a time.

    The mainstream media are almost equally susceptible to being hacked -- even if you don't follow wingnuts like Rush Limbaugh or the insane propaganda and political fart-lighting on Fox News, it's not hard to spot gross errors or oversights in news reporting. "Unbiased" news doesn't exist, investigative reporting isn't anymore, and the media circus is just that -- a circus. Wikipedia may be raw, uncensored, or wrong, but at least it tends to correct itself rapidly.

    For what it's worth, the science articles are rapidly becoming the most comprehensive archive of science knowledge ever aimed at the general public. (Of course the refereed literature is larger, but it's not a reference work for the layperson).

  6. Re:Too recent & controversial for an encyclope by B'Trey · · Score: 5, Insightful

    Well said. Additionally, the article doesn't support the headline. There were only a couple of bogus entries and those were corrected within one or two minutes. The article also takes issue with statements like: "Speculation as to the cause of the heart attack lead many people to believe it was due to the amount of stress put on him by the Enron trial." Where's the problem with that statement? It's clearly labeled as speculation, and many people, rightly or wrongly, still believe the stress of the trial led to his heart attack. Perhaps such speculations are best left out of Wikipedia articles, but one can't reasonably argue that it's incorrect or misleading when it's clearly listed as speculation. In short, this is a desparate attempt to nit-pick Wikipedia and it even fails at that.

    --

    "The legitimate powers of government extend only to such acts as are injurious to others." Thomas Jefferson.

  7. Re:Too recent & controversial for an encyclope by Elemenope · · Score: 5, Insightful

    I would agree that Wikipedia is poor at reporting stories that are both recent AND controversial - but to be fair, I don't think those are the kinds of things you should be looking up in an encyclopedia anyway.

    The comment above is just the sort of comment that deserves a few 'insightful' mod points. Sometimes, pointing out the blindingly obvious is difficult when people so desperately want things to be something other than what they are. Wikipedia is, at best, something *like* an encyclopedia, and as such should serve similar purposes. Some people think that somehow there is a way to take the human element and passion out of a user-contributed site, or any site, or any work or endeavor of humankind for that matter. There isn't. Let us simply understand that you can't have the factual accuracy and neutrality of an encyclopedia for something that occurred yesterday; technology alters the quantity and speed of information, not its quality. If you want neutrality, you must wait for cooler (and further removed) heads to prevail.

    --
    All the techniques ever used to make men moral have been themselves thoroughly immoral... (Nietzsche)
  8. The best summary I've read by bunions · · Score: 5, Insightful
    was, surprisingly, at Penny Arcade:


    Reponses to criticism of Wikipedia go something like this: the first is usually a paean to that pure democracy which is the project's noble fundament. If I don't like it, why don't I go edit it myself? To which I reply: because I don't have time to babysit the Internet. Hardly anyone does. If they do, it isn't exactly a compliment.

    Any persistent idiot can obliterate your contributions. The fact of the matter is that all sources of information are not of equal value, and I don't know how or when it became impolitic to suggest it. In opposition to the spirit of Wikipedia, I believe there is such a thing as expertise.

    The second response is: the collaborative nature of the apparatus means that the right data tends to emerge, ultimately, even if there is turmoil temporarily as dichotomous viewpoints violently intersect. To which I reply: that does not inspire confidence. In fact, it makes the whole effort even more ridiculous. What you've proposed is a kind of quantum encyclopedia, where genuine data both exists and doesn't exist depending on the precise moment I rely upon your discordant fucking mob for my information.


    http://www.penny-arcade.com/2005/12/16

    I think it's valid criticism for non-technical articles. As noted by others, wikipedia kicks ass for noncontroversial, primarily technical topics.
    --
    there is no need to sign your posts. this isn't usenet. your username is right there above your post. stop it.
  9. "The encyclopedia that Slashdot built." by mnemonic_ · · Score: 5, Insightful

    I can see the coder-geek authorbase as the primary cause of Wikipedia's problems. Here are the issues I've noticed in the past. Many of these examples may have been rectified, but they still exist in countless other forms:

    They're insidiously opinionated. Instead of saying wasabi is "fried with peas," they say it is "considered quite tasty with fried peas." Gee, "tasty" is completely objective I guess, not a matter of personal, ahem, taste, at all. Someone tries to argue them down, but they know they're "right," after all they learned C++ when they were 10.

    They miss the forest for the trees. The article on AIDS has wonderful information on the disease's origins, treatment and spread throughout the world. Too bad there's no fucking organization to anything in the article, and the section titled, "Global epidemic" is precisely redundant with the one named, "Current status." It's like the typical geek's desk, awash in code printouts and spec sheets. There's good stuff in there, somewhere (he's sure) but he'll be damned if he can make any sense out of it (but hey it's like a puzzle and those are fun). He should just print one more copy instead of checking if it's already there, and organizing his shit.

    They don't know how to write. If the spelling and language mechanics are correct, then it's good writing (which is like saying that any code that compiles is good code). There's no rule in Strunk & White about too many clauses in one sentence! Thus, the writing is perfect. Decent style, flowing sentences, consistent tone and voice are only for the weak-minded; hackers are made of sterner stuff (well, mentally).

    They're obsessed with dumb trivia. Every article must have its "In popular culture" section, just to prove that they, like Ken Jennings, know stupid references to everything.

    They don't know jackshit about page layout. Does every table need a full set of borders? Must LaTeX equations be fucking huge? Why can't editors use a color wheel (or common sense) to choose nicely matching colors? Deitel & Deitel is not the standard on typesetting or formatting; use a textbook that had an editor as a guide on page layout, like "Fundamentals of Aerodynamics" by Anderson. Clean tables without distracting borders, equations modestly marked by centering and italics (no huge font necessary), headings used only when needed. It's black and white because colors would be superfluous. But it's fun on Wikipedia to add superfluous formatting, it's just like adding new features to software. Oooh, shiney! Instead of featuritis, it's sectionitist, bolditis, table-itis.

    So that's what I think ails Wikipedia in a nutshell. Many of these are addressed by Wikipedia policies, but when even Wikipedia's founder (Jimbo Wales) dislikes following them, how will they ever gain decent implementation? Especially when any editor with half a brain who does support them is just another uncool, uptight elitist who should be ignored. It's no wonder that Wikipedia today is still a nightmare of good information. Citing Wikipedia at the college level is still academic suicide. Unless their policies and people change throughout the chain of command, Wikipedia will never evolve to a real authoritative source that is a true encyclopedia. It's fun to read, but only as accurate and objective as the rest of the internet.

  10. It has safeguards already. by S.P.B.Wylie · · Score: 5, Interesting

    Wikipedia has already taken care of false information problems, in a variety of creative ways.

    First, you have to remember that important article are hit thousands of times by various people, and since everyone has ability to edit, problems can often be quickly cleaned up. I feel that slashdot proves that if you though enough geeks at something, truth comes to the surface quickly.

    Second, Wikipedia strongly supports citing sources. Try moving around Wikipedia, and you will soon find a header stating that "this article needs sources" and basically a warning that it may contain gibberish. When you are doing things of importance, you should always check sources. Especially when dealing with something like Wikipedia. This is also an advantage Wikipedia: unlike most encyclopedias, where you have to go find the sources, Wikipedia is point and click.

    Wikipedia is the the greatest proof that the Market Place of Ideas works. It shows that when you throw enough ideas together, the truth will survive. Though we may have unfortunate events like the one in the article, almost all information is accurate, and problems are quickly solved.

    --
    I give bread to the poor, they call me a saint.
    I ask why the poor have no bread, they call me a communist.
  11. Re:Editorial Oversight != Truth (i.e. FOX News) by killjoe · · Score: 5, Funny

    "What distinguishes FOX News is that it reports both the Left and Right sides of issues."

    Yes for example it examines whether liberals hate america or whether they are merely terrorists.

    I have also heard heated debate on fox news as to whether Hillary Clinton was "pure evil" or merely "very evil".

    Finally I don't think anybody could argue that fox news gives both sides of the important debates on science such as "theory" of evolution vs creationism, the contrversy over global warming and such. Both sides of those issues are to be treated with the same amount of respect.

    --
    evil is as evil does