Slashdot Mirror


How Many Hoaxes Are On Wikipedia? No One Knows

An anonymous reader writes The Washington Post's Caitlin Dewey has written a lengthy feature covering one of Wikipedia's most intractable problems: carefully inserted hoax information that is almost impossible to detect. Dewey's investigation starts with the recent discovery of the nonexistent Australian god "Jar'Edo Wens" (which lasted almost ten years), and discusses a Wikipediocracy post about a recent experiment by critic Greg Kohs, in which 30 articles received cleverly-chosen minor falsehoods. More than half survived for more than two months. Included is also a chart showing that editing participation in Wikipedia has "atrophied" since 2007. It is quite rare to see a feature in a major media outlet as critical as this, of Wikipedia and its little-known internal problems. Especially on the heels of a very favorable CBS 60 Minutes report. As Kohs says, "I think this has proved, beyond a reasonable doubt, that it's not fair to say Wikipedia is 'self-correcting.'"

28 of 186 comments (clear)

  1. Any other examples that anyone's spotted? by Anonymous Coward · · Score: 5, Interesting

    It would be interesting to see them compare to other sources.

    1. Re:Any other examples that anyone's spotted? by don+depresor · · Score: 4, Informative
    2. Re:Any other examples that anyone's spotted? by Anonymous Coward · · Score: 5, Insightful

      Wikipedia's problem is the Napoleon problem - there are a bunch of self-important "editors" who want to exercise extreme control over everything so you get a lot of people who would contribute who are just turned off by the political factors involved in editing Wikipedia.

      Wikipedia created this problem for itself, and now they are learning that they won't get people involved or to donate when they are treated poorly.

    3. Re:Any other examples that anyone's spotted? by Anonymous Coward · · Score: 4, Interesting

      articles received cleverly-chosen minor falsehoods. More than half survived for more than two months

      Ahh, my work has been successful then.

      I'm one of the people who adds innocuous misinformation to various Wikipedia articles. I used to contribute large amounts in a positive and factual way, but with all of my experiences with control freak dick mods/admins or random idiots who think they own articles reverting or fighting almost every single one of my legit edits, I have taken to poisoning the site.

    4. Re:Any other examples that anyone's spotted? by SuiteSisterMary · · Score: 3, Interesting

      Nah, it just means you'd have to use disposable accounts.

      --
      Vintage computer games and RPG books available. Email me if you're interested.
  2. ...Wikipedia has "atrophied" since 2007... by QuietLagoon · · Score: 3, Insightful

    ... Included is also a chart showing that editing participation in Wikipedia has "atrophied" since 2007 ... As Kohs says, "I think this has proved, beyond a reasonable doubt, that it's not fair to say Wikipedia is 'self-correcting.'"...

    I could have told you that, and have been telling you that.

    .
    The big problem with Wikipedia is that in spite of what the publicity says, it is only a small number of people who contribute, and a surprisingly large number of those people have an agenda for what they edit.

    imo, with Wikipedia, truth is not the goal. A certain point of view is the goal.

    1. Re:...Wikipedia has "atrophied" since 2007... by Anonymous Coward · · Score: 5, Funny

      Woo-hoo! Slashdot beat Wikipedia. Slashdot didn't atrophy until 18 Sept. 2012.

    2. Re:...Wikipedia has "atrophied" since 2007... by Neil+Boekend · · Score: 3, Insightful

      Technical subjects usually have quite clear and correct wikipedia pages. As soon as politics enter it wikipedia is not reliable.

      --
      Well, I might have a way, but it only works on a semi spherical planet in a vacuum.
    3. Re:...Wikipedia has "atrophied" since 2007... by Anonymous Coward · · Score: 3, Informative

      imo, with Wikipedia, truth is not the goal. A certain point of view is the goal.

      Truth is explicitly off the table on Wikipedia
      Wikipedia:Verifiability, not truth

      Wikipedia's core sourcing policy, Wikipedia:Verifiability, used to define the threshold for inclusion in Wikipedia as "verifiability, not truth". "Verifiability" was used in this context to mean that material added to Wikipedia must have been published previously by a reliable source. Editors may not add their own views to articles simply because they believe them to be correct, and may not remove sources' views from articles simply because they disagree with them.

      ...

      Not truth: It is not good enough for information to be true, and it is definitely not good enough for you to (perhaps wrongly) believe it to be true. Wikipedia values accuracy, but it requires verifiability. You are allowed and encouraged to add material that is verifiable and true; you are absolutely prohibited from adding any material that is un-verifiable, with zero exceptions—even if the un-verifiable material is True.

      The "Verifiability" policy hinges on the definition of "reliable sources". On Wikipedia, that overwhelmingly means "Newspapers" and "News websites". You can take the rest from there.

      Outright falsehood can and will be published on Wikipedia as long as they are told by "reputable sources". The editors don't care. They edit articles for agit-prop purposes, according to whatever ideological script they happen to be reading from (it varies from article group to article group). Expert opinions, primary sources, published literature? Out the fucking window if some blogger at the NYT says autism causes cancer or whatever their latest Netflix bingeing brain fart.

    4. Re:...Wikipedia has "atrophied" since 2007... by Anonymous Coward · · Score: 3, Insightful

      The "Verifiability" policy hinges on the definition of "reliable sources". On Wikipedia, that overwhelmingly means "Newspapers" and "News websites". You can take the rest from there.

      Outright falsehood can and will be published on Wikipedia as long as they are told by "reputable sources".

      Meh, I just write what I want, then I Google for a book title that looks related and add that ISBN number as a source.
      It's not like someone will buy every book listed as a source and read through only to find out that the book never says anything about the subject.
      "Verifiability" doesn't mean that it is practical to verify, just that it is technically possible.
      Interestingly enough they don't allow original research, so testing something yourself and providing a method for others to repeat the experiment isn't sufficient. You need to at least write it to a discussion section in a tabloid so that you have something written to refer to.

    5. Re:...Wikipedia has "atrophied" since 2007... by alvinrod · · Score: 4, Insightful

      The underlying problem is that it's possible for a single person to essentially "own" an article and reject any changes they don't like and perpetually block anyone else from contributing. This has led to a large collection of petty fiefdoms across the site and many of the local lords getting cozy with one and other so that if anything does get run a little further up the flagpole it still has a chance of being outright ignored or buried under bureaucracy and rule lawyering.

      Wikipedia needs to change how their system works to allow for more collaboration and participation. I'd suggest a system where anyone can propose changes that are collected over a period of time until a group of individuals can work together to create new revisions of an article. Have other teams that are devoted solely to improving the grammar or readability of articles and others that are just looking to fact check the existing information to recommend removal of fallacious information. Perhaps even go so far as to assign people randomly to different teams and articles to mix it up and prevent the same kind of agenda-driven article ownership that we see so often now.

    6. Re:...Wikipedia has "atrophied" since 2007... by AmiMoJo · · Score: 4, Insightful

      It's more a case of editors selecting the sources that confirm their point of view, and attacking the ones that don't as either not reliable enough or by relegating them to an opposing view footnote somewhere.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    7. Re:...Wikipedia has "atrophied" since 2007... by Anonymous Coward · · Score: 4, Insightful

      As soon as politics enter it, nothing is reliable.

    8. Re:...Wikipedia has "atrophied" since 2007... by ErroneousBee · · Score: 4, Insightful

      Technical subjects on wikipedia are never clear. They are jargonated, use obscure notation and never have a simple illuminating example.

      --
      **TODO** Steal someone elses sig.
    9. Re:...Wikipedia has "atrophied" since 2007... by tlhIngan · · Score: 4, Interesting

      The big problem with Wikipedia is that in spite of what the publicity says, it is only a small number of people who contribute, and a surprisingly large number of those people have an agenda for what they edit.

      imo, with Wikipedia, truth is not the goal. A certain point of view is the goal.

      No, the big problem with Wikipedia is politics. Wikipedia is the reinvention of communism, and it's proceeding just like Animal Farm and other Communist nations down the path to failure.

      Heck, it's already at the "Everyone is equal, but some are more equal than others" stage.

      That's the main problem - you have editors and higher ups who now patrol their part of Wikipedia who are not interested in the truth, correctness or other aspects - just in having little power struggles. Heck, for a time there were massive parts being deleted for arbitrary reasons (usually along the lines of "this content is not suitable for Wikipedia" despite having plenty of similar content around). And these days, well, edit-reversions by the same power-mad editors have basically rendered any reason to edit it moot.

      I mean, there's a small amount of contributors because everyone else got driven away. Try to fix a mistake and you'll et into an edit war with an editor who thinks their interpretation is completely correct even if it's obviously wrong.

      Yes, it's an encyclopedia anyone can edit. Except that if you do so, chances are someone will revert it in a few minutes because they don't agree with what you edited, even if all you did was fix an error. "Everyone has equal edit rights, but some people have more equal edit rights".

      The study of Wikipedia itself is quite fascinating, no many times you get to see political ideology put into play and see the results. Usually you end up with people getting hurt or humanitarian crises if you try to experiment.

    10. Re:...Wikipedia has "atrophied" since 2007... by Rei · · Score: 4, Funny

      Two classics. :)

      1.Proof by ghost reference:
              Nothing even remotely resembling the cited theorem appears in the reference given.

      2. Proof by reference to inaccessible literature:
              The author cites a simple corollary of a theorem to be found in a privately circulated memoir of the Slovenian Philological Society, 1883.

      --
      *Kid Rock runs for Senate* Democrats: We must run Kid Scissors.
  3. wikipedia is self-correcting by circletimessquare · · Score: 4, Insightful

    pointing to corrections that haven't been done yet doesn't mean anything. if something is obscure and unimportant it can persist for years, with no impact. and then it's corrected. if it's important, it will probably be corrected in days or minutes

    can anyone point to any other media that this isn't true about? (i'm not talking about corrections, that may never be made, simply that all media has a backlog of errors that need correcting)

    and questioning wikipedia's veracity, alone, has no value

    judge it against other options and their veracity

    the traditional encyclopedia is subject to the editorial whims of professionals, and professionals can have agendas and are not automatically superior to a mass of impartial folk. emphasis on "mass." as thousands of editors, even if there's been a drop in participation, is superior to an overworked few with questionable biases

    and please note we're talking about brief introductions to topics, not deep dives into esoteric academic specialties. wikipedia is never intended as a replacement for serious texts on topics. and if someone is relying on wikipedia alone for vital topics, that's the reader's fault, not wikipedia

    wikipedia's innate superiority is the same reason we have juries instead of professional judges. professional judges can start deciding cases based on having something to prove: "i'm finding this guy guilty because i made the previous guy innocent" or "this guy is clearly innocent, but it's important to send a message, so i'm finding him guilty"

    certainly, a million examples of bad juries can be found. we can find problems with the jury system that are truly horrible

    as if that means anything. because all other options are worse

    this is classic form of propaganda, half-truth, cognitive fallacy: criticism in a vacuum

    outside of the context of other choices, anything can be made to look like shit

    for example, we can criticize all sort so problems with democracy. there are many problems with democracy and they are real and major. it's just that our other options are clearly worse

    likewise with wikipedia: you can list thousands of things wrong with wikipedia, some truly horrendous

    but it's still superior to what came before and other current options

    --
    intellectual property law is philosophically incoherent. it is your moral duty to ignore it or sabotage it
    1. Re:wikipedia is self-correcting by AmiMoJo · · Score: 3, Interesting

      What you say is only true if lots of people can participate equally. Wikipedia has a lot of cliques and groups with agendas where editors support each other to promote a particular view or bias, so it's just as bad or worse than having a single editor writing the material.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
  4. Wikipedia is convenient, not accurate by QuietLagoon · · Score: 4, Insightful
    The popularity of Wikipedia is due more to the convenience of citing an article in it, and not necessarily the accuracy of those articles. You can usually be assured that, no matter the topic, there's an article on the topic in Wikipedia, and that google will return a link to that article near or at the top of search results.

    .
    It is easy to use Wikipedia,

    It is that ease to use, rather than accuracy, that has made Wikipedia as popular as it is.

  5. Wikipedia has exactly one problem... by pla · · Score: 5, Insightful

    The obnoxious cliques of senior editors with god complexes make it virtually impossible to correct anything of substance. And Jimbo cares fuck-all about it as long as enough people click the donation button.

    Sure, you can get into revision wars over whether to use the word "which" or "that" in a given context; but fixing a factual error? Good luck!

    "Citation needed!"
    "But the old, wrong version didn't have a cite either."
    "Doesn't matter, it stays, and my minimum wage burger flipping ass has just banned you for daring to challenge me, you pompous PhD-wielding expert in this particular field!"

    1. Re:Wikipedia has exactly one problem... by Dr.+Evil · · Score: 4, Funny

      ..."burger flipping ass has just banned you for daring to challenge me, you pompous PhD-wielding expert"...

      Burger-flipping and PhD aren't mutually exclusive.

    2. Re:Wikipedia has exactly one problem... by Andreas+Kolbe · · Score: 3, Interesting

      Wikipedians do seem to operate on the assumption that existing content, even if completely made up, is somehow superior to any recent change, as though content gained legitimate merit and factuality simply by being in Wikipedia. There was a concrete example of this in the edit history of the Thoreau case mentioned in the Washington Post article. The hoaxer had made up a reference to make their nonsense stick. When the hoaxer later himself tried to delete the hoax again, another Wikipedian REVERTED them, saying, "Rv; the information is referenced; if you say it's wrong, prove it." Just because the content had been on Wikipedia for a few months, it was assumed it must be correct. Discussed in more detail here.

  6. Two Important Reasons. by BlackHawk-666 · · Score: 5, Funny

    In many of the more relaxed civilizations on the Outer Eastern Rim of the Galaxy, the Wikipedia has already supplanted the great Encyclopedia Galactica as the standard repository of all knowledge and wisdom, for though it has many omissions and contains much that is apocryphal, or at least wildly inaccurate, it scores over the older, more pedestrian work in two important respects.

    First, it is slightly cheaper; and secondly it has the words Don't Panic inscribed in large friendly letters on its cover.

    --
    All those moments will be lost in time, like tears in rain.
  7. It's the citing of hoaxes that's a bigger concern by neilo_1701D · · Score: 3, Informative

    If people want to monkey with Wikipedia, have at it. We're told over and over again that Wikipedia is not a suitable reference; however the references on the page can sometime be useful.

    And then there's http://www.dailydot.com/lol/am...

    The person in the story inserted a little fake factoid into an otherwise proper article. This little factoid ended up very quickly
        - cited in a lesson plan by a Taiwanese English professor
        - cited in a book about Jews and Jesus
        - cited in innumerable blog posts and book reports, as well as a piece by blogger Hanny Hernandez, who speculated that Amelia Bedelia’s tendency toward malapropisms was inspired by Parish’s experiences in Cameroon, as “several messages can be
          misinterpreted between a Cameroonian maid who is serving an American family.” One blogger even speculated that Amelia Bedelia wasn’t a maid, but a slave.
        - cited in the Amelia Bedelia entry on the website TV Tropes and Idioms, and Peggy Parish’s Find-A-Grave page
        - cited by Mr. Amelia Bedelia himself: Herman Parish, Peggy’s nephew and author of the books after his aunt passed away in 1988, who apparently told a reporter from the Waterloo-Cedar Falls Courier that his aunt based “the lead character on a French colonial
          maid in Cameroon.”

    Once again, Wikipedia can be a useful overview of a subject and a launch-pad for further research. But after all these years of Wikipedia hoaxes (and Wikipedia maintains a list of hoaxes; http://en.wikipedia.org/wiki/W...), the mantra must be "trust but verify".

    Because, in Wikipedia's own words:

    Misinformation on Wikipedia misleads readers, causing them to make errors with real consequences, including hurt feelings, public embarrassment, reprints of books, lost points on school assignments, and other costs. With some articles, like medical topics, they could lead to injury or death.

  8. Ive compiled a list. by nimbius · · Score: 4, Funny

    Having worked on this problem for a while, ive found exactly 5 total hoaxes on wikipedia (no more.) Please remove the following articles:

    1. Edward Snowden: is not actually a person, this is an old wives tale. E. Snowden is a hybrid cultivar of the genus Aechmea in the Bromeliad family.
    2. 9/11: Although commonly thought of as a terrorist attack that claimed the lives of several thousand americans, this too is just a silly rumour. 9/11 is a town and municipality located in the province and autonomous community of Navarre, northern Spain.
    3. Barack Obama: This fools several laymen and scholars alike! Obama isnt a president, but was a motor race set to Formula One rules, held on 30 July 1950. The race was won by Argentinean driver Juan Manuel Fangio after a distance of 68 laps.
    4. Christmas: Again, not a holiday at all. He was actually a Polish Air Force Captain and Allied double agent during World War II, using the codename Brutus. After having been offered safety by the Germans, he was sent to England as an agent. However, he made himself known to the British authorities. He was de-briefed by the British (MI6) and Polish authorities about the security lapses of his organization in France. And thats why we have Christmas trees today!
    5. Computers: could NEVER have been real, and most of us know this one to be true. The computer is actually a Ukrainian professional football coach and a former player. As of 2009, he works as an assistant coach with FC Dnipro Dnipropetrovsk.

    --
    Good people go to bed earlier.
  9. Re:Sounds like it's working to me by thekohser · · Score: 4, Informative

    I have to agree. The experiment cited modified 30 articles with minor and cleverly-chosen falsehoods, and more than half were fixed within two months.

    From that, Kohs then claims, "I think this has proved, beyond a reasonable doubt, that it's not fair to say Wikipedia is 'self-correcting.'"

    Um, WTF? That statement proves he's not very good at making accurate statements. If he added a time period to that, and maybe some disclaimer about the popularity of articles being modified, then it wouldn't be much of a point, but it'd be closer to true.

    You conveniently leave out that Kohs himself (that's me) reverted 6 of the false edits himself, when it became clear after more than 45 days that nobody else was likely to do it anytime soon.

    You're also being rather unfair to say that Kohs' statement -- a sound-bite that the Washington Post journalist selected from a lengthy telephone interview -- which you then rip away from the context of the article, "proves" that I'm not good at making accurate statements. Why don't you peruse the actual spreadsheet of the 30 articles, which speaks for itself on my ability to convey accurate information?

  10. Self-fulfilling prophecies by Andy_R · · Score: 4, Interesting

    The Coati (a small member of the raccoon family native to Brazil) is also known as the Brazillian aardvark. The reason that it's known as the Brazillian aadvark is that someone made the phrase up and added it to Wikipedia - but the coinage gained traction, because journalists copied it, and this led to a citation for that name being added to the article. Now wikipedia is in a quandary... there are, thanks to lazy journalists, people who know the coati as the Brazillian aardvark, because they read that in a newspaper... so is the hoax now true?

    Does it become true if the dord of references to that name reaches a certain level?
    Does it become false even though people do use the term, just because the etymology of the word was a hoax?

    --
    A pizza of radius z and thickness a has a volume of pi z z a
  11. Re:Learn how to use Wikipedia ... by AthanasiusKircher · · Score: 3, Insightful

    Oddly enough, people question the Wikipedia when it gives more information about the providence of the writing and content than virtually any other source, yet people insist upon making blanket statements about how unreliable it is. All that really says is that people want an authoritative source rather than a verifiable source. They want someone to tell them what is "true" rather than giving them the tools to assess what they are reading.

    I get tired of reading apologetics for Wikipedia that present false dichotomies.

    "Oh... but things used to be so much worse with other sources which were so bad and evil and... so be grateful for the crap that is Wikipedia today!!"

    Nonsense.

    Look, just because other things may have been bad or worse in some ways doesn't mean we should accept the stupidity that is Wikipedia.

    For example -- there are already vetting processes in place (somewhat) for getting articles approved on Wikipedia as having "good" status, etc. These review processes generally involve doing such things as checking to see sources actually correspond to what's in the article, etc.

    Here's the obvious question -- why not actually create "stable" version of "good" articles, and have that be the default page for that article? Make it so such articles can no longer be edited directly -- instead, anonymous editors and random users can edit an "unstable" or "testing" or whatever version of a page that can be easily accessed through a tab (like the talk and history pages, etc. can be now). Periodically an established editor can clean up such proposed edits and migrate the good ones to the "stable" page.

    Ideally, approved edits to the stable page should be approved by a consensus of editors for that particular page, some of whom may actually be experts in a subject. I know a LOT of academics who spent a little time here or there and tried to edit Wikipedia, because they actually would like to see it made better, but they get driven away by the politics and bureaucratic nonsense. What if we could actually get them involved? What if they could actually be verified and help to determine what makes it into the "stable" versions of articles that they actually know something about... you know, like old-style encyclopedias used to.

    But there could always be checks and balances -- edits need to be approved by 2 or 3 editors with an appropriate level of "clearance" for that page, for example. There are many ways of working out the exact details, but something like this could raise the quality level of central articles significantly -- those stubs on the fringes can still operate as the "wild west" where anybody can edit the live page until someone creates a stable good version.

    You don't need to give away authority completely to experts -- have mixtures of experts and other editorial staff able to approve edits. You don't need to lose the tracking information. In fact, you get even MORE tracking information, and you get a "sandbox" for stable pages for better versions to be worked out and incorporated into existing articles.

    Or whatever. I don't claim to have all the answers. But I do know that there are serious and legitimate criticisms of Wikipedia's model, and some aspects are just going to get worse (and some have been for some time). Anonymous "wild west style" editing for just about anything was a great way to crowdsouce and build a resource... but it's time to hone this into something better, and that requires people with real skills: subject matter experts, experts in editing, etc.

    We should never shut the contributions from crowdsourcing out -- but we can still improve the Wikipedia model while not falling back onto old crappy models either.