Slashdot Mirror


A Wikipedia WIthout Graffiti

Frequent Slashdot Contributor Bennett Haselton writes "I'm a Wikipedia junkie. There's nothing more fun than switching back and forth between reading about the history of human evolution, and following the latest speculation about the identity of the mysterious R.A.B. in the Harry Potter books, and Wikipedia is the best site to find it all in one place. But as a fan, it's always been frustrating for me knowing that Wikipedia could never improve beyond a certain point -- as it becomes more popular, it becomes more tempting to vandalize, and in turn becomes less reliable, a point that many have made already. That's why I'm excited that sites like Citizendium are approaching the same problem with a different model, one that could enable them to become what Wikipedia almost was, but which its intrinsic nature kept it from being: a central, reliable source of freely redistributable information about almost anything. The main difference is that Citizendium articles, after initially being built up through the same collaborative process that Wikipedia uses, will go into an editor-approved stage, at which point an editor (publicly identifiable on the article's history page) signs off on the accuracy of the article, and further edits also have to be approved by an editor."

Editor control over articles is controversial within the "radical collaboration" community; the Wikimedia foundation lists five "foundation issues that are essentially beyond debate", which includes "Ability of anyone to edit articles without registering". (In practice there are some safeguards in place to protect articles that are frequent targets of vandalism, like the George W. Bush entry.) But I'm fanatically results-oriented in my thinking, and I always ask: What are the purposes of this project, and how does this feature help achieve those purposes? It seems to me that a free online encyclopedia fills four main needs:

  1. A source of information about pop culture that can be fun to read even without being 100% sure that it's accurate (like who R.A.B. is)
  2. A source of information that can be freely and legally redistributed, e.g. by printing out copies for a class to read
  3. A source of information on subjects where you need to be close to 100% certain that the information is reliable -- at least as certain, say, as you would be if you read the same fact in several books
  4. A source of information that you can cite in a school paper as being reasonably authoritative and reliable
Anonymous authorship and real-time edits don't affect #1 or #2, and they actually hinder #3 and #4. Citizendium founder (and former Wikipedia board member) Larry Sanger said in a comment for this article, "There is no reason that [projects like Citizendium] even need be collaborative. What we're mainly interested in is reliable, independent/neutral, and free information." Such a statement -- "no reason that they even need to be collaborative" -- may be regarded by some Wikipedia devotees as heresy, but I think it hits the nail on the head. The purpose of such a project is defined by the quality of the information it produces. Collaboration is a possible means to that end, but collaboration itself is not the point.

For the reliability problem, I can't improve on this priceless sentence from Wikipedia's own "Citing Wikipedia" page:

For many purposes, but particularly in academia, Wikipedia may not be considered an acceptable source. [ citation needed ]
Wikipedia has actually done much better than I would have expected -- a study done in 2005 found that Wikipedia averaged about 4 errors per article compared to Britannica's 3, which is pretty good for a site where anybody can write that Columbus sailed to the New World in ships named the Ninja, the Pinto, and the Santa Fe. But for a site that harnesses the efforts of volunteers all over the world, I think the goal should be to surpass what has been done before, not just to tie with Britannica. And even if Wikipedia's error rate someday beats Britannica's, under its current model Wikipedia can never have the key property that Britannica has, which is that you can cite it as an authoritative source without sounding silly.

Citizendium's model of editor-approved articles, and editor approval of further edits to those articles, can help to achieve the benefits of collaboration, harnessing the efforts of volunteers, without falling into Wikipedia's traps. Assuming you can verify an editor's credentials (and we'll get to this in a minute), having an editor manage an article means two things: (a) you know the page wasn't vandalized in the last five minutes, and (b) you ought to be able to cite the work as a reference in a paper if your teacher isn't a total Luddite and you can explain to them how Citizendium works. Meanwhile, volunteers can still contribute without their own credentials being checked out; they can write as much as they want for an editor-approved article, as long as it's approved by the editor before going live.

There are still loopholes, of course. Currently Citizendium asks people to edit under their real name, but says that "we will use the honor principle to begin with", so anyone could claim to be a professor or a lunar astronaut. But the key words are "to begin with"; the difference between Wikipedia and Citizendium is that Citizendium views this as a loophole and not an intrinsic "community value", and loopholes can be fixed. To make the reliability as airtight as possible, I hope that Citizendium will eventually implement some sort of verification system, such as checking a professor's contact information on a Web page in the "faculty" section of an .edu Web server. I'm not instinctively thrilled by the thought of checking out volunteers' contact information, but it seems like the only way to achieve goals #3 and #4 above, so if it's as simple as sending a verification e-mail to an .edu address, that's a lot of gain for little effort. (Remember, this only has to be done for editors who sign off on articles, not for all volunteers. A non-editor volunteer could still ask to have their credentials checked out, so that they can be cited by their real name in the "end credits" of an article that lists volunteer contributors. But impersonation among regular volunteers is not likely to be a problem, since the editorial approval process ensures that only value-adding edits will be allowed, and it's unlikely that Alice would pretend to be Bob so that Bob can take all the glory of Alice's contributions to the project!)

Besides verifying authors' credentials, the one change that I hope Citizendium considers in the future is to give authors and editors credit at the top of each article -- or, for articles with many contributors, perhaps editors would be listed at the top and the "end credits" would list all contributors, on a separate page if necessary. This is because credited authorship for an article can help improve the article's usefulness in two ways -- the article can be cited as a reliable source, and the "name up in lights" factor rewards people for contributing more and better articles. Having authors listed only on the history page of an article, as they are in the current model, achieves the credibility benefit but not the "name up in lights" benefit. Larry Sanger suggested that having authors listed at the top of each article might put off readers from submitting edits -- if an article is perceived as being "owned", then others might feel like it's rude for them to change it. For me personally, this could go either way -- on the one hand, I might not realize that I was welcome to edit an article, but on the other hand, I think I might be more inclined to submit edits if I knew there was an editor in charge to keep someone else from frivolously overwriting my edits later. But in any case, to address this problem, each article could carry a banner at the top saying "Readers are encouraged to submit edits and other suggestions", and each paragraph could be accompanied by an "Edit" link, similar to Wikipedia (except that edits would go into a queue to be reviewed by the editor instead of going live). This would address the ownership-intimidation problem without taking away from the "name up in lights" factor. Sanger says that the Digital Universe Encyclopedia -- comprising the Encyclopedia of Earth and an Encyclopedia of the Cosmos, under development -- has plans to join with Citizendium and will use the credited-author model on their version of the site.

You might say that editors having their "name up in lights" would be an ego thing for editors, and I think you'd be right -- but I don't think this would be a bad thing, inasmuch as ego would motivate more people to become editors and do their best work. Perhaps I'd be wrong about this. Maybe a limited experiment could be carried out with two sites that are similar in every respect except that one allows editors and authors to take credit for their work, as might turn out to be the case with Citizendium and Encyclopedia of Earth. The point is that I don't think such a suggestion should be judged by whether it goes against the "spirit" of the project (as it certainly does in the case of Wikipedia!), but rather whether it helps to achieve the projects goals, such as goals #1 through #4 listed above.

There are still some problems that Citizendium's differences from Wikipedia won't solve. Many schools discourage citing Wikipedia not because it's written anonymously or because it contains errors, but because it's an encyclopedia. Yale's guidelines for citing Wikipedia state:

As an encyclopedia, Wikipedia is written for a common readership. But students in Yale courses are already consulting primary materials and learning from experts in the discipline. In this context, to rely on Wikipedia -- even when the material is accurate -- is to position your work as inexpert and immature.
Presumably many academics would have the same objections to a student citing Citizendium. I understand what these teachers mean, but I think this is a case of not thinking in terms of results. If the purpose of an assignment is to collect and present information, then any means of accomplishing that goal should be valid, including the easiest method of looking up the information in an encyclopedia. To make a student look beyond the encyclopedia, an assignment can simply require depth of research that goes beyond what the encyclopedia would provide. (Students, if you're worried that your teacher will take this to heart and make your assignments harder, just be happy that your teacher is hip enough to be reading this in the first place.) Some things are hard, but they should only be hard if they're intrinsically hard, not because you handicapped yourself with arbitrary rules.

But there is another, more permanent problem -- even with verification of authors' credentials, how do we know that the information in Citizendium articles is accurate? How do we know the author didn't make a mistake, or lie? This gets into deeper issues because these problems exist no matter what source you're consulting. There are books in print that deny the Holocaust or the possibility of evolution, and they're printed on real paper, with ISBN numbers and everything. Some of them even make it into libraries. How skeptical should we be of we read in books? In January two advocacy groups presented a report to Congress in which many government scientists said they felt pressured by the Bush administration to downplay the global warming threat in their statements. Does that mean statements from government scientists are inherently suspect?

And almost anyone who has had more than two articles written about them, knows the feeling of reading the article and reacting, "Wow, I had no idea that I was a transgendered NRA member who volunteers with the Moonies!" The New York Times is hosting an article about me from 2000 claiming that I was fired from Microsoft, when I actually quit. I showed them a copy of my personnel file with "Voluntary resignation" printed on it, but they have still refused to change the article. (When I first wrote to the paper's "Public Editor" about the matter, created to restore "reader credibility" after the Jayson Blair scandal, they replied that they wouldn't change the error because it never appeared in the print version of the paper. Huh?) I put up my own webpage to tell my side of the story, but if you were a Wikipedia or Citizendium editor and you had conflicting information from different sources, who would you believe, the New York Times, or a Web site called PublicEditorMyAss.com?

And yet, I freely admit that even today, I would trust a fact from the New York Times more than a fact from Bob's Bait And Tackle Shop And Technology Blog. We instinctively trust sources because of their reputation; we figure that they must have gotten their reputation somehow. This is not a great algorithm for deciding trustworthiness, but it may be the best that we can do -- in a world where we can't verify every fact firsthand, what choice do we have but to rely on sources that have provided mostly-reliable information in the past? (Wikipedia vandals are able to hack this mental algorithm because we think of Wikipedia as "one source" with a high average reliability, when it's really comprised of many sources, some of whom are deliberately less reliable than others.)

So, I think the Citizendium model is a move in the right direction -- taking into account the limits of what we can know from third-party sources, and doing the best we can within those limits. The least we can do is to know who has signed off on the accuracy of an article, so we can factor that into our decision to trust it. Last month Citizendium released their first editor-approved article, a single article about Biology. It may not look like anything revolutionary right now, but the difference between that and the Wikipedia entry is that you can't change the title of the Citizendium article to LARRY SANGER IS A BUTT BRAIN HA HA. You have to go through an editor for that.

11 of 290 comments (clear)

  1. A link makes a big difference by Reverse+Gear · · Score: 2, Interesting

    I think this very interesting article has a very good point when it says that it would be nice if contributers were allowed to recieve credit for their work. Especially if this credit would result in being allowed to have a link from your name like it does here on /. (the part with the link is my addition to what the article talks about)

    I know and agree that in the perfect world it shouldn't matter, but this world is not perfect. For those with a steady income and a good job they are happy with it doesn't matter so much, but for someone like me a link to my homepage often means the difference between if take the time to contribute or not.
    Traffic on a homepage equals income, at least for me and I do at times have to count the cents.
    I would really like to contribute with something worthwhile now and then and the link to my homepage justifies that I do spend the time on doing so.

    Right now I do not live from my web pages, I don't know if I want to, but with my present job status those returning visitors I do have on my webpage and blog are quite valuable to me as they might be the start of what I may have to turn to make a living, at least for a time, if no geophysics work shows up here soon.

  2. Join Up! Fight vandalism on wikipedia by 314m678 · · Score: 5, Interesting
    Download vandalFighter http://en.wikipedia.org/wiki/WP:VF


    Watch a livefeed of edits in real time.


    Click on suspicious ones to check them out, and revert when apropriate. It's easy, fun and satisifying.

  3. editors can be bought by gavinpquinn · · Score: 2, Interesting
    I think the trust would go down if it had a single editor. They can be centralized, and bought out like MS is doing, and the likes. I think they need a voting system sort of like http://www.grapheety.com. This would allow people to filter maybe by quality.

    I think also the original contributor should have some moderation rights, but not ultimate... Maybe based on your level, you can moderate, or over-moderate other people?

  4. Re:Wall o' text by quadelirus · · Score: 2, Interesting

    I love wikipedia, but it does have one important issue: it is increasingly banned from use in various forms of research, for instance, as a work cited in a research paper for school. Whether that is appropriate or not (I have mixed feelings on the subject myself) has no bearing on the fact that it is happening. Something like this, with accountable "expert" editorial control could prove to be a resource as powerful as wikipedia that also has the added benefit of being recognized by the larger acedemic community.

    Again, let me stress this, I'm not saying that the bans on wikipedia articles are right, just that they are happening. The main argument for the bans (whether flawed or not) seems to what is said to be a "lack of editorial control" (again, I'm not arguing this personally) and I think something like this could appease those currently banning wikipedia which is altogether a great resource for research.

  5. Compromise? by rrohbeck · · Score: 4, Interesting

    I always wonder why Wikipedia doesn't keep some kind of "merit" number for articles.
    Registered users could have a merit number based on how long they've been around, how many edits they made etc.
    Also, registered users could mod authors as well as articles (and, hence, their authors.) That would give each author a semi-reliable merit value. Then you could calculate a merit figure for an article from how much was contributed by whom and any mod points for the article itself.

  6. An example of Wikipedia's problem by Everyman · · Score: 5, Interesting

    One of the top administrators at Wikipedia goes by the name of Essjay. In an article by Stacy Schiff, a Pulitzer Prize-winning writer, Essjay is described as follows in the July 31, 2006 issue of The New Yorker magazine:

    "One regular on the site is a user known as Essjay, who holds a Ph.D. in theology and a degree in canon law and has written or contributed to sixteen thousand entries. A tenured professor of religion at a private university, Essjay made his first edit in February, 2005.... Essjay is serving a second term as chair of the mediation committee. He is also an admin, a bureaucrat, and a checkuser, which means that he is one of fourteen Wikipedians authorized to trace I.P. addresses in cases of suspected abuse. He often takes his laptop to class, so that he can be available to Wikipedians while giving a quiz, and he keeps an eye on twenty I.R.C. chat channels, where users often trade gossip about abuses they have witnessed."

    The information in The New Yorker came from his user page that he developed over the previous year. He pushed all the correct Wikipedia buttons: he said he was gay, an expert on Catholocism but an elder in a liberal Protestant church, he and his partner had both a cat and a dog, and he was past 30 but not yet 40. From credentials like this, and from his mind-boggling level of activity on Wikipedia, he became administrator, bureaucrat, checkuser, oversight, and last month was named a community manager at Wikia.

    Perhaps because he is employed by Wikia now, Essjay has coughed up his real name. He doesn't have two PhDs, and he isn't a tenured professor. He's a 24-year-old living near Louisville, Kentucky. The New Yorker, famous for its fact-checking, got it all wrong.

    Incidents like this illustrate the limitations of the Wikipedia approach. It's not an encyclopedia, but rather it's a video game that escaped from its box, and is now influencing real people in the real world.

  7. MyEditors by Doc+Ruby · · Score: 2, Interesting

    Who are these "trustworthy" central editors? And why can't I have a Wikipedia with edits applied from only those editors who I trust, or who my trusted friends trust?

    --

    --
    make install -not war

  8. Re:I'm not registering or logging in. by ZachPruckowski · · Score: 4, Interesting

    Eventually, once the site is public, that won't be the case. As it stands, the only people who should be on the wiki are the people working on articles. And yes, our Real Name Rule will ultimately require people who want to change articles to provide an email address. But anonymous people will be able to read the site once it leaves "pilot" status.

    Zach Pruckowski
    Citizendium Executive Board

  9. Re:Google needs a Creative Commons image search by smagruder · · Score: 2, Interesting

    Well, this much I know: Google developed a standard for sitemap XML, and other search engines are now working with it (e.g., Yahoo), or are about to work with it (e.g., Live.com). Further, Google and Yahoo currently provides a search for Creative Commons licensed textual content, which is taggable using particular XML on a page. I think it is fathomable that Google could work with Creative Commons to come up with a way of properly tagging CC-licensed images. And like with tagging textual content, tagging images would be voluntary. And that's the point -- people will be able to choose to release their images on their webpages for use on projects like the Wikipedia.

    --
    Steve Magruder, Metro Foodist
  10. Re:Wall o' text by turing_m · · Score: 2, Interesting

    Excellent comment.

    For something like this, there may actually be no real solution. Objectivity is a nice idea but probably impossible to achieve in practice. Different people have different axioms that make up their worldview, and what is true to one is not true to another. And most people will try and cry that their view is the balanced, objective one.

    There would also be a likely clustering of viewpoints. Allowing say, a pro-Israeli and pro-Palestinian page to be edited by each is a nice idea but still vulnerable to one side pretending to be the other in order to sway people looking at both sides in order to find a balanced viewpoint.

    I don't think there is a solution that one site can provide. That's why the more controversial a subject, the more caution I have in relying on wikipedia. Best to do a bit of searching around yourself, and throw a healthy amount of distrust google's way as well.

    --
    If I have seen further it is by stealing the Intellectual Property of giants.
  11. Re:Vaporware & longevity by LordVader717 · · Score: 2, Interesting

    Mod parent up!!

    The Citizendium article is exactly what I do not want to read when I look in an encyclopedia. It's just a hokey writeup, and contains very little information about the subject, but goes on endlessly about philosophical aspects which might be of no interest to the reader.

    Compare it to the Wikipedia article, which is considerably shorter, but contains links to different disciplines, history, interactions and diversity. I can click whatever I want and find out about the things that interest me.
    The title of one part of the CT article is "back to the baby". What's that going to be about?
    Add to that the craptastic quality of the images (It might be different in a HTML version, same goes for the links. I don't know though, they won't let me look at it)(They include a scan of a public health warning from god knows when to make a point about the benefits of the science. How off-topic is that?!)

    The other criticism I have for the project is the reason for it's failure, one which is by far more fundamentally flawed than Wikipedia. They want every article to be checked by an editor, and expect experts to vouluntarily supply them with information and work, from which they then choose what they want to include in their cornball editorials (sorry if this sounds offensive, but this would also be the view of someone who had his hard worked contribution rejected).
    They want editors to invest their time researching matters that don't interest them, to verify that contributions are genuine, and do this for every single article.
    The fact that they have only managed one article is confirms all of this. How long will it take until they have an actual encyclopedia, in which you can actually look up something that you happened to come across? And how long until the articles become outdated and needs to be redone? (Britannica 1910 edition is public domain, freer than Wikipedia and a "proper" encyclopedia. Three guesses why it isn't all that popular today.)
    Maybe they'd have a chance of achieving maturity if they payed people to do the work. See where this is going?

    What makes Wikipedia great is the amount of good, serious people, involved, often experts, who want to share their knowledge to the world.
    Trying to emulate the same kind of (quite arbitrary) complete oversight and authority that a commercial publisher has won't lead anywhere.

    There isn't really anything in that article worth citing, but if I did find something, there's no way I'd consider it much more reliable than Wikipedia, where I can see a number of links, the history of edits and a discussion page if I find myself questioning something.