Slashdot Mirror


Wikipedia 2.0, Now With Trust?

USB EVDO writes "The online encyclopedia is set to trial two systems aimed at boosting readers' confidence in its accuracy. Over the past few years, a series of measures aimed at reducing the threat of vandalism and boosting public confidence in Wikipedia have been developed. Last month a project designed independently of Wikipedia, called WikiScanner, allowed people to work out what the motivations behind certain entries might be by revealing which people or organizations the contributions were made by. Meanwhile the Wikimedia Foundation, the non-profit that oversees the online encyclopedia, now says it is poised to trial a host of new trust-based capabilities."

35 of 228 comments (clear)

  1. An interesting experiment by speaker+of+the+truth · · Score: 4, Insightful

    Wikipedia is good enough for personal information or simply a quick look, i.e. unimportant information, however I doubt it will ever become the encyclopaedia it supposedly hopes of becoming. However having said that, it is certainly an interesting experiment and look into human nature (or at least American nature) with this trust-based scheme simply making the experiment more interesting.

    --
    Using openSUSE instead of Windows since 9th of October, 2007 and liking it.
    1. Re:An interesting experiment by CRCulver · · Score: 4, Interesting

      The problem is that many other reference sites on various topics, developed privately by informed and qualified individuals, have now folded since the maintainers thought Wikipedia superseded hosting such information on one's own website. And now, such information on Wikipedia can be vandalized at any moment right before someone would go look at the page, and kooks can twist the page to their own ends.

    2. Re:An interesting experiment by Anonymous Coward · · Score: 5, Insightful

      I don't know. Personally, I have found exactly what I have wanted from wikipedia every time I have looked into it - on articles ranging from people, geography or technology. Every time I wanted somebody to know something, wikipedia has never failed me. Granted, you may see traces/evidences of vandalism, but give me a system without any amount of noise in it. While you jump up and down shouting 'because anybody can edit it, it can not be trusted', I can simply not think any other website/reference/system capable of replacing wikipedia. And what I find funny is that you - the doubters - end up using it nonetheless.

      Give me an alternative to wikipedia with less noise in it, or shut the fuck up.

    3. Re:An interesting experiment by Snowspinner · · Score: 4, Insightful

      Except, generally speaking, we do OK. Yes, there will still be vandalized/spammed entries. But, as someone who uses Wikipedia frequently both as a reader and as an editor, I can tell you, I rarely run into an article with transparently serious problems. Thus far, as many new techniques and workarounds as trolls, pranksters, and scammers have figured out, none have been able to overcome the one technique we've figured out - having a shitload of well-intentioned volunteers who are broadly empowered to fix things.

    4. Re:An interesting experiment by Ash+Vince · · Score: 5, Insightful

      Actually I think alot of you miss a vitally important part of wikipedia when used to serious research: The references at the bottom of the page.

      I would never actually quote wikipedia as a source in serious documents, but you don't have as a lot of the best pages have a bibliography at the bottom which quite often refers to thoroughly respected publications.

      --
      I dont read /. to RTFA, I read /. to offend people in ignorance.
    5. Re:An interesting experiment by nine-times · · Score: 5, Insightful

      Every time this issue comes up, I make the same suggestion: the Wikipedia should branch into something like "stable" and "unstable" versions. Let the kooks vandalize the unstable version, but try to get trusted editors and fact-checkers to check-in changes to the stable branch.

      First, this keeps the kooks out. Second, if you limit trust strictly enough, then you limit the number of people who can do damage to the stable branch. You set up a review process for those people, which should be easier since there are fewer of them and they're somehow in your "trust" system. Give them instructions that all information that's presented as fact needs to be cited to a reliable source, and have someone watching the watchmen. If any of your fact checkers or experts violate their trust, revoke their trust.

    6. Re:An interesting experiment by joeszilagyi · · Score: 3, Informative

      Stable and unstable versions exist on the German wikipedia, but the English (main) Wikipedia users and admins have been very resistant to the idea.

      --
      Dude, where's my packet?
    7. Re:An interesting experiment by BakaHoushi · · Score: 4, Insightful

      Wikipedia, if you'll allow me to use emotional buzzwords for a minute as if I were a politician in a debate, is a great example of democracy and freedom of speech. The truth is, we'd like all signal and no noise, but to try and rid yourself of all noise, you're going to lose some signal. By forbidding a certain action/author/etc. on Wikipedia, you may ban 100 vandals, but you also ban 1 extremely useful editor. To let the truly insightful speak, you need to let the truly braindead have their say, too.

      The best way to deal with this is our old favorite saying, "citation needed." Like any information source, you need to ask "where did this information come from?" Using Wikipedia for serious work is a bad idea... directly... but it is a good place to find links to other places with more direct credibility.

      Not to mention one should always check the "recent edits" pages for signs of vandals.

      Wikipedia is imperfect, but so are the creatures that make it, so it's to be expected. It has a vast array of information that is hard to find anywhere else, and one of the best ways to look up "Amazon Wildlife" without running into horrible fetish porn sites along the way. So as long as people are willing to read and think and have a grain of salt ready, it will remain a valuable and interesting source of information.

    8. Re:An interesting experiment by zanybrainy941 · · Score: 3, Insightful

      Personally, I have found exactly what I have wanted from wikipedia every time I have looked

      How do you know? You found something, you read something, it passed the sniff test ... now, what is the truth value of what you found?

      Personally, I love Wikipedia for answering questions like "what is this thing and where does it fit into the big picture". I also think there are a lot of capable motivated people making sure that it's as close to true as possible. Still, if you're relying on it for some specific fact, you'd better check a second source. Which is good practice no matter what you're reading, wikipedia or otherwise.

    9. Re:An interesting experiment by diamondmagic · · Score: 3, Informative

      Unlike many encyclopedias, Wikipedia actually requires editors cite sources. All added information is required to have a source, otherwise someone else will come by and add a [citation needed] notice. You can check out all the articles that don't have sources cited.

      Try clicking on the numbers next to each sentence next time you stop by.

    10. Re:An interesting experiment by Kadin2048 · · Score: 5, Insightful

      Yes, kids use Brittannica as a primary source, along with other Encyclopedias. People don't start citing research papers or hard data until college (and even then, only in Grad School for a lot of colleges - sad huh?). The reason it's acceptable, is because the Encyclopedia companies try to ensure all the information is accurate, and then print it. It can't be vandalized later, so it's generally more trustworthy than wikipedia is assuming it's not a really old edition. You say this as if it's a fact carved in stone, that can't be changed. If Wikipedia replaced Britannica for initial research, but teachers stick to their guns about not accepting it as an actual source (which they should not), perhaps it will force more students to start doing real research at a younger age. Using Britannica as a source seems just as inherently lazy as using Wikipedia, and I don't think that should be acceptable even at the high-school level.

      It's not like it's especially hard to drill down to real sources from most WP articles. Most controversial ones have citations, or at least a list of suggested reading, near the bottom. (And some articles, like ones on particular recent events, have direct links to primary source material, which you don't typically get in a traditional encyclopedia entry.) In some ways, it's a lot easier to begin doing real research from WP than it is from Britannica, and I think WP does a better job of encouraging skepticism and fact-checking skills.
      --
      "Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
    11. Re:An interesting experiment by maxwell+demon · · Score: 5, Insightful

      Actually to be sure you'd also have to check those references[1]. Because otherwise you still might fall for fake information[2] or original research pulled out of one's ass[3], as is proven by Murphy[4]. And by the way, one plus one is three[5].

      [1] April Fool: What you can do with references. Journal of Applied Fake 26 (1987), 424
      [2] Joe Sixpack: Resources I trust. Yellow Press Magazine 25 (2001), 321
      [3] A. S. Smith: Pulling and pushing. Yesterday's Research 42 (2010), 1876
      [4] Jack Murphy: What can go wrong. Oops Conference Procedings 7 (1991), 112
      [5] Frank Fake: New Arithmetics, Page 42. Stupid Press, New York 1976, ISBN 0-123-45678-9

      --
      The Tao of math: The numbers you can count are not the real numbers.
    12. Re:An interesting experiment by Eloquence · · Score: 3, Informative

      This is incorrect. Stable versions do not yet exist on the German Wikipedia.

    13. Re:An interesting experiment by MT628496 · · Score: 5, Insightful

      Give me an alternative to wikipedia with less noise in it, or shut the fuck up. Just because you don't have an answer, doesn't mean that there isn't a problem.
    14. Re:An interesting experiment by bob.appleyard · · Score: 4, Interesting

      I actually know someone who is a lecturer, and when he sets papers, goes on the relevant Wikipedia entries and inserts misinformation. Then, when this nonsense crops up in papers, marks them down in a "haha pwnt" sort of way. He says it's a way of teaching people not to rely on such sources.

      Of course, this raises questions of ethics. He's sabotaging a source of information in order to "teach a lesson" to his students. Wouldn't his time be better spent improving said source of information? isn't that his job, after all?

      --
      How dare you be so modest!! You conceited bastard!!
  2. fundamental flaw by daniel.waterfield · · Score: 3, Insightful

    Er, won't wikiscanner just move the corporate/political vandals to home? This is leaving out the fact that wikipedia will never be seriously trusted due to it's open nature, to be taken seriously requires it to close off public access and to change to specialised, academic authorship - something that would corrupt it's mission.

    --
    i know not what weapons the next world war will be fought with, but world war IV will be fought with sticks and stones.
  3. Irony: by Kymri · · Score: 3, Funny

    Seeing a 'Is Fox News fair and balanced?' poll as the ad for this story makes me amused.

    --
    Evolution ceases when stupidity can no longer be fatal.
  4. Won't change a thing by LordKazan · · Score: 5, Insightful

    I stopped editing wikipedia due to some extremely biased, shrill, and bludgeon-you-with-the-rules (claim you were violating the rules when you weren't) editors.

    One of these editors was an admin, another was on ArbCom. It was basically a group of people who would camp one specific subject and keep it edited to support the cultural status quo/their religion's position on the article. They did it through keeping information out of the article that would cast the subject in the disfavorable light it should have, and does in most of the non-english speaking world, and some of the english speaking world.

    These individuals would probably pass whatever trust-checking mechanism.

    The truth is not reached via consensus.

    --
    If you cannot keep politics out of your moderation remove yourself from the Mod Lottery.. NOW!
    1. Re:Won't change a thing by TheRaven64 · · Score: 3, Interesting

      The whole 'notability' requirement was one that really irritated me. I would have thought 'usefulness' was a much better standard for an encyclopaedia with no real size constraints. If a page is getting hits from people reading it, then it should count as sufficiently notable to remain, and not be deleted because it doesn't meet someone's standards for important. It's not like it's wasting shelf space...

      --
      I am TheRaven on Soylent News
  5. Better Living Through Benjamins by RobotRunAmok · · Score: 4, Interesting

    1. Pay contributors, i.e., give them revenue. Even micro-payments will do, pennies. (The added side-benefit of this is that it means contributors will most likely need paypal accounts, which most likely means they will be "of age:" No more changing entries as result of bets made in the back of the school bus.)

    2. Fire contributors who screw up, depriving them of that revenue.

    3. Problem solved.

    Anything else is a hippy-dippy feel-good buzz-word Web-X-point-something-or-other that begins with the letter "cluster."

    1. Re:Better Living Through Benjamins by Snowspinner · · Score: 5, Insightful

      Wikipedia gets hundreds of edits per minute. I don't think even micropayments are going to be cost-effective.

    2. Re:Better Living Through Benjamins by mrnobo1024 · · Score: 5, Interesting

      Plus, any kind of payment system would have people trying to game it, to the detriment of quality - if Wikipedia paid by the edit, they'd have people dragging out trivial changes through as many separate edits as possible, making the history tab practically unusable.

      Whereas on the other hand, if Wikipedia were to pay by amount of content added, this would be likely to lead to the rather undesirable consequence that editors of the aforementioned Internet-based encyclopedia might pad out their edits through the utilization of wholly unnecessary verbiage, guided by the realization that this practice would vastly increase their character count and therefore result in a larger payment to be made to the editors in question, granting to them a larger share of their economy's purchasing power - considered by many to be a desirable state of affairs, and certain to in some cases override any aesthetic misgivings that they might otherwise have had regarding the practice of composing overly long sentences such as this one.

  6. Wikipedia is fine how it is.. by Anonymous Coward · · Score: 3, Insightful

    There is nothing wrong with Wikipedia as it is. I have never trusted traditional encylopedias more than Wikipedia. There is often much more information available in Wikipedia than in a traditional encyclopedia. Furthermore the this comment is just plain dumb "Last month a project designed independently of Wikipedia, called WikiScanner, allowed people to work out what the motivations behind certain entries might be by revealing which people or organisations the contributions were made by." Who gives a crap who made the edit I'm only concerned with the accuracy or value of the information present; if you believe everything you read no amount of academic authorship is going to help anyone. I for one like to listen to whatever anyone has to say on any subject be they retarded or wearing a tin foil hat or if they are teaching at university.

  7. Flagged revisions on Wikipedia / mediawiki.org by saibot834 · · Score: 4, Informative
  8. rfta by distantbody · · Score: 3, Interesting

    And yet the simplest and most effective quality control, requiring registration, is still considered sacrilege to the Wikipedia overlords...

  9. Re:OpenID by erlehmann · · Score: 3, Informative

    also, wikimedia does already have OpenID support.
    http://www.mediawiki.org/wiki/Extension:OpenID

  10. Link to the actual New Scientist article by sczimme · · Score: 5, Informative


    Instead of using a link to a sub-optimal blog site, how about a link to the actual New Scientist article.

    --
    I want to drag this out as long as possible. Bring me my protractor.
  11. Re:Truth vs consensus by Thanatopsis · · Score: 5, Insightful

    Truth by consensus? That's not how the scientific world works. There's the whole experimental model and reproducibility of experiments that leads to consensus.

  12. Comment removed by account_deleted · · Score: 3, Insightful

    Comment removed based on user account deletion

  13. Re:Wikipedia: Pop Culture Resource by Snowspinner · · Score: 4, Insightful

    I dunno. Out of the 30 articles featured and to-be-featured on the main page in September, 7 are popular culture articles. (An article on D&D, the "Bus Uncle" video clip, the pilot episode of Smallville, OutKast's "Hey Ya," Alison Bechdel's graphic novel "Fun Home, the Indian film Lage Raho Munna Bhai, and tomorrow's featured article on Blood Sugar Sex Magik) Yes, that list skews a bit geek (Though the Bechdel graphic novel is about as far from a geek comic as one can get), but there's still 23 featured articles this month on such geeky topics as meteorology, European rugby, Soviet history, and American industrial disasters.

    It's more accurate to say that we, compared to similar reference works, have a disproportionately good coverage of geeky topics. That does not appear to have come at the cost of our coverage of other topics.

  14. Re:Truth vs consensus by smallfries · · Score: 4, Interesting

    Well, anyone who reads self-help books has a problem with understanding reality, let alone truth. Let's examine this wishy-washy new age idea that truth is a consensus consisting of a lot of compromises. I think that this idea is completely flawed on every level. You obviously do not. What consensus do we reach; that it's only partly a bunch of shit?

    To back your point up you mention that things like "history" work less well than things like "thermodynamics". Do you really believe this is because people understand each other's views on science subjects more than arts subjects? That a consensus position can more easily be reached?

    The basic problem with this theory of truth by consensus is that it assumes that truth is not discrete, and it can be reached by majority voting. In many subjects truth is discrete, and the voting model is closer to winner-takes-all. The reason that the truth crystallizes in this manner is because it is objectively testable. This is why we refer to the set of things that behaves in this manner - science. That which can be studied by the scientific method.

    Furthermore, I think that you have a fundamental misunderstanding of what wikipedia's purpose is. It has very explicit design goals, using your terms, it attempts to construct articles that have all of the known facts. That it, is ignores "understanding" as you put it, or POV as wiki puts it. If a fact can be attributed to a respectable source then it goes in. Understanding is left as an exercise for the reader.

    You miss the point that wiki is better for science, because in terms of establishing what the facts are, science subjects are the low hanging fruit. History (for example) is harder because the facts are not always in an objectively testable form, and usually have to pried from subjective observation. An ideal wikipedia article is not a "compromise" between all of the opinions that went into it - it is a collection of all of the facts that could be verified regardless of whether or not the contributors agreed upon them.

    --
    Slashdot: where don knuth is an idiot because he cant grasp the awesome power of php
  15. No longer everyone's knowledge, now just citations by kingduct · · Score: 5, Insightful

    I now find contributing to Wikipedia unbearable. At one time, everyone was supposed to contribute what they knew. It was a place for the world to create a new form of reference based on everyone's knowledge. Now, I find that if I contribute about things I know, I am told to find a citation. Thus, incorrect information with citations is allowed on, and good information without citations is removed. The goal is to look academic (like tradition resources) and not to let everyone share (like it originally was). It was incredibly frustrating to have people who had no idea what they were talking about start telling me that I was in the wrong for changing things.

    I can understand people wanting to make sure that the right stuff is put on the wikipedia. But shouldn't it be people with experience in the subject matter of the topic who go through and find what is wrong? Instead it seems like people attach themselves to articles and feel like rules changes in the wikipedia give them the power to control articles and show their academic formatting superiority, even when they know nothing about the topic. I still use the wikipedia some, but this change has actually made me lose some of my trust in it. Whereas before the wikipedia more openly admitted that it was imperfect and I took it for what it was, now it pretends to be perfect and in order to do so is reducing its validity and I distrust it for that pretension.

  16. Re:Wikipedia: Pop Culture Resource by Anonymous Coward · · Score: 3, Interesting

    Except for the notability crackdown. Unless the 5th season of Buffy is notable in some way, articles about it will probably be deleted with prejudice. I used to go to wikipedia to read trivia about every single episode of Futurama, but they've started cracking down on that; if a TV episide hasn't been nominated for an award, you might not be able to find it on WP in the coming future. (There are other possible reasons for something to be considered notable besides nominations, of course). "Trivia" sections are being removed from articles; long articles about "uncommon" subjects are being replaced with short summaries; articles that don't affirm their own notability will get speedily deleted; and, articles without adequate citations or good references will be tagged for future removal.

    Some editors say, "No, that's exaggerated---we rarely delete things!" That may have been true a few years ago, but that is not the currently policy. I've studied the recent editing guidelines and asked numerous questions in <irc://irc.freenode.net/#wikipedia>. Search wikipedia for something that doesn't exist; now, the 'not found' page has a new line, something like: the article may have been deleted for not meeting quality standards. Open an edit window for an article that doesn't currently exist; there are now multiple boldface warnings about certain things being candidates for speedy deletion. I'm afraid to contribute anything anymore. If I really feel like there's an important fact missing from an article, I'll try to visit a local college library and come up with some good sources, but, I wouldn't dare create a new article, because I know it would have little hope of surviving unless an editor happened to feel like looking for references instead of hitting delete.

    "Imagine everyone having access to all of human knowledge^W^W^W^Wonly the stuff we've deemed notable and non-frivolous. That's what we're trying to do."

    I used to resent the Wikipedia-Watch referring to the editors, arbiters, and overseers as a "hive mind," but, the recent policy changes have made increased the likelihood of a hivemind emerging.

    There's also a new system where there are a few overseers-to-the-overseers who can make an article or particular edit be deleted without showing up in the history log or deletion log; it's supposed to be reserved for the removal of private information, specifically in instances of the "right-to-disappear" and "right-to-anonymity" systems which allow an editor to protect their identity, if they so desire, when necessary. This can lead to strange situations where one user can make another user appear to be a vandal by careful manipulation of a page and posting of private information through multiple accounts; then, looking at the edit history diffs for a page can make vandalism appear to be caused by someone that it isn't, since certain edits are completely hidden. There's no way for anyone but the overseers-to-the-overseers to be able to tell if these kinds of nearly-invisible changes have even occurred on a certain article (or, at least, the pages outlining this policy seem to indicate this; whether some pages and edit histories might have a "Notice: some revisions are hidden to protect certain individuals' privacy, and some diffs may be inaccurate" notice somewhere on them is not documented, although I would hope that sort of notice will be added if it doesn't already exist.)

    I also wish that deleted articles could be viewed by the general public if they so choose. I understand that sometimes deletion is used in cases of illegal content, but, what about the perfectly-legal but uncited or non-notable deletions?

    There are also two database admins who have the power to do anything at all without leaving an audit trail (Jimmy Wales and one of the lead Wiki code developers, iirc), which is a little scary. It seems to go against the ideas that WP is supposed to stand for (opening edit model, visible history, etc). I only hope that it's usage is severely limited and that some am

  17. Re:No longer everyone's knowledge, now just citati by 808140 · · Score: 4, Insightful

    It is true that cited information that happens to be incorrect or misguided will often be difficult or impossible to remove due to the existence of a citation — this is clearly a problem. However, I do not see the other direction as being an issue.

    The fact is, nearly everything that is correct and accurate can indeed be cited. Wikipedia has, for very good reasons, a policy of not allowing original research — so anything you determine yourself is not admissible. But everything else is.

    I'm the sort of person that "knows" a lot of stuff. I have a lot of trivia and information stored in my brain; I'd wager many Slashdotters are similarly of the "know-it-all" variety. But I cannot tell you how many times I have sworn that some factoid or other was true only to discover in the course of research that I was either mistaken, or that the knowledge was somehow so obscure that no one else made any references to it whatsoever (which, let's face it, probably means I was mistaken).

    Unlike you, apparently, when this happens I thank my lucky stars that WP encourages citation of sources. When something is correct, finding a cite is a trivial endeavor, as it only amounts to telling them where you read what you're saying. When something is incorrect, your inability to find a cite will prevent you from looking like a daft fool by insisting something is true when it's not.

    Many people who think they are experts tend to assume that the "cite everything" policy that WP has adopted does not apply to them — but more often than not, these people are not actually experts. Real experts, who do research and read on their subject of expertise in an academic setting pretty much full time, are accustomed to citing their sources (although they are often not accustomed to WP's prohibition against original research — but that's something else entirely).

    As a rule of thumb, if you can't find a citation for what you know to be true, it's probably not true, and so I cannot empathize with your distaste for the citation requirement. However, I think you are right in your assessment of the problem in the other direction: citations can be of poor quality and be incorrect themselves, and people can be very unreceptive (read: belligerent) when you suggest that citation or no, their statement is either incorrect or POV or whatever.

  18. Re:No longer everyone's knowledge, now just citati by The+Earl+of+Sandwich · · Score: 3, Insightful

    At one time, everyone was supposed to contribute what they knew. In practice, many editors of Wikipedia believe they know things that aren't true. Since everybody's anonymous, there's no way to separate the real experts from the kooks. When you get right down to it, material just isn't useful unless it can be verified through references. This policy of demanding references is a matter of necessity, and not just an attempt to "look academic" as you make it out to be.