Slashdot Mirror


Infrequent Anonymous Cowards Reliable on Wikipedia

Hugh Pickens writes "Researchers at Dartmouth University have recently discovered that infrequent anonymous contributors, so called "Good Samaritans," are as reliable as registered users who update constantly and have a reputation to maintain. A graph from page 31 of the group's original paper (pdf file) shows that the quality of contributions of anonymous users goes down as the number of edits increases while quality goes up with the number of edits for registered users."

28 of 264 comments (clear)

  1. Not news by Titoxd · · Score: 5, Interesting

    Unlike what some users may tell you, many anonymous users contribute content and not vandalize. The quality of the edits per se is all over the place, but this is to be expected, as there is no way a new contributor can know all the nuances of the in-house referencing system, or the indications made by the Manual of Style. But they do try.

    ~~~~

    1. Re:Not news by Titoxd · · Score: 2, Interesting

      I'm not really sure I understood the second part of the comment, but I agree with the first part. However, you'd be surprised at the number of people who don't. To prohibit anonymous editing is actually a perennial proposal which comes up periodically. However, studies like these really help debunk the perception that IP editors are inherently bad.

      ~~~~

    2. Re:Not news by fluffman86 · · Score: 3, Interesting

      Even for a registered user like myself this is difficult. I never got around to editing much, but when I did I'd get a notice criticizing my edit for putting periods and commas "inside quotation marks," as opposed to "outside". It seems like the other editors just disregarded the fact that I corrected some major grammatical flaws. I soon stopped making edits while logged in and just waited on other people to fix most problems. :(

      (By the way, in US english, commas and periods should ALWAYS go inside the quotes.)

    3. Re:Not news by Petrushka · · Score: 3, Interesting

      The graph they show is practically meaningless.

      • First, the graph shows that the retention rate for all contributors is below 1%. I find that pretty hard to swallow in the first place, and it makes me doubt that it's based on good data, though I suppose the decimal point could be an error (I'm hoping so).
      • Secondly, the graph shows a continuous line, though the x axis is clearly discrete. Based on the graph, the retention rate for non-registered contributors who have made one edit is about 0.72%; all well and good. How is it that we are given a retention rate for contributors who have made one and a half edits? How is it that we are given a retention rate for contributors who have made no edits? Has any thought at all gone into this?

      The rest of the study may possibly have some good stuff in it, but the incompetence that has gone into this graph leaves me with grave reservations. I notice, for example, that the main body on p. 15 refers to "FIGURE 2 ABOUT HERE". I also notice that there is no figure 2. I don't think this study has a shred of credibility.

    4. Re:Not news by sammyF70 · · Score: 2, Interesting

      Same here. I did a few anonymous edits on Wikipedia, mostly because I knew that the original text was erroneous and correcting it didn't take more than a few minutes. So far, the entry were not removed or even altered.

      --
      "DRM is like the Ford Pinto: it's a smooth ride, right up the point at which it explodes and ruins your day."-C.Doctorow
    5. Re:Not news by FuturePastNow · · Score: 4, Interesting

      I am not a registered Wikipedia user, so anything I do is anonymous. I've only made a few (3 or 4) edits to articles, always to fix minor typos or spelling errors I've seen while reading.

      Every time I have done so, it has been rolled back within minutes, which I assume means that registered editors are watching for anonymous changes and removing them no matter what. As a result, my current attitude towards Wiki editors can be summarized with the words "fuck you."

      Hopefully, some of those pricks will read this article and change their attitude, but I doubt it.

      --
      Give a man fire, and you warm him for the night. Set a man on fire, and you warm him for the rest of his life.
    6. Re:Not news by dgatwood · · Score: 4, Interesting

      The American style is inconsistent. We put question marks and exclamation points inside the quotes only if it is part of the quoted content. Note the difference in these sentences:

      Are you "working a late night"? (Translation: are you sleeping with your secretary? See comment below about terms used ironically.)
      I asked him, "Are you working a late night?" (I asked an innocent question.)

      Similarly, we treat punctuation with regards to parentheses in this way. A period goes inside the parentheses only if it is a complete sentence.

      I am smarter then you (but you knew that).
      I am smarter than you. (My dog is smarter than you.)

      However, the American style says to put periods and commas inside the quotation marks in all cases. I would argue that American usage is simply wrong here, as it is thoroughly inconsistent with all other punctuation combinations. Thus, I make it a point (despite being American) to ignore it and follow the much more rational British rules. The rules for punctuation should logically be determined by whether the punctuation is truly part of what is being quoted or not.

      For example, if I use a term in an ironic way, I might put that in quotes.

      The "nice girl" dumped me yesterday.
      In that context, if that were at the beginning or end of a sentence, punctuation should logically go outside the quotes.

      I got dumped by a "nice girl".

      Putting it inside the quotes implies that you are quoting the period as though "nice girl" were a complete sentence or some reasonable facsimile thereof. It just doesn't make sense. If a wookiee can live on Endor....

      The same holds true if you are using quotes to define new terminology (though this is less frequently done with quotes these days and more frequently done with boldface text or other typographic conventions).

      This type of memory is known as "Random Access Memory".

      This stands in contrast with cases in which punctuation would logically be part of the quote.

      "This is stupid," he said. (The comma takes the place of a period.)
      He said, "This is stiupid."

      But I digress.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    7. Re:Not news by Myopic · · Score: 2, Interesting

      (By the way, in US english, commas and periods should ALWAYS go inside the quotes.)

      Yes, but for a strange reason. American newspapermen couldn't be bothered with the nuances of the English language, even though some of the nuances were linguistically valuable. In this case, placement of punctuation inside or outside quotation marks relays information about the quote. I'm American so, you know, screw the redcoats and all that, but I think our stateside grammarians dropped the ball on this one.

  2. At what point do these posters become registered? by Nrbelex · · Score: 4, Interesting

    Another interesting study might determine how many posts a person usually makes before becoming registered...

  3. Is this why the delay between AC posts increases? by Anonymous Coward · · Score: 1, Interesting

    I remember the good old days when it was 2 minutes between posts, now it's sometimes 30-60 minutes. I'm pretty sure I'm being punished for other people on my ISP/school network.

  4. Lost Passwords? by mochan_s · · Score: 3, Interesting

    Maybe someone just forgot his/her password or don't want to login in library computers.

  5. Re:Or... by Reader+X · · Score: 2, Interesting

    This being Wikipedia, where they are by definition the same.

    It would be interesting to try that study with a commercial entity.

  6. Re:At what point do these posters become registere by Fallingcow · · Score: 3, Interesting

    I made a few grammar, punctuation, and spelling fixes before I ever bothered to register.

    If I'm not already logged in and see a minor problem in an article, I'll usually fix anonymously. Not worth the time to log in.

  7. Questionable methodology, questionable results by Raul654 · · Score: 3, Interesting

    The graph on page 31 is the retention rate of characters contributed by an editor relative to the total edits by that editor to the article ("The dependent variable is the retention rate, R, of contributions, measured as the percent of characters retained per contribution by each contributor.")

    This metric makes sense if the wiki is new, and most of the edits are adding new content. The metric is virtually meaningless if the wiki is established, and most of the edits by a group of people are vandalism or reverts - people fixing the article will have a lower score by virtue of the fact that they are making the same edit (more or less) over and over again.

    Normally, you'd expect that the more edits a user makes, the more trustworthy he is. If he were vandalizing, he wouldn't make more than a few before being blocked. If he's making hundreds, he should be considered more trust worthy (and have a higher retention rate) than if he's new. The results here show the exact opposite for anonymous users. In short, the methodology is flawed and the results are wrong.

    --


    To make laws that man cannot, and will not obey, serves to bring all law into contempt.
    --E.C. Stanton
    1. Re:Questionable methodology, questionable results by Raul654 · · Score: 2, Interesting

      "That said, I wonder if they took reversions into account in their analysis." - yes, they did, in a negative way. If you have an otherwise high trust metric and revert someone's edit back to the old version, then your retention rate as a percentage of characters divided by total edits goes down - in other words, you become less trust worthy after doing anti-vandal patrolling.

      --


      To make laws that man cannot, and will not obey, serves to bring all law into contempt.
      --E.C. Stanton
  8. What's the motivation to register? by EmbeddedJanitor · · Score: 2, Interesting

    I probably edit two entries a month (mainly corrections, sometimes minor additions). I'm not registered and I cannot see any real benefiit in doing so. Perhaps being registered allows you to add pages or modify GW Bush's entry or something but I have not been motivated enough to find out what the benefits are.

    --
    Engineering is the art of compromise.
  9. Road to hell paved with good intentions by SamP2 · · Score: 4, Interesting

    I fully admire the eagerness of individual contributors, anonymous or not, to improve Wikipedia.

    Unfortunately, not all edits which are good-intended actually contribute to the overall quality. Of course, edits which fix simple things like revert vandalism, fix a typo, update a number etc, are all good. But the rest pose a potential problem. First off, newcomers, while well-intented, simply do not know the way Wikipedia works. They may include unsourced or poorly sourced material, insert a POV without even realising it, piss off another editor by being careless (and thus start an edit war) etc.

    But even those edits which do not break any Wikipedia rules or guidelines still can cause damage, this time much more subtle. The thing is, a (good) Wikipedia article is not just a collection of facts, even if every single fact is relevant, neutral, sourced, and deserves to be in the article. An article is a unified piece of work. It should flow to the reader, not bump. Information must be properly organized and related to each other. A major suffering of Wikipedia is the so-called "contribution creep", where people just keep dumping more and more facts into the article. The result is grossly disproportional coverage of some sections compared to others, a huge overemphasis on bullet-point lists rather than coherent paragraphs, lots of small factoids which while each good on their own right, do not belong together, parts of articles being outdated compared to other parts, and a lot of other problems which make Wikipedia look like a search result by Google rather than a real encyclopedia.

    Early on, Wikipedia's first priority was to fill its databank with stuff, and all contributions (other than those breaking policy) were welcome. Recently, WP is at the stage of more stringent enforcement of policies, as well as guidelines and styleguides. And by all means, that is very important and should be the first priority. But it's not enough to be a good encyclopedia. Making sure everything is neutral, notable, verifiable, attributed, legal, and formatted according to style, is all sub-article tasks, which you apply to a particular sentence, paragraph, or image. But then you have to pause for a moment and look at an article at the big picture. Does it flow smoothly? Are all sections balanced? Are all parts equally updated? Would an average reader get a proportional representation from the article?

    You can easily handle the sub-article problems (those that break a clearcut policy or guideline) contributions from anonymous edits (as well as non-anonymous edits). But "Contribution creep" is biggest problem to the overall article, where there is no clearcut right or wrong. And that's why, no matter how important anonymous edits are to Wikipedia (and they certainly are), the already developed articles should be marked as "revised" and new contributions screened before updating them. Not because of potential vandalism or policy violations (those are easy to fix), but precisely to manage contribution creep and make sure well-intented contributions don't introduce speedbumps to an article and break its coherent organization and flow.

    1. Re:Road to hell paved with good intentions by Anonymous Coward · · Score: 2, Interesting

      No matter how many editors there are, there are going to be topics that some people who are not editors know more about.
      So if someone sees something lacking, they should be free to add to it. If the content they add isn't formatted correctly or
      whatever, that is what editors should fix, no?
      As it stands, I've made minor modifications to wikipedia as well as attempting to add at least two pages that have links
      to the page already, but aren't filled out. The modifications went ok, but last I checked the pages I tried to add still aren't
      there. I don't care if I didn't add enough information to the pages or sourced it correctly. The fact that those pages don't
      exist means that, apparently, no one else knows enough or cares enough about the subject to add them (and, of course,
      the content I added didn't pass whatever approval process is necessary).
      It's getting to the point where I think wikipedia is an inappropriate name.

  10. This is true... by FuzzyDaddy · · Score: 3, Interesting
    I've made only one edit ever on Wikipedia, in the section on heat pipes. I happened to notice a minor, but not insignificant, omission.

    I would imagine that most single edits are like that - someone with a good depth of knowledge on a subject, noticing something that's not quite right. The threshold for action is high enough that you'd only do it if it was worthwhile.

    --
    It's not wasting time, I'm educating myself.
  11. ease of logging in by sh3l1 · · Score: 5, Interesting

    I often don't log in when i want to edit an article, because i don't care how my "rep" is, i just want to fix something.

    --
    Help Me! I'm trapped in the tubes! Oh noes! Here comes a internet!
  12. Yo, mod point tanks by skulgnome · · Score: 3, Interesting

    This here post is properly termed "insightful", rather than "funny". It may be funny because it's true, but it's insightful first.

  13. Re:Of course... by maggard · · Score: 3, Interesting

    Really? I just checked the half dozen edits Ive made over the past six months. The 5 trivial ones are all intact, and the extensive one (transportation in the town I live in) was edited & rearranged, for the better.

    Perhaps the quality of the edits is important.

    --
    I don't read ACs: If a post isn't worth so much as a nom de plume to its author then I wont bother either.
  14. Re:Of course... by 1u3hr · · Score: 2, Interesting
    1,2,3...

    Yes, I did try to communicate with him, and no I wasn't abusive. He ignored me.

    I'm not "way too angry". I only mentioned it at all in answer to a direct question. At the time I was pissed because I'd spent time and thought "giving back" to the community only to have it deleted and be insulted for my trouble. I got over it a few minutes later and haven't mentioned it to anyone till now. Now I know Wikipedia is infested with self-important twats who like to play power games, so I don't waste my effort on it.

  15. Re:Of course... by britneys+9th+husband · · Score: 2, Interesting

    This anti vandal bot's talk page has plenty of examples of mistakes. ~~~~

    --
    Hear recorded Slashdot headlines on your phone! New service beta testing. Just call (248) 434-5508
  16. Re:Of course... by 1u3hr · · Score: 2, Interesting
    I said I'm not inclined to believe you, but that does not equate me calling you a liar.

    Yes it does. Weasel words.

    these claims always come up in wikipedia discussions on slashdot, and I've yet to see evidence for them

    I don't "always make these claims". I'm talking, for the first time, about something that happened to me, personally. So if you don't believe me, you are calling me, personally, a liar. Your smug response is exactly what exacerbates these situations.

    If these "claims" are not true, why do so many people make them? A vast conspiracy?

  17. my experiance by petermgreen · · Score: 2, Interesting

    anon contributors tend to be the sort that only make minor contributions, sure they fix a typo or add something useful from time to time but it is the long termers who do the real meat of the editing trying to keep structure to the articles, add citations and so on.

    --
    note: i'm known as plugwash most places but i screwd up registering that here somehow in the past and now can't register
  18. I find this to be true by Espectr0 · · Score: 2, Interesting

    I am not a registered user, but i browse wikipedia quite frequently, and when i spot a simple error, i usually modify it. I think that lots of the anonymous contributors have this same pattern, so i am not impressed with this study.

  19. Re:... and more reliable than Slashdot summaries by njfuzzy · · Score: 2, Interesting

    Interestingly, Dartmouth College is structurally a University-- it consists of multiple distinct schools or colleges. (Dartmouth College, Dartmouth Medical School, Thayer School of Engineering, and Tuck School of Business.) I always wondered why it was still called "Dartmouth College", and perhaps the Dartmouth University in Canada explains that.

    --
    My Photography - http://ian-x.com
    The Deathlings (comic) - http://thedeathlings.com