Wikipedia Founder Sees Serious Quality Problems
Juha-Matti Laurio writes "The Wikipedia co-founder Jimmy Wales has acknowledged there are real quality problems with the online project. From the article: 'Meanwhile, criticism from outside the Wikipedia camp has been rebuffed with a ferocious blend of irrationality and vigor that's almost unprecedented in our experience: if you thought Apple, Amiga, Mozilla or OS/2 fans were er, ... passionate, you haven't met a wiki-fiddler.'"
It's clearly benefited Slashdot. The story quality and lack of dupes proves it.
I'm seeing more and more people use it as their de facto source for information.
Cake or Death? Cake Please!
What other encyclopedia chronicles the history of slashdot?
http://en.wikipedia.org/wiki/Slashdot_history
No Sigs!
I've debated people here and they use wikipedia facts that were wrong as proof they were right. It drove me crazy... he wouldn't take any other source no matter how many, wikipedia was the spoken word. Yikes.
In a perfect world wikipedia would work, but people aren't perfect, and people have agendas... that is why it will never be taken seriously with anyone outside the community.
It's still one of the best destinations and tools on the Net. Everytime I show it to someone who has never seen it, they're blown away.
Bark less. Wag more.
These people still can't hold a candle to Jack Thompson.
You see? You see? Your stupid minds! Stupid! Stupid!
Wikipedia usually works, in my experience, especially on popular or controversial articles. Just within the last hour, another editor and I had a dispute over whether "dry mouth" is a negative or neutral effect of marijuana. We went back and forth a few times but we eventually agreed to combine that postive and negative effect lists, and now it is all settled. Such compromise is not always possible but it is much of the time and the system usually works.
"It is not how things are in the world that is mystical, but that it exists." -Ludwig Wittgenstein
A solution I liked was to make the publicly-editable entries into an unstable branch, and to promote versions of pages that have been fact-checked and have been agreed to be up to Wikipedia standards into a stable branch. Redirect anonymous viewers to stable pages if available, and mark each version as to which branch it belongs to.
It never will. And that's OK.
Wikipedia can be valuable even in mediocrity. I've used it as a "jumping off" point for knowledge about things that aren't covered in more traditional sources. Want to know the origins of "all your base are belong to us"? Wikipedia is great for that sort of trivia. Want an in-depth explanation of Relativity? You probably don't want to necessarily trust Wikipedia for the last word on it, but you might be able to find a few pointers to some good books.
Wikipedia is what it is. As long as everyone understands what it is, it'll do fine.
Sometimes it's best to just let stupid people be stupid.
Could there be a commercial opportunity in forking Wikipedia, and then having an advertising-supported business hire some editors and professionals to verify Wikipedia articles, perhaps in conjunction with other content? Or perhaps having a university fork Wikipedia and then flag which edits have been verified, or edited, by students or professors of the subjects covered by a particular article? Or perhaps introducing a Slashdot-style moderation system (where you can by default, for instance, only see edits which are rated 5*'s or higher?)
http://amishthrasher.blogspot.com/
Actually there's only one step. You don't need an account. Gee, what other site do I know that allows anonymous random folks to spout off nonsense... *looks around*
It seems like this is sort of a trend. I mean, didn't vandalism and trolling force the introduction of the moderation system here? And didn't that happen nearly everywhere on the web as discussion boards increased in size? Anyone see a trend? It seems that once it goes from a clubhouse to a gym, you start to get bad apples.
Another poster suggested a leveling system, and I agree. I think that wikipedia should establish a system whereby articles are ranked, i.e. culture - specialized - mainstream or something. That way, as you start out, you can work on culture articles, then work your way up. Or maybe base it on page views and specialization. People who just joined can make new articles (to fill the missing ones) or can work on general articles that are rarely viewed, then work their way up.
Wikipedia is an excellent online source of information. But because of its name, critics hold Wikipedia to the same standard as an encyclopedia. I certainly don't think it's the same thing as an encyclopedia, a wiki's open and collaborative nature is fundamentally different from the construct of an encyclopedia. It's not better or worse, it's just a different thing.
It's not like the Register doesn't have accuracy issues either.
Test your net with Netalyzr
By it's nature, Wikipedia is no good for academic research or as the final authority on anything. That said, if I want an overview of what something is all about, and the information doesn't have to be 100% accurate, then Wikipedia is the way to go.
Think about the information you would get by just Googling something. You're just as likely, probably more likely, to come up with garbage information. The difference at Wikipedia is that it's been reviewed by many eyes, and it's not under the sole control of some random dude with who has a web page.
Users should, of course, be aware of the potential for bad information. In fact, I'd recommend to any user who hasn't yet, you should read their What Wikipedia Is Not page.
A case in point is the Wikipedia page on the village of Mellor, a small village that has languished on the edge of obscurity for 14,000 years and I'd swear it still had some of its original inhabitants walking around. The odds of there being more than two or three on Slashdot who have ever been there is virtually nil.
Because of the limited editing it gets, the accuracy is probably higher than normal. HOWEVER, any inaccuracy probably lasts longer than normal, for the same reason.
Pages that get edited frequently probably lose errors a lot faster, but gain new ones equally fast. In that sense, it is no different from computer programming, where rapid development cycles create as many (or more) bugs than they fix - although, they're usually different bugs the next time round.
I think Wikipedia would benefit from some sort of development cycle, where an "in progress" copy of the article is maintained, then occasionally snapshotted to create the "official" copy. For "non real-time" articles, I would suggest that pages not significantly edited for, say, 36 or 72 hours be treated as a "final revision". (A minor alteration would be the adding/removing of symbols such as commas and apostrophes.)
This would give you the "anyone can edit" freewheeling anarchy of the current system, the live, raw feel that some apparently crave, and yet also provide a version that has some semblance of consent behind it, something that maybe isn't perfect but is good enough for now. It's not exactly QA, in the usual sense, but it's still QA, in that you've got to not find any showstoppers within some deadline.
A "traditional"(!) wikipedia with deliberately de-synchronised mainstream version would probably not be the best solution, but I honestly can't think of a better one while keeping the current approach.
It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
Hey, it's not like "paper" encyclopedias don't have problems. Just open up encyclopedias printed in the 60's-70's in the US and in USSR and read a few chapters on socialism and communism. :-)
Just hold on for a minute!
Wikipedia is far from a thousand monkeys pounding on typewriters. Yes, some contributors are not the most experienced, but if many contributors, even those ignorant about a particular aspect of knowledge, try to self edit and get the details right, over time the result will be so positive that conductive breakdown will occur and lightning will happen.
Consider this. When Hardy saw Ramanujan's for the first time, he figured that "a single look at them is enough to show that they could only be written down by a mathematician of the highest class. They must be true, for if they were not true, no one would have had the imagination to invent them". Similarly, Wikipedia info is no joke - there are so many serious articles that people put enormous effort into. This should encourage anyone who really cares about any shortcoming to put some work into making the marginal improvements that ultimately benefit us all.
A message to people who have poor communications skills - just express yourself. Do not give in to embarrassment. Put in your knowledge and take a look at other articles. Even copying someone else's style will enable you to enhance your input. If someone edits your work, that's supposed to be a good thing, as long as you maintain the attitude of writing with higher and higher quality.
Know your pads. One time pad: good for cryptography. Two timing pad: where to take your mistress.
Register: Wikipedia Inaccurate, Badly-Written
Pots, kettles war over who's the blackest
[Story body here]
And behind the scenes are a half million desperate nerds trying to be right about something, all while defending this exercise in social onanism as a "community" effort to provide a free educational resource to people.
Much as I'd like you to simply be a troll, there's a lot of truth in that. I've recently started contributing to Wikipedia myself, and I seriously question my motivations; am I just indulging my anal-retentive geek (or rather less flatteringly, nerd) nature when contributing information about frankly unimportant stuff?
And believe me, I don't think I'm the worst case by a very long shot. There are COUNTLESS contributors out there seemingly editing stuff, and adding stuff or making changes in for ego's sake. I don't want to go on about this, but the vandals aren't the problem. They're easily reverted and usually transparent. The problem is the anal-retentive-and-don't-get-it-or-don't-care fact-adders who will (for example), clutter up abbreviation disambiguation pages (such as 'MC' or whatever) with very poor entries. These are at best obscure uses of 'MC', where those using such an abbrevation would know what it means anyway. At worst, they simply take anything they can think of that consists of an 'M'-word then 'C'-word, and slap it in, even if it's an obscure subject and no-one actually uses that abbreviation.
Just an example, but it's dross. And it has to be said that if there is any particular tendency in such addition of inconsequential garbage, it's most noticeable in the geek/nerd manga/sci-fi/computer-gaming subject areas.
They don't get that slapping down a load of facts *isn't* the same as writing a good article; I'm not sure that they care, they're simply writing for the sake of it- if it's about anything, it's about their pet interest. It's this stuff that justifies (in part at least) the "social onanism" tag given in the parent post.
"Slashdot - News and Chat Sites Deviant". (Click "homepage" link above for details).
The real challenge is finding the volunteers to fix all the obscure articles. People work on what they find interesting, and if no contributors find a topic interesting, it's not going to get fixed.
The problem is that a lot of the obscure stuff that *is* there is in areas where geek (or rather nerd) types have interests, and it's not always that well-written. In fact, I think this is arguably at the top of the (otherwised unordered) list of problems with Wikipedia:-
(1) The anal-retentive "fact"-adding tendency. Those who'll add obscure/unused abbrevs to a *disambiguation* page. They don't get that some facts are more important than others, or that simply adding information to an article doesn't necessarily make it more helpful. They'll create lots of small stub articles, when they'd be better combined in a single article (placing them in context). If there's one thing I've learned as I get older, it's that leaving stuff out is *hard* but very important. You can't include everything. And you have to order that information well. The self-indulgent factoid geeks don't know or care about this.
(2) Change for change's sake. I'd be interested to see the amount of "churn" that goes on in some articles simply caused by people changing stuff for the sake of it. It's not necessarily a bad thing; it's just pointlessly wasted effort over a minor issue.
(3) *Potential* subversion by those with an agenda, including professionals. I've seen at least one instance of what appeared to be a PR person editing anonymously. This is dangerous, because most zealots with an agenda are transparent; PR and the like are professionals, and more likely to slip under the radar.
(4) Vandalism; annoying, but usually pretty obvious
(5) Lack of citation. This is very rare, and whilst normal encyclopedias don't normally include citations, Wikipedia's credibility would be much enhanced with more of them.
There are probably more, but my brain is full; that's enough to be going on with...
"Slashdot - News and Chat Sites Deviant". (Click "homepage" link above for details).
Why not have a rating system? They should make a rating system, so you could add Informative, Incomplete, Biased, etc, and have articles with particularly low ratings flagged for review (do they do something like this already?).
I think they should lock a lot more articles that are known to be complete and accurate. The definition of, say, orange juice hasn't changed all that much in the last 10 years and probably won't in the next 10.
Working these two concepts in together, I think they should have the 'modifiability' of the article be based on how high it's rated. For just a stub, or no article at all, then anyone should be able to modify it. But if the article is long (enough) and complete, then say maybe only a register with many high-rated articles can change it.
I think the main idea here is to promote and protect good content, but I seriously think they should not do anything to restrict an average joe from exlpicitly adding content.
Anyone else there think I'm on the right track?
Partial Credit: The Engineer's Best friend
"Well, the bridge didn't fall all the way down!"
Lets test this theory out and take a look at the wikipedia entry for a British band that was popular in the early 80's, Theatre of Hate.
http://en.wikipedia.org/wiki/Theatre_of_Hate
Led by singer/songwriter Kirk Brandon, the original group also consisted of: guitarist Simon Werner, bassist Jonathan Werner and drummer Jim Walker.
Incorrect, Simon and Jonathan were in a previous band with Kirk Brandon, The Pack.
Theatre of Hate garnered much early attention as a live act and in 1981 made their debut with the concert LP "He Who Dares Wins Live at the Warehouse Leeds".
Incorrect, the album was "He Who Dares Wins Live in Berlin".
Shortly after the album's release however, Brandon fired the remainder of the band an assembled a new line-up consisting of: guitarist Billy Duffy, bassist Stan Stammers, saxophonist John Lennard and drummer Nigel Preston (who was soon after replaced by Luke Rendle).
Incorrect. Stammers, Lennard, and Rendle were already in the band. Rendle was fired and replaced with Preston.
Another concert recording, "Live at the Lyceum", followed in 1982 before Theatre of Hate entered the studio with producer Mick Jones of the Clash to record their first non-live album debut, "Westworld", which went on to reach the UK Top 20. The album also spawned the Top 40 single "Do You Believe in the Westworld?".
The only correct sentences, although Westworld made the top 10.
In late 1982, Theatre of Hate released another live album entitled "He Who Dares Wins: Live in Berlin."
Incorrect, see the above correction.
In early 1983 the Theatre of Hate disbanded. Brandon went on to front Spear of Destiny and guitarist Billy Duffy formed the group Southern Death Cult, which would later become enormously successful after shortening their name to The Cult.
Incorrect, Billy Duffy joined The Death Cult, along with Ian Astbury, the singer for disbanded Southern Death Cult.
So, out of 7 sentences, only 2 were correct. Why was it again that I should trust Wikipedia as a source of information?
Just because the website exists, doesn't mean that I am obligated to correct misinformation.
I don't agree with the article (or the other article The Register article refers to) either. In particular I find it slightly cooincidental that the first of two "random articles" he looked up just happened to be one on Bill Gates.
Although upon reading it I find the article is pretty much a fair, balanced and informative article. It is undoubtably an article about one of the most despised persons from the point of view of internet people.
The fact that he "just happened to randomly look it up" I find dubious. Its like opening a Jewish Encyclopedia and "randomly" looking up an article about Hitler.
I've heard people say, "Wikipedia is like a public toilet; when you need, you're glad it's there, but you never know who was there before you".
I've been editing Wikipedia for about a year now, and while I find some of the utopian aspects (i.e. allowing anybody, even anonymous users, to edit) to be intellectually appealing, the result is, without a doubt, mostly crap. Instead of spending my time improving quality, I spend my time fighting blatant vandals, well-intentioned idiots, and clueless newbies. And what time is left over gets eaten up in silly beaurocracy.
Like many /.'ers, I do software development for a living. No software development project (or any big project, be it buiding a space ship or digging ditches) would survive with the attitude that anybody can do anything they want. People need to both be educated as to the right way to do things and prove themselves trustworthy.
Wikipedia is a great resource. I turn to it often to get background, or find out interesting facts about almost anything. But I wouldn't trust it for anything important.
The "tortured prose" of this Register article is apparent in their lack of details on how the Bill Gates and Jane Fonda Wikipedia entries are "unreadable crap" (in Jimmy Wales' words). We're merely told this repeatedly, but the Register never backs their argument (or Wales'). Also, one sees another instance of the double-standards which are tolerated for judging Wikipedia and Encyclopedia Britannica.
If "[s]omething that aspires to be a reference work ought to be judged by the quality of the worst entry" then why are we only allowed to judge one encyclopedia—Wikipedia—on that basis? With such a ridiculously high bar, it's easy to hand-pick articles one knows a great deal about and see if the encyclopedia in question measures up.
Which brings me to the next problematic criticism of these encyclopedias: drawing conclusions by weighing too small a sample. I recall that EB's former editor used exactly one entry to conclude that Wikipedia is akin to filth one is likely to find in a public bathroom (or words to that effect). The Register article's critique centers on reviews of two Wikipedia articles—Bill Gates and Jane Fonda's entries. The only way to reach the conclusion that EB has a "handful of errors" (as the Register says) is to do a survey; you can't judge articles you've never read. It seems to me that a proper review of a large encyclopedia would require a far larger sample size than a "handful" of articles in order to justify any reasonable conclusions about quality, no matter what those conclusions were.
Finally, the Register article mentions a few "respon[ses] to criticism" but doesn't actually critique these responses with a proper explanation. Just because one is told something like "this is what my critics will tell you" doesn't mean you have reason to dismiss the criticism. If one is interested in learning what's really going on, one has an obligation to think about the critique and weigh it on its merits. I "welcome the candour" as well the Register does, but I certainly want my candour to come with examples to back up points. When I evaluate EB using the guidelines I'm told to evaluate Wikipedia by, I come up with the conclusion that EB is merely different from, not better than, Wikipedia. And this conclusion I arrive at without giving any credit to Wikipedia for being free (as in the freedom to share and modify) which EB most certainly isn't. So, if I happen to be a victim of EB's "HUAC", I can't do anything to improve EB without going through the gatekeepers that registered their unwillingness to examine the above topics at all.
Digital Citizen
Uh, if it was just some nobody who rolled back the changes why don't you just reinstate them?
Why on earth would you blame Wikipedia?
"Nine times out of ten, starting a fire is not the best way to solve the problem." - my wife
All Jimmy Wales actually said was that two articles were terribly written. Wales has always had a goal of high quality in Wikipedia. Having two poorly written articles out of over three quarters of a million is hardly an admission of "Quality problems" except for the two particular articles cited. (yes, there are other articles that need work as well.)
... which seems as good a description as any to us."""
:-).
The real issue here is the repeated attacks by this reporter: Remember Andrew Orlowski is the same reporter who wrote about Wikipedia :
""""It's the Khmer Rouge in diapers,"
Clearly Andrew has found that Wikipedia bashing is an easy meal ticket and that is the actual source of his over-exaggerated headline writing. Orlonski needs to get paid and he needs his editors to view him as a positive asset, drawing lots of eyeballs to the Register website. A quick Google for Orlowski and Wikipedia shows a long, slanted history for our boy Andy.
There is a verb for this: "Dvoraking" "To Dvorak"
"The act of trolling by a supposedly 'professional' journalist in order to draw visitors to a webpage generating hits for the paid advertisements."
In fact, given this background information Andrew Orlowski has less real credibility than, say, your average slashdot poster.
Orlowski isn't a total waste of time however. After all he has noted that: "Segway's brains head for toy robot", "Microsoft FAT patent rejected - again", and the incredible "Police stake out bar, hoping to catch man drunk"
Wow, Andrew! Whats next? I wait in breathless anticipation.
(What, proofread this? not worth the time, Andrew.)
I'm not flaming here - but I don't think it's that big of a deal if an article on Bill Gates or Jane Fonda is inaccurate. I'll bet the one on Evolution isn't too great, either - but this is what Wikipedia is about. Let me explain:
To hear EB talk about it, you would think that the only good encyclopedia entry on Bill Gates would include factual information about his birth, life, finances, etc. That's fine if you are writing a history book for schoolchildren, but what Wikipedia does is actually captures the cultural moment around an issue - the fact that Bill Gates' article is inaccurate is because there is so much contention surrounding him.
To my eyes, Britannica is enforcing a cultural imperialism that the only right information is Politically Correct whitewashed facts. While that certainly is important, for instance, if you are really looking for the best definition of "evolution" or an impartial recounting of facts about Jane Fonda, that's not what Wikipedia does.
It captures the fullest dimension of the issues - the facts (as they are percieved) and all the culturally significant alternate views as well. Imagine what value future anthropologists might glean from a snapshot of Wikipedia - they wouldn't care who Bill Gates was in any kind of factual way - they would want to see what the world thought of him. Or the WTO, the World Bank, Greenpeace - you get the idea.
Wikipedia works best for geeky subjects.
I don't think that's true. Wikipedia's featured articles come from all categories. That's certainly not a perfect proof of my point, but an indication.
(6) The idiot who thinks he's funny. In fact, so funny, that _everyone_ should find his stand-up comedy act when seriously searching for information. In fact, heck, everyone should be mandated by law to read his jokes, but finding them instead of actual info is almost an acceptable substitute.
I still remember one article in the German wikipedia... about cloning didgeridoos. Complete with a picture of tiny little digeridoos in test tubes, and a paragraph about how they live longer than the ones born naturally. About a year later, it was still there. (Now it's finally gone, though.)
OK, so it's a sorta the bastard child of your points 3 and 4. Except while the PR professional knows they're subverting and polluting a resource for profit, and the vandal knows they're defacing, the "funny" idiot might actually think he's doing a public service.
A polar bear is a cartesian bear after a coordinate transform.
Why does every project like this have to be "the next big thing". Why do we have to compare to the E. Britanica and rabidly defend Wikipedia with ever more elaborate answers? Wikipedia is an interesting project, and extremely useful as a starting point for research. That's good enough for me - leave the "Wiki-religion" outside.
Different things are "trivia" to different people. From my perspective, the birthdate and biography of someone who lived hundreds of years ago (except for someone historically significant, e.g. Shakespeare or Caesar) is trivia, while a rundown of the features in the latest World of Warcraft patch is not. I imagine the opposite is true for you. My interests are a closer match to Wikipedia than yours, so I'll use that (bearing in mind that it's constantly in motion and checking the Talk and Article History pages as necessary). You have more historical interest, and so a more conventional encyclopedia is probably a better fit for you. It's no shame to Wikipedia that they lack good information in some areas--simply a matter of specialization.
I suspect that this trend will continue. Wikipedia will continue to expand in geek-friendly and pop-culture areas, while articles one would expect to find in Encyclopedia Britannica will be left mostly empty. If you're looking for the title of a Star Trek episode or a comic book supervillain, check Wikipedia; for articles on Ancient Greece, use Encarta. Most teachers don't accept Wikipedia as a bibliographic source anyway, due to the possibility of students editing a Wikipedia article and then quoting themselves authoritatively. I think that as long as people (including Jimmy Wales, the founder) compare Wikipedia to Britannica and expect it to measure up, they'll continue to be disappointed--they're simply different things with different strengths. That's all there is to it.
Information wants to be anthropomorphized!