Slashdot Mirror


Britannica Attacks - Nature Returns Fire

An anonymous reader writes "Just in case you missed it, Nature has replied to Britannica's criticism of the Nature Britannica-Wikipedia comparison. I think it is fair to say Nature is not sympathetic to Britannica's complaints." The original piece regarding the accuracy comparison, along with the response from Britannica.

26 of 217 comments (clear)

  1. The original comparison article by ktwombley · · Score: 5, Informative
    1. Re:The original comparison article by jokestress · · Score: 5, Funny
      Here's my favorite comparison:

      Wikipedia on Britannica

      vs.

      Britannica on Wikipedia

      --
      Evil sig is livE.
  2. Writing on the wall. by Whiney+Mac+Fanboy · · Score: 4, Insightful

    It's really becoming clear reading the article (to me, and probably to Britannica) that the writing is on the wall. Take this quote from the article:

    "Other objections are simply incorrect. The company has, for example, claimed that in one case we sent a reviewer material that did not come from any Britannica publication."

    That - right there is Brittanica getting desperate & flailing around attempting to attack anyone who criticizes them. Note - I don't think Wikipedia is going to 'take over' from Brittanica, its merely one of the many sources (albeit, currently the most important) you can turn to for free, online information.

    The niche that Brittanica used to fill is simply closing - I suggest Brittanica concentrates on expanding its scope rather then attacking criticism if it wants to survive in future.

    --
    There are shills on slashdot. Apparently, I'm one of them.
    1. Re:Writing on the wall. by benito27uk · · Score: 5, Insightful
      It's not 'flailing around attempting to attack anyone who criticizes them'. Britannica's argument is that Nature were selective in their use of articles from Britannica

      In one of the case's, the encyclopedia britannica claims that Nature used a 350 word introduction rather than the full 6000 word article on Lipids. If this is true I would say they have good reason to criticise Nature's article on the relevant merits of both encyclopedias.

      Nature has been remarkably reticent in allowing anyone to see the unabridged reviewer reports to enable readers to make their own judgements, part of their own response to Britannica's allegations states that they 'provided reviewers with chosen excerpts, not full articles; this was done with entries from both Encyclopaedia Britannica and Wikipedia. www.nature.com Making such arbritary decisions, and not detailing this in the original article is not what is expected of such a respectable publication

  3. It boils down to this by DrXym · · Score: 4, Insightful

    Britannica is authorative, peer reviewed and reliable but it costs money. Wikipedia can be spotty but is generally authorative, peer (+ idiot) reviewed and mostly reliable. It costs nothing but has massively more articles and can turn on a dime to cover current events, weather, popular culture etc.. While I feel sorry for Britannica, the simple fact is that most people are not going to fork a pile of cash when Wikipedia is good enough for day to day use.

    1. Re:It boils down to this by bunratty · · Score: 5, Insightful

      When I look something up on Wikipedia, it's usually something I wouldn't find in a general-purpose encyclopedia, even one that spans multiple shelves. Generally when I look something up in Wikipedia, the only alternative at hand is to use Google. What I find is that it's far easier to get the information I want on Wikipedia, and it's generally higher quality than information of the sites Google finds. And if Wikipedia doesn't have the information, I use Google to get it and add it to Wikipedia. The bottom line is that Wikipedia doesn't need to be as good as a paper or CD encyclopedia to do its job; it only needs to be better than the best search engines. In fact, it's often better than other enecyclopedias for me because of its incredible breadth of topics.

      --
      What a fool believes, he sees, no wise man has the power to reason away.
    2. Re:It boils down to this by Moby+Cock · · Score: 4, Interesting

      I agree with you 100%. I had a discussion on this very topic last week with some friends. One of them was concerned that Wikipedia will eventually cause Britannia (and the others) to be pushed out of business and when she does need more and better info than Wikipedia can provide there will be no other sources. An interesting thought.

      What if research libraries no longer have for-profit encyclopedias?

      After some though we realised that encyclopedias are not really primary references anyway. Wikipedia is good enough (even with jackasses vandalising pages) to get you to the proper primary references to continue research and as such serves its function weel. It is certainly good enough to settle day-to-day curioisity and is an excellen primer for more detailed research.

      Send a donation to Wikipedia, they deserve a little love.

    3. Re:It boils down to this by hey! · · Score: 5, Insightful

      Wikipedia can be spotty but is generally authorative

      Authoritative is exactly what the wikipedia is not.

      Authoritative doesn't mean "accurate", nor does it mean "informative", although these qualities contribute to authoritativeness. But to say a source is "authoritative" means it can be cited, and what makes a source citable is predictability. Authorities have their own biases, but at least those biases are documentable and predictable. If one looks at a nineteenth century Britannica for an article on colonialism, their bias is going to be fairly predictable. With Wikipedia, you might end up with a better, more informative, less biased article. Or you might end up with propaganda from one side or the other of an issue. Furthermore which side you get may depend on the day you look.

      Of course in practice this is less of an issue than it would seem. Hot button issues, may be Wikipedia's greatest strength, because many eyeballs expose the review process to the reader. However articles on obscure people or issues are unreliable in the extreme.

      I've often said that Wikipedia would be an excellent platform on which to create an authoritative source. Since it's possible to track every version and change to an article, all one needs to do is keep a database of "reviewed and accepted" articles to make your own purpose specific Wikipedia. For example, you could include this version of the George W Bush article in your database if you prefer the negative slant of the article lead. Then all anybody has to do is compare the version in your database to the version preferred by another group, e.g. like this, to know where your slant is.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
    4. Re:It boils down to this by KDR_11k · · Score: 5, Funny

      Now all Wikipedia needs to do is to put the words "Don't Panic!" in large, friendly letters on the cover and they are going to completely trash Britannica.

      --
      Justice is the sheep getting arrested while an impartial judge declares the vote void.
  4. Old media attacks itself by gihan_ripper · · Score: 4, Insightful

    I think it's amusing that an established publication (Britannica) is worried about another established and peer-reviewed publication (Nature) making favourable comparisons with Wikipedia. We should now see Britannica write about the similarities between Nature and the arXiv!

    --
    Phoenix, Boston, Little Rock, see a pattern?
  5. Um, what? by KDR_11k · · Score: 5, Funny

    Did Britain reestablish the Empire, increase their greenhouse gas production and get wiped out by a natural desaster? Are two hacker groups accusing each other? Is this some Ultima fan-fiction? What the hell is this story about?

    --
    Justice is the sheep getting arrested while an impartial judge declares the vote void.
  6. Encyclopedia Galactica by neoshroom · · Score: 5, Insightful

    Wikipedia is so much better than Britanica in so many ways. For example if you look up Allentown, Pennsylvania it tells me, "The city also is somewhat known for a Billy Joel song, "Allentown," which appeared on Joel's "The Nylon Curtain" (1982) and "Greatest Hits: Volume II" (1985) albums. The song depicts the resolve of Allentonians, amidst the rough and hardened life that characterizes this East Coast, industrial city. "Allentown" also references nearby Bethlehem, home of the then-declining (and now defunct) Bethlehem Steel Corporation." While this may not be a fact that is highbrow enough for inclusion in Britannica, this is actually one of the things I think of when I think of that city -- making it much more useful to me on a practical level.

    Or in other words:

    Here's what the Encyclopedia Galactica has to say about alcohol. It says that alcohol is a colorless volatile liquid formed by the fermentation of sugars and also notes its intoxicating effect on certain carbon-based life forms.

    The Hitchhiker's Guide to the Galaxy also mentions alcohol. It says that the best drink in existence is the Pan Galactic Gargle Blaster. It says that the effect of drinking a Pan Galactic Gargle Blaster is like having your brains smashed out by a slice of lemon wrapped round a large gold brick.

    Thats the difference.
    --
    Elephant Essays - Custom-created essays and research papers.

    --
    Big apple, new Yorik, undig it, something's unrotting in Edenmark.
    1. Re:Encyclopedia Galactica by constantnormal · · Score: 4, Insightful
      Interestingly enough, Douglas Adams penned this comparison of the Encyclopedia Galactica to The Hitchhiker's Guide in the BBC radio script for the origian radio broadcast of it in 1978, long before the existence of the public internet, portable computers or the WWW.

      Whoda thunk that The Encyclopedia Britannica would be compared to Wikipedia in such an eerily similar manner, almost 30 years later?

      And for a final bit of recursive irony, I discovered that nugget of information by searching the Wikipedia for "The HitchHicker's Guide to the Galaxy".

      Just try to extract the same information from Britannica Online.

  7. Average_Joe_Sixpack's Test by Average_Joe_Sixpack · · Score: 5, Funny
    Which is the better resource? Let's see:

    Star Wars Christmas Special .... Wiki yes, Brit No
    History of Robocop ............. Wiki yes, Brit No
    Doctor Who ..................... Wiki yes, Brit yes
    Dr Who, info on the 3rd Doc contracting radiation poisoning on the planet Metebelis 3. Wiki yes, Brit no
  8. Self defense by Dekortage · · Score: 4, Insightful

    From the original Britannica "attack": In its December 15, 2005, issue, the science journal Naturepublished an article that claimed to compare the accuracy of the online Encyclopaedia Britannica with Wikipedia, the Internet database that allows anyone, regardless of knowledge or qualifications, to write and edit articles on any subject. (emphasis added by me)

    Does anyone think this isn't just Britannica watching its business get clobbered by an online startup, and trying to defend itself? Old guard versus young upstart. Britannica should just buy Wikipedia and maintain both, and just market them differently.

    For what it's worth, there appears to be over 6,500 articles on Wikipedia that use Britannica as a reference, which suggests that the folks writing Wikipidia consider Britannica as a reliable source of information. (Not surprisingly, you cannot find Wikipedia in Britannica.)

    Finally, there is one possible problem with the Nature investigation... the question is not total accuracy at one point in time, but overall accuracy over a long period of time. Wikipedia is constantly changing; Britannica is less frequently updated. What does this mean for a researcher? Has Wikipedia been a reliable research tool for the last 365 days, just as Britannica has been?

    --
    $nice = $webHosting + $domainNames + $sslCerts
  9. Nature dodged the issue. by QuietLagoon · · Score: 5, Interesting
    I like how Nature dodged the issue regarding the ethanol review. Notice how they did not say they added non-Britannica materials to the items being reviewed, Nature only said that the paragraphs cited by the reviewer were sourced from Britannica. This side-stepping of the actual issue raised by Britannica raises more concerns that it resolves.

    Why was Nature mixing Britannica and non-Britannica materials together for the reviewer? Was the intent to place the Britannica materials in a certain, and erroneous, context so that the reviewers would be led to an incorrect interpretation?

    The more that surfaces about Nature's tactics (and possibly strategy) here, the more suspicious Nature's intentions look.

    Was there any coverage here on /. of Britannica's rebuttal a week or so ago? I must have missed it.

    1. Re:Nature dodged the issue. by Anonymous Coward · · Score: 5, Insightful

      I'd like to point out something even more disturbing. When Nature was originally questioned they released a MS WORD file. In the file they claimed that they chose articles of same length:

        http://www.nature.com/nature/journal/v438/n7070/ex tref/438900a-s1.doc
        "Only entries that were approximately the same length in both encyclopaedias were selected."

      But when Britannica disputed this, nature replied:

        http://www.nature.com/press_releases/Britannica_re sponse.pdf
        "In a small number of cases, to ensure comparable lengths,
          we provided reviewers with chosen excerpts, not full
          articles"

      That's the smoking gun, they were not truthful about this.

      But this is absolutely devastating:

      One Nature reviewer was sent only the 350-word introduction to Encyclopædia Britannica's
      6,000-word article on lipids. For Nature to have represented Britannica's extensive coverage of
      the subject with this short squib was absurd, and it invalidated the findings of omissions
      alleged by the reviewer, since those matters were covered in sections of the article he or she
      never saw.

      As much as I love wikipedia, Nature should save it's integrity and retract the article!

    2. Re:Nature dodged the issue. by LurkerXXX · · Score: 4, Interesting
      Right you are.

      Especially troubling to see was the quote from Nature justifying that they had done a good job "And of the 123 purported errors in question, Britannica takes issue with fewer than half."

      Ok, I'm a Ph.D. research scientist. I've published papers. I can tell you right now, if I submit a paper to Nature and the reviewers have doubts about "fewer than half my data", there is no freaking way in hell that my paper is going to get published. Seriously. I can't believe that part of the defense from a scientific publication is that "less than half" of it's data was called into question.

      I'm horribly disappointed in Nature. It's considered the top (or one of the very top) scientific journals. Keeping the actual raw data hidden, and these strange defenses of what appears to be a very very flawed study method is far below the level of journalism that they should hold themselves to.

    3. Re:Nature dodged the issue. by The+Cydonian · · Score: 4, Interesting
      Absolutely.

      In fact, I'll even say this:- contrary to the general expectation out here, the whole point of this debate is not to gauge either Wikipedia's or Brittanica's reliability, but Nature's, and I'm afraid the magazine's half-hearted response, for reasons you've stated among many other rthings, has in no way been even remotely satisfactory.

  10. Let's check the history on this by AndroidCat · · Score: 4, Funny

    02:57, April 3, 2006 Nature (rv. we've been through this a thousand times already and consensus is against you, so stop doing this)
    00:51, April 3, 2006 Britannica (Basic concepts of Review - removed the OR, cleaned up the stating of the word history as spelled out in Terra Incognita)
    00:37, April 3, 2006 Nature m (rv ...or it's "original research" or it's "a self-reference" or whatever your excuse du jour is. Uh uh.)
    00:14, April 3, 2006 Britannica (removed redundant disambiguation and restated the first sentence. Comparison has ideas but is an activity. See discussion page)
    15:48, April 1, 2006 FactsGuy (RV another of Britannica's anti-consensus, POV, ill-written revisions. Britannica, please stop doing this!)
    15:12, April 1, 2006 Britannica (Basic concepts of comparison - removed the OR, "may have been inspired by" because that is someone's conjection and OR conclusion and not cited here)

    --
    One line blog. I hear that they're called Twitters now.
  11. Urgh by squiggleslash · · Score: 5, Insightful
    I read Britannica's "response" and must admit I nearly stopped reading after the following:
    Anyone who read the article with even a modicum of care would have noticed a discrepancy between the headline and the data themselves. While the heading proclaimed that "Wikipedia comes close to Britannica in terms of the accuracy of its science entries," the numbers buried deep in the body of the article said precisely the opposite: Wikipedia in fact had a third more inaccuracies than Britannica.
    This is changing the subject. Instead of measuring accuracies, as the headline does, Britannica finds a way of slanting the information, by using "inaccuracies", a figure that is a smaller percentage, to make it look like Wikipedia is awful in comparison. This, to me, undermines Britannica's credibility far more than anything Nature may or may not have "proven". It suggests they can't even fact check their own responses to comments about accuracy, or else are deliberately trying to mislead.

    For those who are looking at the above wondering "Huh?", remember that if one person has three errors, and the other has four, then the other has "a third more errors" than the first. That means the difference between 96% and 97% accurate is "a third more errors" - but most people would look at the two figures and, rightly, say they're very close. In Nature's case, the headline appears to be accurate, and Britannica, in suggesting otherwise on this basis, is engaging in sophistry.

    Britannica then goes on to claim many of the facts Nature depended upon were false. That may be true, but claims like the above suggest Britannica itself is more than willing to massage the facts, and for an organization that's dependent upon its own credibility, that's actually devastating.

    --
    You are not alone. This is not normal. None of this is normal.
  12. People staying away from Wikipedia because of by Ilgaz · · Score: 4, Insightful

    The problem with Wikipedia can be easily understood if you are using Slashdot in regular basis.

    FANATICS and ZEALOTS.

    E.g. while reading an article about Apple Computer, for example recent fight with Beatles Record company, I have even seen people attacking the record company as some "crook company" "not doing anything". Erm, they own the rights of 165 million selling (just in USA!) Beatles.

    Now, that same comment owner as these are "web 2.0" fashion days must have a Wikipedia account. Somehow you may need a very critical info about Apple Computers which _should be_ neutral as it can be.

    Just imagine you read the "info" written by that person and rely on it.

    That is the problem.

    Oh BTW, IMHO Brittanica should make use of bittorrent technology and make site "totally same as the DVD set". That time, people will pay for it. People hates waiting for FedEx or DHL to deliver the freaking "plastic". That is the problem.

  13. Dmitri Mendeleev's article by Brushen · · Score: 4, Interesting
    They said of Mendeleev's Britannica article that he was the 13th of 17 surviving children, and not the 17th. They said of Wikipedia's article that he was the 13th surviving child, and not the 17th. Britannica's error was probably due to a typographical error in the source material that they used, a New York Times article.

    Wikipedia users in January found out on the talk page, trying to make sure they used written sources to correct articles, and not just Nature's word, that in actuality, conflicting sources say that he was the 13th child, and others say he was the 14th, because historians disagree. They made a note of this in the article.

    About two and a half months later, after Wikipedia has already fixed the 'error,' Britannica comes out with the response, and does not directly admit they made an error, but goes on to disagree with Nature saying he was the 14th child, and brags about how they noted historians disagree on the issue of whether he was 13th or 14th. The new Britannica issue will be coming off the presses with the error corrected in about a year, probably. I see a lesson here.

  14. Re:Urgh to you too by blank101 · · Score: 4, Insightful

    I agree that Britannica's comments are disingenuous at best, but they are not wrong. What's wrong is having a discussion at this level of detail.

    To address your point directly, there is no discussion of error/accuracy/inaccuracy percentages, as such a measure is implausible. Would one count the number of facts and then state what percent are erroneous? Then who decides what in an article counts as a "fact" (and no, I'm not proposing relativism for truth)? Should all facts be given equal weight (e.g., is having the 5th decimal place wrong comparable to having the wrong stochiometric balance)? Since there is no logical framework to discuss these questions (and frankly, I can't see it would be worthwhile to do so), the only thing that can be studied scientifically (in the strict sense of the word) is error-rate and even that is misleading (as there is no ready way to compare magnitude of error).

    Thus, Nature was wrong (both in the semantic and practical sense) in its headline. I would have preferred the title "Wikipedia-Britannica Error-Rate Comparison," followed by the data, some statistical analysis, and qualifications about the inadequacy of the comparison (but then, no one likes to admit that what they've done doesn't really get to the heart of the issue).

    There are plenty of engineering-like judgements to be drawn about the practicality of Wikipedia over Britannica (given the cost difference and acceptably comparable error-rate/magnitude for day-to-day use), indeed any /. discussion re: wikipedia makes them. And therein lies the rub; Britannica is certainly right to attack on the details (which as I illustrated are somewhat non-sensical), but the details are largely irrelevant to the real point of the discussion (and shame on Nature for not emphasizing that).

  15. Turn-Around Time by LordLucless · · Score: 4, Insightful

    Ok, Britannica beats Wikipedia on accuracy 3-4. Now give us your corrections and see who beats who in publishing the most accurate new edition.

    --
    Just because you're paranoid doesn't mean there isn't an invisible demon about to eat your face
  16. Wikipedia vs Britannica - a personal perspective. by Autochthonous+Lagomo · · Score: 4, Interesting

    As someone who uses both Britannica (the software version of 2006's encyclopedia) as well as Wikipedia almost daily, I have to say that Britannica is sadly out of its league most of the time.

    Sure, every now and then I'll encounter something on Wikipedia that is blatantly biased or wrong, but 99% of the time it's updated on the talk pages.

    An example comes from a plague I was researching that devastated ancient Athens just as they were gearing up against the Spartans. Britannica is suitably vague about this, but the Wikipedia article on the subject has a great section about how, in 2005, genetic testing proved that it was typhoid fever which devastated Athens at that period. As this was the 2006 Britannica, why didn't it have that information?

    A more obvious example of Britannica being less up-to-date is in the country histories articles. They almost all stop at about 1999-2001, without addressing any of the more recent years. Again, in a 2006 publication, why should this be the case? Wikipedia trumps again.

    And lastly, people hold Britannica and other encyclopedias up higher than Wikipedia and other open-source content, but they do so erroneously. The point is, encyclopedia articles don't go through enormous peer-review, and are more likely to have errors than a non-vandalized Wikipedia article, simply because there are far fewer contributing eyes scanning the text, and far fewer people reviewing it and keeping it up to date.