Kolbe, Debunking the “Accurate as Britannica” Myth

450

Wikipediocracy.com, a site dedicated to exploring issues related to Wikipedia, posted this article on February 16, 2014.

DEBUNKING THE “ACCURATE AS BRITANNICA” MYTH

ANDREAS KOLBE

1

“As the saying goes, a lie told often enough becomes the truth.”

A factoid regularly cited in the press to this day is that a 2005 study by Nature found Wikipedia to be almost as reliable as Britannica. While the study’s (if that is the right word—it wasn’t a peer-reviewed study, but a news story) methodology and conclusions were disputed by Britannica, the result of the Nature comparison has become part of received knowledge for much of the media. As the saying goes, a lie told often enough becomes the truth.

A Meme Is Born

2

The problems really began as soon as the Nature piece was published. Many news outlets failed to mention that in its survey, Nature looked at hard science topics only—subjects like physics, chemistry, biology, astronomy and paleontology—despite the fact that Nature clearly said so, in the very first line of its piece. The following headline and lead from CNET will serve as an example:

Study: Wikipedia as accurate as Britannica.

Wikipedia is about as good a source of accurate information as Britannica, the venerable standard-bearer of facts about the world around us, according to a study published this week in the journal Nature.

Few observers were astute enough to note, as the Register’s Andrew Orlowski did, that restricting the comparison to hard science articles was what “gave the free-for-all web site a fighting chance—as it excluded the rambling garbage and self-indulgence that constitute much of the wannabe encyclopedia’s social science and culture entries.” Another notable exception was Bill Thompson, writing for the BBC, who noted Wikipedia’s problems in “contentious areas such as politics, religion or biography,” and how easily Wikipedia can “be undermined through malice or ignorance thanks to its open architecture.”

3

Nicholas Carr put it this way: in limiting itself to topics like the “kinetic isotope effect” or “Meliaceae,” which no one without some specialized understanding of the subject matter would even be aware of, the Nature survey played to Wikipedia’s strengths. Carr also established that the Nature “study” was not actually an expert-written research article of the type that built the reputation of Nature, but a non-peer-reviewed piece of news journalism (a fact he confirmed with the piece’s author, Jim Giles).

451

4

Another fact that is largely forgotten today: the Nature survey found that many Wikipedia entries were “poorly structured and confusing” and gave undue prominence to controversial theories. Both of these failings are a result of Wikipedia’s crowdsourcing method—one editor adding a sentence here, another adding a sentence there. The study’s highly publicized count of “inaccuracies,” which led to the “Wikipedia is as accurate as Britannica” meme, did not reflect that. While the count penalized Britannica for alleged omissions—which Britannica contested—it imposed no penalty on Wikipedia for meandering off topic.

5

In effect, it considered a sprawling, badly organized jumble of facts to be as valuable as a masterfully written and easy-to-understand introduction to a topic by a world-renowned scholar. The results are not the same. Even so, Nature found that Wikipedia contained about a third more inaccuracies than Britannica. (This doesn’t stop some writers going the whole hog and claiming that Nature found Wikipedia to be more reliable than Britannica. It’s stunning, really, how memes morph on the internet.)

The Reality: A Site Riddled with Hoaxes, Vandalism, PR Manipulation, and Anonymous Defamation

6

Another point that was lost is that Wikipedia’s quality is very uneven. Wikipedia articles on more obscure topics are often lacking in basic literacy. In the worst case, the information they contain may be entirely made up, or so self-serving to the interests of some anonymous Wikipedia author as to make a mockery of Wikipedia’s vaunted concept of a “neutral point of view.”

7

Saying that Wikipedia is “as reliable as Britannica” implies that this is so for any article in Wikipedia. And that just ain’t so. Some of Wikipedia’s articles are indeed reliable. The problem is that you never know whether the article you are looking at is one of them.

8

Wikipedia contains hoaxes and vandalism.”

Wikipedia contains hoaxes and vandalism. It contains malicious defamation and anonymous hatchet jobs authored by people who are in conflict with the person they are writing about, or simply jealous of their success. It contains barely disguised advertising—entries on people and companies written by their subjects, or their PR agents. It contains articles on politics and history that have been meddled with by political extremists. Wikipedia entries are protean edifices: they may say one thing today and a completely different thing tomorrow. Those are all problems conventional reference works like Britannica never had. Is this progress?

9

What reference works like Britannica do have are editors in the traditional sense of the word—experts in their fields, who ensure that what is published meets academic standards. Wikipedia has editors, too, but in Jimmy Wales’ online encyclopedia the word means something entirely different: it is applied to any anonymous person with an internet connection who clicks “Edit” on a Wikipedia page—whether it’s a schoolchild, a mentally disturbed person, a political activist, a knowledgeable amateur, or an actual scholar. Wikipedia has all of them. But academics venturing into the “encyclopedia anyone can edit” (allegedly) often find it a very time-consuming and frustrating experience, punctuated by interminable arguments with young men who may only have a very superficial understanding of the academic’s area of expertise, but unlimited time to spend on Wikipedia, familiarity with the site’s arcane and self-contradictory policies and guidelines, and wiki-friends to back them up. Many a distinguished academic lacks the time and patience to engage with them, and has been blocked from further participation for “incivility.” It’s not the same as talking to your editor at a university press!

452

Horses for Courses

10

Wikipedia is free. It’s understandable that people don’t like to look a gift horse in the mouth. But no one should fool themselves into thinking that the nag they got for free is an Arabian racehorse.

AT ISSUE: SOURCES FOR DEVELOPING A DEFINITION ARGUMENT

  1. What does Kolbe mean in paragraph 1 when he says, “[A] lie told often enough becomes the truth”? What lie does Kolbe address in his essay?

  2. What point does Kolbe concede in paragraph 7? How does he go on to refute this point?

  3. According to Kolbe, what is the major strength of Britannica?

  4. Kolbe clearly does not consider Wikipedia a source of reliable information. Why not? Do any of his arguments seem unfair or biased? Explain.

  5. What point does Kolbe make in his conclusion? Why does he focus on the fact that Wikipedia is free?