Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia

Shane  Greenstein; Feng  Zhu

Article | MIS Quarterly | September 2018

Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia

Abstract

Organizations today can use both crowds and experts to produce knowledge. While prior work compares the accuracy of crowd-produced and expert-produced knowledge, we compare bias in these two models in the context of contested knowledge, which involves subjective, unverifiable, or controversial information. Using data from Encyclopædia Britannica, authored by experts, and Wikipedia, an encyclopedia produced by an online community, we compare the slant and bias of pairs of articles on identical topics of U.S. politics. Our slant measure is less (more) than zero when an article leans towards Democratic (Republican) viewpoints, while bias is the absolute value of the slant. We find that Wikipedia articles are more slanted towards Democratic views than are Britannica articles, as well as more biased. The difference in bias between a pair of articles decreases with more revisions. The bias on a per word basis hardly differs between the sources because Wikipedia articles tend to be longer than Britannica articles. These results highlight the pros and cons of each knowledge production model, help identify the scope of the empirical generalization of prior studies comparing the information quality of the two production models, and offer implications for organizations managing crowd-based knowledge production.

Keywords: online community; Collective Intelligence; wisdom of crowds; bias; Wikipedia; Britannica; knowledge production; Knowledge Sharing; Knowledge Dissemination; Prejudice and Bias;

Format: Print

Find at Harvard

Citation:

Greenstein, Shane, and Feng Zhu. "Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia." MIS Quarterly 42, no. 3 (September 2018): 945–959.

Using patent data from 1976 to 2010 as indicators of inventive activity, we determine the concentration level of where inventive ideas originate and then examine how and why those concentrations change over time. The analysis finds pervasive deconcentration in every area related to the Information and Communication Technology equipment market. We find that booms and busts play an important role in deconcentration trends. In comparison, new entry explains surprisingly little, and merger and acquisition activity does not revert the trend.

Faculty & Research

Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia

Abstract

Citation:

About the Authors

More from these Authors