Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia

Shane  Greenstein; Feng  Zhu

Article | MIS Quarterly | September 2018

Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia

Abstract

Organizations today can use both crowds and experts to produce knowledge. While prior work compares the accuracy of crowd-produced and expert-produced knowledge, we compare bias in these two models in the context of contested knowledge, which involves subjective, unverifiable, or controversial information. Using data from Encyclopædia Britannica, authored by experts, and Wikipedia, an encyclopedia produced by an online community, we compare the slant and bias of pairs of articles on identical topics of U.S. politics. Our slant measure is less (more) than zero when an article leans towards Democratic (Republican) viewpoints, while bias is the absolute value of the slant. We find that Wikipedia articles are more slanted towards Democratic views than are Britannica articles, as well as more biased. The difference in bias between a pair of articles decreases with more revisions. The bias on a per word basis hardly differs between the sources because Wikipedia articles tend to be longer than Britannica articles. These results highlight the pros and cons of each knowledge production model, help identify the scope of the empirical generalization of prior studies comparing the information quality of the two production models, and offer implications for organizations managing crowd-based knowledge production.

Keywords: online community; Collective Intelligence; wisdom of crowds; bias; Wikipedia; Britannica; knowledge production; Knowledge Sharing; Knowledge Dissemination; Prejudice and Bias;

Format: Print

Find at Harvard

Citation:

Greenstein, Shane, and Feng Zhu. "Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia." MIS Quarterly 42, no. 3 (September 2018): 945–959.

We examine how app developers on the Android mobile platform adjust their innovation efforts (rate and direction) and value-capture strategies in response to Google’s entry threat and actual entry into their markets. We find that, after Google’s entry threat increases, affected developers reduce innovation and raise the prices for the affected apps. Once Google enters, the developers reduce innovation and increase prices further. However, app developers’ incentives to innovate are not completely suppressed; rather, they shift innovation to unaffected and new apps. Given many apps already offering similar features, Google’s entry may reduce such social inefficiency.

Teaching note is meant to accompany Zebra Medical Vision case, which offers a look at a company’s decisions as a small startup competing with other startups and major technology companies. It also demonstrates the challenges faced by a machine learning company working on brand-new technology, including difficulties finding training data, hiring competition, and negotiating FDA approvals and other government regulations. Teaching Note for HBS No. 619-014.

One common complaint from third parties about platform businesses is that they see what succeeds on their platforms and then enter the most profitable areas themselves, often decimating third parties in the process. Studies have identified several motivations for platform-owner entry beyond just value capture. Multiple studies have suggested that platforms opt to enter directly in order to improve quality, for example. And the effect of platform entry on complementors is mixed. Some studies found that platform entry can create positive spillover effects on third parties and increase their demand. However, a few other studies find that the impact of entry on complementors can be negative. Google’s introduction of flights into its search engine decreased clicks on other organic results, for example. Careful empirical analysis is needed before policy intervention.

Faculty & Research

Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia

Abstract

Citation:

About the Authors

More from these Authors