Skip to Main Content
HBS Home
  • About
  • Academic Programs
  • Alumni
  • Faculty & Research
  • Baker Library
  • Giving
  • Harvard Business Review
  • Initiatives
  • News
  • Recruit
  • Map / Directions
Faculty & Research
  • Faculty
  • Research
  • Featured Topics
  • Academic Units
  • …→
  • Harvard Business School→
  • Faculty & Research→
Publications
Publications
  • September 2018
  • Article
  • MIS Quarterly

Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia

By: Shane Greenstein and Feng Zhu
  • Format:Print
ShareBar

Abstract

Organizations today can use both crowds and experts to produce knowledge. While prior work compares the accuracy of crowd-produced and expert-produced knowledge, we compare bias in these two models in the context of contested knowledge, which involves subjective, unverifiable, or controversial information. Using data from Encyclopædia Britannica, authored by experts, and Wikipedia, an encyclopedia produced by an online community, we compare the slant and bias of pairs of articles on identical topics of U.S. politics. Our slant measure is less (more) than zero when an article leans towards Democratic (Republican) viewpoints, while bias is the absolute value of the slant. We find that Wikipedia articles are more slanted towards Democratic views than are Britannica articles, as well as more biased. The difference in bias between a pair of articles decreases with more revisions. The bias on a per word basis hardly differs between the sources because Wikipedia articles tend to be longer than Britannica articles. These results highlight the pros and cons of each knowledge production model, help identify the scope of the empirical generalization of prior studies comparing the information quality of the two production models, and offer implications for organizations managing crowd-based knowledge production.

Keywords

Online Community; Collective Intelligence; Wisdom Of Crowds; Bias; Wikipedia; Britannica; Knowledge Production; Knowledge Sharing; Knowledge Dissemination; Prejudice and Bias

Citation

Greenstein, Shane, and Feng Zhu. "Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia." MIS Quarterly 42, no. 3 (September 2018): 945–959.
  • Find it at Harvard

About The Authors

Shane M. Greenstein

Technology and Operations Management
→More Publications

Feng Zhu

Technology and Operations Management
→More Publications

More from the Authors

    • November 2023
    • Research Policy

    Open Source Software and Global Entrepreneurship

    By: Nataliya Langburd Wright, Frank Nagle and Shane Greenstein
    • July 2023
    • Management Science

    Marketplace Scalability and Strategic Use of Platform Investment

    By: Jin Li, Gary Pisano, Richard Xu and Feng Zhu
    • June 2023
    • Faculty Research

    Clash of Two Giants Simulation Exercise

    By: Feng Zhu and Marco Iansiti
More from the Authors
  • Open Source Software and Global Entrepreneurship By: Nataliya Langburd Wright, Frank Nagle and Shane Greenstein
  • Marketplace Scalability and Strategic Use of Platform Investment By: Jin Li, Gary Pisano, Richard Xu and Feng Zhu
  • Clash of Two Giants Simulation Exercise By: Feng Zhu and Marco Iansiti
ǁ
Campus Map
Harvard Business School
Soldiers Field
Boston, MA 02163
→Map & Directions
→More Contact Information
  • Make a Gift
  • Site Map
  • Jobs
  • Harvard University
  • Trademarks
  • Policies
  • Accessibility
  • Digital Accessibility
Copyright © President & Fellows of Harvard College