Skip to Main Content
HBS Home
  • About
  • Academic Programs
  • Alumni
  • Faculty & Research
  • Baker Library
  • Giving
  • Harvard Business Review
  • Initiatives
  • News
  • Recruit
  • Map / Directions
Faculty & Research
  • Faculty
  • Research
  • Featured Topics
  • Academic Units
  • …→
  • Harvard Business School→
  • Faculty & Research→
Publications
Publications
  • September 2018
  • Article
  • MIS Quarterly

Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia

By: Shane Greenstein and Feng Zhu
  • Format:Print
ShareBar

Abstract

Organizations today can use both crowds and experts to produce knowledge. While prior work compares the accuracy of crowd-produced and expert-produced knowledge, we compare bias in these two models in the context of contested knowledge, which involves subjective, unverifiable, or controversial information. Using data from Encyclopædia Britannica, authored by experts, and Wikipedia, an encyclopedia produced by an online community, we compare the slant and bias of pairs of articles on identical topics of U.S. politics. Our slant measure is less (more) than zero when an article leans towards Democratic (Republican) viewpoints, while bias is the absolute value of the slant. We find that Wikipedia articles are more slanted towards Democratic views than are Britannica articles, as well as more biased. The difference in bias between a pair of articles decreases with more revisions. The bias on a per word basis hardly differs between the sources because Wikipedia articles tend to be longer than Britannica articles. These results highlight the pros and cons of each knowledge production model, help identify the scope of the empirical generalization of prior studies comparing the information quality of the two production models, and offer implications for organizations managing crowd-based knowledge production.

Keywords

Online Community; Collective Intelligence; Wisdom Of Crowds; Bias; Wikipedia; Britannica; Knowledge Production; Knowledge Sharing; Knowledge Dissemination; Prejudice and Bias

Citation

Greenstein, Shane, and Feng Zhu. "Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia." MIS Quarterly 42, no. 3 (September 2018): 945–959.
  • Find it at Harvard

About The Authors

Shane M. Greenstein

Technology and Operations Management
→More Publications

Feng Zhu

Technology and Operations Management
→More Publications

More from the Authors

    • March 2022
    • Faculty Research

    Digital Manufacturing at Amgen

    By: Shane Greenstein, Kyle R. Myers and Sarah Mehta
    • February 2022 (Revised March 2022)
    • Faculty Research

    National Electric Vehicles Sweden (NEVS): Materializing a Vision

    By: Shane Greenstein and Elena Corsi
    • February 2022
    • Faculty Research

    Huazhu: A Chinese Hotel Giant's Journey of Digital Transformation

    By: Feng Zhu, Yulin Fang, Bonnie Yining Cao and Duan Yang
More from the Authors
  • Digital Manufacturing at Amgen By: Shane Greenstein, Kyle R. Myers and Sarah Mehta
  • National Electric Vehicles Sweden (NEVS): Materializing a Vision By: Shane Greenstein and Elena Corsi
  • Huazhu: A Chinese Hotel Giant's Journey of Digital Transformation By: Feng Zhu, Yulin Fang, Bonnie Yining Cao and Duan Yang
ǁ
Campus Map
Harvard Business School
Soldiers Field
Boston, MA 02163
→Map & Directions
→More Contact Information
  • Make a Gift
  • Site Map
  • Jobs
  • Harvard University
  • Trademarks
  • Policies
  • Digital Accessibility
Copyright © President & Fellows of Harvard College