Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia

Shane  Greenstein; Feng  Zhu

Article | MIS Quarterly | September 2018

Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia

Abstract

Organizations today can use both crowds and experts to produce knowledge. While prior work compares the accuracy of crowd-produced and expert-produced knowledge, we compare bias in these two models in the context of contested knowledge, which involves subjective, unverifiable, or controversial information. Using data from Encyclopædia Britannica, authored by experts, and Wikipedia, an encyclopedia produced by an online community, we compare the slant and bias of pairs of articles on identical topics of U.S. politics. Our slant measure is less (more) than zero when an article leans towards Democratic (Republican) viewpoints, while bias is the absolute value of the slant. We find that Wikipedia articles are more slanted towards Democratic views than are Britannica articles, as well as more biased. The difference in bias between a pair of articles decreases with more revisions. The bias on a per word basis hardly differs between the sources because Wikipedia articles tend to be longer than Britannica articles. These results highlight the pros and cons of each knowledge production model, help identify the scope of the empirical generalization of prior studies comparing the information quality of the two production models, and offer implications for organizations managing crowd-based knowledge production.

Keywords: online community; Collective Intelligence; wisdom of crowds; bias; Wikipedia; Britannica; knowledge production; Knowledge Sharing; Knowledge Dissemination; Prejudice and Bias;

Format: Print

Find at Harvard

Citation:

Greenstein, Shane, and Feng Zhu. "Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia." MIS Quarterly 42, no. 3 (September 2018): 945–959.

ZBJ.com (ZBJ), an online platform that connects knowledge workers to small- and medium-sized enterprises, is China’s largest outsourcing platform. Founded by Mingyue Zhu in 2006, ZBJ had grown into a unicorn with 4,000 employees and a daily transaction volume of RMB15 million by 2017. During the company’s 11-year history, ZBJ had launched ten transformation campaigns to overcome various challenges by changing its products, operations, and business model. For example, it encountered a winner-takes-all competition, disintermediation (when service providers and clients took transactions off the platform to avoid the platform’s 20% commission fees), the rise of fake transactions, member management issues, and difficulties in delivering satisfactory services to large enterprises. Zhu must decide how to use the next campaign to address challenges that had emerged since the last campaign as well as how ZBJ should expand globally.

Faculty & Research

Do Experts or Crowd-Based Models Produce More Bias? Evidence from Encyclopædia Britannica and Wikipedia

Abstract

Citation:

About the Authors

More from these Authors