Skip to Main Content
HBS Home
  • About
  • Academic Programs
  • Alumni
  • Faculty & Research
  • Baker Library
  • Giving
  • Harvard Business Review
  • Initiatives
  • News
  • Recruit
  • Map / Directions
Faculty & Research
  • Faculty
  • Research
  • Featured Topics
  • Academic Units
  • …→
  • Harvard Business School→
  • Faculty & Research→
Publications
Publications
  • 2019
  • Working Paper
  • HBS Working Paper Series

Judgment Aggregation in Creative Production: Evidence from the Movie Industry

By: Hong Luo, Jeffrey T. Macher and Michael Wahlen
  • Format:Print
  • | Language:English
  • | Pages:51
ShareBar

Abstract

This paper studies a novel, light-touch approach to aggregate judgment from a large number of industry experts on ideas that they encounter in their normal course of business. Our context is the movie industry, in which customer appeal is difficult to predict and investment costs are high. The Black List, an annual publication, ranks unproduced scripts based on anonymous nominations from film executives. While low participation costs enable a high response rate from busy executives, this results in a trade-off, as the nominations lack standard criteria, and which voters see which ideas may be unobservable and affected by various factors. Despite these challenges, we find that such an approach to aggregation is predictive: listed scripts are substantially more likely to be released than observably similar but unlisted scripts, and, conditional on release and investment levels, to generate higher box office revenues. We also find that the results differ by the writer’s experience level: (i) scripts from less-experienced writers are, in fact, more likely to be listed and to rank higher if listed; (ii) but even though being listed is associated with a higher release rate within less-experienced writers, the discrepancy in release probabilities relative to experienced writers remains large (even for top-ranked scripts). Both of these results can be explained by the idea that scripts from less-experienced writers are more visible among eligible voters.

Keywords

Judgment Aggregation; Creativity; Film Entertainment; Judgments; Motion Pictures and Video Industry

Citation

Luo, Hong, Jeffrey T. Macher, and Michael Wahlen. "Judgment Aggregation in Creative Production: Evidence from the Movie Industry." Harvard Business School Working Paper, No. 19-082, January 2019. (Revised September 2019.)
  • SSRN

About The Author

Hong Luo

Strategy
→More Publications

More from the Authors

    • 2023
    • Faculty Research

    Laboratory Safety and Research Productivity

    By: Alberto Galasso, Hong Luo and Brooklynn Zhu
    • May 2022
    • American Economic Journal: Economic Policy

    When Does Product Liability Risk Chill Innovation? Evidence from Medical Implants

    By: Alberto Galasso and Hong Luo
    • March 2022 (Revised April 2022)
    • Faculty Research

    Spotify's Audio-First Strategy: Leading the Podcasting Market

    By: Hong Luo and Carol Lin
More from the Authors
  • Laboratory Safety and Research Productivity By: Alberto Galasso, Hong Luo and Brooklynn Zhu
  • When Does Product Liability Risk Chill Innovation? Evidence from Medical Implants By: Alberto Galasso and Hong Luo
  • Spotify's Audio-First Strategy: Leading the Podcasting Market By: Hong Luo and Carol Lin
ǁ
Campus Map
Harvard Business School
Soldiers Field
Boston, MA 02163
→Map & Directions
→More Contact Information
  • Make a Gift
  • Site Map
  • Jobs
  • Harvard University
  • Trademarks
  • Policies
  • Accessibility
  • Digital Accessibility
Copyright © President & Fellows of Harvard College