Skip to Main Content
HBS Home
  • About
  • Academic Programs
  • Alumni
  • Faculty & Research
  • Baker Library
  • Giving
  • Harvard Business Review
  • Initiatives
  • News
  • Recruit
  • Map / Directions
Faculty & Research
  • Faculty
  • Research
  • Featured Topics
  • Academic Units
  • …→
  • Harvard Business School→
  • Faculty & Research→
Publications
Publications
  • Article
  • Nature

Megastudies Improve the Impact of Applied Behavioural Science

By: Katherine L. Milkman, Dena Gromet, Hung Ho, Joseph S. Kay, Timothy W. Lee, Pepi Pandiloski, Yeji Park, Aneesh Rai, Max Bazerman, John Beshears, Lauri Bonacorsi, Colin Camerer, Edward Chang, Gretchen Chapman, Robert Cialdini, Hengchen Dai, Lauren Eskreis-Winkler, Ayelet Fishbach, James J. Gross, Samantha Horn, Alexa Hubbard, Steven J. Jones, Dean Karlan, Tim Kautz, Erika Kirgios, Joowon Klusowski, Ariella Kristal, Rahul Ladhania, Jens Ludwig, George Loewenstein, Barbara Mellers, Sendhil Mullainathan, Silvia Saccardo, Jann Spiess, Gaurav Suri, Joachim H. Talloen, Jamie Taxer, Yaacov Trope, Lyle Ungar, Kevin G. Volpp, Ashley Whillans, Jonathan Zinman and Angela L. Duckworth
  • Format:Print
ShareBar

Abstract

Policy-makers are increasingly turning to behavioural science for insights about how to improve citizens’ decisions and outcomes. Typically, different scientists test different intervention ideas in different samples using different outcomes over different time intervals. The lack of comparability of such individual investigations limits their potential to inform policy. Here, to address this limitation and accelerate the pace of discovery, we introduce the megastudy—a massive field experiment in which the effects of many different interventions are compared in the same population on the same objectively measured outcome for the same duration. In a megastudy targeting physical exercise among 61,293 members of an American fitness chain, 30 scientists from 15 different U.S. universities worked in small independent teams to design a total of 54 different four-week digital programmes (or interventions) encouraging exercise. We show that 45% of these interventions significantly increased weekly gym visits by 9% to 27%; the top-performing intervention offered microrewards for returning to the gym after a missed workout. Only 8% of interventions induced behaviour change that was significant and measurable after the four-week intervention. Conditioning on the 45% of interventions that increased exercise during the intervention, we detected carry-over effects that were proportionally similar to those measured in previous research. Forecasts by impartial judges failed to predict which interventions would be most effective, underscoring the value of testing many ideas at once and, therefore, the potential for megastudies to improve the evidentiary value of behavioural science.

Keywords

Policy Making; Behavioral Science; Behavior; Change; Decision Making; Policy

Citation

Milkman, Katherine L., Dena Gromet, Hung Ho, Joseph S. Kay, Timothy W. Lee, Pepi Pandiloski, Yeji Park, Aneesh Rai, Max Bazerman, John Beshears, Lauri Bonacorsi, Colin Camerer, Edward Chang, Gretchen Chapman, Robert Cialdini, Hengchen Dai, Lauren Eskreis-Winkler, Ayelet Fishbach, James J. Gross, Samantha Horn, Alexa Hubbard, Steven J. Jones, Dean Karlan, Tim Kautz, Erika Kirgios, Joowon Klusowski, Ariella Kristal, Rahul Ladhania, Jens Ludwig, George Loewenstein, Barbara Mellers, Sendhil Mullainathan, Silvia Saccardo, Jann Spiess, Gaurav Suri, Joachim H. Talloen, Jamie Taxer, Yaacov Trope, Lyle Ungar, Kevin G. Volpp, Ashley Whillans, Jonathan Zinman, and Angela L. Duckworth. "Megastudies Improve the Impact of Applied Behavioural Science." Nature 600, no. 7889 (December 16, 2021): 478–483.
  • Find it at Harvard
  • Read Now

About The Authors

Max H. Bazerman

Negotiation, Organizations & Markets
→More Publications

John Beshears

Negotiation, Organizations & Markets
→More Publications

Edward H. Chang

Negotiation, Organizations & Markets
→More Publications

Ashley V. Whillans

Negotiation, Organizations & Markets
→More Publications

More from the Authors

    • May 2022
    • Lancet Public Health

    Policy Stringency and Mental Health During the COVID-19 Pandemic: A Longitudinal Analysis of Data from 15 Countries

    By: Lara B. Aknin, Bernardo Andretti, Rafael Goldszmidt, John F. Helliwell, Anna Petherick, Jan-Emmanuel De Neve, Elizabeth W. Dunn, Daisy Fancourt, Elkhonon Goldberg, Sarah P. Jones, Ozge Karadag, Elie Karam, Richard Layard, Shekhar Saxena, Emily Thornton, Ashley Whillans and Jamil Zaki
    • 2022
    • Faculty Research

    Decision Leadership: Empowering Others to Make Better Choices

    By: Don A. Moore and Max H. Bazerman
    • March 2022 (Revised April 2022)
    • Faculty Research

    Innovation at Moog Inc.

    By: Brian J. Hall, Ashley V. Whillans, Davis Heniford, Dominika Randle and Caroline Witten
More from the Authors
  • Policy Stringency and Mental Health During the COVID-19 Pandemic: A Longitudinal Analysis of Data from 15 Countries By: Lara B. Aknin, Bernardo Andretti, Rafael Goldszmidt, John F. Helliwell, Anna Petherick, Jan-Emmanuel De Neve, Elizabeth W. Dunn, Daisy Fancourt, Elkhonon Goldberg, Sarah P. Jones, Ozge Karadag, Elie Karam, Richard Layard, Shekhar Saxena, Emily Thornton, Ashley Whillans and Jamil Zaki
  • Decision Leadership: Empowering Others to Make Better Choices By: Don A. Moore and Max H. Bazerman
  • Innovation at Moog Inc. By: Brian J. Hall, Ashley V. Whillans, Davis Heniford, Dominika Randle and Caroline Witten
ǁ
Campus Map
Harvard Business School
Soldiers Field
Boston, MA 02163
→Map & Directions
→More Contact Information
  • Make a Gift
  • Site Map
  • Jobs
  • Harvard University
  • Trademarks
  • Policies
  • Digital Accessibility
Copyright © President & Fellows of Harvard College