Skip to Main Content
HBS Home
  • About
  • Academic Programs
  • Alumni
  • Faculty & Research
  • Baker Library
  • Giving
  • Harvard Business Review
  • Initiatives
  • News
  • Recruit
  • Map / Directions
Faculty & Research
  • Faculty
  • Research
  • Featured Topics
  • Academic Units
  • …→
  • Harvard Business School→
  • Faculty & Research→
Publications
Publications
  • 2023
  • Article
  • American Journal of Health Promotion

A Randomized Trial of Behavioral Nudges Delivered through Text Messages to Increase Influenza Vaccination among Patients with an Upcoming Primary Care Visit

By: Mitesh S. Patel, Katherine L. Milkman, Linnea Gandhi, Heather N. Graci, Dena Gromet, Hung Ho, Joseph S. Kay, Timothy W. Lee, Jake Rothschild, Modupe Akinola, John Beshears, Jonathan E. Bogard, Alison Buttenheim, Christopher Chabris, Gretchen B. Chapman, James J. Choi, Hengchen Dai, Craig R. Fox, Amir Goren, Matthew D. Hilchey, Jillian Hmurovic, Leslie John, Dean Karlan, Melanie Kim, David Laibson, Cait Lamberton, Brigitte C. Madrian, Michelle N. Meyer, Maria Modanu, Jimin Nam, Todd Rogers, Renante Rondina, Silvia Saccardo, Maheen Shermohammed, Dilip Soman, Jehan Sparks, Caleb Warren, Megan Weber, Ron Berman, Chalanda N. Evans, Seung Hyeong Lee, Christopher K. Snider, Eli Tsukayama, Christophe Van den Bulte, Kevin G. Volpp and Angela L. Duckworth
  • | Pages:9
ShareBar

Abstract

Purpose: To evaluate if nudges delivered by text message prior to an upcoming primary care visit can increase influenza vaccination rates.
Design: Randomized, controlled trial.
Setting: Two health systems in the Northeastern US between September 2020 and March 2021.
Subjects: 74,811 adults.
Interventions: Patients in the 19 intervention arms received 1-2 text messages in the 3 days preceding their appointment that varied in their format, interactivity, and content.
Measures: Influenza vaccination.
Analysis: Intention-to-treat.
Results: Participants had a mean (SD) age of 50.7 (16.2) years; 55.8% (41,771) were female, 70.6% (52,826) were White, and 19.0% (14,222) were Black. Among the interventions, 5 of 19 (26.3%) had a significantly greater vaccination rate than control. On average, the 19 interventions increased vaccination relative to control by 1.8 percentage points or 6.1% (p = .005). The top performing text message described the vaccine to the patient as “reserved for you” and led to a 3.1 percentage point increase (95% CI, 1.3 to 4.9; p < .001) in vaccination relative to control. Three of the top five performing messages described the vaccine as “reserved for you.” None of the interventions performed worse than control.
Conclusions: Text messages encouraging vaccination and delivered prior to an upcoming appointment significantly increased influenza vaccination rates and could be a scalable approach to increase vaccination more broadly.

Keywords

Vaccination; Health Care and Treatment; Interpersonal Communication; Communication Technology; Behavior; Health Industry

Citation

Patel, Mitesh S., Katherine L. Milkman, Linnea Gandhi, Heather N. Graci, Dena Gromet, Hung Ho, Joseph S. Kay, Timothy W. Lee, Jake Rothschild, Modupe Akinola, John Beshears, Jonathan E. Bogard, Alison Buttenheim, Christopher Chabris, Gretchen B. Chapman, James J. Choi, Hengchen Dai, Craig R. Fox, Amir Goren, Matthew D. Hilchey, Jillian Hmurovic, Leslie John, Dean Karlan, Melanie Kim, David Laibson, Cait Lamberton, Brigitte C. Madrian, Michelle N. Meyer, Maria Modanu, Jimin Nam, Todd Rogers, Renante Rondina, Silvia Saccardo, Maheen Shermohammed, Dilip Soman, Jehan Sparks, Caleb Warren, Megan Weber, Ron Berman, Chalanda N. Evans, Seung Hyeong Lee, Christopher K. Snider, Eli Tsukayama, Christophe Van den Bulte, Kevin G. Volpp, and Angela L. Duckworth. "A Randomized Trial of Behavioral Nudges Delivered through Text Messages to Increase Influenza Vaccination among Patients with an Upcoming Primary Care Visit." American Journal of Health Promotion 37, no. 3 (2023): 324–332.
  • Find it at Harvard
  • Read Now
  • Purchase

About The Authors

John Beshears

Negotiation, Organizations & Markets
→More Publications

Leslie K. John

Negotiation, Organizations & Markets
→More Publications

More from the Authors

    • March 2025
    • Journal of Financial Economics

    Optimal Illiquidity

    By: John Beshears, James J. Choi, Christopher Clayton, Christopher Harris, David Laibson and Brigitte C. Madrian
    • January 2025
    • Journal of Pension Economics & Finance

    Automatic Enrollment with a 12% Default Contribution Rate

    By: John Beshears, Ruofei Guo, David Laibson, Brigitte C. Madrian and James J. Choi
    • 2024
    • Faculty Research

    Measuring the Prevalence of Sensitive Behaviors

    By: Tamar Krishnamurti and Leslie John
More from the Authors
  • Optimal Illiquidity By: John Beshears, James J. Choi, Christopher Clayton, Christopher Harris, David Laibson and Brigitte C. Madrian
  • Automatic Enrollment with a 12% Default Contribution Rate By: John Beshears, Ruofei Guo, David Laibson, Brigitte C. Madrian and James J. Choi
  • Measuring the Prevalence of Sensitive Behaviors By: Tamar Krishnamurti and Leslie John
ǁ
Campus Map
Harvard Business School
Soldiers Field
Boston, MA 02163
→Map & Directions
→More Contact Information
  • Make a Gift
  • Site Map
  • Jobs
  • Harvard University
  • Trademarks
  • Policies
  • Accessibility
  • Digital Accessibility
Copyright © President & Fellows of Harvard College.