Skip to Main Content
HBS Home
  • About
  • Academic Programs
  • Alumni
  • Faculty & Research
  • Baker Library
  • Giving
  • Harvard Business Review
  • Initiatives
  • News
  • Recruit
  • Map / Directions
Faculty & Research
  • Faculty
  • Research
  • Featured Topics
  • Academic Units
  • …→
  • Harvard Business School→
  • Faculty & Research→
Publications
Publications
  • 2022
  • Working Paper
  • HBS Working Paper Series

When Less Is More: Using Short-term Signals to Overcome Systematic Bias in Long-run Targeting

By: Ta-Wei Huang and Eva Ascarza
  • Format:Print
  • | Language:English
  • | Pages:57
ShareBar

Abstract

Firms are increasingly interested in developing targeted interventions for customers with the best response. Doing so requires firms to identify differences in customer sensitivity, which they often obtain using uplift modeling (i.e., heterogeneous treatment effect estimation). To optimize the long-run business performance, firms should, in theory, construct such models for a long-term outcome. However, we show that targeting using such models fails to improve (even hurts) firms’ long-run profitability when the outcome of interest accumulates noisy customer behaviors over time. We identify two causes of this problem. First, most state-of-the-art uplift models misattribute noise to the treatment effect, making firms fail to identify customers with the highest long-run sensitivity. Second, customer attrition, present in most marketing contexts, exacerbates the problem by creating an identification issue. To overcome this problem, we argue that firms should only use less-noisy short-term signals to estimate heterogeneity in the long-term treatment effect. In particular, we propose a novel imputation technique that reduces noise in attrition and transaction processes. Using simulation and a real-world experiment, we show that (i) using short-term signals instead of the actual long-term outcome in targeting can significantly improve the long-run profitability, and (ii) the proposed technique outperforms the existing imputation approaches.

Keywords

Long-run Targeting; Heterogeneous Treatment Effect; Statistical Surrogacy; Customer Churn; Field Experiments; Consumer Behavior; Customer Focus and Relationships; AI and Machine Learning; Marketing

Citation

Huang, Ta-Wei, and Eva Ascarza. "When Less Is More: Using Short-term Signals to Overcome Systematic Bias in Long-run Targeting." Harvard Business School Working Paper, No. 23-023, October 2022.
  • SSRN
  • Read Now

About The Author

Eva Ascarza

Marketing
→More Publications

More from the Authors

    • August 2022
    • Faculty Research

    Retail Media Networks

    By: Eva Ascarza, Ayelet Israeli and Celine Chammas
    • March 2022 (Revised March 2022)
    • Faculty Research

    Managing Customers in the Digital Era

    By: Eva Ascarza
    • Proceedings of the National Academy of Sciences

    Eliminating Unintended Bias in Personalized Policies Using Bias-Eliminating Adapted Trees (BEAT)

    By: Eva Ascarza and Ayelet Israeli
More from the Authors
  • Retail Media Networks By: Eva Ascarza, Ayelet Israeli and Celine Chammas
  • Managing Customers in the Digital Era By: Eva Ascarza
  • Eliminating Unintended Bias in Personalized Policies Using Bias-Eliminating Adapted Trees (BEAT) By: Eva Ascarza and Ayelet Israeli
ǁ
Campus Map
Harvard Business School
Soldiers Field
Boston, MA 02163
→Map & Directions
→More Contact Information
  • Make a Gift
  • Site Map
  • Jobs
  • Harvard University
  • Trademarks
  • Policies
  • Accessibility
  • Digital Accessibility
Copyright © President & Fellows of Harvard College