Skip to Main Content
HBS Home
  • About
  • Academic Programs
  • Alumni
  • Faculty & Research
  • Baker Library
  • Giving
  • Harvard Business Review
  • Initiatives
  • News
  • Recruit
  • Map / Directions
Faculty & Research
  • Faculty
  • Research
  • Featured Topics
  • Academic Units
  • …→
  • Harvard Business School→
  • Faculty & Research→
Publications
Publications
  • August 2019
  • Article
  • Management Science

When and How to Diversify—A Multicategory Utility Model for Personalized Content Recommendation

By: Yicheng Song, Nachiketa Sahoo and Elie Ofek
  • Format:Print
ShareBar

Abstract

Sometimes we desire change, a break from the same or an opportunity to fulfill different aspects of our needs. Noting that consumers seek variety, several approaches have been developed to diversify items recommended by personalized recommender systems. However, current diversification strategies operate under a one-shot paradigm without considering the evolution of preferences resulting from recent consumption. Therefore, such methods often sacrifice accuracy. In the context of online media, we show that by recognizing that consumption in a session is the result of a sequence of utility-maximizing selections from various categories, one can increase recommendation accuracy by dynamically tailoring the diversity of suggested items to the diversity sought by the consumer. Our approach is based on a multicategory utility model that captures a consumer’s preference for different categories of content, how quickly the consumer satiates with one category and wishes to substitute it with another, and how the consumer trades off costly search efforts by selecting from a recommended list to discover new content. Taken together, these three elements allow us to characterize how an individual selects a diverse set of items to consume over the course of a session and how likely the individual is to click on recommended content. We estimate the model using a clickstream data set from a large media outlet and apply it to determine the most relevant content to recommend at different stages of an online session. We find that our approach generates recommendations that are on average about 10% more accurate than optimized alternatives and about 25% more accurate than those diversified using existing diversification strategies. Moreover, the proposed method recommends content with diversity that more closely matches the diversity sought by readers, exhibiting lower concentration–diversification bias than other personalized recommender systems. Using a policy simulation, we estimate that recommending content using the proposed approach would result in visitors reading 23% more articles at the studied website and deriving 35% higher utility. This could lead to immediate gains in revenue for the publisher and longer-term improvements in customer satisfaction and retention at the site.

Keywords

Recommender Systems; Personalization; Recommendation Diversity; Variety Seeking; Collaborative Filtering; Consumer Utility Models; Digital Media; Clickstream Analysis; Learning-to-rank; Consumer Behavior; Media; Customization and Personalization; Strategy; Mathematical Methods

Citation

Song, Yicheng, Nachiketa Sahoo, and Elie Ofek. "When and How to Diversify—A Multicategory Utility Model for Personalized Content Recommendation." Management Science 65, no. 8 (August 2019): 3737–3757.
  • Find it at Harvard

About The Author

Elie Ofek

Marketing
→More Publications

More from the Authors

    • January 2023
    • Faculty Research

    Aleph Farms: A New Culture of Meat

    By: Elie Ofek
    • January 2023
    • Faculty Research

    Israelis, Palestinians, and the Technology Bridge Between Them: A Work in Progress

    By: Elie Ofek and Lia Weiner
    • December, 2022
    • Journal of Marketing Research (JMR)

    When and How Should Firms Differentiate? Quality and Advertising Decisions in a Duopoly

    By: Dominique Olié Lauga, Elie Ofek and Zsolt Katona
More from the Authors
  • Aleph Farms: A New Culture of Meat By: Elie Ofek
  • Israelis, Palestinians, and the Technology Bridge Between Them: A Work in Progress By: Elie Ofek and Lia Weiner
  • When and How Should Firms Differentiate? Quality and Advertising Decisions in a Duopoly By: Dominique Olié Lauga, Elie Ofek and Zsolt Katona
ǁ
Campus Map
Harvard Business School
Soldiers Field
Boston, MA 02163
→Map & Directions
→More Contact Information
  • Make a Gift
  • Site Map
  • Jobs
  • Harvard University
  • Trademarks
  • Policies
  • Accessibility
  • Digital Accessibility
Copyright © President & Fellows of Harvard College