Skip to Main Content
HBS Home
  • About
  • Academic Programs
  • Alumni
  • Faculty & Research
  • Baker Library
  • Giving
  • Harvard Business Review
  • Initiatives
  • News
  • Recruit
  • Map / Directions
Faculty & Research
  • Faculty
  • Research
  • Featured Topics
  • Academic Units
  • …→
  • Harvard Business School→
  • Faculty & Research→
Publications
Publications
  • 2023
  • Chapter
  • Artificial Intelligence in Marketing

Marketing Through the Machine’s Eyes: Image Analytics and Interpretability

By: Shunyuan Zhang, Flora Feng and Kannan Srinivasan
  • Format:Print
ShareBar

Abstract

he growth of social media and the sharing economy is generating abundant unstructured image and video data. Computer vision techniques can derive rich insights from unstructured data and can inform recommendations for increasing profits and consumer utility—if only the model outputs are interpretable enough to earn the trust of consumers and buy-in from companies. To build a foundation for understanding the importance of model interpretation in image analytics, the first section of this article reviews the existing work along three dimensions: the data type (image data vs. video data), model structure (feature-level vs. pixel-level), and primary application (to increase company profits vs. to maximize consumer utility). The second section discusses how the “black box” of pixel-level models leads to legal and ethical problems, but interpretability can be improved with eXplainable Artificial Intelligence (XAI) methods. We classify and review XAI methods based on transparency, the scope of interpretability (global vs. local), and model specificity (model-specific vs. model-agnostic); in marketing research, transparent, local, model-agnostic methods are most common. The third section proposes three promising future research directions related to model interpretability: the economic value of augmented reality in 3D product tracking and visualization, field experiments to compare human judgments with the outputs of machine vision systems, and XAI methods to test strategies for mitigating algorithmic bias.

Keywords

Transparency; Marketing Research; Algorithmic Bias; AI and Machine Learning; Marketing

Citation

Zhang, Shunyuan, Flora Feng, and Kannan Srinivasan. "Marketing Through the Machine’s Eyes: Image Analytics and Interpretability." Chap. 8 in Artificial Intelligence in Marketing. 20, edited by Naresh K. Malhotra, K. Sudhir, and Olivier Toubia. Review of Marketing Research. Emerald Publishing Limited, forthcoming.

About The Author

Shunyuan Zhang

Marketing
→More Publications

More from the Authors

    • August 2023
    • Faculty Research

    Kariyer.net: Recruiting AI

    By: Shunyuan Zhang, Fares Khrais and Namrata Arora
    • May–June 2023
    • Marketing Science

    Unmasking Behaviors During the Pandemic with Video Analytics

    By: Shunyuan Zhang, Kaiquan Xu and Kannan Srinivasan
    • January 2023
    • Faculty Research

    Perfect Diary (完美日记)

    By: Shunyuan Zhang and Sunil Gupta
More from the Authors
  • Kariyer.net: Recruiting AI By: Shunyuan Zhang, Fares Khrais and Namrata Arora
  • Unmasking Behaviors During the Pandemic with Video Analytics By: Shunyuan Zhang, Kaiquan Xu and Kannan Srinivasan
  • Perfect Diary (完美日记) By: Shunyuan Zhang and Sunil Gupta
ǁ
Campus Map
Harvard Business School
Soldiers Field
Boston, MA 02163
→Map & Directions
→More Contact Information
  • Make a Gift
  • Site Map
  • Jobs
  • Harvard University
  • Trademarks
  • Policies
  • Accessibility
  • Digital Accessibility
Copyright © President & Fellows of Harvard College