Skip to Main Content
HBS Home
  • About
  • Academic Programs
  • Alumni
  • Faculty & Research
  • Baker Library
  • Giving
  • Harvard Business Review
  • Initiatives
  • News
  • Recruit
  • Map / Directions
Faculty & Research
  • Faculty
  • Research
  • Featured Topics
  • Academic Units
  • …→
  • Harvard Business School→
  • Faculty & Research→
Publications
Publications
  • Article
  • Harvard Data Science Review

Online Experimentation: Benefits, Operational and Methodological Challenges, and Scaling Guide

By: Iavor Bojinov and Somit Gupta
  • Format:Electronic
ShareBar

Abstract

In the past decade, online controlled experimentation, or A/B testing, at scale has proved to be a significant driver of business innovation. The practice was first pioneered by the technology sector and, more recently, has been adopted by traditional companies undergoing a digital transformation. This article provides a primer to business leaders, data scientists, and academic researchers on business experimentation at scale, explaining the benefits, challenges (both operational and methodological), and best practices in creating and scaling an experimentation-driven, decision-making culture.

Keywords

A/B Testing; Experimentation; Data-driven Culture; Product Development; Innovation and Invention; Digital Transformation

Citation

Bojinov, Iavor, and Somit Gupta. "Online Experimentation: Benefits, Operational and Methodological Challenges, and Scaling Guide." Harvard Data Science Review, no. 4.3 (Summer, 2022).
  • Read Now

About The Author

Iavor I. Bojinov

Technology and Operations Management
→More Publications

More from the Authors

    • 2022
    • Faculty Research

    Nailing Prediction: Experimental Evidence on the Value of Tools in Predictive Model Development

    By: Daniel Yue, Paul Hamilton and Iavor Bojinov
    • October 2022
    • Faculty Research

    On Ramp to Crypto

    By: Iavor Bojinov, Michael Parzen and Paul Hamilton
    • September 16, 2022
    • Science

    A Causal Test of the Strength of Weak Ties

    By: Karthik Rajkumar, Guillaume Saint-Jacques, Iavor I. Bojinov, Erik Brynjolfsson and Sinan Aral
More from the Authors
  • Nailing Prediction: Experimental Evidence on the Value of Tools in Predictive Model Development By: Daniel Yue, Paul Hamilton and Iavor Bojinov
  • On Ramp to Crypto By: Iavor Bojinov, Michael Parzen and Paul Hamilton
  • A Causal Test of the Strength of Weak Ties By: Karthik Rajkumar, Guillaume Saint-Jacques, Iavor I. Bojinov, Erik Brynjolfsson and Sinan Aral
ǁ
Campus Map
Harvard Business School
Soldiers Field
Boston, MA 02163
→Map & Directions
→More Contact Information
  • Make a Gift
  • Site Map
  • Jobs
  • Harvard University
  • Trademarks
  • Policies
  • Accessibility
  • Digital Accessibility
Copyright © President & Fellows of Harvard College