Publications
Publications
Show Results For
-
All HBS Web
(71)
- Faculty Publications (24)
Page 1 of
24
Results
→
- October 2023
- Technical Note
Design and Evaluation of Targeted Interventions
By: Eva Ascarza and Ta-Wei (David) Huang
Targeted interventions serve as a pivotal tool in business strategy, streamlining decisions for enhanced efficiency and effectiveness. This note delves into two central facets of such interventions: first, the design of potent decision guidelines, or targeting...
View Details
- September 2023
- Supplement
Design and Evaluation of Targeted Interventions
By: Eva Ascarza
Targeted interventions serve as a pivotal tool in business strategy, streamlining decisions for enhanced efficiency and effectiveness. This note delves into two central facets of such interventions: first, the design of potent decision guidelines, or targeting...
View Details
- June 2023
- Simulation
Artea Dashboard and Targeting Policy Evaluation
By: Ayelet Israeli and Eva Ascarza
Companies deploy A/B experiments to gain valuable insights about their customers in order to answer strategic business problems. In marketing, A/B tests are often used to evaluate marketing interventions intended to generate incremental outcomes for the firm. The Artea...
View Details
Keywords:
Algorithm Bias;
Algorithmic Data;
Race And Ethnicity;
Experimentation;
Promotion;
Marketing And Society;
Big Data;
Privacy;
Data-driven Management;
Data Analysis;
Data Analytics;
E-Commerce Strategy;
Discrimination;
Targeted Advertising;
Targeted Policies;
Pricing Algorithms;
A/B Testing;
Ethical Decision Making;
Customer Base Analysis;
Customer Heterogeneity;
Coupons;
Marketing;
Race;
Gender;
Diversity;
Customer Relationship Management;
Marketing Communications;
Advertising;
Decision Making;
Ethics;
E-commerce;
Analytics and Data Science;
Retail Industry;
Apparel and Accessories Industry;
United States
- September 2022
- Article
Experimentation and Startup Performance: Evidence from A/B Testing
By: Rembrand Koning, Sharique Hasan and Aaron Chatterji
Recent scholarship has argued that experimentation should be the organizing principle for entrepreneurial strategy. Experimentation leads to organizational learning, which drives improvements in firm performance. We investigate this proposition by exploiting the...
View Details
- Article
Online Experimentation: Benefits, Operational and Methodological Challenges, and Scaling Guide
By: Iavor Bojinov and Somit Gupta
In the past decade, online controlled experimentation, or A/B testing, at scale has proved to be a significant driver of business innovation. The practice was first pioneered by the technology sector and, more recently, has been adopted by traditional companies...
View Details
- August 2021
- Case
Orchadio’s First Two Split Experiments
By: Iavor I. Bojinov, Marco Iansiti and David Lane
Orchadio, a direct-to-consumer grocery business, needs to conduct its first two A/B tests—one to evaluate the effectiveness and functioning of its newly redesigned website, and one to market-test four versions of a new banner for the website. To do so, it will rely on...
View Details
Keywords:
Information Management;
Technological Innovation;
Knowledge Use and Leverage;
Resource Allocation;
Marketing;
Measurement and Metrics;
Customization and Personalization;
Information Technology;
Internet and the Web;
Digital Platforms;
Information Technology Industry;
Food and Beverage Industry
- June 23, 2021
- Article
Research: When A/B Testing Doesn't Tell You the Whole Story
By: Eva Ascarza
When it comes to churn prevention, marketers traditionally start by identifying which customers are most likely to churn, and then running A/B tests to determine whether a proposed retention intervention will be effective at retaining those high-risk customers. While...
View Details
Keywords:
Customer Retention;
Churn;
Targeting;
Market Research;
Marketing;
Investment Return;
Customers;
Retention;
Research
- March 2021
- Supplement
Artea (A), (B), (C), and (D): Designing Targeting Strategies
By: Eva Ascarza and Ayelet Israeli
Power Point Supplement to Teaching Note for HBS No. 521-021,521-022,521-037,521-043. This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on...
View Details
Keywords:
Targeted Advertising;
Targeting;
Algorithmic Data;
Bias;
A/B Testing;
Experiment;
Advertising;
Gender;
Race;
Diversity;
Marketing;
Customer Relationship Management;
Prejudice and Bias;
Analytics and Data Science;
Retail Industry;
Apparel and Accessories Industry;
Technology Industry;
United States
- February 2021
- Tutorial
T-tests: Theory and Practice
This video provides an introduction to hypothesis testing, sampling, t-tests, and p-values. It provides examples of A/B testing and t-testing to assess whether difference between two groups are statistically significant. This video can be assigned in conjunction with...
View Details
- September 2020 (Revised June 2023)
- Teaching Note
Artea (A), (B), (C), and (D): Designing Targeting Strategies
By: Eva Ascarza and Ayelet Israeli
Teaching Note for HBS No. 521-021,521-022,521-037,521-043. This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on A/B testing analysis and...
View Details
- September 2020 (Revised July 2022)
- Exercise
Artea (B): Including Customer-level Demographic Data
By: Eva Ascarza and Ayelet Israeli
This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on A/B testing analysis and targeting. Parts (B),(C),(D) Introduce algorithmic bias. The...
View Details
- September 2020 (Revised July 2022)
- Exercise
Artea (C): Potential Discrimination through Algorithmic Targeting
By: Eva Ascarza and Ayelet Israeli
This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on A/B testing analysis and targeting. Parts (B),(C),(D) Introduce algorithmic bias. The...
View Details
- September 2020 (Revised July 2022)
- Exercise
Artea (D): Discrimination through Algorithmic Bias in Targeting
By: Eva Ascarza and Ayelet Israeli
This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on A/B testing analysis and targeting. Parts (B),(C),(D) Introduce algorithmic bias. The...
View Details
- September 2020 (Revised June 2023)
- Exercise
Artea: Designing Targeting Strategies
By: Eva Ascarza and Ayelet Israeli
This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on A/B testing analysis and targeting. Parts (B),(C),(D) Introduce algorithmic bias. The...
View Details
Keywords:
Algorithmic Data;
Race And Ethnicity;
Experimentation;
Promotion;
＂Marketing Analytics＂;
Marketing And Society;
Big Data;
Privacy;
Data-driven Management;
Data Analytics;
Data Analysis;
E-Commerce Strategy;
Discrimination;
Targeted Advertising;
Targeted Policies;
Targeting;
Pricing Algorithms;
A/B Testing;
Ethical Decision Making;
Customer Base Analysis;
Customer Heterogeneity;
Coupons;
Algorithmic Bias;
Marketing;
Race;
Gender;
Diversity;
Customer Relationship Management;
Marketing Communications;
Advertising;
Decision Making;
Ethics;
E-commerce;
Analytics and Data Science;
Retail Industry;
Apparel and Accessories Industry;
United States
- September 2020 (Revised June 2023)
- Supplement
Spreadsheet Supplement to Artea Teaching Note
By: Eva Ascarza and Ayelet Israeli
Spreadsheet Supplement to Artea Teaching Note 521-041. This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on A/B testing analysis and...
View Details
- March–April 2020
- Article
Avoid the Pitfalls of A/B Testing
By: Iavor I. Bojinov, Guillaume Sait-Jacques and Martin Tingley
Online experiments measuring whether “A,” usually the current approach, is inferior to “B,” a proposed improvement, have become integral to the product-development cycle, especially at digital enterprises. But often firms make serious mistakes in conducting these...
View Details
- 2020
- Working Paper
The Effects of Hierarchy on Learning and Performance in Business Experimentation
By: Sourobh Ghosh, Stefan Thomke and Hazjier Pourkhalkhali
Do senior managers help or hurt business experiments? Despite the widespread adoption of business experiments to guide strategic decision-making, we lack a scholarly understanding of what role senior managers play in firm experimentation. Using proprietary data of live...
View Details
- 2020
- Working Paper
Digital Experimentation and Startup Performance: Evidence from A/B Testing
By: Rembrand Koning, Sharique Hasan and Aaron Chatterji
Recent work argues that experimentation is the appropriate framework for entrepreneurial strategy. We investigate this proposition by exploiting the time-varying adoption of A/B testing technology, which has drastically reduced the cost of experimentally testing...
View Details
- January 2019
- Teaching Note
Hubble Contact Lenses: Data Driven Direct-to-Consumer Marketing
By: Ayelet Israeli
Teaching Note for HBS No. 519-011. As its Series A extension round approaches, the founders of Hubble, a subscription-based, social-media fueled, direct-to-consumer (DTC) brand of contact lenses, are reflecting on the marketing strategies that have taken them to a...
View Details
Keywords:
DTC;
Direct To Consumer Marketing;
Health Care;
Mobile;
Attribution;
Experimentation;
Experiments;
Churn/retention;
Customer Lifetime Value;
Internet Marketing;
Big Data;
Analytics;
A/B Testing;
CRM;
Advertising;
Marketing;
Marketing Channels;
Marketing Strategy;
Media;
Brands and Branding;
Marketing Communications;
Digital Marketing;
Acquisition;
Growth and Development Strategy;
Customer Focus and Relationships;
Consumer Behavior;
Social Media;
E-commerce
- October 2018
- Case
Booking.com
By: Stefan Thomke and Daniela Beyersdorfer
The case reveals how Booking.com has become the world's leading travel accommodation platform. The company has put online experimentation at the heart of how it designs digital experiences for its customers and partners. To unlock the potential of large-scale testing,...
View Details