Filter Results
:
(149)
Show Results For
-
All HBS Web
(1,245)
- Faculty Publications (149)
Show Results For
-
All HBS Web
(1,245)
- Faculty Publications (149)
Page 1 of
149
Results
→
- 2022
- Working Paper
Nailing Prediction: Experimental Evidence on the Value of Tools in Predictive Model Development
Predictive model development is understudied despite its importance to modern businesses. Although prior discussions highlight advances in methods (along the dimensions of data, computing power, and algorithms) as the primary driver of model quality, the value of tools...
View Details
Keywords:
Analytics and Data Science
Yue, Daniel, Paul Hamilton, and Iavor Bojinov. "Nailing Prediction: Experimental Evidence on the Value of Tools in Predictive Model Development." Harvard Business School Working Paper, No. 23-029, December 2022.
- 2022
- Article
OpenXAI: Towards a Transparent Evaluation of Model Explanations
By: Chirag Agarwal, Satyapriya Krishna, Eshika Saxena, Martin Pawelczyk, Nari Johnson, Isha Puri, Marinka Zitnik and Himabindu Lakkaraju
While several types of post hoc explanation methods have been proposed in recent literature, there is very little work on systematically benchmarking these methods. Here, we introduce OpenXAI, a comprehensive and extensible opensource framework for evaluating and...
View Details
Agarwal, Chirag, Satyapriya Krishna, Eshika Saxena, Martin Pawelczyk, Nari Johnson, Isha Puri, Marinka Zitnik, and Himabindu Lakkaraju. "OpenXAI: Towards a Transparent Evaluation of Model Explanations." Advances in Neural Information Processing Systems (NeurIPS) (2022).
- December 2022
- Article
Shaping Nascent Industries: Innovation Strategy and Regulatory Uncertainty in Personal Genomics
By: Cheng Gao and Rory McDonald
In nascent industries—whose new technologies are often poorly understood
by regulators—contending with regulatory uncertainty can be crucial to organizational survival and growth. Prior research on nonmarket strategy has largely
focused on established firms in mature...
View Details
Keywords:
Technological Change;
Innovation;
Qualitative Methods;
New Categories;
Entrepreneurship;
Technological Innovation;
Governing Rules, Regulations, and Reforms;
Risk and Uncertainty;
Strategy
Gao, Cheng, and Rory McDonald. "Shaping Nascent Industries: Innovation Strategy and Regulatory Uncertainty in Personal Genomics." Administrative Science Quarterly 67, no. 4 (December 2022): 915–967.
- October–December 2022
- Article
Achieving Reliable Causal Inference with Data-Mined Variables: A Random Forest Approach to the Measurement Error Problem
By: Mochen Yang, Edward McFowland III, Gordon Burtch and Gediminas Adomavicius
Combining machine learning with econometric analysis is becoming increasingly prevalent in both research and practice. A common empirical strategy involves the application of predictive modeling techniques to "mine" variables of interest from available data, followed...
View Details
Keywords:
Machine Learning;
Econometric Analysis;
Instrumental Variable;
Random Forest;
Causal Inference;
AI and Machine Learning;
Forecasting and Prediction
Yang, Mochen, Edward McFowland III, Gordon Burtch, and Gediminas Adomavicius. "Achieving Reliable Causal Inference with Data-Mined Variables: A Random Forest Approach to the Measurement Error Problem." INFORMS Journal on Data Science 1, no. 2 (October–December 2022): 138–155.
- October 2022
- Article
How Leaders with Divergent Visions Generate Novel Strategy: Navigating the Paradox of Preservation and Modernization in Swiss Watchmaking
By: Ryan Raffaelli, Rich DeJordy and Rory M. McDonald
How do leaders with divergent visions for their organization come together to create a novel strategy? This paper employs paradox as a lens to investigate how leader-dyads can integrate opposing strategies to produce a new, generative approach. Drawing on a qualitative...
View Details
Keywords:
Strategic Paradoxes;
Senior Leaders;
Organizational Reinvention;
Leadership;
Technological Innovation;
Innovation and Management;
Innovation Strategy;
Change;
Manufacturing Industry;
Consumer Products Industry;
Switzerland
Raffaelli, Ryan, Rich DeJordy, and Rory M. McDonald. "How Leaders with Divergent Visions Generate Novel Strategy: Navigating the Paradox of Preservation and Modernization in Swiss Watchmaking." Academy of Management Journal 65, no. 5 (October 2022): 1593–1622.
- 2022
- Article
Data Poisoning Attacks on Off-Policy Evaluation Methods
By: Elita Lobo, Harvineet Singh, Marek Petrik, Cynthia Rudin and Himabindu Lakkaraju
Off-policy Evaluation (OPE) methods are a crucial tool for evaluating policies in high-stakes domains such as healthcare, where exploration is often infeasible, unethical, or expensive. However, the extent to which such methods can be trusted under adversarial threats...
View Details
Lobo, Elita, Harvineet Singh, Marek Petrik, Cynthia Rudin, and Himabindu Lakkaraju. "Data Poisoning Attacks on Off-Policy Evaluation Methods." Special Issue on Proceedings of the 38th Conference on Uncertainty in Artificial Intelligence (UAI 2022). Proceedings of Machine Learning Research (PMLR) 180 (2022): 1264–1274.
- June 2022
- Article
Conservatism Gets Funded? A Field Experiment on the Role of Negative Information in Novel Project Evaluation
By: Jacqueline N. Lane, Misha Teplitskiy, Gary Gray, Hardeep Ranu, Michael Menietti, Eva C. Guinan and Karim R. Lakhani
The evaluation and selection of novel projects lies at the heart of scientific and technological innovation, and yet there are persistent concerns about bias, such as conservatism. This paper investigates the role that the format of evaluation, specifically information...
View Details
Keywords:
Project Evaluation;
Innovation;
Knowledge Frontier;
Information Sharing;
Negativity Bias;
Projects;
Innovation and Invention;
Information;
Knowledge Sharing
Lane, Jacqueline N., Misha Teplitskiy, Gary Gray, Hardeep Ranu, Michael Menietti, Eva C. Guinan, and Karim R. Lakhani. "Conservatism Gets Funded? A Field Experiment on the Role of Negative Information in Novel Project Evaluation." Management Science 68, no. 6 (June 2022): 4478–4495.
- 2022
- Article
Exploring Counterfactual Explanations Through the Lens of Adversarial Examples: A Theoretical and Empirical Analysis.
By: Martin Pawelczyk, Chirag Agarwal, Shalmali Joshi, Sohini Upadhyay and Himabindu Lakkaraju
As machine learning (ML) models become more widely deployed in high-stakes applications, counterfactual explanations have emerged as key tools for providing actionable model explanations in practice. Despite the growing popularity of counterfactual explanations, a...
View Details
Keywords:
Machine Learning Models;
Counterfactual Explanations;
Adversarial Examples;
Mathematical Methods
Pawelczyk, Martin, Chirag Agarwal, Shalmali Joshi, Sohini Upadhyay, and Himabindu Lakkaraju. "Exploring Counterfactual Explanations Through the Lens of Adversarial Examples: A Theoretical and Empirical Analysis." Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS) 25th (2022).
- Article
How Much Should We Trust Staggered Difference-In-Differences Estimates?
By: Andrew C. Baker, David F. Larcker and Charles C.Y. Wang
We explain when and how staggered difference-in-differences regression estimators, commonly applied to assess the impact of policy changes, are biased. These biases are likely to be relevant for a large portion of research settings in finance, accounting, and law that...
View Details
Keywords:
Difference In Differences;
Staggered Difference-in-differences Designs;
Generalized Difference-in-differences;
Dynamic Treatment Effects;
Mathematical Methods
Baker, Andrew C., David F. Larcker, and Charles C.Y. Wang. "How Much Should We Trust Staggered Difference-In-Differences Estimates?" Journal of Financial Economics 144, no. 2 (May 2022): 370–395. (Editor's Choice, May 2022.)
- 2022
- Article
Probing GNN Explainers: A Rigorous Theoretical and Empirical Analysis of GNN Explanation Methods.
By: Chirag Agarwal, Marinka Zitnik and Himabindu Lakkaraju
As Graph Neural Networks (GNNs) are increasingly employed in real-world applications, it becomes critical to ensure that the stakeholders understand the rationale behind their predictions. While several GNN explanation methods have been proposed recently, there has...
View Details
Keywords:
Graph Neural Networks;
Explanation Methods;
Mathematical Methods;
Framework;
Theory;
Analysis
Agarwal, Chirag, Marinka Zitnik, and Himabindu Lakkaraju. "Probing GNN Explainers: A Rigorous Theoretical and Empirical Analysis of GNN Explanation Methods." Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS) 25th (2022).
- March 2022 (Revised August 2022)
- Case
Hometown Foods: Changing Price Amid Inflation
During the early part of the 2021 Covid-19 pandemic, Hometown Foods, a large seller of flour-based products, thrived as consumers hoarded baked goods and took up baking to pass the time and find comfort. Then, amid growing shortages in commodities, a vaccine arrived,...
View Details
Keywords:
COVID-19 Pandemic;
Consumer Behavior;
Supply Chain;
Inflation and Deflation;
Spending;
Price Bubble;
Price;
Volatility;
Food and Beverage Industry
De Freitas, Julian, Jeremy Yang, and Das Narayandas. "Hometown Foods: Changing Price Amid Inflation." Harvard Business School Case 522-087, March 2022. (Revised August 2022.)
- Article
Eliminating Unintended Bias in Personalized Policies Using Bias-Eliminating Adapted Trees (BEAT)
By: Eva Ascarza and Ayelet Israeli
An inherent risk of algorithmic personalization is disproportionate targeting of individuals from certain groups (or demographic characteristics such as gender or race), even when the decision maker does not intend to discriminate based on those “protected”... View Details
Keywords:
Algorithm Bias;
Personalization;
Targeting;
Generalized Random Forests (GRF);
Discrimination;
Customization and Personalization;
Decision Making;
Fairness;
Mathematical Methods
Ascarza, Eva, and Ayelet Israeli. "Eliminating Unintended Bias in Personalized Policies Using Bias-Eliminating Adapted Trees (BEAT)." e2115126119. Proceedings of the National Academy of Sciences 119, no. 11 (March 8, 2022).
- March 2022
- Article
Estimating the Effectiveness of Permanent Price Reductions for Competing Products Using Multivariate Bayesian Structural Time Series Models
By: Fiammetta Menchetti and Iavor Bojinov
Researchers regularly use synthetic control methods for estimating causal effects when a sub-set of units receive a single persistent treatment, and the rest are unaffected by the change. In many applications, however, units not assigned to treatment are nevertheless...
View Details
Keywords:
Causal Inference;
Partial Interference;
Synthetic Controls;
Bayesian Structural Time Series;
Mathematical Methods
Menchetti, Fiammetta, and Iavor Bojinov. "Estimating the Effectiveness of Permanent Price Reductions for Competing Products Using Multivariate Bayesian Structural Time Series Models." Annals of Applied Statistics 16, no. 1 (March 2022): 414–435.
- 2022
- Working Paper
The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspective
By: Satyapriya Krishna, Tessa Han, Alex Gu, Javin Pombra, Shahin Jabbari, Steven Wu and Himabindu Lakkaraju
As various post hoc explanation methods are increasingly being leveraged to explain complex models in high-stakes settings, it becomes critical to develop a deeper understanding of if and when the explanations output by these methods disagree with each other, and how...
View Details
Krishna, Satyapriya, Tessa Han, Alex Gu, Javin Pombra, Shahin Jabbari, Steven Wu, and Himabindu Lakkaraju. "The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspective." Working Paper, 2022.
- Article
Pattern Detection in the Activation Space for Identifying Synthesized Content
By: Celia Cintas, Skyler Speakman, Girmaw Abebe Tadesse, Victor Akinwande, Edward McFowland III and Komminist Weldemariam
Generative Adversarial Networks (GANs) have recently achieved unprecedented success in photo-realistic image synthesis from low-dimensional random noise. The ability to synthesize high-quality content at a large scale brings potential risks as the generated samples may...
View Details
Cintas, Celia, Skyler Speakman, Girmaw Abebe Tadesse, Victor Akinwande, Edward McFowland III, and Komminist Weldemariam. "Pattern Detection in the Activation Space for Identifying Synthesized Content." Pattern Recognition Letters 153 (January 2022): 207–213.
- 2022
- Working Paper
TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversations
By: Dylan Slack, Satyapriya Krishna, Himabindu Lakkaraju and Sameer Singh
Practitioners increasingly use machine learning (ML) models, yet they have become more complex and harder to understand. To address this issue, researchers have proposed techniques to explain model predictions. However, practitioners struggle to use explainability...
View Details
Slack, Dylan, Satyapriya Krishna, Himabindu Lakkaraju, and Sameer Singh. "TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversations." Working Paper, 2022.
- Article
A Prescriptive Analytics Framework for Optimal Policy Deployment Using Heterogeneous Treatment Effects
By: Edward McFowland III, Sandeep Gangarapu, Ravi Bapna and Tianshu Sun
We define a prescriptive analytics framework that addresses the needs of a constrained decision-maker facing, ex ante, unknown costs and benefits of multiple policy levers. The framework is general in nature and can be deployed in any utility maximizing context, public...
View Details
Keywords:
Prescriptive Analytics;
Heterogeneous Treatment Effects;
Optimization;
Observed Rank Utility Condition (OUR);
Between-treatment Heterogeneity;
Machine Learning;
Decision Making;
Analysis;
Mathematical Methods
McFowland III, Edward, Sandeep Gangarapu, Ravi Bapna, and Tianshu Sun. "A Prescriptive Analytics Framework for Optimal Policy Deployment Using Heterogeneous Treatment Effects." MIS Quarterly 45, no. 4 (December 2021): 1807–1832.
- Article
Counterfactual Explanations Can Be Manipulated
By: Dylan Slack, Sophie Hilgard, Himabindu Lakkaraju and Sameer Singh
Counterfactual explanations are useful for both generating recourse and auditing fairness between groups. We seek to understand whether adversaries can manipulate counterfactual explanations in an algorithmic recourse setting: if counterfactual explanations indicate...
View Details
Slack, Dylan, Sophie Hilgard, Himabindu Lakkaraju, and Sameer Singh. "Counterfactual Explanations Can Be Manipulated." Advances in Neural Information Processing Systems (NeurIPS) 34 (2021).
- Article
Reliable Post hoc Explanations: Modeling Uncertainty in Explainability
By: Dylan Slack, Sophie Hilgard, Sameer Singh and Himabindu Lakkaraju
As black box explanations are increasingly being employed to establish model credibility in high stakes settings, it is important to ensure that these explanations are accurate and reliable. However, prior work demonstrates that explanations generated by...
View Details
Keywords:
Black Box Explanations;
Bayesian Modeling;
Decision Making;
Risk and Uncertainty;
Information Technology
Slack, Dylan, Sophie Hilgard, Sameer Singh, and Himabindu Lakkaraju. "Reliable Post hoc Explanations: Modeling Uncertainty in Explainability." Advances in Neural Information Processing Systems (NeurIPS) 34 (2021).
- October 2021
- Article
Board Design and Governance Failures at Peer Firms
By: Shelby Gai, J. Yo-Jud Cheng and Andy Wu
Our study introduces board committees as a crucial determinant of board actions. We examine how directors who structurally link different board committees—referred to as multi-committee directors (MCDs)—explain why some board actions are merely symbolic while others...
View Details
Keywords:
Board Committees;
Board Monitoring;
New Director Nomination;
Peer Financial Restatements;
Governing and Advisory Boards;
Corporate Governance;
Performance Effectiveness
Gai, Shelby, J. Yo-Jud Cheng, and Andy Wu. "Board Design and Governance Failures at Peer Firms." Strategic Management Journal 42, no. 10 (October 2021): 1909–1938.