Publications

Publications

Filter Results : (149) Arrow Down

Show Results For

Qualitative Methods (General) Remove Qualitative Methods (General) →

Page 1 of 149 Results →

Are you looking for?

→ Search All HBS Web
  • 2022
  • Working Paper

Nailing Prediction: Experimental Evidence on the Value of Tools in Predictive Model Development
By: Daniel Yue, Paul Hamilton and Iavor Bojinov
Predictive model development is understudied despite its importance to modern businesses. Although prior discussions highlight advances in methods (along the dimensions of data, computing power, and algorithms) as the primary driver of model quality, the value of tools...  View Details
Keywords: Analytics and Data Science
Related
  • 2022
  • Article

OpenXAI: Towards a Transparent Evaluation of Model Explanations
By: Chirag Agarwal, Satyapriya Krishna, Eshika Saxena, Martin Pawelczyk, Nari Johnson, Isha Puri, Marinka Zitnik and Himabindu Lakkaraju
While several types of post hoc explanation methods have been proposed in recent literature, there is very little work on systematically benchmarking these methods. Here, we introduce OpenXAI, a comprehensive and extensible opensource framework for evaluating and...  View Details
Keywords: Measurement and Metrics; Analytics and Data Science
Related
  • December 2022
  • Article

Shaping Nascent Industries: Innovation Strategy and Regulatory Uncertainty in Personal Genomics
By: Cheng Gao and Rory McDonald
In nascent industries—whose new technologies are often poorly understood by regulators—contending with regulatory uncertainty can be crucial to organizational survival and growth. Prior research on nonmarket strategy has largely focused on established firms in mature...  View Details
Keywords: Technological Change; Innovation; Qualitative Methods; New Categories; Entrepreneurship; Technological Innovation; Governing Rules, Regulations, and Reforms; Risk and Uncertainty; Strategy
Related
  • October–December 2022
  • Article

Achieving Reliable Causal Inference with Data-Mined Variables: A Random Forest Approach to the Measurement Error Problem
By: Mochen Yang, Edward McFowland III, Gordon Burtch and Gediminas Adomavicius
Combining machine learning with econometric analysis is becoming increasingly prevalent in both research and practice. A common empirical strategy involves the application of predictive modeling techniques to "mine" variables of interest from available data, followed...  View Details
Keywords: Machine Learning; Econometric Analysis; Instrumental Variable; Random Forest; Causal Inference; AI and Machine Learning; Forecasting and Prediction
Related
  • October 2022
  • Article

How Leaders with Divergent Visions Generate Novel Strategy: Navigating the Paradox of Preservation and Modernization in Swiss Watchmaking
By: Ryan Raffaelli, Rich DeJordy and Rory M. McDonald
How do leaders with divergent visions for their organization come together to create a novel strategy? This paper employs paradox as a lens to investigate how leader-dyads can integrate opposing strategies to produce a new, generative approach. Drawing on a qualitative...  View Details
Keywords: Strategic Paradoxes; Senior Leaders; Organizational Reinvention; Leadership; Technological Innovation; Innovation and Management; Innovation Strategy; Change; Manufacturing Industry; Consumer Products Industry; Switzerland
Related
  • 2022
  • Article

Data Poisoning Attacks on Off-Policy Evaluation Methods
By: Elita Lobo, Harvineet Singh, Marek Petrik, Cynthia Rudin and Himabindu Lakkaraju
Off-policy Evaluation (OPE) methods are a crucial tool for evaluating policies in high-stakes domains such as healthcare, where exploration is often infeasible, unethical, or expensive. However, the extent to which such methods can be trusted under adversarial threats...  View Details
Keywords: Analytics and Data Science; Cybersecurity; Mathematical Methods
Related
  • June 2022
  • Article

Conservatism Gets Funded? A Field Experiment on the Role of Negative Information in Novel Project Evaluation
By: Jacqueline N. Lane, Misha Teplitskiy, Gary Gray, Hardeep Ranu, Michael Menietti, Eva C. Guinan and Karim R. Lakhani
The evaluation and selection of novel projects lies at the heart of scientific and technological innovation, and yet there are persistent concerns about bias, such as conservatism. This paper investigates the role that the format of evaluation, specifically information...  View Details
Keywords: Project Evaluation; Innovation; Knowledge Frontier; Information Sharing; Negativity Bias; Projects; Innovation and Invention; Information; Knowledge Sharing
Related
  • 2022
  • Article

Exploring Counterfactual Explanations Through the Lens of Adversarial Examples: A Theoretical and Empirical Analysis.
By: Martin Pawelczyk, Chirag Agarwal, Shalmali Joshi, Sohini Upadhyay and Himabindu Lakkaraju
As machine learning (ML) models become more widely deployed in high-stakes applications, counterfactual explanations have emerged as key tools for providing actionable model explanations in practice. Despite the growing popularity of counterfactual explanations, a...  View Details
Keywords: Machine Learning Models; Counterfactual Explanations; Adversarial Examples; Mathematical Methods
Related
  • Article

How Much Should We Trust Staggered Difference-In-Differences Estimates?
By: Andrew C. Baker, David F. Larcker and Charles C.Y. Wang
We explain when and how staggered difference-in-differences regression estimators, commonly applied to assess the impact of policy changes, are biased. These biases are likely to be relevant for a large portion of research settings in finance, accounting, and law that...  View Details
Keywords: Difference In Differences; Staggered Difference-in-differences Designs; Generalized Difference-in-differences; Dynamic Treatment Effects; Mathematical Methods
Related
  • 2022
  • Article

Probing GNN Explainers: A Rigorous Theoretical and Empirical Analysis of GNN Explanation Methods.
By: Chirag Agarwal, Marinka Zitnik and Himabindu Lakkaraju
As Graph Neural Networks (GNNs) are increasingly employed in real-world applications, it becomes critical to ensure that the stakeholders understand the rationale behind their predictions. While several GNN explanation methods have been proposed recently, there has...  View Details
Keywords: Graph Neural Networks; Explanation Methods; Mathematical Methods; Framework; Theory; Analysis
Related
  • March 2022 (Revised August 2022)
  • Case

Hometown Foods: Changing Price Amid Inflation
By: Julian De Freitas, Jeremy Yang and Das Narayandas
During the early part of the 2021 Covid-19 pandemic, Hometown Foods, a large seller of flour-based products, thrived as consumers hoarded baked goods and took up baking to pass the time and find comfort. Then, amid growing shortages in commodities, a vaccine arrived,...  View Details
Keywords: COVID-19 Pandemic; Consumer Behavior; Supply Chain; Inflation and Deflation; Spending; Price Bubble; Price; Volatility; Food and Beverage Industry
Related
  • Article

Eliminating Unintended Bias in Personalized Policies Using Bias-Eliminating Adapted Trees (BEAT)
By: Eva Ascarza and Ayelet Israeli

An inherent risk of algorithmic personalization is disproportionate targeting of individuals from certain groups (or demographic characteristics such as gender or race), even when the decision maker does not intend to discriminate based on those “protected”...  View Details

Keywords: Algorithm Bias; Personalization; Targeting; Generalized Random Forests (GRF); Discrimination; Customization and Personalization; Decision Making; Fairness; Mathematical Methods
Related
  • March 2022
  • Article

Estimating the Effectiveness of Permanent Price Reductions for Competing Products Using Multivariate Bayesian Structural Time Series Models
By: Fiammetta Menchetti and Iavor Bojinov
Researchers regularly use synthetic control methods for estimating causal effects when a sub-set of units receive a single persistent treatment, and the rest are unaffected by the change. In many applications, however, units not assigned to treatment are nevertheless...  View Details
Keywords: Causal Inference; Partial Interference; Synthetic Controls; Bayesian Structural Time Series; Mathematical Methods
Related
  • 2022
  • Working Paper

The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspective
By: Satyapriya Krishna, Tessa Han, Alex Gu, Javin Pombra, Shahin Jabbari, Steven Wu and Himabindu Lakkaraju
As various post hoc explanation methods are increasingly being leveraged to explain complex models in high-stakes settings, it becomes critical to develop a deeper understanding of if and when the explanations output by these methods disagree with each other, and how...  View Details
Keywords: AI and Machine Learning; Analytics and Data Science; Mathematical Methods
Related
  • Article

Pattern Detection in the Activation Space for Identifying Synthesized Content
By: Celia Cintas, Skyler Speakman, Girmaw Abebe Tadesse, Victor Akinwande, Edward McFowland III and Komminist Weldemariam
Generative Adversarial Networks (GANs) have recently achieved unprecedented success in photo-realistic image synthesis from low-dimensional random noise. The ability to synthesize high-quality content at a large scale brings potential risks as the generated samples may...  View Details
Keywords: Subset Scanning; Generative Models; Synthetic Content Detection
Related
  • 2022
  • Working Paper

TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversations
By: Dylan Slack, Satyapriya Krishna, Himabindu Lakkaraju and Sameer Singh
Practitioners increasingly use machine learning (ML) models, yet they have become more complex and harder to understand. To address this issue, researchers have proposed techniques to explain model predictions. However, practitioners struggle to use explainability...  View Details
Keywords: Natural Language Conversations; Predictive Models; AI and Machine Learning
Related
  • Article

A Prescriptive Analytics Framework for Optimal Policy Deployment Using Heterogeneous Treatment Effects
By: Edward McFowland III, Sandeep Gangarapu, Ravi Bapna and Tianshu Sun
We define a prescriptive analytics framework that addresses the needs of a constrained decision-maker facing, ex ante, unknown costs and benefits of multiple policy levers. The framework is general in nature and can be deployed in any utility maximizing context, public...  View Details
Keywords: Prescriptive Analytics; Heterogeneous Treatment Effects; Optimization; Observed Rank Utility Condition (OUR); Between-treatment Heterogeneity; Machine Learning; Decision Making; Analysis; Mathematical Methods
Related
  • Article

Counterfactual Explanations Can Be Manipulated
By: Dylan Slack, Sophie Hilgard, Himabindu Lakkaraju and Sameer Singh
Counterfactual explanations are useful for both generating recourse and auditing fairness between groups. We seek to understand whether adversaries can manipulate counterfactual explanations in an algorithmic recourse setting: if counterfactual explanations indicate...  View Details
Keywords: Machine Learning Models; Counterfactual Explanations
Related
  • Article

Reliable Post hoc Explanations: Modeling Uncertainty in Explainability
By: Dylan Slack, Sophie Hilgard, Sameer Singh and Himabindu Lakkaraju
As black box explanations are increasingly being employed to establish model credibility in high stakes settings, it is important to ensure that these explanations are accurate and reliable. However, prior work demonstrates that explanations generated by...  View Details
Keywords: Black Box Explanations; Bayesian Modeling; Decision Making; Risk and Uncertainty; Information Technology
Related
  • October 2021
  • Article

Board Design and Governance Failures at Peer Firms
By: Shelby Gai, J. Yo-Jud Cheng and Andy Wu
Our study introduces board committees as a crucial determinant of board actions. We examine how directors who structurally link different board committees—referred to as multi-committee directors (MCDs)—explain why some board actions are merely symbolic while others...  View Details
Keywords: Board Committees; Board Monitoring; New Director Nomination; Peer Financial Restatements; Governing and Advisory Boards; Corporate Governance; Performance Effectiveness
Related

Are you looking for?

→ Search All HBS Web