Filter Results
:
(54)
Show Results For
-
All HBS Web
(163)
- Faculty Publications (54)
Show Results For
-
All HBS Web
(163)
- Faculty Publications (54)
Page 1 of
54
Results
→
- 2023
- Working Paper
An Experimental Design for Anytime-Valid Causal Inference on Multi-Armed Bandits
By: Biyonka Liang and Iavor I. Bojinov
Typically, multi-armed bandit (MAB) experiments are analyzed at the end of the study and thus require the analyst to specify a fixed sample size in advance. However, in many online learning applications, it is advantageous to continuously produce inference on the...
View Details
Liang, Biyonka, and Iavor I. Bojinov. "An Experimental Design for Anytime-Valid Causal Inference on Multi-Armed Bandits." Harvard Business School Working Paper, No. 24-057, March 2024.
- February 26, 2024
- Article
Making Workplaces Safer Through Machine Learning
By: Matthew S. Johnson, David I. Levine and Michael W. Toffel
Machine learning algorithms can dramatically improve regulatory effectiveness. This short article describes the authors' scholarly work that shows how the U.S. Occupational Safety and Health Administration (OSHA) could have reduced nearly twice as many occupational...
View Details
Keywords:
Government Experimentation;
Auditing;
Inspection;
Evaluation;
Process Improvement;
Government Administration;
AI and Machine Learning;
Safety;
Governing Rules, Regulations, and Reforms
Johnson, Matthew S., David I. Levine, and Michael W. Toffel. "Making Workplaces Safer Through Machine Learning." Regulatory Review (February 26, 2024).
- February 2024
- Teaching Note
Data-Driven Denim: Financial Forecasting at Levi Strauss
By: Mark Egan
Teaching Note for HBS Case No. 224-029. Levi Strauss & Co. (“Levi Strauss”) partnered with the IT services company Wipro to incorporate more sophisticated methods, such as machine learning, into their financial forecasting process starting in 2018. The decision to...
View Details
- 2024
- Working Paper
Warnings and Endorsements: Improving Human-AI Collaboration Under Covariate Shift
By: Matthew DosSantos DiSorbo and Kris Ferreira
Problem definition: While artificial intelligence (AI) algorithms may perform well on data that are representative of the training set (inliers), they may err when extrapolating on non-representative data (outliers). These outliers often originate from covariate shift,...
View Details
- January 2024 (Revised February 2024)
- Case
Data-Driven Denim: Financial Forecasting at Levi Strauss
By: Mark Egan
The case examines Levi Strauss’ journey in implementing machine learning and AI into its financial forecasting process. The apparel company partnered with the IT company Wipro in 2017 to develop a machine learning algorithm that could help Levi Strauss forecast its...
View Details
Keywords:
Investor Relations;
Forecasting;
Machine Learning;
Artificial Intelligence;
Apparel;
Corporate Finance;
Forecasting and Prediction;
AI and Machine Learning;
Digital Transformation;
Apparel and Accessories Industry;
United States
Egan, Mark. "Data-Driven Denim: Financial Forecasting at Levi Strauss." Harvard Business School Case 224-029, January 2024. (Revised February 2024.)
- 2023
- Article
Benchmarking Large Language Models on CMExam—A Comprehensive Chinese Medical Exam Dataset
By: Junling Liu, Peilin Zhou, Yining Hua, Dading Chong, Zhongyu Tian, Andrew Liu, Helin Wang, Chenyu You, Zhenhua Guo, Lei Zhu and Michael Lingzhi Li
Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address this gap, we introduce CMExam,...
View Details
Keywords:
Large Language Model;
AI and Machine Learning;
Analytics and Data Science;
Health Industry
Liu, Junling, Peilin Zhou, Yining Hua, Dading Chong, Zhongyu Tian, Andrew Liu, Helin Wang, Chenyu You, Zhenhua Guo, Lei Zhu, and Michael Lingzhi Li. "Benchmarking Large Language Models on CMExam—A Comprehensive Chinese Medical Exam Dataset." Conference on Neural Information Processing Systems (NeurIPS), Datasets and Benchmarks Track 36 (2023).
- October 2023
- Case
ReUp Education: Can AI Help Learners Return to College?
By: Kris Ferreira, Christopher Thomas Ryan and Sarah Mehta
Founded in 2015, ReUp Education helps “stopped out students”—learners who have stopped making progress towards graduation—achieve their college completion goals. The company relies on a team of success coaches to engage with learners and help them reenroll. In 2019,...
View Details
Keywords:
AI;
Algorithms;
Machine Learning;
Edtech;
Education Technology;
Analysis;
Higher Education;
AI and Machine Learning;
Customization and Personalization;
Failure;
Education Industry;
Technology Industry;
United States
Ferreira, Kris, Christopher Thomas Ryan, and Sarah Mehta. "ReUp Education: Can AI Help Learners Return to College?" Harvard Business School Case 624-007, October 2023.
- 2023
- Working Paper
In-Context Unlearning: Language Models as Few Shot Unlearners
By: Martin Pawelczyk, Seth Neel and Himabindu Lakkaraju
Machine unlearning, the study of efficiently removing the impact of specific training points on the
trained model, has garnered increased attention of late, driven by the need to comply with privacy
regulations like the Right to be Forgotten. Although unlearning is...
View Details
Pawelczyk, Martin, Seth Neel, and Himabindu Lakkaraju. "In-Context Unlearning: Language Models as Few Shot Unlearners." Working Paper, October 2023.
- 2023
- Working Paper
The Impact of Input Inaccuracy on Leveraging AI Tools: Evidence from Algorithmic Labor Scheduling
Are the inputs used by your AI tool correct and up to date? In this paper, we show that the answer to this question: (i) is frequently a “no” in real business contexts, and (ii) has significant implications on the performance of AI tools. In the context of algorithmic...
View Details
Kwon, Caleb, Antonio Moreno, and Ananth Raman. "The Impact of Input Inaccuracy on Leveraging AI Tools: Evidence from Algorithmic Labor Scheduling." Working Paper, October 2023.
- September 29, 2023
- Article
Eliminating Algorithmic Bias Is Just the Beginning of Equitable AI
By: Simon Friis and James Riley
When it comes to artificial intelligence and inequality, algorithmic bias rightly receives a lot of attention. But it’s just one way that AI can lead to inequitable outcomes. To truly create equitable AI, we need to consider three forces through which it might make...
View Details
Friis, Simon, and James Riley. "Eliminating Algorithmic Bias Is Just the Beginning of Equitable AI." Harvard Business Review (website) (September 29, 2023).
- 2023
- Article
On the Impact of Actionable Explanations on Social Segregation
By: Ruijiang Gao and Himabindu Lakkaraju
As predictive models seep into several real-world applications, it has become critical to ensure that individuals who are negatively impacted by the outcomes of these models are provided with a means for recourse. To this end, there has been a growing body of research...
View Details
Gao, Ruijiang, and Himabindu Lakkaraju. "On the Impact of Actionable Explanations on Social Segregation." Proceedings of the International Conference on Machine Learning (ICML) 40th (2023): 10727–10743.
- 2023
- Article
Towards Bridging the Gaps between the Right to Explanation and the Right to Be Forgotten
By: Himabindu Lakkaraju, Satyapriya Krishna and Jiaqi Ma
The Right to Explanation and the Right to be Forgotten are two important principles outlined to regulate algorithmic decision making and data usage in real-world applications. While the right to explanation allows individuals to request an actionable explanation for an...
View Details
Keywords:
Analytics and Data Science;
AI and Machine Learning;
Decision Making;
Governing Rules, Regulations, and Reforms
Lakkaraju, Himabindu, Satyapriya Krishna, and Jiaqi Ma. "Towards Bridging the Gaps between the Right to Explanation and the Right to Be Forgotten." Proceedings of the International Conference on Machine Learning (ICML) 40th (2023): 17808–17826.
- July 2023
- Case
DayTwo: Going to Market with Gut Microbiome (Abridged)
By: Ayelet Israeli
DayTwo is a young Israeli startup that applies research on the gut microbiome and machine learning algorithms to deliver personalized nutritional recommendations to its users in order to minimize blood sugar spikes after meals. After a first year of trial rollout in...
View Details
Keywords:
Business Startups;
AI and Machine Learning;
Nutrition;
Market Entry and Exit;
Product Marketing;
Distribution Channels
Israeli, Ayelet. "DayTwo: Going to Market with Gut Microbiome (Abridged)." Harvard Business School Case 524-015, July 2023.
- 2023
- Working Paper
Insufficiently Justified Disparate Impact: A New Criterion for Subgroup Fairness
By: Neil Menghani, Edward McFowland III and Daniel B. Neill
In this paper, we develop a new criterion, "insufficiently justified disparate impact" (IJDI), for assessing whether recommendations (binarized predictions) made by an algorithmic decision support tool are fair. Our novel, utility-based IJDI criterion evaluates false...
View Details
Menghani, Neil, Edward McFowland III, and Daniel B. Neill. "Insufficiently Justified Disparate Impact: A New Criterion for Subgroup Fairness." Working Paper, June 2023.
- 2023
- Working Paper
Digital Lending and Financial Well-Being: Through the Lens of Mobile Phone Data
By: AJ Chen, Omri Even-Tov, Jung Koo Kang and Regina Wittenberg-Moerman
To mitigate information asymmetry about borrowers in developing economies, digital lenders utilize machine-learning algorithms and nontraditional data from borrowers’ mobile devices. Consequently, digital lenders have managed to expand access to credit for millions of...
View Details
Keywords:
Borrowing and Debt;
Credit;
AI and Machine Learning;
Welfare;
Well-being;
Developing Countries and Economies;
Equality and Inequality
Chen, AJ, Omri Even-Tov, Jung Koo Kang, and Regina Wittenberg-Moerman. "Digital Lending and Financial Well-Being: Through the Lens of Mobile Phone Data." Harvard Business School Working Paper, No. 23-076, April 2023. (Revised November 2023. SSRN Working Paper Series, November 2023)
- 2023
- Working Paper
Random Distribution Shift in Refugee Placement: Strategies for Building Robust Models
By: Kirk Bansak, Elisabeth Paulson and Dominik Rothenhäusler
Algorithmic assignment of refugees and asylum seekers to locations within host
countries has gained attention in recent years, with implementations in the U.S.
and Switzerland. These approaches use data on past arrivals to generate machine
learning models that can...
View Details
Bansak, Kirk, Elisabeth Paulson, and Dominik Rothenhäusler. "Random Distribution Shift in Refugee Placement: Strategies for Building Robust Models." Working Paper, June 2023.
- June 2020
- Article
Real-time Data from Mobile Platforms to Evaluate Sustainable Transportation Infrastructure
By: Omar Isaac Asensio, Kevin Alvarez, Arielle Dror, Emerson Wenzel, Catharina Hollauer and Sooji Ha
By displacing gasoline and diesel fuels, electric cars and fleets reduce emissions from the transportation sector, thus offering important public health benefits. However, public confidence in the reliability of charging infrastructure remains a fundamental barrier to...
View Details
Keywords:
Environmental Sustainability;
Transportation;
Infrastructure;
Behavior;
AI and Machine Learning;
Demand and Consumers
Asensio, Omar Isaac, Kevin Alvarez, Arielle Dror, Emerson Wenzel, Catharina Hollauer, and Sooji Ha. "Real-time Data from Mobile Platforms to Evaluate Sustainable Transportation Infrastructure." Nature Sustainability 3, no. 6 (June 2020): 463–471.
- 2023
- Article
Probabilistically Robust Recourse: Navigating the Trade-offs between Costs and Robustness in Algorithmic Recourse
By: Martin Pawelczyk, Teresa Datta, Johannes van-den-Heuvel, Gjergji Kasneci and Himabindu Lakkaraju
As machine learning models are increasingly being employed to make consequential decisions in real-world settings, it becomes critical to ensure that individuals who are adversely impacted (e.g., loan denied) by the predictions of these models are provided with a means...
View Details
Pawelczyk, Martin, Teresa Datta, Johannes van-den-Heuvel, Gjergji Kasneci, and Himabindu Lakkaraju. "Probabilistically Robust Recourse: Navigating the Trade-offs between Costs and Robustness in Algorithmic Recourse." Proceedings of the International Conference on Learning Representations (ICLR) (2023).
- April 2023
- Article
On the Privacy Risks of Algorithmic Recourse
By: Martin Pawelczyk, Himabindu Lakkaraju and Seth Neel
As predictive models are increasingly being employed to make consequential decisions, there is a growing emphasis on developing techniques that can provide algorithmic recourse to affected individuals. While such recourses can be immensely beneficial to affected...
View Details
Pawelczyk, Martin, Himabindu Lakkaraju, and Seth Neel. "On the Privacy Risks of Algorithmic Recourse." Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS) 206 (April 2023).
- 2023
- Working Paper
The Limits of Algorithmic Measures of Race in Studies of Outcome Disparities
By: David S. Scharfstein and Sergey Chernenko
We show that the use of algorithms to predict race has significant limitations in measuring and understanding the sources of racial disparities in finance, economics, and other contexts. First, we derive theoretically the direction and magnitude of measurement bias in...
View Details
Keywords:
Racial Disparity;
Paycheck Protection Program;
Measurement Error;
AI and Machine Learning;
Race;
Measurement and Metrics;
Equality and Inequality;
Prejudice and Bias;
Forecasting and Prediction;
Outcome or Result
Scharfstein, David S., and Sergey Chernenko. "The Limits of Algorithmic Measures of Race in Studies of Outcome Disparities." Working Paper, April 2023.