Go to main content
Harvard Business School
HBS Home
  • About
  • Academic Programs
  • Alumni
  • Faculty & Research
  • Baker Library
  • Harvard Business Review
  • Initiatives
  • News
  • Recruit
  • Map / Directions

Faculty & Research

  • HOME
  • FACULTY
  • RESEARCH
    • Global Research Centers
    • HBS Case Collection
    • HBS Case Development
    • Initiatives & Projects
    • Publications
    • Research Associate (RA) Positions
    • Research Services
    • Seminars & Conferences
    Close
  • FEATURED TOPICS
    • Business and Environment
    • Business History
    • Entrepreneurship
    • Finance
    • Globalization
    • Health Care
    • Human Behavior and Decision-Making
    • Leadership
    • Social Enterprise
    • Technology and Innovation
    Close
  • ACADEMIC UNITS
    • Accounting and Management
    • Business, Government and the International Economy
    • Entrepreneurial Management
    • Finance
    • General Management
    • Marketing
    • Negotiation, Organizations & Markets
    • Organizational Behavior
    • Strategy
    • Technology and Operations Management
    Close
Photo of Himabindu Lakkaraju

Unit: Technology and Operations Management

Contact:

(617) 496-5512

Send Email

Areas of Interest

  • machine learning

Himabindu Lakkaraju

Assistant Professor of Business Administration

I am an Assistant Professor in the Technology and Operations Management Group at Harvard Business School. My research primarily involves machine learning and its applications to high-stakes decision making.   

Prior to my stint at Harvard, I received my PhD in Computer Science from Stanford University. My PhD research was generously supported by a Stanford Graduate Fellowship, a Microsoft Research Dissertation Grant, and a Google Anita Borg Scholarship.

For more details, here is my CV and here is a one-pager about my research.

Print Entire ProfileMore
I am an Assistant Professor in the Technology and Operations Management Group at Harvard Business School. My research primarily involves machine learning and its applications to high-stakes decision making.   

Prior to my stint at Harvard, I received my PhD in Computer Science from Stanford University. My PhD research was generously supported by a Stanford Graduate Fellowship, a Microsoft Research Dissertation Grant, and a Google Anita Borg Scholarship.

For more details, here is my CV and here is a one-pager about my research.


Print Entire ProfileLess
Publications Research Summary Teaching Awards & Honors

Published Papers

  1. Article | Proceedings of the AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society

    Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methods.

    Dylan Slack, Sophie Hilgard, Emily Jia, Sameer Singh and Himabindu Lakkaraju

    Citation:

    Slack, Dylan, Sophie Hilgard, Emily Jia, Sameer Singh, and Himabindu Lakkaraju. "Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methods." Proceedings of the AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society (2020): 180–186.  View Details
    CiteView Details Register to Read Related
  2. Article | Proceedings of the AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society

    "How Do I Fool You?": Manipulating User Trust via Misleading Black Box Explanations

    Himabindu Lakkaraju and Osbert Bastani

    Citation:

    Lakkaraju, Himabindu, and Osbert Bastani. "How Do I Fool You?": Manipulating User Trust via Misleading Black Box Explanations. Proceedings of the AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society (2020): 79–85.  View Details
    CiteView Details Register to Read Related
  3. Article | Proceedings of the AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society

    Faithful and Customizable Explanations of Black Box Models

    Himabindu Lakkaraju, Ece Kamar, Rich Caruana and Jure Leskovec

    As predictive models increasingly assist human experts (e.g., doctors) in day-to-day decision making, it is crucial for experts to be able to explore and understand how such models behave in different feature subspaces in order to know if and when to trust them. To this end, we propose Model Understanding through Subspace Explanations (MUSE), a novel model agnostic framework which facilitates understanding of a given black box model by explaining how it behaves in subspaces characterized by certain features of interest. Our framework provides end users (e.g., doctors) with the flexibility of customizing the model explanations by allowing them to input the features of interest. The construction of explanations is guided by a novel objective function that we propose to simultaneously optimize for fidelity to the original model, unambiguity and interpretability of the explanation. More specifically, our objective allows us to learn, with optimality guarantees, a small number of compact decision sets each of which captures the behavior of a given black box model in unambiguous, well-defined regions of the feature space. Experimental evaluation with real-world datasets and user studies demonstrate that our approach can generate customizable, highly compact, easy-to-understand, yet accurate explanations of various kinds of predictive models compared to state-of-the-art baselines.

    Keywords: interpretable machine learning; black box models; Decision Making; Framework;

    Citation:

    Lakkaraju, Himabindu, Ece Kamar, Rich Caruana, and Jure Leskovec. "Faithful and Customizable Explanations of Black Box Models." Proceedings of the AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society (2019).  View Details
    CiteView Details Register to Read Related
  4. Article | Quarterly Journal of Economics

    Human Decisions and Machine Predictions

    Jon Kleinberg, Himabindu Lakkaraju, Jure Leskovec, Jens Ludwig and Sendhil Mullainathan

    Citation:

    Kleinberg, Jon, Himabindu Lakkaraju, Jure Leskovec, Jens Ludwig, and Sendhil Mullainathan. "Human Decisions and Machine Predictions." Quarterly Journal of Economics 133, no. 1 (February 2018): 237–293.  View Details
    CiteView DetailsFind at Harvard Related
  5. Article | Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining

    The Selective Labels Problem: Evaluating Algorithmic Predictions in the Presence of Unobservables

    Himabindu Lakkaraju, Jon Kleinberg, Jure Leskovec, Jens Ludwig and Sendhil Mullainathan

    Citation:

    Lakkaraju, Himabindu, Jon Kleinberg, Jure Leskovec, Jens Ludwig, and Sendhil Mullainathan. "The Selective Labels Problem: Evaluating Algorithmic Predictions in the Presence of Unobservables." Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining 23rd (2017).  View Details
    CiteView Details Read Now Related
  6. Article | Proceedings of the International Conference on Artificial Intelligence and Statistics

    Learning Cost-Effective and Interpretable Treatment Regimes

    Himabindu Lakkaraju and Cynthia Rudin

    Citation:

    Lakkaraju, Himabindu, and Cynthia Rudin. "Learning Cost-Effective and Interpretable Treatment Regimes." Proceedings of the International Conference on Artificial Intelligence and Statistics 20th (2017).  View Details
    CiteView Details Read Now Related
  7. Article | Proceedings of the AAAI Conference on Artificial Intelligence

    Identifying Unknown Unknowns in the Open World: Representations and Policies for Guided Exploration

    Himabindu Lakkaraju, Ece Kamar, Rich Caruana and Eric Horvitz

    Citation:

    Lakkaraju, Himabindu, Ece Kamar, Rich Caruana, and Eric Horvitz. "Identifying Unknown Unknowns in the Open World: Representations and Policies for Guided Exploration." Proceedings of the AAAI Conference on Artificial Intelligence 31st (2017).  View Details
    CiteView Details Read Now Related
  8. Article | Proceedings of the KDD Workshop on Fairness, Accountability, and Transparency in Machine Learning

    Interpretable and Explorable Approximations of Black Box Models

    Himabindu Lakkaraju, Ece Kamar, Rich Caruana and Jure Leskovec

    Citation:

    Lakkaraju, Himabindu, Ece Kamar, Rich Caruana, and Jure Leskovec. "Interpretable and Explorable Approximations of Black Box Models." Proceedings of the KDD Workshop on Fairness, Accountability, and Transparency in Machine Learning (2017).  View Details
    CiteView DetailsFind at Harvard Related
  9. Article | Proceedings of the Conference on Neural Information Processing Systems

    Confusions over Time: An Interpretable Bayesian Model to Characterize Trends in Decision Making

    Himabindu Lakkaraju and Jure Leskovec

    Citation:

    Lakkaraju, Himabindu, and Jure Leskovec. "Confusions over Time: An Interpretable Bayesian Model to Characterize Trends in Decision Making." Proceedings of the Conference on Neural Information Processing Systems 30th (2016).  View Details
    CiteView Details Read Now Related
  10. Article | Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining

    Interpretable Decision Sets: A Joint Framework for Description and Prediction

    Himabindu Lakkaraju, Stephen H. Bach and Jure Leskovec

    Citation:

    Lakkaraju, Himabindu, Stephen H. Bach, and Jure Leskovec. "Interpretable Decision Sets: A Joint Framework for Description and Prediction." Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining 22nd (2016).  View Details
    CiteView Details Read Now Related
  11. Article | Psychological Methods

    Mining Big Data to Extract Patterns and Predict Real-Life Outcomes

    Michal Kosinki, Yilun Wang, Himabindu Lakkaraju and Jure Leskovec

    Citation:

    Kosinki, Michal, Yilun Wang, Himabindu Lakkaraju, and Jure Leskovec. "Mining Big Data to Extract Patterns and Predict Real-Life Outcomes." Psychological Methods 21, no. 4 (December 2016): 493–506.  View Details
    CiteView DetailsFind at Harvard Related
  12. Conference Presentation | 9 Dec 2016

    Discovering Unknown Unknowns of Predictive Models

    Himabindu Lakkaraju, Ece Kamar, Rich Caruana and Eric Horvitz

    Citation:

    Lakkaraju, Himabindu, Ece Kamar, Rich Caruana, and Eric Horvitz. "Discovering Unknown Unknowns of Predictive Models." Paper presented at the 30th Annual Conference on Neural Information Processing Systems (NIPS), Workshop on Reliable Machine Learning in the Wild, Barcelona, Spain, December 9, 2016.  View Details
    CiteView Details Read Now Related
  13. Conference Presentation | 9 Dec 2016

    Learning Cost-Effective and Interpretable Regimes for Treatment Recommendation

    Himabindu Lakkaraju and Cynthia Rudin

    Citation:

    Lakkaraju, Himabindu, and Cynthia Rudin. "Learning Cost-Effective and Interpretable Regimes for Treatment Recommendation." Paper presented at the 30th Annual Conference on Neural Information Processing Systems (NIPS), Workshop on Interpretable Machine Learning in Complex Systems, Barcelona, Spain, December 9, 2016.  View Details
    CiteView Details Read Now Related
  14. Conference Presentation | 8 Dec 2016

    Learning Cost-Effective and Interpretable Treatment Regimes for Judicial Bail Decisions

    Himabindu Lakkaraju and Cynthia Rudin

    Citation:

    Lakkaraju, Himabindu, and Cynthia Rudin. "Learning Cost-Effective and Interpretable Treatment Regimes for Judicial Bail Decisions." Paper presented at the 30th Annual Conference on Neural Information Processing Systems (NIPS), Symposium on Machine Learning and the Law, Barcelona, Spain, December 8, 2016.  View Details
    CiteView Details Read Now Related
  15. Article | Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining

    A Machine Learning Framework to Identify Students at Risk of Adverse Academic Outcomes

    Himabindu Lakkaraju, Everaldo Aguiar, Carl Shan, David Miller, Nasir Bhanpuri, Rayid Ghani and Kecia Addison

    Citation:

    Lakkaraju, Himabindu, Everaldo Aguiar, Carl Shan, David Miller, Nasir Bhanpuri, Rayid Ghani, and Kecia Addison. "A Machine Learning Framework to Identify Students at Risk of Adverse Academic Outcomes." Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining 21st (2015).  View Details
    CiteView Details Read Now Related
  16. Article | Proceedings of the SIAM International Conference on Data Mining

    A Bayesian Framework for Modeling Human Evaluations

    Himabindu Lakkaraju, Jure Leskovec, Jon Kleinberg and Sendhil Mullainathan

    Citation:

    Lakkaraju, Himabindu, Jure Leskovec, Jon Kleinberg, and Sendhil Mullainathan. "A Bayesian Framework for Modeling Human Evaluations." Proceedings of the SIAM International Conference on Data Mining (2015): 181–189.  View Details
    CiteView Details Read Now Related
  17. Article | Proceedings of the International Learning Analytics and Knowledge Conference

    Who, When, and Why: A Machine Learning Approach to Prioritizing Students at Risk of Not Graduating High School on Time

    Everaldo Aguiar, Himabindu Lakkaraju, Nasir Bhanpuri, David Miller, Ben Yuhas, Kecia Addison and Rayid Ghani

    Citation:

    Aguiar, Everaldo, Himabindu Lakkaraju, Nasir Bhanpuri, David Miller, Ben Yuhas, Kecia Addison, and Rayid Ghani. "Who, When, and Why: A Machine Learning Approach to Prioritizing Students at Risk of Not Graduating High School on Time." Proceedings of the International Learning Analytics and Knowledge Conference 5th (2015).  View Details
    CiteView Details Read Now Related
  18. Article | Proceedings of the NBER Economics of Crime Working Group

    Using Big Data to Improve Social Policy

    Himabindu Lakkaraju, Jon Kleinberg, Jure Leskovec, Jens Ludwig and Sendhil Mullainathan

    Citation:

    Lakkaraju, Himabindu, Jon Kleinberg, Jure Leskovec, Jens Ludwig, and Sendhil Mullainathan. "Using Big Data to Improve Social Policy." Proceedings of the NBER Economics of Crime Working Group (2014).  View Details
    CiteView Details Related
  19. Conference Presentation | 12 Dec 2014

    Aspect Specific Sentiment Analysis Using Hierarchical Deep Learning

    Himabindu Lakkaraju, Richard Socher and Chris Manning

    Citation:

    Lakkaraju, Himabindu, Richard Socher, and Chris Manning. "Aspect Specific Sentiment Analysis Using Hierarchical Deep Learning." Paper presented at the 28th Annual Conference on Neural Information Processing Systems (NIPS), Workshop on Deep Learning and Representation Learning, Montreal, Canada, December 12, 2014.  View Details
    CiteView Details Related
  20. Article | Proceedings of the International AAAI Conference on Weblogs and Social Media

    What's in a Name? Understanding the Interplay Between Titles, Content, and Communities in Social Media

    Himabindu Lakkaraju, Julian McAuley and Jure Leskovec

    Citation:

    Lakkaraju, Himabindu, Julian McAuley, and Jure Leskovec. "What's in a Name? Understanding the Interplay Between Titles, Content, and Communities in Social Media." Proceedings of the International AAAI Conference on Weblogs and Social Media 7th (2013).  View Details
    CiteView DetailsFind at Harvard Related
  21. Article | Proceedings of the IEEE International Conference on Data Mining

    Dynamic Multi-Relational Chinese Restaurant Process for Analyzing Influences on Users in Social Media

    Himabindu Lakkaraju, Indrajit Bhattacharya and Chiranjib Bhattacharyya

    Citation:

    Lakkaraju, Himabindu, Indrajit Bhattacharya, and Chiranjib Bhattacharyya. "Dynamic Multi-Relational Chinese Restaurant Process for Analyzing Influences on Users in Social Media." Proceedings of the IEEE International Conference on Data Mining 12th (2012).  View Details
    CiteView DetailsFind at Harvard Read Now Related
  22. Article | Proceedings of the International World Wide Web Conference

    TEM: A Novel Perspective to Modeling Content on Microblogs

    Himabindu Lakkaraju and Hyung-Il Ahn

    Citation:

    Lakkaraju, Himabindu, and Hyung-Il Ahn. "TEM: A Novel Perspective to Modeling Content on Microblogs." Proceedings of the International World Wide Web Conference 21st (2012).  View Details
    CiteView Details Read Now Related
  23. Article | Proceedings of the SIAM International Conference on Data Mining

    Exploiting Coherence for the Simultaneous Discovery of Latent Facets and Associated Sentiments

    Himabindu Lakkaraju, Chiranjib Bhattacharyya, Indrajit Bhattacharya and Srujana Merugu

    Citation:

    Lakkaraju, Himabindu, Chiranjib Bhattacharyya, Indrajit Bhattacharya, and Srujana Merugu. "Exploiting Coherence for the Simultaneous Discovery of Latent Facets and Associated Sentiments." Proceedings of the SIAM International Conference on Data Mining (2011): 498–509.  View Details
    CiteView DetailsFind at Harvard Related
  24. Article | Proceedings of the ACM Conference on Information and Knowledge Management

    Attention Prediction on Social Media Brand Pages

    Himabindu Lakkaraju and Jitendra Ajmera

    Citation:

    Lakkaraju, Himabindu, and Jitendra Ajmera. "Attention Prediction on Social Media Brand Pages." Proceedings of the ACM Conference on Information and Knowledge Management 20th (2011).  View Details
    CiteView DetailsFind at Harvard Related
  25. Article | Proceedings of the International World Wide Web Conference

    Smart News Feeds for Social Networks Using Scalable Joint Latent Factor Models

    Himabindu Lakkaraju, Angshu Rai and Srujana Merugu

    Citation:

    Lakkaraju, Himabindu, Angshu Rai, and Srujana Merugu. "Smart News Feeds for Social Networks Using Scalable Joint Latent Factor Models." Proceedings of the International World Wide Web Conference 20th (2011).  View Details
    CiteView Details Read Now Related
  26. Conference Presentation | 17 Dec 2011

    A Non Parametric Theme Event Topic Model for Characterizing Microblogs

    Himabindu Lakkaraju and Hyung-Il Ahn

    Citation:

    Lakkaraju, Himabindu, and Hyung-Il Ahn. "A Non Parametric Theme Event Topic Model for Characterizing Microblogs." Paper presented at the 25th Annual Conference on Neural Information Processing Systems (NIPS), Workshop on Computational Science and the Wisdom of Crowds, Granada, Spain, December 17, 2011.  View Details
    CiteView Details Related
  27. Conference Presentation | 17 Dec 2011

    Unified Modeling of User Activities on Social Networking Sites

    Himabindu Lakkaraju and Angshu Rai

    Citation:

    Lakkaraju, Himabindu, and Angshu Rai. "Unified Modeling of User Activities on Social Networking Sites." Paper presented at the 25th Annual Conference on Neural Information Processing Systems (NIPS), Workshop on Computational Science and the Wisdom of Crowds, Granada, Spain, December 17, 2011.  View Details
    CiteView Details Related
Search all publications by Himabindu Lakkaraju »
ǁ
Campus Map
Campus Map
Harvard Business School
Soldiers Field
Boston, MA 02163
→ Map & Directions
→ More Contact Information
→ More Contact Information
→ More Contact Information
→ More Contact Information
  • HBS Facebook
  • Alumni Facebook
  • Executive Education Facebook
  • Michael Porter Facebook
  • Working Knowledge Facebook
  • HBS Twitter
  • Executive Education Twitter
  • HBS Alumni Twitter
  • Michael Porter Twitter
  • Recruiting Twitter
  • Rock Center Twitter
  • Working Knowledge Twitter
  • Jobs Twitter
  • Social Enterprise Twitter
  • HBS Youtube
  • Michael Porter Youtube
  • Executive Education Youtube
  • HBS Linkedin
  • Alumni Linkedin
  • Executive Education Linkedin
  • MBA Linkedin
  • Linkedin
  • HBS Instagram
  • Alumni Instagram
  • Executive Education Instagram
  • Michael Porter Instagram
  • HBS iTunes
  • Executive Education iTunes
  • HBS Tumblr
  • Make a Gift
  • Site Map
  • Jobs
  • Harvard University
  • Trademarks
  • Policies
  • Digital Accessibility
  • Privacy
  • Terms of Use
Copyright © President & Fellows of Harvard College