Publications
Publications
- September–October 2024
- Harvard Business Review
Where Data-Driven Decision-Making Can Go Wrong
By: Michael Luca and Amy C. Edmondson
Abstract
When considering internal data or the results of a study, often business leaders either take the evidence presented as gospel or dismiss it altogether. Both approaches are misguided. What leaders need to do instead is conduct rigorous discussions that assess any findings and whether they apply to the situation in question.
Such conversations should explore the internal validity of any analysis (whether it accurately answers the question) as well as its external validity (the extent to which results can be generalized from one context to another). To avoid missteps, you need to separate causation from correlation and control for confounding factors. You should examine the sample size and setting of the research and the period over which it was conducted. You must ensure that you’re measuring an outcome that really matters instead of one that is simply easy to measure. And you need to look for—or undertake—other research that might confirm or contradict the evidence.
By employing a systematic approach to the collection and interpretation of information, you can more effectively reap the benefits of the ever-increasing mountain of external and internal data and make better decisions.
Such conversations should explore the internal validity of any analysis (whether it accurately answers the question) as well as its external validity (the extent to which results can be generalized from one context to another). To avoid missteps, you need to separate causation from correlation and control for confounding factors. You should examine the sample size and setting of the research and the period over which it was conducted. You must ensure that you’re measuring an outcome that really matters instead of one that is simply easy to measure. And you need to look for—or undertake—other research that might confirm or contradict the evidence.
By employing a systematic approach to the collection and interpretation of information, you can more effectively reap the benefits of the ever-increasing mountain of external and internal data and make better decisions.
Keywords
Citation
Luca, Michael, and Amy C. Edmondson. "Where Data-Driven Decision-Making Can Go Wrong." Harvard Business Review 102, no. 5 (September–October 2024): 80–89.