Publications
Publications
- 2018
- HBS Working Paper Series
How Scheduling Can Bias Quality Assessment: Evidence from Food Safety Inspections
By: Maria Ibanez and Michael W. Toffel
Abstract
Many production processes are subject to inspection to ensure they meet quality, safety, and environmental standards imposed by companies and regulators. Inspection accuracy is critical to inspections being a useful input to assessing risks, allocating quality improvement resources, and making sourcing decisions. This paper examines how the scheduling of inspections risks introducing bias that erodes inspection quality by altering inspector stringency. In particular, we theorize that inspection results are affected by (a) the inspection outcomes at the inspector’s prior inspected establishment and (b) when the inspection occurs within an inspector’s daily schedule. Analyzing thousands of food safety inspections of restaurants and other food-handling establishments, we find that inspectors cite more violations after inspecting establishments that exhibited worse compliance or greater deterioration in compliance. Inspectors cite fewer violations in successive inspections throughout the day and when inspections risk prolonging their typical workday. Our estimates suggest that, if the outcome effects were amplified by 100% and the daily schedule effects were fully mitigated (that is, reduced by 100%), the increase in inspectors’ detection rates would result in their citing an average of 9.9% more violations. Understanding these biases can help managers develop alternative scheduling regimes that reduce bias in quality assessments in domains such as food safety, process quality, occupational safety, working conditions, and regulatory compliance.
Keywords
Assessment; Bias; Inspection; Scheduling; Econometric Analysis; Empirical Research; Regulation; Health; Food; Safety; Quality; Performance Consistency; Performance Evaluation; Food and Beverage Industry; Service Industry
Citation
Ibanez, Maria, and Michael W. Toffel. "How Scheduling Can Bias Quality Assessment: Evidence from Food Safety Inspections." Harvard Business School Working Paper, No. 17-090, April 2017. (Revised October 2018. Formerly titled "Assessing the Quality of Quality Assessment: The Role of Scheduling". Featured in Forbes, Food Safety Magazine, and Food Safety News.)