Article | Journal of the American Medical Informatics Association

Are All Certified EHRs Created Equal? Assessing the Relationship between EHR Vendor and Hospital Meaningful Use Performance

by A Jay Holmgren, Julia Adler-Milstein and Jeffrey McCullough

Abstract

Objective
The federal electronic health record (EHR) certification process was intended to ensure a baseline level of system quality and the ability to support meaningful use criteria. We sought to assess whether there was variation across EHR vendors in the degree to which hospitals using products from those vendors were able to achieve high levels of performance on meaningful use criteria.
Materials and Methods
We created a cross-sectional national hospital sample from the Office of the National Coordinator for Health Information Technology EHR Products Used for Meaningful Use Attestation public use file and the Centers for Medicare & Medicaid Services Medicare EHR Incentive Program Eligible Hospitals public use file. We used regression models to assess the relationship between vendor and hospital performance on 6 Stage 2 Meaningful Use criteria, controlling for hospital characteristics. We also calculated how much variation in performance is explained by vendor choice.
Results
We found significant associations between specific vendor and level of hospital performance for all 6 meaningful use criteria. Epic was associated with significantly higher performance on 5 of the 6 criteria; relationships for other vendors were mixed, with some associated with significantly worse performance on multiple criteria. EHR vendor choice accounted for between 7% and 34% of performance variation across the 6 criteria.
Discussion
A nontrivial proportion of variation in hospital meaningful use performance is explained by vendor choice, and certain vendors are more often associated with better meaningful use performance than others. Our results suggest that policy-makers should improve the certification process by including more “real-world” scenario testing and provider feedback or ratings to reduce this variation. Hospitals can use these results to guide interactions with vendors.
Conclusion
Vendor choice accounts for a meaningful proportion of variation in hospital meaningful use performance, and specific vendors are consistently associated with higher or lower performance across criteria.

Keywords: information technology; Hospitals; electronic health records; digital health; Health Care and Treatment; Information Technology; Service Delivery; Performance Evaluation;

Format: Print Find at HarvardPurchase

Citation:

Holmgren, A Jay, Julia Adler-Milstein, and Jeffrey McCullough. "Are All Certified EHRs Created Equal? Assessing the Relationship between EHR Vendor and Hospital Meaningful Use Performance." Journal of the American Medical Informatics Association 25, no. 6 (June 2018): 654–660. (Editor's Choice.)

About the Author

Campus Map
Campus Map
Harvard Business School
Soldiers Field
Boston, MA 02163
→ Map & Directions
Copyright © President & Fellows of Harvard College