The Annals of Applied Statistics
- Ann. Appl. Stat.
- Volume 11, Number 2 (2017), 504-526.
Random effects models for identifying the most harmful medication errors in a large, voluntary reporting database
Medical errors are a major source of preventable morbidity, mortality and healthcare costs. Voluntary reporting systems are useful data sources that collect detailed information on the circumstances of medical errors occurring in hospitals. Identifying the characteristics of errors that frequently result in patient harm when they occur would allow investigators to prioritize among the many sources of potential errors and design targeted prevention strategies. In this paper, we use data from MEDMARX, a large anonymous and voluntary reporting system for medication errors, to identify the combinations of error characteristics that are more likely to result in harm. To this end, we consider a Bayesian hierarchical model with crossed random effects and a flexible specification of the random effects distribution. We then provide a ranking of the errors using optimal Bayesian ranking based on their probability of harm. The use of optimal Bayesian ranking accounts for the varying amount of uncertainty across the random effects estimates. Finally, we examine the sensitivity of results to different specifications of the random effects distributions. The utility of flexible random effects assumptions is illustrated by empirically comparing results under several choices. We found that errors caused by mistakes in reconciling a patient’s current medication list with the medications prescribed at hospital discharge have an estimated 10.5% probability of harm. These errors had the highest rate of harm of errors that occur during the prescribing stage of medication use. In addition, we found that the results are sensitive to the random effects distribution used in estimation. Thus, an approach that explores this sensitivity is important for accurately comparing the relative harm across errors.
Ann. Appl. Stat., Volume 11, Number 2 (2017), 504-526.
Received: October 2015
Revised: August 2016
First available in Project Euclid: 20 July 2017
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Venturini, Sergio; Franklin, Jessica M.; Morlock, Laura; Dominici, Francesca. Random effects models for identifying the most harmful medication errors in a large, voluntary reporting database. Ann. Appl. Stat. 11 (2017), no. 2, 504--526. doi:10.1214/16-AOAS974. https://projecteuclid.org/euclid.aoas/1500537713
- Supplement A: Error Definitions and Results for the Other Nodes. This supplement contains the list of definitions for all potential error types and causes for MEDMARX reports and the results for the Bayesian hierarchical model (BHM) and empirical Bayes data mining (EBDM) approach applied to the data from each of the four other nodes of medication use: documenting, dispensing, administering and monitoring.
- Supplement B: Empirical Bayes Data Mining Approach. Section 1 of this supplement shows how to adapt the GPS method developed by DuMouchel (1999) and briefly described in Section 4 to the MEDMARX data. Moreover, in Section 2 we provide a brief description of the importance link function estimation as described in MacEachern and Peruggia (2000).
- Supplement C: Bayesian Hierarchical Model Estimates. This supplement reports more details about the estimation of the BHM described in Section 3.