PEDIATRICS Vol. 115 No. 1 January 2005, pp. 135-145 (doi:10.1542/peds.2004-1083)
Relevance of the Agency for Healthcare Research and Quality Patient Safety Indicators for Children's Hospitals
* University of Michigan Health System, Ann Arbor, Michigan
National Association of Children's Hospitals and Related Institutions, Alexandria, Virginia
Agency for Healthcare Research and Quality, Rockville, Maryland
|| Children's Hospital of Wisconsin, Wauwatosa, Wisconsin
Objectives. Patient safety indicators (PSIs) were developed by the Agency for Healthcare Research and Quality. Our objectives were (1) to apply these algorithms to the National Association of Children's Hospitals and Related Institutions (NACHRI) Aggregate Case Mix Comparative Database for 1999–2002, (2) to establish mean rates for each of the PSI events in children's hospitals, (3) to investigate the inadequacies of PSIs in relation to pediatric diagnoses, and (4) to express the data in such a way that children's hospitals could use the PSIs determined to be appropriate for pediatric use for comparison with their own data. In addition, we wanted to use the data to set priorities for ongoing clinical investigations and to propose interventions if the indicators demonstrated preventable errors.
Methods. The Agency for Healthcare Research and Quality PSI algorithms (version 2.1, revision 1) were applied to children's hospital administrative data (1.92 million discharges) from the NACHRI Aggregate Case Mix Comparative Database for 1999–2002. Rates were measured for the following events: complications of anesthesia, death in low-mortality diagnosis-related groups (DRGs), decubitus ulcer, failure to rescue (ie, death resulting from a complication, rather than the primary diagnosis), foreign body left in during a procedure, iatrogenic pneumothorax, infection attributable to medical care (ie, infections related to surgery or device placement), postoperative hemorrhage or hematoma, postoperative pulmonary embolism or venous thrombosis, postoperative wound dehiscence, and accidental puncture/laceration.
Results. Across the 4 years of data, the mean risk-adjusted rates of PSI events ranged from 0.01% (0.1 event per 1000 discharges) for a foreign body left in during a procedure to 14.0% (140 events per 1000 discharges) for failure to rescue. Review of International Classification of Diseases, Ninth Revision, Clinical Modification codes associated with each PSI category showed that the failure to rescue and death in low-mortality DRG indicators involved very complex cases and did not predict preventable events in the majority of cases. The PSI for infection attributable to medical care appeared to be accurate the majority of the time. Incident risk-adjusted rates of infections attributable to medical care averaged 0.35% (3.5 events per 1000 discharges) and varied up to fivefold from the lowest rate to the highest rate. The highest rates were up to 1.8 times the average.
Conclusions. PSIs derived from administrative data are indicators of patient safety concerns and can be relevant as screening tools for children's hospitals; however, cases identified by these indicators do not always represent preventable events. Some, such as a foreign body left in during a procedure, iatrogenic pneumothorax, infection attributable to medical care, decubitus ulcer, and venous thrombosis, seem to be appropriate for pediatric care and may be directly amenable to system changes. Evidence-based practices regarding those particular indicators that have been reported in the adult literature need to be investigated in the pediatric population. In their present form, 2 of the indicators, namely, failure to rescue and death in low-mortality DRGs, are inaccurate for the pediatric population, do not represent preventable errors in the majority of pediatric cases, and should not be used to estimate quality of care or preventable deaths in children's hospitals. The PSIs can assist institutions in prioritizing chart review-based investigations; if clusters of validated events emerge in reviews, then improvement activities can be initiated. Large aggregate databases, such as the NACHRI Case Mix Database, can help establish mean rates of potential pediatric events, giving children's hospitals a context within which to examine their own data.
Key Words: patient safety indicators • Agency for Healthcare Research and Quality • medical error • National Association of Children's Hospitals and Related Institutions
Abbreviations: AHRQ, Agency for Healthcare Research and Quality • PSI, patient safety indicator • NACHRI, National Association of Children's Hospitals and Related Institutions • DRG, diagnosis-related group • ICD-9-CM, International Classification of Diseases, Ninth Revision, Clinical Modification • HCUP, Healthcare Cost and Utilization Project • KID, Kids' Inpatient Database
Accepted Aug 31, 2004.
CiteULike 
Connotea 
Del.icio.us 
Digg 
Facebook 
Reddit 
Technorati 
Twitter What's this?
This article has been cited by other articles:
|
|
 |
|
  H. Yu, M. D. Greenberg, A. M. Haviland, and D. O. Farley "Canary Measures" Among the AHRQ Patient Safety Indicators American Journal of Medical Quality, November 1, 2009; 24(6): 465 - 473. [Abstract] [PDF]
|
|
|
|
 |
|
 K. M. McDonald, S. M. Davies, C. A. Haberland, J. J. Geppert, A. Ku, and P. S. Romano Preliminary Assessment of Pediatric Health Care Quality and Patient Safety in the United States Using Readily Available Administrative Data Pediatrics, August 1, 2008; 122(2): e416 - e425. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. P. Kronman, M. Hall, A. D. Slonim, and S. S. Shah Charges and Lengths of Stay Attributable to Adverse Patient-Care Events Using Pediatric-Specific Quality Indicators: A Multicenter Study of Freestanding Children's Hospitals Pediatrics, June 1, 2008; 121(6): e1653 - e1659. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. C. Scanlon, J. M. Harris II, F. Levy, and A. Sedman Evaluation of the Agency for Healthcare Research and Quality Pediatric Quality Indicators Pediatrics, June 1, 2008; 121(6): e1723 - e1731. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 O. J. Benavidez, K. Gauvreau, P. D. Nido, E. Bacha, and K. J. Jenkins Complications and Risk Factors for Mortality During Congenital Heart Surgery Admissions Ann. Thorac. Surg., July 1, 2007; 84(1): 147 - 155. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 B. A. Mark, D. W. Harless, and W. F. Berman Nurse Staffing and Adverse Events in Hospitalized Children Policy Politics Nursing Practice, May 1, 2007; 8(2): 83 - 92. [Abstract] [PDF]
|
|
