Accuracy of administrative data for surveillance of healthcare-associated infections: A systematic review

BMJ Open

Volumn 5, Issue 8, 2015, Pages

  Van Mourik, Maaike S M ^a   Van Duijn, Pleun Joppe ^a   Moons, Karel G M ^a   Bonten, Marc J M ^a   Lee, Grace M ^b,c  

^a UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^b HARVARD MEDICAL SCHOOL   (United States)

^c BOSTON CHILDREN S HOSPITAL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; CATHETER INFECTION; DIAGNOSTIC ACCURACY; DIAGNOSTIC TEST ACCURACY STUDY; DISEASE SURVEILLANCE; EMBASE; HEALTHCARE ASSOCIATED INFECTION; HUMAN; MEDLINE; PNEUMONIA; PREDICTIVE VALUE; QUALITY CONTROL; SURGICAL INFECTION; SYSTEMATIC REVIEW; TOTAL QUALITY MANAGEMENT; URINARY TRACT INFECTION; CLASSIFICATION; CODING; CROSS INFECTION; HEALTH CARE DELIVERY; HEALTH CARE QUALITY; MEASUREMENT ACCURACY; STANDARDS;

ALGORITHMS; CLINICAL CODING; CROSS INFECTION; DATA ACCURACY; DELIVERY OF HEALTH CARE; HUMANS; QUALITY ASSURANCE, HEALTH CARE;

EID: 84941566456     PISSN: None     EISSN: 20446055     Source Type: Journal    
DOI: 10.1136/bmjopen-2015-008424     Document Type: Article

References (101)

1. Panzer RJ, Gitomer RS, Greene WH, et al. Increasing demands for quality measurement. JAMA 2013;310:1971-80.
2. Elixhauser A, Steiner C, Harris DR, et al. Comorbidity measures for use with administrative data. Med Care 1998;36:8-27.
3. Zhan C, Miller MR. Administrative data based patient safety research: a critical review. Qual Saf Health Care 2003;12(Suppl 2): ii58-63.
4. Jarman B, Pieter D, Van Der Veen AA, et al. The hospital standardised mortality ratio: a powerful tool for Dutch hospitals to assess their quality of care? Qual Saf Health Care 2010;19:9-13.
5. Rosenthal MB. Nonpayment for performance? Medicare's new reimbursement rule. N Engl J Med 2007;357:1573-5.
6. Agency for Healthcare Research and Quality. Patient Safety Indicators Overview. http://wwwqualityindicatorsahrqgov/modules/psi-resourcesaspx 2014
7. (cited 18 Mar. 2014); http://www.qualityindicators.ahrq.gov/modules/psi-resources.aspx
8. Department of Health and Human Services, Centers for Medicare and Medicaid Services. FY 2014 IPPS Final Rule Medicare Program: hospital inpatient prospective payment systems for acute care hospitals and the long-term care hospital prospective payment system and fiscal year 2014 rates; quality reporting requirements for specific providers; hospital conditions of participation; payment policies related to patient status. Federal Register 2013;78:50495-1040.
9. Centers for Medicare and Medicaid Services. Press release: CMS issues proposed inpatient hospital payment system regulation, 2014 (cited 27 May 2014). http://wwwcmsgov/Newsroom/MediaReleaseDatabase/Press-releases/2014-Press-releases-items/2014-04-30.html
10. Goto M, Ohl ME, Schweizer ML, et al. Accuracy of administrative code data for the surveillance of healthcare-associated infections: a systematic review and meta-analysis. Clin Infect Dis 2014;58:688-96.
11. Jhung MA, Banerjee SN. Administrative coding data and health care-associated infections. Clin Infect Dis 2009;49:949-55.
12. Farmer SA, Black B, Bonow RO. Tension between quality measurement, public quality reporting, and pay for performance. JAMA 2013;309:349-50.
13. Iezzoni LI. Assessing quality using administrative data. Ann Intern Med 1997;127(8 Pt 2):666-74.
14. Woeltje KF. Moving into the future: electronic surveillance for healthcare-associated infections. J Hosp Infect 2013;84:103-5.
15. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009;6:e1000097.
16. Drosler SE, Romano PS, Tancredi DJ, et al. International comparability of patient safety indicators in 15 OECD member countries: a methodological approach of adjustment by secondary diagnoses. Health Serv Res 2012;47(1 Pt 1):275-92.
17. Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 2011;155:529-36.
18. Benchimol EI, Manuel DG, To T, et al. Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. J Clin Epidemiol 2011;64:821-9.
19. Naaktgeboren CA, De Groot JA, Van SM, et al. Evaluating diagnostic accuracy in the face of multiple reference standards. Ann Intern Med 2013;159:195-202.
20. Macaskill P, Gatsonis C, Deeks JJ, et al. Chapter 10: Analysing and Presenting the Results. In: Deeks JJ, Bossuyt PM, Gatsonis C, eds. Cochrane handbook for systematic reviews of diagnostic test accuracy Version 1.0. The Cochrane Collaboration, 2010:20-29.
21. Reitsma JB, Glas AS, Rutjes AW, et al. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol 2005;58:982-90.
22. Apte M, Landers T, Furuya Y, et al. Comparison of two computer algorithms to identify surgical site infections. Surg Infect (Larchmt) 2011;12:459-64.
23. Best WR, Khuri SF, Phelan M, et al. Identifying patient preoperative risk factors and postoperative adverse events in administrative databases: results from the Department of Veterans Affairs National Surgical Quality Improvement Program. J Am Coll Surg 2002;194:257-66.
24. Bolon MK, Hooper D, Stevenson KB, et al. Improved surveillance for surgical site infections after orthopedic implantation procedures: extending applications for automated data. Clin Infect Dis 2009;48:1223-9.
25. Braun BI, Kritchevsky SB, Kusek L, et al. Comparing bloodstream infection rates: the effect of indicator specifications in the evaluation of processes and indicators in infection control (EPIC) study. Infect Control Hosp Epidemiol 2006;27:14-22.
26. Cadwallader HL, Toohey M, Linton S, et al. A comparison of two methods for identifying surgical site infections following orthopaedic surgery. J Hosp Infect 2001;48:261-6.
27. Calderwood MS, Ma A, Khan YM, et al. Use of medicare diagnosis and procedure codes to improve detection of surgical site infections following hip arthroplasty, knee arthroplasty, and vascular surgery. Infect Control Hosp Epidemiol 2012;33:40-9.
28. Calderwood MS, Kleinman K, Bratzler DW, et al. Use of medicare claims to identify US hospitals with a high rate of surgical site infection after hip arthroplasty. Infect Control Hosp Epidemiol 2013;34:31-9.
29. Campbell PG, Malone J, Yadla S, et al. Comparison of ICD-9-based, retrospective, and prospective assessments of perioperative complications: assessment of accuracy in reporting. J Neurosurg Spine 2011;14:16-22.
30. Cevasco M, Borzecki AM, O'Brien WJ, et al. Validity of the AHRQ Patient Safety Indicator "central venous catheter-related bloodstream infections". J Am Coll Surg 2011;212:984-90.
31. Cevasco M, Borzecki AM, Chen Q, et al. Positive predictive value of the AHRQ Patient Safety Indicator "Postoperative Sepsis": implications for practice and policy. J Am Coll Surg 2011;212:954-61.
32. Cima RR, Lackore KA, Nehring SA, et al. How best to measure surgical quality? Comparison of the Agency for Healthcare Research and Quality Patient Safety Indicators (AHRQ-PSI) and the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) postoperative adverse events at a single institution. Surgery 2011;150:943-9.
33. Curtis M, Graves N, Birrell F, et al. A comparison of competing methods for the detection of surgical-site infections in patients undergoing total arthroplasty of the knee, partial and total arthroplasty of hip and femoral or similar vascular bypass. J Hosp Infect 2004;57:189-93.
34. Daneman N, Ma X, Eng-Chong M, et al. Validation of administrative population-based data sets for the detection of cesarean delivery surgical site infection. Infect Control Hosp Epidemiol 2011;32:1213-15.
35. Drees M, Hausman S, Rogers A, et al. Underestimating the impact of ventilator-associated pneumonia by use of surveillance data. Infect Control Hosp Epidemiol 2010;31:650-2.
36. Gerbier S, Bouzbid S, Pradat E, et al. [Use of the French medico-administrative database (PMSI) to detect nosocomial infections in the University hospital of Lyon.]. Rev Epidemiol Sante Publique 2011;59:3-14.
37. Haley VB, Van AC, Tserenpuntsag B, et al. Use of administrative data in efficient auditing of hospital-acquired surgical site infections, new york state 2009-2010. Infect Control Hosp Epidemiol 2012;33:565-71.
38. Hebden J. Use of ICD-9-CM coding as a case-finding method for sternal wound infections after CABG procedures. Am J Infect Control 2000;28:202-3.
39. Heisler CA, Melton LJ 3rd, Weaver AL, et al. Determining perioperative complications associated with vaginal hysterectomy: code classification versus chart review. J Am Coll Surg 2009;209:119-22.
40. Hollenbeak CS, Boltz MM, Nikkel LE, et al. Electronic measures of surgical site infection: implications for estimating risks and costs. Infect Control Hosp Epidemiol 2011;32:784-90.
41. Hougland P, Nebeker J, Pickard S, et al. Using ICD-9-CM codes in Hospital claims data to detect adverse events in patient safety surveillance. In: Hendrikson K, Battles JB, Keyes A, et al, eds. Advances in patient safety: new directions and alternative approaches. Rockville, MD: Agency for Healthcare Research and Quality, 2008:1-18.
42. Huang SS, Placzek H, Livingston J, et al. Use of Medicare claims to rank Hospitals by surgical site infection risk following coronary artery bypass graft surgery. Infect Control Hosp Epidemiol 2011;32:775-83.
43. Inacio MC, Paxton EW, Chen Y, et al. Leveraging electronic medical records for surveillance of surgical site infection in a total joint replacement population. Infect Control Hosp Epidemiol 2011;32:351-9.
44. Julian KG, Brumbach AM, Chicora MK, et al. First year of mandatory reporting of healthcare-associated infections, Pennsylvania: an infection control-chart abstractor collaboration. Infect Control Hosp Epidemiol 2006;27:926-30.
45. Kanerva M, Ollgren J, Virtanen MJ, et al. Estimating the annual burden of health care-associated infections in Finnish adult acute care hospitals. Am J Infect Control 2009;37:227-30.
46. Koch CG, Li L, Hixson E, et al. What are the real rates of postoperative complications: elucidating inconsistencies between administrative and clinical data sources. J Am Coll Surg 2012;214:798-805.
47. Landers T, Apte M, Hyman S, et al. A comparison of methods to detect urinary tract infections using electronic data. Jt Comm J Qual Patient Saf 2010;36:411-17.
48. Lawson EH, Louie R, Zingmond DS, et al. A comparison of clinical registry versus administrative claims data for reporting of 30-day surgical complications. Ann Surg 2012;256:973-81.
49. Lee J, Imanaka Y, Sekimoto M, et al. Validation of a novel method to identify healthcare-associated infections. J Hosp Infect 2011;77:316-20.
50. Leth RA, Moller JK. Surveillance of hospital-acquired infections based on electronic hospital registries. J Hosp Infect 2006;62:71-9.
51. Leth RA, Norgaard M, Uldbjerg N, et al. Surveillance of selected post-caesarean infections based on electronic registries: validation study including post-discharge infections. J Hosp Infect 2010;75:200-4.
52. Meddings J, Saint S, McMahon LF Jr. Hospital-acquired catheter-associated urinary tract infection: documentation and coding issues may reduce financial impact of Medicare's new payment policy. Infect Control Hosp Epidemiol 2010;31:627-33.
53. Miner AL, Sands KE, Yokoe DS, et al. Enhanced identification of postoperative infections among outpatients. Emerg Infect Dis 2004;10:1931-7.
54. Moehring RW, Staheli R, Miller BA, et al. Central line-associated infections as defined by the Centers for Medicare and Medicaid Services' Hospital-Acquired Condition versus Standard Infection Control Surveillance: why Hospital compare seems conflicted. Infect Control Hosp Epidemiol 2013;34:238-44.
55. Moro ML, Morsillo F. Can hospital discharge diagnoses be used for surveillance of surgical-site infections? J Hosp Infect 2004;56:239-41.
56. Murff HJ, Fitz Henry F, Matheny ME, et al. Automated identification of postoperative complications within an electronic medical record using natural language processing. JAMA 2011;306:848-55.
57. Ollendorf DA, Fendrick AM, Massey K, et al. Is sepsis accurately coded on hospital bills? Value Health 2002;5:79-81.
58. Olsen MA, Fraser VJ. Use of diagnosis codes and/or wound culture results for surveillance of surgical site infection after mastectomy and breast reconstruction. Infect Control Hosp Epidemiol 2010;31:544-7.
59. Platt R, Kleinman K, Thompson K, et al. Using automated health plan data to assess infection risk from coronary artery bypass surgery. Emerg Infect Dis 2002;8:1433-41.
60. Pokorny L, Rovira A, Martin-Baranera M, et al. Automatic detection of patients with nosocomial infection by a computer-based surveillance system: a validation study in a general hospital. Infect Control Hosp Epidemiol 2006;27:500-3.
61. Romano PS, Mull HJ, Rivard PE, et al. Validity of selected AHRQ patient safety indicators based on VA National Surgical Quality Improvement Program data. Health Serv Res 2009;44:182-204.
62. Sands KE, Yokoe DS, Hooper DC, et al. Detection of postoperative surgical-site infections: comparison of health plan-based surveillance with hospital-based programs. Infect Control Hosp Epidemiol 2003;24:741-3.
63. Scanlon MC, Harris JM, Levy F, et al. Evaluation of the agency for healthcare research and quality pediatric quality indicators. Pediatrics 2008;121:e1723-31.
64. Sherman ER, Heydon KH, St John KH, et al. Administrative data fail to accurately identify cases of healthcare-associated infection. Infect Control Hosp Epidemiol 2006;27:332-7.
65. Song X, Cosgrove SE, Pass MA, et al. Using hospital claim data to monitor surgical site infections for inpatient procedures. Am J Infect Control 2008;36(3 Suppl):S32-6.
66. Spolaore P, Pellizzer G, Fedeli U, et al. Linkage of microbiology reports and hospital discharge diagnoses for surveillance of surgical site infections. J Hosp Infect 2005;60:317-20.
67. Stamm AM, Bettacchi CJ. A comparison of 3 metrics to identify health care-associated infections. Am J Infect Control 2012;40:688-91.
68. Stevenson KB, Khan Y, Dickman J, et al. Administrative coding data, compared with CDC/NHSN criteria, are poor indicators of health care-associated infections. Am J Infect Control 2008;36:155-64.
69. Stone PW, Horan TC, Shih HC, et al. Comparisons of health care-associated infections identification using two mechanisms for public reporting. Am J Infect Control 2007;35:145-9.
70. Tehrani DM, Russell D, Brown J, et al. Discord among performance measures for central line-associated bloodstream infection. Infect Control Hosp Epidemiol 2013;34:176-83.
71. Tinelli M, Mannino S, Lucchi S, et al. Healthcare-acquired infections in rehabilitation units of the Lombardy Region, Italy. Infection 2011;39:353-8.
72. Van Mourik MS, Troelstra A, Moons KG, et al. Accuracy of hospital discharge coding data for the surveillance of drain-related meningitis. Infect Control Hosp Epidemiol 2013;34:433-6.
73. Verelst S, Jacques J, Van Den HK, et al. Validation of Hospital Administrative Dataset for adverse event screening. Qual Saf Health Care 2010;19:e25.
74. Yokoe DS, Christiansen CL, Johnson R, et al. Epidemiology of and surveillance for postpartum infections. Emerg Infect Dis 2001;7:837-41.
75. Yokoe DS, Noskin GA, Cunnigham SM, et al. Enhanced identification of postoperative infections among inpatients. Emerg Infect Dis 2004;10:1924-30.
76. Yokoe DS, Khan Y, Olsen MA, et al. Enhanced surgical site infection surveillance following hysterectomy, vascular, and colorectal surgery. Infect Control Hosp Epidemiol 2012;33:768-73.
77. Zhan C, Elixhauser A, Richards CL Jr, et al. Identification of hospital-acquired catheter-associated urinary tract infections from Medicare claims: sensitivity and positive predictive value. Med Care 2009;47:364-9.
78. Zrelak PA, Sadeghi B, Utter GH, et al. Positive predictive value of the Agency for Healthcare Research and Quality Patient Safety Indicator for central line-related bloodstream infection ("selected infections due to medical care"). J Healthc Qual 2011;33:29-36.
79. Meddings JA, Reichert H, Rogers MA, et al. Effect of nonpayment for hospital-acquired, catheter-associated urinary tract infection: a statewide analysis. Ann Intern Med 2012;157:305-12.
80. Safdar N, Anderson DJ, Braun BI, et al. The evolving landscape of healthcare-associated infections: recent advances in prevention and a road map for research. Infect Control Hosp Epidemiol 2014;35:480-93.
81. Calderwood MS, Kleinman K, Bratzler DW, et al. Medicare claims can be used to identify US hospitals with higher rates of surgical site infection following vascular surgery. Med Care 2014;52:918-25.
82. Mull HJ, Borzecki AM, Loveland S, et al. Detecting adverse events in surgery: comparing events detected by the Veterans Health Administration Surgical Quality Improvement Program and the Patient Safety Indicators. Am J Surg 2014;207:584-95.
83. Cass AL, Kelly JW, Probst JC, et al. Identification of device-associated infections utilizing administrative data. Am J Infect Control 2013;41:1195-9.
84. Atchley KD, Pappas JM, Kennedy AT, et al. Use of administrative data for surgical site infection surveillance after congenital cardiac surgery results in inaccurate reporting of surgical site infection rates. Ann Thorac Surg 2014;97:651-7.
85. Thompson ND, Yeh LL, Magill SS, et al. Investigating Systematic Misclassification of Central Line-Associated Bloodstream Infection (CLABSI) to secondary bloodstream infection during health care-associated infection reporting. Am J Med Qual 2013;28:56-9.
86. Lindenauer PK, Lagu T, Shieh MS, et al. Association of diagnostic coding with trends in hospitalizations and mortality of patients with pneumonia, 2003-2009. JAMA 2012;307:1405-13.
87. Calderwood MS, Kleinman K, Soumerai SB, et al. Impact of Medicare's payment policy on mediastinitis following coronary artery bypass graft surgery in US hospitals. Infect Control Hosp Epidemiol 2014;35:144-51.
88. World Health Organization. International Statistical Classification of Diseases and Related Health Problems 10th Revision (ICD-10) Version for 2010. 2010. 2-5-2014. Ref Type: Report.
89. Drosler SE, Romano PS, Sundararajan V, et al. How many diagnosis fields are needed to capture safety events in administrative data? Findings and recommendations from the WHO ICD-11 Topic Advisory Group on Quality and Safety. Int J Qual Health Care 2014;26:16-25.
90. Cram P, Bozic KJ, Lu X, et al. Use of present-on-admission indicators for complications after total knee arthroplasty: an analysis of Medicare administrative data. J Arthroplasty 2014;29:923-8.
91. Letourneau AR, Calderwood MS, Huang SS, et al. Harnessing claims to improve detection of surgical site infections following hysterectomy and colorectal surgery. Infect Control Hosp Epidemiol 2013;34:1321-3.
92. Patrick SW, Davis MM, Sedman AB, et al. Accuracy of hospital administrative data in reporting central line-associated bloodstream infections in newborns. Pediatrics 2013;131(Suppl 1):S75-80.
93. Knepper BC, Young H, Jenkins TC, et al. Time-saving impact of an algorithm to identify potential surgical site infections. Infect Control Hosp Epidemiol 2013;34:1094-8.
94. Quan H, Eastwood C, Cunningham CT, et al. Validity of AHRQ patient safety indicators derived from ICD-10 hospital discharge abstract data (chart review study). BMJ Open 2013;3:e003716.
95. Leclere B, Lasserre C, Bourigault C, et al. Computer-enhanced surveillance of surgical site infections: early assessment of a generalizable method for French hospitals. European Conference of Clinical Microbiology and Infectious Diseases; 2014.
96. Murphy MV, Du DT, Hua W, et al. The utility of claims data for infection surveillance following anterior cruciate ligament reconstruction. Infect Control Hosp Epidemiol 2014;35:652-9.
97. Grammatico-Guillon L, Baron S, Gaborit C, et al. Quality assessment of hospital discharge database for routine surveillance of hip and knee arthroplasty-related infections. Infect Control Hosp Epidemiol 2014;35:646-51.
98. Knepper BC, Young H, Reese SM, et al. Identifying colon and open reduction of fracture surgical site infections using a partially automated electronic algorithm. Am J Infect Control 2014;42(10 Suppl):S291-5.
99. Warren DK, Nickel KB, Wallace AE, et al. Can additional information be obtained from claims data to support surgical site infection diagnosis codes? Infect Control Hosp Epidemiol 2014;35(Suppl 3):S124-32.
100. Leclere B, Lasserre C, Bourigault C, et al. Matching bacteriological and medico-administrative databases is efficient for a computer-enhanced surveillance of surgical site infections: retrospective analysis of 4, 400 surgical procedures in a French university hospital. Infect Control Hosp Epidemiol 2014;35:1330-5.
101. De Groot JA, Bossuyt PM, Reitsma JB, et al. Verification problems in diagnostic accuracy studies: consequences and solutions. BMJ 2011;343:d4770.