Variable performance of models for predicting methicillin-resistant Staphylococcus aureus carriage in European surgical wards

BMC Infectious Diseases

Volumn 15, Issue 1, 2015, Pages

  Lee, Andie S ^a,b   Pan, Angelo ^c   Harbarth, Stephan ^a   Patroni, Andrea ^d   Chalfine, Annie ^e   Daikos, George L ^f   Garilli, Silvia ^c   Martínez, José Antonio ^g   Cooper, Ben S ^h,i  

^a GENEVA UNIVERSITY HOSPITALS   (Switzerland)

^b ROYAL PRINCE ALFRED HOSPITAL   (Australia)

^c CREMONA HOSPITAL   (Italy)

^d Ospedale di Esine   (Italy)

^e SAINT JOSEPH HOSPITAL   (France)

^f LAIKO GENERAL HOSPITAL   (Greece)

^g HOSPITAL CLÍNIC   (Spain)

^h MAHIDOL UNIVERSITY   (Thailand)

ⁱ UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Methicillin resistant Staphylococcus aureus; Predictive models; Screening

Indexed keywords

ANTIBIOTIC AGENT;

ADULT; AGE; AGED; ARTICLE; BACTERIUM CARRIER; BEST BMA MODEL; BLADDER CATHETERIZATION; BMA MODEL; COMORBIDITY; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; DECUBITUS; DIAGNOSTIC TEST ACCURACY STUDY; DISEASE ASSOCIATION; DRUG USE; FEMALE; FRANCE; GENDER AND SEX; GREECE; HOSPITALIZATION; HUMAN; HUMAN TISSUE; INTERMETHOD COMPARISON; ITALY; MAJOR CLINICAL STUDY; MALE; METHICILLIN RESISTANT STAPHYLOCOCCUS AUREUS; METHICILLIN RESISTANT STAPHYLOCOCCUS AUREUS INFECTION; MULTICENTER STUDY; NONHUMAN; PATIENT CODING; PREDICTIVE VALUE; PROSPECTIVE STUDY; RECEIVER OPERATING CHARACTERISTIC; RISK ASSESSMENT; RISK FACTOR; SENSITIVITY AND SPECIFICITY; SIMPLE MODEL; SKIN INJURY; SPAIN; STATISTICAL MODEL; STEPWISE MODEL; SURGICAL WARD; TRACHEOSTOMY; VALIDATION STUDY; COHORT ANALYSIS; DECISION SUPPORT SYSTEM; DIAGNOSIS; EPIDEMIOLOGY; HETEROZYGOTE; HOSPITAL; HOSPITAL SUBDIVISIONS AND COMPONENTS; ISOLATION AND PURIFICATION; MASS SCREENING; MICROBIOLOGY; MIDDLE AGED; NOSE MUCOSA; PENICILLIN RESISTANCE; PERINEUM; PREVALENCE; STAPHYLOCOCCAL INFECTIONS; STATISTICS; STATISTICS AND NUMERICAL DATA; VERY ELDERLY;

ADULT; AGE FACTORS; AGED; AGED, 80 AND OVER; CARRIER STATE; COHORT STUDIES; DECISION SUPPORT TECHNIQUES; FEMALE; GREECE; HOSPITAL UNITS; HOSPITALIZATION; HOSPITALS; HUMANS; ITALY; MALE; MASS SCREENING; METHICILLIN RESISTANCE; METHICILLIN-RESISTANT STAPHYLOCOCCUS AUREUS; MIDDLE AGED; NASAL MUCOSA; PARIS; PERINEUM; PREVALENCE; PROSPECTIVE STUDIES; RISK FACTORS; SPAIN; STAPHYLOCOCCAL INFECTIONS; STATISTICS AS TOPIC;

EID: 84928724245     PISSN: None     EISSN: 14712334     Source Type: Journal    
DOI: 10.1186/s12879-015-0834-y     Document Type: Article

References (41)

1. Weber SG, Huang SS, Oriola S, Huskins WC, Noskin GA, Harriman K, et al. Legislative mandates for use of active surveillance cultures to screen for methicillin-resistant Staphylococcus aureus and vancomycin-resistant enterococci: Position statement from the Joint SHEA and APIC Task Force. Am J Infect Control. 2007;35:73-85.
2. UK Department of Health. MRSA Screening - Operational Guidance 2. [ http://webarchive.nationalarchives.gov.uk/20130107105354/http://www.dh.gov.uk/en/Publicationsandstatistics/Lettersandcirculars/Dearcolleagueletters/DH_092844 ]
3. Murthy A, De Angelis G, Pittet D, Schrenzel J, Uckay I, Harbarth S. Cost-effectiveness of universal MRSA screening on admission to surgery. Clin Microbiol Infect. 2010;16:1747-53.
4. Robotham JV, Graves N, Cookson BD, Barnett AG, Wilson JA, Edgeworth JD, et al. Screening, isolation, and decolonisation strategies in the control of meticillin resistant Staphylococcus aureus in intensive care units: cost effectiveness evaluation. BMJ. 2011;343:d5694.
5. Collins J, Raza M, Ford M, Hall L, Brydon S, Gould FK. Review of a three-year meticillin-resistant Staphylococcus aureus screening programme. J Hosp Infect. 2011;78:81-5.
6. Kang J, Mandsager P, Biddle AK, Weber DJ. Cost-effectiveness analysis of active surveillance screening for methicillin-resistant Staphylococcus aureus in an academic hospital setting. Infect Control Hosp Epidemiol. 2012;33:477-86.
7. Safdar N, Bradley EA. The risk of infection after nasal colonization with Staphylococcus aureus. Am J Med. 2008;121:310-5.
8. Lee AS, Cooper BS, Malhotra-Kumar S, Chalfine A, Daikos GL, Fankhauser C, et al. Comparison of strategies to reduce meticillin-resistant Staphylococcus aureus rates in surgical patients: a controlled multicentre intervention trial. BMJ Open. 2013;3:e003126.
9. Schweizer M, Perencevich E, McDanel J, Carson J, Formanek M, Hafner J, et al. Effectiveness of a bundled intervention of decolonization and prophylaxis to decrease Gram positive surgical site infections after cardiac or orthopedic surgery: systematic review and meta-analysis. BMJ. 2013;346:f2743.
10. Furuno JP, Harris AD, Wright MO, McGregor JC, Venezia RA, Zhu J, et al. Prediction rules to identify patients with methicillin-resistant Staphylococcus aureus and vancomycin-resistant enterococci upon hospital admission. Am J Infect Control. 2004;32:436-40.
11. Harbarth S, Sax H, Fankhauser-Rodriguez C, Schrenzel J, Agostinho A, Pittet D. Evaluating the probability of previously unknown carriage of MRSA at hospital admission. Am J Med. 2006;119:275. e215-223.
12. Furuno JP, McGregor JC, Harris AD, Johnson JA, Johnson JK, Langenberg P, et al. Identifying groups at high risk for carriage of antibiotic-resistant bacteria. Arch Int Med. 2006;166:580-5.
13. Haley CC, Mittal D, Laviolette A, Jannapureddy S, Parvez N, Haley RW. Methicillin-resistant Staphylococcus aureus infection or colonization present at hospital admission: multivariable risk factor screening to increase efficiency of surveillance culturing. J Clin Microbiol. 2007;45:3031-8.
14. Harbarth S, Sax H, Uckay I, Fankhauser C, Agostinho A, Christenson JT, et al. A predictive model for identifying surgical patients at risk of methicillin-resistant Staphylococcus aureus carriage on admission. J Am Coll Surg. 2008;207:683-9.
15. Riedel S, Von Stein D, Richardson K, Page J, Miller S, Winokur P, et al. Development of a prediction rule for methicillin-resistant Staphylococcus aureus and vancomycin-resistant enterococcus carriage in a Veterans Affairs Medical Center population. Infect Control Hosp Epidemiol. 2008;29:969-71.
16. Morgan DJ, Day HR, Furuno JP, Young A, Johnson JK, Bradham DD, et al. Improving efficiency in active surveillance for methicillin-resistant Staphylococcus aureus or vancomycin-resistant Enterococcus at hospital admission. Infect Control Hosp Epidemiol. 2010;31:1230-5.
17. Robicsek A, Beaumont JL, Wright MO, Thomson Jr RB, Kaul KL, Peterson LR. Electronic prediction rules for methicillin-resistant Staphylococcus aureus colonization. Infect Control Hosp Epidemiol. 2011;32:9-19.
18. Yeung KY, Bumgarner RE, Raftery AE. Bayesian model averaging: development of an improved multi-class, gene selection and classification tool for microarray data. Bioinformatics. 2005;21:2394-402.
19. Wang D, Zhang W, Bakhai A. Comparison of Bayesian model averaging and stepwise methods for model selection in logistic regression. Stat Med. 2004;23:3451-67.
20. Pan A, Lee A, Cooper B, Chalfine A, Daikos GL, Garilli S, et al. Risk factors for previously unknown meticillin-resistant Staphylococcus aureus carriage on admission to 13 surgical wards in Europe. J Hosp Infect. 2013;83:107-13.
21. Van Heirstraeten L, Cortinas Abrahantes J, Lammens C, Lee A, Harbarth S, Molenberghs G, et al. Impact of a short period of pre-enrichment on detection and bacterial loads of methicillin-resistant Staphylococcus aureus from screening specimens. J Clin Microbiol. 2009;47:3326-8.
22. Gazin M, Lee A, Derde L, Kazma M, Lammens C, Ieven M, et al. Culture-based detection of methicillin-resistant Staphylococcus aureus by a network of European laboratories: an external quality assessment study. Eur J Clin Microbiol Infect Dis. 2012;31:1765-70.
23. Cook NR. Statistical evaluation of prognostic versus diagnostic models: beyond the ROC curve. Clin Chem. 2008;54:17-23.
24. Pencina MJ, D'Agostino Sr RB, D'Agostino Jr RB, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157-72. discussion 207-112.
25. Raftery A, Hoeting J, Volinsky C, Painter I, Yeung KY. BMA: Bayesian Model Averaging. R package version 3.14.1. 2011. [ http://CRAN.R-project.org/package=BMA ].
26. R Development Core Team. R. A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. 2010. ISBN 3-900051-07-0 [ http://www.R-project.org/ ]
27. Royston P, Moons KG, Altman DG, Vergouwe Y. Prognosis and prognostic research: Developing a prognostic model. BMJ. 2009;338:b604.
28. 1 penalized regression: A review. Statist Surv. 2008;2:61-93.
29. Babyak MA. What you see may not be what you get: a brief, nontechnical introduction to overfitting in regression-type models. Psychosom Med. 2004;66:411-21.
30. Steyerberg EW, Harrell Jr FE, Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol. 2001;54:774-81.
31. Genell A, Nemes S, Steineck G, Dickman PW. Model selection in medical research: a simulation study comparing Bayesian model averaging and stepwise regression. BMC Med Res Methodol. 2010;10:108.
32. Concato J, Feinstein AR, Holford TR. The risk of determining risk with multivariable models. Ann Intern Med. 1993;118:201-10.
33. Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2010;21:128-38.
34. McKinnell JA, Huang SS, Eells SJ, Cui E, Miller LG. Quantifying the impact of extranasal testing of body sites for methicillin-resistant Staphylococcus aureus colonization at the time of hospital or intensive care unit admission. Infect Control Hosp Epidemiol. 2013;34:161-70.
35. Daum RS. Clinical practice. Skin and soft-tissue infections caused by methicillin-resistant Staphylococcus aureus. N Eng J Med. 2007;357:380-90.
36. Voss A, Loeffen F, Bakker J, Klaassen C, Wulf M. Methicillin-resistant Staphylococcus aureus in pig farming. Emerg Infect Dis. 2005;11:1965-6.
37. Tsiodras S, Daikos GL, Lee A, Plachouras D, Antoniadou A, Ploiarchopoulou F, et al. Risk factors for Community-Associated MRSA in a large metropolitan area in Greece: An Epidemiological Study Using Two Case Definitions. J Global Antimicrobial Resistance. 2014;2:27-33.
38. Altman DG, Vergouwe Y, Royston P, Moons KG. Prognosis and prognostic research: validating a prognostic model. BMJ. 2009;338:b605.
39. WHO. Report on the burden of endemic health care-associated infection worldwide. [ http://www.who.int/gpsc/country_work/burden_hcai/en/ ]
40. Lee AS, Huttner B, Harbarth S. Control of methicillin-resistant Staphylococcus aureus. Infect Dis Clin North Am. 2011;25:155-79.
41. Bode LG, Kluytmans JA, Wertheim HF, Bogaers D, Vandenbroucke-Grauls CM, Roosendaal R, et al. Preventing surgical-site infections in nasal carriers of Staphylococcus aureus. N Eng J Med. 2010;362:9-17.