Good epidemiological practice: a narrative review of appropriate scientific methods to evaluate the impact of antimicrobial stewardship interventions

Clinical Microbiology and Infection

Volumn 23, Issue 11, 2017, Pages 819-825

  de Kraker, M E A ^a   Abbas, M ^a   Huttner, B ^a   Harbarth, S ^a  

^a GENEVA UNIVERSITY HOSPITALS   (Switzerland)

Author keywords

Antimicrobial stewardship; Cluster randomized controlled trial; Contamination; Interrupted time series; Methodology; Regression to the mean; Study design

Indexed keywords

ANTIBIOTIC RESISTANCE; ANTIMICROBIAL STEWARDSHIP; ANTIMICROBIAL THERAPY; HEALTH IMPACT ASSESSMENT; METHODOLOGY; OUTCOME ASSESSMENT; PRIORITY JOURNAL; PROCESS MONITORING; REVIEW; STUDY DESIGN; TIME SERIES ANALYSIS; BACTERIAL INFECTION; HUMAN; RANDOMIZED CONTROLLED TRIAL (TOPIC); TREATMENT OUTCOME;

ANTIINFECTIVE AGENT;

ANTI-BACTERIAL AGENTS; ANTIMICROBIAL STEWARDSHIP; BACTERIAL INFECTIONS; HUMANS; INTERRUPTED TIME SERIES ANALYSIS; OUTCOME ASSESSMENT (HEALTH CARE); RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN; TREATMENT OUTCOME;

EID: 85025453929     PISSN: 1198743X     EISSN: 14690691     Source Type: Journal    
DOI: 10.1016/j.cmi.2017.05.019     Document Type: Review

References (46)

1. Bush, K., Page, M.G.P., What we may expect from novel antibacterial agents in the pipeline with respect to resistance and pharmacodynamic principles. J Pharmacokinet Pharmacodyn 44 (2017), 113–132.
2. Carlet, J., Collignon, P., Goldmann, D., Goossens, H., Gyssens, I.C., Harbarth, S., et al. Society's Failure to protect a precious resource: Antibiotics. Lancet 378 (2011), 369–371.
3. The review on Antimicrobial Resistance chaired by J. O'Neill, Tackling drug-resistant infections globally: Final report and recommendations. 2016, Review on Antimicrobial Resistance, London https://amr-review.org/sites/default/files/160525_Final%20paper_with%20cover.pdf.
4. Guyatt, G.H., Oxman, A.D., Schunemann, H.J., Tugwell, P., Knottnerus, A., Grade guidelines: a new series of articles in the journal of clinical epidemiology. J Clin Epidemiol 64 (2011), 380–382.
5. Zingg, W., Castro-Sanchez, E., Secci, F.V., Edwards, R., Drumright, L.N., Sevdalis, N., et al. Innovative tools for quality assessment: integrated quality criteria for review of multiple study designs (icroms). Public Health 133 (2016), 19–37.
6. Anderson, D.J., Juthani-Mehta, M., Morgan, D.J., Research methods in healthcare epidemiology and antimicrobial stewardship: randomized controlled trials. Infect Control Hosp Epidemiol 37 (2016), 629–634.
7. Davey, P., Marwick, C.A., Scott, C.L., Charani, E., McNeil, K., Brown, E., et al. Interventions to improve antibiotic prescribing practices for hospital inpatients. Cochrane Database Syst Rev, 2, 2017, Cd003543.
8. Kaki, R., Elligsen, M., Walker, S., Simor, A., Palmay, L., Daneman, N., Impact of antimicrobial stewardship in critical care: a systematic review. J Antimicrob Chemother 66 (2011), 1223–1230.
9. Ramsay, C., Brown, E., Hartman, G., Davey, P., Room for improvement: a systematic review of the quality of evaluations of interventions to improve hospital antibiotic prescribing. J Antimicrob Chemother 52 (2003), 764–771.
10. Effective Practice and Organisation of Care, EPOC resources for review authors. 2015, Norwegian Knowledge Centre for the Health Services, Oslo http://epoc.cochrane.org/resources/epoc-resources-review-authors.
11. Cooper, B.S., Stone, S.P., Kibbler, C.C., Cookson, B.D., Roberts, J.A., Medley, G.F., et al. Systematic review of isolation policies in the hospital management of methicillin-resistant staphylococcus aureus: a review of the literature with epidemiological and economic modelling. Health Technol Assess 7 (2003), 1–194.
12. Morton, V., Torgerson, D.J., Regression to the mean: treatment effect without the intervention. J Eval Clin Pract 11 (2005), 59–65.
13. Kochar, S., Sheard, T., Sharma, R., Hui, A., Tolentino, E., Allen, G., et al. Success of an infection control program to reduce the spread of carbapenem-resistant klebsiella pneumoniae. Infect Control Hosp Epidemiol 30 (2009), 447–452.
14. Greenland, S., An introduction to instrumental variables for epidemiologists. Int J Epidemiol 29 (2000), 722–729.
15. Lipsitch, M., Tchetgen Tchetgen, E., Cohen, T., Negative controls: a tool for detecting confounding and bias in observational studies. Epidemiology 21 (2010), 383–388.
16. Harris, A.D., Bradham, D.D., Baumgarten, M., Zuckerman, I.H., Fink, J.C., Perencevich, E.N., The use and interpretation of quasi-experimental studies in infectious diseases. Clin Infect Dis 38 (2004), 1586–1591.
17. McGowan, J.E., Antimicrobial stewardship–the state of the art in 2011: focus on outcome and methods. Infect Control Hosp Epidemiol 33 (2012), 331–337.
18. Morris, A.M., Antimicrobial stewardship programs: appropriate measures and metrics to study their impact. Curr Treat Options Infect Dis 6 (2014), 101–112.
19. Burke, J.P., Antibiotic resistance–squeezing the balloon?. JAMA 280 (1998), 1270–1271.
20. Khan, R., Cheesbrough, J., Impact of changes in antibiotic policy on clostridium difficile-associated diarrhoea (cdad) over a five-year period in a district general hospital. J Hosp Infect 54 (2003), 104–108.
21. Morris, A.M., Brener, S., Dresser, L., Daneman, N., Dellit, T.H., Avdic, E., et al. Use of a structured panel process to define quality metrics for antimicrobial stewardship programs. Infect Control Hosp Epidemiol 33 (2012), 500–506.
22. Evans, S.R., Rubin, D., Follmann, D., Pennello, G., Huskins, W.C., Powers, J.H., et al. Desirability of outcome ranking (door) and response adjusted for duration of antibiotic risk (radar). Clin Infect Dis 61 (2015), 800–806.
23. Molina, J., Cisneros, J.M., Editorial commentary: a chance to change the paradigm of outcome assessment of antimicrobial stewardship programs. Clin Infect Dis 61 (2015), 807–808.
24. Edwards, R., Charani, E., Sevdalis, N., Alexandrou, B., Sibley, E., Mullett, D., et al. Optimisation of infection prevention and control in acute health care by use of behaviour change: a systematic review. Lancet Infect Dis 12 (2012), 318–329.
25. Llewelyn, M.J., Hand, K., Hopkins, S., Walker, A.S., Antibiotic policies in acute english nhs trusts: implementation of ‘start smart-then focus’ and relationship with clostridium difficile infection rates. J Antimicrob Chemother 70 (2015), 1230–1235.
26. Stone, S.P., Cooper, B.S., Kibbler, C.C., Cookson, B.D., Roberts, J.A., Medley, G.F., et al. The ORION statement: guidelines for transparent reporting of outbreak reports and intervention studies of nosocomial infection. Lancet Infect Dis 7 (2007), 282–288.
27. De Kraker, M.E.A., Harbarth, S., Methodological challenges in evaluating antimicrobial stewardship programs: ‘Through measuring to knowledge’. Pulcini, C., Ergönül Ö Can, F., Beovic, B., (eds.) Antimicrobial stewardship, 2017, Academic Press, London, 341–360.
28. Tacconelli, E., Cataldo, M.A., Paul, M., Leibovici, L., Kluytmans, J., Schröder, W., et al. Strobe-AMS: recommendations to optimise reporting of epidemiological studies on antimicrobial resistance and informing improvement in antimicrobial stewardship. BMJ Open, 6, 2016, e010134.
29. Fleet, E., Gopal Rao, G., Patel, B., Cookson, B., Charlett, A., Bowman, C., et al. Impact of implementation of a novel antimicrobial stewardship tool on antibiotic use in nursing homes: a prospective cluster randomized control pilot study. J Antimicrob Chemother 69 (2014), 2265–2273.
30. Dixon-Woods, M., Leslie, M., Tarrant, C., Bion, J., Explaining matching Michigan: an ethnographic study of a patient safety program. Implement Sci, 8, 2013, 70.
31. Taljaard, M., Teerenstra, S., Ivers, N.M., Fergusson, D.A., Substantial risks associated with few clusters in cluster randomized and stepped wedge designs. Clin Trials 13 (2016), 459–463.
32. Barker, D., McElduff, P., D'Este, C., Campbell, M.J., Stepped wedge cluster randomised trials: a review of the statistical methodology used and available. BMC Med Res Methodol, 16, 2016, 69.
33. Wagner, A.K., Soumerai, S.B., Zhang, F., Ross-Degnan, D., Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther 27 (2002), 299–309.
34. Elligsen, M., Walker, S.A., Pinto, R., Simor, A., Mubareka, S., Rachlis, A., et al. Audit and feedback to reduce broad-spectrum antibiotic use among intensive care unit patients: a controlled interrupted time series analysis. Infect Control Hosp Epidemiol 33 (2012), 354–361.
35. Fretheim, A., Zhang, F., Ross-Degnan, D., Oxman, A.D., Cheyne, H., Foy, R., et al. A reanalysis of cluster randomized trials showed interrupted time-series studies were valuable in health system evaluation. J Clin Epidemiol 68 (2015), 324–333.
36. Penfold, R.B., Zhang, F., Use of interrupted time series analysis in evaluating health care quality improvements. Acad Pediatr 13 (2013), S38–S44.
37. Cowpertwait, P.S.P., Metcalfe, A.V., Introductory time series with r. 2009, Springer-Verlag, New York.
38. Jandoc, R., Burden, A.M., Mamdani, M., Levesque, L.E., Cadarette, S.M., Interrupted time series analysis in drug utilization research is increasing: systematic review and recommendations. J Clin Epidemiol 68 (2015), 950–956.
39. Craig, P., Dieppe, P., Macintyre, K., Michie, S., Nazareth, I., Petticrew, M., Developing and evaluating complex interventions: New guidance. 2006, Medical Research Council, London, UK.
40. Davey, P., Peden, C., Charani, E., Marwick, C., Michie, S., Time for action-improving the design and reporting of behaviour change interventions for antimicrobial stewardship in hospitals: early findings from a systematic review. Int J Antimicrob Agents 45 (2015), 203–212.
41. Huttner, B., Pittet, D., Harbarth, S., Comment on: control of extended-spectrum beta-lactamase-producing klebsiella pneumoniae using a computer-assisted management program to restrict third-generation cephalosporin use. J Antimicrob Chemother, 62, 2008, 1165 author reply 65–6.
42. United Nations (UN), Draft political declaration of the high-level meeting of the general assembly on antimicrobial resistance. 2016, UN, Geneva https://www.un.org/pga/71/wp-content/uploads/sites/40/2016/09/DGACM_GAEAD_ESCAB-AMR-Draft-Political-Declaration-1616108E.pdf.
43. World Health Organization (WHO), Global action plan on antimicrobial resistance. 2015, WHO, Geneva http://apps.who.int/iris/handle/10665/193736.
44. Cochrane, Cochrane handbook for systematic reviews of interventions. 2011, The Cochrane Collaboration www.cochrane-handbook.org.
45. Eccles, M., Grimshaw, J., Campbell, M., Ramsay, C., Research designs for studies evaluating the effectiveness of change and improvement strategies. Qual Saf Health Care 12 (2003), 47–52.
46. Chu, R., Thabane, L., Ma, J., Holbrook, A., Pullenayegum, E., Devereaux, P.J., Comparing methods to estimate treatment effects on a continuous outcome in multicentre randomized controlled trials: a simulation study. BMC Med Res Methodol, 11, 2011, 21.