Implementation strategies: Recommendations for specifying and reporting

Implementation Science

Volumn 8, Issue 1, 2013, Pages

  Proctor, Enola K ^a   Powell, Byron J ^a   McMillen, J C ^b  

^a WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

Author keywords

Implementation research; Implementation strategies; Measurement; Methodology

Indexed keywords

ARTICLE; HEALTH CARE DELIVERY; MASS COMMUNICATION; METHODOLOGY; ORGANIZATION AND MANAGEMENT; PROGRAM DEVELOPMENT; RESEARCH;

DELIVERY OF HEALTH CARE; DIFFUSION OF INNOVATION; PROGRAM DEVELOPMENT; RESEARCH;

EID: 84888377256     PISSN: None     EISSN: 17485908     Source Type: Journal    
DOI: 10.1186/1748-5908-8-139     Document Type: Article

References (94)

1. Lomas J. Diffusion, dissemination, and implementation: who should do what?. Ann N Y Acad Sci 1993, 703:226-237. 10.1111/j.1749-6632.1993.tb26351.x, 8192299.
2. Brouwers MC, De Vito C, Bahirathan L, Carol A, Carroll JC, Cotterchio M, Dobbins M, Lent B, Levitt C, Lewis N, McGregor SE, Paszat L, Rand C, Wathen N. What implementation efforts increase cancer screening rates? a systematic review. Implement Sci 2011, 6:1-17. 10.1186/1748-5908-6-1, 3024963, 21208425.
3. Eccles MP, Armstrong D, Baker R, Cleary K, Davies H, Davies S, Gasziou P, Ilott I, Kinmonth ALL, Leng G, Logan S, Marteau T, Michie S, Rogers H, Rycroft-Malone J, Sibbald B. An implementation research agenda. Implement Sci 2009, 4:1-7. 10.1186/1748-5908-4-1, 2639531, 19123945.
4. Institute of Medicine Initial national priorities for comparative effectiveness research 2009, Washington, DC: The National Academies Press, Institute of Medicine.
5. Dissemination and implementation research in health (R01) http://grants.nih.gov/grants/guide/pa-files/PAR-13-055.html.
6. Researching implementation and change while improving quality (R18) http://grants.nih.gov/grants/guide/pa-files/PAR-08-136.html.
7. AHRQ health services research demonstration and dissemination grants (R18) http://grants.nih.gov/grants/guide/pa-files/PA-13-046.html.
8. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci 2012, 7:1-17.
9. Michie S, Fixsen DL, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci 2009, 4:1-6. 10.1186/1748-5908-4-1, 2639531, 19123945.
10. Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci 2010, 5:1-6. 10.1186/1748-5908-5-1, 2881109, 20047652.
11. Colquhoun HL, Brehaut JC, Sales A, Ivers N, Grimshaw J, Michie S, Carroll K, Cahlifoux M, Eva KW. A systematic review of the use of theory in randomized controlled trials of audit and feedback. Implement Sci 2013, 8:1-8. 10.1186/1748-5908-8-1, 3547806, 23279972.
12. Alexander JA, Hearld LR. Methods and metrics challenges of delivery-systems research. Implement Sci 2012, 7:1-11.
13. McKibbon KA, Lokker C, Wilczynski NL, Ciliska D, Dobbins M, Davis DA, Haynes RB, Straus S. A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a tower of Babel?. Implement Sci 2010, 5:1-11. 10.1186/1748-5908-5-1, 2881109, 20047652.
14. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: new guidance 2008, 1-39. London: Medical Research Council.
15. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care 2012, 50:217-226. 10.1097/MLR.0b013e3182408812, 3731143, 22310560.
16. Proctor EK, Landsverk J, Aarons GA, Chambers DA, Glisson C, Mittman BS. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health 2009, 36:24-34. 10.1007/s10488-008-0197-4, 3808121, 19104929.
17. Deming WE. Out of the crisis 1986, Cambridge, MA: MIT Press.
18. Mazzocato P, Savage C, Brommels M, Aronsson H, Thor J. Lean thinking in healthcare: a realist review of the literature. Qual Saf Health Care 2010, 19:376-382. 10.1136/qshc.2009.037986, 20724397.
19. Azocar F, Cuffel B, Goldman W, McCarter L. The impact of evidence-based guideline dissemination for the assessment and treatment of major depression in a managed behavioral health care organization. J Behav Health Serv Res 2003, 30:109-118. 10.1007/BF02287816, 12633007.
20. Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, Glass JE, York JL. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev 2012, 69:123-157. 10.1177/1077558711430690, 3524416, 22203646.
21. Magnabosco JL. Innovations in mental health services implementation: a report on state-level data from the U.S. evidence-based practices project. Implement Sci 2006, 1:1-11.
22. Eccles MP, Johnston M, Hrisos S, Francis J, Grimshaw JM, Steen N, Kaner EF. Translating clinicians' beliefs into implementation interventions (TRACII): a protocol for an intervention modeling experiment to change clinicians' intentions to implement evidence-based practice. Implement Sci 2007, 2:1-6. 10.1186/1748-5908-2-1, 1781466, 17204143.
23. Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature (No. FMHI publication #231) 2005, Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network.
24. Mazza D, Bairstow P, Buchan H, Chakraborty SP, Van Hecke O, Grech C, Kunnamo I. Refining a taxonomy for guideline implementation: results of an exercise in abstract classification. Implement Sci 2013, 8:1-10. 10.1186/1748-5908-8-1, 3547806, 23279972.
25. Cochrane Effective Practice and Organisation of Care Group Data Collection Checklist 2002, 1-30. http://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/datacollectionchecklist.pdf, Cochrane Effective Practice and Organisation of Care Group.
26. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med 2013, 46:81-95. 10.1007/s12160-013-9486-6, 23512568.
27. Glisson C, Hemmelgarn A, Green P, Dukes D, Atkinson S, Williams NJ. Randomized trial of the availability, responsiveness, and continuity (ARC) organizational intervention with community-based mental health programs and clinicians serving youth. J Am Acad Child Adolesc Psychiatry 2012, 51:780-787. 10.1016/j.jaac.2012.05.010, 22840549.
28. Glisson C, Schoenwald S, Hemmelgarn A, Green P, Dukes D, Armstrong KS, Chapman JE. Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. J Consult Clin Psychol 2010, 78:537-550.
29. Institute for Healthcare Improvement The breakthrough series: IHI's colaborative model for achieving breakthrough improvement 2003, Cambridge, Massachusetts: Institute for Healthcare Improvement, Institute for Healthcare Improvement.
30. Massoud MR, Nielsen GA, Nolan K, Nolan T, Schall MW, Sevin CA. A framework for spread: from local improvements to system-wide change 2006, Institute for Healthcare Improvement: Cambridge, Massachusetts.
31. Chinman M, Imm P, Wandersman A. Getting to outcomes 2004: promoting accountability through methods and tools for planning, implementation, and evaluation 2004, Rand Health: Santa Monica, CA.
32. Kegeles SM, Rebchook GM, Hays RB, Terry MA, O'Donnell L, Leonard NR, Kelly JA, Neumann MS. From science to application: the development of an intervention package. AIDS Educ Prev 2000, 12(5 Suppl):62-74.
33. Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implement Sci 2007, 2:1-10. 10.1186/1748-5908-2-1, 1781466, 17204143.
34. Stetler CB, Mittman BS, Francis J. Overview of the VA quality enhancement research inititative (QUERI) and QUERI theme articles: QUERI series. Implement Sci 2008, 3:1-9. 10.1186/1748-5908-3-1, 2235887, 18179688.
35. Glisson C, Dukes D, Green P. The effects of the ARC organizational intervention on caseworker turnover, climate, and culture in children's service systems. Child Abuse Negl 2006, 30:855-880. 10.1016/j.chiabu.2005.12.010, 16930699.
36. Glisson C, Hemmelgarn A, Green P, Williams NJ. Randomized trial of the availability, responsiveness and continuity (ARC) organizational intervention for improving youth outcomes in community mental health programs. J Am Acad Child Adolesc Psychiatry 2013, 52:493-500. 10.1016/j.jaac.2013.02.005, 23622850.
37. Rosen A, Proctor EK. Specifying the treatment process: the basis for effective research. J Soc Serv Res 1978, 2:25-43.
38. Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol 2008, 27:379-387.
39. Kauth MR, Sullivan G, Blevins D, Cully JA, Landes RD, Said Q, Teasdale TA. Employing external facilitation to implement cognitive behavioral therapy in VA clinics: a pilot study. Implement Sci 2010, 5:1-11. 10.1186/1748-5908-5-1, 2881109, 20047652.
40. Rapp CA, Etzel-Wise D, Marty D, Coffman M, Carlson L, Asher D, Callaghan J, Whitley R. Evidence-based practice implementation strategies: results from a qualitative study. Community Ment Health J 2008, 44:213-224. 10.1007/s10597-007-9109-4, 17973191.
41. Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med 2012, 43:337-350. 10.1016/j.amepre.2012.05.024, 3592983, 22898128.
42. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci 2009, 4:1-15. 10.1186/1748-5908-4-1, 2639531, 19123945.
43. Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, Baker R, Eccles MP. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci 2013, 8:1-11. 10.1186/1748-5908-8-1, 3547806, 23279972.
44. Cane J, O'Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci 2012, 7:1-17.
45. Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci 2011, 6:1-11. 10.1186/1748-5908-6-1, 3024963, 21208425.
46. Landsverk J, Brown CH, Chamberlain P, Palinkas LA, Ogihara M, Czaja S, Goldhaver-Fiebert JD, Rolls Reutz JA, Horwitz SM. Design and analysis in dissemination and implementation research. Dissemination and implementation research in health 2012, 225-260. New York: Oxford University Press, Brownson RC, Colditz GA, Proctor EK.
47. Proctor EK, Silmere H, Raghavan R, Hovmand P, Aarons GA, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health Ment Health Serv Res 2011, 38:65-76.
48. Atkins MS, Frazier SL, Leathers SJ, Graczyk PA, Talbott E, Jakobsons L, Adil JA, Marinez-Lora A, Demirtas H, Gibbons RB, Bell CC. Teacher key opinion leaders and mental health consultation in low-income urban schools. J Consult Clin Psychol 2008, 76:905-908.
49. Proctor EK, Brownson RC. Measurement issues in dissemination and implementation research. Dissemination and implementation research in health: translating science to practice 2012, 261-280. New York: Oxford University Press, Brownson RC, Colditz GA, Proctor EK.
50. Proctor EK, Powell BJ, Feely M. Measurement issues in dissemination and implementation science. Child and adolescent therapy: dissemination and implementation of empirically supported treatments New York: Oxford University Press, Beidas RS, Kendall PC, In Press.
51. Eccles M, Grimshaw JM, Walker A, Johnston M, Pitts N. Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol 2005, 58:107-112. 10.1016/j.jclinepi.2004.09.002, 15680740.
52. Grol R, Bosch MC, Hulscher MEJ, Eccles MP, Wensing M. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q 2007, 85:93-138. 10.1111/j.1468-0009.2007.00478.x, 2690312, 17319808.
53. Cochrane effective practice and organisation of care group http://epoc.cochrane.org.
54. Oxman AD, Fretheim A, Flottorp S. The OFF theory of research utilization. J Clin Epidemiol 2005, 58:113-116. 10.1016/j.jclinepi.2004.10.002, 15680741.
55. Wensing M, Oxman A, Baker R, Godycki-Cwirko M, Flottorp S, Szecsenyi J, Grimshaw J, Eccles M. Tailored implementation for chronic diseases (TICD): a project protocol. Implement Sci 2011, 6:1-8. 10.1186/1748-5908-6-1, 3024963, 21208425.
56. Craig P, Dieppe P, Macintyre S, Mitchie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new medical research council guidance. BMJ 2008, 337:979-983.
57. Mittman BS. Implementation science in health care. Dissemination and implementation research in health: translating science to practice 2012, 400-418. New York: Oxford University Press, Brownson RC, Colditz GA, Proctor EK.
58. May C. Towards a general theory of implementation. Implement Sci 2013, 8:1-14. 10.1186/1748-5908-8-1, 3547806, 23279972.
59. Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PACAC, Rubin HR. Why don't physicians follow clinical practice guidelines?. JAMA 1999, 282:1458. 10.1001/jama.282.15.1458, 10535437.
60. Cook JM, Biyanova T, Coyne JC. Barriers to adoption of new treatments: an internet study of practicing community psychotherapists. Adm Policy Ment Health Ment Health Serv Res 2009, 36:83-90.
61. Gerring J. Social science methodology: a criterial framework 2001, Cambridge: Cambridge University Press.
62. Rabin BA, Purcell P, Naveed S, Moser RP, Henton MD, Proctor EK, Brownson RC, Glasgow RE. Advancing the application, quality and harmonization of implementation science measures. Implement Sci 2012, 7:1-11.
63. Rabin BA, Brownson RC, Joshu-Haire D, Kreuter MW, Weaver NL. A glossary of dissemination and implementation research in health. J Public Health Manag 2008, 14:117-123.
64. Rabin BA, Brownson RC. Developing terminology for dissemination and implementation research. Dissemination and implementation research in health: translating science to practice 2012, 23-51. New York: Oxford University Press, Brownson RC, Colditz GA, Proctor EK.
65. Forsner T, Wistedt AA, Brommels M, Janszky I, de Leon AP, Forsell Y. Supported local implementation of clinical guidelines in psychiatry: a two-year follow-up. Implement Sci 2010, 5:1-11. 10.1186/1748-5908-5-1, 2881109, 20047652.
66. Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2006, 2:CD000259.
67. The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG) Designing theoretically-informed implementation interventions. Implement Sci 2006, 1:1-8. The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG).
68. Hysong SJ. Audit and feedback features impact effectiveness on care quality. Med Care 2009, 47:1-8. 10.1097/MLR.0b013e3181808bb5, 19106724.
69. Fine SA, Cronshaw SF. Functional Job analysis: a foundation for human resources management 1995, Mahwah, New Jersey: Lawrence Erlbaum Associates, Inc.
70. Beidas RS, Edmunds JM, Marcus SC, Kendall PC. Training and consultation to promote implementation of an empirically supported treatment: a randomized trial. Psychiatr Serv 2012, 63:660-665. 3432154, 22549401.
71. Johnson DW, Johnson RT, Smith KA. Cooperative learning returns to college: what evidence is there that it works?. Change 1998, 30:27-35.
72. Flodgren G, Parmelli E, Doumit G, Gattellari M, O'Brien MA, Grimshaw J, Eccles MP. Local opinion leaders: effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews 2011, Art. No(Issue 8):CD000125. doi: 10.1002/14651858.CD000125.pub4.
73. Rogers EM. Diffusion of innovations 2003, New York: Free Press, 5.
74. Berwick DM. A primer on leading the improvement of systems. BMJ 1996, 312:619-622. 10.1136/bmj.312.7031.619, 2350403, 8595340.
75. Shortell SM. Increasing value: a research agenda for addressing the managerial and organizational challenges facing health care delivery in the United States. Med Care Res 2004, 61:12S-30S.
76. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q 2004, 82:581-629. 10.1111/j.0887-378X.2004.00325.x, 2690184, 15595944.
77. Lyon AR, Wiltsey Stirman S, Kerns SEU, Burns EJ. Developing the mental health workforce: review and application of training approaches from multiple disciplines. Adm Policy Ment Health 2011, 38:238-253. 10.1007/s10488-010-0331-y, 3093447, 21190075.
78. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health 2011, 38:4-23. 10.1007/s10488-010-0327-7, 3025110, 21197565.
79. Aarons GA, Green AE, Palinkas LA, Self-Brown S, Whitaker DJ, Lutzker JR, Silovsky JF, Hecht DB, Chaffin MJ. Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implement Sci 2012, 7:1-9.
80. Herschell AD, Kolko DJ, Baumann BL, Davis AC. The role of therapist training in the implementation of psychosocial treatments: a review and critique with recommendations. Clin Psychol Rev 2010, 30:448-466. 10.1016/j.cpr.2010.02.005, 2872187, 20304542.
81. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O'Brien MA, Johansen M, Grimshaw J, Oxman AD. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database of Systematic Reviews 2012, Art. No(Issue 6):CD000259. doi: 10.1002/14651858.CD000259.pub3.
82. GEM-Dissemination and implementation initiative (GEM-D&I) http://www.gem-beta.org/GEM-DI.
83. SIRC measures project http://www.seattleimplementation.org/sirc-projects/sirc-instrument-project/.
84. Wensing M, Bosch M, Grol R. Selecting, tailoring, and implementing knowledge translation interventions. Knowledge translation in health care: moving from evidence to practice 2009, 94-113. Oxford, UK: Wiley-Blackwell, Straus S, Tetroe J, Graham ID.
85. Bosch M, van der Weijden T, Wensing M, Grol R. Tailoring quality improvement interventions to identified barriers: a multiple case analysis. J Eval Clin Pract 2007, 13:161-168. 10.1111/j.1365-2753.2006.00660.x, 17378860.
86. Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, Robertson N. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews 2010, Art. No(Issue 3):CD005470. doi: 10.1002/14651858.CD005470.pub2.
87. McSherry LA, Dombrowski SU, Francis JJ, Murphy J, Martin CM, O'Leary JJ, Sharp L, . ATHENS Group 'It's A can of worms': understanding primary care practitioners' behaviors in relation to HPV using the theoretical domains framework. Implement Sci 2012, 7:1-16. ATHENS Group.
88. Addis ME, Wade WA, Hatgis C. Barriers to dissemination of evidence-based practices: addressing practitioners' concerns about manual-based psychotherapies. Clin Psychol Sci Pract 1999, 6:430-441.
89. Bartholomew NG, Joe GW, Rowan-Szai GA, Simpson DD. Counselor assessments of training and adoption barriers. J Subst Abuse Treat 2007, 33:193-199. 10.1016/j.jsat.2007.01.005, 1989156, 17434707.
90. Shapiro CJ, Prinz RJ, Sanders MR. Facilitators and barriers to implementation of an evidence-based parenting intervention to prevent child maltreatment: the triple p-positive parenting program. Child Maltreat 2012, 17:86-95. 10.1177/1077559511424774, 22089827.
91. Bhattacharyya O, Reeves S, Garfinkel S, Zwarenstein M. Designing theoretically-informed implementation interventions: fine in theory, but evidence of effectiveness in practice is needed. Implement Sci 2006, 1:1-3.
92. WIDER recommendations to improve reporting of the content of behaviour change interventions http://interventiondesign.co.uk/wp-content/uploads/2009/02/wider-recommendations.pdf.
93. Davidoff F, Batalden P, Stevens D, Ogrinc G, Mooney S. Publication guidelines for quality improvement in health care: evolution of the SQUIRE project. Qual Saf Health Care 2008, 17(Supplement 1):i3-i9. 2773518, 18836063.
94. Equator network http://www.equator-network.org/.