Variation in research designs used to test the effectiveness of dissemination and implementation strategies: A review

Frontiers in Public Health

Volumn 6, Issue FEB, 2018, Pages

  Mazzucca, Stephanie ^a   Tabak, Rachel G ^a   Pilar, Meagan ^a   Ramsey, Alex T ^b   Baumann, Ana A ^a   Kryzer, Emily ^a   Lewis, Ericka M ^c   Padek, Margaret ^a   Powell, Byron J ^d   Brownson, Ross C ^a,e  

^a WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

^b WASHINGTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF MARYLAND   (United States)

^d IL   (United States)

^e USA   (United States)

Author keywords

Dissemination research; Implementation research; Research methods; Research study design; Review

Indexed keywords

EID: 85045252947     PISSN: None     EISSN: 22962565     Source Type: Journal    
DOI: 10.3389/fpubh.2018.00032     Document Type: Review

References (73)

1. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci (2013) 8(1):117. doi:10.1186/1748-5908-8-117
2. Glasgow RE, Rabin BA. Implementation science and comparative effectiveness research: a partnership capable of improving population health. J Comp EffRes (2014) 3(3):237-40. doi:10.2217/cer.14.9
3. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health (2011) 38(2):65-76. doi:10.1007/s10488-010-0319-7
4. Landsverk J, Brown CH, Smith JD, Chamberlain P, Curran GM, Palinkas L, et al. Design and analysis in dissemination and implementation research. 2nd ed. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and Implementation Research in Health: Translating Science to Practice. New York: Oxford University Press (2017) 201-28
5. Brown CH, Chamberlain P, Saldana L, Padgett C, Wang W, Cruden G. Evaluation of two implementation strategies in 51 child county public service systems in two states: results of a cluster randomized head-to-head implementation trial. Implement Sci (2014) 9:134. doi:10.1186/s13012-014-0134-8
6. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care (2012) 50(3):217-26. doi:10.1097/MLR.0b013e3182408812
7. Glasgow RE, Lichtenstein E, Marcus AC. Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health (2003) 93(8):1261-7. doi:10.2105/AJPH.93.8.1261
8. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health (2011) 38(1):4-23. doi:10.1007/s10488-010-0327-7
9. Brown CH, Curran G, Palinkas LA, Aarons GA, Wells KB, Jones L, et al. An overview of research and evaluation designs for dissemination and implementation. Annu Rev Public Health (2017) 38:1-22. doi:10.1146/annurev-publhealth-031816-044215
10. Mercer SL, Devinney BJ, Fine LJ, Green LW, Dougherty D. Study designs for effectiveness and translation research identifying trade-offs. Am J Prev Med (2007) 33(2):139-54. doi:10.1016/j.amepre.2007.04.005
11. Dubois JM, Prusaczk B. Ethical issues in dissemination and implementation research. 2nd ed. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and Implementation Research in Health: Translating Science to Practice. New York: Oxford University Press (2017) 63-72
12. Brown CH, Kellam SG, Kaupert S, Muthén BO, Wang W, Muthén LK, et al. Partnerships for the design, conduct, and analysis of effectiveness, and implementation research: experiences of the prevention science and methodology group. Adm Policy Ment Health (2012) 39(4):301-16. doi:10.1007/s10488-011-0387-3
13. Chamberlain P, Roberts R, Jones H, Marsenich L, Sosna T, Price JM. Three collaborative models for scaling up evidence-based practices. Adm Policy Ment Health (2012) 39(4):278-90. doi:10.1007/s10488-011-0349-9
14. Weisz JR, Sandler IN, Durlak JA, Anton BS. Promoting and protecting youth mental health through evidence-based prevention and treatment. Am Psychol (2005) 60(6):628-48. doi:10.1037/0003-066X.60.6.628
15. Kazdin AE, Blase SL. Rebooting psychotherapy research and practice to reduce the burden of mental illness. Perspect Psychol Sci (2011) 6(1):21-37. doi:10.1177/1745691610393527
16. Glasgow RE, Vinson C, Chambers D, Khoury MJ, Kaplan RM, Hunter C. National Institutes of Health approaches to dissemination and implementation science: current and future directions. Am J Public Health (2012) 102(7):1274-81. doi:10.2105/AJPH.2012.300755
17. National Cancer Institute. Designing for Dissemination: Conference Summary Report. Washington, DC: National Cancer Institute (2002)
18. The National Advisory Mental Health Council's Services Research and Clinical Epidemiology Workgroup. The Road Ahead: Research Partnerships to Transform Services. Bethesda, MD: National Institutes of Health, National Institute of Mental Health (2006)
19. Baum K, Blakeslee K, Lloyd J, Petrosino A. Violence Prevention: Moving from Evidence to Implementation. Washington, DC: IOM Forum on Global Violence Prevention (2013)
20. NHLBI Cardiovascular Disease Thought Leaders. Research Translation, Dissemination, and Application-Moving Toward a New Vision and Strategic Framework Discussion and Consensus Findings. Bethesda, MD: National Institutes of Health (2005)
21. Biglan A, Ary D, Wagenaar AC. The value of interrupted time-series experiments for community intervention research. Prev Sci (2000) 1(1):31-49. doi:10.1023/A:1010024016308
22. Brown CH, Ten Have TR, Jo B, Dagne G, Wyman PA, Muthén B, et al. Adaptive designs for randomized trials in public health. Annu Rev Public Health (2009) 30:1-25. doi:10.1146/annurev.publhealth.031308.100223
23. Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol (2006) 6:54. doi:10.1186/1471-2288-6-54
24. Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials (2007) 28(2):182-91. doi:10.1016/j.cct.2006.05.007
25. Stetler CB, Legro MW, Wallace CM, Bowman C, Guihan M, Hagedorn H, et al. The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med (2006) 21(Suppl 2):S1-8. doi:10.1007/s11606-006-0267-9
26. Kessler R, Glasgow RE. A proposal to speed translation of healthcare research into practice: dramatic change is needed. Am J Prev Med (2011) 40(6):637-44. doi:10.1016/j.amepre.2011.02.023
27. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci (2015) 10:21. doi:10.1186/s13012-015-0209-1
28. Norton WE, Lungeanu A, Chambers DA, Contractor N. Mapping the growing discipline of dissemination and implementation science in health. Scientometrics (2017) 112(3):1367-90. doi:10.1007/s11192-017-2455-2
29. Implementation Science. Aims and Scope. (2017). Available from: https://implementationscience.biomedcentral.com/about
30. Landsverk J, Brown CH, Rolls Reutz J, Palinkas L, Horwitz SM. Design elements in implementation research: a structured review of child welfare and child mental health studies. Adm Policy Ment Health (2011) 38(1):54-63. doi:10.1007/s10488-010-0315-y
31. Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev (2011) 69(2):123-57. doi:10.1177/1077558711430690
32. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci (2013) 8:139. doi:10.1186/1748-5908-8-139
33. Rabin BA, Brownson RC. Terminology for dissemination and implementation research. 2nd ed. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and Implementation Research in Health: Translating Science to Practice. New York: Oxford University Press (2017) 19-46
34. Kirchner JE, Waltz TJ, Powell BJ, Smith JL, Proctor EK. Implementation strategies. 2nd ed. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and Implementation Research in Health: Translating Science to Practice. New York: Oxford University Press (2017) 245-66
35. Shortell SM. Increasing value: a research agenda for addressing the managerial and organizational challenges facing health care delivery in the United States. Med Care Res Rev (2004) 61(3 Suppl):12S-30S. doi:10.1177/1077558704266768
36. Brown CH, Liao J. Principles for designing randomized preventive trials in mental health: an emerging developmental epidemiology paradigm. Am J Community Psychol (1999) 27(5):673-710. doi:10.1023/A:1022142021441
37. Scott S, Hartling L, Grimshaw J, Johnson D, Osmond M, Plint A, et al. Improving outcomes for ill and injured children in emergency departments: protocol for a program in pediatric emergency medicine and knowledge translation science. Implement Sci (2009) 4:60-60. doi:10.1186/1748-5908-4-60
38. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci (2009) 4:50. doi:10.1186/1748-5908-4-50
39. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health (1999) 89(9):1322-7. doi:10.2105/AJPH.89.9.1322
40. Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care (1998) 7(3):149-58. doi:10.1136/qshc.7.3.149
41. Rycroft-Malone J. The PARIHS framework-a framework for guiding the implementation of evidence-based practice. J Nurs Care Qual (2004) 19(4):297-304. doi:10.1097/00001786-200410000-00002
42. Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A, et al. Making psychological theory useful for implementing evidence based practice: a consensus approach. BMJ Qual Saf (2005) 14(1):26-33. doi:10.1136/qshc.2004.011155
43. Rogers EM. Diffusion of Innovations. 5th ed. New York: Free Press (2003)
44. Grol R, Wensing M. Improving Patient Care: The Implementation of Change in Health Care. 2nd ed. Chichester: Wiley-Blackwell (2013)
45. Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, et al. Framework for design and evaluation of complex interventions to improve health. BMJ (2000) 321(7262):694. doi:10.1136/bmj.321.7262.694
46. Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, et al. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med (2010) 8:63. doi:10.1186/1741-7015-8-63
47. Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness: the chronic care model, part 2. JAMA (2002) 288(15):1909-14. doi:10.1001/jama.288.15.1909
48. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q (2004) 82(4):581-629. doi:10.1111/j.0887-378X.2004.00325.x
49. Logan J, Graham ID. Toward a comprehensive interdisciplinary model of health care research use. Sci Commun (1998) 20(2):227-46. doi:10.1177/1075547098020002004
50. West SG, Duan N, Pequegnat W, Gaist P, Des Jarlais DC, Holtgrave D, et al. Alternatives to the randomized controlled trial. Am J Public Health (2008) 98(8):1359-66. doi:10.2105/AJPH.2007.124446
51. Stacey D, Taljaard M, Smylie J, Boland L, Breau RH, Carley M, et al. Implementation of a patient decision aid for men with localized prostate cancer: evaluation of patient outcomes and practice variation. Implement Sci (2016) 11(1):87. doi:10.1186/s13012-016-0451-1
52. Voorn VM, Marang-van de Mheen PJ, So-Osman C, Kaptein AA, van der Hout A, van den Akker-van Marle ME, et al. De-implementation of expensive blood saving measures in hip and knee arthroplasties: study protocol for the LISBOA-II cluster randomized trial. Implement Sci (2014) 9:48. doi:10.1186/1748-5908-9-48
53. Martinez RG, Lewis CC, Weiner BJ. Instrumentation issues in implementation science. Implement Sci (2014) 9:118. doi:10.1186/s13012-014-0118-8
54. Milat AJ, Bauman A, Redman S. Narrative review of models and success factors for scaling up public health interventions. Implement Sci (2015) 10:113. doi:10.1186/s13012-015-0301-6
55. Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci (2015) 10:53. doi:10.1186/s13012-015-0242-0
56. Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med (2012) 43(3):337-50. doi:10.1016/j.amepre.2012.05.024
57. Brownson RC, Colditz GA, Dobbins M, Emmons KM, Kerner JF, Padek M, et al. Concocting that magic elixir: successful grant application writing in dissemination and implementation research. Clin Transl Sci (2015) 8:710-6. doi:10.1111/cts.12356
58. Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci (2010) 5:14. doi:10.1186/1748-5908-5-14
59. Colquhoun HL, Brehaut JC, Sales A, Ivers N, Grimshaw J, Michie S, et al. A systematic review of the use of theory in randomized controlled trials of audit and feedback. Implement Sci (2013) 8:66. doi:10.1186/1748-5908-8-66
60. Powell BJ, Proctor EK, Glass JE. A systematic review of strategies for implementing empirically supported mental health interventions. Res Soc Work Pract (2014) 24(2):192-212. doi:10.1177/1049731513505778
61. Dissemination & Implementation Models in Health Research & Practice. (2015). Available from: http://www.dissemination-implementation.org/index.aspx
62. Birken SA, Powell BJ, Shea CM, Haines ER, Alexis Kirk M, Leeman J, et al. Criteria for selecting implementation science theories and frameworks: results from an international survey. Implement Sci (2017) 12:124. doi:10.1186/s13012-017-0656-y
63. Glanz K, Bishop DB. The role of behavioral science theory in development and implementation of public health interventions. Annu Rev Public Health (2010) 31:399-418. doi:10.1146/annurev.publhealth.012809.103604
64. Glasgow RE, Green LW, Klesges LM, Abrams DB, Fisher EB, Goldstein MG, et al. External validity: we need to do more. Ann Behav Med (2006) 31(2):105-8. doi:10.1207/s15324796abm3102_1
65. Burke JG, Lich KH, Neal JW, Meissner HI, Yonas M, Mabry PL. Enhancing dissemination and implementation research using systems science methods. Int J Behav Med (2015) 22(3):283-91. doi:10.1007/s12529-014-9417-3
66. Stuart EA, Rubin DB. Best practices in quasi-experimental designs. In: Osborne JW, editor. Best Practices in Quantitative Methods. Los Angeles: SAGE Publications, Inc (2008). p. 155-76
67. Mann CJ. Observational research methods. Research design II: cohort, cross sectional, and case-control studies. Emerg Med J (2003) 20(1):54-60. doi:10.1136/emj.20.1.54
68. McCormack B, Kitson A, Harvey G, Rycroft-Malone J, Titchen A, Seers K. Getting evidence into practice: the meaning of 'context'. J Adv Nurs (2002) 38(1):94-104. doi:10.1046/j.1365-2648.2002.02150.x
69. Lewis CC, Weiner BJ, Stanick C, Fischer SM. Advancing implementation science through measure development and evaluation: a study protocol. Implement Sci (2015) 10(1):102. doi:10.1186/s13012-015-0287-0
70. Powell BJ, Stanick CF, Halko HM, Dorsey CN, Weiner BJ, Barwick MA, et al. Toward criteria for pragmatic measurement in implementation research and practice: a stakeholder-driven approach using concept mapping. Implement Sci (2017) 12(1):118. doi:10.1186/s13012-017-0649-x
71. Kimber M, Barac R, Barwick M. Monitoring fidelity to an evidence-based treatment: practitioner perspectives. Clin Soc Work J (2017):1-15. doi:10.1007/s10615-017-0639-0
72. Lyon AR, Connors E, Jensen-Doss A, Landes SJ, Lewis CC, McLeod BD, et al. Intentional research design in implementation science: implications for the use of nomothetic and idiographic assessment. Transl Behav Med (2017) 7(3):567-80. doi:10.1007/s13142-017-0464-6
73. Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Adm Policy Ment Health (2011) 38(1):44-53. doi:10.1007/s10488-010-0314-z