A framework for enhancing the value of research for dissemination and implementation

American Journal of Public Health

Volumn 105, Issue 1, 2015, Pages 49-57

  Neta, Gila ^a   Glasgow, Russell E ^b   Carpenter, Christopher R ^c   Grimshaw, Jeremy M ^d   Rabin, Borsika A ^e,f   Fernandez, Maria E ^g   Brownson, Ross C ^c,h  

^a NATIONAL CANCER INSTITUTE   (United States)

^b UNIVERSITY OF COLORADO   (United States)

^c WASHINGTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d UNIVERSITY OF OTTAWA   (Canada)

^e UNIVERSITY OF COLORADO   (United States)

^f Institute for Health Research   (United States)

^g UNIVERSITY OF TEXAS SCHOOL OF PUBLIC HEALTH   (United States)

^h WASHINGTON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84921830030     PISSN: 00900036     EISSN: 15410048     Source Type: Journal    
DOI: 10.2105/AJPH.2014.302206     Document Type: Review

References (106)

1. Riley WT, Glasgow RE, Etheredge L, Abernethy AP. Rapid, responsive, relevant (R3) research: a call for a rapid learning health research enterprise. Clin Transl Med. 2013;2(1):10.
2. Balas EA, Boren SA. Managing Clinical Knowledge for Health Care Improvement: Yearbook of Medical Informatics. Stuttgart, Germany: Schattauer; 2000.
3. Glasgow RE, Emmons KM. How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007;28:413-433.
4. How far have we come in reducing health disparities?: progress since 2000-workshop summary. Washington, DC: Institute of Medicine; 2012.
5. Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: what it is and how to do it. BMJ. 2013;347:f6753.
6. Brownson RC, Colditz GA, Proctor EK. Dissemination and Implementation Research in Health: Translating Science to Practice. 1st ed. New York, NY: Oxford University Press; 2012.
7. Glasgow RE, Vinson C, Chambers D, Khoury MJ, Kaplan RM, Hunter C. National Institutes of Health approaches to dissemination and implementation science: current and future directions. Am J Public Health. 2012;102(7):1274-1281.
8. Kolko DJ, Hoagwood KE, Springgate B. Treatment research for children and youth exposed to traumatic events: moving beyond efficacy to amp up public health impact. Gen Hosp Psychiatry. 2010;32(5):465-476.
9. Rothwell PM. External validity of randomised controlled trials: "to whom do the results of this trial apply? Lancet. 2005;365(9453):82-93.
10. Pinnock H, Epiphaniou E, Taylor SJ. Phase IV implementation studies. The forgotten finale to the complex intervention methodology framework. Ann Am Thorac Soc. 2014;11(suppl 2):S118-S122.
11. EQUATOR Network: Enhancing the QUAlity and Transparency Of health Research. 2013. Available at: http://www.equator-network.org. Accessed January 30, 2014.
12. Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43(3):337-350.
13. Wilson PM, Petticrew M, Calnan MW, Nazareth I. Disseminating research findings: what should researchers do? A systematic scoping review of conceptual frameworks. Implement Sci. 2010;5:91.
14. Sales A, Smith J, Curran G, Kochevar L. Models, strategies, and tools. Theory in implementing evidencebased findings into health care practice. J Gen Intern Med. 2006;21(suppl 2):S43-S49.
15. Mitchell SA, Fisher CA, Hastings CE, Silverman LB, Wallen GR. A thematic analysis of theoretical models for translational science in nursing: mapping the field. Nurs Outlook. 2010;58(6):287-300.
16. Khoury MJ, Gwinn M, Ioannidis JP. The emergence of translational epidemiology: from scientific discovery to population health impact. Am J Epidemiol. 2010;172(5):517-524.
17. Klesges LM, Estabrooks PA, Dzewaltowski DA, Bull SS, Glasgow RE. Beginning with the application in mind: designing and planning health behavior change interventions to enhance dissemination. Ann Behav Med. 2005;29(suppl):66-75.
18. Brownson RC, Jacobs JA, Tabak RG, Hoehner CM, Stamatakis KA. Designing for dissemination among public health researchers: findings from a national survey in the United States. Am J Public Health. 2013;103(9):1693-1699.
19. Rogers EM. Diffusion of Innovations. 5th ed. New York, NY: Free Press; 2003.
20. Rabin BA, Brownson RC, Haire-Joshu D, Kreuter MW, Weaver NL. A glossary for dissemination and implementation research in health. J Public Health Manag Pract. 2008;14(2):117-123.
21. McLeroy KR, Bibeau D, Steckler A, Glanz K. An ecological perspective on health promotion programs. Health Educ Q. 1988;15(4):351-377.
22. Stokols D. Social ecology and behavioral medicine: implications for training, practice, and policy. Behav Med. 2000;26(3):129-138.
23. Glasgow RE, Green LW, Klesges LM, et al. External validity: we need to do more. Ann Behav Med. 2006;31(2):105-108.
24. Green LW, Glasgow RE. Evaluating the relevance, generalization, and applicability of research: issues in external validation and translation methodology. Eval Health Prof. 2006;29(1):126-153.
25. Stange KC, Breslau ES, Dietrich AJ, Glasgow RE. State-of-the-art and future directions in multilevel interventions across the cancer control continuum. J Natl Cancer Inst Monogr. 2012;2012(44):20-31.
26. McDonald KM. Considering context in quality improvement interventions and implementation: concepts, frameworks, and application. Acad Pediatr. 2013;13(6, suppl):S45-S53.
27. McKinlay JB. Paradigmatic obstacles to improving the health of populations-implications for health policy. Salud Publica Mex. 1998;40(4):369-379.
28. Weiner BJ, Belden CM, Bergmire DM, Johnston M. The meaning and measurement of implementation climate. Implement Sci. 2011;6:78.
29. Tomoaia-Cotisel A, Scammon DL, Waitzman NJ, et al. Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Ann Fam Med. 2013;11(suppl 1):S115-S123.
30. Stange KC, Glasgow RE. Considering and reporting important contextual factors in research on the patientcentered medical home. In: Rockville, MD: Agency for Healthcare Research and Quality; 2013.
31. Bayliss EA, Bonds DE, Boyd CM, et al. Understanding the context of health for people with multiple chronic conditions: moving from what is the matter to what matters. Ann Fam Med. 2014;12(3):260-269.
32. Klassen AC, Creswell J, Plano Clark VL, Smith KC, Meissner HI. Best practices in mixed methods for quality of life research. Qual Life Res. 2012;21(3):377-380.
33. Glasgow RE, Chambers D. Developing robust, sustainable, implementation systems using rigorous, rapid and relevant science. Clin Transl Sci. 2012;5(1):48-55.
34. Fleurence R, Selby JV, Odom-Walker K, et al. How the Patient-Centered Outcomes Research Institute is engaging patients and others in shaping its research agenda. Health Aff (Millwood). 2013;32(2):393-400.
35. Krumholz HM, Selby JV; Patient-Centered Outcomes Research Institute. Seeing through the eyes of patients: the Patient-Centered Outcomes Research Institute funding announcements. Ann Intern Med. 2012;157(6):446-447.
36. Selby JV. The Patient-Centered Outcomes Research Institute: a 2013 agenda for "research done differently." Popul Health Manag. 2013;16(2):69-70.
37. Selby JV, Beal AC, Frank L. The Patient-Centered Outcomes Research Institute (PCORI) national priorities for research and initial research agenda. JAMA. 2012;307(15):1583-1584.
38. Ritzwoller DP, Sukhanova A, Gaglio B, Glasgow RE. Costing behavioral interventions: a practical guide to enhance translation. Ann Behav Med 2009;37(2):218-227.
39. O'Keeffe-Rosetti MC, Hornbrook MC, Fishman PA, et al. A standardized relative resource cost model for medical care: application to cancer control programs. J Natl Cancer Inst Monogr. 2013;2013(46):106-116.
40. Gold MR, Siegel JE, Russell LB, Weinstein MC. Cost-Effectiveness in Health and Medicine. New York, NY: Oxford University Press; 2003.
41. Bartholomew LK, Parcel GS, Kok G, Gottlieb NH, Fernández ME. Planning Health Promotion Programs: An Intervention Mapping Approach. 3rd ed. San Francisco, CA: Jossey-Bass; 2011.
42. Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4:40.
43. French SD, Green SE, O'Connor DA, et al. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci. 2012;7:38.
44. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:139.
45. Leviton LC, Khan LK, Rog D, Dawkins N, Cotton D. Evaluability assessment to improve public health policies, programs, and practices. Annu Rev Public Health. 2010;31:213-233.
46. Wholey J. Assessing the feasibility and likely usefulness of evaluation. In: Wholey J, Hatry H, Newcomer K, eds. Handbook of Practical Program Evaluation. 2nd ed. San Francisco, CA: Jossey-Bass; 2004:33-62.
47. Lomas J. Diffusion, dissemination, and implementation: who should do what? Ann N Y Acad Sci 1993;703:226-235, discussion 235-227.
48. Hawe P, Shiell A, Riley T. Complex interventions: how "out of control" can a randomised controlled trial be? BMJ. 2004;328(7455):1561-1563.
49. Allen JD, Linnan LA, Emmons KM. Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination. In: Brownson RC, Colditz G, Proctor E, eds. Dissemination and Implementation Research in Health: Translating Science to Practice. New York, NY: Oxford University Press; 2012:281-304.
50. Stirman SW, Miller CJ, Toder K, Calloway A Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci. 2013;8:65.
51. Bellg AJ, Borrelli B, Resnick B, et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004;23(5):443-451.
52. Squires JE, Valentine JC, Grimshaw JM. Systematic reviews of complex interventions: framing the review question. J Clin Epidemiol. 2013;66(11):1215-1222.
53. Gaglio B, Shoup JA, Glasgow RE. The RE-AIM framework: a systematic review of use over time. Am J Public Health. 2013;103(6):e38-e46.
54. Kessler RS, Purcell EP, Glasgow RE, Klesges LM, Benkeser RM, Peek CJ. What does it mean to "employ" the RE-AIM model? Eval Health Prof. 2013;36(1):44-66.
55. Powell AA, White KM, Partin MR, et al. Unintended consequences of implementing a national performance measurement system into local practice. J Gen Intern Med. 2012;27(4):405-412.
56. Naylor MD, Kurtzman ET, Grabowski DC, Harrington C, McClellan M, Reinhard SC. Unintended consequences of steps to cut readmissions and reform payment may threaten care of vulnerable older adults. Health Aff (Millwood). 2012;31(7):1623-1632.
57. Peters E, Klein W, Kaufman A, Meilleur L, Dixon A More is not always better: intuitions about effective public policy can lead to unintended consequences. Soc Issues Policy Rev. 2013;7(1):114-148.
58. Lehmann U, Gilson L. Actor interfaces and practices of power in a community health worker programme: a South African study of unintended policy outcomes. Health Policy Plan. 2013;28(4):358-366.
59. Kaplan RM, Bush JW. Health-related quality of life measurement for evaluation research and policy analysis. Health Psychol. 1982;1(1):61-80.
60. Kaplan RM. Quality of life measurement In: Karoly P, ed. Measurement Strategies in Health Psychology. New York, NY: Wiley & Sons; 1985.
61. Collins CD, Purohit S, Podolsky RH, et al. The application of genomic and proteomic technologies in predictive, preventive and personalized medicine. Vascul Pharmacol. 2006;45(5):258-267.
62. Kaiser J. Francis Collins interview. Departing U. S. Genome Institute director takes stock of personalized medicine. Science. 2008;320(5881):1272.
63. Hamburg MA, Collins FS. The path to personalized medicine. N Engl J Med. 2010;363(4):301-304.
64. Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review-a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10(suppl 1):21-34.
65. Thorpe KE, Zwarenstein M, Oxman AD, et al. A Pragmatic-Explanatory Continuum Indicator Summary (PRECIS): a tool to help trial designers. CMAJ. 2009;180(10):E47-E57.
66. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8:117.
67. Scheirer MA, Dearing JW. An agenda for research on the sustainability of public health programs. Am J Public Health. 2011;101(11):2059-2067.
68. Hartzler B, Lash SJ, Roll JM. Contingency management in substance abuse treatment: a structured review of the evidence for its transportability. Drug Alcohol Depend. 2012;122(1-2):1-10.
69. Bernstein E, Topp D, Shaw E, et al. A preliminary report of knowledge translation: lessons from taking screening and brief intervention techniques from the research setting into regional systems of care. Acad Emerg Med. 2009;16(11):1225-1233.
70. Schoenwald SK, Sheidow AJ, Letourneau EJ, Liao JG. Transportability of multisystemic therapy: evidence for multilevel influences. Ment Health Serv Res. 2003;5(4):223-239.
71. Ioannidis JP. Why most published research findings are false. PLoS Med. 2005;2(8):e124.
72. Prasad V, Vandross A, Toomey C, et al. A decade of reversal: an analysis of 146 contradicted medical practices. Mayo Clin Proc. 2013;88(8):790-798.
73. Murray E, Treweek S, Pope C, et al. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med. 2010;8:63.
74. Proctor E, Silmere H, Raghavan R, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65-76.
75. Glasgow RE, Klesges LM, Dzewaltowski DA, Estabrooks PA, Vogt TM. Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ Res. 2006;21(5):688-694.
76. Haug NA, Shopshire M, Tajima B, Gruber V, Guydish J. Adoption of evidence-based practices among substance abuse treatment providers. J Drug Educ. 2008;38(2):181-192.
77. Henggeler SW, Chapman JE, Rowland MD, et al. Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. J Consult Clin Psychol. 2008;76(4):556-567.
78. Greenhalgh T. Role of routines in collaborative work in healthcare organisations. BMJ. 2008;337:a2448.
79. Cochrane A. Effectiveness and Efficiency: Random Reflections on Health Services. London, England: Nuffield Provincial Hospital Trust; 1972.
80. Chambers D. Foreword. In: Brownson R, Colditz G, Proctor E, eds. Dissemination and Implementation Research in Health: Translating Science to Practice. New York, NY: Oxford University Press; 2012: vii-x.
81. Altman DG, Simera I, Hoey J, Moher D, Schulz K. EQUATOR: reporting guidelines for health research. Open Med. 2008;2(2):e49-e50.
82. Moher D, Simera I, Schulz KF, Hoey J, Altman DG. Helping editors, peer reviewers and authors improve the clarity, completeness and transparency of reporting health research. BMC Med. 2008;6:13.
83. Schulz KF, Altman DG, Moher D, Group C. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMC Med. 2010;8:18.
84. Bossuyt PM, Reitsma JB, Bruns DE, et al. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Intern Med. 2003;138(1):W1-W12.
85. Von Elm E, Altman DG, Egger M, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Ann Intern Med. 2007;147(8):573-577.
86. Davidoff F, Batalden P, Stevens D, Ogrinc G, Mooney S; SQUIRE Development Group. Publication guidelines for improvement studies in health care: evolution of the SQUIRE Project. Ann Intern Med. 2008;149(9):670-676.
87. Husereau D, Drummond M, Petrou S, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. BMJ. 2013;346:f1049.
88. Gagnier JJ, Kienle G, Altman DG, et al. The CARE guidelines: consensus-based clinical case report guideline development. J Clin Epidemiol. 2014;67(1):46-51.
89. Stroup DF, Berlin JA, Morton SC, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000;283(15):2008-2012.
90. Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264-269, W264.
91. Ioannidis JP, Evans SJ, Gotzsche PC, et al. Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004;141(10):781-788.
92. Piaggio G, Elbourne DR, Altman DG, Pocock SJ, Evans SJ, Group C. Reporting of noninferiority and equivalence randomized trials: an extension of the CONSORT statement. JAMA. 2006;295(10):1152-1160.
93. Campbell MK, Elbourne DR, Altman DG; CONSORT Group. CONSORT statement: extension to cluster randomised trials. BMJ. 2004;328(7441):702-708.
94. Zwarenstein M, Treweek S, Gagnier JJ, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008;337:a2390.
95. Gagnier JJ, Boon H, Rochon P, et al. Reporting randomized, controlled trials of herbal interventions: an elaborated CONSORT statement. Ann Intern Med. 2006;144(5):364-367.
96. Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P; CONSORT Group. Methods and processes of the CONSORT Group: example of an extension for trials assessing nonpharmacologic treatments. Ann Intern Med. 2008;148(4):W60-W66.
97. Simera I, Moher D, Hirst A, Hoey J, Schulz KF, Altman DG. Transparent and accurate reporting increases reliability, utility, and impact of your research: reporting guidelines and the EQUATOR Network. BMC Med. 2010;8:24.
98. Tao KM, Li XQ, Zhou QH, Moher D, Ling CQ, Yu WF. From QUOROM to PRISMA: a survey of high-impact medical journals' instructions to authors and a review of systematic reviews in anesthesia literature. PLoS ONE. 2011;6(11):e27611.
99. Albrecht L, Archibald M, Arseneau D, Scott SD. Development of a checklist to assess the quality of reporting of knowledge translation interventions using the Workgroup for Intervention Development and Evaluation Research (WIDER) recommendations. Implement Sci. 2013;8:52.
100. Welch V, Petticrew M, Tugwell P, et al. PRISMA-Equity 2012 extension: reporting guidelines for systematic reviews with a focus on health equity. PLoS Med. 2012;9(10):e1001333.
101. Möhler R, Bartoszek G, Meyer G. Quality of reporting of complex healthcare interventions and applicability of the CReDECI list-a survey of publications indexed in PubMed. BMC Med Res Methodol. 2013;13(1):125.
102. Loudon K, Zwarenstein M, Sullivan F, Donnan P, Treweek S. Making clinical trials more relevant: improving and validating the PRECIS tool for matching trial design decisions to trial purpose. Trials. 2013;14:115.
103. Pinnock H, Taylor S, Epiphaniou E, et al. Developing standards for reporting phase IV implementation studies. 2013. Available at: http://www.equator-network.org/library/reporting-guidelinesunder-development/#17. Accessed December 13, 2013.
104. Slade M. REporting Manualised INterventions for Dissemination and Evaluation (REMINDE) Statement. 2013. Available at: http://www.equator-network.org/library/reporting-guidelines-under-development/#6. Accessed December 13, 2013.
105. Hoffmann TC, Glaziou PP, Boutron I, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.
106. Montgomery P, Grant S, Hopewell S, et al. Protocol for CONSORT-SPI: an extension for social and psychological interventions. Implement Sci. 2013;8(1):99.