Evaluation Approaches for Dissemination and Implementation Research

Dissemination and Implementation Research in Health: Translating Science to Practice

Volumn , Issue , 2012, Pages

  Gaglio, Bridget ^a   Glasgow, Russell E ^b,c  

^a KAISER PERMANENTE MEDICAL CENTER   (United States)

^b Institute for Health Research Kaiser Permanente Colorado   (Australia)

^c NATIONAL CANCER INSTITUTE   (United States)

Author keywords

D I research; Dissemination and implementation; RE AIM model

Indexed keywords

EID: 84921688285     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1093/acprof:oso/9780199751877.003.0016     Document Type: Chapter

References (88)

1. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. (2009). Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.
2. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322-1327.
3. Glasgow RE, Nelson CC, Stryker LA, King D. Using RE-AIM metrics to evaluate diabetes self-management support interventions. Am J Prev Med. 2006;30:67-73.
4. Green LW, Ottoson JM, Garcia C, Hiatt RA. Diffusion theory and knowledge dissemination, utilization, and integration in public health. Annu Rev Public Health. 2009;30:151-174.
5. Jilcott S, Ammerman A, Sommers J, Glasgow RE. Applying the RE-AIM framework to assess the public health impact of policy change. Ann Behav Med. 2007;34:105-114.
6. Klesges LM, Estabrooks PA, Dzewaltowski, DA, Bull SS, Glasgow RE. Beginning with the application in mind: designing and planning health behavior change interventions to enhance dissemination. Ann Behav Med. 2005;29:66S-75S.
7. Leviton LC, Khan LK, Rog D, Dawkins N, Cotton D. Evaluability assessment to improve public health polices, programs, and practices. Annu Rev Public Health. 2010;31:213-233.
8. Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review: a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10:S21-S39.
9. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: The RE-AIM framework. Am J Public Health 1999;89: 1322-1327; PMID 10474547.
10. Glasgow RE, Linnan LA. Evaluation of theory-based interventions. In: Glanz K, Rimer BK, Viswanath K, eds. Health behavior and health education: Theory, research, and practice. 4th ed. San Francisco, CA: Jossey-Bass; 2008;487-508.
11. Wholey JS. Evaluability assessment. In: Wholey JS, Hatry HP, Newcomer KE, eds. Handbook of practical program evaluation. 2nd ed. San Francisco, CA: John Wiley and Sons; 2004;33-62.
12. Leviton LC, Khan LK, Rog D, Dawkins N, Cotton D. Evaluability assessment to improve public health policies, programs, and practices. Annu Rev Public Health 2010;31:213-233.
13. Stokols D, Hall KL, Taylor BK, Moser RP. The science of team science: Overview of the field and introduction to the supplement. Am J Prev Med 2008;35:S77-S89.
14. Emmons KM, Viswanath K, Colditz GA. The role of transdisciplinary collaboration in translating and disseminating health research: Lessons learned and exemplars of success. Am J Prev Med 2008;35:S204-S210.
15. Pawson R, Tilley N. Realistic evaluation. Thousand Oaks, CA: Sage Publications; 1997.
16. Abrams DB. Applying transdisciplinary research strategies to understanding and eliminating health disparities. Health Educ Behav 2006;33:515-531.
17. Green LW. Making research relevant: If it is an evidence-based practice, where's the practice-based evidence? Fam Pract 2008;25 Suppl 1:i20-i24.
18. Glasgow RE, Magid DJ, Beck A, Ritzwoller D, Estabrooks PA. Practical clinical trials for translating research to practice: Design and measurement recommendations. Med Care 2005;43:551-557; PMID 15908849.
19. Tunis SR, Stryer DB, Clancey CM. Practical clinical trials: Increasing the value of clinical research for decision making in clinical and health policy. JAMA 2003;290:1624-1632; PMID 14506122.
20. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implement Sci 2009;4:50.
21. Ferlie EB, Shortell SM. Improving the quality of health care in the United Kingdom and the United States: A framework for change. Milbank Q 2001;79:281-315.
22. Stetler CB, Legro MW, Wallace CM et al. The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med 2006;21 Suppl 2: S1-S8.
23. Aqil A, Lippeveld T, Hozumi D. PRISM framework: A paradigm shift for designing, strengthening and evaluating routine health information systems. Health Policy Plan 2009;24:217-228.
24. Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf 2008;34:228-243.
25. Gold MR, Patrick DL, Torrance GW et al. Identifying and valuing outcomes. In: Gold MR, Siegel JE, Russell LB, Weinstein MC, eds. Cost-effectiveness in health and medicine. New York: Oxford University Press; 1996;82-123.
26. Glasgow RE, Klesges LM, Dzewaltowski DA, Bull SS, Estabrooks P. The future of health behavior change research: What is needed to improve translation of research into health promotion practice? Ann Behav Med 2004;27:3-12; PMID 14979358.
27. Glasgow RE, Emmons KM. How can we increase translation of research into practice? Types of evidence needed. Ann Rev Public Health 2007;28:413-433.
28. Boome J. QALYS. J Public Econ 1993;50:149-167.
29. Congress of the United States, Congressional Budget Office. Research on the comparative effectiveness of medical treatments: Issues and options for an expanded federal role. Washington, DC: Congressional Budget Office; 2007.
30. Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review: A new method of systematic review designed for complex policy interventions. J Health Serv Res Policy 2005;10:S21-S39.
31. Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: A conceptual framework. Qual Health Care 1998;7:149-158.
32. Harvey G, Loftus-Hills A, Rycroft-Malone J et al. Getting evidence into practice: The role and function of facilitation. J Adv Nurs 2002;37:577-588.
33. McCormack B, Kitson A, Harvey G, Rycroft-Malone J, Titchen A, Seers K. Getting evidence into practice: The meaning of "context." J Adv Nurs 2002;38:94-104.
34. Cummings GG, Hutchinson AM, Scott SD, Norton PG, Estabrooks CA. The relationship between characteristics of context and research utilization in a pediatric setting. BMC Health Serv Res 2010;10:168.
35. Ellis I, Howard P, Larson A, Robertson J. From workshop to work practice: An exploration of context and facilitation in the development of evidence-based practice. Worldviews Evid Based Nurs 2005;2:84-93.
36. Brown D, McCormack B. Developing postoperative pain management: Utilising the promoting action on research implementation in health services (PARIHS) framework. Worldviews Evid Based Nurs 2005;2:131-141.
37. Kitson AL, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: Theoretical and practical challenges. Implement Sci 2008;3:1.
38. Thorpe KE, Zwarenstein M, Oxman AD et al. A pragmatic-explanatory continuum indicator summary (PRECIS): A tool to help trial designers. CMAJ 2009;180: E47-E57.
39. Treeweek S, Zwarenstein M. Making trials matter: Pragmatic and explanatory trials and the problem of applicability. Trials 2009;10:37.
40. McQueen L, Mittman BS, Demakis JG. Overview of the Veterans Health Administration (VHA) Quality Enhancement Research Initiative (QUERI). J Am Med Inform Assoc 2004;11:339-343.
41. Yano EM. The role of organizational research in implementing evidence-based practice: QUERI Series. Implement Sci 2008;3:29.
42. Graham ID, Tetroe J. Learning from the U.S. Department of Veterans Affairs Quality Enhancement Research Initiative: QUERI Series. Implement Sci 2009;4:13.
43. Jha AK, Perlin JB, Kizer KW, Dudley RA. Effect of the transformation of the Veterans Affairs Health Care System on the quality of care. N Engl J Med 2003;348: 2218-2227.
44. Asch SM, McGlynn EA, Hogan MM et al. Comparison of quality of care for patients in the Veterans Health Administration and patients in a national sample. Ann Intern Med 2004;141:938-945.
45. Goetz MB, Bowman C, Hoang T et al. Implementing and evaluating a regional strategy to improve testing rates in VA patients at risk for HIV, utilizing the QUERI process as a guiding framework: QUERI Series. Implement Sci 2008;3:16.
46. Krein SL, Bernstein SJ, Fletcher CE et al. Improving eye care for veterans with diabetes: An example of using the QUERI steps to move from evidence to implementation: QUERI Series. Implement Sci 2008;3:18.
47. Smith JL, Williams JW, Jr., Owen RR, Rubenstein LV, Chaney E. Developing a national dissemination plan for collaborative care for depression: QUERI Series. Implement Sci 2008;3:59.
48. Green LW, Kreuter MW. Health program planning: An educational and ecological approach. New York: McGraw-Hill; 2005.
49. Gielden AC, McDonald EM, Gary TL, Bone RL. Using the Precede-Proceed Model to apply health behavior theories. In: Glanz K, Rimer BK, Viswanath K, eds. Health behavior and health education: Theory, research, and practice. 4th ed. San Francisco, CA: Jossey-Bass; 2008;407-433.
50. Chinman M, Hunter SB, Ebener P et al. The getting to outcomes demonstration and evaluation: An illustration of the prevention support system. Am J Community Psychol 2008;41:206-224.
51. Chinman M, Imm P, Wadersman A. Getting to outcomes 2004: Promoting accountability through methods and tools for planning, implementation, and evaluation. Technical Report. Santa Monica, CA: Rand Corporation; 2004.
52. Minkler M, Wallerstein N, Wilson N. Improving health through community organization and community building. In: Glanz K, Rimer BK, Viswanath K, eds. Health behavior and health education. 4th ed. San Francisco, CA: John Wiley; 2008;287-312.
53. Schensul JJ. Community, culture and sustainability in multilevel dynamic systems intervention science. Am J Community Psychol 2009;43:241-256.
54. Patton MQ. Qualitative research and evaluation methods. 3rd ed. Thousand Oaks, CA: Sage Publications; 2002.
55. Greenwald P, Cullen JW. The new emphasis in cancer control. J Natl Cancer Inst 1985;74:543-551.
56. Flay BR. Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. Prev Med 1986;15:451-474.
57. Glasgow RE. RE-AIMing research for application: Ways to improve evidence for family practice. J Am Board Fam Pract 2006;19:11-19; PMID 16492000.
58. Glasgow RE, Nelson CC, Strycker LA, King DK. Using RE-AIM metrics to evaluate diabetes self-management support interventions. Am J Prev Med 2006;30:67-73; PMID 16414426.
59. Glasgow RE, Klesges LM, Dzewaltowski DA, Estabrooks PA, Vogt TM. Evaluating the overall impact of health promotion programs: Using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ Res 2006;21:688-694; PMID 16945984.
60. Moher D, Schulz KF, Altman DG, for the CONSORT Group. The CONSORT statement: Revised recommendations for improving the quality of reports. JAMA 2001;285:1987-1991.
61. Glasgow RE, McKay HG, Piette JD, Reynolds KD. The RE-AIM framework for evaluating interventions: What can it tell us about approaches to chronic illness management? Patient Educ Couns 2001;44:119-127; PMID 11479052.
62. Glasgow RE. Outcomes of and for diabetes education research. Diabetes Educ 1999;25:74-88.
63. Ory MG, Jordan PJ, Bazzare T. The Behavior Change Consortium: Setting the stage for a new century of health behavior change research. Health Educ Res 2002;17: 500-511.
64. Jilcott S, Ammerman C, Sommers J, Glasgow RE. Applying the RE-AIM framework to assess the public health impact of policy change. Ann Behav Med 2007;34:105-114.
65. Klesges LM, Estabrooks PA, Glasgow RE, Dzewaltowski D. Beginning with the application in mind: Designing and planning health behavior change interventions to enhance dissemination. Ann Behav Med 2005;29:66S-75S; PMID 15921491.
66. Ory MG, Mier N, Sharkey JR, Anderson LA. Translating science into public health practice: Lessons from physical activity interventions. Alzheimers and Dement 2007;Apr;3:S52-S57.
67. Green LA, Cifuentes M, Glasgow RE, Stange KC. Redesigning primary care practice to incorporate health behavior change: Prescription for Health Round 2 results. Am J Prev Med 2008;35:S347-S349.
68. Nutting PA, Beasley JW, Werner JJ. Practice-based research networks answer primary care questions. JAMA 1999;281:686-689.
69. Agency for Health Care Research and Quality. Practice-Based Research Networks. ; accessed 5/25/10.
70. Centers for Disease Control and Prevention. Assuring healthy caregivers, a public health approach to translating research into practice: The RE-AIM framework. Neenah, WI: Kimberly-Clark Corporation; 2008.
71. Kaiser Permanente. Community Health Initiatives. ; accessed 5/15/2010.
72. King DK, Glasgow RE, Toobert DJ et al. Self-efficacy, problem solving, and socialenvironmental support are associated with diabetes self-management behaviors. Diabetes Care 2010;33:751-753.
73. Campbell M, Fitzpatrick R, Haines A et al. Framework for design and evaluation of complex interventions to improve health. Br Med J 2000;321:694-696.
74. Ritzwoller DP, Sukhanova A, Gaglio B, Glasgow RE. Costing behavioral interventions: A practical guide to enhance translation. Ann Behav Med 2009;Apr 37:218-227.
75. Ritzwoller DP, Toobert D, Sukhanova A, Glasgow RE. Economic analysis of the Mediterranean Lifestyle Program for Postmenopausal women with diabetes. Diabetes Educ 2006;32:761-769; PMID 16971709.
76. Glasgow RE, Whitlock EP, Eakin EG, Lichtenstein E. A brief smoking cessation intervention for women in low-income Planned Parenthood Clinics. Am J Public Health 2000;90:786-789.
77. Dzewaltowski D, Glasgow RE, Klesges LM, Estabrooks PA, Brock E. RE-AIM: Evidence based standards and a web resource to improve translation research into practice. Ann Behav Med 2003;Oct;28:75-80.
78. King DK, Glasgow RE, Leeman-Castillo B. RE-AIMing RE-AIM: Using the model tp plan, implement, evaluate, and report the impact of environmental change approaches to enhance population health. Am J Public Health. 2010;100(11):2076-2084.
79. Klesges LM, Dzewaltowski DA, Glasgow RE. Review of external validity reporting in childhood obesity prevention research. Am J Prev Med 2008;34:216-223.
80. Glasgow RE, Gaglio B, Estabrooks PA et al. Long-term results of smoking reduction program. Med Care 2008;47:115-120; PMID 19106739.
81. Glasgow RE, Estabrooks PA, Marcus AC et al. Evaluating initial reach and robustness of a practical randomized trial of smoking reduction. Health Psychol 2008;27: 780-788.
82. Ottoson JM, Hawe P (Editors). Knowledge utilization, diffusion, implementation, transfer, and translation: Implications for evaluation: new directions for evaluation. Hoboken, NJ: Wiley; 2009.
83. National Cancer Institute. Cancer Intervention and Surveillance Modeling Network (CISNET). ; accessed 5/11/10.
84. Stern M, Williams K, Eddy D, Kahn R. Validation of prediction of diabetes by the Archimedes model and comparison with other predicting models. Diabetes Care 2008;31:1670-1671.
85. Lei X, Yuan Y, Yin G. Bayesian phase II adaptive randomization by jointly modeling time-to-event efficacy and binary toxicity. Lifetime Data Anal. 2011;17(1):156-174.
86. U.S.Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research (CDER), Center for Biologics Evaluation and Research (CBER). Guidance for industry: Adaptive design clinical trials for drugs and biologics. February-Clinical/Medical ed. Washington DC: US Dept of Health and Human Services; 2010.
87. Woolf SH, Johnson RE, Fryer GE, Jr., Rust G, Satcher D. The health impact of resolving racial disparities: An analysis of US mortality data. Am J Public Health 2008;98:S26-S28.
88. Institute of Medicine, Committee on Quality of Health Care in America. Crossing the quality chasm: A new health system for the 21st Century. Washington, DC: National Academy Press; 2001.