Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination

Dissemination and Implementation Research in Health: Translating Science to Practice, Second Edition

Volumn , Issue , 2017, Pages 267-284

  Allen, Jennifer D ^a   Shelton, Rachel C ^b   Emmons, Karen M ^c   Linnan, Laura A ^d  

^a TUFTS UNIVERSITY   (United States)

^b Department of Medicine   (United States)

^c HARVARD SCHOOL OF PUBLIC HEALTH   (United States)

^d University of North Carolina at Chapel Hill   (United States)

Author keywords

Adaptation; Designing for dissemination; Fidelity; Implementation fidelity; Research design

Indexed keywords

EID: 85044849958     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1093/oso/9780190683214.003.0016     Document Type: Chapter

References (102)

1. Linnan L, Steckler A. Process evaluation for public health interventions and research. San Francisco: Jossey-Bass; 2002.
2. Haynes A, Brennan S, Redman S, et al. Figuring out fidelity: a worked example of the methods used to identify, critique and revise the essential elements of a contextualised intervention in health policy agencies. Implement Sci. 2016;11:23.
3. Dobson KS, Singer AR. Definitional and practical issues in the assessment of treatment integrity. Clin Psychol-Sci Pr. 2005;12(4):384-387.
4. Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2:40.
5. Durlak JA, DuPre EP Implementation matters: a review of research on the influence of implementation on program outcomes and the factorsaffecting implementation. Am J Commun Psychol. 2008;41(3-4):327.
6. Eames C, Daley D, Hutchings J, et al. The Leader Observation Tool: a process skills treatment fidelity measure for the Incredible Years parenting programme. Child Care Health Dev. 2008;34(3):391-400.
7. Johnson-Kozlow M, Hovell MF, Rovniak LS, Sirikulvadhana L, Wahlgren DR, Zakarian JM. Fidelity issues in secondhand smoking interventions for children. Nicotine Tob Res. 2008;10(12):1677-1690.
8. National Institutes of Health. Reproducibility standards. (12/15/14). https://www.nih.gov/research-training/rigor-reproducibility/principles- guidelines-reporting-preclinical-research.
9. Collins FS, Tabak LA. Policy: NIH plans to enhance reproducibility. Nature. 2014;505(7485):612-613.
10. Bauman LJ, Stein RE, Ireys HT. Reinventing fidelity: the transfer of social technology among settings. Am J Commun Psychol. 1991;19(4):619-639.
11. Blakely CH, Mayer JP, Gottschalk RG, et al. The fidelity adaptation debate-tmplications for the implementation of public-sector social programs. Am J Commun Psychol. 1987;15(3):253-268.
12. Dane AV, Schneider BH. Program integrity in primary and early secondary prevention: are implementation effects out of control? Clin Psychol Rev. 1998;18(1):23-45.
13. Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18(2):237-256.
14. Lichstein KL, Riedel BW, Grieve R. Fair tests of clinical trials: a treatment implementation model. Adv Behav Res tter. 1994;16(1):1-29.
15. Moncher FJ, Prinz RJ. Treatment fidelity in outcome studies. Clin Psychol Rev. 1991;11(3):247-266.
16. Bellg AJ, Borrelli B, Resnick B, et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004;23(5):443-451.
17. Bopp M, Saunders RP, Lattimore D. The tug-of- war: fidelity versus adaptation throughout the health promotion program life cycle. J Prim Prev. 2013;34(3):193-207.
18. Breitenstein SM, Gross D, Garvey CA, Hill C, Fogg L, Resnick B. Implementation fidelity in community-based interventions. Res Nurs Health. 2010;33(2):164-173.
19. Perez D, Van der Stuyft P, Zabala MC, Castro M, Lefevre P. A modified theoretical framework to assess implementation fidelity of adaptive public health interventions. Implement Sci. 2016;11(1):91.
20. Resnick B, Bellg AJ, Borrelli B, et al. Examples of implementation and evaluation of treatment fidelity in the BCC studies: where we are and where we need to go. Ann Behav Med. 2005;29 Suppl:46-54.
21. Byrnes HF, Miller BA, Aalborg AE, Plasencia AV, Keagy CD. Implementation fidelity in adolescent family-based prevention programs: relationship to family engagement. Health Educ Res. 2010;25(4):531-541.
22. Gingiss PM, Roberts-Gray C, Boerm M. Bridge- It: A system for predicting implementation fidelity for school-based tobacco prevention programs. Prev Sci. 2006;7(2): 197-207.
23. Mihalic S. tte importance of implementation fidelity. Emot Behav Disord Youth. 2004;4(4):83-105.
24. Rohrbach LA, Gunning M, Sun P, Sussman S. The project towards no drug abuse (TND) dissemination trial: implementation fidelity and immediate outcomes. Prev Science. 2010;11(1):77-88.
25. Cohen DJ, Crabtree BF, Etz RS, et al. Fidelity versus flexibility: translating evidence-based research into practice. Am J Prev Med. 2008;35(5 Suppl):S381-S389.
26. Eames C, Daley D, Hutchings J, et al. The Leader Observation Tool: a process skills treatment fidelity measure for the Incredible Years parenting programme. Child Care Hlth Dev. 2008;34(3):391-400.
27. Hogue A, Henderson CE, Dauber S, Barajas PC, Fried A, Liddle HA. Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems. J Consult Clin Psychol. 2008;76(4):544.
28. Spillane V, Byrne MC, Byrne M, Leathem CS, O'Malley M, Cupples ME. Monitoring treatment fidelity in a randomized controlled trial of a complex intervention. J Adv Nurs. 2007;60(3):343-352.
29. DiGennaro FD, Martens BK, McIntyre LL. Increasing treatment integrity through negative reinforcement: effects on teacher and student behavior. School Psychol Rev. 2005;34(2):220.
30. Burns MK, Peters R, Noell GH. Using performance feedback to enhance implementation fidelity of the problem- tolving team process. J Sch Psychol. 2008;46(5):537-550.
31. Carvalho ML, Honeycutt S, Escoffery C, Glanz K, Sabbs D, Kegler MC. Balancing fidelity and adaptation: implementing evidence-based chronic disease prevention programs. J Public Health Manag Pract. 2013;19(4):348-356.
32. Moore JE, Bumbarger BK, Cooper BR. Examining adaptations of evidence-based programs in natural contexts. J Prim Prev. 2013;34(3):147-161.
33. Castro FG, Barrera M, Martinez CR. The cultural adaptation of prevention interventions: resolving tensions between fidelity and fit. Prev Sci. 2004;5(1):41-45.
34. Cohen DJ, Crabtree BF, Etz RS, et al. Fidelity versus flexibility: translating evidence- based research into practice. Am J Prev Med. 2008;35(5):S381-S389.
35. Morrison DM, Hoppe MJ, Gillmore MR, Kluver C, Higa D, Wells EA. Replicating an intervention: the tension between fidelity and adaptation. Aids Educ Prev. 2009;21(2):128-140.
36. Allen JD, Linnan LA, Emmons KM. Fidelity and adaptation of evidence-based intervention in public health. In: Brownson RC, Colditz, GA, Proctor EK, eds. Dissemination and implementation research in health: Translating science to practice. New York: Oxford University Press; 2012.
37. Slaughter SE, Hill JN, Snelgrove-Clarke E. What is the extent and quality of documentation and reporting of fidelity to implementation strategies: a scoping review. Implement Sci. 2015;10:129.
38. Glasgow RE. What types of evidence are most needed to advance behavioral medicine? Ann Behav Med. 2008;35(1):19-25.
39. Glasgow RE, Klesges LM, Dzewaltowski DA, Bull SS, Estabrooks P. The future of health behavior change research: what is needed to improve translation of research into health promotion practice? Ann Behav Med. 2004;27(1):3-12.
40. Kerner J, Rimer B, Emmons K. Introduction to the special section on dissemination: dissemination research and research dissemination: how can we close the gap? Health Psychol. 2005;24(5):443.
41. Cabassa LJ, Gomes AP, Meyreles Q, et al. Using the collaborative intervention planning framework to adapt a health-care manager intervention to a new population and provider group to improve the health of people with serious mental illness. Implement Sci. 2014;9:178.
42. Minkler M, Wallerstein N. Community-based participatory research for health: From process to outcomes. San Francisco: Jossey-Bass; 2011.
43. Brownson RC, Fielding JE, Maylahn CM. Evidence-based public health: a fundamental concept for public health practice. Annu Rev Public Health. 2009;30:175-201.
44. Horn SD, Gassaway J. Practice-based evidence study design for comparative effectiveness research. Med Care. 2007;45(10 Supl 2):S50-S57.
45. Linnan L, Thompson, B., & Kobetz, E. Process evaluation results from the Working Well Trial. In: Steckler, A. and Linnan, L, eds. Process evaluation in public health interventions and research. San Francisco: Jossey Bass, Inc. 2002:155-183.
46. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581-629.
47. Davis M, Baranowski T, Hughes M, Warnecke C, De Moor C, Mullis R. Using children as change agents to increase fruit and vegetable consumption among lower-income African American parents. Process Eval Public Health Intervent Res. 2002:249-267.
48. Rogers EF. Nature with water and the Spirit: a response to Rowan Williams. Scot J Theology. 2003;56(1):89-100.
49. Research Tested Intervention Programs. https:// rtips.cancer.gov/rtips/index.do. Accessed 12/5/2016.
50. Grover V. Commentary: Implementing interventions: building a shared understanding of why. New Dir Child Adolesc Dev. 2016;2016(154): 109-112.
51. Fagan AA, Arthur MW, Hanson K, Briney JS, Hawkins JD. Effects of Communities That Care on the adoption and implementation fidelity of evidence-based prevention programs in communities: results from a randomized controlled trial. Prev Sci. 2011;12(3):223-234.
52. Dariotis JK, Bumbarger BK, Duncan LG, Greenberg MT. How do implementation efforts relate to program adherence? Examining the role of organizational, implementer, and program factors. J Community Psychol. 2008;36(6):744-760.
53. Weiner BJ. A theory of organizational readiness for change. Implement Sci. 2009;4:67.
54. Kumanyika SK, Yancey AK. Physical activity and health equity: evolving the science. Am J Health Promot. 2009;23(6):S4-S7.
55. Backer. TE. Finding the balance: Programfidelity and adaptation in substance abuse prevention: A state- of-the-art review. Rockville, MD: Center for Substance Abuse Prevention; 2001.
56. Lee CY, August GJ, Realmuto GM, Horowitz JL, Bloomquist ML, Klimes-Dougan B. Fidelity at a distance: assessing implementation fidelity of the Early Risers prevention program in a going-to-scale intervention trial. Prev Sci. 2008;9(3):215-229.
57. Fixsen DL, Naoom SF, Blase KA, Friedman M, Wallace F. Implementation Research: A Synthesis of the Literature. 2005;http://nirn.fpg.unc.edu/sites/nirn.fpg.unc.edu/files/resources/NIRN- MonographFull-01-2005.pdf.
58. Keith RE, Hopp FP, Subramanian U, Wiitala W, Lowery JC. Fidelity of implementation: development and testing of a measure. Implement Sci. 2010;5:99.
59. Nelson MC, Cordray DS, Hulleman CS, Darrow CL, Sommer EC. A procedure for assessing intervention fidelity in experiments testing educational and behavioral interventions. J Behav Health Ser R. 2012;39(4):374-396.
60. Teague GB, Mueser KT, Rapp CA. Advances in fidelity measurement for mental health services research: four measures. Psychiat Serv. 2012;63(8):765-771.
61. Baer JS, Ball SA, Campbell BK, Miele GM, Schoener EP, Tracy K. Training and fidelity monitoring of behavioral interventions in multisite addictions research. Drug Alcohol Depend. 2007;87(2-3):107-118.
62. Berkel C, Mauricio AM, Schoenfelder E, Sandler IN. Putting the pieces together: an integrated model of program implementation. Prev Sci. 2011;12(1):23-33.
63. Lobb R, Gonzalez Suarez E, Fay ME, et al. Implementation of a cancer prevention program for working class, multiethnic populations. Prev Med. 2004;38(6):766-776.
64. Elliott DS, Mihalic S. Issues in disseminating and replicating effective prevention programs. Prev Sci. 2004;5(1):47-53.
65. Balu R, Doolittle F. Commentary: Learning from variations in fidelity ofimplementation. New Direct Child Adolesc Dev. 2016;2016(154):105-108.
66. Castro FG, Barrera M, Jr., Martinez CR, Jr. The cultural adaptation of prevention interventions: resolving tensions between fidelity and fit. Prev Sci. 2004;5(1):41-45.
67. Wiltsey Stirman S, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7:17.
68. Durlak JA. Why program implementation is important. J Prevent Intervent Community. 1998;17(2):5-18.
69. Hallfors D, Godette D. Will the 'principles of effectiveness' improve prevention practice? Early findings from a diffusion study. Health Educ Res. 2002;17(4):461-470.
70. Botvin GJ. Advancing prevention science and practice: challenges, critical issues, and future directions. Prev Sci. 2004;5(1):69-72.
71. Ennett ST, Haws S, Ringwalt CL, et al. Evidence-based practice in school substance use prevention: fidelity of implementation under real-world conditions. Health Educ Res. 2011;26(2):361-371.
72. Hill LG, Maucione K, Hood BK. A focused approach to assessing program fidelity. Prev Sci. 2007;8(1):25-34.
73. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8:117.
74. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38(1):4-23.
75. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Science. 2009;4:50.
76. Lara M, Bryant-Stephens T, Damitz M, et al. Balancing "fidelity" and community context in the adaptation of asthma evidence-based interventions in the "real world." Health Promotion Practice. 2011;12(6_suppl_1):63S-72S.
77. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Hlth. 2011;38(1):4-23.
78. Green AE, Aarons GA. A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping. Implementation Science. 2011;6:104.
79. Bernal G, Saez-Santiago E. Culturally centered psychosocial interventions. J Community Psychol. 2006;34(2):121-132.
80. Cabassa LJ, Baumann AA. A two-way street: bridging implementation science and cultural adaptations of mental health treatments. Implement Sci. 2013;8:90.
81. Kumpfer KL, Pinyuchon M, de Melo AT, Whiteside HO. Cultural adaptation process for international dissemination of the Strengthening Families Program. Eval Health Prof. 2008;31(2):226-239.
82. Marek LI, Brock DJ, Sullivan R. Cultural adaptations to a family life skills program: implementation in rural appalachia. J Prim Prev. 2006;27(2):113-133.
83. McGraw SA, Sellers DE, Stone EJ, et al. Using process data to explain outcomes. An illustration from the Child and Adolescent Trial for Cardiovascular Health (CATCH). Eval Rev. 1996;20(3):291-312.
84. Scheirer MA, Dearing JW. An agenda for research on the sustainability of public health programs. Am J Public Health. 2011;101(11):2059-2067.
85. Shediac-Rizkallah MC, Bone LR. Planning for the sustainability of community-based health programs: conceptual frameworks and future directions for research, practice and policy. Health Educ Res. 1998; 13(1):87-108.
86. Galovski TE, Blain LM, Mott JM, Elwood L, Houle T. Manualized therapy for PTSD: flexing the structure of cognitive processing therapy. J Consult Clin Psychol. 2012;80(6):968-981.
87. Kalichman SC, Kelly JA, Hunter TL, Murphy DA, Tyler R. Culturally tailored HIV-AIDS risk-reduction messages targeted to African- American urban women: impact on risk sensitization and risk reduction. J Consult Clin Psychol. 1993;61(2):291-295.
88. Kennedy MG, Mizuno Y, Hoffman R, Baume C, Strand J. The effect of tailoring a model HIV prevention program for local adolescent target audiences. AIDS Educ Prev. 2000;12(3):225-238.
89. Levitt JT, Malta LS, Martin A, Davis L, Cloitre M. The flexible application of a manualized treatment for PTSD symptoms and functional impairment related to the 9/11 World Trade Center attack. Behav Res Ther. 2007;45(7):1419-1433.
90. Stanton B, Guo J, Cottrell L, et al. The complex business of adapting effective interventions to new populations: an urban to rural transfer. J Adolesc Health. 2005;37(2):163.
91. Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence- based interventions. Implementation Science. 2013;8(1):65.
92. Chambers DA, Norton WE. The adaptome advancing the science of intervention adaptation. Am J Prev Med. 2016;51(4):S124-S131.
93. Wingood GM, DiClemente RJ. The Adapt-Itt model: A novel method of adapting evidence- based HIV interventions. J Acquir Immune Defic Syndr. 2008;47:S40-S46.
94. Escoffery C. A Scoping Study of Program Adaptation Frameworks for Evidence-Based Interventions. 9th Annual Conference on the Science of Dissemination and Implementation; Dec. 14, 2016.
95. Linnan LA, Ferguson YO. Beauty salons: a promising health promotion setting for reaching and promoting health among African American women. Health Educ Behav. 2007;34(3):517-530.
96. Linnan LA, Reiter PL, Duffy C, Hales D, Ward DS, Viera AJ. Assessing and promoting physical activity in African American barbershops: results of the FITStop pilot study. Am J Mens Health. 2011;5(1):38-46.
97. Linnan LA, Ferguson YO, Wasilewski Y, et al. Using community-based participatory research methods to reach women with health messages: results from the North Carolina BEAUTY and Health Pilot Project. Health Promot Pract. 2005;6(2):164-173.
98. National Cancer Institute (2002). Making health communication programs work. U.S. Department of Health and Human Services. Accessed on 5/16/16 from https://www.cancer.gov/publications/health-communication/pink-book.pdf
99. Solomon FM, Linnan LA, Wasilewski Y, Lee AM, Katz ML, Yang J. Observational study in ten beauty salons: results informing development of the North Carolina BEAUTY and Health Project. Health Educ Behav. 2004;31(6):790-807.
100. Emmons K, Colditz, GA. Realizing the potential of cancer prevention-the role of implementation science. N Engl J Med. 2017:376:986-990.
101. Balu R, Doolittle F. Commentary: Learning from variations in fidelity of implementation. New Dir Child Adolesc Dev. 2016;2016(154):105-108.
102. Zwarenstein M, Treweek S, Gagnier JJ, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008;337:a2390.