The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care

Annual Review of Public Health

Volumn 39, Issue , 2018, Pages 55-76

  Shelton, Rachel C ^a   Cooper, Brittany Rhoades ^b   Stirman, Shannon Wiltsey ^c  

^a Columbia University ^*  (United States)

^b WASHINGTON STATE UNIVERSITY   (United States)

^c STANFORD UNIVERSITY   (United States)

Author keywords

adaptation; evidence based interventions; implementation science; maintenance; sustainability

Indexed keywords

ADAPTATION; CAPACITY BUILDING; CLINICAL OUTCOME; COMMUNITY; CONCEPTUAL FRAMEWORK; CONFERENCE PAPER; EMPIRICAL RESEARCH; EVIDENCE BASED PRACTICE; FUTUROLOGY; HEALTH CARE; HEALTH PROGRAM; HUMAN; INTERVENTION STUDY; LOW INCOME COUNTRY; MEASUREMENT; MEDICAL RESEARCH; METHODOLOGY; MIDDLE INCOME COUNTRY; PRIORITY JOURNAL; PROCESS DESIGN; PROGRAM SUSTAINABILITY; PUBLIC HEALTH; PUBLIC HEALTH SERVICE; RISK FACTOR; SOCIAL WORK; STRATEGIC PLANNING; SYSTEMATIC REVIEW (TOPIC); ORGANIZATION AND MANAGEMENT; RESEARCH;

CAPACITY BUILDING; EVIDENCE-BASED PRACTICE; HUMANS; IMPLEMENTATION SCIENCE; PUBLIC HEALTH; PUBLIC HEALTH PRACTICE; RESEARCH;

EID: 85044866850     PISSN: 01637525     EISSN: 15452093     Source Type: Book Series    
DOI: 10.1146/annurev-publhealth-040617-014731     Document Type: Conference Paper

References (150)

1. Aarons GA, Green AE, Trott E, Willging CE, Torres EM, et al. 2016. The roles of system and organizational leadership in system-wide evidence-based intervention sustainment: a mixed-method study. Adm. Policy Mental Health Mental Health Serv. Res. 43:991-1008
2. Aarons GA, Hurlburt M, Horwitz SM. 2011. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm. Policy Mental Health Mental Health Serv. Res. 38:4-23
3. Allen JD, Shelton RC, Emmons KM, Linnan L. 2017. Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination. See Ref. 17, pp. 267-84
4. Amazigo U, Okeibunor J, Matovu V, Zoure H, Bump J, Seketeli A. 2007. Performance of predictors: evaluating sustainability in community-directed treatment projects of the African programme for onchocerciasis control. Soc. Sci. Med. 64:2070-82
5. Ament S, Gillissen F, Moser A, Maessen J, Dirksen CD, et al. 2017. Factors associated with sustainability of 2 quality improvement programs after achieving early implementation success: a qualitative case study. J. Eval. Clin. Pract. 23(6):1135-43
6. Ammerman A, Smith TW, Calancie L. 2014. Practice-based evidence in public health: improving reach, relevance, and results. Annu. Rev. Public Health 35:47-63
7. Barrera M, Berkel C, Castro FG. 2017. Directions for the advancement of culturally adapted preventive interventions: local adaptations, engagement, and sustainability. Prev. Sci. 18(6):640-48
8. Baumann A, Cabassa L, Wiltsey Stirman S. 2017. Adaptation in dissemination and implementation science. See Ref. 17, pp. 285-300
9. Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, et al. 2004. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 23:443-51
10. Berendsen BA, Kremers SP, Savelberg HH, Schaper NC, Hendriks MR. 2015. The implementation and sustainability of a combined lifestyle intervention in primary care: mixed method process evaluation. BMC Fam. Pract. 16:37
11. Bernal G, Sáez-Santiago E. 2006. Culturally centered psychosocial interventions. J. Community Psychol. 34:121-32
12. Blanchet K, Palmer J, Palanchowke R, Boggs D, Jama A, Girois S. 2014. Advancing the application of systems thinking in health: analysing the contextual and social network factors influencing the use of sustainability indicators in a health system-a comparative study in Nepal and Somaliland. Health Res. Policy Syst. 12:46
13. Bond GR, Drake RE, McHugo GJ, Peterson AE, Jones AM, Williams J. 2014. Long-term sustainability of evidence-based practices in community mental health agencies. Adm. Policy Mental Health Mental Health Serv. Res. 41:228-36
14. Bopp M, Saunders RP, Lattimore D. 2013. The tug-of-war: fidelity versus adaptation throughout the health promotion program life cycle. J. Prim. Prev. 34:193-207
15. Bossert TJ. 1990. Can they get along without us? Sustainability of donor-supported health projects in Central America and Africa. Soc. Sci. Med. 30:1015-23
16. Brown CH, Curran G, Palinkas LA, Aarons GA, Wells KB, et al. 2017. An overview of research and evaluation designs for dissemination and implementation. Annu. Rev. Public Health 38:1-22
17. Brownson RC, Colditz GA, Proctor EK, eds. 2017. Dissemination and Implementation Research in Health: Translating Science to Practice. New York: Oxford Univ. Press. 2nd e.d.
18. Buller DB, Walkosz BJ, Andersen PA, Scott MD, Cutter GR. 2015. Sustained use of an occupational sun safety program in a recreation industry: follow-up to a randomized trial on dissemination strategies. Transl. Behav. Med. 5:361-71
19. Calhoun A, Mainor A, Moreland-Russell S, Maier RC, Brossart L, Luke DA. 2014. Using the Program Sustainability Assessment Tool to assess and plan for sustainability. Prev. Chronic Dis. 11:130185
20. Campbell S, Pieters K, Mullen K-A, Reece R, Reid RD. 2011. Examining sustainability in a hospital setting: case of smoking cessation. Implement. Sci. 6:108
21. Carvalho ML, Honeycutt S, Escoffery C, Glanz K, Sabbs D, Kegler MC. 2013. Balancing fidelity and adaptation: implementing evidence-based chronic disease prevention programs. J. Public Health Manag. Pract. 19:348-56
22. Castro FG, Barrera M Jr., Martinez CR Jr. 2004. The cultural adaptation of prevention interventions: resolving tensions between fidelity and fit. Prev. Sci. 5:41-45
23. Chambers DA, Glasgow RE, Stange KC. 2013. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement. Sci. 8:117
24. Chambers DA, Norton WE. 2016. The adaptome: advancing the science of intervention adaptation. Am. J. Prev. Med. 51:S124-31
25. Chaudoir SR, Dugan AG, Barr CH. 2013. Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures. Implement. Sci. 8:22
26. Cook JM, Dinnen S, Thompson R, Simiola V, Schnurr PP. 2014. Changes in implementation of two evidence-based psychotherapies forPTSDinVAresidential treatment programs: a national investigation. J. Trauma. Stress 27:137-43
27. Cooper BR, Bumbarger BK, Moore JE. 2015. Sustaining evidence-based prevention programs: correlates in a large-scale dissemination initiative. Prev. Sci. 16:145-57
28. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. 2012. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med. Care 50:217
29. Curry SJ, Mermelstein RJ, Sporer AK. 2016. Sustainability of community-based youth smoking cessation programs: results from a 3-year follow-up. Health Promot. Pract. 17(6):845-52
30. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. 2009. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement. Sci. 4:50
31. Dearing JW. 2009. Applying diffusion of innovation theory to intervention development. Res. Soc. Work Pract. 19(5):503-18
32. Dearing JW, Kreuter MW. 2010. Designing for diffusion: How can we increase uptake of cancer communication innovations? Patient Educ. Couns. 81:S100-10
33. DoyleC, HoweC, WoodcockT, Myron R, Phekoo K, et al. 2013. Making change last: applying theNHS institute for innovation and improvement sustainability model to healthcare improvement. Implement. Sci. 8:127
34. Durlak JA, DuPre EP. 2008. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am. J. Community Psychol. 41:327-50
35. Estabrooks PA, Smith-Ray RL, Dzewaltowski DA, Dowdy D, Lattimore D, et al. 2011. Sustainability of evidence-based community-based physical activity programs for older adults: lessons from Active for Life. Transl. Behav. Med. 1:208-15
36. Feinberg ME, Bontempo DE, Greenberg MT. 2008. Predictors and level of sustainability of community prevention coalitions. Am. J. Prev. Med. 34:495-501
37. Fleiszer AR, Semenic SE, Ritchie JA, Richer MC, Denis JL. 2015. An organizational perspective on the long-term sustainability of a nursing best practice guidelines program: a case study. BMC Health Serv. Res. 15:535
38. Fleiszer AR, Semenic SE, Ritchie JA, Richer MC, Denis JL. 2016. Nursing unit leaders' influence on the long-term sustainability of evidence-based practice improvements. J. Nurs. Manag. 24(3):309-18
39. Fleiszer AR, Semenic SE, Ritchie JA, Richer MC, Denis JL. 2015. The sustainability of healthcare innovations: a concept analysis. J. Adv. Nurs. 71:1484-98
40. Ford JH II, Krahn D, Wise M, Oliver KA. 2011. Measuring sustainability within the Veterans Administration Mental Health System Redesign Initiative. Q. Manag. Health Care 20:263-79
41. Forehand R, Dorsey S, Jones DJ, Long N, McMahon RJ. 2010. Adherence and flexibility: They can (and do) coexist! Clin. Psychol. Sci. Pract. 17:258-64
42. Francis L, Dunt D, Cadilhac DA. 2016. How is the sustainability of chronic disease health programmes empirically measured in hospital and related healthcare services? A scoping review. BMJ Open 6:e010944
43. Galbraith JS, Stanton B, Boekeloo B, KingW, Desmond S, et al. 2009. Exploring implementation and fidelity of evidence-based behavioral interventions for HIV prevention: lessons learned from the Focus on Kids diffusion case study. Health Educ. Behav. 36:532-49
44. Glanz K, Escoffery C, Elliott T, Nehl EJ. 2015. Randomized trial of two dissemination strategies for a skin cancer prevention program in aquatic settings. Am. J. Public Health 105:1415-23
45. Glasgow RE, Chambers D. 2012. Developing robust, sustainable, implementation systems using rigorous, rapid and relevant science. Clin. Transl. Sci. 5:48-55
46. Glasgow RE, Green LW, Klesges LM, Abrams DB, Fisher EB, et al. 2006. External validity: We need to do more. Ann. Behav. Med. 31:105-8
47. Glasgow RE, Klesges LM, Dzewaltowski DA, Bull SS, Estabrooks P. 2004. The future of health behavior change research:What is needed to improve translation of research into health promotion practice? Ann. Behav. Med. 27:3
48. Glasgow RE, Lichtenstein E, Marcus AC. 2003. Why don't we seemore translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am. J. Public Health 93:1261-67
49. Glasgow RE, Vinson C, Chambers D, Khoury MJ, Kaplan RM, Hunter C. 2012. National Institutes of Health approaches to dissemination and implementation science: current and future directions. Am. J. Public Health 102:1274-81
50. Glasgow RE, Vogt TM, Boles SM. 1999. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am. J. Public Health 89:1322-27
51. Gloppen KM, Brown EC, Wagenaar BH, Hawkins JD, Rhew IC, Oesterle S. 2016. Sustaining adoption of science-based prevention through Communities That Care. J. Community Psychol. 44:78-89
52. Goodman RM, Steckler A. 1989. A model for the institutionalization of health promotion programs. Fam. Community Health 11:63-78
53. GreenLW. 2008. Making research relevant: If it is an evidence-based practice, where's the practice-based evidence? Fam. Pract. 25:i20-24
54. Green LW, Glasgow RE. 2006. Evaluating the relevance, generalization, and applicability of research: issues in external validation and translation methodology. Eval. Health Prof. 29:126-53
55. Green LW, Kreuter MW. 2005. Health Program Planning: An Educational and Ecological Approach. New York: McGraw-Hill C.o.
56. Greenberg MT, FeinbergME, Johnson LE, PerkinsDF, Welsh JA, Spoth RL. 2015. Factors that predict financial sustainability of community coalitions: five years of findings from the PROSPER partnership project. Prev. Sci. 16:158-67
57. Greenhalgh T, Macfarlane F, Barton-Sweeney C, Woodard F. 2012. If we build it, will it stay? A case study of the sustainability of whole-system change in London. Milbank Q. 90:516-47
58. GruenRL, Elliott JH, NolanML, Lawton PD, Parkhill A, et al. 2008. Sustainability science: an integrated approach for health-programme planning. Lancet 372:1579-89
59. Hansen WB, Hill LG, Owens RW. 2013. Component analysis of adherence in a family intervention. Health Educ. 113:264-80
60. Hodge LM, Turner KM. 2016. Sustained implementation of evidence-based programs in disadvantaged communities: a conceptual framework of supporting factors. Am. J. Community Psychol. 58:192-210
61. Hodge LM, Turner KM, Sanders MR, Filus A. 2017. Sustained implementation support scale: validation of a measure of program characteristics and workplace functioning for sustained program implementation. J. Behav. Health Serv. Res. 44(3):442-64
62. Hunter SB, Han B, Slaughter ME, Godley SH, Garner BR. 2015. Associations between implementation characteristics and evidence-based practice sustainment: a study of the Adolescent Community Reinforcement Approach. Implement. Sci. 10:173
63. Iwelunmor J, Blackstone S, Veira D, Nwaozuru U, Airhihenbuwa C, et al. 2016. Toward the sustainability of health interventions implemented in sub-Saharan Africa: a systematic review and conceptual framework. Implement. Sci. 11:43
64. Johnson K, Collins D, Shamblen S, Kenworthy T, Wandersman A. 2017. Long-term sustainability of evidence-based prevention interventions and community coalitions survival: a five and one-half year follow-up study. Prev. Sci. 18(5):610-21
65. Johnson K, Collins D, Wandersman A. 2013. Sustaining innovations in community prevention systems: a data-informed sustainability strategy. J. Community Psychol. 41:322-40
66. Johnson K, Hays C, Center H, Daley C. 2004. Building capacity and sustainable prevention innovations: a sustainability planning model. Eval. Program Plan. 27:135-49
67. Knapp H, Hagedorn H, Anaya HD. 2014. A five-year self-sustainability analysis of nurse-administered HIV rapid testing in Veterans Affairs primary care. Int. J. STD AIDS 25:837-43
68. Kumpfer KL, Alvarado R, Smith P, BellamyN. 2002. Cultural sensitivity and adaptation in family-based prevention interventions. Prev. Sci. 3:241-46
69. Kumpfer KL, Pinyuchon M, de Melo AT, Whiteside HO. 2008. Cultural adaptation process for international dissemination of the Strengthening Families Program. Eval. Health Prof. 31:226-39
70. Leadbeater BJ, Gladstone EJ, Sukhawathanakul P. 2015. Planning for sustainability of an evidence-based mental health promotion program in Canadian elementary schools. Am. J. Community Psychol. 56:120-33
71. Lean M, Leavey G, Killaspy H, Green N, Harrison I, et al. 2015. Barriers to the sustainability of an intervention designed to improve patient engagement within NHS mental health rehabilitation units: a qualitative study nested within a randomised controlled trial. BMC Psychiatry 15:209
72. Leeman J, Calancie L, HartmanMA, Escoffery CT, Herrmann AK, et al. 2015. What strategies are used to build practitioners' capacity to implement community-based interventions and are they effective? A systematic review. Implement. Sci. 10:80
73. Lewis CC, Scott K, Marti CN, Marriott BR, Kroenke K, et al. 2015. Implementing measurementbased care (iMBC) for depression in community mental health: a dynamic cluster randomized trial study protocol. Implement. Sci. 10:127
74. Lewis CC, Stanick CF, Martinez RG, Weiner BJ, Kim M, et al. 2015. The society for implementation research collaboration instrument review project: a methodology to promote rigorous evaluation. Implement. Sci. 10:2
75. Lewis CC, Weiner BJ, Stanick C, Fischer SM. 2015. Advancing implementation science throughmeasure development and evaluation: a study protocol. Implement. Sci. 10:102
76. Luke DA, Calhoun A, Robichaux CB, Elliott MB, Moreland-Russell S. 2014. The Program Sustainability Assessment Tool: a new instrument for public health programs. Prev. Chronic Dis. 11:130184
77. Lyon AR, Koerner K. 2016. User-centered design for psychosocial intervention development and implementation. Clin. Psychol. Sci. Pract. 23:180-200
78. Maher L, Gustafson DH, Evans A. 2010. NHS sustainability model. NHS Inst. Innov. Improv., London. http://www. institute. nhs. uk/sustainability
79. Maher L, Gustafson D, Evans A. 2010. Sustainability Model and Guide. London: NHS Inst. Innov. Improv. http://www. institute. nhs. uk/index. php?option=com-joomcart & main=document- product-info & products-id=291 & cPath=88 (login required)
80. Mancini JA, Marek LI. 2004. Sustaining community-based programs for families: conceptualization and measurement. Fam. Relat. 53:339-47
81. Manning MA, Bollig-Fischer A, Bobovski LB, Lichtenberg P, Chapman R, Albrecht TL. 2014. Modeling the sustainability of community health networks: novel approaches for analyzing collaborative organization partnerships across time. Transl. Behav. Med. 4:46-59
82. Marek LI, Brock D-JP, Sullivan R. 2006. Cultural adaptations to a family life skills program: implementation in rural Appalachia. J. Prim. Prev. 27:113-33
83. Martinez RG, Lewis CC, Weiner BJ. 2014. Instrumentation issues in implementation science. Implement. Sci. 9:118
84. McIntosh K, Mercer SH, Nese RN, Strickland-Cohen MK, Hoselton R. 2016. Predictors of sustained implementation of school-wide positive behavioral interventions and supports. J. Posit. Behav. Interv. 18:209-18
85. Minkler M, Wallerstein N. 2011. Community-Based Participatory Research for Health: From Process to Outcomes. New York: Wiley
86. Moore JE, Bumbarger BK, Cooper BR. 2013. Examining adaptations of evidence-based programs in natural contexts. J. Prim. Prev. 34:147-61
87. Moore JE, Grouchy M, Graham ID, Shandling M, Doyle W, Straus SE. 2016. The Council of Academic Hospitals of Ontario (CAHO) Adopting Research to Improve Care (ARTIC) program: reach, sustainability, spread and lessons learned from an implementation funding model. Healthc. Policy 11:27
88. Moore JE, Mascarenhas A, Bain J, Straus SE. 2017. Developing a comprehensive definition of sustainability. Implement. Sci. 12(1):110
89. Najafizada SAM, Labonté R, Bourgeault IL. 2017. Stakeholder's perspective: sustainability of a community health worker program in Afghanistan. Eval. Program Plan. 60:123-29
90. Nigg C, Geller K, Adams P, Hamada M, Hwang P, Chung R. 2012. Successful dissemination of Fun 5-a physical activity and nutrition program for children. Transl. Behav. Med. 2:276-85
91. Niven DJ, Mrklas KJ, Holodinsky JK, Straus SE, Hemmelgarn BR, et al. 2015. Towards understanding the de-adoption of low-value clinical practices: a scoping review. BMC Med. 13:255
92. O'Loughlin J, Renaud L, Richard L, Gomez LS, Paradis G. 1998. Correlates of the sustainability of community-based heart health promotion interventions. Prev. Med. 27:702-12
93. Pagoto S, Waring ME, May CN, Ding EY, Kunz WH, et al. 2016. Adapting behavioral interventions for social media delivery. J. Med. Internet Res. 18:e24
94. Palinkas L, Cooper B. 2017. Mixed methods evaluation in dissemination and implementation science. See Ref. 17, pp. 335-54
95. Palinkas LA, Chavarin CV, Rafful CM, Um MY, Mendoza DV, et al. 2015. Sustainability of evidencebased practices for HIV prevention among female sex workers in Mexico. PLOS ONE 10:e0141508
96. Perkins DF, Feinberg ME, Greenberg MT, Johnson LE, Chilenski SM, et al. 2011. Team factors that predict to sustainability indicators for community-based prevention teams. Eval. Program Plan. 34:283-91
97. Peters D, Tran N, Adam T. 2013. Implementation Research in Health: A Practical Guide. Geneva: WHO Press
98. Peterson AE, Bond GR, Drake RE, McHugo GJ, Jones AM, Williams JR. 2014. Predicting the longterm sustainability of evidence-based practices in mental health care: an 8-year longitudinal analysis. J. Behav. Health Serv. Res. 41:337-46
99. Pluye P, Potvin L, Denis J-L. 2004. Making public health programs last: conceptualizing sustainability. Eval. Program Plan. 27:121-33
100. Pluye P, Potvin L, Denis J-L, Pelletier J. 2004. Program sustainability: focus on organizational routines. Health Promot. Int. 19:489-500
101. Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, et al. 2017. Methods to improve the selection and tailoring of implementation strategies. J. Behav. Health Serv. Res. 44(2):177-94
102. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, et al. 2015. A refined compilation of implementation strategies: results from the Expert Recommendations for ImplementingChange (ERIC) project. Implement. Sci. 10:21
103. Proctor E, Luke D, Calhoun A, McMillen C, Brownson R, et al. 2015. Sustainability of evidence-based healthcare: research agenda, methodological advances, and infrastructure support. Implement. Sci. 10:88
104. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, et al. 2011. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm. Policy Mental Health Mental Health Serv. Res. 38:65-76
105. Rabin BA, Brownson RC, Haire-JoshuD, Kreuter MW, Weaver NL. 2008. A glossary for dissemination and implementation research in health. J. Public Health Manag. Pract. 14:117-23
106. Rabin BA, Lewis CC, Norton WE, Neta G, Chambers D, et al. 2016. Measurement resources for dissemination and implementation research in health. Implement. Sci. 11:42
107. Racine DP. 2006. Reliable effectiveness: a theory on sustaining and replicating worthwhile innovations. Adm. Policy Mental Health Mental Health Serv. Res. 33:356-87
108. Rhoades BL, Bumbarger BK, Moore JE. 2012. The role of a state-level prevention support system in promoting high-quality implementation and sustainability of evidence-based programs. Am. J. Community Psychol. 50:386-401
109. Richardson WC, Berwick DM, Bisgard J, Bristow L, Buck C, Cassel C. 2001. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: Natl. Acad. Press
110. Rogers EM. 1995. Diffusion of Innovations. New York: Free Press
111. Sarriot E, Morrow M, Langston A, Weiss J, Landegger J, Tsuma L. 2015. A causal loop analysis of the sustainability of integrated community case management in Rwanda. Soc. Sci. Med. 131:147-55
112. Sarriot EG, Winch PJ, Ryan LJ, Bowie J, Kouletio M, et al. 2004. A methodological approach and framework for sustainability assessment in NGO-implemented primary health care programs. Int. J. Health Plan. Manag. 19:23-41
113. Saunders RP, Pate RR, Dowda M, Ward DS, Epping J, Dishman RK. 2012. Assessing sustainability of Lifestyle Education for Activity Program (LEAP). Health Educ. Res. 27:319-30
114. Savaya R, Spiro S, Elran-Barak R. 2008. Sustainability of social programs: a comparative case study analysis. Am. J. Eval. 29:478-93
115. Scheirer MA. 1990. The life cycle of an innovation: adoption versus discontinuation of the fluoride mouth rinse program in schools. J. Health Soc. Behav. 31(2):203-15
116. Scheirer MA. 2005. Is sustainability possible? A review and commentary on empirical studies of program sustainability. Am. J. Eval. 26:320-47
117. Scheirer MA. 2013. Linking sustainability research to intervention types. Am. J. PublicHealth 103:e73-80
118. Scheirer MA, Dearing JW. 2011. An agenda for research on the sustainability of public health programs. Am. J. Public Health 101:2059-67
119. Scheirer MA, Hartling G, Hagerman D. 2008. Defining sustainability outcomes of health programs: illustrations from an on-line survey. Eval. Program Plan. 31:335-46
120. Scheirer MA, Santos SLZ, Tagai EK, Bowie J, Slade J, et al. 2017. Dimensions of sustainability for a health communication intervention in African American churches: a multi-methods study. Implement. Sci. 12:43
121. Schell SF, Luke DA, SchooleyMW, Elliott MB, Herbers SH, et al. 2013. Public health program capacity for sustainability: a new framework. Implement. Sci. 8:15
122. Shediac-Rizkallah MC, Bone LR. 1998. Planning for the sustainability of community-based health programs: conceptual frameworks and future directions for research, practice and policy. Health Educ. Res. 13:87-108
123. Shelton RC, Charles T-A, Dunston SK, Jandorf L, Erwin DO. 2017. Advancing understanding of the sustainability of lay health advisor (LHA) programs for African-American women in community settings. Transl. Behav. Med. 7(3):415-26
124. Shelton RC, Dunston SK, Leoce N, Jandorf L, Thompson HS, et al. 2016. Predictors of activity level and retention among African American lay health advisors (LHAs) from the NationalWitness Project: implications for the implementation and sustainability of community-based LHA programs from a longitudinal study. Implement. Sci. 11:41
125. SinghM, Gmyrek A, Hernandez A, DamonD, Hayashi S. 2017. Sustaining Screening, Brief Intervention and Referral to Treatment (SBIRT) services in health-care settings. Addiction 112:92-100
126. Slaghuis SS, Strating MM, Bal RA, Nieboer AP. 2011. A framework and a measurement instrument for sustainability of work practices in long-term care. BMC Health Serv. Res. 11:314
127. Spoth R, Guyll M, Redmond C, Greenberg M, Feinberg M. 2011. Six-year sustainability of evidencebased intervention implementation quality by community-university partnerships: the PROSPER study. Am. J. Community Psychol. 48:412-25
128. Stanton B, Guo J, Cottrell L, Galbraith J, Li X, et al. 2005. The complex business of adapting effective interventions to new populations: an urban to rural transfer. J. Adolesc. Health 37:163
129. Steckler A, Goodman RM. 1989. How to institutionalize health promotion programs. Am. J. Health Promot. 3:34-43
130. Steckler A, Goodman RM, McLeroy KR, Davis S, Koch G. 1992. Measuring the diffusion of innovative health promotion programs. Am. J. Health Promot. 6:214-24
131. Stetler CB, Ritchie JA, Rycroft-Malone J, Schultz AA, Charns MP. 2009. Institutionalizing evidencebased practice: an organizational case study using a model of strategic change. Implement. Sci. 4:78
132. Stirman SW, Dearing JW. 2018. Sustainability of cancer interventions. In Optimizing the Cancer Control Continuum: Advancing Implementation Research, ed. D Chambers, C Vinson, W Norton. New York: Oxford Univ. Press. In press
133. Stirman SW, Finley EP, Shields N, Cook J, Haine-Schlagel R, et al. 2017. Improving and sustaining delivery of CPT for PTSD in mental health systems: a cluster randomized trial. Implement. Sci. 12:32
134. Stirman SW, Gutner C, Crits-Christoph P, Edmunds J, Evans AC, Beidas RS. 2015. Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy. Implement. Sci. 10:115
135. Stirman SW, Kimberly J, Cook N, Calloway A, Castro F, Charns M. 2012. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement. Sci. 7:17
136. Stirman SW, Matza A, Gamarra J, Toder K, Xhezo R, et al. 2015. System-level influences on the sustainability of a cognitive therapy program in a community behavioral health network. Psychiatr. Serv. 66:734-42
137. Stirman SW, Miller CJ, Toder K, Calloway A. 2013. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement. Sci. 8:65
138. Stoll S, JanevicM, LaraM, Ramos-Valencia G, Stephens TB, et al. 2015. Peer reviewed: a mixed-method application of the Program Sustainability Assessment Tool to evaluate the sustainability of 4 pediatric asthma care coordination programs. Prev. Chronic Dis. 12:E214
139. Swain K, Whitley R, McHugo GJ, Drake RE. 2010. The sustainability of evidence-based practices in routine mental health agencies. Community Mental Health J. 46:119-29
140. Swerissen H, Crisp BR. 2004. The sustainability of health promotion interventions for different levels of social organization. Health Promot. Int. 19:123-30
141. Tabak RG, Duggan K, Smith C, Aisaka K, Moreland-Russell S, Brownson RC. 2016. Assessing capacity for sustainability of effective programs and policies in local health departments. J. Public Health Manag. Pract. 22(2):129-37
142. Tricco AC, Cogo E, Ashoor H, Perrier L, McKibbon KA, et al. 2013. Sustainability of knowledge translation interventions in healthcare decision-making: protocol for a scoping review. BMJ Open 3:e002970
143. Vamos S, Mumbi M, Cook R, Chitalu N, Weiss SM, Jones DL. 2014. Translation and sustainability of an HIV prevention intervention in Lusaka, Zambia. Transl. Behav. Med. 4:141-48
144. Van Acker R, De Bourdeaudhuij I, De CockerK, Klesges LM, Willem A, Cardon G. 2012. Sustainability of the whole-community project 10, 000 Steps: a longitudinal study. BMC Public Health 12:155
145. Welsh JA, Chilenski SM, Johnson L, Greenberg MT, Spoth RL. 2016. Pathways to sustainability: 8-year follow-up from the PROSPER project. J. Prim. Prev. 37:263-86
146. Woodbridge MW, SumiWC, Yu J, Rouspil K, Javitz HS, et al. 2014. Implementation and sustainability of an evidence-based program: lessons learned from the PRISM applied to First Step to Success. J. Emot. Behav. Disord. 22:95-106
147. Wright DB. 2009. Care in the country: a historical case study of long-term sustainability in 4 rural health centers. Am. J. Public Health 99:1612-18
148. Yancey AK, Ortega AN, Kumanyika SK. 2006. Effective recruitment and retention of minority research participants. Annu. Rev. Public Health 27:1-28
149. Yin RK. 1981. Life histories of innovations: how new practices become routinized. Public Adm. Rev. 41(1):21-28
150. Zakumumpa H, Bennett S, Ssengooba F. 2017. Modifications to ART service delivery models by health facilities in Uganda in promotion of intervention sustainability: a mixed methods study. Implement. Sci. 12:45