Measuring sustainment of prevention programs and initiatives: A study protocol

Implementation Science

Volumn 11, Issue 1, 2016, Pages

  Palinkas, Lawrence A ^a   Spear, Suzanne E ^b   Mendon, Sapna J ^a   Villamar, Juan ^c   Valente, Thomas ^d   Chou, Chi Ping ^d   Landsverk, John ^e   Kellam, Shepperd G ^f   Brown, C Hendricks ^c  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b CALIFORNIA STATE UNIVERSITY   (United States)

^c NORTHWESTERN UNIVERSITY   (United States)

^d UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^e OREGON SOCIAL LEARNING CENTER   (United States)

^f JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

Author keywords

Implementation; Instruments; Measures; Prevention; Substance use; Suicide; Sustainment

Indexed keywords

ADOLESCENT; GOVERNMENT; HEALTH CARE PLANNING; HUMAN; PREVENTION AND CONTROL; PROCEDURES; PROGRAM EVALUATION; SUBSTANCE-RELATED DISORDERS; SUICIDE; UNDERAGE DRINKING; UNITED STATES; VIOLENCE;

ADOLESCENT; HEALTH PLAN IMPLEMENTATION; HUMANS; PROGRAM EVALUATION; SUBSTANCE-RELATED DISORDERS; SUICIDE; UNDERAGE DRINKING; UNITED STATES; UNITED STATES SUBSTANCE ABUSE AND MENTAL HEALTH SERVICES ADMINISTRATION; VIOLENCE;

EID: 84978216514     PISSN: None     EISSN: 17485908     Source Type: Journal    
DOI: 10.1186/s13012-016-0467-6     Document Type: Article

References (61)

1. Johnston LD, O'Malley PM, Bachman JG, Schulenberg JE. Monitoring the future national results on drug use: 2012 overview, key findings on adolescent drug use. Ann Arbor: Institute for Social Research, University of Michigan; 2013.
2. National Institute on Drug Abuse. Principles of drug abuse treatment: a research based guide, Third Edition. USDHHS/NIH Publication No. 12-4180; 2012.
3. Patrick ME, O'Malley PM, Johnston LD, Terry-McElrath YM, Schulenberg JE. HIV/AIDS risk behaviors and substance use by young adults in the United States. Prev Sci. 2012;13(5):532-8.
4. Centers for Disease Control and Prevention [Internet]. Atlanta: National Center for Injury Prevention and Control; 2016. Web-based injury statistics query and reporting system (WISQARS). [Cited 2016 June 9] Available from: https://www.cdc.gov/injury/wisqars/.
5. Nock MK, Green JG, Hwang I, McLaughlin KA, Sampson NA, Zaslavsky AM, et al. Prevalence, correlates, and treatment of lifetime suicidal behavior among adolescents: results from the National Comorbidity Survey Replication Adolescent Supplement. JAMA Psychiatry. 2013;70(3):300-10.
6. Kessler RC, Borges G, Walters EE. Prevalence of and risk factors for lifetime suicide attempts in the National Comorbidity Survey. Arch Gen Psychiatry. 1999;56:617-26.
7. Goldston DB, Daniel SS, Erkanli A, Reboussin BA, Mayfield A, Frazier PH, et al. Psychiatric diagnoses as contemporaneous risk factors for suicide attempts among adolescents and young adults: developmental changes. J Consult Clin Psychol. 2009;77(2):281-90.
8. Goldston DB, Walrath CM, McKeon R, Puddy RW, Lubell KM, Potter LB, et al. The Garrett Lee Smith suicide prevention program. Suicide Life Threat Behav. 2010;40(3):245-56.
9. O'Connell ME, Boat T, Warner KE. Preventing mental, emotional and behavioral disorders among young people: progress and possibilities. Washington, DC: National Academies Press; 2009.
10. Kellam SG, Brown CH, Poduska JM, Ialongo NS, Wang W, Toyinbo P, et al. Effects of a universal classroom behavior management program in first and second grades on young adult behavioral, psychiatric, and social outcomes. Drug Alcohol Depend. 2008;95 Suppl 1:S5-S28.
11. Petras H, Kellam SG, Brown CH, Muthén BO, Ialongo NS, Poduska JM. Developmental epidemiological courses leading to antisocial personality disorder and violent and criminal behavior: effects by young adulthood of a universal preventive intervention in first- and second-grade classrooms. Drug Alcohol Depend. 2008;95 Suppl 1:S45-59.
12. Wilcox HC, Kellam SG, Brown CH, Poduska JM, Ialongo NS, Wang W, et al. The impact of two universal randomized first- and second-grade classroom interventions on young adult suicide ideation and attempts. Drug Alcohol Depend. 2008;95 Suppl 1:S60-73.
13. Kellam SG, Wang W, Mackenzie AC, Brown CH, Ompad DC, Or F, et al. The impact of the Good Behavior Game, a universal classroom-based preventive intervention in first and second grades, on high-risk sexual behaviors and drug abuse and dependence disorders into young adulthood. Prev Sci. 2014;15 Suppl 1:S6-18. doi: 10.1007/s11121-012-0296-z.
14. Kellam SG, Mackenzie AC, Brown CH, Poduska JM, Wang W, Petras H, et al. The good behavior game and the future of prevention and treatment. Addict Sci Clin Pract. 2011;6(1):73-84.
15. Poduska J, Kellam S, Brown CH, Ford C, Windham A, Keegan N, et al. Study protocol for a group randomized controlled trial of a classroom-based intervention aimed at preventing early risk factors for drug abuse: integrating effectiveness and implementation research. Implement Sci. 2009;4:56.
16. Brown CH, Wyman PA, Brinales JM, Gibbons RD. The role of randomized trials in testing interventions for the prevention of youth suicide. Int Rev Psychiatry. 2007;19(6):617-31. PMID: 18092240.
17. Spoth R, Rohrbach LA, Greenberg M, Leaf P, Brown CH, Fagan A, et al. Addressing challenges for the next generation of type 2 translation research: the translation science to population impact (TSci2PI) framework. Prev Sci. 2013;14(4):319-51. doi: 10.1007/s11121-012-0362-6.
18. Damschroeder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.
19. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38:4-23.
20. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581-629.
21. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8:117. doi: 10.1186/1748-5908-8-117.
22. Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009;36(1):24-34.
23. Benz J, Infante A, Oppenheimer C, Scherer H, Wilson W. Developing a conceptual framework to assess the sustainability of community coalitions post-federal funding. Chicago: National Opinion Research Center; 2011.
24. Feinberg ME, Bontempo DE, Greenberg MT. Predictors and level of sustainability of community prevention coalitions. Am J Prev Med. 2008;34(6):495-501.
25. Gloppen KM, Arthur MW, Hawkins JD, Shapiro VB. Sustainability of the communities that care prevention system by coalitions participating in the Community Youth Development Study. J Adolesc Health. 2012;51(3):259-64.
26. Rhew IC, Brown EC, Hawkins JD, Briney JS. Sustained effects of the communities that care system on prevention service system transformation. Am J Public Health. 2013;103(3):529-35.
27. Chamberlain P, Brown CH, Saldana L. Observational measures of implementation progression community based settings: the Stages of Implementation Completion (SIC). Implement Sci. 2011;6:116.
28. Luke D, Calhoun A, Robichaux CB, Elliott MB, Moreland-Russell S. The program sustainability assessment tool: a new instrument for public health programs. Prev Chron Dis. 2014;11:130184. doi: 10.5888/pcd.11.130184.
29. Asch SM, McGlynn EA, Hogan MM, Hayward RA, Shekelle P, Rubenstein L, et al. Comparison of quality of care for patients in the Veterans Health Administration and patients in a national sample. Ann Intern Med. 2004;141(12):938-45.
30. Hysong SJ, Khan MM, Petersen LA. Passive monitoring versus active assessment of clinical performance: impact on measured quality of care. Med Care. 2011;49(10):883-90.
31. Institute of Medicine. Committee on Quality of Health Care in America: crossing the quality chasm: a new health care system for the 21st century. Washington: National Academies Press; 2001.
32. Institute of Medicine. Committee on Quality of Health Care in America: performance measurement: accelerating improvement. Washington DC: National Academies Press; 2006.
33. Bearman SK, Weisz JR, Chorpita BF, Hoagwood K, Ward A, Ugueto AM, et al. More practice, less preach? The role of supervision processes and therapist characteristics in EBP implementation. Adm Policy Ment Health. 2013;40(6):518-29. doi: 10.1007/s10488-013-0485-5.
34. Persell SD, Kaiser D, Dolan NC, Andrews B, Levi S, Khandekar J, et al. Changes in performance after implementation of a multifaceted electronic-health-record-based quality improvement system. Med Care. 2011;49(2):117-25.
35. Seidman E, Chorpita BF, Reay WE, Stelk W, Garland AF, Kutash K, et al. A framework for measurement feedback to improve decision-making in mental health. Adm Policy Ment Health. 2010;37(1-2):128-31.
36. Hermann RC, Chan JA, Zazzali JL, Lerner D. Aligning measurement-based quality improvement with implementation of evidence-based practices. Adm Policy Ment Health. 2006;33(6):636-45.
37. SAMHSA [Internet]. Rockville, MD; 2013. Strategic prevention framework components [cited 2016 June 4] Available from http://www.samhsa.gov/capt/applying-strategic-prevention-framework.
38. Brent DA, Baugher M, Bridge J, Chen J, Beery L. Age and sex-related risk factors for adolescent suicide. J Am Acad Child Adolesc Psychiatry. 1999;38(12):1497-505.
39. Gould MS, Greenberg T, Velting DM, Shaffer D. Youth suicide risk and preventive interventions: a review of the past 10 years. J Am Acad Child Psychiatry. 2003;42(4):386-405.
40. Rogers EM. Diffusion of innovations. 5th ed. New York, NY: Free Press; 2003.
41. Bandura A. Social foundations of thought and action: a social cognitive theory. Prentice Hall: Englewood Cliffs, NJ; 1986.
42. Valente TW. Network interventions. Science. 2012;337:49-53.
43. Valente TW, Chou CP, Pentz MA. Community coalitions as a system: effects of network change and adoption of evidence-based substance abuse prevention. Am J Public Health. 2007;97(5):880-6.
44. Valente TW, Davis RL. Accelerating the diffusion of innovations using opinion leaders. Ann Am Acad Polit Soc Sci. 1999;566:55-67.
45. Bess KD, Speer PW, Perkins DD. Ecological contexts in the development of coalitions for youth violence prevention: an organizational network analysis. Health Educ Behav. 2012;39(5):526-37.
46. Kegler MC, Rigler J, Honeycutt S. How does community context influence coalitions in the formation stage? A multiple case study based on community coalition action theory. BMC Public Health. 2010;10:90.
47. Son J, Lin N. Social capital and civic action: a network-based approach. Soc Sci Res. 2008;37:330-49.
48. Feinberg ME, Riggs NR, Greenberg MT. Social networks and community prevention coalitions. J Prim Prev. 2005;26(4):279-98.
49. Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood KE. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Admin Policy Ment Health. 2015;42:533-44. doi: 10.1007/s10488-013-0528-y.
50. Weller SC, Romney AK. Systematic data collection. Newbury Park, CA: Sage; 1988.
51. Crabtree BF, Miller WL. A template approach to text analysis: developing and using codebooks. In: Crabtree BF, Miller WL, editors. Doing qualitative research, vol. 3. Thousand Oaks, CA: Sage Press; 1992. p. 93-109.
52. Fraser D. QSR NVivo NUD*IST Vivo reference guide. Melbourne: QSR International; 2000.
53. Willms DG, Best JA, Taylor DW, Gilbert JR, Wilson DMC, Lindsay EA, et al. A systematic approach for using qualitative methods in primary prevention research. Med Anthropol Q. 1990;4(4):391-409.
54. Miles MB, Huberman AM. Qualitative data analysis: an expanded sourcebook. 2nd ed. Thousand Oaks, CA: Sage; 1994.
55. Strauss AL, Corbin J. Basics of qualitative research: techniques and procedures for developing grounded theory. Thousand Oaks, CA: Sage; 1998.
56. Boyatzis R. Transforming qualitative information: thematic analysis and code development. Thousand Oaks, CA: Sage; 1998.
57. Rice ER, Holloway IW, Barman-Adhikari A, Fuentes D, Brown CH, Palinkas LA. A mixed methods approach to network data collection. Field Methods. 2014;26(3):252-68.
58. Freeman LC. Visualizing social networks. J Social Structure. 2000; 1(1).
59. Borgatti SP, Everett MG, Freeman LC. Ucinet for windows: software for social network analysis. Cambridge, MA: Analytic Technologies; 2002.
60. Muthen LK, Muthen BO. Mplus user's guide. 3rd ed. Los Angeles: Muthen & Muthen; 2009.
61. Gibbons RD, Bock D, Hedeker D, et al. Full information item bifactor analysis of graded response data. Appl Psych Meas. 2007;31:4-19. doi: 10.1177/0146621606289485.