Description of a Fidelity Implementation System: An Example from a Community-Based Children's Mental Health Program

Journal of Child and Family Studies

Volumn 21, Issue 6, 2012, Pages 1028-1040

  Kutash, Krista ^a   Cross, Brittany ^a   Madias, Anthony ^a   Duchnowski, Albert J ^a   Green, Amy L ^a  

^a UNIVERSITY OF SOUTH FLORIDA   (United States)

Author keywords

Children's mental health; Fidelity of implementation; Implementation science; Parent support

Indexed keywords

EID: 84869138232     PISSN: 10621024     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10826-012-9565-5     Document Type: Article

References (49)

1. Abbott, R. D., O'Donnell, J., Hawkins, D., Hill, K. G., Kosterman, R., & Catalano, R. F. (1998). Changing teaching practices to promote achievement and bonding to school. American Journal of Orthopsychiatry, 68, 542-552.
2. Andrade, A. R., Lambert, E. W., & Bickman, L. (2000). Dose effect in child psychotherapy: Outcomes associated with negligible treatment. Journal of the American Academy of Child and Adolescent Psychiatry, 39, 161-168. doi: 10. 1097/00004583-200002000-00014.
3. Barat, I., Andreasen, F., & Damsgaard, E. M. S. (2001). Drug therapy in the elderly: What doctors believe and patients actually do. British Journal of Clinical Pharmacology, 51, 615-622.
4. Barkham, M., Connell, J., Stiles, W., Miles, J., Margison, F., Evans, C., et al. (2006). Dose-effect relations and responsive regulation of treatment duration: The good enough level. Journal of Consulting and Clinical Psychology, 74(1), 160-167.
5. Bernfield, G. A., Farrington, D. P., & Leschied, A. W. (2001). Offender rehabilitation in practice; Implementation and evaluation effective programs. New York: Wiley.
6. Bickman, L., Andrade, A. R., & Lambert, E. W. (2002). Dose response in child and adolescent mental health services. Mental Health Services Research, 4(2), 57-70.
7. Botvin, G. J., Baker, E., Dusenbemy, L., Tortu, S., & Botvin, E. M. (1990). Preventing adolescent drug abuse through a multimodal cognitive behavioral approach: Results of a 3 year study. Journal of Consulting and Clinical Psychology, 5(8), 437-446.
8. Botvin, G. J., Dusenberry, L., Baker, E., James-Ortiz, S., & Rerner, J. (1989). A skills training approach to smoking prevention among Hispanic youth. Journal of Behavioral Medicine, 12, 279-296.
9. Brandon, P. R., Taum, A. K. H., Young, D. B., Pottenger, P. M., I. I. I., & Speitel, T. W. (2008). The complexity of measuring the quality of program implementation with observations. The American Journal of Evaluation, 29(3), 235-250.
10. Burns, N., & Grove, S. K. (2005). The practice of nursing research: Conduct, critique, and utilization (5th ed.). St. Louis, MO: Elsevier Saunders.
11. Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity [Electronic version]. Implementation Science, 2, 40. doi: 10. 1186/1748-5908-2-40.
12. Dane, A., & Schneider, B. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23-24.
13. Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11(2), 193-221.
14. Durlak, J. A. (1998). Why program implementation is important. Journal of Prevention and Intervention in the Community, 17, 5-18.
15. Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18(2), 237-256.
16. Fixsen, D. L, Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231).
17. Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children's mental health treatments. Mental Health Services Research, 7(4), 243-259.
18. Gonzales, J. J., Ringeisen, H. L., & Chambers, D. A. (2002). The tangled and thorny path of science to practice: Tensions in interpreting and applying "evidence". Clinical Psychology: Science and Practice, 9, 204-209.
19. Greenberg, M. T., Domitrovich, C., & Bumbarger, B. (1999). Preventing mental disorder in school-aged children: A review of the effectiveness of prevention programs. Report submitted to The Center for Mental Health Services (SAMHSA), Prevention Research Center, Pennsylvania State University (obtainable at http://www. psu. edu/dept/prevention/).
20. Hansen, W. B., Graham, J. W., Wolkenstein, B. H., & Rohrbach, L. A. (1991). Program integrity as a moderator of prevention program effectiveness: Results for fifth-grade students in the Adolescent Alcohol Prevention Trial. Journal of Studies on Alcohol, 52, 568-579.
21. Hansen, W. B., & McNeil, R. B. (1999). Drug education practice: Results of an observational study. Health Education Research, 14(1), 85-97.
22. Harachi, T. W., Abbott, R. D., Catalano, R. F., Haggerty, K. P., & Fleming, C. B. (1999). Opening the black box: Using process evaluation measures to assess implementation and theory building. American Journal of Community Psychology, 27, 711-731.
23. Henggeler, S. W., Schoenwald, S. K., Rowland, M. D., & Cunningham, P. B. (2002). Serious emotional disturbance in children and adolescents: Multisystemic therapy. New York: Guilford Press. http://www. guilford. com.
24. Hoagwood, K., Cavaleri, M., Olin, S., Burns, B., Slaton, E., Gruttadaro, D., et al. (2010). Family support in children's mental health: A review and synthesis. Clinical Child and Family Psychology Review, 13(1), 1-45.
25. Hogue, A., Liddle, H. A., Singer, A., & Leckrone, J. (2005). Intervention fidelity in family-based prevention counseling for adolescent problem behaviors. Journal of Community Psychology, 33(2), 191-211.
26. Hulleman, C., & Cordray, D. (2009). Moving from the lab to the field: The role of fidelity and achieved relative intervention strength. Journal of Research on Educational Effectiveness, 2, 88-110.
27. Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st Century. Washington, DC: National Academy Press.
28. Kessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005). Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the national comorbidity survey replication. Archives of General Psychiatry, 62, 617-627.
29. Kutash, K., Duchnowski, A. J., Green, A., & Ferron, J. M. (2011). Supporting parents who have youth with emotional disturbances through a parent-to-parent support program: A proof of concept study using random assignment. Administration and Policy in Mental Health and Mental Health Services Research, 38(5), 412-427. doi: 10. 1007/s10488-010-0329-5.
30. Landsverk, J., Brown, H., Aarons, G. A., Chamberlain, P., Gibbons, R., Horwitz, S. M., et al. (2010). Study design issues in implementation research: Application to child welfare settings. Administration and Policy in Mental Health and Mental Health Services Research, 38, 44-63.
31. Lutz, W., Saunders, S. M., Leon, S. C., Martinovich, Z., Kosfelder, J., Schulte, D., et al. (2006). Empirically and clinically useful decision making in psychotherapy: Differential predictions with treatment response models. Psychological Assessment, 18(2), 133-141.
32. Lynch, S., & O'Donnell, C. (2005). The evolving definition, measurement, and conceptualization of fidelity of implementation in scale-up of highly rated science curriculum units in diverse middle schools. Paper presented at the meeting of the American Educational Research Association, Montreal, Canada.
33. Maidment, R., Livingston, G., & Katona, C. (2003). "Just keep taking the tablets": Adherence to antidepressant treatment in older people in primary care. International Journal of Geriatric Psychiatry, 17, 752-757.
34. McBride, N., Farringdon, F., & Midford, R. (2002). Implementing a school drug education programme: Reflections on fidelity. International Journal of Health Promotion Education, 40, 40-50.
35. Mihalic, S. (2002). The importance of implementation fidelity. Retrieved from the Center for the Study of Violence and Prevention website: www. colorado. edu/cspv/blueprints/Fidelity. pdf.
36. National Institute of Mental Health. (2004). Advancing the science of implementation: Improving the fit between mental health intervention development and service systems. Retrieved September 25, 2006 from http://www. nimh. nih. gov/scienfidmeetings/scienceofimplmentation/pdf.
37. O'Donnell, C. L. (2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in k-12 curriculum intervention research. Review of Educational Research, 78(1), 33-84.
38. Proctor, E. K., & Landsverk, J. (2005). Challenges of translating evidence-based treatments into practice contexts and service sectors. Paper presented at the Mental Health Services Research Conference, Washington, DC.
39. Proctor, E. K., Landsverk, J., Aarons, G. A., Chambers, D., Glisson, C., & Mittman, C. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services, 36, 24-34.
40. Resnick, B., Bellg, A. J., Borrelli, B., DeFrancesco, C., Breger, R., & Hecht, J. (2005). Examples of implementation and evaluation of treatment fidelity in the BCC studies: Where we are and where we need to go. Annals of Behavioral Medicine, 29, 46-54.
41. Rohrbach, L. A., Grana, R., Sussman, S., & Valente, T. W. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation and the Health Professions, 29, 302-333.
42. Sanchez, V., Steckler, A., Nitirat, P., Hallfors, D., Cho, H., & Brodish, P. (2007). Fidelity of implementation in a treatment effectiveness trial of Reconnecting Youth. Health Education Research, 22, 95-107. doi: 10. 1093/her/cyl052.
43. Scanlon, J. W., Horst, P., Nay, J. W., Schmidt, R. E., & Waller, J. D. (1977). Evaluability assessment: Avoiding type III or IV errors. In G. R. Gilbert & P. J. Conklin (Eds.), Evaluation management: A source book of readings. Charlottesville: U. S. Civil Service Commission.
44. Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. L., & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38, 32-43.
45. Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000). Multisystemic therapy: Monitoring treatment fidelity. Family Process, 39, 83-103.
46. Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services, 52, 1190-1197.
47. Schoenwald, S. K., Sheidow, A. J., & Letourneau, E. J. (2004). Toward effective quality assurance in evidence-based practice: Links between expert consultation, therapist fidelity, and child outcomes. Journal of Child and Adolescent Clinical Psychology, 33, 94-104.
48. Schulte, A. C., Easton, J. E., & Parker, J. (2009). Advances in treatment integrity research: Multidisciplinary perspectives on the conceptualization, measurement, and enhancement of treatment integrity. School Psychology Review, 38(4), 460-475.
49. Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. E. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620-630.