Implementation of treatment integrity procedures: An analysis of outcome studies of youth interventions targeting externalizing behavioral problems

Zeitschrift fur Psychologie / Journal of Psychology

Volumn 222, Issue 1, 2014, Pages 12-21

  Goense, Pauline ^a   Boendermaker, Leonieke ^a,b   van Yperen, Tom ^b   Stams, Geert Jan ^c   van Laar, Jose ^c  

^a AMSTERDAM UNIVERSITY OF APPLIED SCIENCES   (Netherlands)

^b UNIVERSITY OF GRONINGEN   (Netherlands)

^c UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Adherence; Competence; Fidelity; Implementation; Treatment integrity; Treatment outcome

Indexed keywords

EID: 84892520227     PISSN: 21908370     EISSN: 21512604     Source Type: Journal    
DOI: 10.1027/2151-2604/a000161     Document Type: Review

References (43)

1. Barber, J. P., Gallop, R., Crits-Christoph, P., Frank, A., Thase, M. E., Weiss, R. D., & Gibbons, B. C. (2006). The role of therapist adherence, therapist competence, and alliance in predicting outcome of individual drug counseling: Results from the national institute drug abuse collaborative cocaine treatment study. Psychotherapy Research, 16, 229-240. doi: 10.1080/10503300500288951
2. Barber, J. P., Sharpless, B. A., Klostermann, S., & McCarthy, K. S. (2007). Assessing intervention competence and its relation to therapy outcome. Professional Psychology: Research and Practice, 38, 493-500. doi: 10.1037/0735-7028.38.5.493
3. Barber, J., Triffleman, E., & Marmar, C. (2007). Considerations in treatment integrity: Implications and recommendations for PTSD research. Journal of Traumatic Stress, 20, 793-805. doi: 10.1002/jts.20295
4. Barnoski, R. (2004). Outcome evaluation of Washington State's research-based programs for juvenile offenders. Olympia, WA: Washington State Institute for Public Policy.
5. Bruns, E. J., Suter, J. C., Force, M. M., & Burchard, J. D. (2005). Adherence to wraparound principles and association with outcomes. Journal of Child & Family Studies, 14, 521-534. doi: 10.1007/s10826-005-7186-y
6. Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2, 40. doi: 10.1186/ 1748-5908-2-40
7. Chapman, J. E., & Schoenwald, S. K. (2011). Ethnic similarity, therapist adherence, and long-term multisystemic therapy outcomes. Journal of Emotional & Behavioural Disorders, 19, 3-16. doi: 10.1177/1063426610376773
8. Dishion, T. J., McCord, J., & Poulin, F. (1999). When interventions harm: Peer groups and problem behavior. American Psychologist, 54, 755-764.
9. Eames, C., Daley, D., Hutchings, J., Whitaker, C. J., Bywater, T., Jones, K., & Hughes, J. C. (2010). The impact of group leaders' behaviour on parents acquisition of key parenting skills during parent training. Behaviour Research and Therapy, 48, 1221-1226. doi: 10.1016/j.brat.2010.07.011
10. Eames, C., Daley, D., Hutchings, J., Whitaker, C. J., Jones, K., Hughes, J. C., & Bywater, T. (2009). Treatment fidelity as a predictor of behaviour change in parents attending groupbased parent training. Child: Care, Health & Development, 35, 603-612. doi: 10.1111/j.1365-2214.2009.00975.x
11. Effland, V., Walton, B., & McIntyre, J. (2011). Connecting the dots: Stages of implementation, wraparound fidelity and youth outcomes. Journal of Child & Family Studies, 20, 736-746. doi: 10.1007/s10826-011-9541-5
12. Farrington, D. P., & Welsh, B. C. (2006). A half-century of randomized experiments on crime and justice. In M. Tonry (Ed.), Crime and Justice (pp. 55-132). Chicago, IL: University of Chicago Press.
13. Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., & Chapman, J. E. (2010). Randomized trial of MST and ARC in a two-level evidencebased treatment implementation strategy. Journal of Consulting and Clinical Psychology, 78, 537-550. doi: 10.1037/ a0019160
14. Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65, 821-833.
15. Henggeler, S. W., Pickrel, S. G., & Brondino, M. J. (1999). Multisystemic treatment of substance-abusing and dependent delinquents: Outcomes, treatment fidelity, and transportability. Mental Health Services Research, 1, 171-184.
16. Hogue, A., Dauber, S., Samuolis, J., & Liddle, H. A. (2006). Treatment techniques and outcomes in multidimensional family therapy for adolescent behavior problems. Journal of Family Psychology, 20, 535-543. doi: 10.1037/0893-3200.20.4.535
17. Hogue, A., Henderson, C. E., Dauber, S., Barajas, P. C., Fried, A., & Liddle, H. A. (2008). Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems. Journal of Consulting & Clinical Psychology, 76, 544-555.
18. Holth, P., Torsheim, T., Sheidow, A. J., Ogden, T., & Henggeler, S. W. (2011). Intensive quality assurance of therapist adherence to behavioral interventions for adolescent substance use problems. Journal of Child & Adolescent Substance Abuse, 20, 289-313. doi: 10.1080/1067828X. 2011.581974
19. Huey, S. J., Henggeler, S. W., Brondino, M. J., & Pickrel, S. G. (2000). Mechanisms of change in multisystemic therapy: Reducing delinquent behavior through therapist adherence and improved family and peer functioning. Journal of Consulting and Clinical Psychology, 68, 451-467.
20. Liddle, H. A., Dakof, G. A., Henderson, C., & Rowe, C. (2011). Implementation outcomes of multidimensional family therapy-detention to community: A reintegration program for drug-using juvenile detainees. International Journal of Offender Therapy and Comparative Criminology, 55, 587-604.
21. Little, E., Hudson, A., & Wilks, R. (2002). The efficacy of written teacher advice (tip sheets) for managing classroom behaviour problems. Educational Psychology, 22, 251-266.
22. McGlinchey, J. B., & Dobson, K. S. (2003). Treatment integrity concerns in cognitive therapy for depression. Journal of Cognitive Psychotherapy: An International Quarterly, 17, 299-318.
23. Parhar, K. K., Wormith, J. S., Derkzen, D. M., & Beauregard, A. M. (2008). Offender coercion in treatment: A metaanalysis of effectiveness. Criminal Justice and Behavior, 35, 1109-1135.
24. Perepletchikova, F. (2006). Treatment integrity [Addendum to Perepletchikova, Treat, & Kazdin, 2007]. Retrieved from www.treatmentintegrity.com
25. Perepletchikova, F., & Kazdin, A. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology-Science and Practice, 12, 365-383. doi: 10.1093/clipsy/bpi045
26. Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75, 829-841.
27. Robbins, M. S., Feaster, D. J., Horigian, V. E., Puccinelli, M. J., Henderson, C., & Szapocznik, J. (2011). Therapist adherence in brief strategic family therapy for adolescent drug abusers. Journal of Consulting and Clinical Psychology, 79, 43-53.
28. Schoenwald, S. K., Carter, R. E., Chapman, J. E., & Sheidow, A. J. (2008). Therapist adherence and organizational effects on change in youth behavior problems one year after multisystemic therapy. Administration and Policy in Mental Health and Mental Health Services Research, 35, 379-394. doi: 10.1007/s10488-008-0181-z
29. Schoenwald, S. K., Chapman, J. E., Sheidow, A. J., & Carter, R. E. (2009). Long-term youth criminal outcomes in MST transport: The impact of therapist adherence and organizational climate and structure. Journal of Clinical Child and Adolescent Psychology, 38, 91-105. doi: 10.1080/1537441 0802575388
30. Schoenwald, S. K., Garland, A. F., Southam-Gerow, M. A., Chorpita, B. F., & Chapman, J. E. (2011). Adherence measurement in treatments for disruptive behavior disorders: Pursuing clear vision through varied lenses. Clinical Psychology-Science and Practice, 18, 331-341. doi: 10.1111/j.1468-2850.2011.01264.x
31. Schoenwald, S. K., Sheidow, A. J., & Chapman, J. E. (2009). Clinical supervision in treatment transport: Effects on adherence and outcomes. Journal of Consulting & Clinical Psychology, 77, 410-421. doi: 10.1037/a0013788
32. Schoenwald, S. K., Sheidow, A. J., & Letourneau, E. J. (2004). Toward effective quality assurance in evidence-based practice: Links between expert consultation, therapist fidelity, and child outcomes. Journal of Clinical Child & Adolescent Psychology, 33, 94-104.
33. Schoenwald, S. K., Sheidow, A. J., Letourneau, E. J., & Liao, J. (2003). Transportability of multisystemic therapy: Evidence for multilevel influences. Mental Health Services Research, 5, 223-239. doi: 10.1023/A:1026229102151
34. Sexton, T., & Turner, C. W. (2010). The effectiveness of functional family therapy for youth with behavioral problems in a community practice setting. Journal of Family Psychology, 24, 339-348.
35. Stambaugh, L. F., Mustillo, S. A., Burns, B. J., Stephens, R. L., Baxter, B., Edwards, D., & DeKraai, M. (2007). Outcomes from wraparound and multisystemic therapy in a center for mental health services system-of-care demonstration site. Journal of Emotional and Behavioral Disorders, 15, 143-155.
36. Sundell, K., Hansson, K., Lçfholm, C. A., Olsson, T., Gustle, L. H., & Kadesjç, C. (2008). The transportability of multisystemic therapy to sweden: Short-term results from a randomized trial of conduct-disordered youths. Journal of Family Psychology, 22, 550-560.
37. de Swart, J. J. W., van den Broek, H., Stams, G. J. J. M., Asscher, J. J., van der Laan, P. H., Holsbrink-Engels, G. A., & vanderHelm, G. H. P. (2012). The effectiveness of institutional youth care over the past three decades: A meta-analysis. Children and Youth Services Review, 34, 1818-1824.
38. Toffalo, D. A. D. (2000). An investigation of treatment integrity and outcomes in wraparound services. Journal of Child and Family Studies, 9, 351-361.
39. Veerman, J. W., & van Yperen, T. A. (2007). Degrees of freedom and degrees of certainty: A developmental model for the establishment of evidence-based youth care. Evaluation and Program Planning, 30, 212-221.
40. Walker, H. M., Golly, A., McLane, J. Z., & Kimmich, M. (2005). The oregon first step to success replication initiative: Statewide results of an evaluation of the program's impact. Journal of Emotional & Behavioral Disorders, 13, 163-172.
41. Waltz, J., Addis, M., Koerner, K., & Jacobson, N. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620-630.
42. Weisburd, D. (2003). Ethical practice and evaluation of interventions in crime and justice: The moral imperative for randomized trials. Evaluation Review, 27, 336-354.
43. Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006). Evidence-based youth psychotherapiesversus usual clinical care: A meta-analysis of direct comparisons. American Psychologist, 61, 671-689.