Improving practice in community-based settings: A randomized trial of supervision - study protocol

Implementation Science

Volumn 8, Issue 1, 2013, Pages 1-11

  Dorsey, Shannon ^a   Pullmann, Michael D ^b   Deblinger, Esther ^c   Berliner, Lucy ^d   Kerns, Suzanne E ^b   Thompson, Kelly ^a   Unützer, Jürgen ^b   Weisz, John R ^e   Garland, Ann F ^f  

^a UNIVERSITY OF WASHINGTON   (United States)

^b UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

^c UMDNJ School of Osteopathic Medicine   (United States)

^d UNIVERSITY OF WASHINGTON   (United States)

^e HARVARD MEDICAL SCHOOL   (United States)

^f UNIVERSITY OF SAN DIEGO   (United States)

Author keywords

Behavioral rehearsal; EBT; Evidence based treatment; Fidelity; Implementation; Role play; Supervision; Symptom monitoring; Training; Trauma focused cognitive behavioral therapy

Indexed keywords

ADOLESCENT; CHILD; CLINICAL TRIAL; COGNITIVE THERAPY; COMMUNITY MENTAL HEALTH CENTER; CONTROLLED STUDY; EVIDENCE BASED MEDICINE; HUMAN; MENTAL DISORDERS; MENTAL HEALTH SERVICE; ORGANIZATION AND MANAGEMENT; PHASE 1 CLINICAL TRIAL; PHASE 2 CLINICAL TRIAL; PROCEDURES; PUBLIC RELATIONS; RANDOMIZED CONTROLLED TRIAL; TREATMENT OUTCOME; UNITED STATES;

ADOLESCENT; CHILD; COGNITIVE THERAPY; COMMUNITY MENTAL HEALTH CENTERS; COMMUNITY MENTAL HEALTH SERVICES; EVIDENCE-BASED MEDICINE; HUMANS; INTERPROFESSIONAL RELATIONS; MENTAL DISORDERS; TREATMENT OUTCOME; WASHINGTON;

EID: 84891608933     PISSN: None     EISSN: 17485908     Source Type: Journal    
DOI: 10.1186/1748-5908-8-89     Document Type: Article

References (87)

1. Weisz JR, Jensen-Doss JR, Hawley KM. Youth psychotherapy outcome research: a review and critique of the evidence base. Annual Rev Psychol 2005, 56:337-363. 10.1146/annurev.psych.55.090902.141449, 15709939.
2. Chambless DL, Ollendick TH. Empirically supported psychological interventions: controversies and evidence. Annual Rev Psychol 2001, 52:685-716. 10.1146/annurev.psych.52.1.685, 11148322.
3. Weisz JR, McCarty CA, Valeri SM. Effects of psychotherapy for depression in children and adolescents: a meta-analysis. Psychol Bull 2006, 132:132-149. 2150594, 16435960.
4. Weisz JR, Doss AJ, Haley KM. Evidence-based youth psychotherapies versus usual clinical care: a meta-analysis of direct comparisons. Am Psychol 2006, 61:671-689.
5. Weisz JR, Kuppens S, Eckshtain D, Ugueto AM, Hawley KM, Jensen-Doss A. Do evidence-based youth psychotherapies outperform usual clinical care? a multilevel meta-analysis. JAMA Psychiatry in press.
6. Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature (FMHI publication No. 231) 2005, Tampa, FL: The National Implementation Research Network, University of South Florida, Louis de la Parte Florida mental health institute.
7. Mitchell PF. Evidence-based practice in real-world services for young people with complex needs: new opportunities suggested by recent implementation science. Child Youth Serv Rev 2011, 33:207-216.
8. Beidas RS, Kendall PC. Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clin Psychol Sci Pract 2010, 17:1-30.
9. Herschell AD, Kolko DJ, Baumann BL, Davis AC. The role of therapist training in the implementation of psychosocial treatments: a review and critique with recommendations. Clin Psychol Rev 2010, 30:448-466. 10.1016/j.cpr.2010.02.005, 2872187, 20304542.
10. Ellis M, Krengel M, Ladany N, Schult D. Clinical supervision research from 1981-1993: a methodological critique. J Counsel Psychol 1996, 43:35-50.
11. Kilminster SM, Jolly BC. Effective supervision in clinical practice settings: a literature review. Med Ed 2000, 34:827-840.
12. Callahan JL, Almstrom CM, Swift JK, Borja SE, Heath CJ. Exploring the contribution of supervisors to intervention outcomes. Train Ed Prof Psychol 2009, 3:72-77.
13. Schoenwald S, Carter RE, Chapman JE, Sheidow AJ. Therapist adherence and organizational effects on change in youth behavior problems one year after Multisystemic Therapy. Admin Policy Mental Health Mental Health Serv Res 2008, 35:379-394.
14. Schoenwald SK, Mehta TG, Frazier SL, Shernoff ES. Clinical supervision in effectiveness and implementation research. Clin Psychol Sci Pract 2013, 20:44-59.
15. Miller C, Gruskin S, Subramanian S, Rajaraman D, Heymann S. Orphan care in Botswana's working households: growing responsibilities in the absence of adequate support. Am J Public Health 2006, 96:1429-1435. 10.2105/AJPH.2005.072280, 1522103, 16809585.
16. Schoenwald SK, Sheidow AJ, Chapman JE. Clinical supervision in treatment transport: effects on adherence and outcomes. J Consul Clin Psychol 2009, 77:410-421.
17. Accurso EC, Taylor RM, Garland AF. Evidence-based practices addressed in community-based children's mental health clinical supervision. Train Ed Prof Psychol 2011, 5:88-96.
18. Carroll KM, Rounsaville BJ. A vision of the next generation of behavioral therapies research in the addictions. Addiction 2007, 102:850-862. 10.1111/j.1360-0443.2007.01798.x, 2148498, 17523974.
19. Gonsalvez CJ, Milne DL. Clinical supervisor training in Australia: a review of current problems and possible solutions. Australian Psychol 2010, 45:233-242.
20. Milne DL, Sheikh AI, Pattison S, Wilkinson A. Evidence-based training for clinical supervisors: a systematic review of 11 controlled studies. Clin Sup 2011, 30:53-71.
21. Eby LT, Burk H, Maher CP. How serious of a problem is staff turnover in substance abuse treatment? A longitudinal study of actual turnover. J Subs Abuse Treat 2010, 39:264-271.
22. Chorpita BF, Regan J. Dissemination of effective mental health treatment procedures: maximizing the return on a significant investment. Behav Res Therapy 2009, 47:990-993.
23. Beidas RS, Edmunds JM, Marcus SC, Kendall PC. Training and consultation to promote implementation of an empirically supported treatment: a randomized trial. Psychiatric Serv 2012, 63:660-665.
24. Milne D. Evaluating and enhancing supervision: an experiential model. Casebook for clinical supervision: a competency-based approach 2008, 211-233. Washington, DC US: American Psychological Association, Falender CA, Shafranske EP.
25. Padesky CA. Developing cognitive therapist competency: teaching and supervision models. Frontiers of cognitive therapy 1996, 266-292. New York, NY US: Guilford Press, Salkovskis PM.
26. Sheidow AJ, Donahue BC, Hill HH, Heneggler SW, Ford JD. Development of an audio tape review system for supporting adherence to an evidence based treatment. Prof Psychol Res Prac 2008, 39:553-560.
27. Bearman SK, Weisz JR, Chorpita BF, Hoagwood K, Ward A, Ugueto AM, Bernstein A. More practice, less preach? The role of supervision processes and therapist characteristics in EBP implementation. Admin Policy Mental Health Mental Health Serv Res in press.
28. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Policy Mental Health 2010, 38:65-76.
29. Schoenwald SK, Garland AF, Chapman JE, Frazier SL, Sheidow AJ, Southam-Gerow MA. Toward the effective and efficient measurement of implementation fidelity. Admin Policy Mental Health Mental Health Serv Res 2011, 38:32-43.
30. Garland AF, Bickman L, Chorpita BF. Change what? Identifying quality improvement targets by investigating usual mental health care. Admin Policy Mental Health Mental Health Serv Res 2010, 37:15-26.
31. Hogue A, Ozechowski TJ, Robbins MS, Barrett WH. Making fidelity an intramural game: localizing quality assurance procedures to promote sustainability of evidence-based practices in usual care. Clin Psychol Sci Pract 2013, 20:60-77.
32. Hurlburt MS, Garland AF, Nguyen K, Brookman-Frazee L. Child and family therapy process: concordance of therapist and observational perspectives. Admin Policy Mental Health Mental Health Serv Res 2010, 37:230-244.
33. Hrisos S, Eccles MP, Francis JJ, Dickinson HO, Kaner EFS, Beyer F, Johnston M. Are there valid proxy measures of clinical behavior? a systematic review. Implement Sci 2009, 4:37-56. 10.1186/1748-5908-4-37, 2713194, 19575790.
34. Perepletchikova F, Treat TA, Kazdin AE. Treatment integrity in psychotherapy research: analysis of the studies and examination of the associated factors. J Consul Clin Psychol 2007, 72:829-841.
35. Cross W, Matthieu M, Cerel J, Knox KL. Proximate outcomes of gatekeeper training for suicide prevention in the workplace. Suicide Life-Threat Behav 2007, 37:659-670. 10.1521/suli.2007.37.6.659, 18275372.
36. Beidas RS, Cross WF, Dorsey S. Show me don't tell me: behavioral rehearsal as a training and fidelity tool. Cogn Behav Pract in press.
37. Freeston M. Clinical supervision: art or science? 2010, Boston, MA US: World Congress of Behavioral and Cognitive Therapies.
38. Matthieu M, Cross W, Batres AR, Flora CM, Knox KL. Evaluation of gatekeeper training for suicide prevention in veterans. Archives Suicide Res 2008, 12:148-154.
39. Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M. Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality. JAMA J Am Med Assoc 2000, 283:1715-1722.
40. Unützer J, Chan YF, Hafer E, Knaster J, Shields A, Powers D, Veith RC. Quality improvement with pay-for-performance incentives in integrated behavioral health care. Am J Public Health 2012, 106:e41-e45.
41. Worthen VE, Lambert MJ. Outcome oriented supervision: advantages of adding systematic client tracking to supportive consultations. Counsel Psychotherapy Res 2007, 7:48-53.
42. Hunkeler E, Katon W, Tang L, Williams JW, Kroenke K, Lin EB, Unützer J. Long term outcomes from the IMPACT randomised trial for depressed elderly patients in primary care. BMJ British Med J 2006, 332:259-263.
43. Unützer J, Katon W, Callahan CM, Williams JW, Hunkeler E, Harpole L, Hoffing M, Della Penna RD, Hitchock Noël P, Lin EHB, et al. Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial. JAMA J Am Med Assoc 2002, 288:2836-2845.
44. Garland A, Landsverk J, Lau A. Racial/ethnic disparities in mental health service use among children in foster care. Child Youth Serv Rev 2003, 25:491-507.
45. Palmiter DJ. A survey of the assessment practices of child and adolescent clinicians. Am J Orthopsych 2004, 74:122-128.
46. Barber JP, Crits-Christoph P, Luborksy L. Effects of therapist adherence and competence on patient outcome in brief dynamic therapy. J Consul Clin Psychol 1996, 64:619-622.
47. Schoenwald S, Carter RE, Chapman JE, Sheidow AJ. Therapist adherence and organizational effects on change in youth behavior problems one year after multisystemic therapy. Admin Policy Mental Health 2008, 35:379-394.
48. Webb CA, DeRubeis RJ, Barber JP. Therapist adherence/competence and treatment outcome: a meta-analytic review. J Consul Clin Psychol 2010, 78:200-211.
49. McHugh R, Murray HW, Barlow DH. Balancing fidelity and adaptation in the dissemination of empirically-supported treatments: the promise of transdiagnostic interventions. Behav Res Therapy 2009, 47:946-953.
50. Ellis MV, Ladany N. Inferences concerning supervisees and clients in clinical supervision: an integrative review. Handbook of psychotherapy supervision 1997, 447-507. New York, NY US: Wiley, Watkins CEJr.
51. Schoenwald SK, Sheidow AJ, Letourneau EJ, Liao JG. Transportability of multisystemic therapy: evidence for multi-level influences. Mental Health Serv Res 2003, 5:223-239.
52. Chaffin M, Hecht D, Bard D, Silovsky JF, Beasley WH. A statewide trial of the SafeCare home-based services model with parents in child protective services. Pediatrics 2012, 129:509-515. 10.1542/peds.2011-1840, 3289527, 22351883.
53. Aarons GA, Sommerfeld DH, Hecht DB, Silovsky JF, Chaffin MJ. The impact of evidence-based practice implementation and fidelity monitoring on staff turnover: evidence for a protective effect. J Consul Clin Psychol 2009, 77:270-280.
54. Knudsen HK, Ducharme LJ, Roman PM. Clinical supervision, emotional exhaustion, and turnover intention: a study of substance abuse treatment counselors in the clinical trials network of the national institute on drug abuse. J Subs Abuse Treat 2008, 35:387-395.
55. Cohen JA, Mannarino A, Deblinger E. Treating trauma and traumatic grief in Children and adolescents: a clinician's guide 2006, New York: Guilford Press.
56. Cohen JA, Mannarino AP. Disseminating and implementing trauma-focused CBT in community settings. Trauma Violence Abuse 2008, 9:214-226. 10.1177/1524838008324336, 18936280.
57. Sigel BA, Benton AH, Lynchm CE, Kramer TL. Preliminary findings for statewide dissemination programs using trauma-focused cognitive-behavioral therapy (TF-CBT) with children 2010, Philedelphia, PA US: Presented at the University of Arkansas for Medical Sciences, Annual National Colloquium.
58. Sigel BA, Kramer TL, Conners-Burrow NA, Church JK, Worley KB, Mitrani NA. Statewide dissemination of trauma-focused cognitive-behavioral therapy (TF-CBT). Child Youth Serv Rev 2013, 35:1023-1029.
59. Gleacher AA, Nadeem E, Moy AJ, Whited AL, Albano AM, Radigan M, Wang R, Chassman J, Myrhol-Clarke B, Hoagwood KE. Statewide CBT training for clinicians and supervisors treating youth: the New York State evidence based treatment dissemination center. J Emot Behav Disorders 2010, 19:182-192.
60. Milne D, Aylott H, Fitzpatrick H, Ellis MV. How does clinical supervision work? Using a 'best evidence synthesis' approach to construct a basic model of supervision. Clin Sup 2008, 27:170-190.
61. McLeod BD, Weisz JR. Therapy process observational coding system for child psychotherapy strategies scale. J Clin Child Adol Psychol 2010, 39:436-443.
62. Steinberg AM, Brymer M, Decker K, Pynoos RS. The UCLA PTSD reaction index. Current Psychiatry Reports 2004, 6:96-100. 10.1007/s11920-004-0048-2, 15038911.
63. Steinberg AM, Brymer MJ, Kim S, Briggs EC, Ippen CG, Ostrowsky SA, Gully KJ, Pynoos RS. Psychometric properties of the UCLA PTSD reaction index: part I. J Traumatic Stress 2013, 26:1-9.
64. Goodman R. The strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry 1997, 38:581-586. 10.1111/j.1469-7610.1997.tb01545.x, 9255702.
65. Graen GB, Uhl-Bien M. Relationship-based approach to leadership: development of leader-member exchange (lmx) theory of leadership over 25 years: applying a multi-level multi-domain perspective. Leadership Quarter 1995, 6:219-247.
66. Efstation JF, Patton MJ, Kardish CM. Measuring the working alliance in counsellor supervision. J Counsel Psychol 1990, 37:322-329.
67. Horvath AO, Greenberg LS. Development of the working alliance inventory. The psychotherapeutic process: a research handbook 1986, 529-556. New York, NY US: Guildford Press, Greenberg LS, Pinsoff WM.
68. Rahim MA. The development of a leader power inventory. Multi Behav Res 1988, 23:491-503.
69. Lehman WEK, Greener JM, Simpson DD. Assessing organizational readiness for change. J Subs Abuse Treat 2002, 22:197-209.
70. Borntrager C, Chorpita BF, McMillan-Higa C, Weisz J. Provider attitudes towards evidence based practices: are the concerns with the evidence or the manuals?. Psychiatric Serv 2009, 60:677-681.
71. Maslach C, Jackson S, Leiter M. Maslach burnout inventory manual 1996, Mountain View, California: Consulting Psychologists Press.
72. Walsh JP, Ashford SJ, Hill TE. Feedback obstruction: the influence of the information environment on employee turnover intentions. Human Relat 1985, 38:23-46.
73. Birmaher B, Khetarpal S, Brent D, Cully M. The screen for child anxiety related emotional disorders (SCARED): scale construction and psychometric characteristics. J Am Acad Child Adol Psychiatry 1997, 36:545-553.
74. Muris P, Merckelbach H, Korver P, Meesters C. Screening for trauma in childresn and adolescents: the validity of the traumatic stress disorder scale of the screen for Child anxiety related emotional disorders. J Clin Child Psychol 2000, 29:406-413. 10.1207/S15374424JCCP2903_11, 10969424.
75. Gardner W, Lucas A, Kolko DJ, Campo JV. Comparison of the PSC-17 and alternative mental health screens in an at-risk primary care sample. J Am Acad Child Adol Psychiatry 2007, 46:611-618.
76. Kerns SEU, Dorsey S, Trupin EW, Berliner L. Project Focus: promoting emotional health and wellbeing for youth in foster care through connections to evidence-based practices. Report Emot Behav Disorders Youth 2010, 10:30-38.
77. Baron RM, Kenny DA. The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. J Personal Soc Psychol 1986, 51:1173-1182.
78. Cole DA, Maxwell SE. Testing meditational models with longitudinal data: questions and tips in the use of structural equation modeling. J Abnormal Psychol 2003, 112:558-577.
79. MacKinnon DP. Introduction to statistical mediation analysis 2008, New York, NY US: Lawrence Erlbaum Associates.
80. Stice E, Presnell K, Gau J, Shaw H. Testing mediators of intervention effects in randomized controlled trials: an evaluation of two eating disorder prevention programs. J Consul Clin Psychol 2007, 75:20-32.
81. QSR International NVivo 9: qualitative analysis software program 2010, QSR International.
82. Patton MQ. Qualitative evaluations and research methods 1990, Newbury Park, CA: Sage.
83. Strauss A, Corbin J. Basics of qualitative research 1990, Newbury Park, CA: Sage.
84. Pringle B, Chambers D, Wang PS. Toward enough of the best for all: research to transform the efficacy, quality, and reach of mental health care for youth. Admin Policy Mental Health Mental Health Serv Res 2010, 37:191-196.
85. National Institute of Mental Health The national institute of mental health strategic plan 2008, Bethesda, MD US: U. S. Department of Health and Human Services, National Institutes of Health, National Institute of Mental Health, NIH publication No. 08-6368 edition, National Institute of Mental Health.
86. Bruns EJ, Hoagwood KE. State implementation of evidence-based practice for youths, part I: responses to the state of the evidence. J Am Acad Child Adol Psychiatry 2008, 47:369-373.
87. Jensen-Doss A, Hawley KH, Lopez M, Osterberg LD. Using evidence-based treatments: the experiences of youth providers working under a mandate. Prof Psychol Res Pract 2009, 40:417-424.