A model and guide for evaluating supervision outcomes in cognitive-behavioral therapy-focused training programs

Training and Education in Professional Psychology

Volumn 8, Issue 3, 2014, Pages 165-173

  Lewis, Cara C ^a   Scott, Kelli E ^a   Hendricks, Karin E ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

Cognitive behavioral therapy; Competence; Knowledge; Outcomes; Supervision

Indexed keywords

EID: 84905093081     PISSN: 19313918     EISSN: None     Source Type: Journal    
DOI: 10.1037/tep0000029     Document Type: Article

References (58)

1. Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6, 61-74. doi:10.1023/B:MHSR.0000024351.12294.65
2. Aarons, G. A., Sommerfeld, D. H., Hecht, D. B., Silovsky, J. F., & Chaffin, M. J. (2009). The impact of evidence-based practice implementation and fidelity monitoring on staff turnover: Evidence for a protective effect. Journal of Consulting and Clinical Psychology, 77, 270-280. doi:10.1037/a0013223
3. Beck, J. S., & Beck, A. T. (2011). Cognitive behavior therapy: Basics and beyond. New York, NY: Guilford Press.
4. Beidas, S. R., Cross, W., & Dorsey, S. (2013). Show me, don't tell me: Behavioral rehearsal as a training and analogue fidelity tool. Cognitive and Behavioral Practice. Advance online publication. doi:10.1016/j.cbpra.2013.04.002
5. Bennett-Levy, J., McManus, F., Westling, B. E., & Fennell, M. (2009). Acquiring and refining CBT skills and competencies: Which training methods are perceived to be most effective? Behavioural and Cognitive Psychotherapy, 37, 571-583. doi:10.1017/S1352465809990270
6. Blackburn, I. M., James, I. A., Milne, D. L., Baker, C., Standart, S., Garland, A., & Reichelt, F. K. (2001). The revised cognitive therapy scale: Psychometric properties. Behavioural and Cognitive Psychotherapy, 29, 431-446. doi:10.1017/S1352465801004040
7. Borelli, B. (2011). The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials. Journal of Public Health Dentistry, 71, S52-S63. doi:10.1111/j.1752-7325.2011.00233.x
8. Borntrager, C. F., Chorpita, B., Higa-McMillan, C., & Weisz, J. (2009). Provider attitudes toward evidence-based practices: Are the concerns with the evidence or with the manuals? Psychiatric Services, 60, 677- 681. doi:10.1176/appi.ps.60.5.677
9. Cashwell, T. H., & Dooley, K. (2001). The impact of supervision on counselor self-efficacy. The Clinical Supervisor, 20, 39 - 47. doi:10.1300/J001v20n01_03
10. Chevron, E. S., & Rounsaville, B. J. (1983). Evaluating the clinical skills of psychotherapists: A comparison of techniques. Archives of General Psychiatry, 40, 1129 -1132. doi:10.1001/archpsyc.1983.01790090091014
11. Clinical Psychology Practicum Evaluation Form. (2004). Toronto, Ontario, Canada: Centre for Addiction and Mental Health.
12. Cross, W., Matthieu, M. M., Cerel, J., & Knox, K. L. (2007). Proximate outcomes of gatekeeper training for suicide prevention in the workplace. Suicide and Life-Threatening Behavior, 37, 659-670. doi:10.1521/suli.2007.37.6.659
13. Davis, D. A., Mazmanian, P. E., Fordis, M., Van Harrison, R., Thorpe, K. E., & Perrier, L. (2006). Accuracy of physician self-assessment compared with observed measures of competence. JAMA: Journal of the American Medical Association, 296, 1094-1102. doi:10.1001/jama.296.9.1094
14. Edmunds, J. M., Beidas, R. S., & Kendall, P. C. (2013). Dissemination and implementation of evidence- based practices: Training and consultation as implementation strategies. Clinical Psychology: Science and Practice, 20, 152-165. doi:10.1111/cpsp.12031
15. Efstation, J. F., Patton, M. J., & Kardash, C. M. (1990). Measuring the working alliance in counselor supervision. Journal of Counseling Psychology, 37, 322-329. doi:10.1037/0022-0167.37.3.322
16. Elkin, I., Shea, M. T., Watkins, J. T., Imber, S. D., Sotsky, S. M., Collins, J. F.,... Docherty, J. P. (1989). National Institute of Mental Health treatment of depression collaborative research program: General effectiveness of treatments. Archives of General Psychiatry, 46, 971-982. doi:10.1001/archpsyc.1989.01810110013002
17. Falender, C. A., Cornish, J. A. E., Goodyear, R., Hatcher, R., Kaslow, N. J., Leventhal, G.,... Grus, C. (2004). Defining competencies in psychology supervision: A consensus statement. Journal of Clinical Psychology, 60, 771-785. doi:10.1002/jclp.20013
18. Falender, C. A., & Shafranske, E. P. (2004). Clinical supervision: A competency-based approach. Washington, DC: American Psychological Association. doi:10.1037/10806-000
19. Hansen, J. C., Pound, R., & Petro, C. (1976). Review of research on practicum supervision. Counselor Education and Supervision, 16, 107- 116. doi:10.1002/j.1556-6978.1976.tb01723.x
20. Hatcher, R. L., & Lassiter, K. D. (2007). Initial training in professional psychology: The practicum competencies outline. Training and Education in Professional Psychology, 1, 49-63. doi:10.1037/1931-3918.1.1.49
21. Hollon, S., Evans, M., Auerbach, A., DeRubeis, R., Elkin, I., Lowery, A.,... Pinsecki, J. (1988). Therapist competence, comorbidity and cognitive-behavioral therapy for depression. Unpublished manuscript.
22. Jensen-Doss, A., Cusack, K. J., & de Arellano, M. A. (2008). Workshopbased training in trauma-focused CBT: An in-depth analysis of impact on provider practices. Community Mental Health Journal, 44, 227-244. doi:10.1007/s10597-007-9121-8
23. Kaslow, N. J., Grus, C. L., Campbell, L. F., Fouad, N. A., Hatcher, R. L., & Rodolfa, E. R. (2009). Competency assessment toolkit for professional psychology. Training and Education in Professional Psychology, 3(Suppl), S27-S45. doi:10.1037/a0015833
24. Kazdin, A. E. (2007). Mediators and mechanisms of change in psychotherapy research. Annual Review of Clinical Psychology, 3, 1-27. doi:10.1146/annurev.clinpsy.3.022806.091432
25. Kolb, D. A. (1984). Experiential learning: Experience as the source of learning and development (Vol. 1). Englewood Cliffs, NJ: Prentice Hall.
26. Koob, J. J. (2002). The effects of solution-focused supervision on the perceived self-efficacy of therapists in training. The Clinical Supervisor, 21, 161-183. doi:10.1300/J001v21n02_11
27. Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606 - 613. doi:10.1046/j.1525-1497.2001.016009606.x
28. Kroenke, K., Spitzer, R. L., Williams, J. B., Monahan, P. O., & Lowe, B. (2007). Anxiety disorders in primary care: Prevalence, impairment, comorbidity, and detection. Annals of Internal Medicine, 146, 317-325. doi:10.7326/0003-4819-146-5-200703060-00004
29. Kuyken, W., & Tsivrikos, D. (2009). Therapist competence, comorbidity and cognitive-behavioral therapy for depression. Psychotherapy and Psychosomatics, 78, 42- 48. doi:10.1159/000172619
30. Ladany, N., Ellis, M. V., & Friedlander, M. L. (1999). The supervisory working alliance, trainee self-efficacy, and satisfaction. Journal of Counseling & Development, 77, 447-455. doi:10.1002/j.1556-6676.1999.tb02472.x
31. Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10, 288-301. doi:10.1093/clipsy.bpg025
32. Larson, L. M., & Daniels, J. A. (1998). Review of the counseling selfefficacy literature. The Counseling Psychologist, 26, 179-218. doi:10.1177/0011000098262001
33. Larson, L. M., Suzuki, L. A., Gillespie, K. N., Potenza, M. T., Bechtel, M. A., & Toulouse, A. L. (1992). Development and validation of the counseling self-estimate inventory. Journal of Counseling Psychology, 39, 105-120. doi:10.1037/00220167.39.1.105
34. Lewis, C. C., & Simons, A. D. (2011). A pilot study disseminating cognitive behavioral therapy for depression: Therapist factors and perceptions of barriers to implementation. Administration and Policy in Mental Health and Mental Health Services Research, 38, 324-334. doi:10.1007/s10488-011-0348-x
35. McCall, H., Arnold, V., & Sutton, S. G. (2008). Use of knowledge management systems and the impact on the acquisition of explicit knowledge. Journal of Information Systems, 22, 77-101. doi:10.2308/jis.2008.22.2.77
36. McLeod, B. D. (2001). The therapy process observational coding system for child psychotherapy. Unpublished manuscript. Department of Psychology, University of California, Los Angeles.
37. McLeod, B. D., & Weisz, J. (2010). The therapy process observational coding system for child psychotherapy strategies scale. Journal of Clinical Child and Adolescent Psychology, 39, 436-443. doi:10.1080/15374411003691750
38. Milne, D. (2008). CBT supervision: From reflexivity to specialization. Behavioural and Cognitive Psychotherapy, 36, 779-786. doi:10.1017/S1352465808004773
39. Milne, D., Baker, C., Blackburn, I.-M., James, I., & Reichelt, K. (1999). Effectiveness of cognitive therapy training. Journal of Behavior Therapy and Experimental Psychiatry, 30, 81-92. doi:10.1016/S0005-7916(99)00011-7
40. Muse, K., & McManus, F. (2013). A systematic review of methods for assessing competence in cognitive-behavioral therapy. Clinical Psychology Review, 33, 484-499. doi:10.1016/j.cpr.2013.01.010
41. Myles, P. J., & Milne, D. L. (2004). Outcome evaluation of a brief shared learning programme in cognitive behavioural therapy. Behavioural and Cognitive Psychotherapy, 32, 177-188. doi:10.1016/j.cpr.2013.01.010
42. Palomo, M., Beinart, H., & Cooper, M. J. (2010). Development and validation of the Supervisory Relationship Questionnaire (SRQ) in UK trainee clinical psychologists. British Journal of Clinical Psychology, 49, 131-149. doi:10.1348/014466509X441033
43. Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75, 829 - 841. doi:10.1037/0022-006X.75.6.829
44. Reese, R. J., Usher, E. L., Bowman, D. C., Norsworthy, L. A., Halstead, J. L., Rowlands, S. R., & Chisholm, R. R. (2009). Using client feedback in psychotherapy training: An analysis of its influence on supervision and counselor self-efficacy. Training and Education in Professional Psychology, 3, 157-168. doi:10.1037/a0015673
45. Reiser, R. P., & Milne, D. (2012). Supervising cognitive-behavioral psychotherapy: Pressing needs, impressing possibilities. Journal of Contemporary Psychotherapy, 42, 161-171. doi:10.1007/s10879-011-9200-6
46. Roth, A. D., & Pilling, S. (2008). Using an evidence-based methodology to identify the competences required to deliver effective cognitive and behavioural therapy for depression and anxiety disorders. Behavioural and Cognitive Psychotherapy, 36, 129 -147. doi:10.1017/S1352465808004141
47. Scott, K. J., Ingram, K. M., Vitanza, S. A., & Smith, N. G. (2000). Training in supervision: A survey of current practices. The Counseling Psychologist, 28, 403-422. doi:10.1177/0011000000283007
48. Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005). We don't train in vain: A dissemination trial of three strategies of training clinicians in cognitive- behavioral therapy. Journal of Consulting and Clinical Psychology, 73, 106-115. doi:10.1037/0022006X.73.1.106
49. Simons, A. D., Rozek, D. C., & Serrano, J. L. (2013). Wanted: Reliable and valid measures for the science of cognitive behavioral therapy dissemination and implementation. Clinical Psychology: Science and Practice, 20, 181-194. doi:10.1111/cpsp.12033
50. Steinfeld, B. (2013). Is my patient getting better? Implementation of mental health progress monitoring/outcomes system in an integrated delivery system. Paper presented at the Seattle Implementation Research Conference, Seattle, WA.
51. Strunk, D. R., Cooper, A. A., Ryan, E. T., DeRubeis, R. J., & Hollon, S. D. (2012). The process of change in cognitive therapy for depression when combined with antidepressant medication: Predictors of early intersession symptom gains. Journal of Consulting and Clinical Psychology, 80, 730-738. doi:10.1037/a0029281
52. Stumpf, R. E., Higa-McMillan, C. K., & Chorpita, B. F. (2008). Implementation of evidence-based services for youth assessing provider knowledge. Behavior Modification, 33, 48 - 65. doi:10.1177/0145445508322625
53. Sudak, D. M., Beck, J. S., & Wright, J. (2003). Cognitive behavioral therapy: A blueprint for attaining and assessing psychiatry resident competency. Academic Psychiatry, 27, 154-159. doi:10.1176/appi.ap.27.3.154
54. Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620- 630. doi:10.1037/0022006X.61.4.620
55. Weersing, V. R., Weisz, J. R., & Donenberg, G. R. (2002). Development of the therapy procedures checklist: A therapist-report measure of technique use in child and adolescent treatment. Journal of Clinical Child and Adolescent Psychology, 31, 168 -180. doi:10.1207/153744202753604458
56. Wheeler, S., & Richards, K. (2007). The impact of clinical supervision on counsellors and therapists, their practice and their clients. A systematic review of the literature. Counselling & Psychotherapy Research, 7, 54-65. doi:10.1080/14733140601185274
57. Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012). The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implementation Science, 7, 17. doi:10.1186/1748-5908-7-17
58. Young, J., & Beck, A. T. (1980). Cognitive therapy scale: Rating manual. Unpublished manuscript, University of Pennsylvania: Philadelphia, PA.