Patterns of therapist variability: Therapist effects and the contribution of patient severity and risk

Journal of Consulting and Clinical Psychology

Volumn 80, Issue 4, 2012, Pages 535-546

  Saxon, David ^a   Barkham, Michael ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

CORE OM; multilevel modeling; risk; severity; therapist effects

Indexed keywords

ADULT; ARTICLE; DISEASE SEVERITY; FEMALE; HUMAN; MAJOR CLINICAL STUDY; MALE; MENTAL HEALTH SERVICE; MULTILEVEL ANALYSIS; PATIENT COUNSELING; PATIENT SAFETY; PSYCHOTHERAPIST; THERAPY EFFECT; TREATMENT OUTCOME; ANXIETY DISORDER; CLINICAL COMPETENCE; COUNSELING; DEPRESSION; HUMAN RELATION; METHODOLOGY; MIDDLE AGED; PSYCHOLOGICAL ASPECT; PSYCHOTHERAPY; RISK; SEVERITY OF ILLNESS INDEX;

ADULT; ANXIETY DISORDERS; CLINICAL COMPETENCE; COUNSELING; DEPRESSIVE DISORDER; FEMALE; HUMANS; MALE; MIDDLE AGED; PROFESSIONAL-PATIENT RELATIONS; PSYCHOTHERAPY; RISK; SEVERITY OF ILLNESS INDEX; TREATMENT OUTCOME;

EID: 84872230776     PISSN: 0022006X     EISSN: 19392117     Source Type: Journal    
DOI: 10.1037/a0028898     Document Type: Article

References (63)

1. Adelson, J. L., & Owen, J. (2011, October 3). Bringing the psychotherapist back: Basic concepts for reading articles examining therapist effects using multilevel modeling. Psychotherapy. Advance online publication. doi:10.1037/a0023990
2. American Psychological Association Task Force on Evidence-Based Practice. (2006). Report of the 2005 Presidential Task Force on Evidence-Based Practice in Psychology. American Psychologist, 61, 271-285. doi:10.1037/0003-066X.61.4. 271
3. Baldwin, S. A., & Imel, Z. E. (in press). Therapist effects: Findings and methods. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed.). New York, NY: Wiley.
4. Barkham, M., Gilbert, N., Connell, J., Marshall, C., & Twigg, E. (2005). Suitability and utility of the CORE-OM and CORE-A for assessing severity of presenting problems in psychological therapy services based in primary and secondary care settings. British Journal of Psychiatry, 186, 239-246. doi:10.1192/bjp.186.3.239
5. Barkham, M., Margison, F., Leach, C., Lucock, M., Mellor-Clark, J., Evans, C., . . . McGrath, G. (2001). Service profiling and outcomes benchmarking using the CORE-OM: Towards practice-based evidence in the psychological therapies. Journal of Consulting and Clinical Psychology, 69, 184-196. doi:10.1037/0022-006X.69.2.184
6. Barkham, M., Mellor-Clark, J., Connell, J., & Cahill, J. (2006). A CORE approach to practice-based evidence: A brief history of the origins and applications of the CORE-OM and CORE System. Counselling & Psychotherapy Research, 6, 3-15. doi:10.1080/14733140600581218
7. Barkham, M., Mellor-Clark, J., Connell, J., Evans, R., Evans, C., & Margison, F. (2010). The CORE measures and system: Measuring, monitoring, and managing quality evaluation in the psychological therapies. In M. Barkham, G. E. Hardy, & J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence: A guide for the psychological therapies (pp. 175-219). doi:10.1002/9780470687994.ch8
8. Barkham, M., Mullin, T., Leach, C., Stiles, W. B., & Lucock, M. (2007). Stability of the CORE-OM and BDI-I: Psychometric properties and implications for routine practice. Psychology and Psychotherapy: Theory, Research and Practice, 80, 269-278. doi:10.1348/147608306X148048
9. Barkham, M., Stiles, W. B., Lambert, M. J., & Mellor-Clark, J. (2010). Building a rigorous and relevant knowledge-base for the psychological therapies. In M. Barkham, G. E. Hardy, & J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence: A guide for the psychological therapies (pp. 21-61). doi:10.1002/9780470687994.ch2
10. Borkovec, T. D., Echemendia, R. J., Ragusea, S. A., & Ruitz, M. (2001). The Pennsylvania Practice Research Network and future possibilities for clinically meaningful and scientifically rigorous psychotherapy effectiveness research. Clinical Psychology: Science and Practice, 8, 155-167. doi:10.1093/clipsy.8.2.155
11. Bridgewater, B., Grayson, A. D., Jackson, M., Brooks, N., Grotte, G. J., Keenan, D. J. M., . . . Jones, M. (2003). Surgeon specific mortality in adult cardiac surgery: Comparison between crude and risk stratified data. British Medical Journal, 327, 13-17. doi:10.1136/bmj.327.7405.13
12. Brown, G. S., Lambert, J., Jones, E. R., & Minami, T. (2005). Identifying highly effective psychotherapists in a managed care environment. The American Journal of Managed Care, 11, 513-520.
13. Browne, W. J. (2009). MCMC estimation in MLwiN Version 2.13. Bristol, United Kingdom: University of Bristol, Centre for Multilevel Modelling.
14. Cahill, J., Barkham, M., & Stiles, W. B. (2010). Systematic review of practice-based research on psychological therapies in routine clinic settings. British Journal of Clinical Psychology, 49, 421-453. doi: 10.1348/ 014466509X470789
15. Clark, D. M., Ehlers, A., Hackmann, A., McManus, F., Fennell, M., Grey, N., . . . Wild, J. (2006). Cognitive therapy versus exposure and applied relaxation in social phobia: A randomized controlled trial. Journal of Consulting and Clinical Psychology, 74, 568-578. doi:10.1037/0022-006X.74.3.568
16. Connell, J., Barkham, M., Stiles, W. B., Twigg, E., Singleton, N., Evans, O., & Miles, J. N. V. (2007). Distribution of CORE-OM scores in a general population, clinical cut-off points, and comparison with the CIS-R. British Journal of Psychiatry, 190, 69-74. doi:10.1192/bjp.bp.105.017657
17. Crits-Christoph, P., & Mintz, J. (1991). Implications of therapist effects for the design and analysis of comparative studies of psychotherapy. Journal of Consulting and Clinical Psychology, 59, 20-26. doi:10.1037/0022-006X. 59.1.20
18. Department of Health, Mental Health Programme. (2008). Improving Access to Psychological Therapies: Implementation plan: National guidelines for regional delivery. Retrieved from http://www.iapt.nhs.uk/silo/files/ implementation-plan-national-guidelines-for-regional-delivery.pdf
19. Elkin, I., Falconnier, L., Martinovitch, Z., & Mahoney, C. (2006). Therapist effects in the NIMH Treatment of Depression Collaborative Research Program. Psychotherapy Research, 16, 144-160. doi:10.1080/10503300500268540
20. Elkin, I., Shea, M. T., Watkins, J. T., Imber, S. D., Sotsky, S. M., Collins, J. F., . . . Parloff, M. B. (1989). National Institute of Mental Health Treatment of Depression Collaborative Research Program: General effectiveness of treatments. Archives of General Psychiatry, 46, 971-982. doi:10.1001/ archpsyc.1989.01810110013002
21. Evans, C., Connell, J., Barkham, M., Margison, F., Mellor-Clark, J., McGrath, G., & Audin, K. (2002). Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE-OM. British Journal of Psychiatry, 180, 51-60. doi:10.1192/bjp.180.1.51
22. Garfield, S. L. (1994). Research on client variables in psychotherapy. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change (4th ed., pp. 190-228). New York, NY: Wiley.
23. Goldstein, H., & Healy, M. J. R. (1995). The graphical presentation of a collection of means. Journal of the Royal Statistical Society, 158, 175-177. doi:10.2307/2983411
24. Goldstein, H., & Spiegelhalter, D. (1996). League tables and their limitations: Statistical issues in comparisons of institutional performance. Journal of the Royal Statistical Society, 159, 385-443. doi:10.2307/2983325
25. Hofmann, D. A., & Gavin, M. B. (1998). Centering decisions in hierarchical linear models: Implications for research in organizations. Journal of Management, 24, 623-641. doi:10.1177/014920639802400504
26. Hollon, S. D., DeRebeis, R. J., Evans, M. D., Wiener, M. J., Garvey, M. J., Grove, W. M., & Tuason, V. B. (1992). Cognitive therapy and pharmacotherapy for depression: Singly and in combination. Archives of General Psychiatry, 49, 774-781. doi:10.1001/archpsyc.1992 .01820100018004
27. Huppert, J. D., Bufka, L. F., Barlow, D. H., Gorman, J. M., Shear, M. K., & Woods, S. W. (2001). Therapists, therapist variables, and cognitivebehavioral therapy outcome in a multicenter trial for panic disorder. Journal of Consulting and Clinical Psychology, 69, 747-755. doi: 10.1037/0022-006X.69.5.747
28. Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19. doi:10.1037/0022-006X. 59.1.12
29. Kim, D.-M., Wampold, B. E., & Bolt, D. M. (2006). Therapist effects in psychotherapy: A random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Psychotherapy Research, 16, 161-172. doi:10.1080/10503300500264911
30. Kolehmainen, N., MacLennan, G., Francis, J. J., & Duncan, E. A. S. (2010). Clinicians' caseload management behaviours as explanatory factors in patients' length of time on caseloads: A predictive multilevel study in paediatric community occupational therapy. BMC Health Services Research, 10, 249. doi:10.1186/1472-6963-10-249
31. Kraus, D. R., Castonguay, L., Boswell, J. F., Nordberg, S. S., & Hayes, J. A. (2011). Therapist effectiveness: Implications for accountability and patient care. Psychotherapy Research, 21, 267-276. doi:10.1080/10503307. 2011.563249
32. Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606-613. doi:10.1046/j.1525-1497.2001.016009606.x
33. Larrison, C. R., & Schoppelrey, S. L. (2011). Therapist effects on the disparities experienced by minorities receiving services for mental illness. Research on Social Work Practice, 21, 727-736. doi:10.1177/1049731511410989
34. Lewis, M., Morley, S., van der Windt, D. A. W. M., Hay, E., Jellema, P., Dziedzic, K., & Main, C. J. (2010). Measuring practitioner/therapist effects in randomised trials of low back pain and neck pain interventions in primary care settings. European Journal of Pain, 14, 1033-1039. doi:10.1016/j.ejpain. 2010.04.002
35. Luborsky, L., Crits-Christoph, P., Woody, G. E., Piper, W. E., Imber, S., & Pilkonis, P. A. (1986). Do therapists vary much in their success? Findings from four outcome studies. American Journal of Orthopsychiatry, 56, 501-512.
36. Luborsky, L., McLellan, A. T., Diguer, L., Woody, G., & Seligman, D. A. (1997). The psychotherapist matters: Comparison of outcomes across twenty-two therapists and seven patient samples. Clinical Psychology: Science and Practice, 4, 53-65. doi:10.1111/j.1468-2850.1997.tb00099.x
37. Lutz, W., Leon, S. C., Martinovich, Z., Lyons, J. S., & Stiles, W. B. (2007). Therapist effects in outpatient psychotherapy: A three-level growth curve approach. Journal of Counseling Psychology, 54, 32-39. doi: 10.1037/0022-0167.54.1.32
38. Maas, C. J. M., & Hox, J. J. (2004). Robustness issues in multilevel regression analysis. Statistica Neerlandica, 58, 127-137. doi:10.1046/j.0039- 0402.2003.00252.x
39. Martindale, C. (1978). The therapist-as-fixed-effect fallacy in psychotherapy research. Journal of Consulting and Clinical Psychology, 46, 1526-1530. doi:10.1037/0022-006X.46.6.1526
40. McArdle, C. (2000). ABC of colorectal cancer. Primary treatment-Does the surgeon matter? British Medical Journal, 321, 1121-1123. doi: 10.1136/bmj.321.7269.1121
41. McArdle, C. S., & Hole, D. (1991). Impact of variability among surgeons on postoperative morbidity and mortality and ultimate survival. British Medical Journal, 302, 1501-1505. doi:10.1136/bmj.302.6791.1501
42. McCarthy, W. C., & Frieze, I. H. (1999). Negative aspects of therapy: Client perceptions of therapists' social influence, burnout, and quality of care. Journal of Social Issues, 55, 33-50. doi:10.1111/0022-4537.00103
43. National Health Service. (2002). National Health Service performance indicators: February 2002. Retrieved from http://www.performance.doh.gov.uk/ nhsperformanceindicators/2002/index.html
44. Okiishi, J. C., Lambert, M. J., Eggett, D., Nielson, S. L., Vermeersch, D. A., & Dayton, D. D. (2006). An analysis of therapist treatment effects: Toward providing feedback to individual therapists on their patients' psychotherapy outcome. Journal of Clinical Psychology, 62, 1157-1172. doi:10.1002/jclp.20272
45. Okiishi, J., Lambert, M. J., Nielsen, S. L., & Ogles, B. M. (2003). Waiting for supershrink: An empirical analysis of therapist effects. Clinical Psychology & Psychotherapy, 10, 361-373. doi:10.1002/cpp.383
46. Rasbash, J., Charlton, C., Browne, W. J., Healy, M., & Cameron, B. (2009). MLwiN (Version 2.1) [Computer software]. Bristol, United Kingdom: University of Bristol, Centre for Multilevel Modelling.
47. Rasbash, J., Steele, F., Browne, W. J., & Goldstein, H. (2009). A user's guide to MLwiN, v2.10. Bristol, United Kingdom: University of Bristol, Centre for Multilevel Modelling.
48. Richards, D. A., & Suckling, R. (2009). Improving access to psychological therapies: Phase IV prospective cohort study. British Journal of Clinical Psychology, 48, 377-396. doi:10.1348/014466509X405178
49. Saxon, D., Ricketts, T., & Heywood, J. (2010). Who drops-out? Do measures of risk to self and to others predict unplanned endings in primary care counselling? Counselling & Psychotherapy Research, 10, 13-21. doi:10.1080/14733140902914604
50. Shapiro, D. A., & Firth, J. A. (1987). Prescriptive vs. exploratory psychotherapy: Outcomes of the Sheffield Psychotherapy Project. British Journal of Psychiatry, 151, 790-799. doi:10.1192/bjp.151.6.790
51. Shapiro, D. A., Firth-Cozens, J., & Stiles, W. B. (1989). The question of therapists' differential effectiveness. A Sheffield Psychotherapy Project addendum. British Journal of Psychiatry, 154, 383-385. doi:10.1192/bjp.154.3.383
52. Shaw, B. F., Elkin, I., Yamaguchi, J., Olmsted, M., Vallis, T. M., Dobson, K. S., . . . Watkins, J. T. (1999). Therapist competence ratings in relation to clinical outcome in cognitive therapy of depression. Journal of Consulting and Clinical Psychology, 67, 837-846. doi:10.1037/0022-006X.67.6.837
53. Snijders, T., & Bosker, R. (2004). Multilevel analysis: An introduction to basic and advanced multilevel modeling. London, England: Sage.
54. Soldz, S. (2006). Models and meanings: Therapist effects and the stories we tell. Psychotherapy Research, 16, 173-177. doi:10.1080/10503300500264937
55. Stiles, W. B., Barkham, M., Connell, J., & Mellor-Clark, J. (2008). Responsive regulation of treatment duration in routine practice in United Kingdom primary care settings. Journal of Consulting and Clinical Psychology, 76, 298-305. doi:10.1037/0022-006X.76.2.298
56. Stiles, W. B., Barkham, M., Mellor-Clark, J., & Connell, J. (2008). Effectiveness of cognitive-behavioural, person-centred, and psychodynamic therapies in UK primary care routine practice: Replication with a larger sample. Psychological Medicine, 38, 677-688. doi:10.1017/S0033291707001511
57. Stiles, W. B., Barkham, M., Twigg, E., Mellor-Clark, J., & Cooper, M. (2006). Effectiveness of cognitive-behavioural, person-centred, and psychodynamic therapies as practiced in UK National Health Service settings. Psychological Medicine, 36, 555-566. doi:10.1017/S0033291706007136
58. Trepka, C., Rees, A., Shapiro, D. A., Hardy, G. E., & Barkham, M. (2004). Therapist competence and outcome of cognitive therapy for depression. Cognitive Therapy and Research, 28, 143-157. doi:10.1023/B: COTR.0000021536. 39173.66
59. Vocisano, C., Arnow, B., Blalock, J. A., Vivian, D., Manber, R., Rush, A. J., . . . Thase, M. E. (2004). Therapist variables that predict symptom change in psychotherapy with chronically depressed outpatients. Psychotherapy: Theory, Research, Practice, Training, 41, 255-265. doi: 10.1037/0033-3204.41.3.255
60. Wampold, B. E., & Brown, G. S. (2005). Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73, 914-923. doi:10.1037/0022-006X.73.5.914
61. Wampold, B. E., & Serlin, R. C. (2000). The consequences of ignoring a nested factor on measures of effect size in analysis of variance. Psychological Methods, 5, 425-433. doi:10.1037/1082-989X.5.4.425
62. Webb, C. A., DeRubeis, R. J., & Barber, J. P. (2010). Therapist adherence/competence and treatment outcome: A meta-analytic review. Journal of Consulting and Clinical Psychology, 78, 200-211. doi:10.1037/a0018912
63. Wilson, G. T., Wilfley, D. E., Agras, W. S., & Bryson, S. W. (2011). Allegiance bias and therapist effects: Results of a randomized controlled trial of binge eating disorder. Clinical Psychology: Science and Practice, 18, 119-125. doi:10.1111/j.1468-2850.2011.01243.x