Therapist effects in outpatient psychotherapy: A three-level growth curve approach

Journal of Counseling Psychology

Volumn 54, Issue 1, 2007, Pages 32-39

  Lutz, Wolfgang ^a,b   Martinovich, Zoran ^c   Lyons, John S ^c   Leon, Scott C ^d   Stiles, William B ^e  

^a UNIVERSITY OF BERN   (Switzerland)

^b UNIVERSITY OF TRIER   (Germany)

^c NORTHWESTERN UNIVERSITY   (United States)

^d LOYOLA UNIVERSITY CHICAGO   (United States)

^e MIAMI UNIVERSITY   (United States)

Author keywords

Expected treatment response; Outcomes management; Outpatient psychotherapy; Symptom intensity; Therapist effects; Three level growth curve model

Indexed keywords

ADULT; ARTICLE; CONTROLLED STUDY; FEMALE; HUMAN; MAJOR CLINICAL STUDY; MALE; OUTCOME ASSESSMENT; OUTPATIENT CARE; PSYCHOLOGIC ASSESSMENT; PSYCHOLOGICAL RATING SCALE; PSYCHOTHERAPIST ATTITUDE; PSYCHOTHERAPY; STATISTICAL ANALYSIS; THERAPY EFFECT; TREATMENT OUTCOME; VARIANCE;

EID: 33846108910     PISSN: 00220167     EISSN: None     Source Type: Journal    
DOI: 10.1037/0022-0167.54.1.32     Document Type: Article

References (52)

1. American Psychiatric Association. (1987). Diagnostic and statistical manual of mental disorders (3rd ed., rev.). Washington, DC: Author.
2. American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
3. Barkham, M., Connell, J., Stiles, W. B., Miles, J. N. V., Margison, F., Evans, C., & Mellor-Clark, J. (2006). Dose-effect relations and responsive regulation of treatment duration: The good enough level. Journal of Consulting and Clinical Psychology, 74, 160-167.
4. Crits-Christoph, P., Baranackie, K., Kurcias, J. S., Beck, A. T., Carroll, K., Perry, K., et al. (1991). Meta-analysis of therapist effects in psychotherapy outcome studies. Psychotherapy Research, 1, 81-91.
5. Crits-Christoph, P., & Gallop, R. (2006). Therapist effects in the National Institute of Mental Health Treatment of Depression Collaborative Research Program and other psychotherapy studies. Psychotherapy Research, 16, 178-181.
6. Crits-Christoph, P., & Mintz, J. (1991). Implication of therapist effects for the design and analysis of comparative studies of psychotherapies. Journal of Consulting and Clinical Psychology, 59, 20-26.
7. Crits-Christoph, P., Tu, X., & Gallop, R. (2003). Therapists as fixed versus random effects-Some statistical and conceptional issues: A comment on Siemer and Joormann. Psychological Methods, 8, 518-523.
8. Elkin, I. (1999). A major dilemma in psychotherapy outcome research: Disentangling therapist from therapies. Clinical Psychology: Science and Practice, 6, 10-32.
9. Elkin, I. (2006). Rejoinder to commentaries by Stephen Soldz and Paul Crits-Christoph on therapist effects. Psychotherapy Research, 16, 182-183.
10. Elkin, I., Falconnier, L., Martinovich, Z., & Mahoney, C. (2006). Therapist effects in the NIMH Treatment of Depression Collaborative Research Program. Psychotherapy Research, 16, 144-160.
11. Elkin, I., Shea, M. T., Watkins, J. T., Imber, S. D., Sotsky, S. M., Collins, J. F., et al. (1989). National Institute of Mental Health Treatment of Depression Collaborative Research Program: General effectiveness of treatments. Archives of General Psychiatry, 46, 971-982.
12. Endicott, J., Spitzer, R. L., Fleiss, J. L., & Cohen, J. (1976). The Global Assessment Scale: Procedure for measuring overall severity of psychiatric disturbance. Archives of General Psychiatry, 33, 766-771.
13. Garfield, S. L. (1994). Research on client variables in psychotherapy. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change (4th ed., pp. 190-228). New York: Wiley.
14. Garfield, S. L. (1997). The therapist as a neglected variable in psychotherapy research. Clinical Psychology: Science and Practice, 4, 40-43.
15. Gibbons, R. D., Hedeker, D., Elkin, I., Waterneaux, C., Kraemer, H., Greenhouse, J. B., et al. (1993). Some conceptual and statistical issues in analysis of longitudinal psychiatric data. Archives of General Psychiatry, 50, 739-750.
16. Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002). The psychotherapy dose-response effect and its implications for treatment delivery services. Clinical Psychology: Science and Practice, 9, 329-343.
17. Howard, K. I., Kopta, S. M., Krause, M. S., & Orlinsky, D. E. (1986). The dose-response relationship in psychotherapy. American Psychologist, 41, 159-164.
18. Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). The evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059-1064.
19. Huppert, J. D., Bufka, L. F., Barlow, D. H., Gorman, J. M., & Shear, M. K. (2001). Therapists, therapist variables, and cognitive-behavioral therapy outcome in a multicenter trial for panic disorder. Journal of Consulting and Clinical Psychology, 65, 747-755.
20. Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19.
21. Kim, D.-M., Wampold, B. E., & Bolt, D. M. (2006). Therapist effects in psychotherapy: A random effects modeling of the NIMH TDCRP data. Psychotherapy Research, 16, 161-172.
22. Lambert, M. J., & Bergin, A. E., (1994). The effectiveness of psychotherapy. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change (4th ed., pp. 143-189). New York: Wiley.
23. Lambert, M. J., Hansen, N. B., & Finch, A. E. (2001). Patient-focused research: Using patient outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69, 159-172.
24. Lambert, M. J., & Okiishi, J. C. (1997). The effects of the individual psychotherapist and implications for future research. Clinical Psychology: Science and Practice, 4, 66-75.
25. Leon, S. C., Kopta, S. M., Lutz, W., & Howard, K. I. (1999). Predicting patients' responses to psychotherapy: Are some more predictable than others? Journal of Consulting and Clinical Psychology, 67, 698-704.
26. Luborsky, L., Crits-Christoph, P., McLellan, A. T., Woody, G., Piper, W., Liberman, B., et al. (1986). Do therapists vary much in their success? Findings from four outcome studies. American Journal of Orthopsychiatry, 56, 501-512.
27. Lueger, R. J., Howard, K. I., Martinovich, Z., Lutz, W., Anderson, E., & Grissom, G. (2001). Assessing treatment progress with individualized models of predicted response. Journal of Consulting and Clinical Psychology, 69, 150-158.
28. Lutz, W., Leach, C., Barkham, M., Lucock, M., Stiles, W. B., Evans, C., et al. (2005). Predicting rate and shape of change for individual clients receiving psychological therapy: Using growth curve modeling and nearest neighbor technologies. Journal of Consulting and Clinical Psychology, 73, 904-913.
29. Lutz, W., Martinovich, Z., & Howard, K. I. (1999). Patient profiling: An application of random coefficient regression models to depicting the response of a patient to outpatient psychotherapy. Journal of Consulting and Clinical Psychology, 67, 571-577.
30. Lutz, W., Martinovich, Z., Howard, K. I., & Leon, S. C. (2002). Outcomes management, expected treatment response and severity adjusted provider profiling in outpatient psychotherapy. Journal of Clinical Psychology, 58, 1291-1304.
31. Lutz, W., Saunders, S. M., Leon, S. C., Martinovich, Z., Kosfelder, J., Schulte, D., et al. (2006). Empirically and clinically useful decision making in psychotherapy: Differential predictions with treatment response models. Psychological Assessment, 18, 133-141.
32. Lyons, J. S., Howard, K. I., O'Mahoney, M. T., & Lish, J. D. (1997). The measurement & management of clinical outcomes in mental health. New York: Wiley.
33. Martinovich, Z., & Helgerson, J. (in press). Applications of trajectory analysis in research and outcomes management. In J. Lyons & D. Aron-Weiner (Eds.), Behavioral health care strategies: Total clinical outcomes management. Kingston, NJ: Civic Research Institute, Inc.
34. Merrill, K. A., Tolbert, V. E., & Wade, W. A. (2003). Effectiveness of cognitive therapy for depression in a community mental health center: A benchmarking study. Journal of Consulting and Clinical Psychology, 71, 404-409.
35. Nich, C., & Carroll, K. (1997). Now you see it, now you don't: A comparison of traditional versus random-effects regression models in the analysis of longitudinal follow-up data from a clinical trial. Journal of Consulting and Clinical Psychology, 65, 252-261.
36. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
37. Okiishi, J., Lambert, M. J., Eggett, D., Nielsen, L., Dayton, D. D., & Vermeersch, D. A. (2006). An analysis of therapist treatment effects: Toward providing feedback to individual therapists on their clients' psychotherapy outcome. Journal of Clinical Psychology, 62, 1157-1172.
38. Okiishi, J., Lambert, M. J., Nielsen, S. L., & Ogles, B. M. (2003). Waiting for Supershrink: An empirical analysis of therapist effects. Clinical Psychology and Psychotherapy, 10, 361-373.
39. Pilkonis, P. A., Imber, S. D., Lewis, P., & Rubinsky, P. (1984). A comparative outcome study of individual, group, and conjoint psychotherapy. Archives of General Psychiatry, 41, 431-437.
40. Project MATCH Research Group. (1998). Therapist effects in three treatments for alcohol problems. Psychotherapy Research, 8, 455-474.
41. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Newbury Park, CA: Sage.
42. Raudenbush, S., Bryk, A., Cheong, Y. F., & Congdon, R. (2001). HLM 5: Hierarchical linear and nonlinear modeling. Lincolnwood, IL: Scientific Software International.
43. Ricks, D. F. (1974). Supershrink: Methods of a therapist judged successful on the basis of adult outcomes of adolescent patients. In D. F. Ricks, M. Roff, & A. Thomas (Eds.), Life history research in psychopathology (pp. 288-308). Minneapolis: University of Minnesota Press.
44. Serlin, R. C. Wampold, B. E., & Levin, J. R. (2003). Should providers of treatment be regarded as a random factor? If it ain't broke, don't "fix" it: A comment on Siemer and Joormann (2003). Psychological Methods, 8, 524-534.
45. Shapiro, D. A., Firth-Cozens, J., & Stiles, W. B. (1989). The question of therapists' differential effectiveness: A Sheffield Psychotherapy Project addendum. British Journal of Psychiatry, 154, 383-385.
46. Siemer, M., & Joormann, J. (2003). Power and measures of effect size in analysis of variance with fixed versus random nested factors. Psychological Methods, 8, 435-544.
47. Soldz, S. (2006). Models and meanings: Therapist effects and the stories we tell. Psychotherapy Research, 16, 173-177.
48. Stiles, W. B., Honos-Webb, L., & Surko, M. (1998). Responsiveness in psychotherapy. Clinical Psychology: Science and Practice, 5, 439-458.
49. Stirman, S. W., DeRubeis, R. J., Crits-Christoph, P., & Brody, P. E. (2003). Are samples in randomized controlled trials of psychotherapy representative of community outpatients? A new methodology and initial findings. Journal of Consulting and Clinical Psychology, 71, 963-972.
50. Vessey, J. T., & Howard, K. I. (1993). Who seeks psychotherapy? Psychotherapy, 30, 546-553.
51. Wampold, B. E., & Bolt, D. M. (2006). Therapist effects: Clever ways to make them (and everything else) disappear. Psychotherapy Research, 16, 184-187.
52. Wampold, B. E., & Brown, G. S. (2005). Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73, 914-923.