The dependability of alliance assessments: The alliance-outcome correlation is larger than you might think

Journal of Consulting and Clinical Psychology

Volumn 79, Issue 3, 2011, Pages 267-278

  Crits Christoph, Paul ^a   Gibbons, Mary Beth Connolly ^a   Hamilton, Jessica ^a   Ring Kurtz, Sarah ^a   Gallop, Robert ^b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b WEST CHESTER UNIVERSITY   (United States)

Author keywords

alliance; generalizability theory; outcome; therapist

Indexed keywords

ADULT; ALLIANCE ASSESSMENT; ARTICLE; COGNITIVE THERAPY; COUNSELING; DISEASE SEVERITY; DOCTOR PATIENT RELATION; DYSTHYMIA; FEMALE; GENERALIZED ANXIETY DISORDER; HUMAN; INTERNAL CONSISTENCY; MAJOR CLINICAL STUDY; MAJOR DEPRESSION; MALE; PATIENT ASSESSMENT; PATIENT CARE; POSTTRAUMATIC STRESS DISORDER; PSYCHOTHERAPIST; PSYCHOTHERAPY; SCORING SYSTEM; SOCIAL PHOBIA; TREATMENT DURATION; TREATMENT OUTCOME;

ADOLESCENT; ADULT; DEPRESSIVE DISORDER, MAJOR; FEMALE; HUMANS; MALE; MIDDLE AGED; PROFESSIONAL-PATIENT RELATIONS; PSYCHOLOGICAL THEORY; PSYCHOTHERAPY; TREATMENT OUTCOME;

EID: 79958781190     PISSN: 0022006X     EISSN: 19392117     Source Type: Journal    
DOI: 10.1037/a0023668     Document Type: Article

References (70)

1. A. Bachelor, R. Salamé Participants' perceptions of dimensions of the therapeutic alliance over the course of therapy Journal of Psychotherapy Practice and Research 9 2000 39 53 Retrieved from http://jppr.psychiatryonline. org/cgi/content/full/9/1/39 (Pubitemid 30005180)
2. R.M. Bagby, A.G. Ryder, D.R. Schuller, M.B. Marshall The Hamilton Depression Rating Scale: Has the gold standard become a lead weight? American Journal of Psychiatry 161 2004 2163 2177 doi: 10.1176/appi.ajp.161.12.2163 (Pubitemid 39587278)
3. S.A. Baldwin, B.E. Wampold, Z.E. Imel Untangling the alliance-outcome correlation: Exploring the relative importance of therapist and patient variability in the alliance Journal of Consulting and Clinical Psychology 75 2007 842 852 doi: 10.1037/0022-006X.75.6.842
4. J.P. Barber, M.B. Connolly, P. Crits-Christoph, M. Gladis, L. Siqueland Alliance predicts patients' outcome beyond in-treatment change in symptoms Journal of Consulting and Clinical Psychology 68 2000 1027 1032 doi: 10.1037/0022-006X.68.6.1027 (Pubitemid 32038380)
5. A.T. Beck, R.A. Steer, G.K. Brown Manual for Beck Depression Inventory II (BDI-II) 1996 Psychology Corporation San Antonio, TX
6. E.S. Bordin The generalizability of the psychoanalytic concept of the working alliance Psychotherapy: Theory, Research, Practice, Training 16 1979 252 260 doi: 10.1037/h0085885
7. D.F. Brossart, V.L. Willson, M.J. Patton, D.M. Kivlighan, K.D. Multon A time series model of the working alliance: A key process in short-term psychoanalytic counseling Psychotherapy: Theory, Research, Practice, Training 35 1998 197 205 doi: 10.1037/h0087645 (Pubitemid 28523313)
8. A. Bryk, S.W. Raudenbush Hierarchical linear modeling: Applications and data analysis methods 1992 Sage Thousand Oaks, CA
9. J. Cardinet, J. Johnson, G. Pini Applying generalizability theory using EduG 2010 Routledge/Taylor & Francis Group New York, NY
10. K.M. Carroll, C. Nich, B.J. Rounsaville Contribution of the therapeutic alliance to outcome in active versus control psychotherapies Journal of Consulting and Clinical Psychology 65 1997 510 514 doi: 10.1037/0022-006X.65.3. 510 (Pubitemid 27246793)
11. L. Castonguay, M. Constantino, M.G. Holtforth The working alliance: Where are we and where should we go? Psychotherapy: Theory, Research, Practice, Training 43 2006 271 279 doi: 10.1037/0033-3204.43.3.271 (Pubitemid 44454294)
12. M.B. Connolly Gibbons, P. Crits-Christoph, J.P. Barber, S.W. Stirman, R. Gallop, L. Goldstein, S. Ring Kurtz Unique and common mechanisms of change across cognitive and dynamic psychotherapies Journal of Consulting and Clinical Psychology 77 2009 801 813 doi: 10.1037/a0016596
13. G.J. Connors, K.M. Carroll, C.C. DiClemente, R. Longabaugh, D.M. Donovan The therapeutic alliance and its relationship to alcoholism treatment participation and outcome Journal of Consulting and Clinical Psychology 65 1997 588 598 doi: 10.1037/0022-006X.65.4.588 (Pubitemid 27343829)
14. P. Crits-Christoph, M.B. Connolly, R. Gallop, J.P. Barber, X. Tu, M. Gladis, L. Siqueland Early improvement during manual-guided cognitive and dynamic psychotherapies predicts 16-week remission status Journal of Psychotherapy Research and Practice 10 2001 145 154 Retrieved from http://jppr.psychiatryonline.org/cgi/content/full/10/3/145 (Pubitemid 32522224)
15. P. Crits-Christoph, M.B. Connolly Gibbons, K. Crits-Christoph, J. Narducci, M. Schamberger, R. Gallop Can therapists be trained to improve their alliances? A pilot study of alliance-fostering therapy Psychotherapy Research 16 2006 268 281 doi: 10.1080/10503300500268557 (Pubitemid 43675219)
16. P. Crits-Christoph, M.B. Connolly Gibbons, B. Hearon Does the alliance cause good outcome? Recommendations for future research on the alliance Psychotherapy: Theory, Research, Practice, Training 43 2006 280 285 doi: 10.1037/0033-3204.43.3.280 (Pubitemid 44454295)
17. Crits-Christoph, P., & Crits-Christoph, K. (1998). Alliance-fostering therapy for major depressive disorder. Unpublished manuscript, University of Pennsylvania.
18. P. Crits-Christoph, R. Gallop, C.M. Temes, G. Woody, S.A. Ball, S. Martino, K.M. Carroll The alliance in motivational enhancement therapy and counseling as usual for substance use problems Journal of Consulting and Clinical Psychology 77 2009 1125 1135 doi: 10.1037/a0017045
19. P. Crits-Christoph, L. Siqueland, J. Blaine, A. Frank, L. Luborsky, L.S. Onken, A.T. Beck Psychosocial treatments for cocaine dependence: National Institute on Drug Abuse Collaborative Cocaine Treatment Study Archives of General Psychiatry 56 1999 493 502 doi: 10.1001/archpsyc.56.6.493 (Pubitemid 29304640)
20. L. Cronbach, N. Rajaratnam, G.C. Gleser Theory of generalizability: A liberalization of reliability theory British Journal of Statistical Psychology 16 1963 137 163
21. Y. de Roten, M. Fischer, M. Drapeau, V. Beretta, U. Kramer, N. Favre, J.-N. Despland Is one assessment enough? Patterns of helping alliance development and outcome Clinical Psychology & Psychotherapy 11 2004 324 331 doi: 10.1002/cpp.420 (Pubitemid 39409609)
22. R.J. DeRubeis, M.A. Brotman, C.J. Gibbons A conceptual and methodological analysis of the nonspecifics argument Clinical Psychology: Science and Practice 12 2005 174 183 doi: 10.1093/clipsy/bpi022 (Pubitemid 40852371)
23. R.J. DeRubeis, M. Feeley Determinants of change in cognitive therapy for depression Cognitive Therapy and Research 14 1990 469 482 doi: 10.1007/BF01172968 (Pubitemid 20377899)
24. T.T. Eaton, N. Abeles, M.J. Gutfreund Therapeutic alliance and outcome: Impact of treatment length and pretreatment symptomatology Psychotherapy: Theory, Research, Practice, Training 25 1988 536 542 doi: 10.1037/h0085379 (Pubitemid 19016816)
25. M. Feeley, R. DeRubeis, L. Gelfand The temporal relation of adherence and alliance to symptom change in cognitive therapy for depression Journal of Consulting and Clinical Psychology 67 1999 578 582 doi: 10.1037/0022-006X.67.4. 578 (Pubitemid 29379472)
26. M.B. First, R.L. Spitzer, M. Gibbon, J.B.W. Williams Structured Clinical Interview for Axis I DSM-IV Disorders - Patient Edition 1994 American Psychiatric Press Washington, DC
27. M.B. First, R.L. Spitzer, M. Gibbon, J.B.W. Williams, L. Benjamin Structured Clinical Interview for DSM-IV Axis-II Personality Disorders (SCID-II, version 2.0) 1994 Biometrics Research, New York State Psychiatric Institute New York, NY
28. S. Freud The dynamics of transference J. Strachey The standard edition of the complete psychological works of Sigmund Freud 12 1966 Hogarth Press London, England 97 108 (Original work published 1912)
29. L. Gaston The concept of the alliance and its role in psychotherapy: Theoretical and empirical considerations Psychotherapy: Theory, Research, Practice, Training 27 1990 143 153 doi: 10.1037/0033-3204.27.2.143 (Pubitemid 20306824)
30. L. Gaston Reliability and criterion-related validity of the California Psychotherapy Alliance Scales - Patient Version Psychological Assessment 3 1991 68 74 doi: 10.1037/1040-3590.3.1.68
31. L. Gaston, W.E. Piper, E.G. Debbane, J. Bienvenu, J. Garant Alliance and technique for predicting outcome in short- and long-term analytic psychotherapy Psychotherapy Research 4 1994 121 135 doi: 10.1080/10503309412331333952
32. B.R. Golden, S.B. Robbins The working alliance within time-limited therapy: A case analysis Professional Psychology: Research and Practice 21 1990 476 481 doi: 10.1037/0735-7028.21.6.476
33. H. Goldstein Multilevel models in educational and social research 1987 Griffin London, England
34. M. Hamilton A rating scale for depression Journal of Neurology, Neurosurgery & Psychiatry 23 1960 56 62 doi: 10.1136/jnnp.23.1.56
35. D. Hartley, H. Strupp The therapeutic alliance: Its relationship to outcome in brief psychotherapy J. Masling Empirical studies of psychoanalytic theories 1983 Erlbaum Hillsdale, NJ 1 27
36. A.G. Hersoug, P. Hłoglend, J.T. Monsen, O.E. Havik Quality of working alliance in psychotherapy: Therapist variables and patient/therapist similarity as predictors Journal of Psychotherapy Research and Practice 10 2001 205 216 Retrieved from http://jppr.psychiatryonline.org/cgi/content/full/10/4/ 205 (Pubitemid 32959171)
37. M.J. Hilsenroth, E.J. Peters, S.J. Ackerman The development of therapeutic alliance during psychological assessment: Patient and therapist perspectives across treatment Journal of Personality Assessment 83 2004 332 344 doi: 10.1207/s15327752jpa8303-14 (Pubitemid 39578819)
38. A.O. Horvath, R.P. Bedi The alliance J.C. Norcross Psychotherapy relationships that work: Therapist contributions and responsiveness to patients 2002 Oxford University Press New York, NY 37 69
39. A.O. Horvath, B.D. Symonds Relation between working alliance and outcome in psychotherapy: A meta-analysis Journal of Counseling Psychology 38 1991 139 149 doi: 10.1037/0022-0167.38.2.139
40. W.T. Hoyt, J.N. Melby Dependability of measurement in counseling psychology: An introduction to generalizability theory Counseling Psychologist 27 1999 325 352 doi: 10.1177/0011000099273003
41. A.S. Joyce, W.E. Piper An examination of Mann's model of time-limited individual psychotherapy Canadian Journal of Psychiatry 35 1990 41 49
42. D.M. Kivlighan, P. Shaughnessy Analysis of the development of the working alliance using hierarchical linear modeling Journal of Counseling Psychology 42 1995 338 349 doi: 10.1037/0022-0167.42.3.338
43. D.M. Kivlighan, P. Shaughnessy Patterns of working alliance development: A typology of client's working alliance ratings Journal of Counseling Psychology 47 2000 362 371 doi: 10.1037/0022-0167.47.3.362 (Pubitemid 32780582)
44. M.R. Klee, N. Abeles, R.T. Muller Therapeutic alliance: Early indicators, course, and outcome Psychotherapy 27 1990 166 174 doi: 10.1037/0033-3204.27.2. 166 (Pubitemid 20306826)
45. D.N. Klein, J.E. Schwartz, N.J. Santiago, D. Vivian, C. Vocisano, L.G. Castonguay, M.B. Keller Therapeutic alliance in depression treatment: Controlling for prior change and patient characteristics Journal of Consulting and Clinical Psychology 71 2003 997 1006 doi: 10.1037/0022-006X.71.6.997 (Pubitemid 37448890)
46. A.M. Kokotovic, T.J. Tracey Working alliance in the early phase of counseling Journal of Counseling Psychology 37 1990 16 21 doi: 10.1037/0022-0167.37.1.16
47. U. Kramer, Y. de Roten, V. Beretta, L. Michel, J.-N. Despland Alliance patterns over the course of short-term dynamic psychotherapy: The shape of productive relationships Psychotherapy Research 19 2009 699 706 doi: 10.1080/10503300902956742
48. J.L. Krupnick, I. Elkin, J. Collins, S. Simmens, S.M. Sotsky, P.A. Pilkonis, J.T. Watkins Therapeutic alliance and clinical outcome in the NIMH Treatment of Depression Collaborative Research Program: Preliminary findings Psychotherapy 31 1994 28 35 doi: 10.1037/0033-3204.31.1.28 (Pubitemid 24174405)
49. R.C. Littell, G.A. Milliken, W.W. Stroup, R.D. Wolfinger, O. Schabenberger SAS system for mixed models 2nd ed. 2006 SAS Institute Cary, NC
50. L. Luborsky, P. Crits-Christoph, L. Alexander, M. Margolis, M. Cohen Two helping alliance methods for predicting outcomes of psychotherapy: Counting signs vs. a global rating Journal of Nervous and Mental Disease 171 1983 480 491 doi: 10.1097/00005053-198308000-00005 (Pubitemid 13032821)
51. C.R. Marmar, D.S. Weiss, L. Gaston Toward the validation of the California Therapeutic Alliance Rating System Psychological Assessment: A Journal of Consulting and Clinical Psychology 1 1989 46 52 doi: 10.1037/1040-3590.1.1.46
52. D.J. Martin, J.P. Garske, M.K. Davis Relation of the therapeutic alliance with outcome and other variables: A meta-analytic review Journal of Consulting and Clinical Psychology 68 2000 438 450 doi: 10.1037/0022-006X.68.3.438
53. E. Marziali Three viewpoints on the therapeutic alliance: Similarities, differences, and associations with psychotherapy outcome Journal of Nervous and Mental Disease 172 1984 417 423 doi: 10.1097/00005053-198407000-00008 (Pubitemid 14084521)
54. R. Morgan, L. Luborsky, P. Crits-Christoph, H. Curtis, J. Solomon Predicting the outcomes of psychotherapy by the Penn Helping Alliance Rating Method Archives of General Psychiatry 39 1982 397 402 Retrieved from http://archpsyc.ama-assn.org/cgi/reprint/39/4/397 (Pubitemid 12152808)
55. J.S. Ogrodniczuk, W.E. Piper, A.S. Joyce, M. McCallum Different perspectives of the therapeutic alliance and therapist technique in 2 forms of dynamically oriented psychotherapy Canadian Journal of Psychiatry/Revue canadienne de psychiatrie 45 2000 452 458 Retrieved from https://ww1.cpa-apc. org/Publications/Archives/CJP/2000/June/June2000.asp
56. S.C. Paivio, L.M. Bahr Interpersonal problems, working alliance, and outcome in short-term experiential therapy Psychotherapy Research 8 1998 392 407 doi: 10.1093/ptr/8.4.392 (Pubitemid 128548683)
57. S.C. Paivio, L.A. Patterson Alliance development in therapy for resolving child abuse issues Psychotherapy 36 1999 343 354 doi: 10.1037/h0087843 (Pubitemid 30368241)
58. M.J. Patton, D.M. Kivlighan, K.D. Multon The Missouri Psychoanalytic Counseling Research Project: Relation of changes in counseling process to client outcomes Journal of Counseling Psychology 44 1997 189 208 doi: 10.1037/0022-0167.44.2.189 (Pubitemid 127465571)
59. W.E. Piper, D.R. Boroto, A.S. Joyce, M. McCallum, H.F. Azim Pattern of alliance and outcome in short-term individual psychotherapy Psychotherapy 32 1995 639 647 doi: 10.1037/0033-3204.32.4.639 (Pubitemid 26154571)
60. W.E. Piper, J.S. Ogrodniczuk, C. Lamarche, T. Hilscher, A.S. Joyce Level of alliance, pattern of alliance, and outcome in short-term group therapy International Journal of Group Psychotherapy 55 2005 527 550 doi: 10.1521/ijgp.2005.55.4.527 (Pubitemid 41512379)
61. R. Rosenthal, R.L. Rosnow Essentials of behavioral research: Methods and data analysis 2nd ed. 1991 McGraw Hill New York, NY
62. E.M. Sauer, F.G. Lopez, B. Gormley Respective contributions of therapist and client adult attachment orientations to the development of the early working alliance: A preliminary growth modeling study Psychotherapy Research 13 2003 371 382 doi: 10.1093/ptr/kpg027 (Pubitemid 40990847)
63. H.C. Sexton, K. Hembre, G. Kvarme The interaction of the alliance and therapy microprocess: A sequential analysis Journal of Consulting and Clinical Psychology 64 1996 471 480 doi: 10.1037/0022-006X.64.3.471 (Pubitemid 26230541)
64. R.J. Shavelson, N.M. Webb Generalizability theory: A primer 1991 Sage Thousand Oaks, CA
65. Steering Committee Empirically supported therapy relationships: Conclusions and recommendations of the Division 29 Task Force J.C. Norcross Psychotherapy relationships that work: Therapist contributions and responsiveness to patients 2002 Oxford University Press New York, NY 441 443
66. W.B. Stiles, R. Agnew-Davies, G.E. Hardy, M. Barkham, D.A. Shapiro Relations of the alliance with psychotherapy outcome: Findings in the Second Sheffield Psychotherapy Project Journal of Consulting and Clinical Psychology 66 1998 791 802 doi: 10.1037/0022-006X.66.5.791 (Pubitemid 28478347)
67. W.B. Stiles, M.J. Glick, K. Osatuke, G.E. Hardy, D.A. Shapiro, R. Agnew-Davies, M. Barkham Patterns of alliance development and the rupture-repair hypothesis: Are productive relationships U-shaped or V-shaped? Journal of Counseling Psychology 51 2004 81 92 doi: 10.1037/0022-0167.51.1.81 (Pubitemid 38180631)
68. R.H. Wasserman, K. Levy, E. Loken Generalizability theory in psychotherapy research: The impact of multiple sources of variance on the dependability of psychotherapy process ratings Psychotherapy Research 19 2009 397 408 doi: 10.1080/10503300802579156
69. N.M. Webb, R.J. Shavelson, E.H. Haertel Reliability coefficients and generalizability theory C.R. Rao S. Sinharay Handbook of statistics: Vol. 26. Psychometrics 2006 Elsevier Amsterdam, Netherlands 81 124
70. J.B.W. Williams A structured interview guide for the Hamilton Depression Rating Scale Archives of General Psychiatry 45 1988 742 747 Retrieved from http://archpsyc.ama-assn.org/cgi/content/abstract/45/8/742