Patient-rated alliance as a measure of therapist performance in two clinical settings

Journal of Consulting and Clinical Psychology

Volumn 81, Issue 1, 2013, Pages 154-165

  Imel, Zac E ^a   Hubbard, Rebecca A ^b   Rutter, Carolyn M ^b   Simon, Gregory ^b  

^a UNIVERSITY OF UTAH   (United States)

^b GROUP HEALTH RESEARCH INSTITUTE   (United States)

Author keywords

alliance; multilevel; therapist

Indexed keywords

ADULT; AGED; ARTICLE; CLINICAL ASSESSMENT TOOL; DECISION MAKING; DISCRIMINANT VALIDITY; DOCTOR PATIENT RELATION; FEMALE; HUMAN; MAJOR CLINICAL STUDY; MALE; MEASUREMENT; PATIENT CARE; PATIENT RATED ALLIANCE; PSYCHOTHERAPIST ATTITUDE; PSYCHOTHERAPY; RATING SCALE; SKILL;

EID: 84875350175     PISSN: 0022006X     EISSN: 19392117     Source Type: Journal    
DOI: 10.1037/a0030903     Document Type: Article

References (39)

1. Agency for Health Care Research and Quality. (2008). ECHO Experience of Care and Health Outcomes Survey. Rockville, MD: U. S. Department of Health and Human Services. Retrieved from https://www.cahps.ahrq.gov/content/products/ECHO/ PROD-ECHO-Intro.asp
2. Baldwin, S. A., Wampold, B. E., & Imel, Z. E. (2007). Untangling the alliance-outcome correlation: Exploring the relative importance of therapist and patient variability in the alliance. Journal of Consulting and Clinical Psychology, 75, 842-852. doi:10.1037/0022-006X.75.6.842
3. Bordin, E. S. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, Research & Practice, 16, 252-260. doi:10.1037/h0085885
4. Brown, G. S. J., Lambert, M. J., Jones, E. R., & Minami, T. (2005). Identifying highly effective psychotherapists in a managed care environment. The American Journal of Managed Care, 11, 513-520. (Pubitemid 41208932)
5. Browne, W. J., & Subramanian, K. J. (2005). Variance partitioning in multilevel logistic models that exhibit overdispersion. Journal of the Royal Statistical Society, 168, 599-613. doi:10.1111/j.1467-985X.2004 .00365.x (Pubitemid 40900539)
6. Constantino, M. J., Castonguay, M. G., & Schut, A. J. (2002). The working alliance: A flagship for the scientist-practitioner model in psychotherapy. In G. S. Tryon (Ed.), Counseling based on process research: Applying what we know (pp. 81-131). Boston, MA: Allyn & Bacon.
7. Crits-Christoph, P., Gallop, R., Temes, C. M., Woody, G., Ball, S. A., Martino, S., & Carroll, K. M. (2009). The alliance in motivational enhancement therapy and counseling as usual for substance use problems. Journal of Consulting and Clinical Psychology, 77, 1125-1135. doi:10.1037/a0017045
8. Crits-Christoph, P., Gibbons, M. B. C., Hamilton, J., Ring-Kurtz, S., & Gallop, R. (2011). The dependability of alliance assessments: The alliance-outcome correlation is larger than you might think. Journal of Consulting and Clinical Psychology, 79, 267-278. doi:10.1037/a0023668
9. Crosier, M., Scott, J., & Steinfield, B. (2011). Improving satisfaction in patients receiving mental health care: A case study. Journal of Behavioral Health Services & Research, Online First. doi:10.1007/s11414-011- 9252-0
10. Dinger, U., Strack, M., Leichsenring, F., Wilmers, F., & Schauenburg, H. (2008). Therapist effects on outcome and alliance in inpatient psychotherapy. Journal of Clinical Psychology, 64, 344-354. doi:10.1002/jclp .20443 (Pubitemid 351450390)
11. Elvins, R., & Green, J. (2008). The conceptualization and measurement of therapeutic alliance: An empirical review. Clinical Psychology Review, 28, 1167-1187. doi:10.1016/j.cpr.2008.04.002
12. Flückiger, C., Del Re, A. C., Wampold, B. E., Symonds, D., & Horvath, A. O. (2012). How central is the alliance in psychotherapy? A multilevel longitudinal meta-analysis. Journal of Counseling Psychology, 59, 10-17. doi:10.1037/a0025749
13. Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models. New York, NY: Cambridge University Press. doi:10.1017/CBO9780511790942
14. Hatcher, R. L., & Barends, A. W. (2006). How a return to theory could help alliance research. Psychotherapy: Theory, Research, Practice, Training, 43, 292-299. doi:10.1037/0033-3204.43.3.292 (Pubitemid 44454298)
15. Hatcher, R. L., Barends, A., Hansell, J., & Gutfreund, M. J. (1995).Patients' and therapists' shared and unique views of the therapeutic alliance: An investigation using confirmatory factor analysis in a nested design. Journal of Consulting and Clinical Psychology, 63, 636-643. doi:10.1037/0022-006X.63.4.636
16. Hatcher, R. L., & Gillaspy, J. A. (2006). Development and validation of a revised short version of the working alliance inventory. Psychotherapy Research, 16, 12-25. doi:10.1080/10503300500352500 (Pubitemid 43135565)
17. Horvath, A. O., Del Re, A. C., Flückiger, C., & Symonds, D. (2011). Alliance in individual psychotherapy. Psychotherapy, 48, 9-16. doi: 10.1037/a0022186
18. Horvitz-Lennon, M., Normand, S., Frank, R., & Goldman, H. (2003). "Usual care" for major depression in the 1990s: Characteristics and expert-estimated outcomes. The American Journal of Psychiatry, 160, 720-726. doi:10.1176/appi.ajp.160.4.720 (Pubitemid 41079605)
19. Hox, J. J. (2002). Multilevel analysis techniques and applications. Mahwah, NJ: Erlbaum.
20. Hoyt, W. T. (2002). Bias in participant ratings of psychotherapy process: An initial generalizability study. Journal of Counseling Psychology, 49, 35-46. doi:10.1037/0022-0167.49.1.35 (Pubitemid 34092404)
21. Lewis, M. (2003). Moneyball: The art of winning an unfair game. New York, NY: Norton.
22. Lunn, D. J., Thomas, A., Best, N., & Spiegelhalter, D. (2000). Win-BUGS-a Bayesian modelling framework: Concepts, structure, and extensibility. Statistics and Computing, 10, 325-337. doi:10.1023/A: 1008929526011
23. Maas, C. J. M., & Hox, J. J. (2005). Sufficient sample sizes for multilevel modeling. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 1, 86-92. doi:10.1027/1614-2241.1 .3.85
24. Marcus, D. K., Kashy, D. A., & Baldwin, S. A. (2009). Studying psychotherapy using the one-with-many design: The therapeutic alliance as an exemplar. Journal of Counseling Psychology, 56, 537-548. doi:10.1037/a0017291
25. Marcus, D. K., Kashy, D. A., Wintersteen, M. B., & Diamond, G. S. (2011). The therapeutic alliance in adolescent substance abuse treatment: A one-with-many analysis. Journal of Counseling Psychology, 58, 449-455. doi:10.1037/a0023196
26. Nissen-Lie, H. A., Monsen, J. T., & Ronnestad, M. H. (2010). Therapist predictors of early patient-rated working alliance: A multilevel approach. Psychotherapy Research, 20, 627-646. doi:10.1080/10503307 .2010.497633
27. Norcross, J. (Ed.). (2011). Psychotherapy relationships that work: Evidence based responsiveness (2nd ed.). New York, NY: Oxford.
28. Owen, J., & Hilsenroth, M. J. (2011). Interaction between alliance and technique in predicting patient outcome during psychodynamic psychotherapy. The Journal of Nervous and Mental Disease, 199, 384-389. doi:10.1097/NMD. 0b013e31821cd28a
29. Owen, J. J., Quirk, K., Hilsenroth, M. J., & Rodolfa, E. (2011). Working through: In-session processes that promote between-session thoughts and activities. Journal of Counseling Psychology. Advance online publication. doi:10.1037/a0023616
30. Owen, J. J., Rhoades, G. K., Stanley, S. M., & Markman, H. J. (2011). The role of leaders' working alliance in premarital education. Journal ofFamily Psychology, 25, 49-57. doi:10.1037/a0022084
31. Owen, J. J., Tao, K., Leach, M. M., & Rodolfa, E. (2011). Clients' perceptions of their psychotherapists' multicultural orientation. Psychotherapy, 48, 274-282. doi:10.1037/a0022065
32. Owen, J. J., Tao, K., & Rodolfa, E. (2010). Microaggressions and women in short-term psychotherapy: Initial evidence. The Counseling Psychologist, 38, 923-946.
33. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
34. Simon, G. E., & Ludman, E. J. (2010). Predictors of early dropout from psychotherapy for depression in community practice. Psychiatric Services, 61, 684-689. doi:10.1176/appi.ps.61.7.684
35. Simon, G. E., Ludman, E. J., Tutty, S., Operskalski, B., & Von Korff, M. (2004). Telephone psychotherapy and telephone care management for primary care patients starting antidepressant treatment: A randomized controlled trial. JAMA: Journal of the American Medical Association, 292, 935-942. doi:10.1001/jama.292.8.935 (Pubitemid 39097203)
36. Simon, G., Rutter, C., Crosier, M., Scott, J., Operskalski, B. H., & Ludman, E. (2009). Are comparisons of consumer satisfaction with providers biased by nonresponse or case mix differences? Psychiatric Services, 60, 67-73. doi:10.1176/appi.ps.60.1.67
37. Strauss, J. L., Hayes, A. M., Johnson, S. L., Newman, C. F., Brown, G. K., Barber, J. P., . . . Beck, A. T. (2006). Early alliance, alliance ruptures, and symptom change in a nonrandomized trial of cognitive therapy for avoidant and obsessive-compulsive personality disorders. Journal of Consulting and Clinical Psychology, 74, 337-345. doi:10.1037/0022-006X.74.2.337 (Pubitemid 43807365)
38. Wampold, B. E., & Brown, G. S. (2005). Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73, 914-923. doi:10.1037/0022-006X.73.5.914 (Pubitemid 41643241)
39. Zuroff, D. C., Kelly, A. C., Leybman, M. J., Blatt, S. J., & Wampold, B. E. (2010). Between-therapist and within-therapist differences in the quality of the therapeutic relationship: Effects on maladjustment and self-critical perfectionism. Journal of Clinical Psychology, 66, 681-697.