The outcome of psychotherapy: Yesterday, today, and tomorrow

Psychotherapy

Volumn 50, Issue 1, 2013, Pages 88-97

  Miller, Scott D ^a   Hubble, Mark A ^a   Chow, Daryl L ^a   Seidel, Jason A ^a  

^a International Center for Clinical Excellence   (United States)

Author keywords

Excellence; Outcome; Practice based evidence; Psychotherapy; Therapist variability

Indexed keywords

ARTICLE; EVIDENCE BASED PRACTICE; HUMAN; MEDICAL LITERATURE; PSYCHOTHERAPIST; PSYCHOTHERAPY; SIMULATION; TREATMENT OUTCOME;

CURRICULUM; FORECASTING; HUMANS; LONGITUDINAL STUDIES; MENTAL DISORDERS; OUTCOME ASSESSMENT (HEALTH CARE); PROFESSIONAL COMPETENCE; PROFESSIONAL-PATIENT RELATIONS; PSYCHOTHERAPY; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH; TREATMENT OUTCOME; UNITED STATES;

EID: 84875298987     PISSN: 00333204     EISSN: 19391536     Source Type: Journal    
DOI: 10.1037/a0031097     Document Type: Article

References (119)

1. Addiction and Mental Health Services. (2011). AMH approved practices and process. Retrieved from http://www.oregon.gov/oha/amh/pp./ebp/practices.aspx
2. American Psychological Association. (2004). Communicating the value of psychology to the public. Washington, DC: American Psychological Association.
3. American Psychological Association. (2012, August 9). Resolution on the recognition of psychotherapy effectiveness. American Psychological Association. Retrieved from http://www.apa.org/news/press/releases/2012/08/resolution-psychotherapy.aspx
4. American Psychological Association Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271-285.
5. Anderson, T., Ogles, B., Patterson, C., Lambert, M., & Vermeersch, D. (2009). Therapist effects: Facilitative interpersonal skills as a predictor of therapist success. Journal of Clinical Psychology, 65, 755-768.
6. Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting & Clinical Psychology, 77, 693-704.
7. APA Monitor. (2010, April). Psychology salaries decline. Monitor on Psychology, 41, 11.
8. Atkins, D. C., & Christiansen, A. (2001). Is professional training worth the bother? A review of the impact of psychotherapy training on client outcome. Australian Psychologist, 36, 122-130.
9. Bachelor, A., & Horvath, A. (1999). The therapeutic relationship. In M. A. Hubble, B. L. Duncan, & S. D. Miller (Eds.), The heart and soul of change: What works in therapy (pp. 133-178). Washington, DC: American Psychological Association.
10. Baldwin, S., Wampold, B., & Imel, Z. (2007). Untangling the allianceoutcome correlation: Exploring the relative importance of therapist and patient variability in the alliance. Journal of Consulting and Clinical Psychology, 75, 842-852.
11. Barlow, D. H. (2004). Psychological treatments. American Psychologist, 59, 869-878.
12. Benish, S. G., Imel, Z., & Wampold, B. (2008). The relative efficacy of bona fide psychotherapies for treating posttraumatic stress disorder: A meta-analysis of direct comparisons. Clinical Psychology Review, 28, 746-758.
13. Berg, I. K., & Miller, S. D. (1992). Working with the problem drinker: A solution-focused approach. New York: Norton.
14. Bertolino, B., & Miller, S. D. (Eds.) (2012). ICCE manuals on feedbackinformed treatment (Vol. 1-6). Chicago, IL: ICCE Press.
15. Beutler, L. E., Malik, M., Alimohamed, S., Harwood, T. M., Talebi, H., Noble, S., & Wong, E. (2004). Therapist variables. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (5th ed., pp. 227-306). New York: Wiley.
16. Bickman, L., Rosof-Williams, J., Salzer, M. S., Summerfelt, W., Noser, K., Wilson, S. J., & Karver, M. S. (2000). What information do clinicians value for monitoring adolescent client progress and outcomes? Professional Psychology: Research and Practice, 31, 70-74.
17. Bohanske, R., & Franczak, M. (2010). Transforming public behavioral health care: A case example of consumer-directed services, recovery, and the common factors. In B. Duncan, S. Miller, B. Wampold, & M. Hubble (Eds.), The heart and soul of change: Delivering what works in therapy (2nd ed., pp. 299-322). Washington, DC: APA Press.
18. Bordin, E. S. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, Research, and Practice, 16, 252-260.
19. Bradshaw, J. (2012, September). Petition seeks to dump DSM and adopt ICD. National Psychologist. Retrieved from http://nationalpsychologist.com/2012/09.
20. Brown, G. S., & Minami, T. (2010). Outcomes management, reimbursement, and the future of psychotherapy. In B. Duncan, S. Miller, B. Wampold, & M. Hubble (Eds.), The heart and soul of change: Delivering what works in therapy (2nd ed., pp. 267-297). Washington, DC: APA Press.
21. Chambless, D. L., & Hollon, S. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7-18.
22. Chow, D., Miller, S. D., Kane, R., & Thornton, J. (n.d.). The study of supershrinks: Development and deliberate practices of highly effective psychotherapists. Manuscript in preparation.
23. Clay, R. A. (2012). Improving disorder classification, worldwide. Monitor on Psychology, 43, 40.
24. Colvin, G. (2008). Talent is overrated: What really separates world-class performers from everybody else. New York: Penguin.
25. Cooper, J. L., & Aratani, Y. (2009). The status of states' policies to support evidence-based practices in children's mental health. Psychiatric Services, 60, 1672-1675.
26. Coyle, D. (2009). The talent code: Greatness isn't born. It's grown. Here's how. New York: Bantam Dell.
27. Crits-Christoph, P., Baranackie, K., Kurcias, J., Beck, A. T., Carroll, K., Perry, K., Zitrin, C. (1991). Meta-analysis of therapist effects in psychotherapy outcome studies. Psychotherapy Research, 1, 81-91.
28. Crits-Christoph, P., & Mintz, J. (1991). Implications of therapist effects for the design and analysis of comparative studies of psychotherapies. Journal of Consulting and Clinical Psychology, 59, 20-26.
29. Cummings, N., & O'Donohue, W. (2008). Eleven blunders that cripple psychotherapy in America: A remedial unblundering. New York: Routledge.
30. de Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22, 464-474.
31. Duncan, B. (2010). On becoming a better therapist. Washington, DC: APA Press.
32. Duncan, B. L., Miller, S. D., Reynolds, L., Sparks, J., Claud, D., Brown, J., & Johnson, L. D. (2003). The session rating scale: Preliminary psychometric properties of a "working" alliance scale. Journal of Brief Therapy, 3, 3-12.
33. Duncan, B. L., Miller, S. D., Wampold, B. E., & Hubble, M. A. (Eds.). (2010). The heart and soul of change: Delivering what works in therapy (2nd ed.) Washington, DC: APA Press.
34. Eid, M., & Larsen, R. J. (2008). The science of subjective well-being. New York: Guilford.
35. Ericsson, K. A. (1996). The acquisition of expert performance: An introduction to some of the issues. In K. A. Ericsson (Ed.), The road to excellence: The acquisition of expert performance in the arts and sciences, sports, and games (pp. 1-50). Mahwah, NJ: Lawrence Erlbaum Associates.
36. Ericsson, K. A. (2006). The Influence of experience and deliberate practice on the development of superior expert performance. In K. A. Ericsson, N. Charness, P. J. Feltovich & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 683-703). Cambridge: Cambridge University Press.
37. Ericsson, K. A. (2009a). Enhancing the development of professional performance: Implications from the study of deliberate practice. In Development of professional expertise: Toward measurement of expert performance and design of optimal learning environments (pp. 405-431). New York: Cambridge University Press.
38. Ericsson, K. A. (Ed.). (2009b). Development of professional expertise: Toward measurement of expert performance and design of optimal learning environments. New York: Cambridge University Press.
39. Ericsson, K. A., Charness, N., Feltovich, P. J., & Hoffman, R. R. (2006). The Cambridge handbook of expertise and expert performance. Cambridge: Cambridge University Press.
40. Ericsson, K. A., Krampe, R. T., & Tesch-Romer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100, 363-406.
41. Ericsson, K. A., & Staszewski, J. (1989). Skilled memory and expertise: Mechanisms of exceptional performance. In D. Klahr & K. Kotovsky (Eds.), Complex information processing: The Impact of Herbert A. Simon (pp. 265-268). Hillsdale, NJ: Lawrence Erlbaum.
42. Eysenck, H. J. (1952). The effects of psychotherapy: An evaluation. Journal of Consulting Psychology, 16, 319-324.
43. Eysenck, H. (1964). The outcome problem in psychotherapy: A reply. Psychotherapy: Theory, Research & Practice, 1, 97-100.
44. Frank, J. D. (1992). Historical developments in research centers: The Johns Hopkins Psychotherapy Research Project. In D. K. Freedheim (Ed.), A history of psychotherapy: A century of change (pp. 392-396). Washington, DC: APA Press.
45. Frank, J. D., & Frank, J. B. (1991). Persuasion and healing: A comparative study of psychotherapy. Baltimore, MD: Johns Hopkins University Press.
46. Froyd, J., & Lambert, M. (1989, May). A 5-year survey of outcome measures in psychotherapy research. Paper presented at the Western Psychological Association Conference, Reno, NV.
47. Gambrill, E. (1990). Critical thinking in clinical practice. San Francisco, CA: Jossey-Bass.
48. Garfield, S. L. (1997). The therapist as a neglected variable in psychotherapy research. Clinical Psychology: Science & Practice, 4, 40-43.
49. Grencavage, L. M., & Norcross, J. C. (1990). Where are the commonalities among the therapeutic common factors? Professional Psychology: Research and Practice, 21, 372-378.
50. Hatfield, D. R., & Ogles, B. M. (2004). The use of outcome measures by psychologists in clinical practice. Professional Psychology: Research and Practice, 35, 485-491.
51. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. San Diego, CA: Academic Press.
52. Hilgard, E. (1987). Psychology in American: A historical survey. New York: HBJ.
53. Horvath, A. (2001). The alliance. Psychotherapy: Theory/Research/ Practice/Training, 38, 365-372.
54. Horvath, A. O., Del Re, A., Fluckiger, C., & Symonds, D. (2011). Alliance in individual psychotherapy. Psychotherapy, 48, 9-16.
55. Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059-1064.
56. Imel, Z. E., Wampold, B. E., Miller, S. D., & Fleming, R. R. (2008). Distinctions without a difference: Direct comparisons of psychotherapies for alcohol use disorders. Psychology of Addictive Behaviors, 22, 533-543.
57. Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19.
58. Johnson, L. D. (1995). Psychotherapy in the age of accountability. New York: Norton.
59. Kim, D.-M., Wampold, B. E., & Bolt, D. M. (2006). Therapist effects in psychotherapy: A random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Psychotherapy Research, 16, 161-172.
60. Lambert, M. J. (2010). Yes, it is time for clinicians to routinely monitor treatment outcome. In B. Duncan, S. Miller, B. Wampold, & M. Hubble (Eds.), The heart and soul of change: Delivering what works in treatment (pp. 239-266). Washington, DC: APA Press.
61. Lambert, M. J. (2012). Helping clinicians to use and learn from researchbased systems: The OQ-analyst. Psychotherapy (Chicago, Ill), Training, 49, 109-114.
62. Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48, 72-79.
63. Lambert, M. J., Whipple, J. L., Smart, D. W., Vermeersch, D. A., Nielsen, S. L., & Hawkins, E. J. (2001). The effects of providing therapists with feedback on patient progress during psychotherapy: Are outcomes enhanced? Psychotherapy Research, 11, 49-68.
64. Luborsky, L. (1954). Selecting psychiatric residents: Survey of the Topeka research. Bulletin of the Menninger Clinic, 18, 252-259.
65. Luborsky, L., Crits-Christoph, P., Mclellan, A. T., Woody, G., Piper, W., Liberman, B., Imber, S., & Pilkonis, P. (1986). Do therapists vary much in their success? Findings from four outcome studies. American Journal of Orthopsychiatry, 56, 501-512.
66. Luborsky, L., McClellan, A. T., Diguer, L., Woody, G., & Seligman, D. A. (1997). The psychotherapist matters: Comparison of outcomes across twenty-two therapists and seven patient samples. Clinical Psychology: Science and Practice, 4, 53-65.
67. Luborsky, L., McClellan, A. T., Woody, G. E., O'Brien, C. P., & Auerbach, A. (1985). Therapist success and its determinants. Archives of General Psychiatry, 42, 602-611.
68. Lutz, W., Leon, S. C., Martinovich, Z., Lyons, J. S., & Stiles, W. B. (2007). Therapist effects in outpatient psychotherapy: A three-level growth curve approach. Journal of Counseling Psychology, 54, 32-39.
69. Miller, S. D. (2010a). Finding feasible measures for practice-based evidence. Top Performance Blog. Retrieved from http://www.scottdmiller.com/?q=taxonomy/term/70.
70. Miller, S. D. (2010b). Feedback, friends, and outcome in behavioral health. Top Performance Blog. Retrieved from http://www.scottdmiller.com/?q=taxonomy/term/70.
71. Miller, S. D., & Berg, I. K. (1995). The miracle method: A radically new approach to problem drinking. New York: Norton.
72. Miller, S. D., & Duncan, B. L. (2000). The outcome and session rating scales. Chicago, IL: International Center for Clinical Excellence. Retrieved from http://www.scottdmiller.com/?q=node/6.
73. Miller, S. D., Duncan, B. L., Brown, J., Sorrell, R., & Chalk, M. B. (2006). Using formal client feedback to improve retention and outcome: Making ongoing real-time assessment feasible. Journal of Brief Therapy, 5, 5-22.
74. Miller, S. D., Duncan, B. L., Brown, J., Sparks, J., & Claud, D. (2003). The outcome rating scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy, 2, 91-100.
75. Miller, S. D., Duncan, B. L., & Hubble, M. A. (1997). Escape from Babel: Toward a unifying language for psychotherapy practice. New York: Norton.
76. Miller, S. D., Duncan, B. L., & Hubble, M. A. (2004). Beyond integration: The triumph of outcome over process in clinical practice. Psychotherapy in Australia, 10, 2-19.
77. Miller, S. D., Duncan, B. L., Sorrell, R., & Brown, J. (2005). The partners for change outcome management system. Journal of Clinical Psychology, 61, 199-208.
78. Miller, S. D., & Hubble, M. (2011). The road to mastery. Psychotherapy Networker, 35(2), 22-60.
79. Miller, S. D., Hubble, M. A., & Duncan, B. L. (2007). Supershrinks. Psychotherapy Networker, 31, 26-35, 56.
80. Miller, S. D., Hubble, M. A., Duncan, B. L., & Wampold, B. (2010). Delivering what works. In B. L. Duncan, S. D. Miller, B. E. Wampold, & M. A. Hubble (Eds.), The heart and soul of change: Delivering what works in therapy (pp. 421-429). Washington, DC: APA Press.
81. Miller, S. D., Maeschalck, C., Axsen, R., & Seidel, J. (2011). The international center for clinical excellence core competencies. Retrieved from http://centerforclinicalexcellence.com/wp-content/plugins/buddypress-group-documents/documents/1281032711-CoreCompetencies.pdf.
82. Moore, D. S. (1994). The craft of teaching. Address at the award ceremony for distinguished college or university teaching of mathematics. San Francisco, CA. Retrieved from http://www.stat.purdue.edu/~dsmoore/articles/Craft.pdf.
83. Najavits, L., & Strupp, H. (1994). Differences in the effectiveness of psychodynamic therapies: A process-outcome study. Psychotherapy, 31, 114-123.
84. Nathan, P. E. (1997). Fiddling while psychology burns? Register Report, 23, 1, 4-5, 10.
85. Neimeyer, G., Taylor, J., & Wear, D. (2009). Continuing education in psychology: Outcomes, evaluation, and mandates. Professional Psychology: Research and Practice, 40, 617-624.
86. Nissen-Lie, H. A., Monsen, J. T., & Ronnestad, M. H. (2010). Therapist predictors of early patient-rated working alliance: A multilevel approach. Psychotherapy Research, 20, 627-646.
87. Norcross, J. C. (1997). Emerging breakthroughs in psychotherapy integration: Three predictions and one fantasy. Psychotherapy: Theory, Research, Practice, Training, 34, 86-90.
88. Norcross, J. (1999). Foreword. In M. A. Hubble, B. L. Duncan, & S. D. Miller (Eds.). The heart and soul of change (pp. xvii-xix).
89. Norcross, J. C. (2010). The therapeutic relationship. In B. L. Duncan, S. D. Miller, B. E. Wampold & M. A. Hubble (Eds.), The heart and soul of change: Delivering what works in therapy (2nd ed., pp. 113-142). Washington, DC: American Psychological Association.
90. Nyman, S., Nafziger, M., & Smith, T. (2010). Client outcomes across counselor training level within a multitiered supervision model. Journal of Counseling & Development, 88, 204-209.
91. Ogles, B. M., Lambert, M. J., & Fields, S. (2002). Essentials of outcome assessment. New York: John Wiley & Sons.
92. Ogles, B., Lambert, M., & Masters, K. (1996). Assessing outcome in clinical practice. Needham Heights, MA: Allyn & Bacon.
93. Okiishi, J. C., Lambert, M. J., Eggett, D., Nielsen, S. L., Dayton, D. D., & Vermeersch, D. A. (2006). An analysis of therapist treatment effects: Toward providing feedback to individual therapists on their patients' psychotherapy outcome. Journal of Clinical Psychology, 62, 1157-1172.
94. Okiishi, J. C., Lambert, M. J., Nielsen, S. L., & Ogles, B. M. (2003). Waiting for supershrink: An empirical analysis of therapist effects. Clinical Psychology & Psychotherapy, 10, 361-373.
95. Orlinsky, D. E., & Ronnestad, M. H. (2005). How psychotherapists develop: A study of therapeutic work and professional growth. Washington, DC: American Psychological Association.
96. Phelps, R., Eisman, E., & Kohout, J. (1998). Psychological practice and managed care: Results of the CAPP practitioner survey. Professional Psychology: Research and Practice, 29, 31-36.
97. Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy: Theory, Research, Practice, Training, 46, 418-431.
98. Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010). Effect of client feedback on couple psychotherapy outcomes. Psychotherapy: Theory, Research, Practice, Training December, 47, 616-630.
99. Rosenzweig, S. (1954). A transvaluation of psychotherapy: A reply to Hans Eysenck. The Journal of Abnormal and Social Psychology, 49, 298-304.
100. Schenkenberg, T., Bradford, D., & Ajax, E. (1980). Line bisection and unilater visual neglect in patients with neurological impairment. Neurology, 30, 509-517.
101. Shapiro, D. A., Firth-Cozens, J., & Stiles, W. B. (1989). The question of therapists' differential effectiveness: A Sheffield Psychotherapy Project addendum. British Journal of Psychiatry, 154, 383-385.
102. Shenk, D. (2010). The genius in all of us: Why everything you've been told about genetics, talent, and IQ is wrong. New York: Random House.
103. Smith, M. L., & Glass, G. V. (1977). Meta-analysis of psychotherapy outcome studies. American Psychologist, 32, 752-760.
104. Strupp, H. (1963). The outcome problem in psychotherapy revisited. Psychotherapy: Theory, Research & Practice, 1, 1-13.
105. Strupp, H. (1964). The outcome problem in psychotherapy: A rejoinder. Psychotherapy: Theory, Research & Practice, 1, 101.
106. Strupp, H., & Anderson, T. (1997). On the limitations of therapy manuals. Clinical Psychology: Science and Practice, 4, 76-82.
107. Syed, M. (2010). Bounce: Mozart, Federer, Picasso, Beckham, and the science of success. New York: Harper Collins.
108. Therapy in America. (2004). A survey conducted by Harris Interactive on behalf of Psychology Today and Pacificare Behavioral Health. Retrieved from http://www.napabipolardepression.org/images/therapy_in_america.pdf.
109. VandenBos, G. R., Cummings, N., & DeLeon, P. H. (1992). A century of psychotherapy: Economic and environmental influences. In D. K. Freedheim (Ed.), A history of psychotherapy: A century of change. Washington, DC: APA Press.
110. Walfish, S., McAlister, B., O'Donnell, P., & Lambert, M. J. (2012). An investigation of self-assessment bias in mental health providers. Psychological Reports, 110, 639-644.
111. Wampold, B. E. (2001). The great psychotherapy debate: Models, methods, and findings. Mahwah, NJ: Erlbaum.
112. Wampold, B. E. (2005). Establishing specificity in psychotherapy scientifically: Design and evidence issues. Clinical Psychology: Science & Practice Summer, 12, 194-197.
113. Wampold, B. E. (2010). The research evidence for the common factor models: A historically situated perspective. In B. L. Duncan, S. D. Miller, B. E. Wampold & M. A. Hubble (Eds.), The heart and should of change: Delivering what works in therapy (2nd ed., pp. 49-82). Washington, DC: American Psychological Association.
114. Wampold, B. E., & Bolt, D. M. (2006). Therapist effects: Clever ways to make them (and everything else) disappear. Psychotherapy Research, 16, 184-187.
115. Wampold, B. E., & Brown, G. S. (2005). Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73, 914-923.
116. Wampold, B. E., Mondin, G. W., Moody, M., & Ahn, H.-n. (1997). The flat earth as a metaphor for the evidence for uniform efficacy of bona fide psychotherapies: Reply to Crits-Christoph (1997), and Howard et al. (1997). Psychological Bulletin, 122, 226-230.
117. Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-n. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empirically, "all must have prizes." Psychological Bulletin, 122, 203-215.
118. Wilson, G. T. (1995). Empirically validated treatments as a basis for clinical practice: Problems and prospects. In S. C. Hayes, V. M. Follette, R. M. Dawes, & K. E. Grady (Eds.), Scientific standards of psychological practice: Issues and recommendations (pp. 163-196). Reno, NV: Context Press.
119. Zuriff, G. E. (1985). Behaviorism: A conceptual reconstruction. New York: Columbia University Press.