The good, the bad, and the ugly: A 50-year perspective on the outcome problem

Psychotherapy

Volumn 50, Issue 1, 2013, Pages 16-24

  Wampold, Bruce E ^a,b  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b MODUM BAD PSYCHIATRIC CENTER   (Norway)

Author keywords

Effectiveness; Outcome; Process; Relative effectiveness

Indexed keywords

ARTICLE; BEHAVIOR THERAPY; CLINICAL EFFECTIVENESS; CLINICAL RESEARCH; COGNITIVE THERAPY; DIAGNOSTIC AND STATISTICAL MANUAL OF MENTAL DISORDERS; EVIDENCE BASED PRACTICE; GENERAL PRACTITIONER; HEALTH CARE QUALITY; HUMAN; MENTAL FUNCTION; NEUROSIS; POSTTRAUMATIC STRESS DISORDER; PSYCHOANALYSIS; PSYCHODYNAMICS; PSYCHOTHERAPY; TREATMENT OUTCOME;

HUMANS; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); PSYCHOTHERAPY;

EID: 84875361051     PISSN: 00333204     EISSN: 19391536     Source Type: Journal    
DOI: 10.1037/a0030570     Document Type: Article

References (91)

1. Andrews, G., & Harvey, R. (1981). Does psychotherapy benefit neurotic patients? A reanalysis of the Smith, Glass, & Miller data. Archives of General Psychiatry, 38, 1203-1208.
2. Anestis, M. D., Anestis, J. C., & Lilienfeld, S. O. (2011). When it comes to evaluating psychodynamic therapy, the devil is in the details. American Psychologist, 66, 149-151.
3. Baker, T. B., McFall, R. M., & Shoham, V. (2008). Current status and future prospects of clinical psychology: Toward a scientifically principled approach to mental and behavioral health care. Psychological Science in the Public Interest, 9, 67-103.
4. Baldwin, S. A., Berkeljon, A., Atkins, D. C., Olsen, J. A., & Nielsen, S. L. (2009). Rates of change in naturalistic psychotherapy: Contrasting dose-effect and good-enough level models of change. Journal of Consulting and Clinical Psychology, 77, 203-211.
5. Beck, A. T., & Bhar, S. S. (2009). 'Effectiveness of long-term psychodynamic psychotherapy: A meta-analysis': Comment. Journal of the American Medical Association: Journal of the American Medical Association, 301, 930-933.
6. Beck, A. T., Rush, A. J., Shaw, B. F., & Emery, G. (1979). Cognitive therapy of depression. New York: Guilford Press.
7. Benish, S. G., Imel, Z. E., & Wampold, B. E. (2008). The relative efficacy of bona fide psychotherapies of post-traumatic stress disorder: A metaanalysis of direct comparisons. Clinical Psychology Review, 28, 746-758.
8. Bergin, A. E. (1971). The evaluation of therapeutic outcomes. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change (pp. 217-270). New York: Wiley.
9. Bhar, S. S., & Beck, A. T. (2009). Treatment integrity of studies that compare short-term psychodynamic psychotherapy with cognitivebehavior therapy. Clinical Psychology: Science and Practice, 16, 370-378.
10. Bhar, S. S., Thombs, B. D., Pignotti, M., Bassel, M., Jewett, L., Coyne, J. C., & Beck, A. T. (2010). Is longer-term psychodynamic psychotherapy more effective than shorter-term therapies? Review and critique of the evidence. Psychotherapy and Psychosomatics, 79, 208-216.
11. Clark, D. M., Fairburn, C. G., & Wessely, S. (2008). Psychological treatment outcomes in routine NHS services: A commentary on Stiles et al. Psychological Medicine, 38, 629-634.
12. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis for field settings. Chicago, IL: Rand McNally.
13. Coyne, J. C., Bhar, S. S., Pignotti, M., Tovote, K. A., & Beck, A. T. (2011). Missed opportunity to rectify or withdraw a flawed metaanalysis of longer-term psychodynamic psychotherapy. Psychotherapy and Psychosomatics, 80, 53-54.
14. Danziger, K. (1990). Constructing the subject: Historical origins of psychological research. Cambridge, UK: Cambridge University Press.
15. Dennhag, I., Connolly Gibbons, M. B., Barber, J. P., Gallop, R., & Crits-Christoph, P. (2012). How many treatment sessions and patients are needed to create a stable score of adherence and compentence in the treatment of cocaine dependence? Psychotherapy Research, 22, 475-488.
16. Ehlers, A., Bisson, J., Clark, D. M., Creamer, M., Pilling, S., Richards, D., Yule, W. (2010). Do all psychological treatments really work the same in posttraumatic stress disorder? Clinical Psychology Review, 30, 269-276.
17. Eysenck, H. J. (1952). The effects of psychotherapy: An evaluation. Journal of Consulting Psychology, 16, 319-324.
18. Eysenck, H. J. (1961). The effects of psychotherapy. In H. J. Eysenck (Ed.), Handbook of abnormal psychology. New York: Basic Books.
19. Eysenck, H. J. (1964). The outcome problem in psychotherapy: A reply. Psychotherapy: Theory, Research & Practice, 1, 97-100.
20. Eysenck, H. J. (1966). The effects of psychotherapy. New York: International science press.
21. Eysenck, H. J. (1978). An exercise in meta-silliness. American Psychologist, 33, 517.
22. Eysenck, H. J. (1984). Meta-analysis: An abuse of research integration. The Journal of Special Education, 18, 41-59.
23. Eysenck, H. J. (1990). Rebel with a cause (an autobiography). London: W. H. Allen.
24. Eysenck, H. J. (1995). Meta-analysis squared-does it make sense? American Psychologist, 50, 110-111.
25. Falkenström, F., Granström, F., & Holmqvist, R. (2012). Therapeutic alliance predicts symptomatic improvement session by session. Submitted for publication.
26. Fishman, D. B., & Franks, C. M. (1992). Evolution and differentiation within behavior therapy: A theoretical and epistemological review. In D. K. Freedheim (Ed.), History of psychotherapy: A century of change (pp. 159-196). Washington, DC: American Psychological Association.
27. Follette, W. C., & Houts, A. C. (1996). Models of scientific progress and the role of theory in taxonomy development: A case study of the DSM. Journal of Consulting and Clinical Psychology, 64, 1120-1132.
28. Gehan, E., & Lemak, N. A. (1994). Statistics in medical research: Developments in clinical trials. New York: Plenum Medical Book.
29. Glass, G. V., & Kliegl, R. M. (1983). An apology for research integration in the study of psychotherapy. Journal of Consulting and Clinical Psychology, 51, 28-41.
30. Glass, G. V., & Smith, M. L. (1978). A reply to Eysenck. American Psychologist, 33, 517-519.
31. Goldfried, M. R., & Wolfe, B. E. (1998). Toward a more clinically valid approach to therapy research. Journal of Consulting and Clinical Psychology, 66, 143-150.
32. Gould, S. J. (2000). Deconstructing the "science wars" by reconstructing an old mold. Science, 287, 253-261.
33. Greenberg, L. S. (1986). Research strategies. In L. S. Greenberg & W. M. Pinsof (Eds.), The psychotherapeutic process: A research handbook (pp. 707-734). New York: Guilford Press.
34. Grob, G. N. (1991). Origins of DSM-I: A study in appearance and reality. The American Journal of Psychiatry, 148, 421-431.
35. Hoffart, A., Borge, F.-M., Sexton, H., Clark, D. M., & Wampold, B. E. (2012). Psychotherapy for social phobia: How do alliance and cognitive process interact to produce outcome? Psychotherapy Research, 22, 82-94.
36. Hunt, M. (1997). How science takes stock: The story of meta-analysis. New York: Russell Sage Foundation.
37. Hunt, M., & Corman, R. (November 11, 1962). Analysis of psychoanalysis. New York Times.
38. Imel, Z. E., Baer, J. S., Martino, S., Ball, S. A., & Carroll, K. M. (2011). Mutual influence in therapist competence and adherence to motivational enhancement therapy. Drug and Alcohol Dependence, 115, 229-236.
39. Imel, Z. E., & Wampold, B. E. (2008). The common factors of psychotherapy. In S. D. Brown & R. W. Lent (Eds.), Handbook of counseling psychology (4th ed.). New York: Wiley.
40. Imel, Z. E., Wampold, B. E., Miller, S. D., & Fleming, R. R. (2008). Distinctions without a difference: Direct comparisons of psychotherapies for alcohol use disorders. Psychology of Addictive Behaviors, 22, 533-543.
41. Kazdin, A. E. (2009). Understanding how and why psychotherapy leads to change. Psychotherapy Research, 19, 418-428.
42. Kiesler, D. J. (1994). Standardization of intervention: The tie that binds psychotherapy research and practice. In P. F. Talley, H. H. Strupp & S. F. Butler (Eds.), Psychotherapy research and practice: Bridging the gap (pp. 143-153). New York: Basic Books.
43. Knight, R. P. (1941). Evaluation of the results of psychoanalytic therapy. American Journal of Psychiatry, 98, 434-446.
44. Lambert, M. J., & Ogles, B. M. (2004). The efficacy and effectiveness of psychotherapy. In M. J. Lambert (Ed.), Handbook of psychotherapy and behavior change (5th ed.). New York: John Wiley & Sons.
45. Landman, J. T., & Dawes, R. M. (1982). Psychotherapy outcome: Smith and Glass' conclusions stand up under scrutiny. American Psychologist, 37, 504-516.
46. Leichsenring, F., & Leibing, E. (2003). The effectiveness of psychodynamic therapy and cognitive behavior therapy in the treatment of personality disorders: A meta-analysis. American Journal of Psychiatry, 160, 1223-1231.
47. Leichsenring, F., & Rabung, S. (2011). Double standards in psychotherapy research. Psychotherapy and Psychosomatics, 80, 48-51.
48. Leichsenring, F., Rabung, S., & Leibing, E. (2004). The efficacy of short-term psychodynamic psychotherapy in specific psychiatric disorders. Archives of General Psychiatry, 61, 1208-1216.
49. Luborsky, L., & DeRubeis, R. J. (1984). The use of psychotherapy treatment manuals: A small revolution in psychotherapy research style. Clinical Psychology Review, 4, 5-14.
50. Luborsky, L., Singer, B., & Luborsky, L. (1975). Comparative studies of psychotherapies: Is it true that "Everyone has won and all must have prizes?" Archives of General Psychiatry, 32, 995-1008.
51. Mann, C. C. (1994). Can meta-analysis make policy? Science, 266, 960-962.
52. McDonagh, A., Friedman, M., McHugo, G., Ford, J., Sengupta, A., Mueser, K., Descamps, M. (2005). Randomized trial of cognitivebehavioral therapy for chronic posttraumatic stress disorder in adult female survivors of childhood sexual abuse. Journal of Consulting and Clinical Psychology, 73, 515-524.
53. McKay, D. (2011). Methods and mechanisms in the efficacy of psychodynamic psychotherapy. American Psychologist, 66, 147-148.
54. McNeilly, C. L., & Howard, K. I. (1991). The effects of psychotherapy: A reevaluation based on dosage. Psychotherapy Research, 1, 74-78.
55. Meltzoff, J., & Kornreich, M. (1970). Research in psychotherapy. Chicago, IL: Adline.
56. Miller, D. (1994). Critical rationalism: A restatement and defense. Chicago, IL: Open Court.
57. Miller, S. D., Wampold, B. E., & Varhely, K. (2008). Direct comparisons of treatment modalities for youth disorders: A meta-analysis. Psychotherapy Research, 18, 5-14.
58. Minami, T., Davies, D. R., Tierney, S. C., Bettmann, J. E., McAward, S. M., Averill, L. A., Wampold, B. E. (2009). Preliminary evidence on the effectiveness of psychological treatments delivered at a university counseling center. Journal of Counseling Psychology, 56, 309-320.
59. Minami, T., Wampold, B. E., Serlin, R. C., Hamilton, E., Brown, G. S., & Kircher, J. (2008). Benchmarking the effectiveness of psychotherapy treatment for adult depression in a managed care environment: A preliminary study. Journal of Consulting and Clinical Psychology, 76, 116-124.
60. Popper, K. (1963). Conjectures and refutations. London: Routledge.
61. Rachman, S. (1971). The effects of psychotherapy. Oxford: Pergammon Press.
62. Rachman, S., & Wilson, G. T. (1980). The effects of psychological therapy (2nd ed.). New York: Pergamon.
63. Shapiro, A. K., & Shapiro, E. S. (1997). The powerful placebo: From ancient priest to modern medicine. Baltimore, MD: The Johns Hopkins University Press.
64. Shedler, J. (2010). The efficacy of psychodynamic psychotherapy. American Psychologist, 65, 98-109.
65. Shedler, J. (2011). Science or Ideology. American Psychologist, 66, 152-154.
66. Smith, M. L., & Glass, G. V. (1977). Meta-analysis of psychotherapy outcome studies. American Psychologist, 32, 752-760.
67. Smith, M. L., Glass, G. V., & Miller, T. I. (1980). The benefits of psychotherapy. Baltimore, MD: The Johns Hopkins University Press.
68. Spielmans, G. I., Pasek, L. F., & McFall, J. P. (2007). What are the active ingredients in cognitive and behavioral psychotherapy for anxious and depressed children? A meta-analytic review. Clinical Psychology Review, 27, 642-654.
69. Stiles, W. B. (2008). Routine psychological treatment and the Dodo verdict: A rejoinder to Clark et al. Psychological Medicine, 38, 905-910.
70. Stiles, W. B., Barkham, M., Mellor-Clark, J., & Connell, J. (2008). Effectiveness of cognitive-behavioural, person-centred, and psychodynamic therapies in UK primary-care routine practice: Replication in a larger sample. Psychological Medicine, 38, 677-688.
71. Stiles, W. B., Barkham, M., Twigg, E., Mellor-Clark, J., & Cooper, M. (2006). Effectiveness of cognitive-behavioural, person-centred and psychodynamic therapies as practised in UK National Health Service settings. Psychological Medicine, 36, 555-566.
72. Strupp, H. H. (1963). The outcome problem in psychotherapy revisited. Psychotherapy: Theory, Research and Practice, 1, 1-13.
73. Strupp, H. H. (1964). The outcome problem in psychotherapy: A rejoinder. Psychotherapy: Theory, Research & Practice, 1, 97-100.
74. Task Force on Promotion and Dissemination of Psychological Procedures. (1995). Training in and dissemination of empirically-validated psychological treatment: Report and recommendations. The Clinical Psychologist, 48, 2-23.
75. Thombs, B. D., Jewett, L. R., & Bassel, M. (2011). Is there room for criticism of studies of psychodynamic psychotherapy? American Psychologist, 66, 148-149.
76. Wakefield, J. C. (1992). The concept of mental disorder: On the boundary between biological facts and social values. American Psychologist, 47, 373-388.
77. Wakefield, J. C. (1999). Evolutionary versus protype analyses of the concept of disorder. Journal of Abnormal Psychchology, 108, 374-399.
78. Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620-630.
79. Wampold, B. E. (1997). Methodological problems in identifying efficacious psychotherapies. Psychotherapy Research, 7, 21-43.
80. Wampold, B. E. (2001a). Contextualizing psychotherapy as a healing practice: Culture, history, and methods. Applied and Preventive Psychology, 10, 69-86.
81. Wampold, B. E. (2001b). The great psychotherapy debate: Model, methods, and findings. Mahwah, NJ: Lawrence Erlbaum Associates.
82. Wampold, B. E. (2007). Psychotherapy: The humanistic (and effective) treatment. American Psychologist, 62, 857-873.
83. Wampold, B. E. (in press). Humanism as a common factor in psychotherapy. Psychotherapy.
84. Wampold, B. E., & Budge, S. L. (2012). The 2011 Leona Tyler Award Address: The relationship-and its relationship to the common and specific factors of psychotherapy. The Counseling Psychologist, 40, 601-623.
85. Wampold, B. E., Imel, Z. E., Bhati, K. S., & Johnson Jennings, M. D. (2006). Insight as a common factor. In L. G. Castonguay & C. E. Hill (Eds.), Insight in psychotherapy. Washington, DC: American Psychological Association.
86. Wampold, B. E., Imel, Z. E., Laska, K. M., Benish, S., Miller, S. D., Flückiger, C., Budge, S. (2010). Determining what works in the treatment of PTSD. Clinical Psychology Review, 30, 923-933.
87. Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empirically, "All must have prizes". Psychological Bulletin, 122, 203-215.
88. Webb, C. A., DeRubeis, R. J., & Barber, J. P. (2010). Therapist adherence/competence and treatment outcome: A meta-analytic review. Journal of Consulting and Clinical Psychology, 78, 200-211.
89. Westen, D. (1998). The scientific legacy of Sigmund Freud: Toward a psychodynamically informed psychological science. Psychological Bulletin, 124, 333-371.
90. Widiger, T. A., & Trull, T. J. (2007). Plate tectonics in the classification of personality disorders: Shifting to a dimensional model. American Psychologist, 62, 71-83.
91. Wilson, G. T., & Rachman, S. J. (1983). Meta-analysis and the evaluation of psychotherapy outcome: Limitations and liabilities. Journal of Consulting and Clinical Psychology, 51, 54-64.