Evidence-based psychotherapies I: Qualifiers and limitations in what we know

South African Journal of Psychology

Volumn 44, Issue 4, 2014, Pages 381-403

  Kazdin, Alan E ^a  

^a YALE UNIVERSITY   (United States)

Author keywords

Evidence based psychotherapy; limitations of Evidence based treatments; psychotherapy outcome research

Indexed keywords

EID: 84909947850     PISSN: 00812463     EISSN: 2078208X     Source Type: Journal    
DOI: 10.1177/0081246314533750     Document Type: Article

References (90)

1. Achenbach T. M., Krukowski R. A., Dumenci L., Ivanova M. Y.. Assessment of adult psychopathology: Meta-analyses and implications of cross-informant correlations. Psychological Bulletin. 2005 ; 131: 361-382
2. Evidence-based practice in psychology. American Psychologist. 2006 ; 61: 271-285
3. Baldwin S. A., Christian S., Berkeljon A., Shadish W. R.. The effects of family therapies for adolescent delinquency and substance abuse: A meta-analysis. Journal of Marital and Family Therapy. 2012 ; 38: 281-304
4. Baskin T. W., Tierney S. C., Minami T., Wampold B. E.. Establishing specificity in psychotherapy: A meta-analysis of structural equivalence of placebo controls. Journal of Consulting and Clinical Psychology. 2003 ; 71: 973-979
5. Benedetti F. Placebo effects: Understanding the mechanisms in health and disease. New York, NY: Oxford University Press ; 2009 :
6. Blanton H., Jaccard J.. Arbitrary metrics in psychology. American Psychologist. 2006 ; 61: 27-41
7. Boot W. R., Simons D. J., Stothart C., Stutts C.. The pervasive problem with placebos in psychology: Why active control groups are not sufficient to rule out placebo effects. Perspectives on Psychological Science. 2013 ; 8: 445-454
8. Bullock J. G., Green D. P., Ha S. E.. Yes, but what's the mechanisms? Don't expect an easy answer. Journal of Personality and Social Psychology. 2010 ; 98: 550-558
9. Cahill J., Barkham M., Stiles W. B.. Systematic review of practice-based research on psychological therapies in routine clinic settings. British Journal of Clinical Psychology. 2010 ; 49: 421-453
10. Cavanagh K., Strauss C., Forder L., Jones F.. Can mindfulness and acceptance be learnt by self-help? A systematic review and meta-analysis of mindfulness and acceptance-based self-help interventions. Clinical Psychology Review. 2014 ; 34: 118-129
11. Chambless D. L., Ollendick T. H.. Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology. 2001 ; 52: 685-716
12. Christopherson E. R., Vanscoyoc S. Treatments that work with children: Empirically supported strategies for managing childhood problems. 2013 ). Treatments that work with children: Empirically supported strategies for managing childhood problems (2nd ed.). Washington, DC: American Psychological Association. Washington, DC: American Psychological Association ; 2013 :
13. Cohen J. S. Statistical power analysis in the behavioral sciences. 1988 ). Statistical power analysis in the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum. Hillsdale, NJ: Lawrence Erlbaum ; 1988 :
14. Cooper H., VandenBos G. R.. Archives of Scientific Psychology: A new journal for a new era. Archives of Scientific Psychology. 2013 ; 1 (1). 1-6
15. Davis M.. NMDA receptors and fear extinction: Implications for cognitive behavioral therapy. Dialogues in Clinical Neuroscience. 2011 ; 13: 463-474
16. Dawson G., Rogers S., Munson J., Smith M., Winter J., Greenson J.,... Varley J.. Randomized controlled trial of an intervention for toddlers with Autism: The Early Start Denver Model. Pediatrics. 2010 ; 125: e17 - e23
17. De Angelis C. D., Drazen J. M., Frizelle F. A., Haug C., Hoey J., Horton R., Weyden M. B. V. D.. Is this clinical trial fully registered? - A statement from the International Committee of Medical Journal Editors. New England Journal of Medicine. 2005 ; 352: 2436-2438
18. De Los Reyes A., Kazdin A. E.. Conceptualizing changes in behavior in intervention research: The Range of Possible Changes Model. Psychological Review. 2006 ; 113: 554-583
19. De Los Reyes A., Kazdin A. E.. When the evidence says, "yes, no, and maybe so": Attending to and interpreting inconsistent findings among evidence-based interventions. Current Directions in Psychological Science. 2008 ; 17: 47-51
20. De Los Reyes A., Thomas S. A., Goodman K. L., Kundey S. M.. Principles underlying the use of multiple informants' reports. Annual Review of Clinical Psychology. 2013 ; 9: 123-149
21. DeRubeis R. J., Cohen Z. D., Forand N. R., Fournier J. C., Gelfand L. A., Lorenzo-Luaces L.. The Personalized Advantage Index: Translating research on prediction into individualized treatment recommendations: A demonstration. PloS One. 2014 ; 9 (1). e83875
22. Doehrmann O., Ghosh S. S., Polli F. E., Reynolds G. O., Horn F., Keshavan A.,... Gabrieli J. D.. Predicting treatment response in social anxiety disorder from functional magnetic resonance imaging. JAMA Psychiatry. 2013 ; 70: 87-97
23. Driessen E., Van H. L., Don F. J., Peen J., Kook S., Westra D.,... Dekker J. J. M.. The efficacy of cognitive-behavioral therapy and psychodynamic therapy in the outpatient treatment of major depression: A randomized clinical trial. American Journal of Psychiatry. 2013 ; 170: 1041-1050
24. Druss B. G., Hwang I., Petukhova M., Sampson N. A., Wang P. S., Kessler R. C.. Impairment in role functioning in mental and chronic medical disorders in the US: Results from the National Comorbidity Survey Replication. Molecular Psychiatry. 2009 ; 14: 728-737
25. Duman C. H., Schlesinger L., Russell D. S., Duman R. S.. Voluntary exercise produces antidepressant and anxiolytic behavioral effects in mice. Brain Research. 2008 ; 1199: 148-158
26. The heart and soul of change: Delivering what works in therapy. 2010 ). The heart and soul of change: Delivering what works in therapy (2nd ed.). Washington, DC: American Psychological Association. Duncan B. L. Miller S. D. Wampold B. E. Hubble M. A., ed. Washington, DC: American Psychological Association ; 2010 :
27. Dwan K., Altman D. G., Arnaiz J. A., Bloom J., Chan A. W., Cronin E.,... Williamson P. R.. Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PloS One. 2008 ; 3: e3081
28. Eich E. P. R.. Business not as usual. Psychological Science. 2014 ; 25: 3-6
29. Finniss D. G., Kaptchuk T. J., Miller F., Benedetti F.. Biological, clinical, and ethical advances of placebo effects. Lancet. 2010 ; 375: 686-695
30. Frank E., Cassano G. B., Rucci P., Thompson W. K., Kraemer H. C., Fagiolini A.,... Forgione R. N.. Predictors and moderators of time to remission of major depression with interpersonal psychotherapy and SSRI pharmacotherapy. Psychological Medicine. 2011 ; 41: 151-162
31. Freedland K. E., Mohr D. C., Davidson K. W., Schwartz J. E.. Usual and unusual care: Existing practice control groups in randomized controlled trials of behavioral interventions. Psychosomatic Medicine. 2011 ; 73: 323-335
32. Frewen P. A., Dozois D. J. A., Lanius R. A.. Neuroimaging studies of psychological interventions for mood and anxiety disorders: Empirical and methodological review. Clinical Psychology Review. 2008 ; 28: 228-246
33. Furey M. L., Drevets W. C., Hoffman E. M., Frankel E., Speer A. M., Zarate C. A.. Potential of pretreatment neural activity in the visual cortex during emotional processing to predict treatment response to scopolamine in major depressive disorder. JAMA Psychiatry. 2013 ; 70: 280-290
34. Grant P. M., Beck A. T.. Cognitive therapy in patients with schizophrenia - Reply. JAMA Psychiatry. 2013 ; 70: 543-544
35. Grissom R. J.. The magical number.7 +/.2: Meta-meta-analysis of the probability of superior outcome in comparisons involving therapy, placebo, and control. Journal of Consulting and Clinical Psychology. 1996 ; 64: 973-982
36. Grissom R. J., Kim J. J. Effect sizes for research: Univariate and multivariate applications. 2011 ). Effect sizes for research: Univariate and multivariate applications (2nd ed.). New York, NY: Taylor & Francis. New York, NY: Taylor & Francis ; 2011 :
37. Harvey A. G., Lee J., Williams J., Hollon S. D., Walker M. P., Thompson M. A., Smith R.. Improving outcome of psychosocial treatments by enhancing memory and learning. Perspectives on Psychological Science. 2014 ; 9: 161-179
38. Hill C. E., Chui H., Baumann E.. Revisiting and re envisioning the outcome problem in psychotherapy: An argument to include individualized and qualitative measurement. Psychotherapy. 2013 ; 50: 68-76
39. Jacobson N. S., Roberts L. J., Berns S. B., McGlinchey J.. Methods for defining and determining the clinical significance of treatment effects in mental health research: Current status, new applications, and future directions. Journal of Consulting and Clinical Psychology. 1999 ; 67: 300-307
40. John L. K., Loewenstein G., Prelec D.. Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science. 2012 ; 23: 524-532
41. Joober R., Schmitz N., Annable L., Boksa P.. Publication bias: What are the challenges and can they be overcome?. Journal of Psychiatry & Neuroscience. 2012 ; 37: 149-152
42. Kam-Hansen S., Jakubowski M., Kelley J. M., Kirsch I., Hoaglin D. C., Kaptchuk T. J., Burstein R.. Altered placebo and drug labeling changes the outcome of episodic migraine attacks. Science Translational Medicine. 2014 ; 6: 218ra5
43. Kaplan R. M.. Special issue: Mediation and moderation. Health Psychology. 2008 ; 27: S99 - S100
44. Kazantzis N.. Power to detect homework effects in psychotherapy outcome research. Journal of Consulting and Clinical Psychology. 2000 ; 68: 166-170
45. Kazdin A. E. Evidence-based psychotherapies for children and adolescents. 2010 ). Problem-solving skills training and parent management training for Oppositional Defiant Disorder and Conduct Disorder. In WeiszJ. R.KazdinA. E. (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed., pp. 211-226). New York, NY: Guilford Press. Weisz J. R. Kazdin A. E., ed. New York, NY: Guilford Press ; 2010: 211-226.
46. Kazdin A. E.. Evidence-based treatment and usual care: Cautions and qualifications. JAMA Psychiatry. 2013 ; 70: 666-667
47. Kazdin A. E. Quantitative and qualitative methods in psychotherapy. Lutz W. Knox S., ed. New York, NY: Taylor & Francis ; 2014: 87-101.
48. Kazdin A. E. South African Journal of Psychology. Evidence-based psychotherapies II: New directions to extend impact of treatment ;
49. Kazdin A. E. Research design in clinical psychology. 5 th ed.). Boston, MA: Pearson. Boston, MA: Pearson ;
50. Kazdin A. E., Bass D.. Power to detect differences between alternative treatments in comparative psychotherapy outcome research. Journal of Consulting and Clinical Psychology. 1989 ; 57: 138-147
51. Kazdin A. E., Whitley M. K.. Comorbidity, case complexity, and effects of evidence-based treatment for children referred for disruptive behavior. Journal of Consulting and Clinical Psychology. 2006 ; 74: 455-467
52. Kessler R., Aguilar-Gaxiola S., Alonso J., Chatterji S., Lee S., Ormel J.,... Wang P.. The global burden of mental disorders: An update from the WHO World Mental Health (WMH) Surveys. Epidemiologia e Psichiatria Sociale. 2009 ; 18: 23-33
53. Kessler R. C., Demler O., Frank R. G., Olfson M., Pincus H. A., Walters E. E.,... Zaslavsky A. M.. Prevalence and treatment of mental disorders, 1990 to 2003. New England Journal of Medicine. 2005 ; 352: 2515-2523
54. Kessler R. C., Wang P. S.. The descriptive epidemiology of commonly occurring mental disorders in the United States. Annual Review of Public Health. 2008 ; 29: 115-129
55. Kraemer H. C.. Discovering, comparing, and combining moderators of treatment on outcome after randomized clinical trials: A parametric approach. Statistics in Medicine. 2013 ; 32: 1964-1973
56. Laine C., Goodman S. N., Griswold M. E., Sox H. C.. Reproducible research: Moving toward research the public can really trust. Annals of Internal Medicine. 2007 ; 146: 450-453
57. Bergin and Garfield's handbook of psychotherapy and behavior change. 2013 ). Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed.). New York, NY: John Wiley & Sons. Lambert M. J., ed. New York, NY: John Wiley & Sons ; 2013 :
58. Lambert M. J., Ogles B. M. Bergin and Garfield's handbook of psychotherapy and behavior change. 2013 ). The efficacy and effectiveness of psychotherapy. In LambertM. J. (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 169-218). New York, NY: John Wiley & Sons. Lambert M. J., ed. New York, NY: John Wiley & Sons ; 2013: 169-218.
59. Leijten P., Raaijmakers M. A., de Castro B. O., Matthys W.. Does socioeconomic status matter? A meta-analysis on parent training effectiveness for disruptive child behavior. Journal of Clinical Child and Adolescent Psychology. 2013 ; 42: 384-392
60. Lutz W., Hill C. E.. Quantitative and qualitative methods for psychotherapy research: Introduction to special section. Psychotherapy Research. 2009 ; 19: 369-373
61. Miles M. B., Huberman A. M., Saldaña J. Qualitative data analysis: A methods sourcebook. 2014 ). Qualitative data analysis: A methods sourcebook (3rd ed.). Thousand Oaks, CA: SAGE. Thousand Oaks, CA: SAGE ; 2014 :
62. Morris B. Discovering bits and pieces of me: Research exploring women's experiences of psychoanalytic psychotherapy. London, England: Women's Therapy Centre ; 2005 :
63. Mulcahy R., Reay R. E., Wilkinson R. B., Owen C.. A randomised control trial for the effectiveness of group interpersonal psychotherapy for postnatal depression. Archives of Women's Mental Health. 2010 ; 13: 125-139
64. Treatments that work. 4 th ed.). New York, NY: Oxford University Press. Nathan P. E. Gorman J. M., ed. New York, NY: Oxford University Press ;
65. Nelson J. C., Devanand D. P.. A systematic review and meta-analysis of placebo-controlled antidepressant studies in people with depression and dementia. Journal of the American Geriatrics Society. 2011 ; 59: 577-585
66. Nilsson T., Svensson M., Sandell R., Clinton D.. Patients' experiences of change in cognitive-behavioral therapy and psychodynamic therapy: A qualitative comparative study. Psychotherapy Research. 2007 ; 17: 553-566
67. Ogles B. M. Bergin and Garfield's handbook of psychotherapy and behavior change. 2013 ). Measuring change in psychotherapy research. In LambertM. J. (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 134-167). Hoboken, NJ: John Wiley & Sons. Lambert M. J., ed. Hoboken, NJ: John Wiley & Sons ; 2013: 134-167.
68. Paul G. L. Insight versus desensitization in psychotherapy: An experiment in anxiety reduction. Stanford, CA: Stanford University Press ; 1966 :
69. Paul G. L.. Outcome research in psychotherapy. Journal of Consulting Psychology. 1967 ; 31: 109-118
70. Porto P. R., Oliveira L., Mari J., Volchan E., Figueira I., Ventura P.. Does cognitive behavioral therapy change the brain? A systematic review of neuroimaging in anxiety disorders. Journal of Neuropsychiatry and Clinical Neurosciences. 2009 ; 21: 114-125
71. Quidé Y., Witteveen A. B., El-Hage W., Veltman D. J., Olff M.. Differences between effects of psychological versus pharmacological treatments on functional and morphological brain alterations in anxiety disorders and major depressive disorder: A systematic review. Neuroscience and Biobehavioral Reviews. 2012 ; 36: 626-644
72. Richards D., Richardson T.. Computer-based psychological treatments for depression: A systematic review and meta-analysis. Clinical Psychology Review. 2012 ; 32: 329-342
73. Roffman J. L., Marci C. M., Glick D. M., Dougherty D. D., Rauch S. L.. Neuroimaging and the functional neuroanatomy of psychotherapy. Psychological Medicine. 2005 ; 35: 1385-1398
74. Roth A., Fonagy P. What works for whom: A critical review of psychotherapy research. 2005 ). What works for whom: A critical review of psychotherapy research (2nd ed.). New York, NY: Guilford Press. New York, NY: Guilford Press ; 2005 :
75. Rutledge T., Loh C.. Effect sizes and statistical testing in the determination of clinical significance in behavioral medicine research. Annals of Behavioral Medicine. 2004 ; 27: 138-145
76. Sen S., Duman R., Sanacora G.. Serum brain-derived neurotrophic factor, depression, and antidepressant medications: Meta-analyses and implications. Biological Psychiatry. 2008 ; 64: 527-532
77. Simmons J. P., Nelson L. D., Simonsohn U.. False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science. 2011 ; 22: 1359-1366
78. Speer D. C., Greenbaum P. E.. Five methods for computing significant individual client change and improvement rates: Support for an individual growth curve approach. Journal of Consulting and Clinical Psychology. 1995 ; 63: 1044-1048
79. Spielmans G. I., Kirsch I.. Drug approval and drug effectiveness. Annual Review of Clinical Psychology. 2014 ; 10: 741-766
80. Substance Abuse and Mental Health Services Administration (SAMHSA). (2011). SAMHSA announces a working definition of "recovery" from mental disorders and substance abuse disorders. Retrieved from www.samhsa.gov/newsroom/advisories/1112223420.aspx
81. Sun S., Pan W., Wang L. L.. A comprehensive review of effect size reporting and interpreting practices in academic journals in education and psychology. Journal of Educational Psychology. 2010 ; 102: 989-1004
82. US Department of Health and Human Services (USDHHS). (2014). Substance Abuse and Mental Health Services Administration (SAMHSA), National Registry of Evidence-based Programs and Practices (NREPP). Retrieved from http://www.nrepp.samhsa.gov/AboutNREPP.aspx
83. Wallace M. L., Frank E. J., Kraemer H. C.. A novel approach for developing and interpreting moderator profiles in randomized controlled trials. JAMA Psychiatry. 2013 ; 70: 1241-1247
84. Wampold B. E., Budge S. L., Laska K. M., Del Re A. C., Baardseth T. P., Gunn W.. Evidence-based interventions for depression and anxiety versus intervention-as usual: A meta-analysis of direct comparisons. Clinical Psychology Review. 2011 ; 31: 1304-1312
85. Weisz J. R., Jensen-Doss A. J., Hawley K. M.. Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist. 2006 ; 61: 671-689
86. Evidence-based psychotherapies for children and adolescents. 2010 ). Evidence-based psychotherapies for children and adolescents (2nd ed.). New York, NY: Guilford Press. Weisz J. R. Kazdin A. E., ed. New York, NY: Guilford Press ; 2010 :
87. Weisz J. R., Kuppens S., Eckshtain D., Ugueto A. M., Hawley K. M., Jensen-Doss A. J.. Performance of evidence-based youth psychotherapies compared with usual clinical care: A multilevel meta-analysis. JAMA Psychiatry. 2013 ; 70: 750-761
88. Whitley R., Drake R.. Recovery: A dimensional approach. Psychiatric Services. 2010 ; 61: 1248-1250
89. The great push: Investing in mental health. Occoquan, VA: Author ; 2011 :
90. The global burden of disease: 2004 update. Geneva, Switzerland: Author ; 2008 :