Expanding the lens of evidence-based practice in psychotherapy: A common factors perspective

Psychotherapy

Volumn 51, Issue 4, 2014, Pages 467-481

  Laska, Kevin M ^a   Gurman, Alan S ^b,c   Wampold, Bruce E ^c  

^a VETERANS AFFAIRS MEDICAL CENTER   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

^c UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

Common factors; Empirically supported treatments; Evidence based practice; Outcomes; Psychotherapy

Indexed keywords

ANXIETY DISORDER; ARTICLE; BEHAVIOR THERAPY; COGNITIVE THERAPY; EMOTIONAL STRESS; EVIDENCE BASED PRACTICE; HUMAN; MENTAL HEALTH SERVICE; PATIENT COMPLIANCE; POSTTRAUMATIC STRESS DISORDER; PSYCHOTHERAPY; TOTAL QUALITY MANAGEMENT; EMPIRICAL RESEARCH; EVIDENCE BASED MEDICINE; MENTAL DISORDERS; PROCEDURES;

EMPIRICAL RESEARCH; EVIDENCE-BASED MEDICINE; HUMANS; MENTAL DISORDERS; PSYCHOTHERAPY;

EID: 84922512555     PISSN: 00333204     EISSN: 19391536     Source Type: Journal    
DOI: 10.1037/a0034332     Document Type: Article

References (157)

1. Ahn, H.,&Wampold, B. E. (2001). Where oh where are the specific ingredients? A meta-analysis of component studies in counseling and psychotherapy. Journal of Counseling Psychology, 48, 251-257. doi:10.1037/O022-OI67.48.3.251
2. Alexander, J. F., Barton, C., Schiavo, R.,&Parsons, B. (1976). Behavioral intervention with families of delinquents: Therapist characteristics and outcome. Journal of Consulting and Clinical Psychology, 44, 656-664.
3. American Psychological Association (APA). (2013). Recognition of Psychotherapy Effectiveness. Psychotherapy, 50, 102-109. doi:10.1037/a0030276
4. American Psychological Association (APA) Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271-285. doi:10.1037/0003-066X.61.4.271
5. Anderson, T., Ogles, B. M., Patterson, C. L., Lambert, M. J.,&Vermeersch, D. A. (2009). Therapist effects: Facilitative interpersonal skills as a predictor of therapist success. Journal of Clinical Psychology, 65, 755-768. doi:10.1002/jclp.20583
6. Antony, M. M.,&Roemer, L. (2011). Behavior therapy: Traditional approaches. In S. B. Messer&A. S. Gurman (Eds.), Essential psychotherapies: Theory and practice (3rd ed., pp. 107-142). New York: Guilford Press.
7. Arch, J. J., Eifert, G. H., Davies, C., Plumb-Vilardaga, J. C., Rose, R. D., & Craske, M. G. (2012). Randomized clinical trial of cognitive behavioral therapy (CBT) versus acceptance and commitment therapy (ACT) for mixed anxiety disorders. Journal of Consulting and Clinical Psychology, 5, 750-765. doi:10.1037/a0028310
8. Baardseth, T., Goldberg, S., Pace, B., Wislocki, A. P., Frost, N. D., Siddiqui, J. R., . . . Wampold, B. W. (2013). Cognitive-behavioral therapy versus other therapies: Redux. Clinical Psychology Review, 33, 395-405. doi:10.1016/j.cpr.2013.01.004
9. Baker, T. B., McFall, R. M.,&Shoham, V. (2008). Current status and future prospects of clinical psychology: Toward a scientifically principled approach to mental and behavioral health care. Psychological Science in the Public Interest, 9, 67-103. doi:10.1111/j.1539-6053.2009.01036.x
10. Baldwin, S. A.,&Imel, Z. E. (2013). Therapist effects: Findings and methods. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 258-297). New York: Wiley.
11. Baldwin, S. A., Wampold, B. E.,&Imel, Z. E. (2007). Untangling the alliance-outcome correlation: Exploring the relative importance of therapist and patient variability in the alliance. Journal of Consulting and Clinical Psychology, 75, 842-852. doi:10.1037/0022-006X.75.6.842
12. Barkham, M., Hardy, G. E.,&Mellor-Clark, J. (2010). Developing and delivering practice-based evidence: A guide for the psychological therapies. Chichester, United Kingdom: Wiley Blackwell.
13. Barlow, D. H. (2004). Psychological treatments. American Psychologist, 59, 869-878. doi:10.1037/0003-066X.59.9.869
14. Barlow, D. H. (2008). Clinical handbook of psychological disorders: A step-by-step treatment manual (4th ed.). New York: Guilford Press.
15. Barlow, D. H. (2010). The dodo bird-again-and again. The Behavior Therapist, 33, 15-16.
16. Barlow, D. H., Farchione, T. J., Fairholme, C. P., Ellard, K. K., Boisseau, C. L., Allen, L. B.,&Ehrenreich, J. (2011). Unified protocol for transdiagnostic treatment of emotional disorders: Therapist guide. New York: Oxford University Press.
17. Beck, A. T., Rush, A. J., Shaw, B. E.,&Emery, G. (1979). Cognitive therapy of depression. New York: Guilford Press.
18. Bell, E. C., Marcus, D. K.,&Goodlad, J. K. (2013). Are the parts as good as the whole? A meta-analysis of component treatment studies. Journal of Consulting and Clinical Psychology, 81, 722-736. doi:10.1037/a0033004
19. Benish, S., Imel, Z. E.,&Wampold, B. E. (2007). The relative efficacy of bona fide psychotherapies of post-traumatic stress disorder: A metaanalysis of direct comparisons. Clinical Psychology Review, 28, 746-758. doi:10.1016/j.cpr.2007.10.005
20. Bergin, A. E.,&Strupp, H. H. (1972). Changing frontiers in the science of psychotherapy. Chicago, IL: Aldine-Atherton.
21. Blanchard, E. B., Hickling, E. J., Devineni, T., Veazey, C. H., Galovski, T. E., Mundy, E., . . . Buckley, T. C. (2003). A controlled evaluation of cognitive behavioral therapy for posttraumatic stress in motor vehicle accident survivors. Behaviour Research and Therapy, 41, 79-96.
22. Bleiberg, K. L.,&Markowitz, J. C. (2005). A pilot study of interpersonal psychotherapy for posttraumatic stress disorder. American Journal of Psychiatry, 162, 181-183.
23. Blow, A. J., Sprenkle, D. H.,&Davis, S. D. (2007). Is who delivers the treatment more important than the treatment itself? The role of the therapist in common factors. Journal of Marital and Family Therapy, 33, 298-317.
24. Bordin, E. S. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, Research&Practice, 16, 252-260.
25. Bowlby, J. Attachment and loss. New York: Basic Books, 1973.
26. Brown, H. (2013, March 25). Looking for evidence that therapy works. The New York Times, p. 4.
27. Bryant, R. A., Moulds, M. L., Guthrie, R. M., Dang, S. T., Mastrodomenico, J., Nixon, R. D. V., . . . Creamer, M. (2008). A randomized controlled trial of exposure therapy and cognitive restructuring for posttraumatic stress disorder. Journal of Consulting and Clinical Psychology, 76, 695-703. doi:10.1037/a0012616
28. Budge, S. L., Baardseth, T. P., Wampold, B. E.,&Flückiger, C. (2010). Researcher allegiance and supportive therapy: Pernicious affects on results of randomized clinical trials. European Journal of Counselling and Psychotherapy, 12, 23-39.
29. Castonguay, L., Barkham, M., Lutz, W.,&McAleavey, A. (2013). Practice-oriented research: Approaches and applications. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 85-133). New York: Wiley.
30. Chambless, D. L.,&Crits-Christoph, P. (2006). The treatment method. In J. C. Norcorss, L. E. Beutler,&R. F. Levant (Eds.), Evidence-based practices in mental health (pp. 191-200). Washington, DC: American Psychologicsl Association.
31. Chambless, D. L.,&Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7-18.
32. Chambless, D. L., Sanderson, W. C., Shoham, V., Johnson, S. B., Pope, K. S., Crits-Christoph, P., . . . McCurry, S. (1996). An update on empirically validated therapies. The Clinical Psychologist, 49, 5-18.
33. Clark, D. M., Fairburn, C. G.,&Wessely, S. (2007). Psychological treatment outcomes in routine NHS services: A commentary on Stiles et al. Psychological Medicine, 38:629-634, 2007. doi:10.1017/S0033291707001869
34. Classen, C. C., Palesh, O. G., Cavanaugh, C. E., Koopman, C., Kaupp, J. W., Kraemer, H. C., . . . Spiegel, D. (2011). A comparison of trauma-focused and present-focused group therapy for survivors of childhood sexual abuse: A randomized controlled trial. Psychological Trauma: Theory, Research, Practice, and Policy, 3, 84-93. doi:10.1037/a0020096
35. Cook, T. D.,&Campbell, D. T. (1979). Quasi-experimentation: Design and analysis for field settings. Chicago, IL: Rand McNally.
36. Crits-Christoph, P. (1997). Limitations of the dodo bird verdict and the role of clinical trials in psychotherapy research: Comment on Wampold et al (1997). Psychological Bulletin, 122, 216-220.
37. Crits-Christoph, P., Baranackie, K., Kurcias, J. S., Carroll, K., Luborsky, L., McLellan, T., . . . Zitrin, C. (1991). Meta-analysis of therapist effects in psychotherapy outcome studies. Psychotherapy Research, 1, 81-91.
38. Crits-Christoph, P., Gallop, R., Temes, C. M., Woody, G., Ball, S. A., Martino, S.,&Carroll, K. M. (2009). The alliance in motivational enhancement therapy and counseling as usual for substance use problems. Journal of Consulting and Clinical Psychology, 77, 1125-1135. doi:10.1037/a0017045
39. Crits-Christoph, P., Gibbons, M. B. C., Hamilton, J., Ring-Kurtz, S., & Gallop, R. (2011). The dependability of alliance assessments: The alliance-outcome correlation is larger than you might think. Journal of Consulting and Clinical Psychology, 79, 267-278. doi:10.1037/a0023668
40. Cuijpers, P., Driessen, E., Hollon, S. D., van Oppen, P., Barth, J., & Andersson, G. (2012). The efficacy of non-directive supportive therapy for adult depression: A meta analysis. Clinical Psychology Review, 32, 280-291. doi:10.1016/j.cpr.2012.01.003
41. Cuijpers, P., van Straten, A., Andersson, G.,&van Oppen, P. (2008). Psychotherapy for depression in adults: A meta-analysis of comparative outcome studies. Journal of Consulting and Clinical Psychology, 76, 909-922. doi:10.1037/a0013075
42. Del Re, A. C., Flückiger, C., Horvath, A. O., Symonds, D.,&Wampold, B. E. (2012). Therapist effects in the therapeutic alliance-outcome relationship: A restricted-maximum likelihood meta-analysis. Clinical Psychology Review, 32, 642-649. doi:10.1016/j.cpr.2012.07.002
43. DeRubeis, R. J., Brotman, M. A.,&Gibbons, C. J. (2005). A conceptual and methodological analysis of the nonspecifics argument. Clinical Psychology: Science and Practice, 12, 174-183. doi:10.1093/clipsy/bpi022
44. Devilly, G. J.,&Foa, E. B. (2001). The investigation of exposure and cognitive therapy: Comment on Tarrier et al (1999). Journal of Consulting and Clinical Psychology, 69, 114-116.
45. Dimidjian, S., Hollon, S. D., Dobson, K. S., Schmaling, K. B., Kohlenberg, R. J., Addis, M. E., . . . Jacobson, N. S. (2006). Randomized trial of behavioral activation, cognitive therapy, and antidepressant medication in the acute treatment of adults with major depression. Journal of Consulting and Clinical Psychology, 74, 658-670. doi:10.1037/0022-006X.74.4.658
46. Dinger, U., Strack, M., Leichsenring, F., Wilmers, F.,&Schauenburg, H. (2008). Therapist effects on outcome and alliance in inpatient psychotherapy. Journal of Clinical Psychology, 64, 344-354. doi:10.1002/jclp.20443
47. Duncan, B. L. (2012). The partners for change outcome management system (PCOMS): The heart and soul of change project. Canadian Psychology, 53, 93-104. doi:10.1037/a0027762
48. Duncan, B. L., Miller, S. D., Wampold, B. E.,&Hubble, M. A. (2010). The heart and soul of change: Delivering what works in therapy (2nd ed.). Washington, DC: American Psychological Association.
49. Ehlers, A., Bisson, J., Clark, D. M., Creamer, M., Pilling, S., Richards, D., . . . Yule, W. (2010). Do all psychological treatments really work the same in posttraumatic stress disorder? Clinical Psychology Review, 30, 269-276. doi:10.1016/j.cpr.2009.12.001
50. Elkin, I., Falconnier, L., Martinovich, Z.,&Mahoney, C. (2006). Therapist effects in the NIMH Treatment of Depression Collaboarative Research Program. Psychotherapy Research, 16, 144-160.
51. Elkin, I., Gibbons, R. D., Shea, M. T.,&Shaw, B. F. (1996). Science is not a trial (but it can sometimes be a tribulation). Journal of Consulting and Clinical Psychology, 64, 92-103.
52. Falkenström, F., Granström, F.,&Holmqvist, R. (2013). Therapeutic alliance predicts symptomatic improvement session by session. Journal of Counseling Psychology, 60, 317-328.
53. Flückiger, C., Del Re, A. C., Wampold, B. E., Symonds, D.,&Horvath, A. O. (2012). How central is the alliance in psychotherapy? A multilevel longitundinal meta-analysis. Journal of Counseling Psychology, 1, 10-17. doi:10.1037/a0025749
54. Foa, E. B. (2013). Challanged and successes in dissemination of evidencebased treatment for posttraumatic stress: Lessons learned from prolonged exposure therapy for PTSD. Psychological Science in the Public Interest, 14, 65-111. doi:10.1177/1529100612468841
55. Foa, E. B., Hembree, E. A.,&Rothbaum, B. O. (2007). Prolonged exposure therapy for PTSD: Emotional processing of traumatic experiences: Therapist guide. Oxford: Oxford University Press.
56. Foa, E. B.,&Kozak, M. J. (1986). Emotional processing of fear: Exposure to corrective information. Psychological Bulletin, 99, 20-35.
57. Frank, J. D.,&Frank, J. B. (1993). Persuasion and healing: A comparative study of psychotherapy (3rd ed.). Baltimore, MD: Johns Hopkins University Press.
58. Frost, N. D., Laska, K. M.,&Wampold, B. E. (2014). The evidence for present centered therapy as an evidence-based treatment for posttraumatic stress disorder. Journal of Traumatic Stress, 27, 1-8. doi:10.1002/jts.21881
59. Gurman, A. S. (2011). Couple therapy research and the practice of couple therapy: Can we talk? Family Process, 50, 280-292. doi:10.1111/j.1545-5300.2011.01360.x
60. Hajcak, G.,&Starr, L. (n.d.) Society of Clinical Psychology American Psychological Association Division 12. Retrieved from http://www.div12.org/PsychologicalTreatments/disorders/ptsd_main.php. Retrieved August 1, 2012.
61. Hayes, S. C., Levin, M. E., Plumb, J. C., Villatte, J. L.,&Pistorello, J. (2011). Acceptance and commitment therapy and contextual behavioral science: Examinging the progress of a distinctive model of behavioral and cognitive therapy. Behavior Therapy, 44, 180-198. doi:10.1016/j.beth.2009.08.002
62. Hayes, S. C., Strosahl, K. D.,&Wilson, K. G. (2012). Acceptance and commitment therapy: The process and practice of mindful change (2nd ed.). New York: Guilford Press.
63. Herbert, J. D., Lilienfeld, S. O., Lohr, J. M., Montgomery, R. W., O'Donohue, W. T., Rosen, G. M.,&Tolin, D. F. (2000). Science and pseudoscience in the development of eye movement desensitization and reprocessing: Implications for clinical psychology. Clinical Psychology Review, 20, 945-971.
64. Hoffart, A., Borge, F.-M., Sexton, H., Clark, D. M.,&Wampold, B. E. (2012). Psychotherapy for social phobia: How do alliance and cognitive process interact to produce outcome? Psychotherapy Research, 22, 82-94. doi:10.1080/10503307.2011.626806
65. Hofmann, S. G. (2008). Common misconceptions about cognitive mediation of treatment change: A commentary to Longmore and Worrell. Clinical Psychology Review, 28, 67-70.
66. Hofmann, S. G. (2013). An introduction to modern CBT: Psychological solutions to mental health problems. Malden, MA: Wiley-Blackwell.
67. Hofmann, S. G.,&Asmundson, G. J. G. (2008). Acceptance and mindfulness-based therapy: New wave or old hat? Clinical Psychology Review, 28, 1-16. doi:10.1016/j.cpr.2007.09.003
68. Hofmann, S. G.,&Lohr, J. (2010). To kill a dodo bird. The Behavior Therapist, 33, 14-15.
69. Hofmann, S. G.,&Smits, J. A. J. (2008). Cognitive-behavioral therapy for adult anxiety disorders: A meta-analysis of randomized placebocontrolled trials. Journal of Clinical Psychiatry, 69, 621-632.
70. Horvath, A. O., Del Re, A. C., Flückiger, C.,&Symonds, D. (2011). Alliance in individual psychotherapy. Psychotherapy, 48, 9-16.
71. Hunsley, J.,&Di Giulio, G. (2002). Dodo bird, phoenix, or urban legend? The question of psychotherapy equivalence. The Scientific Review of Mental Health Practice, 1, 11-22.
72. Imel, Z. E.,&Wampold, B. E. (2008). The common factors of psychotherapy. In S. D. Brown&R. W. Lent (Eds.), Handbook of counseling psychology (4th ed.). New York: Wiley.
73. Imel, Z. E., Wampold, B. E., Miller, S. D.,&Fleming, R. R. (2008). Distinctions without a difference: Direct comparisons of psychotherapies for alcohol use disorders. Journal of Addictive Behaviors, 22, 533-543. doi:10.1037/a0013171
74. Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st century. Washington, DC: National Academies Press.
75. Jacobson, N. S. (1991). Behavioral versus insight-oriented marital therapy: Labels can be misleading. Journal of Consulting and Clinical Psychology, 59, 142-145.
76. Jacobson, N. S., Dobson, K. S., Truax, P. A., Addis, M. E., Koerner, K., Gollan, J. K., . . . Price, S. E. (1996). A component analysis of cognitive-behavioral treatment for depression. Journal of Consulting and Clinical Psychology, 64, 295-304.
77. Jacobson, N. S.,&Hollon, S. D. (1996). Cognitive-behavior therapy versus pharmacotherapy: Now that the jury's returned its verdict, it's time to present the rest of evidence. Journal of Consulting and Clinical Psychology, 64, 74-80.
78. Kazdin, A. E.,&Blasé, S. L. (2011). Rebooting psychotherapy research and practice to reduce the burden of mental illness. Perspectives on Psychological Science, 6, 21-37. doi:10.1177/17456991610393527
79. Kiesler, D. J. (1966). Some myths of psychotherapy research and the search for a paradigm. Psychological Bulletin, 65, 110-136.
80. Kuhn, T. S. (1962). The structure of scientific revolutions. Chicago, IL: University of Chicago Press.
81. Lakatos, I. (1970). Falsification and the methodology of scientific research programmes. In I. Lakatos&A. Musgrave (Eds.), Criticism and the growth of knowledge (pp. 91-196). Cambridge, England: Cambridge University Press.
82. Lambert, M. J. (2009). "Yes, its time for clinicians to routinely monitor treatment outcome". In B. L. Duncan, S. D. Miller, B. E. Wampold, & M. A. Hubble (Eds.), The heart and soul of change (2nd ed.). Washington, DC: American Psychological Association.
83. Lambert, M. J. (2013a). The efficacy and effectiveness of psychotherapy. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 169-218). New York: Wiley.
84. Lambert, M. J. (2013b). Outcome in psychotherapy: The past and important advances. Psychotherapy, 50, 42-51. doi:10.1037/a0030682
85. Lambert, M. J.,&Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48, 72-79. doi:10.1037/a0022238
86. Laska, K. M. (2012). The cost of determining the marginal efficacy of empirically supported treatments (Doctoral dissertation).University of Wisconsin-Madison, Madison, WI.
87. Laska, K. M., Smith, T. L., Wislocki, A., Minami, T.,&Wampold, B. E. (2013). Uniformity of evidence based treatments in practice? Therapist effects in the delivery of cognitive processing therapy for PTSD. Journal of Counseling Psychology, 60, 31-41. doi:10.1037/a0031294
88. Leichsenring, F.,&Leibing, E. (2003). The effectiveness of psychodynamic therapy and cognitive behavior therapy in the treatment of personality disorders: A meta-analysis. American Journal of Psychiatry, 160, 1223-1231.
89. Leichsenring, F., Salzer, S., Hilsenroth, M. J., Leibing, E., Leweke, F., & Rabung, S. (2011). Treatment integrity: An unresolved issue in psychotherapy research. Current Psychiatry Reviews, 7, 313-321. doi:10.2174/157340011797928259
90. Lilienfeld, S. O., Ritschel, L. A., Lynn, S. J., Cautin, R. L.,&Latzman, R. D. (2013). Why many clinical psychologists are resistant to evidencebased practice: Root causes and con- structive remedies. Clinical Psychology Review. pii: S0272-7358(13)00049-4. Retrieved from. doi:10.1016/j.cpr.2012.09.008
91. Luebbe, A. M., Radcliffe, A. M., Callands, T. A., Green, D.,&Thorn, B. E. (2007). Evidence-based practice in psychology: Perceptions of graduate students in scientist practitioner programs. Journal of Clinical Psychology, 63, 643-655. doi:10.1037/0022-006X.66.1.126
92. Markowitz, J. C., Kocsis, J. H., Fishman, B., Spielman, L. A., Jacobsberg, L. B., Frances, A. J., . . . Perry, S. W. (1998). Treatment of depressive symptoms in human immunodeficiency virus-positive patients. Archives of General Psychiatry, 55, 452-457.
93. Markowitz, J. C., Milrod, B., Bleiberg, K.,&Marshall, R. D. (2009). Interpersonal factors in understanding and treating posttraumatic stress disorder. Journal of Psychiatric Practice, 15, 133-140. doi:10.1097/01.pra.0000348366.34419.28
94. McDonagh, A., Friedman, M., McHugo, G., Ford, J., Sengupta, A., Mueser, K., . . . Descamps, M. (2005). Randomized trial of cognitive-behavioral therapy for chronic posttraumatic stress disorder in adult female survivors of childhood sexual abuse. Journal of Consulting and Clinical Psychology, 73, 515-524. doi:10.1037/0022-006X.73.3.515
95. McHugh, R. K.,&Barlow, D. H. (2010). The dissemination and implementation of evidence based psychological treatments: A review of current efforts. American Psychologist, 65, 73-84. doi:10.1037/a0018121
96. McHugh, R. K.,&Barlow, D. H. (2012). Dissemination and implementation of evidence-based psychological interventions. New York: Oxford University Press.
97. McNally, R. J. (1999). EMDR and Mesmerism: A comparative historical analysis. Journal of Anxiety Disorders, 13, 225-236.
98. Miller, S. D., Wampold, B. E.,&Varhely, K. (2008). Direct comparisons of treatment modalities for youth disorders: A meta-analysis. Psychotherapy Research, 18, 5-14. doi:10.1080/10503300701472131
99. Minami, T., Wampold, B. E., Serlin, R. C., Hamilton, E., Brown, G. S., & Kircher, J. (2008). Benchmarking the effectiveness of psychotherapy treatment for adult depression in a managed care environment: A preliminary study. Journal of Consulting and Clinical Psychology, 76, 116-124. doi:10.1037/0022-006X.76.1.116
100. Minami, T., Wampold, B. E., Serlin, R. C., Kircher, J. C.,&Brown, G. S. J. (2007). Benchmarks for psychotherapy efficacy in adult major depression. Journal of Consulting and Clinical Psychology, 75, 232-243. doi:10.1037/a0015398
101. Moses, E. B.,&Barlow, D. H. (2006). A new unified treatment approach for emotional disorders based on emotion science. Current Directions in Psychological Science, 15, 146-150.
102. Norcross, J. C.,&Lambert, M. J. (2011). Psychotherapy relationships that work II. Psychotherapy, 48, 4-8. doi:10.1037/a0022180
103. Orlinsky, D. E., Botermanns, J.,&Ronnestad, M. H. (2001). Towards an empirically grounded model of psychotherapy training: Four thousand therapists rate influences on their development. Australian Psychologist, 36, 139-148.
104. Owen, J.,&Hilsenroth, M. J. (2011). Interaction between alliance and technique in predicting patient outcome during psychodynamic psychotherapy. Journal of Nervous and Mental Disease, 199, 384-389. doi:10.1097/NMD.0b013e31821cd28a
105. Pagoto, S. L., Spring, B., Coups, E. J., Mulvaney, S., Coutu, M. F., & Ozakinci, G. (2007). Barriers and facilitators of evidence-based practice perceived by behavioral science health professionals. Journal of Clinical Psychology, 63, 695-705.
106. Perepletchikova, F., Treat, T. A.,&Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75, 829-841. doi:10.1037/0022-006X.75.6.829
107. Pesale, F. P., Hilsenroth, M. J.,&Owen, J. J. (2012). Patient early session experience and treatment outcome. Psychotherapy Research, 22, 417-425. doi:10.1080/10503307.2012.662607
108. Pinsof, W. M.,&Wynne, L. C. (2000). Toward progress research: Closing the gap between family therapy practice and research. Journal of Marital and Family Therapy, 26, 1-8.
109. Pinsof, W. M., Zinbarg, R. E., Lebow, J. L., Knobloch-Fedders, L. M., Durbin, E., Chambers, A., . . . Friedman, G. (2009). Laying the foundation for progress research in family, couple, and individual therapy: The development and psychometric features of the initial systemic therapy inventory of change. Psychotherapy Research, 19, 143-156. doi:10.1080/10503300802669973
110. Powers, M. B., Halpern, J. M., Ferenschak, M. P., Gillihan, S. J.,&Foa, E. B. (2010). A meta-analytic review of prolonged exposure for posttraumatic stress disorder. Clinical Psychology Review, 30, 635-641. doi:10.1016/j.cpr.2010.04.007
111. Resick, P. A., Galovski, T. E., Uhlmansiek, M. O. B., Scher, C. D., Clum, G. A.,&Young-Xu, Y. (2008). A randomized clinical trial to dismantle components of cognitive processing therapy for posttraumatic stress disorder in female victims of interpersonal violence. Journal of Consulting and Clinical Psychology, 76, 243-258. doi:10.1037/0022-006x.76.2.243
112. Resick, P. A., Nishith, P., Weaver, T. L. Astin, M. C.,&Feuer, C. A. (2002). A comparison of cognitive processing therapy with prolonged exposure and waiting condition for the treatment of chronic posttraumatic stress disorder in female rape victims. Journal of Consulting and Clinical Psychology, 70, 867-879. doi:10.1037//0022-006X.70.4.867
113. Resick, P. A.,&Schnicke, M. K. (1992). Cognitive processing therapy for sexual assault victims. Journal of Consulting and Clinical Psychology, 60, 748-756. doi:10.1037/0022-006X.60.5.748
114. Ruzek, J. I., Karlin, B. E.,&Zeiss, A. M. (2012). Implementation of evidence-based psychological treatments in the Veterans Health Administration. In R. K. McHugh&D. H. Barlow (Eds.), Dissemination of evidence-based psychological treatments (pp. 78-96). New York: Oxford University Press.
115. Saxon, D.,&Barkham, M. (2012). Patterns of therapist variability: Therapist effects and the contribution of patient severity and risk. Journal of Consulting and Clinical Psychology, 80, 535-546. doi:10.1037/a0028898
116. Schnurr, P. P., Friedman, M. J., Engel, C. C., Foa, E. B., Shea, M. T., Chow, B. K., . . . Bernardy, N. (2007). Cognitive behavioral therapy for posttraumatic stress disorder in women. Journal of the American Medical Association, 297, 820-830. doi:10.1001/jama.297.8.820
117. Schnurr, P. P., Friedman, M. J., Foy, D. W., Shea, T., Hsieh, F. Y., Lavori, P.W., . . . Bernardy, N. C. (2003). A randomized trial of trauma-focused group therapy for post traumatic stress disorder: Results from a Department of Veterans Affairs Cooperative Study. Archives of General Psychiatry, 60, 481-489.
118. Seidler, G.,&Wagner, F. E. (2006). Comparing the efficacy of EMDR and trauma-focused cognitive-behavioral therapy in the treatment of PTSD: A meta-analytic study. Psychological Medicine, 36, 1515-1522. doi:10.1017/S0033291706007963
119. Serlin, R. C.,&Lapsley, D. K. (1985). Rationality in psychological research: The good-enough principle. American Psychologist, 40, 73-83. doi:10.1037/0003-066x.40.1.73
120. Shafran, R., Clark, D. M., Fairburn, C. G., Arntz, A., Barlow, D. H., Ehlers, A., . . . Wilson, G. T. (2009). Mind the gap: Improving the dissemination of CBT. Behaviour Research and Therapy, 47, 902-909. doi:10.1016/j.brat.2009.07.003
121. Shedler, J. (2010). The efficacy of psychodynamic psychotherapy. American Psychologist, 65, 98-109. doi:10.1037/a0018378
122. Shimokawa, K., Lambert, M. J.,&Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298-311. doi:10.1037/a0019247
123. Siev, J., Huppert, J. D.,&Chambless, D. L. (2009). The dodo bird, treatment technique, and disseminating empirically supported treatments. The Behavior Therapist, 32, 69-76.
124. Simons, A. D., Padesky, C. A., Montemarano, J., Lewis, C. C., Murakami, J., Lamb, K., . . . Beck, A. T. (2010). Training and dissemination of cognitive behavior therapy for depression in adults: A preliminary examination of therapist competence and client outcomes. Journal of Consulting and Clinical Psychology, 5, 751-756. doi:10.1037/a0020569
125. Skynner, A. C. R. (1980). Recent developments in marital therapy. Journal of Family Therapy, 2, 271-296.
126. Snyder, D. K., Wills, R. M.,&Grady-Fletcher, A. (1991). Long-term effectiveness of behavioral versus insight oreinted marital therapy: A 4-year follow-up study. Journal of Consulting and Clinical Psychology, 59, 138-141.
127. Spielmans, G. I., Benish, S., Marin, C., Bowman, W., Menster, M., & Wheeler, A. J. (2013). Specificity of psychological treatments for bulimia nervosa and binge eating disorder? A meta-analysis of direct comparisons. Clinical Psychology Review, 33, 460-469. doi:10.1016/j.cpr.2013.01.008
128. Spielmans, G. I., Gatlin, E. T.,&McFall, J. P. (2010). The efficacy of evidence-based psychotherapies versus usual care for youths: Controlling confounds in a meta-reanalysis. Psychotherapy Research, 20, 234-246. doi:10.1080/10503300903311293
129. Spielmans, G. I., Pasek, L. F.,&McFall, J. P. (2007). What are the active ingredients in cognitive and behavioral psychotherapy for anxious and depressed children? A meta-analytic review. Clinical Psychology Review, 27, 642-654. doi:10.1016/j.cpr.2006.06.001
130. Stewart, R. E., Stirman, S. W.,&Chambless, D. (2012). A qualitative investigation of practicing psychologists' attitudes toward researchinformed practice: Implications for dissemination strategies. Professional Psychology: Research and Practice, 43, 100-109. doi:10.1037/a0025694
131. Stiles, W. B., Barkham, M., Mellor-Clark, J.,&Connell, J. (2008). Effectiveness of cognitive-behavioural, person-centred, and psychodynamic therapies in UK primary-care routine practice: Replication in a larger sample. Psychological Medicine, 38, 677-688. doi:10.1017/S0033291707001511
132. Stiles, W. B., Barkham, M., Twigg, E., Mellor-Clark, J.,&Cooper, M. (2006). Effectiveness of cognitive-behavioural, person-centred and psychodynamic therapies as practised in UK National Health Service settings. Psychological Medicine, 36, 555-566. doi:10.1017/S0033291706007136
133. Sullivan, H. S. (1953). The interpersonal theory of psychiatry. New York: Norton.
134. Suris, A., Link-Malcolm, J., Chard, K., Ahn, C.,&North, C. (2013). A randomized clinical trial of cognitive processing therapy for veterans with PTSD related to military sexual trauma. Journal of Traumatic Stress, 26, 1-10. doi:10.1002/jts.21765
135. Tarrier, N., Pilgrim, H., Sommerfield, C., Fragher, B., Reynolds, M., Graham, E.,&Barrowclough, C. (1999). A randomized trial of cognitive therapy and imaginal exposure in the treatment of chronic posttraumatic stress disorder. Journal of Consulting and Clinical Psychology, 67, 13-18.
136. Tolin, D. F. (2010). Is cognitive-behavioral therapy more effective than other therapies?: A meta-analytic review. Clinical Psychology Review, 30, 710-720. doi:10.1016/j.cpr.2010.05.003
137. Ulvenes, P. G., Berggraf, L., Hoffart, A., Stiles, T. C., Svartberg, M., McCullough, L.,&Wampold, B. E. (2012). Different processes for different therapies: Therapist actions, therapeutic bond, and outcome. Psychotherapy, 49, 291-302. doi:10.1037/a0027895
138. Wachtel, P. (2010). Beyond "ESTs": Problematic assumptions in the persuit of evidence based practice. Psychoanalytic Psychology, 27, 251-272. doi:10.1037/a0020532
139. Walfish, S., McAlister, B., O'Donnell, P.,&Lambert, M. J. (2012). An investigation of self-assessment bias in mental health providers. Psychological Reports, 110, 639-644. doi:10.2466/02.07.17.PR0.110.2.639-644
140. Waller, G. (2009). Evidence-based treatment and therapist drift. Behaviour Research and Therapy, 47, 119-127. doi:10.1016/j.brat.2008.10.018
141. Wampold, B. E. (2001). The great psychotherapy debate: Models, methods, and findings. Mahwah, NJ: Erlbaum.
142. Wampold, B. E. (2007). Psychotherapy: The humanistic (and effective) treatment. American Psychologist, 62, 857-873.
143. Wampold, B. E.,&Brown, G. S. (2005). Estimating therapist variability: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73, 914-923. doi:10.1037/0022-006X.73.5.914
144. Wampold, B. E.,&Budge, S. L. (2012). The 2011 Leona Tyler Award Address: The relationship-and its relationship to the common and specific factors of psychotherapy. The Counseling Psychologist, 40, 601-623. doi:10.1177/0011000011432709
145. Wampold, B. E., Budge, S. L., Laska, K. M., Del Re, A. C., Baardseth, T. P., Flückiger, C., . . . Gunn, W. (2011). Evidence-based treatments for depression and anxiety versus treatment-as-usual: A meta-analysis of direct comparisons. Clinical Psychology Review, 31, 1304-1312. doi:10.1016/j.cpr.2011.07.012
146. Wampold, B. E., Imel, Z. E., Laska, K. M., Benish, S., Miller, S. D., Flückiger, C., . . . Budge, S. (2010). Determining what works in the treatment of PTSD. Clinical Psychology Review, 30, 923-933. doi:10.1016/j.cpr.2010.06.005
147. Wampold, B. E., Imel, Z. E.,&Miller, S. D. (2009). Barriers to the dissemination of empirically supported treatments: Matching messages to the evidence. The Behavior Therapist, 32, 144-155.
148. Wampold, B. E., Minami, T., Baskin, T. W.,&Tierney, S. C. (2002). A meta-(re)analysis of the effects of cognitive therapy versus "other therapies" for depression. Journal of Affective Disorders, 68, 159-165.
149. Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empirically, "All must have prizes". Psychological Bulletin, 122, 203-215.
150. Wampold, B. E.,&Serlin, R. C. (2000). The consequence of ignoring a nested factor on measures of effect size in analysis of variance. Psychological Methods, 5, 425-433. doi:10.1037//1082-989X.5.4.425
151. Wampold, B. E.,&Serlin, R. C. (2014). Meta-analytic methods to test relative efficacy. Quality&Quantity: International Journal of Methodology, 48, 755-765. doi:10.1007/s11135-012-9800-6.
152. Webb, C. A., DeRubeis, R. J., Amsterdam, J. D., Shelton, R. C., Hollon, S. D.,&Dimidjian, S. (2011). Two aspects of the therapeutic alliance: Differential relations with depressive symptom change. Journal of Consulting and Clinical Psychology, 79, 279-283. doi:10.1037/a0023252
153. Webb, C. A., DeRubeis, R. J.,&Barber, J. P. (2010). Therapist adherence/competence and treatment outcome: A meta-analytic review. Journal of Consulting and Clinical Psychology, 78, 200-211. doi:10.1037/a0018912
154. Weisz, J. R., Jensen-Doss, A.,&Hawley, K. M. (2006). Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. The American Psychologist, 61, 671-689. doi:10.1037/0003-066X.61.7.671
155. Westen, D., Novotny, C. M.,&Thompson-Brenner, H. (2004). The empirical status of empirically supported psychotherapies: Assumptions, findings, and reporting in controlled clinical trials. Psychological Bulletin, 130, 631-663. doi:10.1037/0033-2909.130.4.631
156. Westen, D., Novotny, C. M.,&Thompson-Brenner, H. (2005). EBP ≠ EST: Reply to Crits-Christoph et al. (2005). and Weisz et al (2005). Psychological Bulletin, 131, 427-433. doi:10.1037/0033-2909.131.3.427
157. Zuroff, D. C., Kelly, A. C., Leybman, M. J., Blatt, S. J.,&Wampold, B. E. (2010). Between-therapist and within-therapist differences in the quality of the therapeutic relationship: Effects on maladjustment and self-critical perfectionism. Journal of Clinical Psychology, 66, 681-697. doi:10.1002/jclp.20683