Can psychotherapists function as their own controls? Meta-analysis of the crossed therapist design in comparative psychotherapy trials

Journal of Clinical Psychiatry

Volumn 74, Issue 5, 2013, Pages 482-491

  Falkenström, Fredrik ^a,b   Markowitz, John C ^d   Jonker, Hanske ^d,e   Philips, Björn ^a,c   Holmqvist, Rolf ^a  

^a LINKÖPING UNIVERSITY   (Sweden)

^b UPPSALA UNIVERSITY   (Sweden)

^c KAROLINSKA INSTITUTE   (Sweden)

^d NEW YORK STATE PSYCHIATRIC INSTITUTE   (United States)

^e UTRECHT UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COGNITIVE THERAPY; CROSSED THERAPIST DESIGN; HUMAN; META ANALYSIS; PRIORITY JOURNAL; PSYCHOTHERAPIST; PSYCHOTHERAPIST ALLEGIANCE; PSYCHOTHERAPIST ATTITUDE; PSYCHOTHERAPY; RANDOMIZED CONTROLLED TRIAL (TOPIC); RELIABILITY; STUDY DESIGN; SYSTEMATIC ERROR; TREATMENT OUTCOME;

EID: 84878250307     PISSN: 01606689     EISSN: None     Source Type: Journal    
DOI: 10.4088/JCP.12r07848     Document Type: Article

References (64)

1. Wampold BE. The Great Psychotherapy Debate: Models, Methods, and Findings. Mahwah, NJ: Lawrence Erlbaum Associates Publishers; 2001.
2. Kraus DR, Castonguay L, Boswell JF, et al. Therapist effectiveness: implications for accountability and patient care. Psychother Res. 2011;21(3):267-276. doi:10.1080/1050307.201.563249 PubMed
3. Wampold BE, Brown GS. Estimating variability in outcomes attributable to therapists: a naturalistic study of outcomes in managed care. J Consult Clin Psychol. 2005;73(5):914-923. doi:10.1037/02-06X.73.5.914 PubMed (Pubitemid 41643241)
4. Elkin I, Falconnier L, Martinovich Z, et al. Therapist effects in the National Institute of Mental Health Treatment of Depression Collaborative Research Program. Psychother Res. 2006;16(2):144-160. doi:10.1080/10503050268540
5. Kim D-M, Wampold BE, Bolt DM. Therapist effects in psychotherapy: a random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Psychother Res. 2006;16(2):161-172. doi:10.1080/1050305026491
6. Crits-Christoph P, Mintz J. Implications of therapist effects for the design and analysis of comparative studies of psychotherapies. J Consult Clin Psychol. 1991;59(1):20-26. doi:10.1037/02-06X.59.1.20 PubMed
7. de Jong K, Moerbeek M, van der Leeden R. A priori power analysis in longitudinal three-level multilevel models: an example with therapist effects. Psychother Res. 2010;20(3):273-284. doi:10.1080/10503090376320 PubMed
8. Chambless DL, Hollon SD. Defining empirically supported therapies. J Consult Clin Psychol. 1998;66(1):7-18. doi:10.1037/02-06X.6.1.7 PubMed (Pubitemid 28086807)
9. Shadish WR, Cook TD, Campbell DT. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston, MA: Houghton Mifflin; 2002.
10. Elkin I. A major dilemma in psychotherapy outcome research: disentangling therapists from therapies. Clin Psychol Sci Pract. 1999;6(1):10-32. doi:10.1093/clipsy.6.1.10
11. Cottraux J, Note I, Yao SN, et al. Randomized controlled comparison of cognitive behavior therapy with Rogerian supportive therapy in chronic post-traumatic stress disorder: a 2-year follow-up. Psychother Psychosom. 2008;77(2):101-110. doi:10.159/01287 PubMed (Pubitemid 351172100)
12. Staines GL. Comparative outcome evaluations of psychotherapies: guidelines for addressing eight limitations of the gold standard of causal inference. Psychotherapy (Chic). 2007;44(2):161-174. PubMed (Pubitemid 47444898)
13. Shapiro DA, Barkham M, Rees A, et al. Effects of treatment duration and severity of depression on the effectiveness of cognitive-behavioral and psychodynamic-interpersonal psychotherapy. J Consult Clin Psychol. 1994;62(3):522-534. doi:10.1037/02-06X.62.3.52 PubMed
14. Luborsky L, Diguer L, Seligman DA, et al. The researcher's own therapy allegiances: a "wild card" in comparisons of treatment efficacy. Clin Psychol Sci Pract. 1999;6(1):95-106. doi:10.1093/clipsy.6.1.95
15. Luborsky L, Singer B, Luborsky L. Comparative studies of psychotherapies: is it true that "everyone has one and all must have prizes"? Arch Gen Psychiatry. 1975;32(8):995-1008. doi:10.101/archpsyc.1975.017602605904 PubMed
16. Robinson LA, Berman JS, Neimeyer RA. Psychotherapy for the treatment of depression: a comprehensive review of controlled outcome research. Psychol Bull. 1990;108(1):30-49. doi:10.1037/03-2909.108.1.30 PubMed
17. Kocsis JH, Gerber AJ, Milrod B, et al. A new scale for assessing the quality of randomized clinical trials of psychotherapy. Compr Psychiatry. 2010;51(3):319-324. doi:10.1016/j.compsych.209.07.01 PubMed
18. Barkham M, Rees A, Shapiro DA, et al. Outcomes of time-limited psychotherapy in applied settings: replicating the Second Sheffield Psychotherapy Project. J Consult Clin Psychol. 1996;64(5):1079-1085. doi:10.1037/02-06X.64.5.1079 PubMed (Pubitemid 26349589)
19. Luty SE, Carter JD, McKenzie JM, et al. Randomised controlled trial of interpersonal psychotherapy and cognitive-behavioural therapy for depression. Br J Psychiatry. 2007;190(6):496-502. doi:10.192/bjp.bp.106.024729 PubMed (Pubitemid 46868833)
20. Clark DM, Ehlers A, Hackmann A, et al. Cognitive therapy versus exposure and applied relaxation in social phobia: a randomized controlled trial. J Consult Clin Psychol. 2006;74(3):568-578. doi:10.1037/02-06X.74.3.568 PubMed (Pubitemid 44128236)
21. McIntosh VVW, Jordan J, Carter FA, et al. Three psychotherapies for anorexia nervosa: a randomized, controlled trial. Am J Psychiatry. 2005;162(4):741-747. doi:10.176/api.ajp.162.4.741 PubMed (Pubitemid 40489137)
22. Taylor S, Thordarson DS, Maxfield L, et al. Comparative efficacy, speed, and adverse effects of three PTSD treatments: exposure therapy, EMDR, and relaxation training. J Consult Clin Psychol. 2003;71(2):330-338. doi:10.1037/02-06X.71.2.30 PubMed (Pubitemid 36323937)
23. Agras WS, Walsh T, Fairburn CG, et al. A multicenter comparison of cognitive-behavioral therapy and interpersonal psychotherapy for bulimia nervosa. Arch Gen Psychiatry. 2000;57(5):459-466. doi:10.101/archpsyc.57.5.459 PubMed (Pubitemid 30257260)
24. Barkham M, Shapiro DA, Hardy GE, et al. Psychotherapy in two-plus-one sessions: outcomes of a randomized controlled trial of cognitive-behavioral and psychodynamic-interpersonal therapy for subsyndromal depression. J Consult Clin Psychol. 1999;67(2):201-211. doi:10.1037/02-06X.67.2.201 PubMed (Pubitemid 29206768)
25. Beck AT, Sokol L, Clark DA, et al. A crossover study of focused cognitive therapy for panic disorder. Am J Psychiatry. 1992;149(6):778-783. PubMed
26. Bjornsson AS, Bidwell LC, Brosse AL, et al. Cognitive-behavioral group therapy versus group psychotherapy for social anxiety disorder among college students: a randomized controlled trial. Depress Anxiety. 2011;28(11):1034-1042. doi:10.102/da.2087 PubMed
27. Borkovec TD, Mathews AM, Chambers A, et al. The effects of relaxation training with cognitive or nondirective therapy and the role of relaxation-induced anxiety in the treatment of generalized anxiety. J Consult Clin Psychol. 1987;55(6):883-888. doi:10.1037/02-06X.5.6.83 PubMed
28. Borkovec TD, Mathews AM. Treatment of nonphobic anxiety disorders: a comparison of nondirective, cognitive, and coping desensitization therapy. J Consult Clin Psychol. 1988;56(6):877-884. doi:10.1037/02-06X.56.6.87 PubMed
29. Castelnuovo G, Manzoni GM, Villa V, et al. Brief strategic therapy vs cognitive behavioral therapy for the inpatient and telephone-based outpatient treatment of binge eating disorder: the STRATOB randomized controlled clinical trial. Clin Pract Epidemol Ment Health. 2011;7:29-37. PubMed
30. Cottraux J, Note ID, Boutitie F, et al. Cognitive therapy versus Rogerian supportive therapy in borderline personality disorder: two-year follow-up of a controlled pilot study. Psychother Psychosom. 2009;78(5):307-316. doi:10.159/029769 PubMed
31. Dunn NJ, Rehm LP, Schillaci J, et al. A randomized trial of self-management and psychoeducational group therapies for comorbid chronic posttraumatic stress disorder and depressive disorder. J Trauma Stress. 2007;20(3):221-237. doi:10.102/jts.20214 PubMed (Pubitemid 47075436)
32. Fairburn CG, Kirk J, O'Connor M, et al. A comparison of two psychological treatments for bulimia nervosa. Behav Res Ther. 1986;24(6):629-643. doi:10.1016/05-7967(86)9058-6 PubMed (Pubitemid 17213217)
33. Fairburn CG, Jones R, Peveler RC, et al. Three psychological treatments for bulimia nervosa: a comparative trial. Arch Gen Psychiatry. 1991;48(5):463-469. doi:10.101/archpsyc.191.0181029075014 PubMed
34. Frank E, Kupfer DJ, Thase ME, et al. Two-year outcomes for interpersonal and social rhythm therapy in individuals with bipolar I disorder. Arch Gen Psychiatry. 2005;62(9):996-1004. doi:10.101/archpsyc.62.9.96 PubMed (Pubitemid 41248379)
35. Goldman RN, Greenberg LS, Angus L. The effects of adding emotion-focused interventions to the client-centered relationship conditions in the treatment of depression. Psychother Res. 2006;16(5):537-549. doi:10.1080/10503060589456 (Pubitemid 44530270)
36. Gosselin P, Ladouceur R, Morin CM, et al. Benzodiazepine discontinuation among adults with GAD: a randomized trial of cognitive-behavioral therapy. J Consult Clin Psychol. 2006;74(5):908-919. doi:10.1037/02-06X.74.5.908 PubMed (Pubitemid 44547485)
37. le Grange D, Crosby RD, Rathouz PJ, et al. A randomized controlled comparison of family-based treatment and supportive psychotherapy for adolescent bulimia nervosa. Arch Gen Psychiatry. 2007;64(9):1049-1056. doi:10.101/archpsyc.64.9.1049 PubMed (Pubitemid 47360850)
38. Greenberg L, Watson J. Experiential therapy of depression: differential effects of client-centered relationship conditions and process experiential interventions. Psychother Res. 1998;8(2):210-224. (Pubitemid 128549095)
39. Guthrie E, Creed F, Dawson D, et al. A randomised controlled trial of psychotherapy in patients with refractory irritable bowel syndrome. Br J Psychiatry. 1993;163(3):315-321. doi:10.192/bjp.163.3.315 PubMed (Pubitemid 23274372)
40. Herbert JD, Gaudiano BA, Rheingold AA, et al. Cognitive behavior therapy for generalized social anxiety disorder in adolescents: a randomized controlled trial. J Anxiety Disord. 2009;23(2):167-177. doi:10.1016/j.janxdis.208.06.04 PubMed
41. Hopko DR, Armento MEA, Robertson SMC, et al. Brief behavioral activation and problem-solving therapy for depressed breast cancer patients: randomized trial. J Consult Clin Psychol. 2011;79(6):834-849. doi:10.1037/a025450 PubMed
42. Hudson JL, Rapee RM, Deveney C, et al. Cognitive-behavioral treatment versus an active control for children and adolescents with anxiety disorders: a randomized trial. J Am Acad Child Adolesc Psychiatry. 2009;48(5):533-544. doi:10.1097/CHI.0b013e31819c2401 PubMed
43. Lipsitz JD, Gur M, Vermes D, et al. A randomized trial of interpersonal therapy versus supportive therapy for social anxiety disorder. Depress Anxiety. 2008;25(6):542-553. doi:10.102/da.20364 PubMed (Pubitemid 351898395)
44. Marchand A, Coutu MF, Dupuis G, et al. Treatment of panic disorder with agoraphobia: randomized placebo-controlled trial of four psychosocial treatments combined with imipramine or placebo. Cogn Behav Ther. 2008;37(3):146-159. doi:10.1080/16506070701743120 PubMed
45. Marks I, Lovell K, Noshirvani H, et al. Treatment of posttraumatic stress disorder by exposure and/or cognitive restructuring: a controlled study. Arch Gen Psychiatry. 1998;55(4):317-325. doi:10.101/archpsyc.5.4.317 PubMed (Pubitemid 28173621)
46. Masheb RM, Kerns RD, Lozano C, et al. A randomized clinical trial for women with vulvodynia: cognitive-behavioral therapy vs supportive psychotherapy. Pain. 2009;141(1-2):31-40. doi:10.1016/j.pain.208.09.031 PubMed
47. Miklowitz DJ, Otto MW, Frank E, et al. Psychosocial treatments for bipolar depression: a 1-year randomized trial from the Systematic Treatment Enhancement Program. Arch Gen Psychiatry. 2007;64(4):419-426. doi:10.101/archpsyc.64.4.419 PubMed
48. Shapiro DA, Firth J. Prescriptive v. exploratory psychotherapy: outcomes of the Sheffield Psychotherapy Project. Br J Psychiatry. 1987;151(6):790-799. doi:10.192/bjp.151.6.790 PubMed (Pubitemid 18000092)
49. Snyder DK, Wills RM. Behavioral versus insight-oriented marital therapy: effects on individual and interspousal functioning. J Consult Clin Psychol. 1989;57(1):39-46. doi:10.1037/02-06X.57.1.39 PubMed (Pubitemid 19151644)
50. Strauman TJ, Vieth AZ, Merrill KA, et al. Self-system therapy as an intervention for self-regulatory dysfunction in depression: a randomized comparison with cognitive therapy. J Consult Clin Psychol. 2006;74(2):367-376. doi:10.1037/02-06X.74.2.367 PubMed (Pubitemid 43807368)
51. Tarrier N, Pilgrim H, Sommerfield C, et al. A randomized trial of cognitive therapy and imaginal exposure in the treatment of chronic posttraumatic stress disorder. J Consult Clin Psychol. 1999;67(1):13-18. doi:10.1037/02-06X.67.1.13 PubMed (Pubitemid 29077504)
52. Walsh BT, Wilson GT, Loeb KL, et al. Medication and psychotherapy in the treatment of bulimia nervosa. Am J Psychiatry. 1997;154(4):523-531. PubMed (Pubitemid 27147606)
53. Wilfley DE, Welch RR, Stein RI, et al. A randomized comparison of group cognitive-behavioral therapy and group interpersonal psychotherapy for the treatment of overweight individuals with binge-eating disorder. Arch Gen Psychiatry. 2002;59(8):713-721. doi:10.101/archpsyc.59.8.713 PubMed (Pubitemid 34847944)
54. Zettle RD, Rains JC. Group cognitive and contextual therapies in treatment of depression. J Clin Psychol. 1989;45(3):436-445. doi:10.102/1097-4679(198905)45:3〈436:AID-JCLP270450314〉3.0.CO;2-L PubMed (Pubitemid 19160407)
55. Gaffan EA, Tsaousis I, Kemp-Wheeler SM. Researcher allegiance and meta-analysis: the case of cognitive therapy for depression. J Consult Clin Psychol. 1995;63(6):966-980. doi:10.1037/02-06X.63.6.96 PubMed
56. Becker BJ. Synthesizing standardized mean-change measures. Br J Math Stat Psychol. 1988;41(2):257-278. doi:10.1/j.204-8317.198.tb0901.x
57. Cohen J. A power primer. Psychol Bull. 1992;112(1):155-159. doi:10.1037/03-2909.12.1.15 PubMed
58. Raudenbusch SW, Bryk AS. Hierarchical Linear Models. Applications and Data Analysis Methods. 2nd ed. Thousand Oaks, CA: Sage Publications; 2002.
59. Hedges LV, Tipton E, Johnson MC. Robust variance estimation in meta-regression with dependent effect size estimates. Res Synth Methods. 2010;1(1):39-65. doi:10.102/jrsm.5
60. Hedberg EC. ROBUMETA: Stata Module to Perform Robust Variance Estimation in Meta-Regression With Dependent Effect Size Estimates.: Boston, MA: Boston College Department of Economics; 2011.
61. O'Keefe DJ. Colloquy: should familywise alpha be adjusted? Hum Commun Res. 2003;29(3):431-447. doi: 10.1/j.1468-2958.203.tb0846.x
62. Thoma NC, McKay D, Gerber AJ, et al. A quality-based review of randomized controlled trials of cognitive-behavioral therapy for depression: an assessment and metaregression. Am J Psychiatry. 2012;169(1):22-30. doi:10.176/api.ajp.201. 103043 PubMed
63. Webb CA, Derubeis RJ, Barber JP. Therapist adherence/competence and treatment outcome: a meta-analytic review. J Consult Clin Psychol. 2010;78(2):200-211. doi:10.1037/a018912 PubMed
64. Markowitz JC, Kocsis JH, Christos P, et al. Pilot study of interpersonal psychotherapy versus supportive psychotherapy for dysthymic patients with secondary alcohol abuse or dependence. J Nerv Ment Dis. 2008;196(6):468-474. doi:10.1097/NMD.0b013e3181738f1 PubMed