Researcher allegiance in psychotherapy outcome research: An overview of reviews

Clinical Psychology Review

Volumn 33, Issue 4, 2013, Pages 501-511

  Munder, Thomas ^a,b   Brütsch, Oliver ^a   Leonhart, Rainer ^c   Gerger, Heike ^a   Barth, Jürgen ^a  

^a UNIVERSITY OF BERN   (Switzerland)

^b UNIVERSITY OF KASSEL   (Germany)

^c UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Overview of reviews; Psychotherapy outcome research; Researcher allegiance

Indexed keywords

COGNITIVE THERAPY; EFFECT SIZE; FAMILY THERAPY; GROUP THERAPY; HUMAN; MEDICAL RESEARCH; META ANALYSIS; PSYCHOTHERAPY; PUBLISHING; REVIEW; RISK ASSESSMENT; TREATMENT OUTCOME;

META-ANALYSIS AS TOPIC; MODELS, STATISTICAL; OUTCOME ASSESSMENT (HEALTH CARE); PSYCHOTHERAPY; PUBLICATION BIAS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REVIEW LITERATURE AS TOPIC;

EID: 84874985489     PISSN: 02727358     EISSN: 18737811     Source Type: Journal    
DOI: 10.1016/j.cpr.2013.02.002     Document Type: Review

References (61)

1. Baskin T.W., Tierney S.C., Minami T., Wampold B.E. Establishing specificity in psychotherapy: A meta-analysis of structural equivalence of placebo controls. Journal of Consulting and Clinical Psychology 2003, 71:973-979. 10.1037/0022-006X.71.6.973.
2. Becker L.A., Oxman A.D. Chapter 22: Overview of reviews. Cochrane handbook for systematic reviews of interventions (version 5.1.0) 2011, (Retrieved from http://www.cochrane-handbook.org). J.P.T. Higgins, S. Green (Eds.).
3. *Berman J.S., Miller R., Massman P.J. Cognitive therapy versus systematic desensitization: Is one treatment superior?. Psychological Bulletin 1985, 97:451-461. 10.1037/0033-2909.97.3.451.
4. *Burke B.L., Arkowitz H., Menchola M. The efficacy of motivational interviewing: A meta-analysis of controlled clinical trials. Journal of Consulting and Clinical Psychology 2003, 71:843-861. 10.1037/0022-006X.71.5.843.
5. Chambless D.L., Hollon S.D. Defining empirically supported treatments. Journal of Consulting and Clinical Psychology 1998, 66:7-18. 10.1037/0022-006X.66.1.7.
6. Cooper H., Koenka A.C. The overview of reviews: Unique challenges and opportunities when research syntheses are the principal elements of new integrative scholarship. American Psychologist 2012, 67:446-462. 10.1037/a0027119.
7. *Cuijpers P., Driessen E., Hollon S.D., van Oppen P., Barth J., Andersson G. The efficacy of non-directive supportive therapy for adult depression: A meta-analysis. Clinical Psychology Review 2012, 32:280-291. 10.1016/j.cpr.2012.01.003.
8. Cuijpers P., Smit F., Bohlmeijer E., Hollon S.D., Andersson G. Efficacy of cognitive-behavioural therapy and other psychological treatments for adult depression: Meta-analytic study of publication bias. The British Journal of Psychiatry 2010, 196:173-178. 10.1192/bjp.bp.109.066001.
9. Cuijpers P., van Straten A., Bohlmeijer E., Hollon S.D., Andersson G. The effects of psychotherapy for adult depression are overestimated: A meta-analysis of study quality and effect size. Psychological Medicine 2010, 40:211-223. 10.1017/S0033291709006114.
10. *Currier J.M., Holland J.M., Neimeyer R.A. Do CBT-based interventions alleviate distress following bereavement? A review of the current evidence. International Journal of Cognitive Therapy 2010, 3:77-93. 10.1521/ijct.2010.3.1.77.
11. *Dush D.M., Hirt M.L., Schroeder H. Self-statement modification with adults: A meta-analysis. Psychological Bulletin 1983, 94:408-422. 10.1037/0033-2909.94.3.408.
12. Elkin I., Shea M.T., Watkins J.T., Imber S.D., Sotsky S.M., Collins J.F., et al. National institute of mental health treatment of depression collaborative research program: General effectiveness of treatments. Archives of General Psychiatry 1989, 46:971-982. 10.1001/archpsyc.1989.01810110013002.
13. *Elliott R., Greenberg L.S., Lietaer G. Research on experiential psychotherapies. Bergin & Garfield's handbook of psychotherapy and behavior change 2004, 493-539. Wiley, New York, NY. 5th ed. M.J. Lambert (Ed.).
14. *Gaffan E.A., Tsaousis I., Kemp-Wheeler S.M. Researcher allegiance and meta-analysis: The case of cognitive therapy for depression. Journal of Consulting and Clinical Psychology 1995, 63:966-980. 10.1037/0022-006X.63.6.966.
15. *Ghahramanlou M. Cognitive behavioral treatment efficacy for anxiety disorders: A meta-analytic review. Dissertation Abstracts International: Section B: The Sciences and Engineering 2003, 64(4-B):1901.
16. Harbord R.M., Higgins J.P.T. Meta-regression in Stata. The Stata Journal 2008, 8:493-519.
17. Hedges L.V., Olkin I. Statistical methods for meta-analysis 1985, Academic Press, Inc., Orlando, FL.
18. Higgins J.P.T., Deeks J.J., Altman D.G. Chapter 16: Special topics in statistics. Cochrane handbook for systematic reviews of interventions (version 5.1.0) 2011, (Retrieved from http://www.cochrane-handbook.org). J.P.T. Higgins, S. Green (Eds.).
19. Higgins J.P.T., Thompson S.G. Controlling the risk of spurious findings from meta-regression. Statistics in Medicine 2004, 23:1663-1682. 10.1002/sim.1752.
20. Higgins J.P.T., Thompson S.G., Deeks J.J., Altman D.G. Measuring inconsistency in meta-analyses. British Medical Journal 2003, 327:557-560. 10.1136/bmj.327.7414.557.
21. Hight T.L. Do the rich get richer? A meta-analysis of methodological and substantive moderators of couple enrichment. Dissertation Abstracts International: Section B: The Sciences and Engineering 2000, 61(6-B):3278.
22. *Hoag M.J., Burlingame G.M. Evaluating the effectiveness of child and adolescent group treatment: A meta-analytic review. Journal of Clinical Child Psychology 1997, 26:234-246. 10.1207/s15374424jccp2603_2.
23. *Houts A.C., Berman J.S., Abramson H. Effectiveness of psychological and pharmacological treatments for nocturnal enuresis. Journal of Consulting and Clinical Psychology 1994, 62:737-745. 10.1037/0022-006X.62.4.737.
24. *Imel Z.E., Wampold B.E., Miller S.D., Fleming R.R. Distinctions without a difference: Direct comparisons of psychotherapies for alcohol use disorders. Psychology of Addictive Behaviors 2008, 22:533-543. 10.1037/a0013171.
25. Kaptchuk T.J. The double-blind, randomized, placebo-controlled trial: Gold standard or golden calf?. Journal of Clinical Epidemiology 2001, 54:541-549. 10.1016/S0895-4356(00)00347-4.
26. Klein D.F. Dealing with the effects of therapy allegiances. Clinical Psychology: Science and Practice 1999, 6:124-126. 10.1093/clipsy.6.1.124.
27. Knapp G., Hartung J. Improved tests for a random effects meta-regression with a single covariate. Statistics in Medicine 2003, 22:2693-2710. 10.1002/sim.1482.
28. Lambert M.J. Are differential treatment effects inflated by researcher therapy allegiance? Could clever Hans count?. Clinical Psychology: Science and Practice 1999, 6:127-130. 10.1093/clipsy.6.1.127.
29. Lambert M.J., Ogles B. The efficacy and effectiveness of psychotherapy. Bergin and Garfield's handbook of psychotherapy and behavior change 2004, 139-193. Wiley, New York, NY. 5th ed. M.J. Lambert (Ed.).
30. Leichsenring F., Hoyer J., Beutel M., Herpertz S., Hiller W., Irle E., et al. The social phobia psychotherapy research network. The first multicenter randomized controlled trial of psychotherapy for social phobia: Rationale, methods and patient characteristics. Psychotherapy and Psychosomatics 2009, 78:35-41. 10.1159/000162299.
31. Leykin Y., DeRubeis R.J. Allegiance in psychotherapy outcome research: Separating association from bias. Clinical Psychology: Science and Practice 2009, 16:54-65. 10.1111/j.1468-2850.2009.01143.x.
32. Lipsey M.W., Wilson D.B. Practical meta-analysis 2001, Sage, Thousand Oaks, CA.
33. *Luborsky L., Diguer L., Luborsky E., Singer B., Dickter D., Schmidt K. The efficacy of dynamic psychotherapies: Is it true that "everyone has won and all must have prizes?". Psychodynamic treatment 1993, 497-516. Basic Books, New York, NY. N. Miller, L. Luborsky, J. Barber, J. Docherty (Eds.).
34. *Luborsky L., Diguer L., Seligman D.A., Rosenthal R., Krause E.D., Johnson S., et al. The researcher's own therapy allegiances: A "wild card" in comparisons of treatment efficacy. Clinical Psychology: Science and Practice 1999, 6:95-106. 10.1093/clipsy.6.1.95.
35. Luborsky L., Singer B., Luborsky L. Comparative studies of psychotherapies: Is it true that "everybody has won and all must have prizes"?. Archives of General Psychiatry 1975, 32:995-1008.
36. *McRoberts C., Burlingame G.M., Hoag M.J. Comparative efficacy of individual and group psychotherapy: A meta-analytic perspective. Group Dynamics: Theory, Research, and Practice 1998, 2:101-117. 10.1037/1089-2699.2.2.101.
37. *Menchola M., Arkowitz H.S., Burke B.L. Efficacy of self-administered treatments for depression and anxiety. Professional Psychology: Research and Practice 2007, 38:421-429. 10.1037/0735-7028.38.4.421.
38. *Miller S., Wampold B., Varhely K. Direct comparisons of treatment modalities for youth disorders: A meta-analysis. Psychotherapy Research 2008, 18:5-14. 10.1080/10503300701472131.
39. Moher D., Liberati A., Tetzlaff J., Altman D.G. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine 2009, 6(7):e1000097. The PRISMA Group. 10.1371/journal.pmed.1000097.
40. *Mojtabai R., Nicholson R.A., Carpenter B.N. Role of psychosocial treatments in management of schizophrenia: A meta-analytic review of controlled outcome studies. Schizophrenia Bulletin 1998, 24:569-587.
41. *Munder T., Flückiger C., Gerger H., Wampold B.E., Barth J. Is the allegiance effect an epiphenomenon of true efficacy differences between treatments? A meta-analysis. Journal of Counseling Psychology 2012, 59:631-637. 10.1037/a0029571.
42. *Munder T., Gerger H., Trelle S., Barth J. Testing the allegiance bias hypothesis: A meta-analysis. Psychotherapy Research 2011, 21:670-684. 10.1080/10503307.2011.602752.
43. Orwin R.G. A fail-safe n for effect size in meta-analysis. Journal of Educational Statistics 1983, 8:157-159.
44. Perepletchikova F., Treat T.A., Kazdin A.E. Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology 2007, 75:829-841. 10.1037/0022-006X.75.6.829.
45. *Prendergast M.L., Podus D., Chang E., Urada D. The effectiveness of drug abuse treatment: A meta-analysis of comparison group studies. Drug and Alcohol Dependence 2002, 67:53-72. 10.1016/S0376-8716(02)00014-5.
46. *Robinson L.A., Berman J.S., Neimeyer R.A. Psychotherapy for the treatment of depression: A comprehensive review of controlled outcome research. Psychological Bulletin 1990, 108:30-49. 10.1037/0033-2909.108.1.30.
47. Shadish W.R., Cook T.D., Campbell D.T. Experimental and quasi-experimental designs for generalized causal inference 2002, Houghton Mifflin, Boston, MA.
48. *Shadish W.R., Montgomery L.M., Wilson P., Wilson M.R., Bright I., Okwumabua T. Effects of family and marital psychotherapies: A meta-analysis. Journal of Consulting and Clinical Psychology 1993, 61:992-1002. 10.1037/0022-006X.61.6.992.
49. *Shirk S.R., Russell R.L. A reevaluation of estimates of child therapy effectiveness. Journal of the American Academy of Child and Adolescent Psychiatry 1992, 31:703-710. 10.1097/00004583-199207000-00019.
50. *Smith M.L., Glass G.V., Miller T.I. The benefits of psychotherapy 1980, Johns Hopkins University Press, Baltimore, MD.
51. *Spielmans G.I., Berman M.I., Usitalo A.N. Psychotherapy versus second-generation antidepressants in the treatment of depression: A meta-analysis. The Journal of Nervous and Mental Disease 2011, 199:142-149. 10.1097/NMD.0b013e31820caefb.
52. *Spielmans G.I., Gatlin E.T., McFall J.P. The efficacy of evidence-based psychotherapies versus usual care for youths: Controlling confounds in a meta-reanalysis. Psychotherapy Research 2010, 20:234-246. 10.1080/10503300903311293.
53. Tamim R.M., Bernard R.M., Borokhovski E., Abrami P.C., Schmid R.F. What forty years of research says about the impact of technology on learning: A second-order meta-analysis and validation study. Review of Educational Research 2011, 81:4-28. 10.3102/0034654310393361.
54. Thase M.E. What is the investigator allegiance effect and what should we do about it?. Clinical Psychology: Science and Practice 1999, 6:113-115. 10.1093/clipsy.6.1.113.
55. *Tolin D.F. Is cognitive-behavioral therapy more effective than other therapies? A meta-analytic review. Clinical Psychology Review 2010, 30:710-720. 10.1016/j.bbr.2011.03.031.
56. Wampold B.E. The great psychotherapy debate: Model, methods and findings 2001, Lawrence Erlbaum, Mahwah, NJ.
57. Wampold B.E., Mondin G.W., Moody M., Stich F., Benson K., Ahn H.-n. A meta-analysis of outcome studies comparing bona fide psychotherapies: Empirically, "all must have prizes". Psychological Bulletin 1997, 122:203-215. 10.1037/0033-2909.122.3.203.
58. Wampold B.E., Serlin R.C. The consequence of ignoring a nested factor on measures of effect size in analysis of variance. Psychological Methods 2000, 5:425-433. 10.1037/1082-989X.5.4.425.
59. *Weisz J.R., Jensen-Doss A., Hawley K.M. Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist 2006, 61:671-689. 10.1037/0003-066X.61.7.671.
60. Weisz J.R., Weiss B., Han S.S., Granger D.A., Morton T. Effects of psychotherapy with children and adolescents revisited: A meta-analysis of treatment outcome studies. Psychological Bulletin 1995, 117:450-468. 10.1037/0033-2909.117.3.450.
61. Westen D., Novotny C.M., Thompson-Brenner H. The next generation of psychotherapy research: Reply to Ablon and Marci (2004), Goldfried and Eubanks-Carter (2004), and Haaga (2004). Psychological Bulletin 2004, 130:677-683. 10.1037/0033-2909.130.4.677.