Is the allegiance effect an epiphenomenon of true efficacy differences between treatments? A meta-analysis

Journal of Counseling Psychology

Volumn 59, Issue 4, 2012, Pages 631-637

  Munder, Thomas ^a   Flückiger, Christoph ^b   Gerger, Heike ^a   Wampold, Bruce E ^c   Barth, Jürgen ^a  

^a UNIVERSITY OF BERN   (Switzerland)

^b UNIVERSITY OF ZURICH   (Switzerland)

^c MODUM BAD PSYCHIATRIC CENTER   (Norway)

Author keywords

Comparative outcome research; Meta analysis; Researcher allegiance

Indexed keywords

EID: 84874300882     PISSN: 00220167     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0029571     Document Type: Article

References (51)

1. Arntz, A., Tiesema, M., & Kindt, M. (2007). Treatment of PTSD: A comparison of imaginal exposure with and without imagery rescripting. Journal of Behavior Therapy and Experimental Psychiatry, 38, 345-370. doi:10.1016/j.jbtep.2007.10.006
2. Berman, J. S., Miller, R., & Massman, P. J. (1985). Cognitive therapy versus systematic desensitization: Is one treatment superior? Psychological Bulletin, 97, 451-461. doi:10.1037/0033-2909.97.3.451
3. Bisson, J., & Andrew, M. (2008). Psychological treatment of posttraumatic stress disorder (PTSD). Cochrane Database of Systematic Reviews. doi:10.1002/14651858.CD003388.pub3
4. Blake, D. D., Weathers, F. W., Nagy, L. M., Kaloupek, D. G., Gusman, F. D., Charney, D. S., & Keane, T. M. (1995). The development of a clinician-administered PTSD scale. Journal of Traumatic Stress, 8, 74-90. doi:10.1007/BF02105408
5. Bradley, R., Greene, J., Russ, E., Dutra, L., & Westen, D. (2005). A multidimensional meta-analysis of psychotherapy for PTSD. American Journal of Psychiatry, 162, 214-227. doi:10.1176/appi.ajp.162.2.214
6. Bryant, R. A., Moulds, M. L., Guthrie, R. M., Dang, S. T., Mastrodomenico, J., Nixon, R. D. V.,... Creamer, M. (2008). A randomized controlled trial of exposure therapy and cognitive restructuring for posttraumatic stress disorder. Journal of Consulting and Clinical Psychology, 76, 695-703. doi:10.1037/a0012616
7. Bryant, R. A., Moulds, M. L., Guthrie, R. M., Dang, S. T., & Nixon, R. D. V. (2003). Imaginal exposure alone and imaginal exposure with cognitive restructuring in treatment of posttraumatic stress disorder. Journal of Consulting and Clinical Psychology, 71, 706-712. doi: 10.1037/0022-006X.71.4.706
8. Cloitre, M., Stovall-McClough, K., Nooner, K., Zorbas, P., Cherry, S., Jackson, C. L.,... Petkova, E. (2010). Treatment for PTSD related to childhood abuse: A randomized controlled trial. American Journal of Psychiatry, 167, 915-924. doi:10.1176/appi.ajp.2010.09081247
9. DerSimonian, R., & Laird, N. (1986). Meta-analysis in clinical trials. Controlled Clinical Trials, 7, 177-188. doi:10.1016/0197-2456(86)90046-2
10. Devilly, G. J., & Spence, S. H. (1999). The relative efficacy and treatment distress of EMDR and a cognitive-behavior trauma treatment protocol in the amelioration of posttraumatic stress disorder. Journal of Anxiety Disorders, 13, 131-157. doi:10.1016/S0887-6185(98)00044-9
11. Devilly, G. J., Spence, S. H., & Rapee, R. M. (1998). Statistical and reliable change with eye movement desensitization and reprocessing: Treating trauma within a veteran population. Behavior Therapy, 29, 435-455. doi:10.1016/S0005-7894(98)80042-7
12. Ehlers, A., Bisson, J., Clark, D. M., Creamer, M., Pilling, S., Richards, D.,... Yule, R. (2010). Do all psychological treatments really work the same in posttraumatic stress disorder? Clinical Psychology Review, 30, 269-276. doi:10.1016/j.cpr.2009.12.001
13. Ehlers, A., Clark, D. M., Hackmann, A., McManus, F., & Fennell, M. (2005). Cognitive therapy for post-traumatic stress disorder: Development and evaluation. Behaviour Research and Therapy, 43, 413-431. doi:10.1016/j.brat.2004.03.006
14. Foa, E. B., Dancu, C. V., Hembree, E. A., Jaycox, L. H., Meadows, E. A., & Street, G. P. (1999). A comparison of exposure therapy, stress inoculation training, and their combination for reducing posttraumatic stress disorder in female assault victims. Journal of Consulting and Clinical Psychology, 67, 194-200. doi:10.1037/0022-006X.67.2.194
15. Foa, E. B., Hembree, E. A., Cahill, S. P., Rauch, S. A. M., Riggs, D. S., Feeny, N. C., & Yadin, E. (2005). Randomized trial of prolonged exposure for posttraumatic stress disorder with and without cognitive restructuring: Outcome at academic and community clinics. Journal of Consulting and Clinical Psychology, 73, 953-964. doi:10.1037/0022-006X.73.5.953
16. Gaffan, E. A., Tsaousis, I., & Kemp-Wheeler, S. M. (1995). Researcher allegiance and meta-analysis: The case of cognitive therapy for depression. Journal of Consulting and Clinical Psychology, 63, 966-980. doi:10.1037/0022-006X.63.6.966
17. Gerger, H., Zurkinden, R., Jüni, P., Munder, T., & Barth, J. (2009, June). Network meta-analysis on the comparative efficacy of individual psychotherapies for PTSD. Poster presented at the 40th International Meeting of the Society for Psychotherapy Research, Santiago, Chile.
18. Higgins, J. P. T., Deeks, J. J., & Altman, D. G. (2011). Chapter 16: Special topics in statistics. In J. P. T. Higgins &S. Green (Eds.), Cochrane handbook for systematic reviews of interventions (Version 5.1.0). Retrieved from http://www.cochrane-handbook.org
19. Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. British Medical Journal, 327, 557-560. doi:10.1136/bmj.327.7414.557
20. Horowitz, M. J., Wilner, N., & Alvarez, W. (1979). The Impact of Event Scale: A measure of subjective stress. Psychosomatic Medicine, 41, 209-218.
21. Ironson, G., Freud, B., Strauss, J., & Williams, J. (2002). Comparison for two treatments for traumatic stress: A community-based study of EMDR and prolonged exposure. Journal of Clinical Psychology, 58, 113-128. doi:10.1002/jclp.1132
22. Johnson, D. R., & Lubin, H. (2006). The counting method: Applying the rule of parsimony to the treatment of posttraumatic stress disorder. Traumatology, 12, 83-99. doi:10.1177/153476560601200106
23. Lambert, M. (1999). Are differential treatment effects inflated by researcher therapy allegiance? Could Clever Hans count? Clinical Psychology: Science and Practice, 6, 127-130. doi:10.1093/clipsy/6.1.127
24. Lambert, M., & Ogles, B. (2004). The efficacy and effectiveness of psychotherapy. In M. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (5th ed., pp. 139-193). New York, NY: Wiley.
25. Lee, C., Gavriel, H., Drummond, P., Richards, J., & Greenwald, R. (2002). Treatment of PTSD: Stress inoculation training with prolonged exposure compared to EMDR. Journal of Clinical Psychology, 58, 1071-1089. doi:10.1002/jclp.10039
26. Leykin, Y., & DeRubeis, R. J. (2009). Allegiance in psychotherapy outcome research: Separating association from bias. Clinical Psychology: Science and Practice, 16, 54-65. doi:10.1111/j.1468-2850.2009.01143.x
27. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
28. Luborsky, L., Diguer, L., Seligman, D. A., Rosenthal, R., Krause, E. D., Johnson, S.,... Schweizer, E. (1999). The researcher's own therapy allegiances: A "wild card" in comparisons of treatment efficacy. Clinical Psychology: Science and Practice, 6, 95-106. doi:10.1093/clipsy/6.1.95
29. Luborsky, L., Singer, B., & Luborsky, L. (1975). Comparative studies of psychotherapies: Is it true that "Everyone has won and all must have prizes"? Archives of General Psychiatry, 32, 995-1008. doi:10.1001/archpsyc.1975.01760260059004
30. Marks, I., Lovell, K., Noshirvani, H., Livanou, M., & Thrasher, S. (1998). Treatment of posttraumatic stress disorder by exposure and/or cognitive restructuring: A controlled study. Archives of General Psychiatry, 55, 317-325. doi:10.1001/archpsyc.55.4.317
31. Miller, S., Wampold, B. E., & Varhely, K. (2008). Direct comparisons of treatment modalities for youth disorders: A meta-analysis. Psychotherapy Research, 18, 5-14. doi:10.1080/10503300701472131
32. Munder, T., Gerger, H., Trelle, S., & Barth, J. (2011). Testing the allegiance bias hypothesis: A meta-analysis. Psychotherapy Research, 21, 670-684. doi:10.1080/10503307.2011.602752
33. National Institute for Clinical Excellence. (2005). Post-traumatic stress disorder. The management of PTSD in adults and children in primary and secondary care (National Clinical Practice Guideline Number 26). Retrieved from http://www.nice.org.uk/nicemedia/live/10966/29772/29772.pdf
34. Nüesch, E., Trelle, S., Reichenbach, S., Rutjes, A. W. S., Bürgi, E., Scherer, M.,... Jüni, P. (2009). The effects of excluding patients from the analysis in randomised controlled trials: Meta-epidemiological study [online exclusive]. British Medical Journal. doi:10.1136/bmj.b3244
35. Paunovic, N., & öst, L. G. (2001). Cognitive-behavior therapy vs exposure therapy in the treatment of PTSD in refugees. Behaviour Research and Therapy, 39, 1183-1197. doi:10.1016/S0005-7967(00)00093-0
36. Power, K., McGoldrick, T., Brown, K., Buchanan, R., Sharp, D., Swanson, V., & Karatzias, A. (2002). A controlled comparison of eye movement desensitization and reprocessing versus exposure plus cognitive restructuring versus waiting list in the treatment of post-traumatic stress disorder. Clinical Psychology and Psychotherapy, 9, 299-318. doi: 10.1002/cpp.341
37. Powers, M. B., Halpern, J. M., Ferenschak, M. P., Gillihan, S. J., & Foa, E. B. (2010). A meta-analytic review of prolonged exposure for posttraumatic stress disorder. Clinical Psychology Review, 30, 635-641. doi:10.1016/j.cpr.2010.04.007
38. Resick, P. A., Galovski, T. E., Uhlmansiek, M. O., Scher, C. D., Clum, G. A., & Young-Xu, Y. (2008). A randomized clinical trial to dismantle components of cognitive processing therapy for posttraumatic stress disorder in female victims of interpersonal violence. Journal of Consulting and Clinical Psychology, 76, 243-258. doi:10.1037/0022-006X.76.2.243
39. Resick, P. A., Nishith, P., Weaver, T. L., Astin, M. C., & Feuer, C. A. (2002). A comparison of cognitive-processing therapy with prolonged exposure and a waiting condition for the treatment of chronic posttraumatic stress disorder in female rape victims. Journal of Consulting and Clinical Psychology, 70, 867-879. doi:10.1037/0022-006X.70.4.867
40. Robinson, L. A., Berman, J. S., & Neimeyer, R. A. (1990). Psychotherapy for the treatment of depression: A comprehensive review of controlled outcome research. Psychological Bulletin, 108, 30-49. doi:10.1037/0033-2909.108.1.30
41. Rogers, S., Silver, S. M., Goss, J., Obenchain, J., Willis, A., & Whitney, R. L. (1999). A single session, group study of exposure and eye movement desensitization and reprocessing in treating posttrau-636 MUNDER, FLÜ CKIGER, GERGER, WAMPOLD, AND BARTH matic stress disorder among Vietnam war veterans: Preliminary data. Journal of Anxiety Disorders, 13, 119-130. doi:10.1016/S0887-6185(98)00043-7
42. Rosenthal, R., & Rosnow, R. L. (1991). Essentials of behavioral research: Methods and data analysis (2nd ed.). New York, NY: McGraw-Hill.
43. Rothbaum, B. O., Astin, M. C., & Marsteller, F. (2005). Prolonged exposure versus eye movement desensitization and reprocessing (EMDR) for PTSD rape victims. Journal of Traumatic Stress, 18, 607-616. doi:10.1002/jts.20069
44. Shapiro, F. (1989). Efficacy of the eye movement desensitization procedure in the treatment of traumatic memories. Journal of Traumatic Stress, 2, 199-223. doi:10.1002/jts.2490020207
45. Tarrier, N., Pilgrim, H., Sommerfield, C., Faragher, B., Reynolds, M., Graham, E., & Barrowclough, C. (1999). A randomized trial of cognitive therapy and imaginal exposure in the treatment of chronic posttraumatic stress disorder. Journal of Consulting and Clinical Psychology, 67, 13-18. doi:10.1037/0022-006X.67.1.13
46. Taylor, S., Thordarson, D., Fedoroff, I., Maxfield, L., Lovell, K., & Ogrodniczuk, J. (2003). Comparative efficacy, speed, and adverse effects of three PTSD treatments: Exposure therapy, EMDR, and relaxation training. Journal of Consulting and Clinical Psychology, 71, 330-338. doi:10.1037/0022-006X.71.2.330
47. Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008). Selective publication of antidepressant trials and its influence on apparent efficacy. New England Journal of Medicine, 358, 252-260. doi:10.1056/NEJMsa065779
48. van Etten, M. L., & Taylor, S. (1998). Comparative efficacy of treatments for post-traumatic stress disorder: A meta-analysis. Clinical Psychology and Psychotherapy, 5, 126-144. doi:10.1002/(SICI)1099-0879(199809)5:3-126::AID-CPP153-3.0.CO;2-H
49. Wampold, B. E. (2001). The great psychotherapy debate: Model, methods and findings. Mahwah, NJ: Erlbaum.
50. Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-n. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empirically, "all must have prizes". Psychological Bulletin, 122, 203-215. doi:10.1037/0033-2909.122.3.203
51. Weisz, J. R., Weiss, B., Han, S. S., Granger, D. A., & Morton, T. (1995). Effects of psychotherapy with children and adolescents revisited: A meta-analysis of treatment outcome studies. Psychological Bulletin, 117, 450-468. doi:10.1037/0033-2909.117.3.450