Is there an excess of significant findings in published studies of psychotherapy for depression?

Psychological Medicine

Volumn 45, Issue 2, 2015, Pages 439-446

  Flint, J ^a   Cuijpers, P ^b   Horder, J ^c   Koole, S L ^b   Munafo M R ^d  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b VU UNIVERSITY AMSTERDAM   (Netherlands)

^c KING'S COLLEGE LONDON   (United Kingdom)

^d UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

Cognitive behavioural therapy; depression; excess of significance; meta Analysis; psychotherapy; publication bias

Indexed keywords

ANTIDEPRESSANT AGENT;

DEPRESSIVE DISORDER, MAJOR; HUMAN; META ANALYSIS; PROCEDURES; PSYCHOTHERAPY; PUBLISHING; RANDOMIZED CONTROLLED TRIAL (TOPIC);

ANTIDEPRESSIVE AGENTS; DEPRESSIVE DISORDER, MAJOR; HUMANS; PSYCHOTHERAPY; PUBLICATION BIAS; RANDOMIZED CONTROLLED TRIALS AS TOPIC;

EID: 84988296152     PISSN: 00332917     EISSN: 14698978     Source Type: Journal    
DOI: 10.1017/S0033291714001421     Document Type: Article

References (23)

1. Barth J, MunDer T, Gerger H, Nuesch E, Trelle S, Znoj H, Juni P, Cuijpers P (2013). Comparative efficacy of seven psychotherapeutic interventions for patients with depression: a network meta-Analysis. PLoS Medicine 10, e1001454
2. Button KS, Ioannidis JP, Mokrysz C, Nosek BA, Flint J, Robinson ES, Munafo MR (2013a). ConfiDence and precision increase with high statistical power. Nature Reviews Neuroscience 14, 585
3. Button KS, Ioannidis JP, Mokrysz C, Nosek BA, Flint J, Robinson ES, Munafo MR (2013b). Power failure: why small sample size unDermines the reliability of neuroscience. Nature Reviews Neuroscience 14, 365-376
4. Clark DM (2011). Implementing NICE guidelines for the psychological treatment of depression and anxiety disorDers: the IAPT experience. International Review of Psychiatry 23, 318-327
5. Cuijpers P, AnDersson G, Donker T, Van Straten A (2011). Psychological treatment of depression: results of a series of meta-Analyses. Nordic Journal of Psychiatry 65, 354-364
6. Cuijpers P, Smit F, Bohlmeijer E, Hollon SD, AnDersson G (2010). Efficacy of cognitive-behavioural therapy and other psychological treatments for adult depression: meta-Analytic study of publication bias. British Journal of Psychiatry 196, 173-178
7. Cuijpers P, Van Straten A, AnDersson G, Van Oppen P (2008a). Psychotherapy for depression in adults: a meta-Analysis of comparative outcome studies. Journal of Consulting and Clinical Psychology 76, 909-922
8. Cuijpers P, Van Straten A, Van Oppen P, AnDersson G (2008b). Are psychological and pharmacologic interventions equally effective in the treatment of adult depressive disorDers? A meta-Analysis of comparative studies. Journal of Clinical Psychiatry 69, 1675-1685
9. Elkin I, Shea MT, Watkins JT, Imber SD, Sotsky SM, Collins JF, Glass DR, Pilkonis PA, Leber WR, Docherty JP, Fiester SJ, Parloff MB (1989). National Institute of Mental Health Treatment of Depression Collaborative Research Program. General effectiveness of treatments. Archives General Psychiatry 46, 971-982
10. Faul F, ErdfelDer E, Lang AG, Buchner A (2007). G Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods 39, 175-191
11. Francis G (2012). EviDence that publication bias contaminated studies relating social class and unethical behavior. Proceedings of the National Academy of Sciences USA 109, E1587
12. Hedges LV, Olkin I (1985). Statistical Methods for Meta-Analysis. Academic Press: Orlando, FL
13. Higgins JP, Thompson SG, Deeks JJ, Altman DG (2003). Measuring inconsistency in meta-Analyses. British Medical Journal 327, 557-560
14. Higgins JPT, Green S (2011). Cochrane Handbook for Systematic Reviews of Interventions. The Cochrane Collaboration (www.cochrane-handbook.org
15. HorDer J, Matthews P, Waldmann R (2011). Placebo, prozac and PLoS: significant lessons for psychopharmacology. Journal of Psychopharmacology 25, 1277-1288
16. Ioannidis JP (2011). Excess significance bias in the literature on brain volume abnormalities. Archives General Psychiatry 68, 773-780
17. Ioannidis JP, Trikalinos TA (2007). An exploratory test for an excess of significant findings. Clinical Trials 4, 245-253
18. Ioannidis JPA (2013). Clarifications on the application and interpretation of the test for excess significance and its extensions. Journal of Mathematical Psychology 57, 184-187
19. Kirsch I, Deacon BJ, Huedo-Medina TB, Scoboria A, Moore TJ, Johnson BT (2008). Initial severity and antidepressant benefits: a meta-Analysis of data submitted to the Food and Drug Administration. PLoS Medicine 5, e45
20. Lau J, Ioannidis JP, Terrin N, Schmid CH, Olkin I (2006). The case of the misleading funnel plot. British Medical Journal 333, 597-600
21. Murphy SE, Norbury R, Godlewska BR, Cowen PJ, Mannie ZM, Harmer CJ, Munafo MR (2013). The effect of the serotonin transporter polymorphism (5-HTTLPR) on amygdala function: a meta-Analysis. Molecular Psychiatry 18, 512-520
22. Simmons JP, Nelson LD, Simonsohn U (2011). False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science 22, 1359-1366
23. Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R (2008). Selective publication of antidepressant trials and its influence on apparent efficacy. New England Journal of Medicine 358, 252-260