Burning issues in the meta-analysis of pharmaceutical trials for depression

Journal of Psychopharmacology

Volumn 28, Issue 2, 2014, Pages 106-117

  Fountoulakis, Konstantinos N ^a   Samara, Myrto T ^a   Siamouli, Melina ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

antidepressants; Depression; randomized controlled trials

Indexed keywords

ANTIDEPRESSANT AGENT;

CLINICAL EFFECTIVENESS; DEPRESSION; DISEASE ASSOCIATION; DISEASE SEVERITY; DRUG EFFICACY; HUMAN; MAJOR DEPRESSION; META ANALYSIS (TOPIC); OUTCOME ASSESSMENT; PATIENT ASSESSMENT; PRIORITY JOURNAL; PSYCHOANALYSIS; PSYCHOLOGICAL RATING SCALE; PSYCHOMETRY; QUALITY CONTROL; REVIEW; RISK ASSESSMENT; RISK FACTOR; SYNDROME DELINEATION;

ANTIDEPRESSANTS; DEPRESSION; RANDOMIZED CONTROLLED TRIALS;

DEPRESSION; HUMANS; META-ANALYSIS AS TOPIC; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN;

EID: 84892925800     PISSN: 02698811     EISSN: 14617285     Source Type: Journal    
DOI: 10.1177/0269881113504014     Document Type: Review

References (127)

1. Al Khalaf MM, Thalib L, Doi SA. Combining heterogenous studies using the random-effects model is a mistake and leads to inconclusive meta-analyses. J Clin Epidemiol. 2010 ; 64: 119-123
2. AngellM (2011a) The epidemic of mental illness: Why? Available at: www.nybooks.com/articles/archives/2011/jun/23/epidemic-mental-illness-why/? pagination=false.
3. AngellM (2011b) The illusions of psychiatry. Available at: www.nybooks.com/articles/archives/2011/jul/14/illusions-of-psychiatry/? pagination=false.
4. Arfken CL, Balon R. Declining participation in research studies. Psychother Psychosom. 2011 ; 80: 325-328
5. Bagby RM, Ryder AG, Schuller DR, et al. The Hamilton Depression Rating Scale: Has the gold standard become a lead weight?. Am J Psychiatry. 2004 ; 161: 2163-2177 (Pubitemid 39587278)
6. Baghai TC, Blier P, Baldwin DS, et al. General and comparative efficacy and effectiveness of antidepressants in the acute treatment of depressive disorders: A report by the WPA section of pharmacopsychiatry. Eur Arch Psychiatry Clin Neurosci. 2011 ; 261: S207 - S245
7. Baghai TC, Blier P, Baldwin DS, et al. Executive summary of the report by the WPA section on pharmacopsychiatry on general and comparative efficacy and effectiveness of antidepressants in the acute treatment of depressive disorders. Eur Arch Psychiatry Clin Neurosci. 2012 ; 262: 13-22
8. Barbui C, Furukawa TA, Cipriani A. Effectiveness of paroxetine in the treatment of acute major depression in adults: A systematic re-examination of published and unpublished data from randomized trials. CMAJ. 2008 ; 178: 296-305 (Pubitemid 351212875)
9. Barrett JE, Williams JW, Oxman TE, et al. Treatment of dysthymia and minor depression in primary care: A randomized trial in patients aged 18 to 59 years. J Fam Pract. 2001 ; 50: 405-412 (Pubitemid 32440814)
10. Bauer M, Pretorius HW, Constant EL, et al. Extended-release quetiapine as adjunct to an antidepressant in patients with major depressive disorder: Results of a randomized, placebo-controlled, double-blind study. J Clin Psychiatry. 2009 ; 70: 540-549
11. Bech P. Rating scales for affective disorders: Their validity and consistency. Acta Psychiatr Scand Suppl. 1981 ; 295: 1-101
12. Bech P. Assessment scales for depression: The next 20 years. Acta Psychiatr Scand Suppl. 1983 ; 310: 117-130 (Pubitemid 14191487)
13. Bech P. The instrumental use of rating scales for depression. Pharmacopsychiatry. 1984 ; 17: 22-28 (Pubitemid 14143574)
14. Bech P. Rating scales for mood disorders: Applicability, consistency and construct validity. Acta Psychiatr Scand Suppl. 1988a ; 345: 45-55
15. Bech P. Rating scales in psychopharmacology. Statistical aspects. Acta Psychiatr Belg. 1988b ; 88: 291-302 (Pubitemid 20114780)
16. Bech P. Psychometric developments of the Hamilton scales: The spectrum of depression, dysthymia, and anxiety. Psychopharmacol Ser. 1990 ; 9: 72-79
17. Bech P. Meta-analysis of placebo-controlled trials with mirtazapine using the core items of the Hamilton Depression Scale as evidence of a pure antidepressive effect in the short-term treatment of major depression. Int J Neuropsychopharmacol. 2001 ; 4: 337-345 (Pubitemid 33151677)
18. Bech P. Modern psychometrics in clinimetrics: Impact on clinical trials of antidepressants. Psychother Psychosom. 2004 ; 73: 134-138 (Pubitemid 38437714)
19. Bech P. Rating scales in depression: Limitations and pitfalls. Dialogues Clin Neurosci. 2006 ; 8: 207-215 (Pubitemid 44113991)
20. Bech P. Applied psychometrics in clinical psychiatry: The pharmacopsychometric triangle. Acta Psychiatr Scand. 2009 ; 120: 400-409
21. Bech P. Is the antidepressive effect of second-generation antidepressants a myth?. Psychol Med. 2010 ; 40: 181-186
22. Bech P, Allerup P, Gram LF, et al. The Hamilton depression scale. Evaluation of objectivity using logistic models. Acta Psychiatr Scand. 1981 ; 63: 290-299 (Pubitemid 11137960)
23. Bech P, Cialdella P, Haugh MC, et al. Meta-analysis of randomised controlled trials of fluoxetine v. placebo and tricyclic antidepressants in the short-term treatment of major depression. Br J Psychiatry. 2000 ; 176: 421-428 (Pubitemid 30249617)
24. Bech P, Fava M, Trivedi MH, et al. Factor structure and dimensionality of the two depression scales in STAR*D using level 1 datasets. J Affect Disord. 2011a ; 132: 396-400
25. Bech P, Fava M, Trivedi MH, et al. Outcomes on the pharmacopsychometric triangle in bupropion-SR vs. buspirone augmentation of citalopram in the STAR*D trial. Acta Psychiatr Scand. 2011b ; 125: 342-348
26. Bech P, Gram LF, Dein E, et al. Quantitative rating of depressive states. Acta Psychiatr Scand. 1975 ; 51: 161-170
27. Bech P, Tanghoj P, Cialdella P, et al. Escitalopram dose-response revisited: An alternative psychometric approach to evaluate clinical effects of escitalopram compared to citalopram and placebo in patients with major depression. Int J Neuropsychopharmacol. 2004 ; 7: 283-290 (Pubitemid 39166462)
28. Blomqvist N. On the relation between change and initial value. J Am Stat Assoc. 1977 ; 72: 746-749
29. Borm GF, Donders AR. Updating meta-analyses leads to larger type I errors than publication bias. J Clin Epidemiol. 2009 ; 62: 825-830
30. Borm GF, Lemmers O, Fransen J, et al. The evidence provided by a single trial is less reliable than its statistical analysis suggests. J Clin Epidemiol. 2009 ; 62: 711-715
31. Broich K. Committee for Medicinal Products for Human Use (CHMP) assessment on efficacy of antidepressants. Eur Neuropsychopharmacol. 2009 ; 19: 305-308
32. Cipriani A, Barbui C, Salanti G, et al. Comparative efficacy and acceptability of antimanic drugs in acute mania: A multiple-treatments meta-analysis. Lancet. 2011 ; 378: 1306-1315
33. Cipriani A, Furukawa TA, Salanti G, et al. Comparative efficacy and acceptability of 12 new-generation antidepressants: A multiple-treatments meta-analysis. Lancet. 2009 ; 373: 746-758
34. Cohen J. A power primer. Psychol Bull. 1992 ; 112: 155-159
35. Cuijpers P, Smit F, Bohlmeijer E, et al. Efficacy of cognitive- behavioural therapy and other psychological treatments for adult depression: Meta-analytic study of publication bias. Br J Psychiatry. 2010a ; 196: 173-178
36. Cuijpers P, van Straten A, Schuurmans J, et al. Psychotherapy for chronic major depression and dysthymia: A meta-analysis. Clin Psychol Rev. 2010b ; 30: 51-62
37. Cuijpers P, van Straten A, van Oppen P, et al. Are psychological and pharmacologic interventions equally effective in the treatment of adult depressive disorders? A meta-analysis of comparative studies. J Clin Psychiatry. 2008 ; 69: 1675-1685
38. DeRubeis RJ, Hollon SD, Amsterdam JD, et al. Cognitive therapy vs medications in the treatment of moderate to severe depression. Arch Gen Psychiatry. 2005 ; 62: 409-416 (Pubitemid 40471690)
39. Dimidjian S, Hollon SD, Dobson KS, et al. Randomized trial of behavioral activation, cognitive therapy, and antidepressant medication in the acute treatment of adults with major depression. J Consult Clin Psychol. 2006 ; 74: 658-670 (Pubitemid 44199118)
40. El-Khalili N, Joyce M, Atkinson S, et al. Extended-release quetiapine fumarate (quetiapine XR) as adjunctive therapy in major depressive disorder (MDD) in patients with an inadequate response to ongoing antidepressant treatment: A multicentre, randomized, double-blind, placebo-controlled study. Int J Neuropsychopharmacol. 2010 ; 13: 917-932
41. Elkin I, Shea MT, Watkins JT, et al. National Institute of Mental Health Treatment of Depression Collaborative Research Program. General effectiveness of treatments. Arch Gen Psychiatry. 1989 ; 46: 971-982 (Pubitemid 19278225)
42. Fava GA. Meta-analyses and conflict of interest. CNS Drugs. 2011a ; 26: 93-96
43. Fava GA. Statistical alchemy for drug treatment of generalized anxiety disorder: A commentary on the meta-analysis by Baldwin et al. Brit Med J Psychother Psychosom. 2011b 2011 ; 342 80: 261-263
44. Fava GA, Belaise C. A discussion on the role of clinimetrics and the misleading effects of psychometric theory. J Clin Epidemiol. 2005 ; 58: 753-756 (Pubitemid 40966831)
45. Fava GA, Offidani E. The mechanisms of tolerance in antidepressant action. Prog Neuropsychopharmacol Biol Psychiatry. 2010 ; 35: 1593-1602
46. Fava GA, Rafanelli C, Tomba E. The clinical process in psychiatry: A clinimetric approach. J Clin Psychiatry. 2011a ; 73: 177-184
47. Fava GA, Tomba E, Sonino N. Clinimetrics: The science of clinical measurements. Int J Clin Pract. 2011b ; 66: 11-15
48. Fava GA, Tomba E, Tossani E. Innovative trends in the design of therapeutic trials in psychopharmacology and psychotherapy. Prog Neuropsychopharmacol Biol Psychiatry. 2013 ; 40: 306-311
49. Feinstein AR. Meta-analysis: Statistical alchemy for the 21st century. J Clin Epidemiol. 1995 ; 48: 71-79
50. Fountoulakis KN, Kontis D. Mathematical coupling and the true role of baseline severity in acute mania trials. Neuropsychopharmacology. 2012 ; 37: 850
51. Fountoulakis KN, Moller HJ. Efficacy of antidepressants: A re-analysis and re-interpretation of the Kirsch data. Int J Neuropsychopharmacol. 2010 ; 14: 405-412
52. Fountoulakis KN, Moller HJ. Antidepressants vs. placebo: Not merely a quantitative difference in response. Int J Neuropsychopharmacol. 2011 ; 14: 1435-1437
53. Fountoulakis KN, Moller HJ. Antidepressant drugs and the response in the placebo group: The real problem lies in our understanding of the issue. J Psychopharmacol. 2012 ; 26: 744-750
54. Fountoulakis KN, Hoschl C, Kasper S, et al. The media and intellectuals' response to medical publications: The antidepressants' case. Ann Gen Psychiatry. 2013 ; 12: 11
55. Fournier JC, DeRubeis RJ, Hollon SD, et al. Antidepressant drug effects and depression severity: A patient-level meta-analysis. JAMA. 2010 ; 303: 47-53
56. Gartlehner G, Gaynes BN, Hansen RA, et al. Comparative benefits and harms of second-generation antidepressants: Background paper for the American College of Physicians. Ann Intern Med. 2008 ; 149: 734-750
57. Gartlehner G, Gaynes BN, Hansen RA, et al. Ranking antidepressants. Lancet. 2009 ; 373: 1761
58. Ghaemi SN. Why antidepressants are not antidepressants: STEP-BD, STAR*D, and the return of neurotic depression. Bipolar Disord. 2008 ; 10: 957-968
59. Gibbons RD, Hur K, Brown CH, et al. Benefits from antidepressants: Synthesis of 6-week patient-level outcomes from double-blind placebo-controlled randomized trials of fluoxetine and venlafaxine. Arch Gen Psychiatry. 2012 ; 69: 572-579
60. Gibertini M, Nations KR, Whitaker JA. Obtained effect size as a function of sample size in approved antidepressants: A real-world illustration in support of better trial design. Int Clin Psychopharmacol. 2012 ; 27: 100-106
61. Glenny AM, Altman DG, Song F, et al. Indirect comparisons of competing interventions. Health Technol Assess. 2005 ; 9: 1-134
62. Goldstein DJ, Mallinckrodt C, Lu Y, et al. Duloxetine in the treatment of major depressive disorder: A double-blind clinical trial. J Clin Psychiatry. 2002 ; 63: 225-231 (Pubitemid 34407082)
63. Goodman SN. Toward evidence-based medical statistics. 1: The P value fallacy. Ann Intern Med. 1999a ; 130: 995-1004 (Pubitemid 29283991)
64. Goodman SN. Toward evidence-based medical statistics. 2: The Bayes factor. Ann Intern Med. 1999b ; 130: 1005-1013 (Pubitemid 29283992)
65. Gotzsche PC, Johansen HK. Misleading statements in industry-sponsored meta-analysis of itraconazole. J Clin Oncol. 2005 ; 23: 9428-9429
66. Hegerl U, Mergl R. The clinical significance of antidepressant treatment effects cannot be derived from placebo-verum response differences. J Psychopharmacol. 2010 ; 24: 445-448
67. Horder J, Matthews P, Waldmann R. Placebo, Prozac and PLoS: Significant lessons for psychopharmacology. J Psychopharmacol. 2010 ; 25: 1277-1288
68. Huedo-Medina T, Johnson B, Kirsch I. Kirsch et al.'s (2008) calculations are correct: Reconsidering Fountoulakis & Moeller's re-analysis of the Kirsch data. Int J Neuropsychopharmacol. 2012 ; 15: 1193-1198
69. Ioannidis JP. Ranking antidepressants. Lancet. 2009 ; 373: 1759-1760
70. Jin P. Toward a reconceptualization of the law of initial value. Psychological Bulletin. 1992 ; 111: 176-184
71. Johnson SR, Tomlinson GA, Hawker GA, et al. Methods to elicit beliefs for Bayesian priors: A systematic review. J Clin Epidemiol. 2009 ; 63: 355-369
72. Jorgensen AW, Hilden J, Gotzsche PC. Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: Systematic review. BMJ. 2006 ; 333: 782
73. Khan A, Faucett J, Lichtenberg P, et al. A systematic review of comparative efficacy of treatments and controls for depression. PLoS One. 2012 ; 7: e41778
74. Khan A, Khan SR, Leventhal RM, et al. An application of the revised CONSORT standards to FDA summary reports of recently approved antidepressants and antipsychotics. Biol Psychiatry. 2002a ; 52: 62-67 (Pubitemid 34655557)
75. Khan A, Leventhal RM, Khan SR, et al. Severity of depression and response to antidepressants and placebo: An analysis of the Food and Drug Administration database. J Clin Psychopharmacol. 2002b ; 22: 40-45 (Pubitemid 34101291)
76. Khan A, Warner HA, Brown WA. Symptom reduction and suicide risk in patients treated with placebo in antidepressant clinical trials: An analysis of the Food and Drug Administration database. Arch Gen Psychiatry. 2000 ; 57: 311-317 (Pubitemid 30202315)
77. Kirsch I. Antidepressants and the placebo response. Epidemiol Psichiatr Soc. 2009a ; 18: 318-322
78. Kirsch I The Emperor's New Drugs: Exploding the Antidepressant Myth. London: The Bodley Head ; 2009b :
79. Kirsch I, Deacon BJ, Huedo-Medina TB, et al. Initial severity and antidepressant benefits: A meta-analysis of data submitted to the Food and Drug Administration. PLoS Med. 2008 ; 5: e45
80. Kobak KA, Leuchter A, DeBrota D, et al. Site versus centralized raters in a clinical depression trial: Impact on patient selection and placebo response. J Clin Psychopharmacol. 2010 ; 30: 193-197
81. Leucht S, Arbter D, Engel RR, et al. How effective are second-generation antipsychotic drugs? A meta-analysis of placebo-controlled trials. Mol Psychiatry. 2009 ; 14: 429-447
82. Leucht S, Hierl S, Kissling W, et al. Putting the efficacy of psychiatric and general medicine medication into perspective: Review of meta-analyses. Br J Psychiatry. 2012 ; 200: 97-106
83. Licht RW, Gouliaev G, Vestergaard P, et al. Generalisability of results from randomised drug trials. A trial on antimanic treatment. Br J Psychiatry. 1997 ; 170: 264-267 (Pubitemid 27117690)
84. Lyman GH, Kuderer NM. The strengths and limitations of meta-analyses based on aggregate data. BMC Med Res Methodol. 2005 ; 5: 14
85. McAllister-Williams RH. Do antidepressants work? A commentary on 'Initial severity and antidepressant benefits: A meta-analysis of data submitted to the Food and Drug Administration' by Kirsch et al. Evid Based Ment Health. 2008 ; 11: 66-68
86. Maier W, Moller HJ. Meta-analyses: A method to maximise the evidence from clinical studies?. Eur Arch Psychiatry Clin Neurosci. 2009 ; 260: 17-23
87. Maier W, Philipp M. Comparative analysis of observer depression scales. Acta Psychiatr Scand. 1985 ; 72: 239-245 (Pubitemid 16257029)
88. Melander H, Salmonson T, Abadie E, et al. A regulatory apologia-a review of placebo-controlled studies in regulatory submissions of new-generation antidepressants. Eur Neuropsychopharmacol. 2008 ; 18: 623-627
89. Moller HJ. Isn't the efficacy of antidepressants clinically relevant? A critical comment on the results of the metaanalysis by Kirsch et al. Eur Arch Psychiatry Clin Neurosci. 2008 2008 ; 258: 451-455
90. Moller H. Antidepressants: Controversies about their efficacy in depression, their effect on suicidality and their place in a complex psychiatric treatment approach. World J Biol Psychiatry. 2009a ; 10: 180-195
91. Moller HJ. Is evidence sufficient for evidence-based medicine?. Eur Arch Psychiatry Clin Neurosci. 2009b ; 259: S167 - S172
92. Moller HJ, Broich K. Principle standards and problems regarding proof of efficacy in clinical psychopharmacology. Eur Arch Psychiatry Clin Neurosci. 2010 ; 260: 3-16
93. Moller HJ, Fountoulakis KN. Problems in determining efficacy and effectiveness of antidepressants. Psychiatrike. 2011 ; 22: 298-306
94. Moller HJ, Maier W. Evidence-based medicine in psychopharmacotherapy: Possibilities, problems and limitations. Eur Arch Psychiatry Clin Neurosci. 2010 ; 260: 25-39
95. Moller HJ, Bitter I, Bobes J, et al. Position statement of the European Psychiatric Association (EPA) on the value of antidepressants in the treatment of unipolar depression. Eur Psychiatry. 2012 ; 27: 114-128
96. Moncrieff J, Wessely S, Hardy R. Active placebos versus antidepressants for depression. Cochrane Database Syst Rev. 2004 ;: CD003012
97. Oldham P. A note on the analysis of repeated measurements of the same subjects. J Chronic Dis. 1962 ; 15: 969-977
98. Partonen T, Sihvo S, Lonnqvist JK. Patients excluded from an antidepressant efficacy trial. J Clin Psychiatry. 1996 ; 57: 572-575 (Pubitemid 27056898)
99. Patsopoulos NA, Analatos AA, Ioannidis JP. Relative citation impact of various study designs in the health sciences. JAMA. 2005 ; 293: 2362-2366 (Pubitemid 40676758)
100. Pereira TV, Ioannidis JP. Statistically significant meta-analyses of clinical trials have modest credibility and inflated effects. J Clin Epidemiol. 2011 ; 64: 1060-1069
101. Philipp M, Kohnen R, Hiller KO. Hypericum extract versus imipramine or placebo in patients with moderate depression: Randomised multicentre study of treatment for eight weeks. Brit Med J. 1999 ; 319: 1534-1538
102. Romera I, Perez V, Menchon JM, et al. Optimal cutoff point of the Hamilton Rating Scale for Depression according to normal levels of social and occupational functioning. Psychiatry Res. 2010 ; 186: 133-137
103. Roseman M, Milette K, Bero LA, et al. Reporting of conflicts of interest in meta-analyses of trials of pharmacological treatments. JAMA. 2011 ; 305: 1008-1017
104. Rush AJ. STAR*D: What have we learned?. Am J Psychiatry. 2007 ; 164: 201-204
105. Seemuller F, Moller HJ, Dittmann S, et al. Is the efficacy of psychopharmacological drugs comparable to the efficacy of general medicine medication?. BMC Med. 2012 ; 10: 17
106. Seyringer ME, Kasper S. Ranking antidepressants. Lancet. 2009 ; 373: 1760-1761
107. Song F, Altman DG, Glenny AM, et al. Validity of indirect comparison for estimating efficacy of competing interventions: Empirical evidence from published meta-analyses. Brit Med J. 2003 ; 326: 472
108. Song F, Loke YK, Walsh T, et al. Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: Survey of published systematic reviews. Brit Med J. 2009 ; 338: b1147
109. Talamo A, Baldessarini RJ, Centorrino F. Comparison of mania patients suitable for treatment trials versus clinical treatment. Hum Psychopharmacol. 2008 ; 23: 447-454
110. Tarr GP, Glue P, Herbison P. Comparative efficacy and acceptability of mood stabilizer and second generation antipsychotic monotherapy for acute mania - A systematic review and meta-analysis. J Affect Disord. 2011 ; (134). 14-19
111. Thase ME, Larsen KG, Kennedy SH. Assessing the 'true' effect of active antidepressant therapy v. placebo in major depressive disorder: Use of a mixture model. Br J Psychiatry. 2011 ; 199: 501-507
112. Tohen M, Vieta E, Calabrese J, et al. Efficacy of olanzapine and olanzapine-fluoxetine combination in the treatment of bipolar I depression. Arch Gen Psychiatry. 2003 ; 60: 1079-1088 (Pubitemid 37429647)
113. Tomba E. Nowhere patients. Psychother Psychosom. 2012 ; 81: 69-72
114. Tomba E, Bech P. Clinimetrics and clinical psychometrics: Macro- and micro-analysis. Psychother Psychosom. 2012 ; 81: 333-343
115. Tourian KA, Padmanabhan SK, Groark J, et al. Desvenlafaxine 50 and 100 mg/d in the treatment of major depressive disorder: An 8-week, phase III, multicenter, randomized, double-blind, placebo-controlled, parallel-group trial and a post hoc pooled analysis of three studies. Clin Ther. 2009 ; 31: 1405-1423
116. Trikalinos TA, Churchill R, Ferri M, et al. Effect sizes in cumulative meta-analyses of mental health randomized trials evolved over time. J Clin Epidemiol. 2004 ; 57: 1124-1130 (Pubitemid 39573018)
117. Tu YK, Maddick IH, Griffiths GS, et al. Mathematical coupling can undermine the statistical assessment of clinical research: Illustration from the treatment of guided tissue regeneration. J Dent. 2004 ; 32: 133-142 (Pubitemid 38121639)
118. Turner E, Moreno SG, Sutton AJ. Ranking antidepressants. Lancet. 2009 1760 ; 373: 1761-1762
119. Turner EH, Rosenthal R. Efficacy of antidepressants. Brit Med J. 2008 ; 336: 516-517
120. Turner EH, Matthews AM, Linardatos E, et al. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008 ; 358: 252-260
121. Undurraga J, Baldessarini RJ. Randomized, placebo-controlled trials of antidepressants for acute major depression: Thirty-year meta-analytic review. Neuropsychopharmacology. 2012 ; 37: 851-864
122. Van der Lem R, van der Wee NJ, van Veen T, et al. The generalizability of antidepressant efficacy trials to routine psychiatric out-patient practice. Psychol Med. 2010 ; 41: 1353-1363
123. Wisniewski SR, Rush AJ, Nierenberg AA, et al. Can phase III trial results of antidepressant medications be generalized to clinical practice? A STAR*D report. Am J Psychiatry. 2009 ; 166: 599-607
124. Wolf S, Pinsky RH. Effects of placebo administration and occurrence of toxic reactions. J Am Med Assoc. 1954 ; 155: 339-341
125. Yildiz A, Vieta E, Leucht S, et al. Efficacy of antimanic treatments: Meta-analysis of randomized, controlled trials. Neuropsychopharmacology. 2011 ; 36: 375-389
126. Zetin M, Hoepner CT. Relevance of exclusion criteria in antidepressant clinical trials: A replication study. J Clin Psychopharmacol. 2007 ; 27: 295-301 (Pubitemid 46763313)
127. Zimmerman M, Mattia JI, Posternak MA. Are subjects in pharmacological treatment trials of depression representative of patients in routine clinical practice?. Am J Psychiatry. 2002 ; 159: 469-473 (Pubitemid 34184745)