Magnitude of effects in clinical trials published in high-impact general medical journals

International Journal of Epidemiology

Volumn 40, Issue 5, 2011, Pages 1280-1291

  Siontis, Konstantinos C M ^a   Evangelou, Evangelos ^a   Ioannidis, John P A ^a,b,c,d  

^a UNIVERSITY OF IOANNINA   (Greece)

^b INSTITUTE OF COMPUTER SCIENCE   (Greece)

^c TUFTS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Clinical trials; Inflated effects; Meta epidemiology; Prestigious general medical journals; Publication bias

Indexed keywords

DATABASE; EPIDEMIOLOGY; LITERATURE REVIEW; META-ANALYSIS; PUBLISHING;

ARTICLE; CLINICAL TRIAL (TOPIC); MEDICAL LITERATURE; PRIORITY JOURNAL; PUBLICATION; SYSTEMATIC REVIEW (TOPIC);

ANALYSIS OF VARIANCE; BIBLIOMETRICS; CLINICAL TRIALS AS TOPIC; HUMANS; META-ANALYSIS AS TOPIC; PERIODICALS AS TOPIC; PUBLICATION BIAS; TREATMENT OUTCOME;

EID: 80755187799     PISSN: 03005771     EISSN: 14643685     Source Type: Journal    
DOI: 10.1093/ije/dyr095     Document Type: Article

References (41)

1. Ioannidis JP. Concentration of the most-cited papers in the scientific literature: analysis of journal ecosystems. PLoS One 2006;1:e5.
2. Ioannidis JP. Contradicted and initially stronger effects in highly cited clinical research. JAMA 2005;294: 218-28.
3. Young NS, Ioannidis JP, Al-Ubaydli O. Why current publication practices may distort science. PLoS Med 2008;5: e201.
4. Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med 2008; 358:252-60.
5. Dwan K, Altman DG, Arnaiz JA et al. Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One 2008;3:e3081.
6. Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet 1991;337: 867-72.
7. Olson CM, Rennie D, Cook D et al. Publication bias in editorial decision making. JAMA 2002;287: 2825-28.
8. Bassler D, Briel M, Montori VM et al. Stopping randomized trials early for benefit and estimation of treatment effects: systematic review and meta-regression analysis. JAMA 2010;303:1180-87.
9. Ioannidis JP. Why most discovered true associations are inflated. Epidemiology 2008;19:640-48.
10. Hughes MD, Pocock SJ. Stopping rules and estimation problems in clinical trials. Stat Med 1988;7: 1231-42.
11. Pocock SJ, Hughes MD. Practical problems in interim analyses, with particular regard to estimation. Control Clin Trials 1989;10:209S-21S.
12. Ioannidis JP. Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA 1998;279:281-86.
13. Ioannidis JP, Cappelleri JC, Lau J. Issues in comparisons between meta-analyses and large trials. JAMA 1998;279: 1089-93.
14. ISI Web of Knowledge. Journal Citation Reports. (http://admin-apps.isiknowledge.com/JCR/JCR?SID=U275bPKI8jN1Kjn5EC6) (15 February 2010, date last accessed).
15. Chew M, Villanueva EV, Van Der Weyden MB. Life and times of the impact factor: retrospective analysis of trends for seven medical journals (1994-2005) and their editors' views. J R Soc Med 2007;100:142-50.
16. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986;7:177-88.
17. Lau J, Ioannidis JP, Schmid CH. Quantitative synthesis in systematic reviews. Ann Intern Med 1997;127:820-26.
18. Sterne JA, Jüni P, Schulz KF, Altman DG, Bartlett C, Egger M. Statistical methods for assessing the influence of study characteristics on treatment effects in 'metaepidemiological' research. Stat Med 2002;21:1513-24.
19. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med 2002;21:1539-58.
20. Ioannidis JP, Patsopoulos NA, Evangelou E. Uncertainty in heterogeneity estimates in meta-analyses. BMJ 2007; 335:914-16.
21. Steering Committee of the Physicians' Health Study Research Group. Final report on the aspirin component of the ongoing Physicians' Health Study. N Engl J Med 1989;321:129-35.
22. Lachman E, Pitsoe SB, Gaffin SL. Anti-lipopolysaccharide immunotherapy in management of septic shock of obstetric and gynaecological origin. Lancet 1984;1:981-83.
23. Pildal J, Gøtzsche PC. Polyclonal immunoglobulin for treatment of bacterial sepsis: a systematic review. Clin Infect Dis 2004;39:38-46.
24. Tepel M, van der Giet M, Schwarzfeld C, Laufer U, Liermann D, Zidek W. Prevention of radiographiccontrast-agent-induced reductions in renal function by acetylcysteine. N Engl J Med 2000;343:180-84.
25. Sterne JA, Gavaghan D, Egger M. Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. J Clin Epidemiol 2000;53:1119-29.
26. Sterne JA, Egger M, Smith GD. Systematic reviews in health care: Investigating and dealing with publication and other biases in meta-analysis. BMJ 2001;323:101-5.
27. Rücker G, Schwarzer G, Carpenter JR, Schumacher M. Undue reliance on I(2) in assessing heterogeneity may mislead. BMC Med Res Methodol 2008;8:79.
28. Etter JF, Stapleton J. Citations to trials of nicotine replacement therapy were biased toward positive results and high-impact-factor journals. J Clin Epidemiol 2009; 62:831-37.
29. Nieminen P, Rucker G, Miettunen J, Carpenter J, Schumacher M. Statistically significant papers in psychiatry were cited more often than others. J Clin Epidemiol 2007;60:939-46.
30. Smith R. Medical journals and pharmaceutical companies: uneasy bedfellows. BMJ 2003;326:1202-5.
31. Lundh A, Barbateskovic M, Hróbjartsson A, Gøtzsche PC. Conflicts of interest at medical journals: the influence of industry-supported randomised trials on journal impact factors and revenue - cohort study. PLoS Med 2010;7: e1000354.
32. Jane-wit D, Horwitz RI, Concato J. Variation in results from randomized, controlled trials: stochastic or systematic? J Clin Epidemiol 2010;63:56-63.
33. Bassler D, Montori VM, Briel M, Glasziou P, Guyatt G. Early stopping of randomized clinical trials for overt efficacy is problematic. J Clin Epidemiol 2008;61:241-46.
34. Gehr BT, Weiss C, Porzsolt F. The fading of reported effectiveness. A meta-analysis of randomised controlled trials. BMC Med Res Methodol 2006;6:25.
35. Clarke M, Alderson P, Chalmers I. Discussion sections in reports of controlled trials published in general medical journals. JAMA 2002;287:2799-801.
36. Wang R, Lagakos SW, Ware JH, Hunter DJ, Drazen JM. Statistics in medicine-reporting of subgroup analyses in clinical trials. N Engl J Med 2007;357:2189-94.
37. Ferreira-Gonzalez I, Permanyer-Miralda G, Busse JW et al. Composite outcomes can distort the nature and magnitude of treatment benefits in clinical trials. Ann Intern Med 2009;150:566-67.
38. Ferreira-González I, Permanyer-Miralda G, Busse JW et al. Methodologic discussions for using and interpreting composite endpoints are limited, but still identify major concerns. J Clin Epidemiol 2007;60:651-57.
39. Barbui C, Cipriani A, Malvini L, Tansella M. Validity of the impact factor of journals as a measure of randomized controlled trial quality. J Clin Psychiatry 2006;67:37-40.
40. Jüni P, Witschi A, Bloch R, Egger M. The hazards of scoring the quality of clinical trials for meta-analysis. JAMA 1999;282:1054-60.
41. Wood L, Egger M, Gluud LL et al. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: metaepidemiological study. BMJ 2008;336:601-5.