Perceived information gain from randomized trials correlates with publication in high-impact factor journals

Journal of Clinical Epidemiology

Volumn 65, Issue 12, 2012, Pages 1274-1281

  Evangelou, Evangelos ^a   Siontis, Konstantinos C ^a   Pfeiffer, Thomas ^b,c,d   Ioannidis, John P A ^a,e,f  

^a UNIVERSITY OF IOANNINA   (Greece)

^b TUFTS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c HARVARD UNIVERSITY   (United States)

^d MASSEY UNIVERSITY   (New Zealand)

^e STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^f STANFORD UNIVERSITY   (United States)

Author keywords

Entropy; Impact factor; Information gain; Meta analysis; Randomized trials; Scientific journals

Indexed keywords

ARTICLE; MEDICAL INFORMATION; META ANALYSIS (TOPIC); PRIORITY JOURNAL; PUBLICATION; RANDOMIZED CONTROLLED TRIAL (TOPIC); SCIENTIFIC LITERATURE; STATISTICAL SIGNIFICANCE;

EID: 84867861117     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2012.06.009     Document Type: Review

References (40)

1. E. Garfield The history and meaning of the journal impact factor JAMA 295 2006 90 93
2. S.N. Goodman, D.G. Altman, and S.L. George Statistical reviewing policies of medical journals: caveat lector? J Gen Intern Med 13 11 1998 753 756
3. N.S. Young, J.P. Ioannidis, and O. Al-Ubaydli Why current publication practices may distort science PLoS Med 5 10 2008 e201
4. J.P. Ioannidis Concentration of the most-cited papers in the scientific literature: analysis of journal ecosystems PLoS One 1 2006 e5
5. K. Dickersin, S. Chan, T.C. Chalmers, H.S. Sacks, and H. Smith Jr. Publication bias and clinical trials Control Clin Trials 8 1987 343 353
6. K.C. Siontis, E. Evangelou, and J.P. Ioannidis Magnitude of effects in clinical trials published in high-impact general medical journals Int J Epidemiol 40 2011 1280 1291
7. D.V. Lindley On a measure of the information provided by an experiment Ann Math Stat 27 4 1956 986 1005
8. J.D. Nelson Finding useful questions: on Bayesian diagnosticity, probability, impact, and information gain Psychol Rev 112 4 2005 979 999
9. A.C. Atkinson, A.N. Donev, and R.D. Tobias Optimum experimental designs, with SAS 2007 Oxford University Press Oxford, UK
10. Tamuz O, Liu Ce, Belongie S, Shamir S, Shamir O, Kalai AT. Adaptively learning the crowd kernel, in Proceedings of the 28th International Conference on Machine Learning; Bellevue, WA, USA; 2011.
11. M.E. Glickman Adaptive paired comparison design J Stat Plann Infer 127 2005 279 293
12. T. Pfeiffer, and J. Almenberg Prediction markets and their potential role in biomedical research - a review Biosystems 102 2-3 2010 71 76
13. J. Lau, J.P. Ioannidis, and C.H. Schmid Quantitative synthesis in systematic reviews Ann Intern Med 127 1997 820 826
14. J. Ioannidis, and J. Lau Evolution of treatment effects over time: empirical insight from recursive cumulative metaanalyses Proc Natl Acad Sci U S A 98 3 2001 831 836
15. J. Lau, E.M. Antman, J. Jimenez-Silva, B. Kupelnick, F. Mosteller, and T.C. Chalmers Cumulative meta-analysis of therapeutic trials for myocardial infarction N Engl J Med 327 1992 248 254
16. A. Kumar, H. Soares, R. Wells, M. Clarke, I. Hozo, and A. Bleyer Are experimental treatments for cancer in children superior to established treatments? Observational study of randomised controlled trials by the Children's Oncology Group BMJ 331 1995 1295
17. B. Djulbegovic, A. Kumar, H.P. Soares, I. Hozo, G. Bepler, and M. Clarke Treatment success in cancer: new cancer treatment successes identified in phase 3 randomized controlled trials conducted by the National Cancer Institute-sponsored cooperative oncology groups, 1955 to 2006 Arch Intern Med 168 2008 632 642
18. J.P. Ioannidis Why most discovered true associations are inflated Epidemiology 19 2008 640 648
19. T.V. Pereira, and J.P. Ioannidis Statistically significant meta-analyses of clinical trials have modest credibility and inflated effects J Clin Epidemiol 64 2011 1060 1069
20. L.V. Hedges, and I. Olkin Statistical methods for meta-analysis 1985 Academic Press Orlando, FL
21. R. DerSimonian, and N. Laird Meta-analysis in clinical trials Control Clin Trials 7 1986 177 188
22. J.P. Higgins, and S.G. Thompson Quantifying heterogeneity in a meta-analysis Stat Med 21 2002 1539 1558
23. J.P. Higgins, S.G. Thompson, J.J. Deeks, and D.G. Altman Measuring inconsistency in meta-analyses BMJ 327 2003 557 560
24. J.P. Ioannidis, N.A. Patsopoulos, and E. Evangelou Uncertainty in heterogeneity estimates in meta-analyses BMJ 335 2007 914 916
25. D. Butler Free journal-ranking tool enters citation market Nature 451 2008 6
26. M.E. Falagas, V.D. Kouranos, R. Arencibia-Jorge, and D.E. Karageorgopoulos Comparison of SCImago journal rank indicator with journal impact factor FASEB J 22 8 2008 2623 2628
27. P.O. Seglen Why the impact factor of journals should not be used for evaluating research BMJ 314 1997 498 502
28. T. Opthof Sense and nonsense about the impact factor Cardiovasc Res 33 1997 1 7
29. S. Hansson Impact factor as a misleading tool in evaluation of medical journals Lancet 346 1995 906
30. S. Saha, S. Saint, and D.A. Christakis Impact factor: a valid measure of journal quality? J Med Libr Assoc 91 2003 42 46
31. M. Chew, E.V. Villanueva, and M.B. Van Der Weyden Life and times of the impact factor: retrospective analysis of trends for seven medical journals (1994-2005) and their Editors' views J R Soc Med 100 3 2007 142 150
32. J.P. Ioannidis, L. Belbasis, and E. Evangelou Fifty-year fate and impact of general medical journals PLoS One 5 9 2011 e12531
33. J.P. Ioannidis, and T.A. Trikalinos Early extreme contradictory estimates may appear in published research: the Proteus phenomenon in molecular genetics research and randomized trials J Clin Epidemiol 58 2005 543 549
34. T. Pfeiffer, L. Bertram, and J.P. Ioannidis Quantifying selective reporting and the Proteus phenomenon for multiple datasets with similar bias PLoS One 6 3 2011 e18362
35. G.B. Emerson, W.J. Warme, F.M. Wolf, J.D. Heckman, R.A. Brand, and S.S. Leopold Testing for the presence of positive-outcome bias in peer review: a randomized controlled trial Arch Intern Med 170 2010 1934 1939
36. C.M. Olson, D. Rennie, D. Cook, K. Dickersin, A. Flanagin, and J.W. Hogan Publication bias in editorial decision making JAMA 287 2002 2825 2828
37. K. Dickersin, Y.I. Min, and C.L. Meinert Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards JAMA 267 1992 374 378
38. K. Dwan, D.G. Altman, J.A. Arnaiz, J. Bloom, A.W. Chan, and E. Cronin Systematic review of the empirical evidence of study publication bias and outcome reporting bias PLoS One 3 8 2008 e3081
39. D. Fanelli "Positive" results increase down the Hierarchy of the Sciences PLoS One 5 4 2010 e10068
40. I. Chalmers, and R. Matthews What are the implications of optimism bias in clinical research? Lancet 367 2006 449 450