Randomized trials published in higher vs. lower impact journals differ in design, conduct, and analysis

Journal of Clinical Epidemiology

Volumn 66, Issue 3, 2013, Pages 286-295

  Bala, Malgorzata M ^a   Akl, Elie A ^b,c,d   Sun, Xin ^b,e   Bassler, Dirk ^f   Mertz, Dominik ^b   Mejza, Filip ^a   Vandvik, Per Olav ^g,h   Malaga, German ⁱ   Johnston, Bradley C ^j,k   Dahm, Philipp ^l   Alonso Coello, Pablo ^m   Diaz Granados, Natalia ^b   Srinathan, Sadeesh K ⁿ   Hassouneh, Basil ^b   Briel, Matthias ^b,o   Busse, Jason W ^b   You, John J ^b   Walter, Stephen D ^b   Altman, Douglas G ^p   Guyatt, Gordon H ^b  

^a JAGIELLONIAN UNIVERSITY MEDICAL COLLEGE   (Poland)

^b MCMASTER UNIVERSITY   (Canada)

^c AMERICAN UNIVERSITY OF BEIRUT   (Lebanon)

^d UNIVERSITY AT BUFFALO   (United States)

^e CENTER FOR HEALTH RESEARCH   (United States)

^f UNIVERSITY HOSPITAL TÜBINGEN   (Germany)

^g NORWEGIAN KNOWLEDGE CENTRE FOR THE HEALTH SERVICES   (Norway)

^h INNLANDET HOSPITAL TRUST   (Norway)

ⁱ UNIVERSIDAD PERUANA CAYETANO HEREDIA   (Peru)

^j HOSPITAL FOR SICK CHILDREN RESEARCH INSTITUTE   (Canada)

^k UNIVERSITY OF TORONTO   (Canada)

^l UNIVERSITY OF FLORIDA COLLEGE OF MEDICINE   (United States)

^m BIOMEDICAL RESEARCH INSTITUTE SANT PAU IIB SANT PAU   (Spain)

ⁿ UNIVERSITY OF MANITOBA   (Canada)

^o UNIVERSITY HOSPITAL BASEL   (Switzerland)

^p UNIVERSITY OF OXFORD   (United Kingdom)

more..

Author keywords

Data interpretation; Humans; Periodical; Randomized controlled trial; Research design; Systematic review

Indexed keywords

ARTICLE; COMPARATIVE STUDY; FUNDING; HEALTH CARE PERSONNEL; HYPOTHESIS; JOURNAL IMPACT FACTOR; MEDICAL LITERATURE; METHODOLOGY; OUTCOME VARIABLE; PERSONNEL; PRIORITY JOURNAL; RANDOMIZED CONTROLLED TRIAL (TOPIC); RESOURCE ALLOCATION; SAMPLE; STUDY DESIGN; SYSTEMATIC REVIEW;

BIAS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; HUMANS; JOURNAL IMPACT FACTOR; PERIODICALS AS TOPIC; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN; SAMPLE SIZE;

EID: 84872767239     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2012.10.005     Document Type: Article

References (37)

1. H. Balshem, M. Helfand, H.J. Schünemann, A.D. Oxman, R. Kunz, and J. Brozek GRADE guidelines: 3. Rating the quality of evidence J Clin Epidemiol 64 2011 401 406
2. A.V. Kulkarni, J.W. Busse, and I. Shams Characteristics associated with citation rates of the medical literature PLoS One 2 2007 e403
3. A.V. Kulkarni, B. Aziz, I. Shams, and J.W. Busse Author self-citation in the clinical general medicine literature PLoS One 6 2011 e20885
4. A.V. Kulkarni, B. Aziz, I. Shams, and J.W. Busse Comparisons of citations in Web of Science, Scopus, and Google Scholar for articles published in general medical journals JAMA 302 2009 1092 1096
5. P. Dreyfuss, and R. Baker In response to treatment of neck pain Eur Spine J 17 2008 1270 1272
6. L.L. Gluud, T.I.A. Sørensen, P.C. Gøtzsche, and C. Gluud The journal impact factor as a predictor of trial quality and outcomes: cohort study of hepatobiliary randomized clinical trials Am J Gastroenterol 100 2005 2431 2435
7. L.M. Kuroki, J.E. Allsworth, and J.F. Peipert Methodology and analytic techniques used in clinical research: associations with journal impact factor Obstet Gynecol 114 2009 877 884
8. Y. Littner, F.B. Mimouni, S. Dollberg, and D. Mandel Negative results and impact factor: a lesson from neonatology Arch Pediatr Adolesc Med 159 2005 1036 1037
9. Z. Kanaan, S. Galandiuk, M. Abby, K.V. Shannon, D. Dajani, and N. Hicks The value of lesser-impact-factor surgical journals as a source of negative and inconclusive outcomes reporting Ann Surg 253 2011 619 623
10. C. Barbui, A. Cipriani, L. Malvini, and M. Tansella Validity of the impact factor of journals as a measure of randomized controlled trial quality J Clin Psychiatry 67 2006 37 40
11. K.P. Lee, M. Schotland, P. Bacchetti, and L.A. Bero Association of journal quality indicators with methodological quality of clinical research articles JAMA 287 2002 2805 2808
12. M.H. Pittler, N.C. Abbot, E.F. Harkness, and E. Ernst Location bias in controlled clinical trials of complementary/alternative therapies J Clin Epidemiol 53 2000 485 489
13. S. Danilla, J. Wasiak, S. Searle, C. Arriagada, C. Pedreros, and H. Cleland Methodological quality of randomised controlled trials in burns care. A systematic review Burns 35 2009 956 961
14. X. Sun, M. Briel, J.W. Busse, J.J. You, E.A. Akl, and F. Mejza The influence of study characteristics on reporting of subgroup analyses in randomised controlled trials: systematic review BMJ 342 2011 d1569
15. National Library of Medicine. Abridged Index Medicus (AIM or "core clinical") journal titles. 2012. Available at www.nlm.nih.gov/bsd/aim.html.
16. X. Sun, M. Briel, J. Busse, E. Akl, J. You, and F. Mejza Subgroup Analysis of Trials Is Rarely Easy (SATIRE): a study protocol for a systematic review to characterize the analysis, reporting, and claim of subgroup effects in randomized trials Trials 10 2009 101
17. Thomson Reuters Web of Knowledge website. 2012. Available at http://wokinfo.com.
18. R. Jones, S. Younie, A. Macallister, and J. Thornton A comparison of the scientific quality of publicly and privately funded randomized controlled drug trials J Eval Clin Pract 16 2010 1322 1325
19. F.T. Bourgeois, S. Murthy, and K.D. Mandl Outcome reporting among drug trials registered in ClinicalTrials.gov Ann Intern Med 153 2010 158 166
20. K.F. Schulz, I. Chalmers, R.J. Hayes, and D.G. Altman Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials JAMA 273 1995 408 412
21. L. Wood, M. Egger, L.L. Gluud, K.F. Schulz, P. Jüni, and D.G. Altman Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study BMJ 336 2008 601 605
22. D. Moher, B. Pham, A. Jones, D.J. Cook, A.R. Jadad, and M. Moher Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet 352 1998 609 613
23. L.L. Kjaergard, J. Villumsen, and C. Gluud Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses Ann Intern Med 135 2001 982 989
24. J. Pildal, A. Hróbjartsson, K.J. Jørgensen, J. Hilden, D.G. Altman, and P.C. Gøtzsche Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials Int J Epidemiol 36 2007 847 857
25. P. Jüni, D.G. Altman, and M. Egger Systematic reviews in health care: assessing the quality of controlled clinical trials BMJ 323 2001 42 46
26. M. Egger, P. Jüni, C. Bartlett, F. Holenstein, and J. Sterne How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study Health Technol Assess 7 1 2003
27. J. Odgaard-Jensen, G.E. Vist, A. Timmer, R. Kunz, E.A. Akl, and H. Schünemann Randomisation to protect against selection bias in healthcare trials Cochrane Database Syst Rev 4 2011 MR000012
28. E.A. Akl, M. Briel, J.J. You, X. Sun, B.C. Johnston, and J.W. Busse Potential impact on estimated treatment effects of information lost to follow-up in randomised controlled trials (LOST-IT): systematic review BMJ 344 2012 e2809
29. G.Y. Gandhi, M.H. Murad, A. Fujiyoshi, R.J. Mullan, D.N. Flynn, and M.B. Elamin Patient-important outcomes in registered diabetes trials JAMA 299 2008 2543 2549
30. K. Rahimi, A. Malhotra, A.P. Banning, and C. Jenkinson Outcome selection and role of patient reported outcomes in contemporary cardiovascular trials: systematic review BMJ 341 2010 c5707
31. K.P. Lee, E.A. Boyd, J.M. Holroyd-Leduc, P. Bacchetti, and L.A. Bero Predictors of publication: characteristics of submitted manuscripts associated with acceptance at major biomedical journals Med J Aust 184 2006 621 626
32. J. Ray, M. Berkwits, and F. Davidoff The fate of manuscripts rejected by a general medical journal Am J Med 109 2000 31 35
33. S.F. Assmann, S.J. Pocock, L.E. Enos, and L.E. Kasten Subgroup analysis and other (mis)uses of baseline data in clinical trials Lancet 355 2000 1064 1069
34. E.D. Moreira Jr., Z. Stein, and E. Susser Reporting on methods of subgroup analysis in clinical trials: a survey of four scientific journals Braz J Med Biol Res 34 2001 1441 1446
35. R. Wang, S.W. Lagakos, J.H. Ware, D.J. Hunter, and J.M. Drazen Statistics in medicine reporting of subgroup analyses in clinical trials N Engl J Med 357 2007 2189 2194
36. A.V. Hernandez, E. Boersma, G.D. Murray, J.D. Habbema, and E.W. Steyerberg Subgroup analyses in therapeutic cardiovascular clinical trials: are most of them misleading? Am Heart J 151 2006 257 264
37. P.J. Devereaux, P.T.L. Choi, S. El-Dika, M. Bhandari, V.M. Montori, and H.J. Schünemann An observational study found that authors of randomized controlled trials frequently used concealment of randomization and blinding, despite the failure to report these methods J Clin Epidemiol 57 2004 1232 1236