Influence of reported study design characteristics on intervention effect estimates from randomized, controlled trials

Annals of Internal Medicine

Volumn 157, Issue 6, 2012, Pages 429-438

  Savović, Jelena ^a   Jones, Hayley E ^a   Altman, Douglas G ^b   Harris, Ross J ^c   Jüni, Peter ^d   Pildal, Julie ^e   Als Nielsen, Bodil ^f   Balk, Ethan M ^g   Gluud, Christian ^e   Gluud, Lise Lotte ^h   Ioannidis, John P A ⁱ   Schulz, Kenneth F ^j   Beynon, Rebecca ^a   Welton, Nicky J ^a   Wood, Lesley ^k   Moher, David ^l   Deeks, Jonathan J ^m   Sterne, Jonathan A C ^a  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

^c PUBLIC HEALTH ENGLAND   (United Kingdom)

^d UNIVERSITY OF BERN   (Switzerland)

^e Rigshospitalet   (Denmark)

^f HILLERØD HOSPITAL   (Denmark)

^g TUFTS MEDICAL CENTER   (United States)

^h GENTOFTE UNIVERSITY HOSPITAL   (Denmark)

ⁱ STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^j FAMILY HEALTH INTERNATIONAL   (United States)

^k Children's Food Trust   (United Kingdom)

^l OTTAWA HOSPITAL RESEARCH INSTITUTE   (Canada)

^m UNIVERSITY OF BIRMINGHAM   (United Kingdom)

more..

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BAYESIAN LEARNING; DATA BASE; HUMAN; INTERVENTION STUDY; META ANALYSIS (TOPIC); MORTALITY; OBSERVATIONAL STUDY; OUTCOME ASSESSMENT; PRIORITY JOURNAL; RANDOMIZED CONTROLLED TRIAL (TOPIC); RESOURCE ALLOCATION; STUDY DESIGN;

EID: 84868308325     PISSN: 00034819     EISSN: 15393704     Source Type: Journal    
DOI: 10.7326/0003-4819-157-6-201209180-00537     Document Type: Article

References (39)

1. Gluud LL. Bias in clinical intervention research. Am J Epidemiol. 2006;163: 493-501. [PMID: 16443796]
2. Egger M, Juni P, Bartlett C, Holenstein F, Sterne J. How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess. 2003;7:1-76. [PMID:12583822]
3. Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, et al. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet. 1998;352:609-13. [PMID: 9746022]
4. Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995;273:408-12. [PMID: 7823387]
5. Als-Nielsen B, Chen W, Gluud LL, Siersma V, Hilden J, Gluud C. Are trial size and reported methodological quality associated with treatment effects? Observational study of 523 randomised trials. Presented at 12th Cochrane Colloquium: Bridging the Gaps, Ottawa, Ontario, Canada, 2-6 October 2004.
6. Balk EM, Bonis PA, Moskowitz H, Schmid CH, Ioannidis JP, Wang C, et al. Correlation of quality measures with estimates of treatment effect in metaanalyses of randomized controlled trials. JAMA. 2002;287:2973-82. [PMID:12052127]
7. Pildal J, Hróbjartsson A, Jørgensen KJ, Hilden J, Altman DG, Gøtzsche PC. Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. Int J Epidemiol. 2007;36:847-57. [PMID: 17517809]
8. Kjaergard LL, Villumsen J, Gluud C. Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med. 2001;135:982-9. [PMID: 11730399]
9. Wood L, Egger M, Gluud LL, Schulz KF, Jüni P, Altman DG, et al. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ. 2008; 336: 601-5. [PMID: 18316340]
10. Savović J, Harris RJ, Wood L, Beynon R, Altman D, Als-Nielsen B, et al. Development of a combined database for meta-epidemiological research. Research Synthesis Methods. 2010;1:212-25.
11. Siersma V, Als-Nielsen B, Chen W, Hilden J, Gluud LL, Gluud C. Multivariable modelling for meta-epidemiological assessment of the association between trial quality and treatment effects estimated in randomized clinical trials. Stat Med. 2007;26:2745-58. [PMID: 17117373]
12. Contopoulos-Ioannidis DG, Gilbody SM, Trikalinos TA, Churchill R, Wahlbeck K, Ioannidis JP. Comparison of large versus smaller randomized trials for mental health-related interventions. Am J Psychiatry. 2005;162:578-84. [PMID: 15741476]
13. Savović J, Jones HE, Altman DG, Harris RJ, Jüni P, Pildal J, et al. Influence of study design characteristics on intervention effect estimates from randomised controlled trials: combined analysis of meta-epidemiological studies. Health Technol Assess. 2012. [Forthcoming].
14. Welton NJ, Ades AE, Carlin JB, Altman DG, Sterne JAC. Models for potentially biased evidence in meta-analysis using empirically based priors. J R Stat Soc Ser A Stat Soc. 2009;172:119-36.
15. Moja LP, Telaro E, D'Amico R, Moschetti I, Coe L, Liberati A. Assessment of methodological quality of primary studies by systematic reviews: results of the metaquality cross sectional study. BMJ. 2005;330:1053. [PMID: 15817526]
16. International Statistical Classification of Diseases and Related Health Problems, 10th Revision. World Health Organization; 2007. Accessed at http://apps.who.int/classifications/apps/icd/icd10online on 19 August 2010.
17. Dechartres A, Boutron I, Trinquart L, Charles P, Ravaud P. Single-center trials show larger treatment effects than multicenter trials: evidence from a metaepidemiologic study. Ann Intern Med. 2011;155:39-51. [PMID: 21727292]
18. Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG. The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010;340:c723. [PMID: 20332510]
19. Huwiler-Müntener K, Jüni P, Junker C, Egger M. Quality of reporting of randomized trials as a measure of methodologic quality. JAMA. 2002;287: 2801-4. [PMID: 12038917]
20. Hill CL, LaValley MP, Felson DT. Discrepancy between published report and actual conduct of randomized clinical trials. J Clin Epidemiol. 2002;55: 783-6. [PMID: 12384192]
21. Hróbjartsson A, Pildal J, Chan AW, Haahr MT, Altman DG, Gøtzsche PC. Reporting on blinding in trial protocols and corresponding publications was often inadequate but rarely contradictory. J Clin Epidemiol. 2009;62:967-73. [PMID: 19635403]
22. Soares HP, Daniels S, Kumar A, Clarke M, Scott C, Swann S, et al; Radiation Therapy Oncology Group. Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. BMJ. 2004;328:22-4. [PMID: 14703540]
23. Pildal J, Chan AW, Hróbjartsson A, Forfang E, Altman DG, Gøtzsche PC. Comparison of descriptions of allocation concealment in trial protocols and the published reports: cohort study. BMJ. 2005;330:1049. [PMID: 15817527]
24. Higgins JPT, Altman DG. Chapter 8: Assessing risk of bias in included studies. In: Higgins JPT, Green S, eds. Cochrane Handbook for Systematic Reviews of Interventions. Chichester, United Kingdom: J Wiley; 2008:187-241.
25. Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al; Cochrane Bias Methods Group. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928. [PMID:22008217]
26. Nüesch E, Trelle S, Reichenbach S, Rutjes AW, Bürgi E, Scherer M, et al. The effects of excluding patients from the analysis in randomised controlled trials: meta-epidemiological study. BMJ. 2009;339:b3244. [PMID: 19736281]
27. Vestbo J, Anderson JA, Calverley PM, Celli B, Ferguson GT, Jenkins C, et al. Bias due to withdrawal in long-term randomised trials in COPD: evidence from the TORCH study. Clin Respir J. 2011;5:44-9. [PMID: 21159140]
28. Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan AW, Cronin E, et al. Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One. 2008;3:e3081. [PMID: 18769481]
29. Kirkham JJ, Dwan KM, Altman DG, Gamble C, Dodd S, Smyth R, et al. The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ. 2010;340:c365. [PMID: 20156912]
30. Nüesch E, Reichenbach S, Trelle S, Rutjes AW, Liewald K, Sterchi R, et al. The importance of allocation concealment and patient blinding in osteoarthritis trials: a meta-epidemiologic study. Arthritis Rheum. 2009;61:1633-41. [PMID:19950329]
31. Hróbjartsson A, Gøtzsche PC. Is the placebo powerless? An analysis of clinical trials comparing placebo with no treatment. N Engl J Med. 2001;344: 1594-602. [PMID: 11372012]
32. Krogsbøll LT, Hróbjartsson A, Gøtzsche PC. Spontaneous improvement in randomised clinical trials: meta-analysis of three-armed trials comparing no treatment, placebo and active intervention. BMC Med Res Methodol. 2009;9:1. [PMID: 19123933]
33. Devereaux PJ, Manns BJ, Ghali WA, Quan H, Lacchetti C, Montori VM, et al. Physician interpretations and textbook definitions of blinding terminology in randomized controlled trials. JAMA. 2001;285:2000-3. [PMID:11308438]
34. Montori VM, Bhandari M, Devereaux PJ, Manns BJ, Ghali WA, Guyatt GH. In the dark: the reporting of blinding status in randomized controlled trials. J Clin Epidemiol. 2002;55:787-90. [PMID: 12384193]
35. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869. [PMID:20332511]
36. Schulz KF, Altman DG, Moher D; CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332. [PMID: 20332509]
37. Forder PM, Gebski VJ, Keech AC. Allocation concealment and blinding: when ignorance is bliss. Med J Aust. 2005;182:87-9. [PMID: 15651970]
38. Siontis GC, Tzoulaki I, Ioannidis JP. Predicting death: an empirical evaluation of predictive tools for mortality. Arch Intern Med. 2011;171:1721-6. [PMID: 21788535]
39. Goodman S, Dickersin K. Metabias: a challenge for comparative effectiveness research [Editorial]. Ann Intern Med. 2011;155:61-2. [PMID: 21727295]