Bias and small-study effects influence treatment effect estimates: A meta-epidemiological study in oral medicine

Journal of Clinical Epidemiology

Volumn 67, Issue 9, 2014, Pages 984-992

  Papageorgiou, Spyridon N ^a   Antonoglou, Georgios N ^b   Tsiranidou, Elli ^c   Jepsen, Søren ^a   Jäger, Andreas ^a  

^a UNIVERSITY OF BONN   (Germany)

^b UNIVERSITY OF OULU   (Finland)

^c ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Dentistry; Effect size; Meta analysis; Meta epidemiologic study; systematic error; Systematic review

Indexed keywords

CONFIDENCE INTERVAL; DENTISTRY; EFFECT SIZE; HUMAN; LANGUAGE; MEDLINE; META ANALYSIS (TOPIC); PRIORITY JOURNAL; RANDOMIZED CONTROLLED TRIAL (TOPIC); REVIEW; STOMATOLOGY; STUDY DESIGN; SYSTEMATIC REVIEW;

DENTISTRY; EFFECT SIZE; META-ANALYSIS; META-EPIDEMIOLOGIC STUDY; SYSTEMATIC ERROR; SYSTEMATIC REVIEW;

ABSTRACTING AND INDEXING AS TOPIC; BIAS (EPIDEMIOLOGY); CONFIDENCE INTERVALS; EPIDEMIOLOGIC STUDIES; HUMANS; MEDICAL SUBJECT HEADINGS; MEDLINE; ODDS RATIO; ORAL MEDICINE; OUTCOME ASSESSMENT (HEALTH CARE); RANDOMIZED CONTROLLED TRIALS AS TOPIC;

EID: 84905053615     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2014.04.002     Document Type: Review

References (51)

1. M. Egger, P. Juni, C. Bartlett, F. Holenstein, and J. Sterne How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? empirical study Health Technol Assess 7 2003 1 76
2. P. Jüni, F. Holenstein, J. Sterne, C. Bartlett, and M. Egger Direction and impact of language bias in meta-analyses of controlled trials: empirical study Int J Epidemiol 31 2002 115 123
3. D. Moher, B. Pham, T.P. Klassen, K.F. Schulz, J.A. Berlin, and A.R. Jadad et al. What contributions do languages other than English make on the results of meta-analyses? J Clin Epidemiol 53 2000 964 972
4. S. Golder, Y.K. Loke, and M. Bland Meta-analyses of adverse effects data derived from randomised controlled trials as compared to observational studies: methodological overview PLoS Med 8 2011 e1001026
5. I. Tzoulaki, K.C. Siontis, and J.P. Ioannidis Prognostic effect size of cardiovascular biomarkers in datasets from observational studies versus randomised trials: meta-epidemiology study BMJ 343 2011 d6829
6. J. Savović, H. Jones, D. Altman, R. Harris, P. Juni, and J. Pildal et al. Influence of reported study design characteristics on intervention effect estimates from randomised controlled trials: combined analysis of meta-epidemiological studies Health Technol Assess 16 2012 1 82
7. A. Chaimani, H.S. Vasiliadis, N. Pandis, C.H. Schmid, N.J. Welton, and G. Salanti Effects of study precision and risk of bias in networks of interventions: a network meta-epidemiological study Int J Epidemiol 42 2013 1120 1131
8. A. Dechartres, L. Trinquart, I. Boutron, and P. Ravaud Influence of trial sample size on treatment effect estimates: meta-epidemiological study BMJ 346 2013 f2304
9. E. Nüesch, S. Trelle, S. Reichenbach, A.W. Rutjes, B. Tschannen, and D.G. Altman et al. Small study effects in meta-analyses of osteoarthritis trials: meta-epidemiological study BMJ 341 2010 c3515
10. Z. Zhang, X. Xu, and H. Ni Small studies may overestimate the effect sizes in critical care meta-analyses: a meta-epidemiological study Crit Care 17 2013 R2
11. D. Richards Outcomes, what outcomes? Evid Based Dent 6 2005 1
12. N. Pandis, A. Polychronopoulou, and T. Eliades An assessment of quality characteristics of randomised control trials published in dental journals J Dent 38 2010 713 721
13. E. Lesaffre, M.J. Garcia Zattera, C. Redmond, H. Huber, I. Needleman ISCB Subcommittee on Dentistry Reported methodological quality of split-mouth studies J Clin Periodontol 34 2007 756 761
14. S.N. Papageorgiou, M.A. Papadopoulos, and A.E. Athanasiou Reporting characteristics of meta-analyses in orthodontics: methodological assessment and statistical recommendations Eur J Orthod 36 2014 74 85
15. S. Pocock Allocation of patients to treatment in clinical trials Biometrics 35 1979 183 197
16. A.L. Avins Can unequal be more fair? Ethics, subject allocation, and randomised clinical trials J Med Ethics 24 1998 401 408
17. J.C. Dumville, S. Hahn, J.N. Miles, and D.J. Torgerson The use of unequal randomisation ratios in clinical trials: a review Contemp Clin Trials 1 2006 1 12
18. D. Torgerson, and M. Campbell Unequal randomisation can improve the economic efficiency of clinical trials J Health Serv Res Policy 2 1997 81 85
19. W. Cates Jr., D.A. Grimes, K.F. Schulz, H.W. Ory, and C.W. Tyler Jr. World Health Organization studies of prostaglandins versus saline as abortifacients: a reappraisal Obstet Gynecol 52 1978 493 498
20. M.J.N.C. Keirse Electronic monitoring: who needs a trojan horse? Birth 21 1994 111 113
21. K.F. Schulz, and D.A. Grimes Unequal group sizes in randomised trials: guarding against guessing Lancet 359 2002 966 970
22. J.P.T. Higgins, and S. Green Cochrane handbook for systematic reviews of interventions version 5.1.0 [updated March 2011] 2011 The Cochrane Collaboration Available at http://www.cochrane-handbook.org/
23. A. Liberati, D.G. Altman, J. Tetzlaff, C. Mulrow, P.C. Gøtzsche, and J.P. Ioannidis et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration J Clin Epidemiol 62 2009 e1 34
24. M. Clarke Searching for trials for systematic reviews: what difference does it make? Int J Epidemiol 31 2002 123 124
25. J.A. Sterne, P. Juni, K.F. Schulz, D.G. Altman, C. Bartlett, and M. Egger Statistical methods for assessing the influence of study characteristics on treatment effects in 'meta-epidemiological' research Stat Med 21 2002 1513 1524
26. W.G. Cochran The combination of estimates from different experiments Biometrics 10 1954 101 129
27. A. Whitehead, and J. Whitehead A general parametric approach to the meta-analysis of randomised clinical trials Stat Med 10 1991 1665 1677
28. J.P. Higgins, S.G. Thompson, J.J. Deeks, and D.G. Altman Measuring inconsistency in meta-analyses BMJ 327 2003 557 560
29. J.P. Higgins, and S.G. Thompson Quantifying heterogeneity in a meta-analysis Stat Med 21 2002 1539 1558
30. J.P. Ioannidis, N.A. Patsopoulos, and E. Evangelou Uncertainty in heterogeneity estimates in meta-analyses BMJ 335 2007 914 916
31. Orsini N, Bottai M, Higgins J, Buchan I. Heterogi: Stata module to quantify heterogeneity in a meta-analysis. Available at http://EconPapers.repec. org/RePEc:boc:bocode:s449201. Accessed November 8, 2013.
32. J.L. Peters, A.J. Sutton, D.R. Jones, K.R. Abrams, and L. Rushton Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetry J Clin Epidemiol 61 2008 991 996
33. M. Egger, G. Davey Smith, M. Schneider, and C. Minder Bias in meta-analysis detected by a simple, graphical test BMJ 315 1997 629 634
34. J.P. Ioannidis Interpretation of tests of heterogeneity and bias in meta-analysis J Eval Clin Pract 14 2008 951 957
35. B. Shea, D. Moher, I. Graham, B. Pham, and P. Tugwell A comparison of the quality of Cochrane reviews and systematic reviews published in paper-based journals Eval Health Prof 25 2002 116 129
36. L.P. Moja, E. Telaro, R. D'Amico, I. Moschetti, L. Coe, and A. Liberati Assessment of methodological quality of primary studies by systematic reviews: results of the metaquality cross sectional study BMJ 330 2005 1053
37. J. Fenwick, I.G. Needleman, and D.R. Moles The effect of bias on the magnitude of clinical outcomes in periodontology: a pilot study J Clin Periodontol 35 2008 775 782
38. P. Juni, D.G. Altman, and M. Egger Systematic reviews in health care: assessing the quality of controlled clinical trials BMJ 323 2001 42 46
39. O.A. Panagiotou, D.G. Contopoulos-Ioannidis, and J.P. Ioannidis Comparative effect sizes in randomised trials from less developed and more developed countries: meta-epidemiological assessment BMJ 346 2013 f707
40. K. Dickersin The existence of publication bias and risk factors for its occurrence JAMA 263 1990 1385 1389
41. J.M. Scholey Publication bias in dental research [master thesis] 2002 University of Liverpool
42. J.C. Türp, J.M. Schulte, and G. Antes Nearly half of dental randomized controlled trials published in German are not included in Medline Eur J Oral Sci 110 2002 405 411
43. K. Benson, and A. Hartz A comparison of observational studies and randomized, controlled trials N Engl J Med 342 2000 1878 1886
44. J. Concato, N. Shah, and R.I. Horwitz Randomized, controlled trials, observational studies, and the hierarchy of research designs N Engl J Med 342 2000 1887 1892
45. J.J. Deeks, J. Dinnes, R. D'Amico, A.J. Sowden, C. Sakarovitch, and F. Song et al. Evaluating non-randomised intervention studies Health Technol Assess 7 2003 1 173
46. J.P.A. Ioannidis, A. Haidich, M. Pappa, N. Pantazis, S.I. Kokori, and M.G. Tektonidou et al. Comparison of evidence of treatment effects in randomized and nonrandomized studies JAMA 286 2001 821 830
47. P.N. Papanikolaou, G.D. Christidi, and J.P. Ioannidis Comparison of evidence on harms of medical interventions in randomized and nonrandomized studies CMAJ 174 2006 635 641
48. J.A. Sterne, A.J. Sutton, J.P. Ioannidis, N. Terrin, D.R. Jones, and J. Lau et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials BMJ 343 2011 d4002
49. J.J. Kirkham, K.M. Dwan, D.G. Altman, C. Gamble, S. Dodd, and R. Smyth et al. The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews BMJ 340 2010 c365
50. L.L. Kjaergard, J. Villumsen, and C. Gluud Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses Ann Intern Med 135 2001 982 989
51. S. Yusuf, P. Held, K.K. Teo, and E.R. Toretsky Selection of patients for randomized controlled trials: implications of wide or narrow eligibility criteria Stat Med 9 1990 73 83