Publication bias and small-study effects in pediatric dentistry meta-analyses

Journal of Evidence-Based Dental Practice

Volumn 15, Issue 1, 2015, Pages 8-24

  Papageorgiou, Spyridon N ^a   Dimitraki, Dionysia ^b   Coolidge, Trilby ^c   Kotsanos, Nikolaos ^b  

^a UNIVERSITY OF BONN   (Germany)

^b ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^c UNIVERSITY OF WASHINGTON   (United States)

Author keywords

File drawer problem; Funnel plot.; Meta analysis; Meta analytical study; Pediatric dentistry; Publication bias

Indexed keywords

DENTISTRY; HUMAN; META ANALYSIS (TOPIC); METHODOLOGY; ODDS RATIO; PUBLISHING; STATISTICAL MODEL; TREATMENT OUTCOME;

HUMANS; LINEAR MODELS; META-ANALYSIS AS TOPIC; MODELS, STATISTICAL; ODDS RATIO; PEDIATRIC DENTISTRY; PUBLICATION BIAS; RESEARCH DESIGN; TREATMENT OUTCOME;

EID: 84923003254     PISSN: 15323382     EISSN: 15323390     Source Type: Journal    
DOI: 10.1016/j.jebdp.2014.09.001     Document Type: Article

References (97)

1. D. Chavalarias, and J.P. Ioannidis Science mapping analysis characterizes 235 biases in biomedical research J Clin Epidemiol 63 2010 1205 1215
2. J.P.T. Higgins, and S. Green Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 2011 The Cochrane Collaboration [updated March 2011]. Available at: http://www.cochrane.handbook.org Accessed 03.07.14
3. D. Koletsi, A. Karagianni, N. Pandis, M. Makou, A. Polychronopoulou, and T. Eliades Are studies reporting significant results more likely to be published? Am J Orthod Dentofacial Orthop 136 2009 632.e1 632.e5
4. P. Pitak-Arnnop, R. Sader, and A.D. Rapidis Publication bias in oral and maxillofacial surgery journals: an observation on published controlled trials J Craniomaxillofac Surg 38 2010 4 10
5. A. Polychronopoulou, N. Pandis, and T. Eliades Assessment of publication bias in dental specialty journals J Evid Based Dent Pract 10 2010 207 211
6. J.M. Scholey Publication Bias in Dental Research (Master Thesis) 2002 University of Liverpool UK
7. K. Dwan, C. Gamble, P.R. Williamson, J.J. Kirkham Reporting Bias Group Systematic review of the empirical evidence of study publication bias and outcome reporting bias - an updated review PLoS One 8 2013 e66844
8. J.A. Sterne, D. Gavaghan, and M. Egger Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature J Clin Epidemiol 53 2000 1119 1129
9. J.A. Sterne, M. Egger, and G.D. Smith Systematic reviews in health care: investigating and dealing with publication and other biases in meta-analysis BMJ 323 2001 101 105
10. E.C. Lula, V. Monteiro-Neto, C.M. Alves, and C.C. Ribeiro Microbiological analysis after complete or partial removal of carious dentin in primary teeth: a randomized clinical trial Caries Res 43 2009 354 358
11. L. Bjørndal, C. Reit, and G. Bruun Treatment of deep caries lesions in adults: randomized clinical trials comparing stepwise vs. direct complete excavation, and direct pulp capping vs. partial pulpotomy Eur J Oral Sci 118 2010 290 297
12. P.R. Williamson, and C. Gamble Identification and impact of outcome selection bias in meta-analysis Stat Med 24 2005 1547 1561
13. J.P.A. Ioannidis Interpretation of tests of heterogeneity and bias in meta-analysis J Eval Clin Pract 14 2008 951 957
14. B. Mcmahon, L. Holly, R. Harrington, C. Roberts, and J. Green Do larger studies find smaller effects? The example of studies for the prevention of conduct disorder Eur Child Adolesc Psychiatry 17 2008 432 437
15. A.J. Sutton Evidence concerning the consequences of publication and related biases H.R. Rothstein, A.J. Sutton, M. Borenstein, Publication Bias in Meta-analysis: Prevention, Assessment and Adjustments 2005 Wiley Chichester 175 192
16. M. Borenstein, L.V. Hedges, J.P.T. Higgins, and H.R. Rothstein Publication bias M. Borenstein, L.V. Hedges, J.P.T. Higgins, H.R. Rothstein, Introduction to Meta-analysis 2009 Wiley Chichester 277 294
17. G. Rücker Small-study Effects and Heterogeneity in Meta-analysis (PhD Thesis) 2010 Germany: Freiburg
18. A.W. Chan, A. Hrobjartsson, M.T. Haahr, P.C. Gotzsche, and D.G. Altman Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles J Am Med Assoc 291 2004 2457 2465
19. S. Hopewell, K. Loudon, M.J. Clarke, A.D. Oxman, and K. Dickersin Publication bias in clinical trials due to statistical significance or direction of trial results Cochrane Database Syst Rev 1 2009 MR000006
20. M. Egger, G. Davey Smith, M. Schneider, and C. Minder Bias in meta-analysis detected by a simple, graphical test BMJ 315 1997 629 634
21. S.N. Papageorgiou, M.A. Papadopoulos, and A.E. Athanasiou Assessing small study effects and publication bias in orthodontic meta-analyses: a meta-epidemiological study Clin Oral Invest 18 2014 1031 1044
22. S.N. Papageorgiou, M.A. Papadopoulos, and A.E. Athanasiou Reporting characteristics of meta-analyses in orthodontics: methodological assessment and statistical recommendations Eur J Orthod 36 2014 74 85
23. S.N. Papageorgiou, G. Antonoglou, E. Tsiranidou, S. Jepsen, and A. Jäger Influence of study characteristics on the estimated effects of meta-analyses: a meta-epidemiological study in dental and maxillofacial medicine J Clin Epidemiol 67 2014 984 992
24. A.J. Sutton, S.J. Duval, R.L. Tweedie, K.R. Abrams, and D.R. Jones Empirical assessment of effect of publication bias on meta-analyses BMJ 320 2000 1574 1577
25. M.D. Jennions, and A.P. Møller Publication bias in ecology and evolution: an empirical assessment using the 'trim and fill' method Biol Rev Camb Philos Soc 77 2002 211 222
26. J.P. Higgins, S.G. Thompson, J.J. Deeks, and D.G. Altman Measuring inconsistency in meta-analyses BMJ 327 2003 557 560
27. P. Cuijpers, F. Smit, E. Bohlmeijer, S.D. Hollon, and G. Andersson Efficacy of cognitive-behavioural therapy and other psychological treatments for adult depression: meta-analytic study of publication bias Br J Psychiatry 196 2010 173 178
28. R. Light, and D. Pillemer Summing up: The Science of Reviewing Research 1984 Harvard University Press Cambridge
29. C.B. Begg, and M. Mazumdar Operating characteristics of a rank correlation test for publication bias Biometrics 50 1994 1088 1101
30. R. Rosenthal Meta-analytic Procedures for Social Research 1991 Sage Publications Newbury Park
31. S. Duval, and R. Tweedie Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis Biometrics 56 2000 455 463
32. ® Science Edition 2011. Available at: http://www.thomsonreuters.com; Accessed 03.07.14.
33. SCImago. SCImago Journal and Country Rank. Available at: http://www.scimagojr.com; Accessed 03.07.14.
34. J.P.T. Higgins, and S.G. Thompson Controlling the risk of spurious results from meta-regression Stat Med 23 2004 1663 1682
35. J.P. Ioannidis, and T.A. Trikalinos The appropriateness of asymmetry tests for publication bias in meta-analyses: a large survey CMAJ 176 2007 1091 1096
36. C.Y. Johnson, and J. Little Folate intake, markers of folate status and oral clefts: is the evidence converging? Int J Epidemiol 37 2008 1041 1058
37. O. Haugejorden Using the DMF gender difference to assess the "major" role of fluoride toothpastes in the caries decline in industrialized countries: a meta-analysis Community Dent Oral Epidemiol 24 1996 369 375
38. A. Bårdsen "Risk periods" associated with the development of dental fluorosis in maxillary permanent central incisors: a meta-analysis Acta Odontol Scand 57 1999 247 256
39. A.I. Ismail, and R.R. Bandekar Fluoride supplements and fluorosis: a meta-analysis Community Dent Oral Epidemiol 27 1999 48 56
40. B.J. Polder, M.A. Van't Hof, F.P. Van der Linden, and A.M. Kuijpers-Jagtman A meta-analysis of the prevalence of dental agenesis of permanent teeth Community Dent Oral Epidemiol 32 2004 217 226
41. S.M. Weinberg, B.S. Maher, and M.L. Marazita Parental craniofacial morphology in cleft lip with or without cleft palate as determined by cephalometry: a meta-analysis Orthod Craniofac Res 9 2006 18 30
42. P.A. Romitti, A.M. Herring, L.K. Dennis, and D.L. Wong-Gibbons Meta-analysis: pesticides and orofacial clefts Cleft Palate Craniofac J 44 2007 358 365
43. J. Berg, C. Gerweck, and P.P. Hujoel Evidence-based clinical recommendations regarding fluoride intake from reconstituted infant formula and enamel fluorosis: a report of the American Dental Association Council on Scientific Affairs J Am Dent Assoc 142 2011 79 87
44. R.L. Badovinac, M.M. Werler, P.L. Williams, K.T. Kelsey, and C. Hayes Folic acid-containing supplement consumption during pregnancy and risk for oral clefts: a meta-analysis Birth Defects Res A Clin Mol Teratol 79 2007 8 15
45. Y.I. Goh, E. Bollano, T.R. Einarson, and G. Koren Prenatal multivitamin supplementation and rates of congenital anomalies: a meta-analysis J Obstet Gynaecol 28 2006 680 689
46. A. Hackshaw, C. Rodeck, and S. Boniface Maternal smoking in pregnancy and birth defects: a systematic review based on 173 687 malformed cases and 11.7 million controls Hum Reprod Update 17 2011 589 604
47. A.P. Herkrath, F.J. Herkrath, M.A. Rebelo, and M.V. Vettore Parental age as a risk factor for non-syndromic oral clefts: a meta-analysis J Dent 40 2012 3 14
48. J. Little, A. Cardy, and R.G. Munger Tobacco smoking and oral clefts: a meta-analysis Bull World Health Organ 82 2004 213 218
49. Y.L. Luo, Y.L. Cheng, P. Ye, W. Wang, X.H. Gao, and Q. Chen Association between MTHFR polymorphisms and orofacial clefts risk: a meta-analysis Birth Defects Res A Clin Mol Teratol 94 2012 237 244
50. L.E. Mitchell Transforming growth factor alpha locus and nonsyndromic cleft lip with or without cleft palate: a reappraisal Genet Epidemiol 14 1997 231 240
51. M.J. Nieuwenhuijsen, D. Martinez, and J. Grellier Chlorination disinfection by-products in drinking water and congenital anomalies: review and meta-analyses Environ Health Perspect 117 2009 1486 1493
52. A. Verkleij-Hagoort, J. Bliek, F. Sayed-Tabatabaei, N. Ursem, E. Steegers, and R. Steegers-Theunissen Hyperhomocysteinemia and MTHFR polymorphisms in association with orofacial clefts and congenital heart defects: a meta-analysis Am J Med Genet A 143A 2007 952 960
53. A.R. Vieira, I.M. Orioli, and J.C. Murray Maternal age and oral clefts: a reappraisal Oral Surg Oral Med Oral Pathol Oral Radiol Endod 94 2002 530 535
54. D.F. Wyszynski, D.L. Duffy, and T.H. Beaty Maternal cigarette smoking and oral clefts: a meta-analysis Cleft Palate Craniofac J 34 1997 206 210
55. Costa TAPG Avaliação da efectividade na redução da cárie de agentes terapêuticos nos dentífricos - meta-análise (Master Thesis) 2011 Portugal: Porto
56. A. Derks, C. Katsaros, J.E. Frencken, M.A. Van't Hof, and A.M. Kuijpers-Jagtman Caries-inhibiting effect of preventive measures during orthodontic treatment with fixed appliances. A systematic review Caries Res 38 2004 413 420
57. C. Hayden, J.O. Bowler, and S. Chambers Obesity and dental caries in children: a systematic review and meta-analysis Community Dent Oral Epidemiol 41 2013 289 308
58. U. Helfenstein, and M. Steiner Fluoride varnishes (Duraphat): a meta-analysis Community Dent Oral Epidemiol 22 1994 1 5
59. J. Huang, Z. Chen, and Y. Guo Topical fluoride for the prevention of dental caries in children: a systematic review Chin J Evid Based Med 12 2012 848 854
60. P.P. Hujoel Vitamin D and dental caries in controlled clinical trials: systematic review and meta-analysis Nutr Rev 71 2013 88 97
61. J.C. Llodra, M. Bravo, M. Delgado-Rodriguez, P. Baca, and R. Galvez Factors influencing the effectiveness of sealants - a meta-analysis Community Dent Oral Epidemiol 21 1993 261 268
62. V.C. Marinho, J.P. Higgins, S. Logan, and A. Sheiham Fluoride gels for preventing dental caries in children and adolescents Cochrane Database Syst Rev 2 2002 CD002280
63. V.C. Marinho, J.P. Higgins, S. Logan, and A. Sheiham Fluoride varnishes for preventing dental caries in children and adolescents Cochrane Database Syst Rev 3 2002 CD002279
64. V.C. Marinho, J.P. Higgins, S. Logan, and A. Sheiham Fluoride mouthrinses for preventing dental caries in children and adolescents Cochrane Database Syst Rev 3 2003 CD002284
65. V.C. Marinho, J.P.T. Higgins, S. Logan, and A. Sheiham Fluoride toothpastes for preventing dental caries in children and adolescents Cochrane Database Syst Rev 1 2003 CD002278
66. V.C. Marinho, J.P.T. Higgins, S. Logan, and A. Sheiham Topical fluoride (toothpastes, mouthrinses, gels or varnishes) for preventing dental caries in children and adolescents Cochrane Database Syst Rev 4 2003 CD002782
67. V.C. Marinho, J.P. Higgins, A. Sheiham, and S. Logan One topical fluoride (toothpastes, or mouthrinses, or gels, or varnishes) versus another for preventing dental caries in children and adolescents Cochrane Database Syst Rev 1 2004 CD002780
68. V.C. Marinho, J.P.T. Higgins, A. Sheiham, and S. Logan Combinations of topical fluoride (toothpastes, mouthrinses, gels, varnishes) versus single topical fluoride for preventing dental caries in children and adolescents Cochrane Database Syst Rev 1 2004 CD002781
69. I. Mejàre, P. Lingström, and L.G. Petersson Caries-preventive effect of fissure sealants: a systematic review Acta Odontol Scand 61 2003 321 330
70. H.M. Van Rijkom, G.J. Truin, and M.A. Van't Hof A meta-analysis of clinical studies on the caries-inhibiting effect of fluoride gel treatment Caries Res 32 1998 83 92
71. T. Walsh, H.V. Worthington, A.M. Glenny, P. Appelbe, V.C. Marinho, and X. Shi Fluoride toothpastes of different concentrations for preventing dental caries in children and adolescents Cochrane Database Syst Rev 1 2010 CD007868
72. National Health and Medical Research Council A Systematic Review of the Efficacy and Safety of Fluoridation 2007 Australian National Health and Medical Research Council, Australian Government Canberra
73. M. Fallahinejad Ghajari, M. Mirkarimi, M. Vatanpour, and J.K. Fardi Comparison of pulpotomy with formocresol and MTA in primary molars: a systematic review and meta-analysis Iran Endod J 3 2008 45 49
74. M. Fallahinejad Ghajari, M.N. Kermani, M.J.K. Fard, and M. Vatanpout Comparison of formocresol and ferric sulfate pulpotomy in primary molars: a systematic review and meta-analysis J Dent (Tehran) 6 2009 29 36
75. R.C. Randall, M.M. Vrijhoef, and N.H. Wilson Efficacy of preformed metal crowns vs. amalgam restorations in primary molars: a systematic review J Am Dent Assoc 131 2000 337 343
76. F. Schwendicke, C.E. Dörfer, and S. Paris Incomplete caries removal: a systematic review and meta-analysis J Dent Res 92 2013 306 314
77. W. Xiao-Yan, N. Jie, C. Xue, V. Yengopal, and Mickenautsch Failure rate of atraumatic restorative treatment using high-viscosity glass-ionomer cement compared to conventional amalgam restorative treatment in primary and permanent teeth: a systematic review of Chinese trials J Minim Interv Dent 5 2012 377 415
78. P. Frazão, P.C. Narvai, R. Latorre MDO, and R.A. Castellanos Are severe occlusal problems more frequent in permanent than deciduous dentition? Rev Saude Publica 38 2004 247 254
79. Q.V. Nguyen, P.D. Bezemer, L. Habets, and B. Prahl-Andersen A systematic review of the relationship between overjet size and traumatic dental injuries Eur J Orthod 21 1999 503 515
80. M. Themessl-Huber, R. Freeman, G. Humphris, S. Macgillivray, and N. Terzi Empirical evidence of the relationship between parental and child dental fear: a structured review and meta-analysis Int J Paediatr Dent 20 2010 83 101
81. S.N. Papageorgiou, M.A. Papadopoulos, and A.E. Athanasiou Evaluation of methodology and quality characteristics of systematic reviews in orthodontics Orthod Craniofac Res 14 2011 116 137
82. J.J. Deeks, P. Macaskill, and L. Irwig The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed J Clin Epidemiol 58 2005 882 893
83. J.A. Sterne, and M. Egger Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis J Clin Epidemiol 54 2001 1046 1055
84. N. Terrin, C.H. Schmid, and J. Lau In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias J Clin Epidemiol 58 2005 894 901
85. L.L. Kjaergard, J. Villumsen, and C. Gluud Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses Ann Intern Med 135 2001 982 989
86. A. Shang, K. Huwiler-Müntener, and L. Nartey Are the clinical effects of homoeopathy placebo effects? Comparative study of placebo-controlled trials of homoeopathy and allopathy Lancet 366 2005 726 732
87. J.P. Souza, C. Pileggi, and J.G. Cecatti Assessment of funnel plot asymmetry and publication bias in reproductive health meta-analyses: an analytic survey Reprod Health 4 2007 3
88. P. Vavken, and R. Dorotka The prevalence and effect of publication bias in orthopaedic meta-analyses J Orthop Sci 16 2011 238 244
89. J.A. Sterne, A.J. Sutton, and J.P. Ioannidis Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials BMJ 343 2011 d4002
90. T.A. Furukawa, N. Watanabe, I.M. Omori, V.M. Montori, and G.H. Guyatt Association between unreported outcomes and effect size estimates in Cochrane metaanalyses J Am Med Assoc 297 2007 468 470
91. J.L. Tang, and J.L. Liu Misleading funnel plot for detection of bias in meta-analysis J Clin Epidemiol 53 2000 477 484
92. S.G. Moreno, A.J. Sutton, A.E. Ades, N.J. Cooper, and K.R. Abrams Adjusting for publication biases across similar interventions performed well when compared with gold standard data J Clin Epidemiol 64 2011 1230 1241
93. G. Rücker, G. Schwarzer, J.R. Carpenter, H. Binder, and M. Schumacher Treatment-effect estimates adjusted for small-study effects via a limit meta-analysis Biostatistics 12 2011 122 142
94. R.M. Harbord, M. Egger, and J.A. Sterne A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints Stat Med 25 2006 3443 3457
95. S.G. Moreno, A.J. Sutton, J.R. Thompson, A.E. Ades, K.R. Abrams, and N.J. Cooper A generalized weighting regression-derived meta-analysis estimator robust to small-study effects and heterogeneity Stat Med 31 2012 1407 1417
96. J.B. Copas, and J.Q. Shi A sensitivity analysis for publication bias in systematic reviews Stat Methods Med Res 10 2010 251 265
97. G. Schwarzer, J. Carpenter, and G. Rücker Empirical evaluation suggests Copas selection model preferable to trim-and-fill method for selection bias in meta-analysis J Clin Epidemiol 63 2010 282 288