Basic study design influences the results of orthodontic clinical investigations

Journal of Clinical Epidemiology

Volumn 68, Issue 12, 2015, Pages 1512-1522

  Papageorgiou, Spyridon N ^a   Xavier, Guilherme M ^b   Cobourne, Martyn T ^b  

^a UNIVERSITY OF BONN   (Germany)

^b GUY S HOSPITAL   (United Kingdom)

Author keywords

Meta analysis; Orthodontics; Prospective clinical study; Randomized controlled trial; Retrospective clinical study; Systematic review

Indexed keywords

ADVERSE OUTCOME; CLINICAL RESEARCH; EFFECT SIZE; HUMAN; META ANALYSIS (TOPIC); ORTHODONTICS; PRIORITY JOURNAL; RANDOMIZATION; RANDOMIZED CONTROLLED TRIAL (TOPIC); REVIEW; SAMPLE SIZE; SENSITIVITY ANALYSIS; STUDY DESIGN; SYSTEMATIC ERROR; SYSTEMATIC REVIEW (TOPIC); DENTAL RESEARCH; INFORMATION PROCESSING; META ANALYSIS; METHODOLOGY; OUTCOME ASSESSMENT; PROSPECTIVE STUDY; RETROSPECTIVE STUDY; STATISTICAL BIAS;

BIAS (EPIDEMIOLOGY); DATA COLLECTION; DENTAL RESEARCH; HUMANS; ORTHODONTICS; PATIENT OUTCOME ASSESSMENT; PROSPECTIVE STUDIES; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN; RETROSPECTIVE STUDIES;

EID: 84948717613     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2015.03.008     Document Type: Review

References (64)

1. D.L. Sackett, W.S. Richardson, W. Rosenberg, and R.B. Haynes Evidence-based medicine - how to practice and teach EBM 1997 Churchill Livingstone New York, NY
2. M. Egger, G.D. Smith, and D.G. Altman Systematic reviews in health care: meta-analysis in context 2nd edition 2001 BMJ Books London, UK
3. R. Kunz, G. Vist, and A.D. Oxman Randomisation to protect against selection bias in healthcare trials Cochrane Database Syst Rev 2007 MR000012
4. S.N. Papageorgiou, M.A. Papadopoulos, and A.E. Athanasiou Evaluation of methodology and quality characteristics of systematic reviews in orthodontics Orthod Craniofac Res 14 2011 116 137
5. S.N. Papageorgiou, M.A. Papadopoulos, and A.E. Athanasiou Reporting characteristics of meta-analyses in orthodontics: methodological assessment and statistical recommendations Eur J Orthod 36 2014 74 85
6. P. Amat What would you choose: evidence-based treatment or an exciting, risky alternative? Am J Orthod Dentofacial Orthop 132 2007 724 725
7. J.E. Harrison Clinical trials in orthodontics I: demographic details of clinical trials published in three orthodontic journals between 1989 and 1998 J Orthod 30 2003 25 30
8. R. Gibson, and J. Harrison What are we reading? An analysis of the orthodontic literature 1999 to 2008 Am J Orthod Dentofacial Orthop 139 2011 e471 e484
9. N. Pandis, A. Polychronopoulou, P. Madianos, M. Makou, and T. Eliades Reporting of research quality characteristics of studies published in 6 major clinical dental specialty journals J Evid Based Dent Pract 11 2011 75 83
10. W.R. Proffit Evidence and clinical decisions: asking the right questions to obtain clinically useful answers Semin Orthod 19 2013 130 136
11. G. Zuccati, C. Clauser, and R. Giorgetti Randomized clinical trials in orthodontics: reality, dream or nightmare? Am J Orthod Dentofacial Orthop 136 2009 634 637
12. M.C. Meikle Guest editorial: what do prospective randomized clinical trials tell us about the treatment of class II malocclusions? A personal viewpoint Eur J Orthod 27 2005 105 114
13. Bondemark L, Ruff S. EJO open session 2013 a debate randomized controlled trial (RCT): the gold standard or unobtainable fallacy. Available at http://www.oxfordjournals.org/our-journals/eortho/ejovideo.html. Accessed April 14, 2014.
14. C.D. Naylor Meta-analysis and the meta-epidemiology of clinical research BMJ 315 1997 617 619
15. K.F. Schulz, I. Chalmers, R.J. Hayes, and D.G. Altman Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials JAMA 273 1995 408 412
16. L. Wood, M. Egger, L.L. Gluud, K.F. Schulz, P. Jüni, D.G. Altman, and et al. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study BMJ 336 2008 601 605
17. J. Savović, H. Jones, D. Altman, R. Harris, P. Juni, J. Pildal, and et al. Influence of reported study design characteristics on intervention effect estimates from randomised controlled trials: combined analysis of meta-epidemiological studies Health Technol Assess 16 2012 1 82
18. B.C. Reeves, J.P.T. Higgins, C. Ramsay, B. Shea, P. Tugwell, and G.A. Wells An introduction to methodological issues when including non-randomised studies in systematic reviews on the effects of interventions Res Synth Meth 4 2013 1 11
19. S.N. Papageorgiou, G. Antonoglou, E. Tsiranidou, S. Jepsen, and A. Jäger Bias and small-study effects influence treatment effect estimates: a meta-epidemiological study in oral medicine J Clin Epidemiol 67 2014 984 992
20. D. Koletsi, N. Pandis, A. Polychronopoulou, and T. Eliades What's in a title? An assessment of whether randomized controlled trial in a title means that it is one Am J Orthod Dentofacial Orthop 141 2012 679 685
21. S.G. Thompson, and S.J. Sharp Explaining heterogeneity in meta-analysis: a comparison of methods Stat Med 18 1999 2693 2708
22. G. Knapp, and J. Hartung Improved tests for a random-effects meta-regression with a single covariate Stat Med 22 2003 2693 2710
23. J.P. Higgins, and S.G. Thompson Controlling the risk of spurious findings from meta-regression Stat Med 23 2004 1663 1682
24. J. Cohen Statistical power analysis for the behavioral sciences 2nd ed 1988 Academic Press New York
25. J.P. Higgins, and S.G. Thompson Quantifying heterogeneity in a meta-analysis Stat Med 21 2002 1539 1558
26. J.P. Higgins, S.G. Thompson, J.J. Deeks, and D.G. Altman Measuring inconsistency in meta-analyses BMJ 327 2003 557 560
27. J.P. Ioannidis, N.A. Patsopoulos, and E. Evangelou Uncertainty in heterogeneity estimates in meta-analyses BMJ 335 2007 914 916
28. Orsini N, Bottai M, Higgins J, Buchan I. Heterogi: Stata module to quantify heterogeneity in a meta-analysis. Available at http://econpapers.repec.org/RePEc:boc:bocode:s449201. Accessed April 14, 2014.
29. J.P. Higgins, S.G. Thompson, and D.J. Spiegelhalter A re-evaluation of random-effects meta-analysis J R Stat Soc Ser A Stat Soc 172 2009 137 159
30. J.P. Ioannidis Interpretation of tests of heterogeneity and bias in meta-analysis J Eval Clin Pract 14 2008 951 957
31. M. Egger, G. Davey Smith, M. Schneider, and C. Minder Bias in meta-analysis detected by a simple, graphical test BMJ 315 1997 629 634
32. S. Golder, Y.K. Loke, and M. Bland Meta-analyses of adverse effects data derived from randomised controlled trials as compared to observational studies: methodological overview PLos Med 8 2011 e1001026
33. R. Chou, and M. Helfand Challenges in systematic reviews that assess treatment harms Ann Intern Med 142 2005 1090 1099
34. J.P. Ioannidis, A.B. Haidich, M. Pappa, N. Pantazis, S.I. Kokori, M.G. Tektonidou, and et al. Comparison of evidence of treatment effects in randomized and nonrandomized studies JAMA 286 2001 821 830
35. I. Tzoulaki, K.C. Siontis, and J.P. Ioannidis Prognostic effect size of cardiovascular biomarkers in datasets from observational studies versus randomised trials: meta-epidemiology study BMJ 343 2011 d6829
36. W.C. Jacobs, M.C. Kruyt, W.A. Moojen, A.J. Verbout, and F.C. Oner No evidence for intervention-dependent influence of methodological features on treatment effect J Clin Epidemiol 66 2013 1347 1355.e3
37. J.J. Deeks, J. Dinnes, R. D'Amico, A.J. Sowden, C. Sakarovitch, F. Song, and et al. Evaluating non-randomised intervention studies Health Technol Assess 7 2003 iii-x, 1-173
38. B.M. Psaty, T.D. Koepsell, D. Lin, N.S. Weiss, D.S. Siscovick, F.R. Rosendaal, and et al. Assessment and control for confounding by indication in observational studies J Am Geriatr Soc 47 1999 749 754
39. L.E. Johnston Jr. Moving forward by looking back: 'retrospective' clinical studies J Orthod 29 2002 221 226
40. C. Flores-Mir Can we extract useful and scientifically sound information from retrospective nonrandomized trials to be applied in orthodontic evidence-based practice treatments? Am J Orthod Dentofacial Orthop 131 2007 707 708
41. P.N. Papanikolaou, and J.P. Ioannidis Availability of large-scale evidence on specific harms from systematic reviews of randomized trials Am J Med 117 2004 582 589
42. J.P. Vandenbroucke When are observational studies as credible as randomised trials? Lancet 363 2004 1728 1731
43. P.N. Papanikolaou, G.D. Christidi, and J.P.A. Ioannidis Comparison of evidence on harms of medical interventions in randomized and nonrandomized studies CMAJ 174 2006 635 641
44. J.P. Vandenbroucke What is the best evidence for determining harms of medical treatment? CMAJ 174 2006 645 646
45. M. Zwarenstein, and A. Oxman Why are so few randomized trials useful, and what can we do about it? J Clin Epidemiol 59 2006 1125 1126
46. M. Hordijk-Trion, M. Lenzen, W. Wijns, P. de Jaegere, M.L. Simoons, W.J. Scholte op Reimer, and et al. Patients enrolled in coronary intervention trials are not representative of patients in clinical practice: results from the Euro Heart Survey on Coronary Revascularization Eur Heart J 27 2006 671 678
47. D. O'Connor, S. Green, and J.P.T. Higgins Chapter 5: defining the review question and developing criteria for including studies J.P.T. Higgins, S. Green, Cochrane handbook for systematic reviews of intervention. Version 5.1.0 (updated March 2011) 2011 The Cochrane Collaboration Available at www.cochranehandbook.org Accessed April 15, 2014
48. G.H. Guyatt, A.D. Oxman, G. Vist, R. Kunz, J. Brozek, P. Alonso-Coello, and et al. GRADE guidelines: 4. Rating the quality of evidence-study limitations (risk of bias) J Clin Epidemiol 64 2011 407 415
49. M. Egger, M. Schneider, and G. Davey Smith Spurious precision? Meta-analysis of observational studies BMJ 316 1998 140 144
50. P.J. Easterbrook, J.A. Berlin, R. Gopalan, and D.R. Matthews Publication bias in clinical research Lancet 337 1991 867 872
51. N.A. Patsopoulos A pragmatic view on pragmatic trials Dialogues Clin Neurosci 13 2011 217 224
52. M.S. Cepeda, R. Boston, J.T. Farrar, and B.L. Strom Comparison of logistic regression versus propensity score when the number of events is low and there are multiple confounders Am J Epidemiol 158 2003 280 287
53. G. Lonjon, I. Boutron, L. Trinquart, N. Ahmad, F. Aim, R. Nizard, and et al. Comparison of treatment effect estimates from prospective nonrandomized studies with propensity score analysis and randomized controlled trials of surgical procedures Ann Surg 259 2014 18 25
54. J.P. Higgins, C. Ramsay, B. Reeves, J.J. Deeks, B. Shea, J.C. Valentine, and et al. Issues relating to study design and risk of bias when including non-randomized studies in systematic reviews on the effects of interventions Res Synth Methods 4 2013 12 25
55. S.N. Papageorgiou Meta-analysis for orthodontists: Part II - is all that glitters gold? J Orthod 41 2014 327 336
56. J.C. Valentine, and S.G. Thompson Issues relating to confounding and meta-analysis when including non-randomized studies in systematic reviews on the effects of interventions Res Synth Meth 4 2013 26 35
57. S.N. Papageorgiou Meta-analysis for orthodontists: Part I - how to choose effect measure and statistical model J Orthod 41 2014 317 326
58. N.J. Welton, A.E. Ades, J.B. Carlin, D.G. Altman, and J.A.C. Sterne Models for potentially biased evidence in meta-analysis using empirically based priors J R Stat Soc Ser A Stat Soc 172 2009 119 136
59. S. Dias, N.J. Welton, V.C.C. Marinho, G. Salanti, J.P.T. Higgins, and A.E. Ades Estimation and adjustment of bias in randomized evidence by using mixed treatment comparison meta-analysis J R Stat Soc Ser A Stat Soc 173 2010 613 629
60. S. Hopewell, I. Boutron, D.G. Altman, and P. Ravaud Incorporation of assessments of risk of bias of primary studies in systematic reviews of randomised trials: a cross-sectional study BMJ Open 3 2013 e003342
61. A. Mavropoulos, and S. Kiliaridis Orthodontic literature: an overview of the last 2 decades Am J Orthod Dentofacial Orthop 124 2003 30 40
62. J.P. Higgins, D.G. Altman, P.C. Gøtzsche, P. Jüni, D. Moher, A.D. Oxman, and et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials BMJ 343 2011 d5928
63. J.A. Sterne, P. Juni, K.F. Schulz, D.G. Altman, C. Bartlett, and M. Egger Statistical methods for assessing the influence of study characteristics on treatment effects in 'meta-epidemiological' research Stat Med 21 2002 1513 1524
64. A.R. Feinstein Clinical epidemiology. The architecture of clinical research 1985 W. B. Saunders Company Philadelphia, PA