No evidence for intervention-dependent influence of methodological features on treatment effect

Journal of Clinical Epidemiology

Volumn 66, Issue 12, 2013, Pages 1347-1355.e3

  Jacobs, Wilco C H ^a   Kruyt, Moyo C ^b   Moojen, Wouter A ^a   Verbout, Ab J ^b   Oner, F Cumhur ^b  

^a LEIDEN UNIVERSITY MEDICAL CENTER   (Netherlands)

^b UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

Author keywords

Allocation concealment; Effect modifier; Epidemiologic; Randomization; Research design; Risk of bias

Indexed keywords

FOLIC ACID; PLACEBO;

ARTICLE; CANCER SCREENING; CANCER SURGERY; CARDIOVASCULAR DISEASE; CHILDBIRTH; CHILDHOOD DISEASE; COCHRANE LIBRARY; COLORECTAL CANCER; CONDUCT DISORDER; CONSERVATIVE TREATMENT; DEPRESSION; EFFECT SIZE; EMBASE; FEMUR NECK FRACTURE; GASTROINTESTINAL DISEASE; GENERAL SURGERY; GENETIC HETEROGENEITY; HOMEOPATHY; HUMAN; INFECTION; INTENTION TO TREAT ANALYSIS; INTERNAL VALIDITY; MEDLINE; META ANALYSIS (TOPIC); METHODOLOGY; NEURAL TUBE DEFECT; ORTHOPEDIC SURGERY; OSTEOSYNTHESIS; PHARMACEUTICAL CARE; PHYSIOTHERAPY; PREGNANCY; PRIORITY JOURNAL; PSYCHOTHERAPY; RADIOTHERAPY; RANDOMIZATION; RANDOMIZED CONTROLLED TRIAL (TOPIC); SAMPLE SIZE; SELF HELP; SKIN INCISION; SPINE FUSION; STUDY DESIGN; SURGICAL MORTALITY; SYSTEMATIC REVIEW; TENSION HEADACHE; THERAPY EFFECT;

EID: 84886947962     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2013.06.007     Document Type: Review

References (30)

1. E. Nuesch, S. Trelle, S. Reichenbach, A.W. Rutjes, B. Tschannen, and D.G. Altman Small study effects in meta-analyses of osteoarthritis trials: meta-epidemiological study BMJ 341 2010 c3515
2. V. Siersma, B. Als-Nielsen, W. Chen, J. Hilden, L.L. Gluud, and C. Gluud Multivariable modelling for meta-epidemiological assessment of the association between trial quality and treatment effects estimated in randomized clinical trials Stat Med 26 2007 2745 2758
3. L. Wood, M. Egger, L.L. Gluud, K.F. Schulz, P. Jüni, and D.G. Altman Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study BMJ 336 2008 601 605
4. B. Als-Nielsen, W. Chen, C. Gluud, and L.L. Kjaergard Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events? JAMA 290 2003 921 928
5. K.F. Schulz, I. Chalmers, R.J. Hayes, and D.G. Altman Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials JAMA 273 1995 408 412
6. E.M. Balk, P.A. Bonis, H. Moskowitz, C.H. Schmid, J.P. Ioannidis, and C. Wang Correlation of quality measures with estimates of treatment effect in meta-analyses of randomized controlled trials JAMA 287 2002 2973 2982
7. J.P. Ioannidis, A.B. Haidich, M. Pappa, N. Pantazis, S.I. Kokori, and M.G. Tektonidou Comparison of evidence of treatment effects in randomized and nonrandomized studies JAMA 286 2001 821 830
8. N.S. Abraham, C.J. Byrne, J.M. Young, and M.J. Solomon Meta-analysis of well-designed nonrandomized comparative studies of surgical procedures is as good as randomized controlled trials J Clin Epidemiol 63 2010 238 245
9. A.D. Furlan, G. Tomlinson, A.A. Jadad, and C. Bombardier Examining heterogeneity in meta-analysis: comparing results of randomized trials and nonrandomized studies of interventions for low back pain Spine 33 3 2008 339 348
10. D. Moher, B. Pham, A. Jones, D.J. Cook, A.R. Jadad, and M. Moher Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet 352 1998 609 613
11. R. Kunz, and A.D. Oxman The unpredictability paradox: review of empirical comparisons of randomised and non-randomised clinical trials BMJ 317 1998 1185 1190
12. I. Shrier, J.F. Boivin, R.J. Steele, R.W. Platt, A. Furlan, and R. Kakuma Should meta-analyses of interventions include observational studies in addition to randomized controlled trials? A critical examination of underlying principles Am J Epidemiol 166 2007 1203 1209
13. J.J. Deeks, J. Dinnes, R. D'Amico, A.J. Sowden, C. Sakarovitch, and F. Song Evaluating non-randomised intervention studies [review] Health Technol Assess 7 2003 1 173
14. M. Bhandari, P. Tornetta, T. Ellis, L. Audige, S. Sprague, and J.C. Kuo Hierarchy of evidence: differences in results between non-randomized studies and randomized trials in patients with femoral neck fractures Arch Orthop Trauma Surg 124 1 2004 10 16
15. A. Shang, K. Huwiler-Muntener, L. Nartey, P. Jüni, S. Dörig, and J.A. Sterne Are the clinical effects of homoeopathy placebo effects? Comparative study of placebo-controlled trials of homoeopathy and allopathy Lancet 366 2005 726 732
16. J. Gellatly, P. Bower, S. Hennessy, D. Richards, S. Gilbody, and K. Lovell What makes self-help interventions effective in the management of depressive symptoms? Meta-analysis and meta-regression Psychol Med 37 9 2007 1217 1228
17. A.P. Verhagen, H.C.W. de Vet, S. Willemsen, and T. Stijnen A meta-regression analysis shows no impact of design characteristics on outcome in trials on tension-type headaches J Clin Epidemiol 61 2008 813 818
18. B. McMahon, L. Holly, R. Harrington, C. Roberts, and J. Green Do larger studies find smaller effects? The example of studies for the prevention of conduct disorder Eur Child Adolesc Psychiatry 17 7 2008 432 437
19. L.L. Kjaergard, J. Villumsen, and C. Gluud Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses Ann Intern Med 135 2001 982 989
20. J.F. Tierney, and L.A. Stewart Investigating patient exclusion bias in meta-analysis Int J Epidemiol 34 2005 79 87
21. E. Nuesch, S. Trelle, S. Reichenbach, A.W. Rutjes, E. Bürgi, and M. Scherer The effects of excluding patients from the analysis in randomised controlled trials: meta-epidemiological study BMJ 339 2009 b3244
22. J. Lexchin, L.A. Bero, B. Djulbegovic, and O. Clark Pharmaceutical industry sponsorship and research outcome and quality: systematic review BMJ 326 2003 1167 1170
23. J.E. Bekelman, Y. Li, and C.P. Gross Scope and impact of financial conflicts of interest in biomedical research: a systematic review JAMA 289 2003 454 465
24. L.L. Kjaergard, and B. Als-Nielsen Association between competing interests and authors' conclusions: epidemiological study of randomised clinical trials published in the BMJ BMJ 325 2002 249
25. B. Djulbegovic, M. Lacevic, A. Cantor, K.K. Fields, C.L. Bennett, and J.R. Adams The uncertainty principle and industry-sponsored research Lancet 356 2000 635 638
26. M. Egger, P. Juni, C. Bartlett, F. Holenstein, and J. Sterne How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study Health Technol Assess 7 2003 1 76
27. K. Linde, M. Scholz, G. Ramirez, N. Clausius, D. Melchart, and W.B. Jonas Impact of study quality on outcome in placebo-controlled trials of homeopathy J Clin Epidemiol 52 1999 631 636
28. R.R. MacLehose, B.C. Reeves, I.M. Harvey, T.A. Sheldon, I.T. Russell, and A.M. Black A systematic review of comparisons of effect sizes derived from randomised and non-randomised studies Health Technol Assess 4 2000 1 154
29. J. Pildal, A. Hrobjartsson, K.J. Jorgensen, J. Hilden, D.G. Altman, and P.C. Gotzsche Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials Int J Epidemiol 36 2007 847 857
30. C.A. van Nieuwenhoven, E. Buskens, F.H. van Tiel, and M.J. Bonten Relationship between methodological trial quality and the effects of selective digestive decontamination on pneumonia and mortality in critically ill patients JAMA 286 2001 335 340