A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints

Statistics in Medicine

Volumn 25, Issue 20, 2006, Pages 3443-3457

  Harbord, Roger M ^a   Egger, Matthias ^a,b   Sterne, Jonathan A C ^a  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b UNIVERSITY OF BERN   (Switzerland)

Author keywords

Binary data; Funnel plot; Meta analysis; Publication bias; Small study effects; Systematic reviews

Indexed keywords

NICOTINE DERIVATIVE; PLACEBO;

ANALYTICAL ERROR; ARTICLE; CLINICAL TRIAL; DATA ANALYSIS; FACTORIAL DESIGN; FALSE POSITIVE RESULT; HUMAN; LINEAR REGRESSION ANALYSIS; MATHEMATICAL COMPUTING; META ANALYSIS; OUTCOME ASSESSMENT; PUBLISHING; RANDOMIZATION; SAMPLE SIZE; SCORING SYSTEM; SIMULATION; SMOKING CESSATION; STATISTICAL ANALYSIS; SYSTEMATIC REVIEW; TOBACCO DEPENDENCE; TREATMENT OUTCOME; VARIANCE;

ENDPOINT DETERMINATION; HUMANS; META-ANALYSIS; META-ANALYSIS AS TOPIC; PUBLICATION BIAS; RANDOMIZED CONTROLLED TRIALS; RANDOMIZED CONTROLLED TRIALS AS TOPIC;

EID: 33748090675     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.2380     Document Type: Article

References (49)

1. Simes RJ. Publication bias: the case for an international registry of clinical trials. Journal of Clinical Oncology 1986; 4:1529-1541.
2. Begg CB, Berlin JA. Publication bias: a problem in interpreting medical data. Journal of the Royal Statistical Society, Series A 1988; 151:419-463.
3. Dickersin K. The existence of publication bias and risk factors for its occurrence. Journal of the American Medical Association 1990; 263(10):1385-1389.
4. Easterbrook PJ, Berlin J, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet 1991; 337: 867-872.
5. Stern JM, Simes RJ. Publication bias: evidence of delayed publication in a cohort study of clinical research projects. British Medical Journal 1997; 315(7109):640-645.
6. Light RJ, Pillemer DB. Summing Up. The Science of Reviewing Research, vol. 1. Harvard University Press: Cambridge, MA, London, England, 1984.
7. Egger M, Davey Smith G, Schneider M, Minder CE. Bias in meta-analysis detected by a simple, graphical test. British Medical Journal 1997; 315:629-634.
8. Egger M, Juni P, Bartlett C, Sterne J. How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technology Assessment 2003; 7(1). Available at http://www.ncchta.org/minisumm/min701.rtf
9. Sterne JAC, Gavaghan DJ, Egger M. Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. Journal of Clinical Epidemiology 2000; 53:1119-1129.
10. Sterne JAC, Egger M, Davey Smith G. Investigating and dealing with publication and other biases in meta-analysis. British Medical Journal 2001; 323(7304):101-105.
11. Deeks JJ, Higgins JPT, Altman DG. Analysing and presenting results. In Cochrane Reviewers' Handbook 4.2.2, Alderson P, Green S, Higgins J (eds), [updated March 2004]; http://www.cochrane.org/resources/handbook/ handbook.pdf (accessed 17 January 2005).
12. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics 1994; 50:1088-1101.
13. Irwig L, Macaskill P, Berry G, Glasziou P. Bias in meta-analysis detected by a simple, graphical test. Graphical test is itself biased (Letter). British Medical Journal 1998; 316:470.
14. Macaskill P, Walter SD, Irwig L. A comparison of methods to detect publication bias in meta-analysis. Statistics in Medicine 2001; 20(4):641-654.
15. Schwarzer G, Antes G, Schumacher M. Inflation of type I error rate in two statistical tests for the detection of publication bias in meta-analyses with binary outcomes. Statistics in Medicine 2002; 21(17):2465-2477.
16. Woolf B. On estimating the relation between blood group and disease. Annals of Human Genetics 1955; 19(3):251-253.
17. Sweeting MJ, Sutton AJ, Lambert PC. What to add to nothing? Use and avoidance of continuity corrections in meta-analysis of sparse data. Statistics in Medicine 2004; 23(9):1351-1375.
18. Silagy C, Lancaster T, Stead L, Mant D, Fowler G. Nicotine replacement therapy for smoking cessation. The Cochrane Database of Systematic Reviews, Issue 3, 2004.
19. Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Statistics in Medicine 2002; 21(11):1539-1558.
20. Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. British Medical Journal 2003; 327(7414):557-560.
21. Sterne JAC, Egger M. Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. Journal of Clinical Epidemiology 2001; 54:1046-1055.
22. Galbraith R. A note on graphical presentation of estimated odds ratios from several clinical trials. Statistics in Medicine 1988; 7:889-894.
23. Galbraith R. Graphical display of estimates having differing standard errors. Technometrics 1988; 30(3):271-281.
24. Steichen TJ, Egger M, Sterne JAC. sbe19.1: tests for publication bias in meta-analysis. Stata Technical Bulletin 1998; 44:3-4.
25. Tang JL, Liu JL. Misleading funnel plot for detection of bias in meta-analysis. Journal of Clinical Epidemiology 2000; 53(5):477-484.
26. Whitehead A, Whitehead J. A general parametric approach to the meta-analysis of randomized clinical trials. Statistics in Medicine 1991; 10(11):1665-1677.
27. Whitehead J. The Design and Analysis of Sequential Clinical Trials. Wiley: Chichester, 1992.
28. Yusuf S, Peto R, Lewis J, Collins R, Sleight P. Beta blockade during and after myocardial infarction: an overview of the randomized trials. Progress in Cardiovascular Diseases 1985; 27(5):335-371.
29. Maldonado G, Greenland S. The importance of critically interpreting simulation studies. Epidemiology 1997; 8(4):453-456.
30. Terrin N, Schmid CH, Lau J, Olkin I. Adjusting for publication bias in the presence of heterogeneity. Statistics in Medicine 2003; 22(13):2113-2126.
31. Hilbe J, Linde-Zwirble W. sg44: random number generators. Stata Technical Bulletin 1995; 28:20-21.
32. Hilbe J, Linde-Zwirble W. sg44.1: corrections to random number generators. Stata Technical Bulletin 1998; 41:23.
33. StataCorp. Stata Statistical Software: Release 8.0. Stata Corporation: College Station, TX, 2003.
34. DerSimonian R, Laird N. Meta-analysis in clinical trials. Controlled Clinical Trials 1986; 7(3):177-188.
35. Sackett DL, Deeks JJ, Altman D. Down with odds ratios! Evidence-Based Medicine 1996; 1:164-166.
36. Bown MJ, Sutton AJ, Bell PRF, Sayers RD. A meta-analysis of 50 years of ruptured abdominal aortic aneurysm repair. British Journal of Surgery 2002; 89(6):714-730.
37. Thompson SG, Sharp SJ. Explaining heterogeneity in meta-analysis: a comparison of methods. Statistics in Medicine 1999; 18:2693-2708.
38. McCullagh P, Nelder JA. Generalized Linear Models. Chapman & Hall: London, 1989.
39. Davey Smith G, Egger M, Phillips AN. Meta-analysis: beyond the grand mean? British Medical Journal 1997; 315(7122):1610-1614.
40. Iyengar S, Greenhouse JB. Selection problems and the file drawer problem. Statistical Science 1988; (3): 109-135.
41. Dear KBG, Begg CB. An approach for assessing publication bias prior to performing a meta-analysis. Statistical Science 1992; 7(2):237-245.
42. Copas JB, Shi JQ. A sensitivity analysis for publication bias in systematic reviews. Statistical Methods in Medical Research 2001; 10(4):251-265.
43. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 2000; 56(2):455-463.
44. Duval S, Tweedie R. A nonparametric 'trim and fill' method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association 2000; 95(449):89-98.
45. Sterne JAC, Egger M. High false positive rate for trim and fill method (electronic letter). http://bmj.bmjjournals.com/cgi/eletters/320/7249/ 1574 2000 (accessed 17 January 2005).
46. Egger M, Ebrahim S, Davey Smith G. Where now for meta-analysis? International Journal of Epidemiology 2002; 31(1):1-5.
47. Greenland S, Salvan A. Bias in the one-step method for pooling study results. Statistics in Medicine 1990; 9:247-252.
48. Evans T, Gulmezoglu M, Pang T. Registering clinical trials: an essential role for WHO. Lancet 2004; 363(9419):1413-1414.
49. Moher D, Schulz KF, Altman D, for the CONSORT Group. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. Journal of the American Medical Association (JAMA) 2001; 285(15):1987-1991.