Testing for publication bias in diagnostic meta-analysis: A simulation study

Statistics in Medicine

Volumn 33, Issue 18, 2014, Pages 3061-3077

  Bürkner, Paul Christian ^a   Doebler, Philipp ^a  

^a UNIVERSITY OF MÜNSTER   (Germany)

Author keywords

Diagnostic meta analysis; Diagnostic odds ratio; Publication bias; Simulation study; Trim and fill

Indexed keywords

ARTICLE; BIVARIATE MODEL; CONTROLLED STUDY; DIAGNOSTIC ACCURACY; DIAGNOSTIC META ANALYSIS; DIAGNOSTIC TEST; ERROR; LINEAR REGRESSION ANALYSIS; PUBLISHING; SIMULATION; STATISTICAL ANALYSIS; STATISTICAL MODEL; BIOSTATISTICS; COMPUTER SIMULATION; DIAGNOSIS; HUMAN; META ANALYSIS (TOPIC); REGRESSION ANALYSIS; RISK; STATISTICS AND NUMERICAL DATA;

BIOSTATISTICS; COMPUTER SIMULATION; DIAGNOSIS; HUMANS; META-ANALYSIS AS TOPIC; MODELS, STATISTICAL; ODDS RATIO; PUBLICATION BIAS; REGRESSION ANALYSIS;

EID: 84903816130     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.6177     Document Type: Article

References (57)

1. Irwig L, Tosteson AN, Gatsonis C, Lau J, Colditz G, Chalmers TC, Mosteller F. Guidelines for meta-analyses evaluating diagnostic tests. Annals of Internal Medicine 1994120(8):667-676.
2. Irwig L, Macaskill P, Glasziou P, Fahey M. Meta-analytic methods for diagnostic test accuracy. Journal of Clinical Epidemiology 199548(1):119-130.
3. Tacconelli E. Systematic reviews: CRD's guidance for undertaking reviews in health care. The Lancet Infectious Diseases 201010(4):1-281.
4. Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. Journal of Clinical Epidemiology 200558(9):882-893.
5. Easterbrook PJ, Gopalan R, Berlin J, Matthews DR. Publication bias in clinical research. The Lancet 1991337(8746):867-872.
6. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Lijmer JG, Moher D, Rennie D, DeVet H. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Standards for reporting of diagnostic accuracy. Clinical Chemistry 200349(1):68-73.
7. Pepe MS. The Statistical Evaluation of Medical Tests for Classification and Prediction, Oxford University Press: Oxford, 2003.
8. Cheng D, Branscum AJ, Stamey JD. A Bayesian approach to sample size determination for studies designed to evaluate continuous medical tests. Computational Statistics & Data Analysis 201054(2):298-307.
9. Li CR, Liao CT, Liu JP. A non-inferiority test for diagnostic accuracy based on the paired partial areas under ROC curves. Statistics in Medicine 200827(10):1762-1776.
10. Liu JP, Ma MC, Wu Cy, Tai JY. Tests of equivalence and non-inferiority for diagnostic accuracy based on the paired areas under ROC curves. Statistics in Medicine 200625(7):1219-1238.
11. Song F, Khan KS, Dinnes J, Sutton AJ. Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy. International Journal of Epidemiology 200231(1):88-95.
12. Begg CB, Berlin JA. Publication bias: a problem in interpreting medical data. Journal of the Royal Statistical Society. Series A (Statistics in Society) 198820(3):419-463.
13. Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PM. The diagnostic odds ratio: a single indicator of test performance. Journal of Clinical Epidemiology 200356(11):1129-1135.
14. Rutter CM, Gatsonis CA. A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Statistics in Medicine 200120(19):2865-2884.
15. Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. Journal of Clinical Epidemiology 200558(10):982-990.
16. Harbord RM, Deeks JJ, Egger M, Whiting P, Sterne JA. A unification of models for meta-analysis of diagnostic accuracy studies. Biostatistics 20078(2):239-251.
17. Arends L, Hamza T, VanHouwelingen J, Heijenbrok-Kal M, Hunink M, Stijnen T. Bivariate random effects meta-analysis of ROC curves. Medical Decision Making 200828(5):621-638.
18. Macaskill P, Gatsonis C, Deeks JJ, Harbord RM, Takwoingi Y. Chapter 10: analysing and presenting results, InCochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy, Deeks JJ, Bossuyt PM, Gatsonis C (eds), Version 1.0. The Cochrane Collaboration, 2010. Available from: http://srdta.cochrane.org/.
19. Ma X, Nie L, Cole SR, Chu H. Statistical methods for multivariate meta-analysis of diagnostic tests: an overview and tutorial. Statistical Methods in Medical Research 20130(0):1-24.
20. Leeflang MM, Deeks JJ, Gatsonis C, Bossuyt PM. Systematic reviews of diagnostic test accuracy. Annals of Internal Medicine 2008149(12):889-897.
21. Littenberg B, Moses LE. Estimating diagnostic accuracy from multiple conflicting reports a new meta-analytic method. Medical Decision Making 199313(4):313-321.
22. Sweeting MJ, Sutton AJ, Lambert PC. What to add to nothing? Use and avoidance of continuity corrections in meta-analysis of sparse data. Statistics in Medicine 200423(9):1351-1375.
23. Haddock CK, Rindskopf D, Shadish WR. Using odds ratios as effect sizes for meta-analysis of dichotomous data: a primer on methods and issues. Psychological Methods 19983(3):339-353.
24. Schwarzer G, Antes G, Schumacher M. Inflation of type I error rate in two statistical tests for the detection of publication bias in meta-analyses with binary outcomes. Statistics in Medicine 200221(17):2465-2477.
25. Le CT. A solution for the most basic optimization problem associated with an ROC curve. Statistical Methods in Medical Research 200615(6):571-584.
26. Holling H, Böhning W, Böhning D. Likelihood-based clustering of meta-analytic SROC curves. Psychometrika 201277(1):106-126.
27. Holling H, Böhning W, Böhning D. Meta-analysis of diagnostic studies based upon SROC-curves: a mixed model approach using the Lehmann family. Statistical Modelling 201212(4):347-375.
28. Youden WJ. Index for rating diagnostic tests. Cancer 19503(1):32-35.
29. Böhning D, Böhning W, Holling H. Revisiting Youden's index as a useful measure of the misclassification error in meta-analysis of diagnostic studies. Statistical Methods in Medical Research 200817(6):543-554.
30. Böhning D, Holling H, Patilea V. A limitation of the diagnostic-odds ratio in determining an optimal cut-off value for a continuous diagnostic test. Statistical Methods in Medical Research 201120(5):541-550.
31. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 196020(1):37-46.
32. Kraemer HC, Periyakoil V, Noda A. Kappa coefficients in medical research. Statistics in Medicine 200221(14):2109-2129.
33. Bloch DA. Comparing two diagnostic tests against the same "gold standard" in the same sample. Biometrics 199753(1):73-85.
34. Fleiss JL. Measuring nominal scale agreement among many raters. Psychological Bulletin 197176(5):378-382.
35. Fleiss JL, Cohen J, Everitt BS. Large sample standard errors of kappa and weighted kappa. Psychological Bulletin 196972(5):323-327.
36. Richard J, Pillemer DB. Summing Up: The Science of Reviewing Research, Harvard University Press: Cambridge, Massachusetts, 1984.
37. Rothstein HR, Sutton AJ, Borenstein M. Publication Bias in Meta-analysis: Prevention, Assessment and Adjustments, Wiley: Chichester, UK, 2006.
38. Terrin N, Schmid CH, Lau J. In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias. Journal of Clinical Epidemiology 200558(9):894-901.
39. Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ 1997315(7109):629-634.
40. Thompson SG, Sharp SJ. Explaining heterogeneity in meta-analysis: a comparison of methods. Statistics in Medicine 199918(20):2693-2708.
41. Macaskill P, Walter SD, Irwig L. A comparison of methods to detect publication bias in meta-analysis. Statistics in Medicine 200120(4):641-654.
42. Harbord RM, Egger M, Sterne JA. A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Statistics in Medicine 200625(20):3443-3457.
43. Rücker G, Schwarzer G, Carpenter J. Arcsine test for publication bias in meta-analyses with binary outcomes. Statistics in Medicine 200827(5):746-763.
44. Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Comparison of two methods to detect publication bias in meta-analysis. JAMA: the journal of the American Medical Association 2006295(6):676-680.
45. Peters J, Sutton A, Jones D, Abrams K, Rushton L. 2005. Performance of tests and adjustments for publication bias in the presence of heterogeneity, Technical Report Technical Report 05-01, Department of Health Sciences, University of Leicester, Leicester, England.
46. Sterne JA, Gavaghan D, Egger M. Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. Journal of Clinical Epidemiology 200053(11):1119-1129.
47. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics 199450(4):1088-1101.
48. Kendall MG. A new measure of rank correlation. Biometrika 193830(1/2):81-93.
49. Schwarzer G, Antes G, Schumacher M. A test for publication bias in meta-analysis with sparse binary data. Statistics in Medicine 200726(4):721-733.
50. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 200056(2):455-463.
51. Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity. Statistics in Medicine 200726(25):4544-4562.
52. Dear KB, Begg CB. An approach for assessing publication bias prior to performing a meta-analysis. Statistical Science 19927(2):237-245.
53. Givens GH, Smith D, Tweedie R. Publication bias in meta-analysis: a Bayesian data-augmentation approach to account for issues exemplified in the passive smoking debate. Statistical Science 199712(4):221-240.
54. Hedges LV. Modeling publication selection effects in meta-analysis. Statistical Science 19927(2):246-255.
55. R Core Team. R: a language and environment for statistical computing, R Foundation for Statistical Computing, Vienna, Austria, 2013. http://www.R-project.org/ [Accessed on 6 December 2013], ISBN 3-900051-07-0.
56. Eddelbuettel D, François R. Rcpp: seamless R and C++ integration. Journal of Statistical Software 201140(8):1-18.
57. Schwarzer G. meta: meta-analysis with R, (2013). http://CRAN.R-project.org/package=meta [Accessed on 6 December 2013], r package version 3.1-2.