A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis

Journal of the American Statistical Association

Volumn 95, Issue 449, 2000, Pages 89-98

  Duval, Sue ^a   Tweedie, Richard ^b  

^a Immunology and Pathology   (United States)

^b UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Data augmentation; File drawer problem; Funnel plot; Lung cancer; Meta analysis; Missing studies; Passive smoking; Publication bias

Indexed keywords

EID: 0442309557     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.2000.10473905     Document Type: Article

References (36)

1. Begg, C. B. (1994), “Publication Bias,” in The Handbook of Research Synthesis, eds. H Cooper and L. V. Hedges, New York: Russell Sage Foundation, pp. 399-409.
2. Begg, C. B., and Mazumdar, M. (1994), “Operating Characteristics of a Rank Correlation Test for Publication Bias,” Biometrics, 50, 1088-1101.
3. Biggerstaff, B. J., and Tweedie, R. L. (1997), “Incorporating Variability in Estimates of Heterogeneity in the Random-Effects Model in Meta-Analysis," Statistics in Medicine, 16, 753-768.
4. British Medical Journal Editorial Staff (1983), 'The Editor Regrets.,.” (editorial), British Medical Journal, 280, 508.
5. Casella, G., and Berger, R. L. (1990), Statistical Inference, Belmont, CA: Duxbury.
6. Cooper, H. (1998), Synthesizing Research, Thousand Oaks, CA: Sage.
7. Cooper, H., and Hedges, L. V. (Eds.) (1994), The Handbook of Research Synthesis, New York: Russell Sage Foundation.
8. Dear, K., and Begg, C. (1992), "An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis,” Statistical Science, 7, 237-245.
9. Dear, K., and Dobson, A. (1997), Comment on “Publication Bias in Meta-Analysis: A Bayesian Data-Augmentation Approach to Account for Issues Exemplified in the Passive Smoking Debate" by G. H. Givens, D. D. Smith, and R. L. Tweedie, Statistical Science, 12, 245-246.
10. DerSimonian, R., and Laird, N. M. (1986), “Meta-Analysis in Clinical Trials,” Controlled Clinical Trials, 7, 177-188.
11. Dickersin, K., Min, Y., and Meinert, C. (1992). “Factors Influencing Publication of Research Results,” Journal of the American Medical Association, 267, 374-378.
12. DuMouchel, W., and Harris, J. (1997), Comment on “Publication Bias in Meta-Analysis: A Bayesian Data-Augmentation Approach to Account for Issues Exemplified in the Passive Smoking Debate" by G. H. Givens. D. D. Smith, and R. L. Tweedie, Statistical Science, 12, 244-245.
13. Duval, S. J., (1999), “Effects of Publication Bias in Meta-Analysis.” doctoral dissertation. University of Colorado Health Sciences Center. Dept, of Preventive Medicine and Biometrics.
14. Duval, S. J., and Tweedie, R. L. (2000), “Trim and Fill: A Simple Funnel Plot-Based Method of Testing and Adjusting for Publication Bias in Meta-Analysis," Biometrics, 56, 276-284.
15. Duval, S. J., and Tweedie, R. L. “Robustness of the Trim and Fill’ publication bias approach to different mechanisms for study suppression," (in preparation).
16. Easterbrook, P., Berlin, J., Gopalan, R., and Matthews, D. (1991), "Publication Bias in Clinical Research," Lancet, 337, 867-872.
17. Eberly, L. E., and Casella, G. (1999), "Estimating the Number of Unseen Studies in a Meta-Analysis,” Journal of Official Statistics, 15 (in press).
18. Egger, M., Smith, G. D., Schneider, M., and Minder, C. (1997), "Bias in Meta-Analysis Detected by a Simple Graphical Test," British Medical Journal, 315, 629-634.
19. Galbraith, R. (1988). “A Note on the Graphical Presentation of Estimated Odds Ratios From Several Clinical Trials," Statistics in Medicine, 7, 889-894.
20. Givens, G. H., Smith, D. D., and Tweedie, R. L. (1997), “Publication Bias in Meta-Analysis: A Bayesian Data-Augmentation Approach to Account for Issues Exemplified in the Passive Smoking Debate" (with discussion), Statistical Science, 12. 221-250.
21. Gleser, L. J., and Olkin, I. (1996), "Models for Estimating the Number of Unpublished Studies," Statistics in Medicine, 15, 2493-2507.
22. Hedges, L. (1992), “Modeling Publication Selection Effects in Meta-Analysis,” Statistical Science, 7, 227-236.
23. Hedges, L., and Olkin, I. (1985), Statistical Methods for Meta-Analysis, New York: Academic Press.
24. Iyengar, S., and Greenhouse, J. B. (1988), “Selection Models and the File Drawer Problem" (with discussion). Statistical Science, 3, 109-135.
25. Lee, P. N. (1992), Environmental Tobacco Smoke and Mortality, Basel: Karger.
26. Light, R., and Pillemer, D. (1984), Summing Up: the Science of Reviewing Research, Cambridge, MA: Harvard University Press.
27. Marascuilo, L. A., and McSwecney, M. (1977), Nonparametric and Distribution-Free Methods for the Social Sciences, Monterey, CA: Brooks/Cole.
28. Mcngcrsen, K., Tweedie, R., and Biggerstaff, B. (1995), ‘The Impact of Method Choice in Meta-Analysis.” Australian Journal of Statistics, 37, 19-44.
29. Misakian, A. L., and Bero, L. A. (1998), “Publication Bias and Research on Passive Smoking: Comparison of Published and Unpublished Studies,” Journal of the American Medical Association. 280, 250-253.
30. NRC Committee on Applied and Theoretical Statistics (1992), Combining Information: Statistical Issues and Opportunities for Research. Washington, DC: National Academy Press.
31. Olkin, I. (1992), “Meta-Analysis: Methods for Combining Independent Studies,” Statistical Science, 7, 226.
32. Smith, D. J., Givens, G. H., and Tweedie, R. L. (1999), “Adjusting for Publication and Quality Bias in Bayesian Meta-Analysis," in Meta-Analysis in Medicine and Health Policy, eds, D. A. Berry and D. K. Stangl, New York: Marcel Dckkcr.
33. Sugita, M., Kanamori, M., Izuno, T., and Miyakawa, M. (1992), “Estimating a Summarized Odds Ratio Whilst Eliminating Publication Bias in Meta-Analysis," Japanese Journal of Clinical Oncology, 22, 354-358.
34. Sugita, M., Yamaguchi, N., Izuno, T., Kanamori, M., and Kasuga, H. (1994), “Publication Probability of a Study on Odds Ratio Value: Circumstantial Evidence for Publication Bias in Medical Study Areas.” Tokai Journal of Experimental and Clinical Medicine, 19, 29-37.
35. Sutton, A. J., Duval, S. J., Tweedie, R. L., Abrams, K. R., and Jones, D. R. (1999), “The Impact of Publication Bias on Meta-Analyses Within the Cochrane Database of Systematic Reviews,” (submitted for publication).
36. Tweedie, R. L., Scott, D. S., Biggerstaff, B. J., and Mengersen, K. L. (1996), "Bayesian Meta-Analysis, With Application to Studies of ETS and Lung Cancer," Lung Cancer, 14, S171-S194.