The file-drawer problem revisited: A general weighted method for calculating fail-safe numbers in meta-analysis

Evolution

Volumn 59, Issue 2, 2005, Pages 464-468

  Rosenberg, Michael S ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

Author keywords

Fail safe numbers; File drawer problem; Meta analysis; Publication bias; Statistical methods

Indexed keywords

META-ANALYSIS; SAMPLING BIAS; STATISTICAL ANALYSIS;

EID: 14844346281     PISSN: 00143820     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.0014-3820.2005.tb01004.x     Document Type: Article

References (34)

1. Arnqvist, G., and T. Nilsson. 2000. The evolution of polyandry: multiple mating and female fitness in insects. Anim. Behav. 60:145-164.
2. Begg, C. B. 1985. A measure to aid in the interpretation of published clinical trials. Stat. Med. 4:1-9.
3. _. 1994. Publication bias. Pp. 399-409 in H. Cooper and L. V. Hedges, eds. The handbook of research synthesis. Russell Sage Foundation, New York.
4. Begg, C. B., and J. A. Berlin. 1988. Publication bias: a problem in interpreting medical data. J. R. Stat. Soc. A 151:419-463.
5. Begg, C. B., and M. Mazumdar. 1994. Operating characteristics of a rank correlation test for publication bias. Biometrics 50:1088-1101.
6. Cohen, J. 1969. Statistical power analysis for the behavioral sciences. Academic Press, New York.
7. Coltman, D. W., and J. Slate. 2003. Microsatellite measures of inbreeding: a meta-analysis. Evolution 57:971-983.
8. Crnokrak, P., and S. C. H. Barrett. 2002. Perspective: Purging the genetic load: a review of the experimental evidence. Evolution 56:2347-2358.
9. Duval, S., and R. Tweedie. 2000a. A non-parametric "trim and fill" method of assessing publication bias in meta-analysis. J. Am. Stat. Assoc. 95:89-98.
10. _. 2000b. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 56:455-463.
11. Garamszegi, L. Z., and A. P. Møller. 2004. Extrapair paternity and the evolution of bird song. Beha. Ecol. 15:508-519.
12. Greenland, S. 1994. A critical look at some popular meta-analytic methods. Am. J. Epidemiol. 140:290-296.
13. Gurevitch, J., and L. V. Hedges. 1993. Meta-analysis: combining the results of independent experiments. Pp. 378-398 in S. M. Scheiner and J. Gurevitch, eds. Design and analysis of ecological experiments. Chapman and Hall, New York.
14. Hedges, L. V. 1992. Modeling publication selection effects in meta-analysis. Stat. Sci. 7:246-255.
15. Hedges, L. V., and I. Olkin. 1985. Statistical methods for meta-analysis. Academic Press, San Diego, CA.
16. Hedges, L. V., and J. L. Vevea. 1996. Estimating effect size under publication bias: small sample properties and robustness of a random effects selection model. J. Educ. Behav. Stat. 21:299-332.
17. _. 1998. Fixed- and random-effects models in meta-analysis. Psychol. Methods 3:486-504.
18. Jennions, M. D., and A. P. Møller. 2002a. Publication bias in ecology and evolution: an empirical assessment using the 'trim and fill' method. Biol. Rev. 77:211-222.
19. _. 2002b. Relationships fade with time: a meta-analysis of temporal trends in publication in ecology and evolution. Proc. R. Soc. Lond. B 269:43-48.
20. L'Abbé, K. A., A. S. Detsky, and K. O'Rourke. 1987. Meta-analysis in clinical research. Ann. Internal Med. 107:224-233.
21. Møller, A. P., and M. D. Jennions. 2001. Testing and adjusting for publication bias. Trends Ecol. Evol. 16:580-586.
22. _. 2002. How much variance can be explained by ecologists and evolutionary biologists? Oecologia 132:492-500.
23. Møller, A. P., and R. Thornhill. 1997. A meta-analysis of the heritability of developmental stability. J. Evol. Biol. 10:1-16.
24. _. 1998. Bilateral symmetry and sexual-selection: a meta-analysis. Am. Nat. 151:174-192.
25. Orwin, R. G. 1983. A fail-safe N for effect size in meta-analysis. J. Educ. Stat. 8:157-159.
26. Overton, R. C. 1998. A comparison of fixed-effects and mixed (random-effects) models for meta-analysis tests of moderator variable effects. Psychol. Methods 3:354-379.
27. Palmer, A. R. 1999. Detecting publication bias in meta-analysyes: a case study of fluctuating asymmetry and sexual selection. Am. Nat. 154:220-233.
28. Raudenbush, S. W. 1994. Random effects models. Pp. 301-321 in H. Cooper and L. V. Hedges, eds. The handbook of research synthesis. Russell Sage Foundation, New York.
29. Reed, D. H., and R. Frankham. 2001. How closely correlated are molecular and quantitative measures of genetic variation? A meta-analysis. Evolution 55:1095-1103.
30. Rosenberg, M. S., D. C. Adams, and J. Gurevitch. 2000. MetaWin: statistical software for meta-analysis. Sinauer Associates, Sunderland, MA.
31. Rosenthal, R. 1979. The "file drawer problem" and tolerance for null results. Psychol. Bull. 86:638-641.
32. _. 1991. Meta-analytic procedures for social research. Sage, Newbury Park, CA.
33. Vander Werf, E. 1992. Lack's clutch size hypothesis: an examination of the evidence using meta-analysis. Ecology 73:1699-1705.
34. Wang, M. C., and B. J. Bushman. 1998. Using the normal quantile plot to explore meta-analytic data sets. Psychol. Methods 3:46-54.