Estimating Effect Size under Publication Bias: Small Sample Properties and Robustness of a Random Effects Selection Model

Journal of Educational and Behavioral Statistics

Volumn 21, Issue 4, 1996, Pages 299-332

  Hedges, Larry V ^a   Vevea, Jack L ^b  

^a UNIVERSITY OF CHICAGO   (United States)

^b UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

File drawer problem; Meta analysis; Publication bias; Random effects models; Robustness; Selection models

Indexed keywords

EID: 0030356911     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/10769986021004299     Document Type: Article

References (29)

1. Begg, C. B. (1994). Publication bias. In H. M. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 399-409). New York: Russell Sage Foundation.
2. Begg, C. B., & Berlin, J. A. (1988). Publication bias: A problem in interpreting medical data (with discussion). Journal of the Royal Statistical Society, Series A, 151, 419-463.
3. Begg, C. B., & Mazumdar, M. (in press). Operating characteristics of a rank correlation test for publication bias. Biometrics.
4. Bozarth, J. D., & Roberts, R. R. (1972). Signifying significant significance. American Psychologist, 27, 774-775.
5. Cooper, H., & Hedges, L. V. (Eds.). (1994). The handbook of research synthesis. New York: Russell Sage Foundation.
6. Dagpunar, J. (1988). Principles of random variate generation. Oxford, England: Oxford University Press.
7. Dear, K. B. G., & Begg, C. B. (1992). An approach for assessing publication bias prior to performing a meta-analysis. Statistical Science, 7, 237-245.
8. Dickersin, K., & Min, Y-I. (1993). NIH clinical trials and publication bias. Online Journal of Current Clinical Trials [On-line serial]. Available: Doc. No. 50.
9. Dickersin, K., Min, Y-I., & Meinert, C. L. (1991). The fate of controlled trials funded by the NIH in 1979. Controlled Clinical Trials, 12, 634.
10. Dickersin, K., Min, Y-I., & Meinert, C. L. (1992). Factors influencing the publication of research results: Followup of applications submitted to two institutional review boards. Journal of the American Medical Association, 267, 374-378.
11. Easterbrook, P. J., Berlin, J. A., Gopalan, R., & Matthews, D. R. (1991). Publication bias in clinical research. Lancet, 337, 867-872.
12. Hartigan, J. A., & Wigdor, A. K. (1989). Fairness in employment testing: Validity generalization, minority issues and the General Aptitude Test Battery. Washington, DC: National Academy Press.
13. Hedges, L. V. (1984). Estimation of effect size under nonrandom sampling: The effects of censoring studies yielding statistically insignificant mean differences: Journal of Educational Statistics, 9, 61-85.
14. Hedges, L. V. (1992). Modeling publication selection effects in meta-analysis. Statistical Science, 7, 246-255.
15. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. New York: Academic Press.
16. Hunter, J. E., & Schmidt, F. L. (1990). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage.
17. Iyengar, S., & Greenhouse, J. B. (1988). Selection models and the file drawer problem. Statistical Science, 3, 109-135.
18. Kendall, M., & Stuart, A. (1979). The advanced theory of statistics: Vol. 2. Inference and relationship (4th ed.). London: Charles Griffin and Company.
19. Lane, D. M., & Dunlap, W. P. (1978). Estimating effect size: Bias resulting from the significance criterion in editorial decisions. British Journal of Mathematical and Statistical Psychology, 31, 107-112.
20. Light, R. J., & Pillemer, D. B. (1984). Summing up: The science of reviewing research. Cambridge, MA: Harvard University Press.
21. National Research Council. (1992). Combining information: Statistical issues and research opportunities. Washington, DC: National Academy Press.
22. Nelson, N., Rosenthal, R., & Rosnow, R. L. (1986). Interpretation of significance levels by psychological researchers. American Psychologist, 41, 1299-1301.
23. Rao, C. R. (1965). On discrete distributions arising out of methods of ascertainment. Sankhyā, Series A, 27, 311-324.
24. Rao, C. R. (1985). Weighted distributions arising out of methods of ascertainment: What does a population represent? In A. C. Atkinson & S. E. Feinberg (Eds.), A celebration of statistics: The ISI centenary volume (pp. 543-569). New York: Springer.
25. Rosenthal, R., & Gaito, J. (1963). The interpretation of levels of significance by psychological researchers. Journal of Psychology, 55, 33-38.
26. Rosenthal, R., & Gaito, J. (1964). Further evidence for the cliff effect in the interpretation of levels of significance. Psychological Reports, 15, 570.
27. Sterling, T. C. (1959). Publication decisions and their possible effects on inferences drawn from tests of significance or vice versa. Journal of the American Statistical Association, 54, 30-34.
28. Vevea, J. L., Clements, N. C., & Hedges, L. V. (1993). Assessing the effects of selection bias on validity data for the General Aptitude Test Battery. Journal of Applied Psychology, 78, 981-987.
29. Vevea, J. L., & Hedges, L. V. (1995). A general linear model for estimating effect size in the presence of publication bias. Psychometrika, 60, 419-435.