Homogeneity tests in meta-analysis: A Monte Carlo comparison of statistical power and type I error

Quality and Quantity

Volumn 31, Issue 4, 1997, Pages 385-399

  Sánchez Meca, Julio ^a   Marín Martínez, Fulgencio ^a  

^a UNIVERSITY OF MURCIA   (Spain)

Author keywords

Effect size; Meta analysis; Monte Carlo

Indexed keywords

EID: 0040052051     PISSN: 00335177     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1004298118485     Document Type: Article

References (27)

1. Alexander, R. A., Scozzaro, M. J. & Borodkin, L. J. (1989). Statistical and empirical examination of the chi-square test for homogeneity of correlations in meta-analysis, Psychological Bulletin 106: 329-331.
2. Bangert-Drowns, R. L. (1986). Review of developments in meta-analytic method, Psychological Bulletin 99: 388-399.
3. Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd edn). Hillsdale, NJ: Erlbaum.
4. Cooper, H. M. (1989). Integrating Research: A Guide for Literature Reviews (2nd edn). Beverly Hills, CA: Russell Sage Foundation.
5. Cooper, H. M. & Hedges, L. V. (eds) (1994). The Handbook of Research Synthesis. New York: Russell Sage Foundation.
6. Cornwell, J. M. (1993). Monte Carlo comparisons of three tests for homogeneity of independent correlations, Educational and Psychological Measurement 53: 605-618.
7. Cornwell, J. M. & Ladd, R. T. (1993). Power and accuracy of the Schmidt and Hunter meta-analytic procedures, Educational and Psychological Measurement 53: 877-895.
8. GAUSS (1992). The GAUSS System (Vers. 3.0). Washington: Aptech Systems, Inc.
9. Glass, G. V., McGaw, B. & Smith, M. L. (1981). Meta-Analysis in Social Research. Beverly Hills, CA: Russell Sage Foundation.
10. Hall, J. A. & Rosenthal, R. (1991). Testing for moderator variables in meta-analysis: issues and methods, Communication Monographs 58: 437-448.
11. Hedges, L. V. (1981). Distribution theory for Glass's estimator of effect size and related estimators, Journal of Educational Statistics 6: 107-128.
12. Hedges, L. V. (1982). Fitting categorial models to effect sizes from a series of experiments, Journal of Educational Statistics 7: 119-137.
13. Hedges, L. V. (1994). Fixed effects models, pp. 285-299 in H. M. Cooper & L. V. Hedges (eds), The Handbook of Research Synthesis. New York: Russell Sage Foundation.
14. Hedges, L. V. & Olkin, I. (1985). Statistical Methods for Meta-Analysis. New York: Academic Press.
15. Hunter, J. E. & Schmidt, F. L. (1990). Methods of Meta-Analysis: Correcting Error and Bias in Research Findings. Beverly Hills, CA: Russell Sage Foundation.
16. Johnson, B. T. (1993). DSTAT 1.10: Software for the Meta-Analytic Review of Research Literatures [manual]. Hillsdale, NJ: Erlbaum.
17. Johnson, B. T. & Turco, R. M. (1993). The value of goodness-of-fit indices in meta-analysis: a comment on Hall and Rosenthal, Communication Monographs 59: 388-396.
18. Johnson, B. T. Mullen, B. & Salas, E. (1995). Comparison of three major meta-analytic approaches, Journal of Applied Psychology 80: 94-106.
19. Koslowsky, M. & Sagie, A. (1994). Components of artifactual variance in meta-analytic research, Personnel Psychology 47: 561-574.
20. Osburn, H. G., Callender, J. C., Greener, J. M. & Ashworth, S. (1983). Statistical power of tests of the situational specificity hypothesis in validity generalization studies: a cautionary note, Journal of Applied Psychology 68: 115-122.
21. Rosenthal, R. (1991). Meta-Analytic Procedures for Social Research (revised edn). Newbury Park, CA: Russell Sage Foundation.
22. Rosenthal, R. (1994). Parametric measures of effect size, pp. 231-244 in H. M. Cooper & L. V. Hedges (eds), The Handbook of Research Synthesis. New York: Russell Sage Foundation.
23. Sackett, P. R., Harris, M. M. & Orr, J. M. (1986). On seeking moderator variables in the meta-analysis of correlational data: a Monte Carlo investigation of statistical power and resistance to Type I error, Journal of Applied Psychology 71: 302-310.
24. Sagie, A. & Koslowsky, M. (1993). Detecting moderators with meta-analysis: an evaluation and comparison of techniques, Personnel Psychology 46: 629-640.
25. Sánchez-Meca, J. & Ato, M. (1989). Meta-análisis: una alternativa metodologica a las revisiones tradicionales de la investigación [Meta-analysis: a methodological alternative to traditional research reviews], pp. 617-669 in J. Arnau & H. Carpintero (eds), Tratado de Psicología General. I: Historia, Teoría y Método. Madrid: Alhambra.
26. Shadish, W. R. & Haddock, C. K. (1994). Combining estimates of effect size, pp. 261-281 in H. M. Cooper & L. V. Hedges (eds), The Handbook of Research Synthesis. New York: Russell Sage Foundation.
27. Spector, P. E. & Levine, E. L. (1987). Meta-analysis for integrating study outcomes: a Monte Carlo study of its susceptibility to Type I and Type II errors. Journal of Applied Psychology 72: 3-9.