Is the meta-analysis of correlation coefficients accurate when population correlations vary?

Psychological Methods

Volumn 10, Issue 4, 2005, Pages 444-467

  Field, Andy P ^a  

^a UNIVERSITY OF SUSSEX   (United Kingdom)

Author keywords

Correlation coefficients; Meta analysis; Random effects model

Indexed keywords

ARTICLE; HUMAN; META ANALYSIS; METHODOLOGY; POPULATION DYNAMICS; PSYCHOLOGICAL MODEL; PSYCHOLOGY; STATISTICS;

HUMANS; META-ANALYSIS; MODELS, PSYCHOLOGICAL; POPULATION DYNAMICS; PSYCHOLOGY, EXPERIMENTAL; STATISTICS;

EID: 30544435423     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.10.4.444     Document Type: Article

References (38)

1. Barrick, M. R., & Mount, M. K. (1991). The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26.
2. Becker, B. J. (1996). The generalizability of empirical research results. In C. P. Benbow and D. Lubinski (Eds.), Intellectual talent: Psychological and social issues (pp. 363-383). Baltimore, MD: Johns Hopkins University Press.
3. Cohen, J. (1988). Statistical power analysis for the behavioural sciences (2nd ed.). New York: Academic Press.
4. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.
5. Field, A. P. (2001). Meta-analysis of correlation coefficients: A Monte Carlo comparison of fixed- and random-effects methods. Psychological Methods, 6, 161-180.
6. Field, A. P. (2003a). Can meta-analysis be trusted? The Psychologist, 16, 642-645.
7. Field, A. P. (2003b). The problems in using fixed-effects models of meta-analysis on real-world data. Understanding Statistics, 2, 77-96.
8. Field, A. P. (2005). Discovering statistics using SPSS (2nd ed.). London: Sage.
9. Fisher, R. A. (1921). On the probable error of a coefficient of correlation deduced from a small sample. Metron, 1, 3-32.
10. Friedman, L. (2000). Estimators of random effects variance components in meta-analysis. Journal of Educational and Behavioural Statistics, 25, 1-12.
11. GAUSS for Windows 4.0 [Computer software]. (1984). Maple Valley, WA: Aptech Systems.
12. Glass, G. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5, 3-8.
13. Hall, S. M., & Brannick, M. T. (2002). Comparison of two random-effects methods of meta-analysis. Journal of Applied Psychology, 87, 377-389.
14. Hedges, L. V. (1992). Meta-analysis. Journal of Educational Statistics, 17, 279-296.
15. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.
16. Hedges, L. V., & Pigott, T. D. (2001). The power of statistical tests in meta-analysis. Psychological Methods, 6, 203-217.
17. Hedges, L. V., & Vevea, J. L. (1998). Fixed- and random-effects models in meta-analysis. Psychological Methods, 3, 486-504.
18. Hunter, J. E., & Schmidt, F. L. (1990a). Dichotomization of continuous variables: The implications for meta-analysis. Journal of Applied Psychology, 75, 334-349.
19. Hunter, J. E., & Schmidt, F. L. (1990b). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage.
20. Hunter, J. E., & Schmidt, F. L. (2000). Fixed effects vs. random effects meta-analysis models: Implications for cumulative knowledge in psychology. International Journal of Selection and Assessment, 8, 275-292.
21. Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Newbury Park, CA: Sage.
22. Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1982). Meta-analysis: Cumulating research findings across studies. Beverly Hills, CA: Sage.
23. Johnson, B. T., Mullen, B., & Salas, E. (1995). Comparison of three major meta-analytic approaches. Journal of Applied Psychology, 80, 94-106.
24. Mooney, C. Z. (1997). Monte Carlo simulation (Sage University Paper series on Quantitative Applications in the Social Sciences, Series No. 07-116). Thousand Oaks, CA: Sage.
25. National Research Council. (1992). Combining information: Statistical issues and opportunities for research. Washington, DC: National Academy Press.
26. Osburn, H. G., & Callender, J. (1992). A note on the sampling variance of the mean uncorrected correlation in meta-analysis and validity generalization. Journal of Applied Psychology, 77, 115-122.
27. Overton, R. C. (1998). A comparison of fixed-effects and mixed (random-effects) models for meta-analysis tests of moderator variable effects. Psychological Methods, 3, 354-379.
28. Rosenthal, R. (1991). Meta-analytic procedures for social research (rev.). Newbury Park, CA: Sage.
29. Rosenthal, R., & Rubin, D. (1978). Interpersonal expectancy effects: The first 345 studies. Behavior and Brain Sciences, 3, 377-415.
30. Sackett, P. R., Harris, M. M., & Orr, J. M. (1986). On seeking moderator variables in the meta-analysis of correlational data: A Monte Carlo investigation of statistical power and resistance to Type I error. Journal of Applied Psychology, 71, 302-310.
31. Schmidt, F. L., & Hunter, J. E. (1977). Development of a general solution to the problem of validity generalization. Journal of Applied Psychology, 62, 529-540.
32. Schmidt, F. L., & Hunter, J. E. (1999). Comparison of three meta-analysis methods revisited: An analysis of Johnson, Mullen, and Salas (1995). Journal of Applied Psychology, 84(1), 144-148.
33. Schmidt, F. L., Hunter, J. E., & Urry, V. W. (1976). Statistical power in criterion-related validation studies. Journal of Applied Psychology, 61, 473-485.
34. Schulze, R. (2004). Meta-analysis: A comparison of approaches. Cambridge, MA: Hogrefe & Huber.
35. Silver, N. C., & Dunlap, W. P. (1987). Averaging correlation coefficients: Should Fisher's Z transformation be used? Journal of Applied Psychology, 72, 146-148.
36. Strube, M. J. (1988). Averaging correlation coefficients: Influence of heterogeneity and set size. Journal of Applied Psychology, 73, 559-568.
37. Takkouche, B., Cadarso-Suarez, C., & Spiegelman, D. (1999). Evaluation of old and new tests of heterogeneity in epidemiologic meta-analysis. American Journal of Epidemiology, 150, 206-215.
38. Wolf, F. M. (1986). Meta-analysis. Sage university paper series on quantitative applications in the social sciences, 07-061. Newbury Park, CA: Sage.