Combining correlation matrices: Simulation analysis of improved fixed-effects methods

Journal of Educational and Behavioral Statistics

Volumn 32, Issue 2, 2007, Pages 180-205

  Hafdahl, Adam R ^a,b  

^a UNIVERSITY OF MISSOURI   (United States)

^b WASHINGTON UNIVERSITY   (United States)

Author keywords

Correlation; Generalized least squares; Meta analysis; Monte Carlo study

Indexed keywords

EID: 34250155265     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/1076998606298041     Document Type: Article

References (47)

1. Alexander, R. A., Scozzaro, M. J., & Borodkin, L. J. (1989). Statistical and empirical examination of the chi-square test for homogeneity of correlations in meta-analysis. Psychological Bulletin, 106, 329-331.
2. Becker, B. J. (1992a, April). Missing data and the synthesis of correlation matrices. Paper presented at the meeting of the American Educational Research Association, San Francisco, CA.
3. Becker, B. J. (1992b). Using results from replicated studies to estimate linear models. Journal of Educational Statistics, 17, 341-362.
4. Becker, B. J. (1995). Corrections to "Using results from replicated studies to estimate linear models." Journal of Educational and Behavioral Statistics, 20, 100-102.
5. Becker, B. J. (2000). Multivariate meta-analysis. In H. E. A. Tinsley & S. D. Brown (Eds.), Handbook of applied multivariate statistics and mathematical modeling (pp. 499-525). San Diego, CA: Academic Press.
6. Becker, B. J., & Fahrbach (1994, April). A comparison of approaches to the synthesis of correlation matrices. Paper presented at the meeting of the American Educational Research Association, New Orleans, LA.
7. Becker, B. J., & Schram, C. M. (1994). Examining explanatory models through research synthesis. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 357-381). New York: Russell Sage Foundation.
8. Brown, S. A., & Hedges, L. V. (1994). Predicting metabolic control in diabetes: A pilot study using meta-analysis to estimate a linear model. Nursing Research, 43, 362-368.
9. Burke, M. J. (1984). Validity generalization: A review and critique of the correlation model. Personnel Psychology, 37, 93-115.
10. Cheung, M. W. L., & Chan, W. (2005). Meta-analytic structural equation modeling: A two-stage approach. Psychological Methods, 10, 40-64.
11. Cheung, S. F. (2000). Examining solutions to two practical issues in meta-analysis: Dependent correlations and missing data in correlation matrices. Dissertation Abstracts International, 67(08), 4469B. (UMI No. AAI9984691)
12. Cooper, H. M., & Hedges, L. V. (Eds.). (1994). The handbook of research synthesis. New York: Russell Sage Foundation.
13. Cornwell, J. M., & Ladd, R. T. (1993). Power and accuracy of the Schmidt and Hunter meta-analytic procedures. Educational and Psychological Measurement, 53, 877-895.
14. Emmers-Sommer, T. M., & Allen, M. (1999). Variables related to sexual coercion: A path model. Journal of Social and Personal Relationships, 16, 659-678.
15. Furlow, C. F., & Beretvas, S. N. (2005). Meta-analytic methods of pooling correlation matrices for structural equation modeling under different patterns of missing data. Psychological Methods, 10, 227-254.
16. Gleser, L. J., & Olkin, I. (1994). Stochastically dependent effect sizes. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 339-355). New York: Russell Sage Foundation.
17. Grube, B. S., Bilder, R. M., & Goldman, R. S. (1998). Meta-analysis of symptom factors in schizophrenia. Schizophrenia Research, 31, 113-120.
18. Hafdahl, A. R. (2001). Multivariate meta-analysis for exploratory factor analytic research (doctoral dissertation, the University of North Carolina at Chapel Hill, 2001). Dissertation Abstracts International, 62(08), 3843B.
19. Hafdahl, A. R. (2004, June). Refinements for random-effects meta-analysis of correlation matrices. Paper presented at the meeting of the Psychometric Society, Monterey, CA.
20. Hamilton, M. A. (1998). Message variables that mediate and moderate the effect of equivocal language on source credibility. Journal of Language and Social Psychology, 17, 109-143.
21. Hedges, L. V. (1983). Combining independent estimators in research synthesis. British Journal of Mathematical and Statistical Psychology, 36, 123-131.
22. Hedges, L. V. (1988). The meta-analysis of test validity studies: Some new approaches. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 191-212). Hillsdale, NJ: Lawrence Erlbaum.
23. Hedges, L. V. (1989). An unbiased correction for sampling error in validity generalization studies. Journal of Applied Psychology, 74, 469-477.
24. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. New York: Academic Press.
25. Hedges, L. V., & Vevea, J. L. (1998). Fixed- and random-effects models in metaanalysis. Psychological Methods, 3, 486-504.
26. Higgins, E. T. (1987). Self-discrepancy: A theory relating self and affect. Psychological Review, 94, 319-340.
27. Hunter, J. E., & Schmidt, F. L. (1994). Estimation of sampling error variance in the meta-analysis of correlations: Use of average correlation in the homogeneous case. Journal of Applied Psychology, 79, 171-177.
28. Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks, CA: Sage.
29. James, L. R., Demaree, R. G., & Mulaik, S. A. (1986). A note on validity generalization procedures. Journal of Applied Psychology, 71, 440-450.
30. Kalaian, H. A., & Raudenbush, S. W. (1996). A multivariate mixed linear model for meta-analysis. Psychological Methods, 1, 227-235.
31. Kavale, K. (1982). Meta-analysis of the relationship between visual perceptual skills and reading achievement. Journal of Learning Disabilities, 15, 42-51.
32. Klein, H. J., Wesson, M. J., Hollenbeck, J. R., Wright, P. M., & DeShon, R. P. (2001). The assessment of goal commitment: A measurement model meta-analysis. Organizational Behavior and Human Decision Processes, 85, 32-55.
33. Law, K. S. (1995). The use of Fisher's Z in Schmidt-Hunter-type meta-analyses. Journal of Educational and Behavioral Statistics, 20, 287-306.
34. Law, K. S., Schmidt, F. L., & Hunter, J. E. (1994). A test of two refinements in procedures for meta-analysis. Journal of Applied Psychology, 79, 978-986.
35. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
36. Olkin, I., & Finn, J. (1990). Testing correlated correlations. Psychological Bulletin, 108, 330-333.
37. Olkin, I., & Finn, J. D. (1995). Correlations redux. Psychological Bulletin, 118, 155-164.
38. Olkin, I., & Siotani, M. (1976). Asymptotic distribution of functions of a correlation matrix. In S. Ikeda, T. Hayakawa, H. Hudimoto, M. Okamoto, M. Siotani, & S. Yamamoto (Eds.), Essays in probability and statistics: A volume in honor of Professor Junjiro Ogawa (pp. 235-251). Wakaba, Tokyo: Shinko Tsusho.
39. Osburn, H. G., & Callender, J. (1992). A note on the sampling variance of the mean unconnected correlation in meta-analysis and validity generalization. Journal of Applied Psychology, 77, 115-122.
40. Roesch, S. C., & Weiner, B. (2001). A meta-analytic review of coping with illness: Do causal attributions matter? Journal of Psychosomatic Research, 50, 205-219.
41. Schmidt, F. L., Hunter, J. E., & Raju, N. S. (1988). Validity generalization and situational specificity: A second look at the 75% rule and Fisher's z transformation. Journal of Applied Psychology, 73, 665-672.
42. Shadish, W. R. (1996). Meta-analysis and the exploration of causal mediating processes: A primer of examples, methods, and issues. Psychological Methods, 1, 47-65.
43. Shadish, W. R., & Haddock, C. K. (1994). Combining estimates of effect size. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 261-281). New York: Russell Sage Foundation.
44. Silver, N. C., & Dunlap, W. P. (1987). Averaging correlation coefficients: Should Fisher's z transformation be used? Journal of Applied Psychology, 72, 146-148.
45. Steiger, J. H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245-251.
46. Viana, M. A. (1993). On a criterion for combining correlational data. Journal of Educational Statistics, 18, 261-270.
47. Viswesvaran, C., & Ones, D. S. (1995). Theory testing: Combining psychometric meta-analysis and structural equations modeling. Personnel Psychology, 48, 865-885.