Apples and Oranges (and Pears, Oh My!): The Search for Moderators in Meta-Analysis

Organizational Research Methods

Volumn 6, Issue 4, 2003, Pages 415-439

  Cortina, Jose M ^a  

^a GEORGE MASON UNIVERSITY   (United States)

Author keywords

Meta analysis; Moderators; Review; Second order meta analysis

Indexed keywords

EID: 0141989803     PISSN: 10944281     EISSN: None     Source Type: Journal    
DOI: 10.1177/1094428103257358     Document Type: Review

References (49)

1. Aguinis, H., & Whitehead, R. (1997). Sampling variance of the correlation coefficient under indirect range restriction: Implications for validity generalization. Journal of Applied Psychology, 82, 528-538.
2. Beal, D. J., Corey, D. M., & Dunlap, W. P. (2002). On the bias of Huffcutt and Arthur's (1995) procedure for identifying outliers in the meta-analysis of correlations. Journal of Applied Psychology, 87, 583-589.
3. Bentler, P. M., & Bonnet, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588-606.
4. Callender, J. C., & Osburn, H. C. (1981). Testing the constancy of validity with computer generated sampling distributions of the multiplicative model variance estimate: Results for petroleum industry validation research. Journal of Applied Psychology, 66, 274-281.
5. Cattell, R. B., & Vogelmann, S. (1977). A comprehensive trial of the scree and HG criteria for determining the number of factors. Multivariate Behavioral Research, 12, 289-325.
6. Cortina, J. M., & Dunlap, W. P. (1997). On the logic and purpose of significance testing. Psychological Methods, 2, 161-172.
7. Cortina, J. M., & Folger, R. G. (1998). When is it acceptable to accept the null hypothesis: No way, Jose? Organizational Research Methods, 1, 334-350.
8. Cortina, J. M., & Gully, S. M. (1999). So the great dragon was cast out ... who deceives the whole world. Newsletter of the Research Methods Division of the Academy of Management, 14(1).
9. Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272-299.
10. Gerstner, C. R., & Day, D. V. (1997). Meta-analytic review of leader-member exchange theory: Correlates and construct issues. Journal of Applied Psychology, 82, 827-844.
11. Guttman, L. (1954). Some necessary conditions for common factor analysis. Psychometrika, 19, 149-162.
12. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. New York: Academic Press.
13. Huber, P. (1981). Robust statistics. New York: John Wiley.
14. Huffcutt, A. I., & Arthur, W. (1995). Development of a new outlier statistic for meta-analytic data. Journal of Applied Psychology, 80, 327-333.
15. Huffcutt, A. I., Roth, P. L., & McDaniel, M. A. (1996). A meta-analytic investigation of cognitive ability in employment interview evaluations: Moderating characteristics and implications for incremental validity. Journal of Applied Psychology, 81, 459-473.
16. Hunter, J. E., & Schmidt, F. L. (1990). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage.
17. Hunter, J. E., & Schmidt, F. L. (1994). Estimation of sampling error variance in the meta-analysis of correlations: Use of average correlation in the homogenous case. Journal of Applied Psychology, 79, 171-177.
18. James, L. R., Demaree, R. J., & Mulaik, S. A. (1986). A note on validity generalization procedures. Journal of Applied Psychology, 71, 440-450.
19. James, L. R., Demaree, R. J., Mulaik, S. A., & Ladd, R. T. (1992). Validity generalization in the context of situational models. Journal of Applied Psychology, 77, 3-14.
20. James, L. R., Demaree, R. J., Mulaik, S. A., & Mumford, M. D. (1988). Validity generalization: A rejoinder to Schmidt, Hunter, & Raju, 1988. Journal of Applied Psychology, 73, 673-678.
21. Johnson, B. T., Mullen, M., & Salas, E. (1995). Comparison of three major meta-analytic approaches. Journal of Applied Psychology, 80, 94-106.
22. Kaiser, H. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20, 141-151.
23. Kemery, E. R., Mossholder, K. W., & Roth, L. (1987). The power of the Schmidt and Hunter additive model of validity generalization. Journal of Applied Psychology, 72, 30-37.
24. Kozlowsky, M., Sagie, A., Krausz, M., & Singer, A. D. (1997). Correlates of employee lateness: Some theoretical considerations. Journal of Applied Psychology, 82, 79-88.
25. Law, K. S., Schmidt, F. L., & Hunter, J. E. (1994a). Nonlinearity of range corrections in meta-analysis: Test of an improved procedure. Journal of Applied Psychology, 79, 425-438.
26. Law, K. S., Schmidt, F. L., & Hunter, J. E. (1994b). A test of two refinements for procedures in meta-analysis. Journal of Applied Psychology, 79, 978-986.
27. Marascuilo, L. A. (1971). Statistical methods for behavioral science research. New York: McGraw-Hill.
28. Mulaik, S. A., James, L. R., Van Alstine, J., Bennett, N., Lind, S., & Stillwell, C. D. (1989). Evaluation of goodness of fit indices for structural equation models. Psychological Bulletin, 105, 430-445.
29. Ones, D. S., Viswesvaran, C., & Reiss, A. D. (1996). Role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology, 81, 660-679.
30. Orwin, R. G., & Cordray, D. S. (1985). Effects of deficient reporting on meta-analysis: A conceptual framework and reanalysis. Psychological Bulletin, 97, 134-147.
31. Osburn, H. C., Callender, J. C., Greener, J. M., & Ashworth, S. (1983). Statistical power of tests of the situational specificity hypothesis in validity generalization studies: A cautionary note. Journal of Applied Psychology, 68, 115-122.
32. Pearlman, K., Schmidt, F. L., & Hunter, J. E. (1980). Validity generalization results for tests of used to predict job proficiency and training success in clerical occupations. Journal of Applied Psychology, 65, 373-406.
33. Podsakoff, P. M., MacKenzie, S. B., & Bommer, W. H. (1996). Meta-analysis of the relationships between Kerr and Jermier's substitutes for leadership and employee job attitudes, role perceptions, and performance. Journal of Applied Psychology, 81, 380-399.
34. Raju, N. S., & Burke, M. J. (1983). Two new procedures for studying validity generalization. Journal of Applied Psychology, 68, 382-395.
35. Raju, N. S., Pappas, S., & Williams, C. P. (1989). An empirical Monte Carlo test of the accuracy of the correlation, covariance, and regression slope models for assessing validity generalization. Journal of Applied Psychology, 74, 901-911.
36. Sackett, P. R., Harris, M. M., & Orr, J. M. (1987). On seeking moderator variables in the meta-analysis of correlation data: A Monte Carlo investigation of statistical power and resistance to Type I error. Journal of Applied Psychology, 71, 302-310.
37. Salgado, J. F. (1997). The five factor model of personality and job performance in the European community, Journal of Applied Psychology, 82, 30-43.
38. Schmidt, F. L., & Hunter, J. E. (1977). Development of a general solution to the problem of validity generalization. Journal of Applied Psychology, 62, 529-540.
39. Schmidt, F. L., Hunter, J. E., & Caplan, J. R. (1981). Validity generalization results for two job groups in the petroleum industry. Journal of Applied Psychology, 66, 261-273.
40. Slavin, R. E. (1984). Meta-analysis in education: How has it been used? Educational Researcher, 13, 6-15.
41. Society for Industrial and Organizational Psychology. (2000). 16th Annual Conference call for proposals. Bowling Green, OH: Author.
42. Spector, P. E., & Levine, E. L. (1987). Meta-analysis for integrating study outcomes: A Monte Carlo study of its susceptibility to Type I and Type II errors. Journal of Applied Psychology, 72, 3-9.
43. Steel, P. D., & Kammeyer-Mueller (2002). Comparing meta-analytic moderator estimation techniques under realistic conditions. Journal of Applied Psychology, 87, 96-111.
44. Switzer, F. S., Paese, P. W., & Drasgow, F. (1992). Bootstrap estimates of standard errors in validity generalization research. Journal of Applied Psychology, 77, 123-129.
45. van Eerde, W., & Thierry, H. (1996). Vroom's expectancy model and work-related criteria: A meta-analysis. Journal of Applied Psychology, 81, 575-586.
46. Wanous, J. P., Sullivan, S. E., & Malinak, J. (1989). The role of judgment calls in meta-analysis. Journal of Applied Psychology, 74, 259-264.
47. Whitener, E. M. (1990). Confusion of confidence intervals and credibility intervals in meta-analysis. Journal of Applied Psychology, 75, 315-321.
48. Wilcox, R. R. (1997). How many discoveries have been lost by ignoring modern statistical methods? American Psychologist, 53, 300-314.
49. Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99, 432-442.