Fixed Effects vs. Random Effects Meta-Analysis Models: Implications for Cumulative Research Knowledge

International Journal of Selection and Assessment

Volumn 8, Issue 4, 2000, Pages 275-292

  Hunter, John E ^b   Schmidt, Frank L ^a  

^a UNIVERSITY OF IOWA   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0034559950     PISSN: 0965075X     EISSN: None     Source Type: Journal    
DOI: 10.1111/1468-2389.00156     Document Type: Article

References (73)

1. Barrick, M.R. and Mount, M.K. (1991) The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26.
2. Becker, B.J. (1987) Applying tests of combined significance in meta-analysis. Psychological Bulletin, 102, 164-71.
3. Becker, B.J. (1988) Synthesizing standardized mean change measures. British Journal of Mathematical and Statistical Psychology, 41, 257-78.
4. Becker, B.J. (1996) The generalizability of empirical research results. In C. P. Benbow and D. Lubinski (eds.), Intellectual Talent: Psychological and Social Issues. Baltimore: Johns Hopkins University Press, 363-83.
5. Bettencourt, B.A. and Miller, N. (1996) Gender differences in aggression as a function of provocation: A meta-analysis. Psychological Bulletin, 119, 422-7.
6. Bond, C.F. and Titus, L.J. (1983) Social facilitation: A meta-analysis of 241 studies. Psychological Bulletin, 94, 265-92.
7. Brown, S.P. (1996) A meta-analysis and review of organizational research. Psychological Bulletin, 120, 235-55.
8. Burt, D. B., Zembar, M.J. and Niederehe, G. (1995) Depression and memory impairment: A meta-analysis of the association, it pattern, and specificity. Psychological Bulletin, 117, 285-303.
9. Callender, J.C. and Osburn, H.G. (1980) Development and test of a new model for validity generalization. Journal of Applied Psychology, 65, 543-58.
10. Cohen, J. (1962) The statistical power of abnormalsocial psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145-53.
11. Cohen, J. (1988) Statistical Power Analysis for the Behavioral Sciences. (2nd edn.) Hillsdale, NJ: Erlbaum.
12. Cohen, J. (1992) Statistical power analysis. Current Directions in Psychological Science, 1, 98-101.
13. Cohen, J. (1994) The earth is flat (p < .05). American Psychologist, 49, 997-1003.
14. Collins, N.L. and Miller, L.C. (1994) Self-disclosure and liking: A meta-analytic review. Psychological Bulletin, 116, 457-75.
15. Cooper, H. (1997) Some finer points in meta-analysis. In M. Hunt (ed.), How Science Takes Stock: The Story of Meta-analysis. New York: Russell Sage Foundation, pp. 169-81.
16. Cooper, H. and Hedges, L.V. (eds.) (1994) The Handbook of Research Synthesis. New York: Russell Sage Foundation.
17. Cowles, M. (1989) Statistics in Psychology: An Historical Perspective. Hillsdale, NJ: Erlbaum.
18. Eagly, A.H. and Carli, L.L. (1981) Sex of researchers and sex-typical communications as determinants of sex differences in influenceability: A meta-analysis of social influence studies. Psychological Bulletin, 90, 1-20.
19. Eagly, A.H. and Johnson, B.T. (1990) Gender and leadership style: A meta-analysis. Psychological Bulletin, 108, 233-56.
20. Eagly, A.H., Karau, S.J. and Makhijani, M.G. (1995) Gender and the effectiveness of leaders: A meta-analysis. Psychological Bulletin, 117, 125-45.
21. Eagly, A.H., Makhijani, M.G. and Klonsky, B.G. (1992) Gender and the evaluation of leaders: A meta-analysis. Psychological Bulletin, 111, 3-22.
22. Erel, O. and Burman, B. (1996) Interrelatedness of marital relations and parent-child relations: A meta-analytic review. Psychological Bulletin, 118, 108-32.
23. Erez, A., Bloom, M.C. and Wells, M.T. (1996) Using random rather than fixed effects models in meta-analysis: Implications for situational specificity and validity generalization. Personnel Psychology, 49, 275-306.
24. Feingold, A. (1994) Gender differences in personality: A meta-analysis. Psychological Bulletin, 116, 429-56.
25. Hedges, L.V. (1983) A random effects model for effect sizes. Psychological Bulletin, 93, 388-95.
26. Hedges, L.V. (1988) The meta-analysis of test validity studies: Some new approaches. In H. Wainer and H. Braun (eds.), Test Validity. Hillsdale, NJ: Erlbaum, pp. 191-212.
27. Hedges, L.V. (1992) Meta-analysis. Journal of Educational Statistics, 17, 279-96.
28. Hedges, L.V. (1994a) Statistical considerations. In H. Cooper and L.V. Hedges (eds.), Handbook of Research Synthesis. New York: Russell Sage Foundation, pp. 29-38.
29. Hedges, L.V. (1994b) Fixed effects models. In H. Cooper and L.V. Hedges (eds.), Handbook of Research Synthesis. New York: Russell Sage Foundation, pp. 285-300.
30. Hedges, L.V. and Olkin, I. (1985) Statistical Methods for Meta-analysis. Orlando, FL: Academic Press.
31. Hedges, L.V. and Vevea, J.L. (1998) Fixed-and random effects models in meta-analysis. Psychological Methods, 3, 486-504.
32. Herbert, T.B. and Cohen, S. (1995) Depression and immunity: A meta-analytic review. Psychological Bulletin, 113, 472-86.
33. Hunter, J.E. (1997) Needed: A ban on the significance test. Psychological Science, 8, 3-7.
34. Hunter, J.E. and Schmidt, F.L. (1990a) Methods of Meta-analysis: Correcting Error and Bias in Research Findings. Beverly Hills, CA: Sage.
35. Hunter, J.E. and Schmidt, F.L. (1990b) Dichotomization of continuous variables: The implications for meta-analysis. Journal of Applied Psychology, 75, 334-49.
36. Hunter, J.E. and Schmidt, F.L. (1996) Cumulative research knowledge and social policy formulation: the critical role of meta-analysis. Psychology, Public Policy and Law, 2, 324-347.
37. Hunter, J.E., Schmidt, F.L. and Jackson, G.B. (1982) Meta-annlysis: Cumulating Research Finding across Studies. Beverly Hills, CA: Sage.
38. Ito, Tiffany A., Miller, N. and Pollock, V.E. (1996) Alcohol and aggression: A meta-analysis of the moderating effects of inhibitory cues, triggering events, and self-focused attention. Psychological Bulletin, 120, 60-82.
39. Jorgensen, R.S., Johnson, B.T., Kolodziej, M.E. and Scheer, G.E. (1996) Elevated blood pressure and personality: A meta-analytic review. Psychological Bulletin, 120, 293-320.
40. Knight, G.P., Fabes, R.A., and Higgins, D.A. (1996) Concerns about drawing causal inferences from meta-analyses: An example in the study of gender differences in aggression. Psychological Bulletin, 119, 410-21.
41. Loftus, G.R. (1996) Psychology will be a much better science when we change the way we analyze data. Current Directions in Psychological Science, 5, 161-71.
42. Mengersen, K.L., Tweedie, R.L. and Biggerstaff, B. (1995) The impact of method choice on meta-analysis. Australian Journal of Statistics, 37, 19-44.
43. Morris, S.B. and DeShon, R.P. (1997) Correcting effect sizes computed from factorial analysis of variance for use in meta-analysis. Psychological Methods, 2, 192-9.
44. Mosteller, F.M. and Bush, R.R. (1954) Selected quantitative techniques. In G. Lindzey (Ed.), Handbook of Social Psychology: Volume I. Theory and Method. Cambridge, MA: Addison-Wesley.
45. National Research Council (1992) Combining Information: Statistical Issues and Opportunities for Research. Washington, DC: National Academy Press.
46. Newcomb, A.F. and Bagwell, C.L. (1995) Children's friendship relations: A meta-analytic review. Psychological Bulletin, 117, 306-47.
47. Osburn, H.G. and Callender, J. (1992) A note on the sampling variance of the mean uncorrected correlation in meta-analysis and validity generalization. Journal of Applied Psychology, 77, 115-22.
48. Overton, R.C. (1998) A comparison of fixed effects and mixed (random effects) models for meta-analysis tests of moderator variable effects. Psychological Methods, 3, 354-79.
49. Polich, J., Pollock, V.E., and Bloom, F.E. (1994) Meta-analysis of P300 amplitude from males at risk for alcoholism. Psychological Bitlletin, 115, 55-73.
50. Raju, N.S. and Burke, M.J. (1983) Two procedures for studying validity generalization. Journal of Applied Psychology, 68, 382-95.
51. Raudenbush, S.W. (1994) Random effects models. In H. Cooper and L.V. Hedges (eds.), Handbook of Research Synthesis. New York: Russell Sage Foundation, pp. 301-22.
52. Raudenbush, S.W. and Bryk, A.S. (1985) Empirical Bayes meta-analysis. Journal of Educational Statistics, 10, 75-98.
53. Rosenthal, R. (1978) Combining results of independent studies. Psychological Bulletin, 85, 185-93.
54. Rosenthal, R. (1991) Meta-analytic Procedures for Social Research. Sage.
55. Rosenthal, R. (1995) Writing a meta-analytic review. Psychological Bulletin, 118, 183-92.
56. Rosenthal, R. and Rubin, D.B. (1982a) Further meta-analytic procedures for assessing cognitive gender differences. Journal of Educational Psychology, 74, 708-12.
57. Rosenthal, R. and Rubin, D.B. (1982b) Comparing effect sizes of independent studies. Psychological Bulletin, 92, 500-4.
58. Rubin, D.B. (1980) Using empirical Bayes techniques in the law school validity studies. Journal of the American Statistical Association, 75 (372), 801-27.
59. Rubin, D.B. (1981) Estimation in parallel randomized experiments. Journal of Educational Statistics, 6, 337-400.
60. Schmidt, F.L (1992) What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology. American Psychologist, 47, 1173-81.
61. Schmidt, F.L. (1996) Statistical significance testing and cumulative knowledge in psychology: Implications for the training of researchers. Psychological Methods, 1, 115-29.
62. Schmidt, F.L. and Hunter, J.E. (1997) Eight common but false objections to the discontinuation of statistical significance testing. In L. Harlow and S. Muliak (eds.), What If There Were No Significance Tests? Hillsdale, NJ: Lawrence Erlbaum.
63. Schmidt, F.L., Hunter, J.E. and Raju, N. S. (1988) Validity generalization and situational specificity: A second look at the 75% rule and the Fisher z transformation. Journal of Applied Psychology, 73, 665-72.
64. Schmidt, F.L., Law, K., Hunter, J.E., Rothstein, H.R., Pearlman, K. and McDaniel, M. (1993) Refinements in validity generalization methods: Implications for the situational specificity hypothesis. Journal of Applied Psychology, 78, 3-13.
65. Sedlmeier, P. and Gigerenzer, G. (1989) Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309-16.
66. Shadish, W.R., and Haddock, C.K. (1994) Combining estimates of effects size. In H. Cooper and L.V. Hedges (eds.), Handbook of Research Synthesis. New York: Russell Sage Foundation, pp. 261-82.
67. Stoffelmeyr, B.E., Dillavou, D. and Hunter, J.E. (1983) Premorbid functioning and recidivism in schizophrena: A cumulative analysis. Journal of Consulting and Clinical Psychology, 51, 338-52.
68. Stouffer, S.A., Suchman, E.A., DeVinney, L.C., Star, S.A. and Williams, R.M., Jr. (1949) The American Soldier: Adjustment During Army Life (Vol. 1). Princeton, NJ: Princeton University Press.
69. Symons, C.S. and Johnson, B.T. (1997) The self-reference effect in memory: A meta-analysis. Psychological Bulletin, 121, 371-94.
70. Van Iizendorn, M.H. (1995) Adult attachment representations, parental responsiveness, and infant attachment: A meta-analysis on the predictive validity of the adult attachment interview. Psychological Bulletin, 117, 387-403.
71. Voyer, D., Voyer, S. and Bryden, M.P. (1995) Magnitude of sex differences in spatial abilities: A meta-analysis and consideration of critical variables. Psychological Bulletin, 117, 250-70.
72. Wood, W. (1987) Meta-analytic review of sex differences in group performance. Psychological Bulletin, 102, 53-71.
73. Wood, W., Lundgren, S., Ouellette, J.A., Busceme, S., and Blackstone, T. (1994) Minority influence: A meta-analytic review of social influence processes. Psychological Bulletin, 115, 323-45.