Methods for second order meta-analysis and illustrative applications

Organizational Behavior and Human Decision Processes

Volumn 121, Issue 2, 2013, Pages 204-218

  Schmidt, Frank L ^a   Oh, In Sue ^b  

^a UNIVERSITY OF IOWA   (United States)

^b TEMPLE UNIVERSITY   (United States)

Author keywords

Meta analysis; Research synthesis; Sampling error; Second order meta analysis

Indexed keywords

EID: 84876337061     PISSN: 07495978     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.obhdp.2013.03.002     Document Type: Article

References (44)

1. Aguinis H., Gottfredson R.K., Wright T.A. Best-practice recommendations for estimating interaction effects using meta-analysis. Journal of Organizational Behavior 2011, 32:1033-1043.
2. Aytug Z.G., Rothstein H.R., Zhou W., Kern M.C. Revealed or concealed? Transparency of procedures, decisions, and judgment calls in meta-analyses. Organizational Research Methods 2012, 15:103-133.
3. Bangert-Drowns R.L. Review of developments in meta-analysis methods. Psychological Bulletin 1986, 99:388-399.
4. Barrick M.R., Mount M.K. The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology 1991, 44:1-26.
5. Barrick M.R., Mount M.K., Judge T.A. Personality and performance at the beginning of the new millennium: What do we know and where do we go next?. International Journal of Selection & Assessment 2001, 9:9-30.
6. Borenstein M., Hedges L.V., Higgins J.P.T., Rothstein H.R. Subgroup analyses. Introduction to meta-analysis 2009, Wiley, Chichester, UK.
7. Brannick M.T., Yang L., Cafri G. Comparison of weights for meta-analysis of r and d under realistic conditions. Organizational Research Methods 2011, 14:587-607.
8. Carlson K.D., Ji F.X. Citing and building on meta-analytic findings: A review and recommendations. Organizational Research Methods 2011, 14:696-717.
9. Chan M.E., Arvey R.D. Meta-analysis and the development of knowledge. Perspectives on Psychological Science 2012, 7:79-92.
10. Colquitt J.A., Conlon D.E., Wesson M.J., Porter C.O.L.H., Ng K.Y. Justice at the millennium: A meta-analytic review of 25 years of organizational justice research. Journal Of Applied Psychology 2001, 86:425-445.
11. Combs J.G., Liu Y., Hall A.T., Ketchen D.J. How much do high performance work practices matter? A meta-analysis of their effects on organizational performance. Personnel Psychology 2006, 59:501-528.
12. Cooper H., Koenka A.C. The overview of reviews: Unique challenges and opportunities when research syntheses are the principal elements of new integrative scholarship. American Psychologist 2012, 67:446-462.
13. DeGeest D., Schmidt F.L. The impact of research synthesis methods on industrial-organizational psychology: The road from pessimism to optimism about cumulative knowledge. Research Synthesis Methods 2010, 1:185-197.
14. Dudley N.M., Orvis K.A., Lebiecki J.E., Cortina J.M. A meta-analytic investigation of Conscientiousness in the prediction of job performance: Examining the intercorrelations and the incremental validities of narrow traits. Journal of Applied Psychology 2006, 91:40-57.
15. Ghiselli E.E. Theory of psychological measurement 1964, McGraw-Hill, New York.
16. Hedges L.V. Fixed effects models. The handbook of research synthesis 1994, 285-300. Russell Sage Foundation, New York. H. Cooper, L.V. Hedges (Eds.).
17. Hedges L.V., Olkin I. Statistical methods for meta-analysis 1985, Academic Press, London.
18. Hofstede G. The GLOBE debate: Back to relevance. Journal of International Business Studies 2010, 41:1339-1346.
19. Hunter J.E., Schmidt F.L. Fixed vs. random effects meta-analysis models: Implications for cumulative research knowledge. International Journal of Selection and Assessment 2000, 8:275-292.
20. Hunter J.E., Schmidt F.L. Methods of meta-analysis: Correcting error and bias in research findings 2004, Sage, Newbury Park, CA. 2nd ed.
21. Hurtz G.M., Donovan J.J. Personality and job performance: The Big Five revisited. Journal of Applied Psychology 2000, 85:869-879.
22. Johnson J.W., Steel P., Scherbaum C.A., Hoffman C.C., Jeanneret P.R., Foster J. Validation is like motor oil: Synthetic is better. Industrial and Organizational Psychology 2010, 3:305-328.
23. Kepes S., Banks G.C., McDaniel M.A., Whetzel D.L. Publication bias in the organizational sciences. Organizational Research Methods 2012, 15:624-662.
24. Li A., Cropanazano R. Do East Asians respond more/less strongly to organizational justice than North Americans? A meta-analysis. Journal of Management Studies 2009, 46:787-805.
25. Magnusson D. Test theory 1966, Addison-Wesley, New York.
26. McDaniel M.A. Validity generalization as a test validation approach. Alternative validation strategies 2007, 159-180. Jossey Bass, San Francisco. S.M. McPhail (Ed.).
27. Mesmer-Magnus J.R., DeChurch L.A., Jimenez M.J., Wildman J., Shuffler M. A meta-analytic examination of virtuality and information sharing in teams. Organizational Behavior and Human Decision Processes 2011, 115:214-225.
28. Murphy K.R., Newman D.A. The past, present, and future of validity generalization. Validity generalization 2003, 403-424. Erlbaum Associates, Mahwah, NJ. K.R. Murphy (Ed.).
29. Nunnally J.C., Bernstein I.H. Psychometric theory 1994, McGraw-Hill, New York. 3rd ed.
30. Oh, I. -S. (2009). The Five-Factor Model of personality and job performance in East Asia: A cross-cultural validity generalization study. Unpublished doctoral dissertation. Iowa City, IA: University of Iowa.
31. Podsakoff P.M., Bommer W.H., Podsakoff N.P., MacKenzie S.B. Relationships between leader reward and punishment behavior and subordinate attitudes, perceptions, and behaviors: A meta-analytic review of existing and new research. Organizational Behavior and Human Decision Processess 2006, 99:113-142.
32. Raudenbush S.W. Random effects models. The handbook of research synthesis 1994, 301-322. Russell Sage Foundation, New York. H. Cooper, L.V. Hedges (Eds.).
33. Raudenbush S.W. Analyzing effect sizes: Random effects models. Handbook of research synthesis and meta-analysis 2009, 295-316. Russell Sage, NY. H. Cooper, L.V. Hedges, J.C. Valentine (Eds.).
34. Sackett P.R. The status of validity generalization research: Key issues in drawing inferences from cumulative research findings. Validity generalization 2003, 91-114. Erlbaum Associates, Mahwah, NJ. K.R. Murphy (Ed.).
35. Salgado J.F. The five-factor model of personality and job performance in the European community. Journal of Applied Psychology 1997, 82:30-43.
36. Salgado J.F. The Big Five personality dimensions and job performance in army and civil occupations: A European perspective. Human Performance 1998, 11:271-288.
37. Schmidt F.L. Meta-analysis: A constantly evolving research integration tool. Organizational Research Methods 2008, 11:96-113.
38. Schmidt F.L. Detecting and correcting the lies that data tell. Perspectives on Psychological Science 2010, 5:233-242.
39. Schmidt F.L., Oh I.-S., Hayes T.L. Fixed vs. random models in meta-analysis: Model properties and an empirical comparison of differences in results. British Journal of Mathematical and Statistical Psychology 2009, 62:97-128.
40. Schmidt F.L., Shaffer J.A., Oh I.-S. Increased accuracy for range restriction corrections: Implications for the role of personality and general mental ability in job and training performance. Personnel Psychology 2008, 61:827-868.
41. Spector, P. E. (2001). Research methods in industrial and organizational psychology: Data collection and data analysis with special consideration to international issues. In N. Anderson, D. S. Ones, H. K. Sinangil, & C. Viswesvaran (Eds.), Handbook of industrial, work and organizational psychology (Vol. 1, pp. 10-26). Thousand Oaks, CA: Sage.
42. Tracz S.M., Elmore P.B., Pohlmann J.T. Correlational meta-analyses: Independent and nonindependent cases. Educational and Psychological Measurement 1992, 52:879-888.
43. Van Iddekinge C.H., Roth P.L., Putka D.J., Lanivich S.E. Are you interested? A meta-analysis of relations between vocational interests and employee performance and turnover. Journal of Applied Psychology 2011, 96:1167-1194.
44. Wang G., Oh I.-S., Courtright S.H., Colbert A.E. Transformational leadership and performance across criteria and levels: A meta-analytic review of 25 years of research. Group & Organizational Management 2011, 36:223-270.