Using a Computational Model to Understand Possible Sources of Skews in Distributions of Job Performance

Personnel Psychology

Volumn 69, Issue 4, 2016, Pages 931-974

  Vancouver, Jeffrey B ^a   Li, Xiaofei ^a   Weinhardt, Justin M ^b   Steel, Piers ^b   Purl, Justin D ^a  

^a OHIO UNIVERSITY   (United States)

^b UNIVERSITY OF CALGARY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84960398024     PISSN: 00315826     EISSN: 17446570     Source Type: Journal    
DOI: 10.1111/peps.12141     Document Type: Article

References (91)

1. Ackerman PL. (1987). Individual differences in skill learning: An integration of psychometric and information processing perspectives. Psychological Bulletin, 102, 3–27. http://dx.doi.org/10.1037/0033-2909.102.1.3
2. Ackerman PL. (1989). Within-task intercorrelations of skilled performance: Implications for predicting individual differences? (A comment on Henry & Hulin, 1987). Journal of Applied Psychology, 74, 360–364. http://dx.doi.org/10.1037/0021-9010.74.2.360
3. Ackerman PL. (2007). New developments in understanding skilled performance. Current Directions in Psychological Science, 16, 235–239. doi: 10.1111/j.1467-8721.2007.00511.x
4. Ackerman PL, (2013). Nonsense, common sense, and science of expert performance: Talent and individual differences, Intelligence, 45, 6–17. doi: 10.1016/j.intell.2013.04.009
5. Aguinis H, O'Boyle E. (2014). Star performers in twenty-first century organizations. Personnel Psychology, 67, 313–350. doi: 10.1111/peps.12054
6. Aguinis H, O'Boyle E, Gonzalez-Mulé E, Joo H. (2014). Cumulative advantage: Conductors and insulators of heavy-tailed productivity distributions and productivity stars. Personnel Psychology. doi: 10.1111/peps.12095
7. Allport FH. (1934). The J-curve hypothesis of conforming behavior. The Journal of Social Psychology, 5, 141–183. doi: 10.1080/00224545.1934.9919446
8. Alvares KM, Hulin CL. (1972). Two explanations of temporal changes in ability-skill relationships: A literature review and theoretical analysis. Human Factors: The Journal of the Human Factors and Ergonomics Society, 14, 295–308. doi: 10.1177/001872087201400402
9. Austin JT, Vancouver JB. (1996). Goal constructs in psychology: Structure, process, and content. Psychological Bulletin, 120, 338–375. doi: 10.1037//0033-2909.120.3.338
10. Autor DH. (2014). Skills, education, and the rise of earnings inequality among the “other 99 percent.” Science, 344(6186), 843–851. doi: 10.1126/science.1251868
11. Banerjee AV. (1992). A simple model of herd behavior. Quarterly Journal of Economics, 107, 797–817. doi:10.2307/2118364
12. Barabási AL, Albert R. (1999). Emergence of scaling in random networks. Science, 286(5439), 509–512. doi: 10.1126/science.286.5439.509
13. Beal DJ, Weiss HM, Barros E, MacDermid SM. (2005). An episodic process model of affective influences on performance. Journal of Applied Psychology, 90, 1054–1068. http://dx.doi.org/10.1037/0021-9010.90.6.1054.
14. Beck JW, Beatty AS, Sackett PR. (2013). On the distribution of job performance: The role of measurement characteristics in observed departures from normality. Personnel Psychology, 67(3), 531–566. doi: 10.1111/peps.12060
15. Bidwell M. (2011). Paying more to get less: The effects of external hiring versus internal mobility. Administrative Science Quarterly, 56, 369–407. doi:10.1177/0001839211433562
16. Bikhchandani S, Hirshleifer D, Welch I. (1992). A theory of fads, fashion, custom, and cultural change as informational cascades. Journal of Political Economy, 100, 992–1026. doi:10.2307/2138632
17. Bloom M. (1999). The performance effects of pay dispersion on individuals and organizations. Academy of Management Journal, 42, 25–40. doi: 10.2307/256872
18. Boudreau JW, Berger CJ. (1985). Decision-theoretic utility analysis applied to employee separations and acquisitions. Journal of Applied Psychology, 70, 581–612. http://dx.doi.org/10.1037/0021-9010.70.3.581.
19. Bowling NA, Burns GN. (2010). A comparison of work-specific and general personality measures as predictors of work and non-work criteria. Personality and Individual Differences, 49, 95–101. doi:10.1016/j.paid.2010.03.009
20. Brett JM, Stroh LK. (2003). Working 61 plus hours a week: Why do managers do it? Journal of Applied Psychology, 88, 67–78. http://dx.doi.org/10.1037/0021-9010.88.1.67.
21. Burt C. (1957). Distribution of intelligence. British Journal of Psychology, 48, 161–175. doi: 10.1111/j.2044-8295.1957.tb00614.x
22. Busemeyer JR, Diederich A. (2010). Cognitive modeling. Thousand Oaks, CA: Sage.
23. Byington E, Felps W. (2010). Why do IQ scores predict job performance?: An alternative, sociological explanation. Research in Organizational Behavior, 30, 175–202. doi:10.1016/j.riob.2010.08.003
24. Cameron AC, Trivedi PK. (1998). Regression analysis of count data. Cambridge, UK: Cambridge University Press.
25. Campbell JP. (1990). Modeling the performance prediction problem in industrial and organizational psychology. In MD Dunnette, LM Hough (Eds.), Handbook of industrial and organizational psychology (Vol. 1, 2nd ed, pp. 687–732). Palo Alto, CA: Consulting Psychologists Press.
26. Campbell JP, Pritchard RD. (1976). Motivation theory in industry and organizational psychology. In MD Dunnette (Ed.), Handbook of industrial and organizational psychology (pp. 63–130). Chicago, IL: Rand McNally.
27. Choi CJ, Berger R. (2009). Ethics of global Internet, community and fame addition. Journal of Business Ethics, 85, 193–200. doi: 10.1007/s10551-009-0090-4
28. Cortina JM, Luchman JN. (2013). Personnel selection and employee performance. In NW Schmitt, S Highhouse (Eds.), Handbook of psychology, industrial and organizational psychology (Vol 12. pp. 143–183). Hoboken, NJ: John Wiley & Sons, Inc.
29. Crain WM, Tollison RD. (2002). Consumer choice and the popular music industry: A test of the superstar theory. Empirica, 29, 1–9. doi: 10.1023/A:1014651130414
30. Cronin MA, Gonzalez C, Sterman JD. (2009). Why don't well-educated adults understand accumulation? A challenge to researchers, educators, and citizens. Organizational Behavior and Human Decision Processes, 108, 116–130. doi:10.1016/j.obhdp.2008.03.003
31. Dalal RS, Bhave DP, Fiset J. (2014). Within-person variability in job performance: A theoretical review and research agenda. Journal of Management, 40, 1396–1436. doi: 10.1177/0149206314532691
32. Dalal RS, Hulin CL. (2008). Motivation for what? The criterion question. In R Kanfer, G Chen, RD Pritchard (Eds.), Work motivation: Past, present, and future (pp. 63–100). New York, NY: Routledge. doi:10.1177/0149206314532691
33. Davis JP, Eisenhardt KM, Bingham CB. (2007). Developing theory through simulation methods. Academy of Management Review, 32(2), 480–499. doi:10.5465/AMR.2007.24351453
34. DeShon RP. (2013). Multivariate dynamics in organizational science. In SWJ Kozlowski (Ed.), The Oxford handbook of organizational psychology (pp. 117–142). New York, NY: Oxford University Press.
35. DiPrete TA, Eirich GM. (2006). Cumulative advantage as a mechanism for inequality: A review of theoretical and empirical developments. Annual Review of Sociology, 32, 271–297. doi: 10.1146/annurev.soc.32.061604.123127
36. Edwards JR. (2010). Reconsidering theoretical progress in organizational and management research. Organizational Research Methods, 13, 615–619. doi: 10.1177/1094428110380468
37. Embretson SE, Reise SP. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.
38. Ericsson KA, Krampe RT, Tesch-Römer C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100, 363–406. http://dx.doi.org/10.1037/0033-295X.100.3.363.
39. Farrell S, Lewandowsky S. (2010). Computational models as aids to better reasoning in psychology. Current Directions in Psychological Science, 19, 329–335. doi: 10.1177/0963721410386677
40. Favaro K, Karlsson PO, Neilson GL. (2014). The lives and times of the CEO. Strategy & Leadership, 75. http://www.strategy-business.com/article/00254?pg=all#ceo_turnover.
41. Groysberg B, Polzer JT, Elfenbein HA. (2011). Too many cooks spoil the broth: How high-status individuals decrease group effectiveness. Organization Science, 22, 722–737. http://dx.doi.org/10.1287/orsc.1100.0547.
42. Hindman AH, Erhart AC, Wasik BA. (2012). Reducing the Matthew effect: Lessons from the ExCELL head start intervention. Early Education & Development, 23, 781–806. doi: 10.1080/10409289.2010.549443
43. Hockey R. (1983). Stress and fatigue in human performance (Vol. 3). New York, NY: John Wiley & Sons Inc.
44. Hopkins WG, Hewson DJ. (2001).Variability of competitive performance of distance runners. Medicine and Science in Sports and Exercise, 33, 1588–1592. doi: 10.1097/00005768-200109000-00023
45. Hambrick DZ, Oswald FL, Altmann EM, Meinz EJ, Gobet F, Campitelli G. (2013). Deliberate practice: Is that all it takes to become an expert? Intelligence, 45, 34–45. doi:10.1016/j.intell.2013.04.001
46. Hunter JE, Schmidt FL. (2004). Methods of meta-analysis: Correcting error and bias in research findings. Thousand Oaks, CA: Sage.
47. Judge TA, Ilies R. (2002). Relationship of personality to performance motivation: A meta-analytic review. Journal of Applied Psychology, 87(4), 797–807. http://dx.doi.org/10.1037/0021-9010.87.4.797.
48. Kendall MG. (1961). Natural law in the social sciences. Journal of the Royal Statistical Society, Series A, 124, 1–18. http://onlinelibrary.wiley.com/journal/10.1111/(ISSN)1467-985X.
49. Kluger AN, DeNisi A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119, 254–284. http://dx.doi.org/10.1037/0033-2909.119.2.254.
50. Kunst EJ. (1941). Variations in work performance under normal industrial conditions. Psychological Bulletin, 38, 530. http://www.apa.org/pubs/journals/bul/.
51. Levy M, Levy H. (2003). Investment talent and the Pareto wealth distribution: Theoretical and experimental analysis. Review of Economics and Statistics, 85, 709–725. doi:10.1162/003465303322369830
52. Mandelbrot B. (1953). An informational theory of the statistical structure of language. In Jackson W (Ed.), Communication theory (pp. 486–502). London, UK: Butterworths.
53. Martindale C. (1995). Fame more fickle than fortune: On the distribution of literary eminence. Poetics, 23, 219–234. doi:10.1016/0304-422X(94)00026-3
54. Mendenhall W, Scheaffer RL, Wackerly DD. (1986). Mathematical statistics with applications. Belmont, CA: Cengage Learning.
55. Merton RK. (1968). Social theory and social structure. Science, 159(3810), 56–63.
56. Merton RK. (1988). The Matthew effect in science, II: Cumulative advantage and the symbolism of intellectual property. ISIS, 79, 606–623. http://www.jstor.org/journal/isis.
57. Micceri T. (1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105, 156–166. http://dx.doi.org/10.1037/0033-2909.105.1.156.
58. Motowidlo SJ, Kell HJ. (2013). Job performance. In NW Schmitt, S Highhouse, I Weiner (Eds.), Handbook of psychology, industrial and organizational psychology (Vol. 12, pp. 82–103). Hoboken, NJ: Wiley.
59. Murphy KR. (1989). Is the relationship between cognitive ability and job performance stable over time? Human Performance, 2, 183–200. doi: 10.1207/s15327043hup0203_3
60. Murphy KR, Cleveland J. (1995). Understanding performance appraisal: Social, organizational, and goal-based perspectives. Thousand Oaks, CA: Sage.
61. Newman ME. (2005). Power laws, Pareto distributions and Zipf's law. Contemporary Physics, 46, 323–351. doi: 10.1080/00107510500052444
62. Newman ME, Barabási AL, & Watts DJ. (2006). The structure and dynamics of networks. Princeton, NJ: Princeton University Press.
63. Nisbett RE. (2009). Intelligence and how to get it: Why schools and cultures count. New York, NY: WW Norton & Company.
64. O'Boyle E., Aguinis H. (2012). The best and the rest: Revisiting the norm of normality of individual performance. Personnel Psychology, 65, 79–119. doi: 10.1111/j.1744-6570.2011.01239.x
65. Pearson K. (1901). “On some applications of the theory of chance to racial differentiation.” Phil. Mag 6.1, 110–24.
66. Pervin LA. (1989). Persons, situations, interactions: The history of a controversy and a discussion of theoretical models. Academy of Management Review, 14, 350–360. doi: 10.5465/AMR.1989.4279066
67. Piketty T. (2014). Capital in the twenty-first century. Cambridge, MA: Harvard University Press.
68. Podsakoff PM, MacKenzie SB, Podsakoff NP, Bachrach DG. (2008). Scholarly influence in the field of management: A bibliometric analysis of the determinants of university and author impact in the management literature in the past quarter century. Journal of Management, 34, 641–720. doi: 10.1177/0149206308319533
69. Riniolo TC, Porges SW. (2000). Evaluating group distributional characteristics: Why psychophysiologists should be interested in qualitative departures from the normal distribution. Psychophysiology, 37, 21–28. http://journals.cambridge.org/action/displayJournal?jid=PGY.
70. Rothe HF. (1946). Output rates among butter wrappers: I. Work curves and their stability. Journal of Applied Psychology, 30, 199–211. http://dx.doi.org/10.1037/h0062587.
71. Rotundo M, Sackett PR, Enns JR, Mann SL. (2012). Refocusing effort across job tasks: Implications for understanding temporal change in job performance. Human Performance, 25, 201–214. doi: 10.1080/08959285.2012.683905
72. Schmidt FL, Kaplan LB. (1971). Compositive vs. multiple criteria: A review and resolution of the controversy. Personnel Psychology, 24, 419–434. doi: 10.1111/j.1744-6570.1971.tb00365.x
73. Simon HA. (1955). A behavioral model of rational choice. The Quarterly Journal of Economics, 69, 99–118. doi: 10.2307/1884852
74. Simonton DK. (1999). Talent and its development: An emergenic and epigenetic model. Psychological Review, 106, 435–457. http://dx.doi.org/10.1037/0033-295X.106.3.435.
75. Simonton DK. (2001). Talent development as a multidimensional, multiplicative, and dynamic process. Current Directions in Psychological Science, 10, 39–43. doi: 10.1111/1467-8721.00110
76. Sonnetag S, Frese M. (2013). Dynamic performance. In SWJ Kozlowski (Ed.), The Oxford handbook of organizational psychology (pp. 548–575). New York, NY: Oxford University Press.
77. Starbuck WH. (2003). Turning lemons into lemonade where is the value in peer reviews? Journal of Management Inquiry, 12, 344–351. doi: 10.1177/1056492603258972
78. Starbuck WH. (2013). Why and where do academics publish? Management, 16, 707–718. doi: 10.3917/mana.165.0707
79. Steel P, Weinhardt J. (2012). The building blocks of motivation. Anderson N, Ones DS, Sinangil HK, Viswesveran C (Eds.), Handbook of industrial, work & organizational psychology (2nd ed, Vol. 3). Thousand Oaks, CA: Sage.
80. Steele-Johnson D, Osburn HG, Pieper KF. (2000). A review and extension of current models of dynamic criteria. International Journal of Selection and Assessment, 8, 110–136. doi: 10.1111/1468-2389.00141
81. Sturman MC. (2007). The past, present, and future of dynamic performance research. Research in Personnel and Human Resources Management, 26, 49–110. doi: 10.1111/1468-2389.00141
82. Swaab R, Schaerer I, Anicich ME, Ronay R, Galinsky AD. (2014). The too-much-talent effect: Team interdependence determines when more talent is too much or not enough. Psychological Science, 25, 1581–1591. doi:10.1177/0956797614537280
83. Vancouver JB, Tamanini KB, Yoder RJ. (2010). Using dynamic computational models to reconnect theory and research: Socialization by the proactive newcomer example. Journal of Management, 36, 764–793. doi: 10.1177/0149206308321550
84. Vancouver JB, Weinhardt JM, Schmidt AM. (2010). A formal, computational theory of multiple-goal pursuit: Integrating goal-choice and goal-striving processes. Journal of Applied Psychology, 95, 985–1008. http://dx.doi.org/10.1037/a0020628.
85. Vancouver JB, Yoder RJ, More KM. (2008). Predicting research productivity among I/O Psychologists: The implications of a dynamic interaction model in validity research. The Industrial-Organizational Psychologist, 45, 27–36. http://www.siop.org/tip/.
86. Vázquez A, Oliveira JG, Dezsö Z, Goh KI, Kondor I, Barabási AL. (2006). Modeling bursts and heavy tails in human dynamics. Physical Review E, 73, 036127, 1–19. http://dx.doi.org/10.1103/PhysRevE.73.036127.
87. Walberg HJ, Strykowski BF, Rovai E, Hung SS. (1984). Exceptional performance. Review of Educational Research, 54, 87–112. doi: 10.3102/00346543054001087
88. Weinhardt JM, Hendijani R, Harman JL, Steel P, & Gonzalez C. (2015). How analytic reasoning style and global thinking relate to understanding stocks and flows. Journal of Operations Management, 39, 23–30. doi:10.1016/j.jom.2015.07.003
89. Yelle LE. (1979). The learning curve: Historical review and comprehensive survey. Decision Sciences, 10, 302–328. doi: 10.1111/j.1540-5915.1979.tb00026.x
90. Yule GU. (1926). Why do we sometimes get nonsense-correlations between time-series? A study in sampling and the nature of time-series. Journal of the Royal Statistical Society, 89, 1–63. doi: 10.2307/2341482
91. Zipf GK. (1949). Human behavior and the principle of least effort. Reading, MA: Addison-Wesley.