Implications of the multidimensional nature of job performance for the validity of selection tests: Multivariate frameworks for studying test validity

Personnel Psychology

Volumn 50, Issue 4, 1997, Pages 823-854

  Murphy, Kevin R ^a   Shiarella, Ann Harris ^b  

^a Department of Environmental and Radiological Health Sciences   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0031283611     PISSN: 00315826     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1744-6570.1997.tb01484.x     Document Type: Article

References (80)

1. Ackerman PL, Kanfer R, Goff M. (1995). Cognitive and noncognitive determinants and consequences of complex skill acquisition. Journal of Experimental Psychology: Applied, 1, 270-304.
2. Astin A. (1964). Criterion-centered research. Educational and Psychological Measurement, 24, 807-822.
3. Avila RD, Fern EF, Mann OK. (1988). Unraveling the criteria for assessing the performance of salespeople: A causal analysis. Journal of Personal Selling and Sales Management, 8, 45-54.
4. Barrick MR, Mount MK. (1991). The Big Five personality dimensions and job performance: A meta-analysis. PERSONNEL PSYCHOLOGY, 44, 1-26.
5. Barrick MR, Mount MK, Strauss JP. (1992, May). The Big Five and ability predictors of citizenship, delinquency, and sales performance. Paper presented at Seventh Annual Conference of the Society for Industrial and Organizational Psychology, Inc., Montreal.
6. Barrick MR, Mount MK, Strauss JP. (1994). Antecedents of involuntary turnover due to a reduction in force. PERSONNEL PSYCHOLOGY, 47, 515-535.
7. Bazerman M. (1990). Judgment in managerial decision making (2nd ed.). New York: Wiley.
8. Becker TE, Randall DM. (1994). Validation of a measure of organizational citizenship behavior against an objective behavioral criterion. Educational and Psychological Measurement, 54, 160-167.
9. Borman WC, Hanson M, Hedge J. (1997). Personnel selection. Annual Review of Psychology, 48, 299-337.
10. Borman WC, Motowidlo SJ. (1993). Expanding the criterion domain to include elements of contextual performance. In Schmitt N, Borman WC (Eds.), Personnel selection in organizations (pp. 71-98). San Francisco: Jossey-Bass.
11. Boudreau JW. (1991). Utility analysis for decisions in human resource management. In Dunnette M, Hough L (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 2, pp. 621-745). Palo Alto, CA: Consulting Psychologists Press.
12. Boudreau JW, Sturman MC, Judge TA. (1994). Utility analysis: What are the black boxes, and do they affect decisions? In Anderson N, Herriot P (Eds.), Assessment and selection in organizations: Methods and practice for recruitment and appraisal (pp. 77-96). New York: Wiley.
13. Brand CR. (1994). Open to experience-closed to intelligence: Why the "Big Five" are really the "Comprehensive Six." Special Issue: The fifth of the Big Five. European Journal of Personality, 8, 299-310.
14. Brief AP, Motowidlo SJ. (1986). Prosocial organizational behaviors. Academy of Management Review, 10, 710-725.
15. Campbell JP. (1990). Modeling the performance prediction problem in industrial and organizational psychology. In Dunnette MD, Hough LM (Eds.), Handbook of industrial and organizational psychology (Vol. 1, pp. 687-732). Palo Alto, CA: Consulting Psychologists Press.
16. Campbell JP, McCloy RA, Oppler SH, Sager CE. (1993). A theory of performance. In Schmitt N, Borman W (Eds.), Personnel selection in organizations (pp. 35-70). San Francisco: Jossey Bass.
17. Cascio WF. (1995). Whither industrial and organizational psychology in a changing world of work. American Psychologist, 50, 928-939.
18. Cattell RB, Butcher HJ. (1968). The prediction of achievement and creativity. Indianapolis: Bobbs-Merrill.
19. Cattell RB, Kline P. (1977). The scientific analysis of personality and motivation. London: Academic Press.
20. Conway JM. (1996). Additional evidence for the task-contextual performance distinction. Human Performance, 9, 309-330.
21. Dawes RM. (1979). The robust beauty of improper linear models in decision making. American Psychologist, 34, 571-582.
22. Dawes RM, Corrigan B. (1974). Linear models in decision making. Psychological Bulletin, 81, 95-106.
23. Day DV, Silverman SB. (1989). Personality and job performance: Evidence of incremental validity. PERSONNEL PSYCHOLOGY, 42, 25-36.
24. Dreger RM. (1968). General temperament and personality factors related to intellectual performance. Journal of Genetic Psychology, 113, 275-293.
25. Edwards JE, Morrison RF. (1994). Selecting and classifying future Naval officers: The paradox of greater specialization in broader arenas. In Rumsey M, Walker C, Harris J (Eds.), Personnel selection and classification (pp. 69-84). Hillsdale, NJ: Sage.
26. Edwards W, Newman JR. (1982). Multiattribute evaluation. Beverly Hills: Sage.
27. Einhorn H, Hogarth R. (1975). Unit weighting schemes for decision making. Organizational Behavior and Human Performance, 13, 171-192.
28. Gatewood RD, Field HS. (1994). Human resource selection (3rd ed.). Hinsdale, IL: Dryden Press.
29. Gaugler BB, Rosenthal DB, Thornton GC, Bentson C. (1987). Meta-analysis of assessment center validity. Journal of Applied Psychology, 72, 493-511.
30. Guion RM. (1991). Personnel assessment, selection, and placement. In Dunnette M, Hough L (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 2, pp. 327-398). Palo Alto, CA: Consulting Psychologists Press.
31. Gutenberg RL, Arvey RD, Osburn HG, Jenneret PR. (1983). Moderating effects of decision-making/information processing job dimensions on test validities. Journal of Applied Psychology, 68, 602-608.
32. Hakstian AR, Woolley RM, Woolley LK, Kryger BR. (1991a). Management selection by multiple-domain assessment: I. Concurrent validity. Educational and Psychological Measurement, 51, 883-898.
33. Hakstian AR, Woolley RM, Woolley LK, Kryger BR. (1991b). Management selection by multiple-domain assessment: II. Utility to the organization. Educational and Psychological Measurement, 51, 899-911.
34. Howard A. (1995). The changing nature of work. San Francisco, CA: Jossey-Bass.
35. Hunter JE. (1986). Cognitive ability, cognitive aptitudes, job knowledge, and job performance. Journal of Vocational Behavior, 29, 340-362.
36. Hunter JE, Hirsh HR. (1987). Applications of meta-analysis. In. Cooper CL, Robertson IT (Eds.), International review of industrial and organizational psychology (pp. 321-357). Chichester: Wiley.
37. Hunter JE, Hunter RF. (1984). The validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72-98.
38. Hunter JE, Schmidt FL. (1990). Methods of meta-analysis. Newbury Park, CA: Sage.
39. Ilgen D, Hollenbeck J. (1991). The structure of work: Job design and roles. In Dunnette M, Hough L (Eds.), Handbook of industrial and Organizational psychology (2nd ed., Vol. 2, pp. 165-208). Palo Alto: Consulting Psychologists Press.
40. Jones GR, Wright PM. (1992). An economic approach to conceptualizing the utility of human resource management practices. In Ferris G, Rowland K (Eds.), Research in human resources management (Vol. 10, pp. 31-72). Greenwich, CT: JAI Press.
41. Kemry ER, Mossholder KW, Roth L. (1987). The power of the Schmidt and Hunter additive model of validity generalization. Journal of Applied Psychology, 72, 30-37.
42. Landy FJ, Shankster LJ, Kohler SS. (1994). Personnel selection and placement. Annual Review of Psychology, 45, 261-296.
43. McCloy RA, Campbell JP, Cudeck R. (1994). A confirmatory test of a model of performance determinants. Journal of Applied Psychology, 79, 493-505.
44. McHenry JJ, Hough LM, Toquam JL, Hanson MA, Ashworth S. (1990). Project A validity results: The relationship between predictor and criterion domains. PERSONNEL PSYCHOLOGY, 43, 335-355.
45. McIntyre RM, Salas E. (1995). Measuring and managing for team performance: Emerging principles from complex environments. In Guzzo R, Salas E (Eds.), Team effectiveness and decision making in organizations (pp. 9-45). San Francisco: Jossey-Bass.
46. Milkovich GT, Boudreau JW. (1994). Human resource management, 7th ed. Homewood, IL: Richard D. Irwin.
47. Motowidlo SJ, Van Scotter JR. (1994). Evidence that task performance should be distinguished from contextual performance. Journal of Applied Psychology, 79, 475-480.
48. Mount MK, Barrick MR. (1995). The Big Five personality dimensions: Implications for research and practice in human resource management In Ferris G (Ed.), Research in personnel and human resource management (Vol. 13, pp. 153-200). Greenwich, CT: JAI.
49. Murphy KR. (1989). Dimensions of job performance. In Dillon R, Pelligrino J (Eds.), Testing: Applied and theoretical perspectives (pp. 218-247). New York: Praeger.
50. Murphy KR. (1994). Toward a broader conception of jobs and job performance: Impact of changes in the military environment on the structure, assessment, and prediction of job performance. In Rumsey M, Walker C, Harris J (Eds.), Personnel selection and classification (pp. 85-102). Hillsdale, NJ: Erlbaum.
51. Murphy KR. (1996). Individual differences and behavior in organizations: Much more than g. In Murphy K (Ed), Individual differences and behavior in organizations (pp. 3-30). San Francisco: Jossey-Bass.
52. Murphy KR, Cleveland JN. (1995). Understanding performance appraisal: Social, organizational and goal-based perspectives. Thousand Hills, CA: Sage.
53. Nathan BR, Alexander RA. (1988). A comparison of criteria for test validation: A metaanalytic investigation. PERSONNEL PSYCHOLOGY, 41, 517-535.
54. Nunnally JC. (1978). Psychometric theory. New York: McGraw-Hill.
55. Ones DS, Schmidt FL, Viswesvaran C. (1993a, May). Integrity and ability: Implications for incremental validity and adverse impact. Presented at the Eighth Annual Conference of Society for Industrial and Organizational Psychology, Inc., San Francisco.
56. Ones DS, Schmidt FL, Viswesvaran C. (1993b, May). Nomological net for measures of integrity and conscientiousness. Presented at the Eighth Annual Conference of Society for Industrial and Organizational Psychology, Inc., San Francisco.
57. Organ DW. (1988). Organizational citizenship behavior. The good soldier syndrome. Lexington, MA: Lexington, Books.
58. Organ DW. (1994). Personality and organizational citizenship behavior. Journal of Management, 20, 465-478.
59. Organ DW, Konovsky MA. (1989). Cognitive versus affective determinants of organizational citizenship behavior. Journal of Applied Psychology, 74, 157-164.
60. Organ DW, Lingl A. (1995). Personality, satisfaction, and organizational citizenship behavior. Journal of Social Psychology, 135, 339-350.
61. Organ DW, Ryan K. (1995). A meta-analytic review of attitudinal and dispositional predictors of organizational citizenship behavior. PERSONNEL PSYCHOLOGY, 48, 775-802.
62. Osburn HG, Callender JC, Greener JM, Ashworth S. (1983). Statistical power of tests of the situational specificity hypothesis in validity generalization studies: A cautionary note. Journal of Applied Psychology, 68, 115-122.
63. Pritchard RD. (1990). Measuring and improving organizational productivity. New York: Praeger.
64. Ree MJ, Earles JA. (1994). The ubiquitous productiveness of g. In Rumsey MG, Walker CB, Harris JH (Eds.), Personnel selection and classification (pp. 127-136). Hillsdale, NJ: Erlbaum.
65. Reilly RR, Chao GT. (1982). Validity and fairness of some alternate employee selection procedures. PERSONNEL PSYCHOLOGY, 35, 1-67.
66. Roth PL. (1994). Multi-attribute utility analysis using the ProMES approach. Journal of Business and Psychology, 9, 69-80.
67. Rothstein MG, Paunonen SV, Rush JC, King GA. (1994). Personality and cognitive ability predictors of performance in graduate business school. Journal of Educational Psychology, 86, 516-530.
68. Sackett PR, Harris MM, Orr JM. (1986). On seeking moderator variables in the metaanalysis of correlational data: A Monte Carlo investigation of statistical power and resistance to Type I error. Journal of Applied Psychology, 71, 302-310.
69. Schmidt FL. (1992). What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology. American Psychologist, 47, 1173-1181.
70. Schmidt FL. (1994). The future of personnel selection in the U.S. Army. In Rumsey M, Walker C, Harris J (Eds.), Personnel selection and classification (pp. 333-349). Hillsdale, NJ: Erlbaum.
71. Schmidt FL, Hunter JE, Outerbridge AN. (1986). Impact of job experience and ability on job knowledge, work sample, performance, and supervisory ratings of job performance. Journal of Applied Psychology, 71, 432-439.
72. Schmidt FL, Kaplan LB. (1971). Composite versus multiple criteria: A review and resolution of the controversy. PERSONNEL PSYCHOLOGY, 24, 419-434.
73. Schmidt FL, Ones DO, Hunter JE. (1992). Personnel selection. Annual Review of Psychology, 43, 627-670.
74. Smith CA, Organ DW, Near JP. (1983). Organizational citizenship behavior: Its nature and antecedents. Journal of Applied Psychology, 68, 653-663.
75. Stevens J. (1986). Applied multivariate statistics for the social sciences. Hillsdale, NJ: Erlbaum.
76. Sturman M, Judge TA. (1995). Utility analysis for multiple selection devices and multiple outcomes. Center for Advanced Human Resource Studies Working paper 95-12. Cornell University
77. Tett RP, Jackson DN, Rothstein M. (1991). Personality measures as predictors of job performance: A meta-analytic review. PERSONNEL PSYCHOLOGY, 44, 703-745.
78. Viswesvaran C. (1996, April). Modeling job performance: Is there a general factor? Presented at the 11th Annual Conference of the Society for Industrial and Organizational Psychology, Inc., San Diego.
79. Wainer H. (1976). Estimating coefficients in linear models: It don't make no never mind. Psychological Bulletin, 83, 213-217.
80. Wolfe RN, Johnson SD. (1995). Personality as a predictor of college performance. Educational and Psychological Measurement, 55, 177-185.