Selection or training? A two-fold test of the validity of job-analytic ratings of trainability

Journal of Business and Psychology

Volumn 15, Issue 3, 2001, Pages 363-389

  Jones, Robert G ^a   Sanchez, Juan I ^b   Parameswaran, Gowri ^a   Phelps, Jeanne ^a   Shoptaugh, Carol ^a   Williams, Marie ^b   White, Steve ^b  

^a MISSOURI STATE UNIVERSITY   (United States)

^b FLORIDA INTERNATIONAL UNIVERSITY   (United States)

Author keywords

Job analysis; Rating accuracy

Indexed keywords

EID: 0042788867     PISSN: 08893268     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1007804815480     Document Type: Article

References (58)

1. Allen, M. J., & Yen, W. M. (1979). Introduction to measurement theory. Monterey, CA: Brooks-Cole.
2. Arvey, R. D., Davis, G. A., McGowen, S. L., & Dipboye, R. L. (1982). Potential sources of bias in job analytic processes. Academy of Management Journal, 25, 618-629.
3. Arvey, R. D., Passino, E. M., & Lounsbury, J. W. (1977). Job analysis results as influenced by sex of incumbents and sex of analyst. Journal of Applied Psychology, 62, 411-416.
4. Brief, A. P., Burke, M. J., George, J. M., Robinson, B. S., & Webster, J. (1988). Should negative affectivity remain an unmeasured variable in the study of job stress. Journal of Applied Psychology, 73, 193-198.
5. Brief, A. P., & Motowidlo, S. J. (1986). Prosocial organizational behaviors. Academy of Management Review, 10, 710-725.
6. Burke, M. J., Brief, A. P., & George, J. M. (1993). The role of negative affectivity in understanding relations between self-reports of stressors and strains: A comment on the applied psychology literature. Journal of Applied Psychology, 78, 402-412.
7. Cain, P. S., & Green, B. F. (1983). Reliability of selected ratings available from the Dictionary of Occupational Titles. Journal of Applied Psychology, 68, 155-165.
8. Chen, P. Y., & Spector, P. E. (1991). Negative affectivity as the underlying cause of correlations between stressors and strains. Journal of Applied Psychology, 76, 398-407.
9. Cornelius, E. T., Denisi, A. S., & Blencoe, A. G. (1984). Expert and naive raters using the PAQ: Does it matter? Personnel Psychology, 37, 453-464.
10. Cornelius, E. T., & Lyness, K. S. (1980). A comparison of holistic and decomposed judgment strategies in job analysis by job incumbents. Journal of Applied Psychology, 65, 155-163.
11. Danserau, F., Jr., Graen, G., & Haga, W. J. (1975). A vertical dyad linkage approach to leadership within formal organizations: A longitudinal investigation of the role making process. Organizational Behavior and Human Performance, 13, 46-78.
12. Ford, J. K., & Noe, R. (1987). Self-assessed training needs: The effects of attitudes towards training, managerial level, and function. Personnel Psychology, 45, 511-527.
13. Ford, J. K., Smith, E. M., Sego, D. J., & Quinones, M. A. (1991). Impact of task experience and individual factors on training-emphasis ratings. Journal of Applied Psychology, 78, 583-590.
14. Friedman, L., & Harvey, R. J. (1986). Can raters with reduced job descriptive information provide accurate position analysis questionnaire (PAQ) ratings? Personnel Psychology, 39, 779-789.
15. Ganzach, Y. (1994). Theory and configurality in expert and layperson judgment. Journal of Applied Psychology, 79, 439-448.
16. Gerhart, B. (1988). Sources of variance in incumbent perceptions of job complexity. Journal of Applied Psychology, 73, 154-162.
17. Goldstein, I. (1986). Training in Organizations. Pacific Grove, CA: Brooks/Cole.
18. Green, S. B., & Stutzman, T. (1986). An evaluation of methods to select respondents to structured job analysis questionnaires. Personnel Psychology, 39, 543-564.
19. Hackman, J. R., & Oldham, G. R. (1975). Development of the Job Diagnostic Survey. Journal of Applied Psychology, 60, 159-170.
20. Harvey, R. J. (1991). Job analysis. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of Industrial and Organizational Psychology, v. 2, chpt. 7. Palo Alto: CPP.
21. Harvey, R. J., & Wilson, M. A. (1994). Assessing the redundancy between dichotomous versus multipoint job analysis scales: The critical role of the does-not-apply rating. Paper presented at the convention of the Society for Industrial and Organizational Psychology, Nashville.
22. Hattie, J., & Cooksey, R. W. (1984). Procedures for assessing the validities of tests using the "known-groups" method. Applied Psychological Measurement, 8, 295-305.
23. Hughes, G. L., & Prien, E. P. (1989). Evaluation of task and job skill linkage judgments used to develop test specifications. Personnel Psychology, 42, 283-292.
24. James, L. R., Demaree, R. G., & Wolf, G. (1984). Estimating within group interrater reliability with and without response bias. Journal of Applied Psychology, 69, 85-98.
25. James, L. R., & Jones, A. P. (1980). Perceived job characteristics and job satisfaction: An examination of reciprocal causation. Personnel Psychology, 33, 97-135.
26. James, L. R., & Tetrick, L. E. (1986). Confirmatory analytic tests of three causal models relating job perceptions to job satisfaction. Journal of Applied Psychology, 71, 77-82.
27. Kozlowski, S. W. J., Kirsch, M. P., & Chao, G. T. (1986). Job knowledge, ratee familiarity, conceptual similarity, and halo error: An exploration. Journal of Applied Psychology, 71, 45-49.
28. Kruglanski, A. W. (1989). The psychology of being "right": The problem of accuracy in social perception and cognition. Psychological Bulletin, 106(3), 395-409.
29. Kunzo, J. P., & York, C. M. (1994). Field data on the assessment of incumbent expertise in job analysis. Paper presented at Society for Industrial and Organizational Psychology, Nashville.
30. Landy, F. (1993). Job analysis and job evaluation: The respondent's perspective. In H. Schuler, J. L. Farr, & M. Smith (Eds.), Personnel selection and assessment. Individual and organizational perspectives (pp. 75-90). Hillsdale, NJ: Lawrence Erlbaum.
31. Landy, F. J., & Farr, J. L. (1980). Performance rating. Psychological Bulletin, 87, 72-107.
32. Landy, F. J., & Vasey, J. (1991). Job analysis: The composition of SME samples. Personnel Psychology, 44, 27-50.
33. Levine, E. L. (1983). Everything you always wanted to know about job analysis. Tampa: Mariner.
34. Mathieu, J. E., Farr, J. L., Shankster, L. J., Landy, F. J., & Kohler, S. S. (1994). An examination of the convergence between incumbents' and managers' job analysis ratings. Paper presented at Society for Industrial and Organizational Psychology, Nashville.
35. Morgeson, F. P., & Campion, M. A. (1997). Social and cognitive sources of potential inaccuracy in job analysis. Journal of Applied Psychology, 82, 627-655.
36. Mumford, M. D., Weeks, J. L., Harding, F. D., & Fleishman, E. A. (1987). Measuring occupational difficulty: A construct validation against training criteria. Journal of Applied Psychology, 72, 578-587.
37. Murphy, K. R. (1991). Criterion issues in performance appraisal research. Organizational Behavior and Human Decision Processes, 50, 45-50.
38. Murphy, K. R., & Cleveland, J. N. (1995). Understanding Performance Appraisal. Thousand Oaks, CA: Sage.
39. O'Connor, E. J., & Barret, G. V. (1980). Informational cues and individual differences as determinants of subjective perceptions of task enrichment. Academy of Management Journal, 23, 697-716.
40. Riggs, M. L. (1989). The development of self-efficacy and outcome scales for general applications. Paper presented at the Annual Conference of The Society for Industrial and Organizational Psychology, Boston, MA.
41. Sanchez, J. I., & Fraser, S. L. (1992). On the choice of scales for task analysis. Journal of Applied Psychology, 77(4), 545-553.
42. Schmitt, N., & Cohen, S. A. (1989). Internal analyses of task ratings by job incumbents. Journal of Applied Psychology, 74, 96-104.
43. Schneider, B. (1987). The people make the place. Personnel Psychology, 40, 437-453.
44. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428.
45. Smith, J. E., & Hakel, M. D. (1979). Convergence among data sources, response bias, and reliability and validity of a structured job analysis questionnaire. Personnel Psychology, 32, 677-693.
46. Society for Industrial and Organizational Psychology (1987). Principles for the Validation and Use of Personnel Selection Procedures. Author.
47. Spector, P. E., & Jex, S. M. (1991). Relations of job characteristics from multiple data sources withe employee affect, absence, turnover intentions, and health. Journal of Applied Psychology, 76, 46-53.
48. Spector, P. E., Jex, S. M., & Chen, P. Y. (1994). Relations of incumbent affect-related personality traits with incumbent and objective measures of characteristics of jobs. Journal of Organizational Behavior, 15, 1-7.
49. Speilberger, C. D., Gorsuch, R. L., & Lushene, R. E. (1970). Manual for the State-Trait Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press, Inc.
50. Staw, B. M., Bell, N. E., & Clausen, J. A. (1986). The dispositional approach to job attitudes: A lifetime longitudinal test. Administrative Science Quarterly, 31, 56-77.
51. Staw, B. M., & Ross, J. (1985). Stability in the midst of change: A dispositional approach to job attitudes. Journal of Applied Psychology, 70, 469-480.
52. Stone, E. F. (1979). Field independence and perceptions of job characteristics: A laboratory investigation. Journal of Applied Psychology, 64, 305-310.
53. Sulsky, L. M., & Balzer, W. K. (1988). Meaning and measurement of rating accuracy: Some methodological and theoretical concerns. Journal of Applied Psychology, 73, 497-506.
54. Taber, T. D., & Taylor, E. (1990). A review and evaluation of the psychometric properties of the Job Diagnostic Survey. Personnel Psychology, 43, 467-500.
55. Viteles, M. J. (1932). Industrial psychology. New York: Norton.
56. U.S. Department of Labor, Manpower Administration (1972). Handbook for analyzing jobs. Washington, D.C.: U.S. Government Printing Office.
57. U.S. Department of Labor (1991). Dictionary of occupational titles (4th ed., revised). Washington, D.C.: U.S. Government Printing Office.
58. Williams, L. J., Gavin, M. B., & Williams, M. L. (1996). Measurement and nonmeasurement processes with negative affectivity and employee attitudes. Journal of Applied Psychology, 81, 88-101.