So many jobs, so little "N": Applying expanded validation models to support generalization of cognitive test validity

Personnel Psychology

Volumn 53, Issue 4, 2000, Pages 955-991

  Hoffman, Calvin C ^a   Holden, Lisa M ^b   Gale, Kelly ^c  

^a Alliant University   (United States)

^b TBA Entertainment   (United States)

^c Aon Consulting   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0034553497     PISSN: 00315826     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1744-6570.2000.tb02426.x     Document Type: Article

References (54)

1. Aldenderfer MS, Blashfield RK. (1984). Cluster analysis. Beverly Hills, CA: Sage.
2. American Gas Association. (1990). American Gas Association Physical Abilities Study (Vol. 2, 3, 4, 5, 8a). Houston, TX: Jeanneret & Associates, Inc.
3. Barrett LE, Driskill WE. (1990, April). Job component validity: Ability requirements for semantic task categories. Paper presented at the Annual Conference of the Society for Industrial and Organizational Psychology, Miami, FL.
4. Binning JF, Barrett GV. (1989). Validity of personnel decisions: A conceptual analysis of the inferential and evidential bases. Journal of Applied Psychology, 74, 478-494.
5. Cascio WF, Valenzi ER, Silbey V. (1978). Validation and statistical power: Implications for applied research. Journal of Applied Psychology, 63, 589-595.
6. Dunnette MD, Borman W. (1979). Personnel selection and classification systems. In Rosenzweig M, Porter L (Eds.), Annual review of psychology, 30 (pp. 477-526).
7. Fine SA. (1962). Functional job analysis as a method of indirect validation: A study in synthetic validation. Unpublished doctoral dissertation, George Washington University, Washington, D.C.
8. Gale K. (1993). System gas dispatcher validation report. Unpublished technical report, Southern California Gas Company, Los Angeles, CA.
9. Gale K. (1995). Customer billing analyst and special account representative validation report. Unpublished technical report, Southern California Gas Company, Los Angeles, CA.
10. Guion RM. (1998). Assessment, measurement, and prediction for personnel decisions. Mahwah, NJ: Erlbaum.
11. Gutenberg RL, Arvey RD, Osburn HG, Jeanneret PR. (1983). Moderating effects of decision-making/information processing job dimensions on test validities. Journal of Applied Psychology, 36, 237-247.
12. Harvey RJ. (1991). Job analysis. In Dunnette MD, Hough LM (Eds.), Handbook of industrial and organizational psychology, 2nd edition. Palo Alto, CA: Consulting Psychologists Press.
13. Hoffman CC. (1988). Job analysis report: Mechanical and maintenance jobs. Unpublished technical report, Southern California Gas Company, Los Angeles, CA.
14. Hoffman CC. (1989). Test validation report: Mechanical and maintenance jobs. Unpublished technical report, Southern California Gas Company, Los Angeles, CA.
15. Hoffman CC. (1994, August). Replicating Hogan's structure of physical performance via the PAQ. Paper presented at the Annual Conference of the American Psychological Association, Los Angeles, CA.
16. Hoffman CC. (1995). Applying range restriction corrections using published norms: Three case studies. PERSONNEL PSYCHOLOGY, 48, 913-923.
17. Hoffman CC. (1999). Generalizing physical ability test validity: A case study using transportability, validity generalization, and construct validation evidence. PERSONNEL PSYCHOLOGY, 52, 1019-1041.
18. Hoffman CC, Haase SL, Babasa B. (2000, April). Using JCV predicted scores in setting test battery cut scores. Practitioner Forum presented at the Annual Conference of the Society for Industrial and Organizational Psychology, New Orleans, LA.
19. Hoffman CC, Nathan BR, Holden LM. (1991). A comparison of validation criteria: Objective versus subjective and self- versus supervisory ratings. PERSONNEL PSYCHOLOGY, 44, 601-619.
20. Hoffman CC, Lamartine SC. (1995, May). Transporting physical ability test validity via the Position Analysis Questionnaire. Paper presented as part of the symposium Current innovations in PAQ-based research and practice, Hoffman CC (chair), at the Annual Conference of the Society for Industrial and Organizational Psychology, Orlando, FL.
21. Hoffman CC, McPhail SM. (1998). Exploring options for supporting test use in situations precluding local validation. PERSONNEL PSYCHOLOGY, 51, 987-1003.
22. Hoffman CC, Stormes JM. (1998). Responding to competitive pressures with integrated human resource systems. In Rothwell WJ, DuBois DD (Eds.), Improving performance in organizations. Alexandria, VA: American Society for Training & Development.
23. Hoffman CC, Thornton GC III. (1997). Examining selection utility where competing predictors differ in adverse impact. PERSONNEL PSYCHOLOGY, 50, 455-470.
24. Hogan J. (1991). Structure of physical performance in occupational tasks. Journal of Applied Psychology, 76, 495-507.
25. Holden LM. (1991). Job analysis of instrument mechanic position and criterion-related validation of selection procedures. Unpublished technical report, Southern California Gas Company, Los Angeles, CA.
26. Holden LM. (1992). Job analysis and validity study for the distribution planning office technical progression. Unpublished technical report, Southern California Gas Company, Los Angeles, CA.
27. Holden LM. (1993). Test transport study for gas storage technician. Unpublished technical report, Southern California Gas Company, Los Angeles, CA.
28. Holden LM. (1995a). Job analysis and test validation for senior appliance service representative and service technician. Unpublished technical report, Southern California Gas Company, Los Angeles, CA.
29. Holden LM. (1995b). Job analysis and test validation study for construction service planner. Unpublished technical report, Southern California Gas Company, Los Angeles, CA.
30. Hunter JE. (1980). Test validation for twelve thousand jobs: An application of job classification and validity generalization analysis to the General Aptitude Test Battery (GATB). Washington, DC: U.S. Employment Service, U.S. Department of Labor.
31. Hunter JE, Hunter RF. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72-98.
32. Jeanneret PR. (1992). Applications of job component/synthetic validity to construct validity. Human Performance, 5, 81-96.
33. Landkammer K. (1994). Job analysis and validity transport study for meter repair technician. Unpublished technical report, Southern California Gas Company, Los Angeles, CA.
34. Landy FJ. (1986). Stamp collecting versus science: Validation as hypothesis testing. American Psychologist, 41, 1183-1192.
35. Lawshe CH, Steinberg M. (1955). Studies in synthetic validity: An exploratory investigation of clerical jobs. PERSONNEL PSYCHOLOGY, 8, 281-301.
36. Lent RH, Aurbach HA, Levin LS. (1971). Research design and validity assessment. PERSONNEL PSYCHOLOGY, 24, 247-274.
37. Marquadt LD, McCormick EJ. (1974). The job dimensions underlying the job elements of the Position Analysis Questionnaire (PAQ Form B; Tech. Rep. No. 4). West Lafayette, IN: Purdue University, Psychological Sciences Department.
38. McCormick EJ, DeNisi AS, Shaw JB. (1979). Use of the Position Analysis Questionnaire for establishing the job component validity of tests. Journal of Applied Psychology, 64, 51-56.
39. McCormick EJ, Jeanneret PR, Mecham RC. (1972). A study of job characteristics and job dimensions based on the Position Analysis Questionnaire (PAQ). Journal of Applied Psychology, 56, 347-368.
40. McCormick EJ, Mecham RC, Jeanneret PR. (1977). Technical manual for the Position Analysis Questionnaire (PAQ). Logan, UT: PAQ Services, Inc.
41. McCormick EJ, Mecham RC, Jeanneret PR. (1989). Technical manual for the Position Analysis Questionnaire (PAQ). Logan, UT: PAQ Services, Inc.
42. McPhail SM. (1995, May). Job component validity predictions compared to empirical validities. Paper presented as part of the symposium Current innovations in PAQ-based research and practice, Hoffman CC (chair), at the Annual Conference of the Society for Industrial and Organizational Psychology, Orlando, FL.
43. Mecham RC, McCormick EJ, Jeanneret PR. (1977). Position Analysis Questionnaire User's Manual (System II). Logan, UT: PAQ Services, Inc.
44. Mecham RC, McCormick EJ. (1969). The use of data based on the Position Analysis Questionnaire in developing synthetically derived attribute requirements of jobs (Technical report No. 4). West Lafayette, IN: Purdue University, Occupational Research Center.
45. Morey LC, Blashfield RK, Skinner HA. (1983). A comparison of cluster analysis techniques within a sequential validation framework. Multivariate Behavioral Research, 18, 309-329.
46. Mossholder KW, Arvey RD. (1984). Synthetic validity: A conceptual and comparative review. Journal of Applied Psychology, 69, 322-333.
47. Murphy KR, Schiarella AH. (1997). Implications of the multidimensional nature of job performance for the validity of selection tests: Multivariate frameworks for studying test validity. PERSONNEL PSYCHOLOGY, 50, 823-854.
48. Palomar J. (1995). Lead customer service representative validation study, unpublished technical report, Southern California Gas Company, Los Angeles, CA.
49. Pearlman K, Schmidt FL, Hunter JE. (1980). Validity generalization results for tests used to predict job proficiency and training success in clerical occupations. Journal of Applied Psychology, 65, 373-406.
50. Primoff ES. (1955). Test selection by job analysis: The J-coefficient, what it is, how it works (Test Technical Series, No. 20). Washington, DC: U.S. Civil Service Commission, Standards Division.
51. Psychological Services, Inc. (1988). Transportability of validity to clerical, secretarial, and administrative positions at Southern California Gas Company. Unpublished technical report, Glendale, CA.
52. Ree MJ, Earles JA. (1992). Predicting training success: Not much more than g. PERSONNEL PSYCHOLOGY, 44, 321-332.
53. Sackett PR. (1991). Exploring strategies for clustering military occupations. In Wigdor AK, Green BF (Eds.), Performance assessment for the workplace (Vol. 2, pp. 305-332), Washington, DC: National Academy Press.
54. Uniform Guidelines on Employee Selection Procedures. (1978). Federal Register, 43, 38289-38309.