Synthetic validity: Past, present, and future

Personnel Psychology

Volumn 58, Issue 2, 2005, Pages 481-515

  Scherbaum, Charles A ^a,b  

^a CITY UNIVERSITY OF NEW YORK   (United States)

^b Box B 8 215 ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 20744455027     PISSN: 00315826     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1744-6570.2005.00547.x     Document Type: Review

References (115)

1. Adams S. (1996). The Dilbert principle. New York: Harper Business.
2. Algera JA, Greuter MA. (1989). Job analysis for personnel selection. In Smith M, Robertson I (Eds.), Advances in selection and assessment (pp. 7-30). Oxford, UK: Wiley.
3. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
4. Arvey RD. (1979). Fairness in selecting employees. Reading MA: Addison-Wesley.
5. Balma MJ. (1959). The development of processes for indirect or synthetic validity: 1. The concept of synthetic validity. A symposium. PERSONNEL PSYCHOLOGY, 72, 395-396.
6. Barrett LE, Driskill WE. (1990, April). Job components validity: Ability requirements for semantic task categories. Paper presented at the 5th Annual Conference of the Society for Industrial and Organizational Psychology, Miami Beach, FL.
7. Borman WC, Motowidlo SJ. (1993). Expanding the criterion domain to include elements of contextual performance. In Schmitt WBN (Ed.), Personnel selection in organizations (pp. 71-98). San Francisco: Jossey-Bass.
8. Brannick MT, Levine EL. (2002). Job Analysis. Thousand Oaks, CA: Sage.
9. Bridges W. (1994). The end of the job. Fortune, 130, 62-74.
10. Brown R, Harvey RJ. (1996, April). Job-component validation using the Myers-Briggs Type Indicator (MBTI) and the Common-Metric Questionnaire (CMQ). Paper presented at the 11th Annual Conference of the Society for Industrial and Organizational Psychology, San Diego.
11. Campbell JP. (1990). Modeling the performance prediction problem in industrial and organizational psychology. In Dunnette MD, Hough LM (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 1, pp. 687-732): Palo Alto, CA: Consulting Psychologists' Press.
12. Campbell JP, McCloy RA, Oppler SH, Sager CE. (1993). A theory of performance. In Schmitt N, Borman W (Eds.), Personnel selection in organizations (pp. 35-70). San Francisco: Jossey-Bass.
13. Cascio WF. (1995). Whither industrial and organizational psychology in a changing world of work? American Psychologist, 50, 928-939.
14. Cascio WF. (1998). Applied psychology in human resource management. Upper Saddle River, NJ: Prentice Hall.
15. Culbertson AL. (1947). The adequacy of an operational checklist for the general description of clerical jobs. Unpublished master's thesis, Purdue University, West Lafayette, IN.
16. Dawes RM. (1979). The robust beauty of improper linear models in decision making. American Psychologist, 34, 571-582.
17. D'Egidio EL. (2001). Building a job component validity model using job analysis data from the occupational information network. Unpublished dissertation. University of Houston, Houston, TX.
18. Drewes DE. (1961). Development and validation of synthetic dexterity tests based on elemental motion analysis. Journal of Applied Psychology, 45, 179-185.
19. Dunnette MD. (1963). A note on the criterion. Journal of Applied Psychology, 47, 317-323.
20. Dunnette MD. (1966). Personnel selection and placement. Belmont, CA: Brooks/Cole.
21. Earles JS, Driskill WE, Dittmar MJ. (1996). Methodology for identifying abilities for job classification: An application of job analysis. Military Psychology, 8, 179-193.
22. Fine SA. (1962). Functional job analysis as a method of indirect validity: A study in synthetic validation. Unpublished dissertation, George Washington University, Washington, DC.
23. Fine SA. (1963). Functional job analysis (FJA) as a method of indirect validity. American Psychologist, 18, 438.
24. Fleetwood R, Field H. (2001). Human resource selection (5th ed.). Cincinnati, OH: Southwestern College Publishers.
25. Fleishman EA. (1975). Manual for Abilities Requirement Scale (MARS). Bethesda, MD: Management Research Institute.
26. Fleishman EA, Mumford MD. (1988). Ability requirement scales. In Gael S (Ed.), The job analysis handbook of business, industry, and government (Vol. 2, pp. 1019-1035). New York: Wiley.
27. Fleishman EA, Quaintance MK. (1984). Taxonomies of human performance. New York: Academic Press.
28. Fleishman EA, Costanza DP, Marshall-Meis J. (1999). Abilities. In Peterson NG, Mumford MD, Borman WC, Jeanneret PR, Fleishman EA (Eds.), An occupational information system for the 21st century: The development of O* NET (pp. 175-195). Washington, DC: American Psychological Association.
29. Ghiselli EE. (1959). The development of processes for indirect or synthetic validity: II. The generalization of validity. A symposium. PERSONNEL PSYCHOLOGY, 12, 397-402.
30. Ghiselli EE, Brown CW. (1955). Personnel and industrial psychology (2nd ed.). New York: McGraw-Hill.
31. Goldstein HW, Zedeck S, Goldstein IL. (2002). g: Is this your final answer? Human Performance, 15, 123-142.
32. Griffin CH. (1959). The development of processes for indirect or synthetic validity: V. Application of motion and time analysis to dexterity tests. A symposium. PERSONNEL PSYCHOLOGY, 72, 418-420.
33. Guion RM. (1965). Synthetic validity in a small company: A demonstration. PERSONNEL PSYCHOLOGY. 18, 49-63.
34. Guion RM. (1976). Recruiting, selection, job placement. In Dunnette MD (Ed.), Handbook of industrial and organizational psychology (pp. 777-828). Chicago: Rand McNally.
35. Guion RM. (1998). Assessment, measurement, and prediction for personnel decisions. Mahwah, NJ: Erlbaum.
36. Hakel MD. (1986). Personnel selection and placement. Annual Review of Psychology, 37, 351-380.
37. Hamilton JW. (1981). Options for small samples in validation: A case for the J-coefficient. PERSONNEL PSYCHOLOGY, 34, 805-816.
38. Hamilton JW, Dickinson TL. (1987). Comparison of several procedures for generating J-coefficients. Journal of Applied Psychology, 72, 49-54.
39. Harvey RJ. (1991a). The Common-Metric Questionnaire (CMQ): A job analysis system. San Antonio, TX: The Psychological Corporation.
40. Harvey RJ. (1991b). Job analysis. In Dunnette MD, Hough LM (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 2, pp. 71-163). Palo Alto, CA: Consulting Psychologists Press.
41. Hesketh B, Robertson I. (1993). Validating personnel selection: A process model for research and practice. Validating Personnel Selection, 1, 3-17.
42. Hess LR. (1973). Synthetic validity: A means of meeting EEOC test validation requirements? Training and Development Journal, 27, 48-50.
43. Hoffman CC. (1999). Generalizing physical ability test validity: A case study using test transportability, validity generalization, and construct-related validation evidence. PERSONNEL PSYCHOLOGY, 52, 1019-1041.
44. Hoffman CC, Holden LM, Gale K. (2000). So many jobs, so little "N": Applying expanded validation models to support generalization of cognitive test validity. PERSONNEL PSYCHOLOGY, 53, 955-991.
45. Hoffman CC, McPhail SM. (1998). Exploring options for supporting test use in situations precluding local validation. PERSONNEL PSYCHOLOGY, 57, 987-1003.
46. Hoffman CC, Morris DC. (2003, April). Testing a proposed method for estimating JCV battery validity. Poster presented at the 18th Annual Conference of the Society for Industrial and Organizational Psychology, Orlando, FL.
47. Hofmann DA. (1997). An overview of the logic and rationale of hierarchical linear models. Journal of Management, 23, 723-744.
48. Hollenbeck JR, Whitener EM. (1988). Criterion-related validation for small sample contexts: An integrated approach to synthetic validity. Journal of Applied Psychology, 73, 536-544.
49. Hough LM. (2001). I/Owes its advances to personality. In Roberts BW, Hogan RT (Eds.), The intersection of personality and industrial/organizational psychology (pp. 19-44). Washington, DC: American Psychological Association.
50. Hough LM, Ones DS. (2001). The structure, measurement, validity, and use of personality variables in industrial, work, and organizational psychology. In Anderson NR, Ones DS, Sinangil HK, Viswesvaran C (Eds.), Handbook of work psychology (pp. 233-277). New York: Sage.
51. Hough LM, Oswald FL. (2000). Personnel selection: Looking toward the future - Remembering the past. Annual Review of Psychology, 51, 631-664.
52. Jago IA. (1995). Methods for estimating test validity: An examination of empirical and synthetic techniques. Unpublished dissertation, University of Georgia, Athens, GA.
53. Jeanneret PR. (1992). Applications of job component/synthetic validity to construct validity. Human Performance, 5, 81-96.
54. Jeanneret PR, Strong MH. (2003). Linking O* NET job analysis information to job requirement predictors: An O* NET application. PERSONNEL PSYCHOLOGY, 56, 465-492.
55. Johnson JW, Carter GW, Dorsey DW. (2003, April). Linking O* NET descriptors to occupational aptitudes using job component validation. Poster presented at the 18th Annual Conference of the Society for Industrial and Organizational Psychology, Orlando, FL.
56. Johnson JW, Carter GW, Davison HK, Oliver DH. (2001). A synthetic validity approach to testing differential prediction hypotheses. Journal of Applied Psychology, 86, 774-780.
57. Johnson JW, Carter GW, Tippins NT. (2001, April). A synthetic validation approach to the development of a selections system for multiple job families. In Johnson J, Carter G (Chairs), Advances in the application of synthetic validity. Symposium conducted at the 16th Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA.
58. Kintop CL, Mussio SJ. (1974). The validation of selection devices for high level clerical classifications: A demonstration in the use of synthetic validity and work sample tests. Division of Personnel Research, City of Minneapolis, Civil Service Commission.
59. Lawshe CH. (1952). Employee selection. PERSONNEL PSYCHOLOGY, 6, 31-34.
60. Lawshe CH, Steinberg MD. (1955). Studies in synthetic validity. I. An exploratory investigation of clerical jobs. PERSONNEL PSYCHOLOGY, 8, 291-301.
61. McCloy RA. (1994). Predicting job performance scores without performance data. In Green BF, Mavor AS (Eds.), Modeling cost and performance for military enlistment: Report of a workshop. Washington, DC: National Academy Press.
62. McCloy RA. (2001, April). Predicting job performance scores in jobs lacking criterion data. In Johnson J, Carter G (Chairs), Advances in the application of synthetic validity. Symposium conducted at the 16th Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA.
63. McCloy et al. v. Willamette Industries (2002). United States District Court for the Southern District of Georgia, Savannah Division.
64. McCormick EJ. (1959). The development of processes for indirect or synthetic validity: III. Application of job analysis to indirect validity. A symposium. PERSONNEL PSYCHOLOGY, 72, 402-413.
65. McCormick EJ. (1976). Job and task analysis. In Dunnette MD (Ed.), Handbook of industrial and organizational psychology (pp. 651-696). Chicago: Rand McNally.
66. McCormick EJ, Cunningham JW, Thornton GC. (1967). The prediction of job requirements by a structured job analysis procedure. PERSONNEL PSYCHOLOGY, 20, 431-440.
67. McCormick EJ, DeNisi AS, Shaw JB. (1979). Use of the position analysis questionnaire for establishing the job component validity of tests. Journal of Applied Psychology, 64, 51-56.
68. McCormick EJ, Jeanneret PR, Mecham RC. (1972). A study of job characteristics and job dimensions as based on the position analysis questionnaire (PAQ). Journal of Applied Psychology, 56, 347-368.
69. McCormick EJ, Mecham RC. (1970). Job analysis data as the basis for synthetic test validity. Psychology Annual, 4, 30-35.
70. McCormick EJ, Mecham RC, Jeanneret PR. (1989). Technical manual for the Position Analysis Questionnaire (2nd ed.). Logan, UT: PAQ Services, Inc.
71. Mecham RC. (1985, August). Comparative effectiveness of situational, generalized, and job component validation methods. In Jeanneret PR (Chair), Job component validity: Job requirements, estimates, and validity generalization comparisons. Symposium Conducted at the Annual Convention of the American Psychological Association, Los Angeles.
72. Meehl P. (1954). Clinical versus statistical prediction: A theoretical analysis and a review of the evidence. Minneapolis, MN: University of Minnesota.
73. Messick S. (1981). Constructs and their vicissitudes in educational and psychological assessment. Psychological Bulletin, 89, 575-588.
74. Messick S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749.
75. Morris DC, Hoffman CC, Shultz KS. (2002). Exploring job components: Comparing JCV estimates to meta-analytic validity estimates, and developing JCV battery validity estimates. Unpublished manuscript.
76. Morris DC, Hoffman CC, Shultz KS. (2003, April). A comparison of job components validity estimates to meta-analytic validity estimates. Poster presented at the 18th Annual Conference of the Society for Industrial and Organizational Psychology, Orlando, FL.
77. Mossholder KW, Arvey RD. (1984). Synthetic validity: A conceptual and comparative review. Journal of Applied Psychology, 69, 322-333.
78. Murphy KR, Shiarella AH. (1997). Implications of the multidimensional nature of job performance for the validity of selection tests: Multivariate frameworks for studying test validity. PERSONNEL PSYCHOLOGY, 50, 823-854.
79. Nathan BR, Alexander RA. (1988). A comparison of criteria for test validation: A metaanalytic investigation. PERSONNEL PSYCHOLOGY, 41, 517-535.
80. Nunnally JC. (1978). Introduction to psychological measurement (2nd ed.). New York: McGraw-Hill.
81. Olsen HC, Fine SA, Meyers DC, Jennings MC. (1981). The use of the functional job analysis in establishing performance standards for heavy equipment operators. PERSONNEL PSYCHOLOGY, 34, 351-364.
82. Pearlman K. (1980). Job families: A review and discussion of their implications for personnel selection. Psychological Bulletin, 87, 1-28.
83. Pearlman K, Schmidt FL, Hunter JE. (1980). Validity generalization results for tests used to predict job proficiency and training success in clerical occupations. Journal of Applied Psychology, 65, 373-406.
84. Peterson NJ, Wise LL, Arabian J, Hoffman G. (2001). Synthetic validation and validity generalization: When empirical validation is not possible. In Campbell J, Knapp D (Eds.), Exploring the limits of personnel selection and classification (pp. 411-451). Mahwah, NJ: Erlbaum.
85. Primoff ED. (1955). Test selection by job analysis: The J-coefficient, what it is how it works (Test technical Series, No. 20). Washington, D C: U.S. Civil Service Commission, Standards Division.
86. Primoff ED. (1957). The J-Coefficient approach to jobs and tests. Personnel Administrator, 20, 31-40.
87. Primoff ES. (1959). Empirical validation of the J-coefficient. PERSONNEL PSYCHOLOGY, 72, 413-418.
88. Primoff ES. (1980). The use of self-assessments in examining. PERSONNEL PSYCHOLOGY, 33, 283-290.
89. Pulakos ED, Borman WC, Hough LM. (1988). Test validation for scientific understanding: Two demonstrations of an approach to studying predictor-criterion linkages. PERSONNEL PSYCHOLOGY, 47, 703-716.
90. Raymark PH, Schmit MJ, Guion RM. (1997). Identifying potentially useful personality constructs for employee selection. PERSONNEL PSYCHOLOGY, 50, 723-736.
91. Sackett PR. (1991). Exploring strategies for clustering military occupations. In Wigdor A, Green B (Eds.), Performance assessment for the workplace (Vol. 2, pp. 305-332). Washington, DC: National Academy Press.
92. Sackett PR, Arvey RD. (1993). Selection in small n settings. In Schmitt N, Borman W (Eds.), Personnel selection in organizations (pp. 418-447). San Francisco: Jossey-Bass.
93. Sawyer J. (1966). Measurement and prediction, clinical and statistical. Psychological Bulletin, 66, 178-200.
94. Schmitt N, Chan D. (1998). Personnel selection: A theoretical approach. Thousand Oaks, CA: Sage.
95. Schmidt FL, Hunter JE. (1977). Development of a general solution to the problem of validity generalization. Journal of Applied Psychology, 62, 529-540.
96. Schmidt FL, Hunter JE. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262-274.
97. Schmidt FL, Hunter JE, Groll PR, McKenzie RC. (1983). Estimation of employment test validities by expert judgment. Journal of Applied Psychology, 68, 590-601.
98. Schmidt FL, Hunter JE, Pearlman K. (1981). Task differences and validity of aptitude tests in selection: A red herring. Journal of Applied Psychology, 66, 166-185.
99. Schmitt N, Robertson I. (1990). Personnel selection. Annual Review of Psychology, 41, 289-319.
100. Schneider B. (1976). Staffing organizations. Pacific Palisades, CA: Goodyear Publishing.
101. Schneider RJ, Hough LM, and Dunnette MD. (1996). Broadsided by broad traits: How to sink science in five dimensions or less. Journal of Organizational Behavior, 17, 639-655.
102. Sells SB. (1966). Multivariate technology in industrial and organizational psychology. In Cattell RB (Ed.), Handbook of multivariate experimental psychology (pp. 841-855). Chicago: Rand McNally.
103. Society for Industrial and Organizational Psychology (2003). Principles for the validation and use of personnel selection procedures. Bowling Green, OH: STOP.
104. Sparrow J. (1989). The utility of PAQ in relating job behaviours to traits. Journal of Occupational Psychology, 62, 151-162.
105. Sparrow J, Patrick J, Spurgeon P, Barwell F. (1982). The use of job components analysis and related aptitudes in personnel selection. Journal of Occupational Psychology, 55, 157-164.
106. Taylor v. James River Corporation (1989). CA 88-0818-T-C (TC) (S. D. AL, 1989).
107. Tenopyr ML, Oeltjen PD. (1982). Personnel selection and classification. Annual Review of Psychology, 35, 581-618.
108. Trattner MH. (1982). Synthetic validity and its application to the uniform guidelines validation requirements. PERSONNEL PSYCHOLOGY, 35, 383-397.
109. Turban DB, Sanders PA, Francis DJ, Osburn HG. (1989). Construct equivalence as an approach to replacing validated cognitive ability selection tests. Journal of Applied Psychology, 74, 62-71.
110. Uniform guidelines on employee selection procedures. (1978). Federal Register, 43(166), 38295-38309.
111. Varca PE, Pattison P. (1993). Evidentiary standards in employment discrimination: A view toward the future. PERSONNEL PSYCHOLOGY, 46, 239-258.
112. Wagner TA, Harvey RJ. (2004, April). Job-component validation using CMQ and O* NET: Assessing the additivity assumption. Paper presented at the 19th Annual Conference of the Society for Industrial and Organizational Psychology, Chicago.
113. Wagner TA, Harvey RJ. (2005, April). JCV predicting worker-trait requirements from the CMQ job analysis ratings. Paper Presented at the 20th Annual Conference of the Society for Industrial and Organizational Psychology, Los Angeles.
114. Wilk SL, Desmarias L, Sackett PR. (1995). Gravitation to jobs commensurate with ability: Longitudinal and cross-sectional tests. Journal of Applied Psychology, 80, 79-85
115. Wise LL, Campbell JP, Arabian JM. (1988). The Army synthetic validation project. In Green B, Wing H, Wigdor A (Eds.), Linking military enlistments standards to job performance: Report of a workshop. Washington, DC: National Academy Press.