Designing Pareto-Optimal Selection Systems: Formalizing the Decisions Required for Selection System Development

Journal of Applied Psychology

Volumn 96, Issue 5, 2011, Pages 907-926

  De Corte, Wilfried ^a   Sackett, Paul R ^b   Lievens, Filip ^a  

^a GHENT UNIVERSITY   (Belgium)

^b UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Adverse impact; Pareto optimal; Personnel selection; Selection design

Indexed keywords

ARTICLE; HUMAN; METHODOLOGY; PERSONNEL MANAGEMENT; PSYCHOLOGICAL MODEL; STANDARD;

HUMANS; MODELS, PSYCHOLOGICAL; PERSONNEL SELECTION; RESEARCH DESIGN;

EID: 80052827069     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0023298     Document Type: Article

References (32)

1. Bobko P., Roth P.L., Buster M.A. The usefulness of unit weights in creating composite scores. A literature review, application to content validity, and meta-analysis. Organizational Research Methods 2007, 10:689-709. 10.1177/1094428106294734.
2. Boggs P.T., Tolle J.W. Sequential quadratic programming. Acta Numerica 1995, 4:1-51. 10.1017/S0962492900002518.
3. Das I., Dennis J.E. Normal-boundary intersection: A new method for generating the Pareto surface in nonlinear multicriteria optimization problems. SIAM Journal on Optimization 1998, 8:631-657. 10.1137/S1052623496307510.
4. Day N.E. Estimating components of a mixture of normal distributions. Biometrika 1969, 56:463-474. 10.1093/biomet/56.3.463.
5. De Corte W., Lievens F., Sackett P.R. Predicting adverse impact and multistage mean criterion performance in selection. Journal of Applied Psychology 2006, 91:523-537. 10.1037/0021-9010.91.3.523.
6. De Corte W., Lievens F., Sackett P.R. Combining predictors to achieve optimal trade-offs between selection quality and adverse impact. Journal of Applied Psychology 2007, 92:1380-1393. 10.1037/0021-9010.92.5.1380.
7. De Corte W., Lievens F., Sackett P.R. Validity and adverse impact potential of predictor composite formation. International Journal of Selection and Assessment 2008, 16:183-194. 10.1111/j.1468-2389.2008.00423.x.
8. De Corte W., Sackett P.R., Lievens F. Selecting predictor subsets considering validity and adverse impact. International Journal of Selection and Assessment 2010, 18:260-270. 10.1111/j.1468-2389.2010.00509.x.
9. Doverspike D., Winter J.L., Healy M.C., Barrett G.V. Simulations as a method of illustrating the impact of differential weights on personnel selection outcomes. Human Performance 1996, 9:259-273. 10.1207/s15327043hup0903_5.
10. Finch D.M., Edwards B.D., Wallace J.C. Multistage selection strategies: Simulating the effects on adverse impact and expected performance for various predictor combinations. Journal of Applied Psychology 2009, 94:318-340. 10.1037/a0013775.
11. Hedges L.V., Olkin I. Statistical methods for meta-analysis 1985, Academic Press, Orlando, FL.
12. Hong S. Generating correlation matrices with model error for simulation studies in factor analysis: A combination of the Tucker-Koopman-Linn model and Wijsman's algorithm. Behavior Research Methods, Instruments, & Computers 1999, 31:727-730. 10.3758/BF03200754.
13. Johnson, J. W., Abrahams, N., & Held, J. D. (2004). A procedure for selecting predictors considering validity and adverse impact. Poster presented at the 19th Annual Conference of the Society for Industrial and Organizational Psychology, Chicago, IL.
14. Kehoe J.F. Commentary on Pareto-optimality as a rationale for adverse impact reduction: What would organizations do?. International Journal of Selection and Assessment 2008, 16:195-200. 10.1111/j.1468-2389.2008.00424.x.
15. Landy F.J., Conte J.M. Work in the 21st century: An introduction to industrial and organizational psychology 2007, Blackwell, Malden, MA. 2nd ed.
16. Mardia K.V., Kent J.T., Bibby J.M. Multivariate analysis 1988, Academic Press, New York, NY.
17. McFarland L.A., Ryan A.M. Variance in faking across noncognitive measures. Journal of Applied Psychology 2000, 85:812-821. 10.1037/0021-9010.85.5.812.
18. Messac A., Ismail-Yahaya A., Mattson C.A. The normalized normal constraint method for generating the Pareto frontier. Structural and Multidisciplinary Optimization 2003, 25:86-98. 10.1007/s00158-002-0276-1.
19. Murphy K.R. When your top choice turns you down-Effect of rejected offers on the utility of selection tests. Psychological Bulletin 1986, 99:133-138. 10.1037/0033-2909.99.1.133.
20. Newman D.A., Lyon J.S. Recruitment efforts to reduce adverse impact: Targeted recruiting for personality, cognitive ability, and diversity. Journal of Applied Psychology 2009, 94:298-317. 10.1037/a0013472.
21. Ones D.S., Viswesvaran C. Gender, age, and race differences on overt integrity tests: Results across four large-scale job applicant data sets. Journal of Applied Psychology 1998, 83:35-42. 10.1037/0021-9010.83.1.35.
22. Ones D.S., Viswesvaran C., Schmidt F.L. Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance. Journal of Applied Psychology 1993, 78:679-703. 10.1037/0021-9010.78.4.679.
23. Ployhart R.E., Holtz B.C. The diversity-validity dilemma: Strategies for reducing racioethnic and sex subgroup differences and adverse impact in selection. Personnel Psychology 2008, 61:153-172. 10.1111/j.1744-6570.2008.00109.x.
24. Potosky D., Bobko P., Roth P.L. Forming composites of cognitive ability and alternative measures to predict job performance and reduce adverse impact: Corrected estimates and realistic expectations. International Journal of Selection and Assessment 2005, 13:304-315. 10.1111/j.1468-2389.2005.00327.x.
25. Potosky D., Bobko P., Roth P.L. Some comments on Pareto thinking, test validity, and adverse impact: When " and" is optimal and " or" is a trade-off. International Journal of Selection and Assessment 2008, 16:201-205. 10.1111/j.1468-2389.2008.00425.x.
26. Sackett P.R., De Corte W., Lievens F. Pareto-optimal predictor composite formation: A complementary approach to alleviating the selection quality/adverse impact dilemma. International Journal of Selection and Assessment 2008, 16:206-209. 10.1111/j.1468-2389.2008.00426.x.
27. Sackett P.R., Roth L. Multi-stage selection strategies: A Monte Carlo investigation of effects on performance and minority hiring. Personnel Psychology 1996, 49:549-572. 10.1111/j.1744-6570.1996.tb01584.x.
28. Sackett P.R., Wanek J.E. New developments in the use of measures of honesty, integrity, conscientiousness, dependability, trustworthiness, and reliability for personnel selection. Personnel Psychology 1996, 49:787-829. 10.1111/j.1744-6570.1996.tb02450.x.
29. Schmidt F.L., Hunter J. The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin 1998, 124:262-274. 10.1037/0033-2909.124.2.262.
30. Schmitt N., Ployhart R.E. Estimates of cross-validity for stepwise regression and with predictor selection. Journal of Applied Psychology 1999, 84:50-57. 10.1037/0021-9010.84.1.50.
31. Tam A.P., Murphy K.R., Lyall J.T. Can changes in differential dropout rates reduce adverse impact? A computer simulation study of a multi-wave selection system. Personnel Psychology 2004, 57:905-934. 10.1111/j.1744-6570.2004.00010.x.
32. Van Iddekinge C.H., Raymark P.H., Eidson C.E., Attenweiler W.J. What do structured selection interviews really measure? The construct validity of behavior description interviews. Human Performance 2004, 17:71-93. 10.1207/S15327043HUP1701_4.