Measurement Invariance Versus Selection Invariance: Is Fair Selection Possible?

Psychological Methods

Volumn 13, Issue 2, 2008, Pages 75-98

  Borsboom, Denny ^a   Romeijn, Jan Willem ^b   Wicherts, Jelte M ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

fairness; measurement invariance; psychometrics; selection invariance; testing

Indexed keywords

ARTICLE; DECISION MAKING; HUMAN; PSYCHOLOGICAL MODEL; PSYCHOMETRY;

CHOICE BEHAVIOR; HUMANS; MODELS, PSYCHOLOGICAL; PSYCHOMETRICS;

EID: 45449089872     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.13.2.75     Document Type: Article

References (47)

1. Aguinis H., and Smith M.E. Understanding the impact of test validity and bias on selection errors and adverse impact in human resource selection. Personnel Psychology 60 (2007) 165-199
2. American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. Standards for educational and psychological testing. 2nd ed. (1999), American Psychological Association, Washington, DC
3. Birnbaum M.H. Procedures for the detection and correction of salary inequities. In: Pezzullo T.R., and Brittingham B.E. (Eds). Salary equity (1979), Lexington Books, Lexington, MA 121-144
4. Borsboom D. Measuring the mind: Conceptual issues in contemporary psychometrics (2005), Cambridge University Press, Cambridge, United Kingdom
5. Campbell J.P. Group differences and personnel decisions: Validity, fairness, and affirmative action. Journal of Vocational Behavior 49 (1996) 122-158
6. Cleary T.A. Test bias: Prediction of grades of Negro and White students in integrated colleges. Journal of Educational Measurement 5 (1968) 115-124
7. Cole N.S. Bias in selection. Journal of Educational Measurement 10 (1973) 237-255
8. Darlington R.B. Another look at "culture fairness.". Journal of Educational Measurement 8 (1971) 71-82
9. Eggen T.J.M., and Straetmans G.J.J.M. Computerized adaptive testing for classifying examinees into three categories. Educational and Psychological Measurement 60 (2000) 713-734
10. Evers A., Te Nijenhuis J., and Van der Flier H. Ethnic bias and fairness in personnel selection: Evidence and consequences. In: Evers A., Anderson N., and Voskuijl O.F. (Eds). The Blackwell handbook of personnel selection (2005), Blackwell, Oxford, United Kingdom 306-328
11. Gamliel E., and Cahan S. Mind the gap: Between-group differences and fair test use. International Journal of Selection and Assessment 15 (2007) 273-282
12. Holland P.W., and Wainer H. Differential item functioning (1993), Erlbaum, Hillsdale, NJ 197-239
13. Hunter J.E., and Schmidt F.L. Racial and gender bias in ability and achievement tests. Psychology, Public Policy, and Law 6 (2000) 151-158
14. Hunter J.E., Schmidt F.L., and Rauschenberger J. Methodological and statistical issues in the study of bias in mental testing. In: Reynolds C.R., and Brown R.T. (Eds). Perspectives on bias in mental testing (1984), Plenum Press, New York 41-99
15. Kelley T.L. Interpretation of educational measurements (1927), Macmillan, New York
16. Kotz S., Balakrishnan N., and Johnson N.L. Continuous multivariate distributions. 2nd ed. (2000), Wiley, New York
17. Lewis C., and Sheehan K. Using Bayesian decision theory to design a computerized mastery test. Applied Psychological Measurement 14 (1990) 367-386
18. Linn R.L. Pearson selection formulas: Implications for studies of predictive bias and estimates of educational effects in selected samples. Journal of Educational Measurement 20 (1983) 1-15
19. Linn R.L., and Werts C.E. Considerations for studies of test bias. Journal of Educational Measurement 8 (1971) 1-4
20. Lord F.M., and Novick M.R. Statistical theories of mental test scores (1968), Addison-Wesley, Oxford, United Kingdom
21. Mellenbergh G.J. Item bias and item response theory. International Journal of Educational Research 13 (1989) 127-143
22. Mellenbergh G.J. A unidimensional latent trait model for continuous item responses. Multivariate Behavioral Research 19 (1994) 223-236
23. Mellenbergh G.J. Measurement precision in test score and item response models. Psychological Methods 1 (1996) 293-299
24. Meredith W. Measurement invariance, factor analysis, and factorial invariance. Psychometrika 58 (1993) 525-543
25. Miller E.M. The relevance of group membership for personnel selection: A demonstration using Bayes' theorem. Journal of Social, Political, and Economic Studies 19 (1994) 323-359
26. Millsap R.E. Invariance in measurement and prediction: Their relationship in the single-factor case. Psychological Methods 2 (1997) 248-260
27. Millsap R.E. Group differences in regression intercepts: Implications for factorial invariance. Multivariate Behavioral Research 33 (1998) 403-424
28. Millsap R.E. Invariance in measurement and prediction revisited. Psychometrika 72 (2007) 461-473
29. Millsap R.E., and Everson H.T. Methodology review: Statistical approaches for assessing bias. Applied Psychological Measurement 17 (1993) 297-334
30. Millsap R.E., and Kwok O. Evaluating the impact of partial factorial invariance on selection in two populations. Psychological Methods 99 (2004) 93-115
31. Neisser U., Boodoo G., Bouchard T.J., Boykin A., Brody N., Ceci S.J., et al. Intelligence: Knowns and unknowns. American Psychologist 51 (1996) 77-101
32. Petersen N.S., and Novick M.R. An evaluation of some models for culture-fair selection. Journal of Educational Measurement 13 (1976) 3-29
33. Reilly R.R. A note on minority group bias studies. Psychological Bulletin 80 (1973) 130-133
34. Rushton J.P., and Jensen A.R. Thirty years of research on race differences in cognitive ability. Psychology, Public Policy, and Law 11 (2005) 235-294
35. Sackett P.R., and Wilk S.L. Within-group norming and other forms of score adjustment in pre-employment testing. American Psychologist 49 (1994) 929-954
36. Simpson E.H. The interpretation of interaction in contingency tables. Journal of the Royal Statistical Society 13 (1951) 238-241
37. Society for Industrial and Organizational Psychology. Principles for validation and use of personnel selection procedures (2003). http://siop.org/_principles/principles.pdf Retrieved from http://siop.org/_principles/principles.pdf
38. Spray J.A., and Reckase M.D. Comparison of SRPT and sequential Bayes procedures for classifying examinees into two categories using a computerized test. Journal of Educational and Behavioral Statistics 21 (1996) 405-414
39. Steele C.M. A threat in the air: How stereotypes shape intellectual identity and performance. American Psychologist 52 (1997) 613-629
40. Thorndike R.L. Concepts of culture fairness. Journal of Educational Measurement 8 (1971) 63-70
41. Vos H.J. Applications of Bayesian decision theory to sequential mastery testing. Journal of Educational and Behavioral Statistics 24 (1999) 271-292
42. Wainer H. Kelley's paradox. Chance 13 (2000) 47-48
43. Wainer H. Graphic discovery (2005), Princeton University Press, Princeton, NJ
44. Wainer H., and Brown L.M. Two statistical paradoxes in the interpretation of group differences: Illustrated with medical school admission and licensing data. The American Statistician 58 (2004) 117-123
45. Weiss D.J., and Kingsbury G.G. Application of computerized adaptive testing to educational problems. Journal of Educational Measurement 21 (1984) 361-375
46. Willingham W.W., Pollack J.M., and Lewis C. Grades and test scores: Accounting for observed differences. Journal of Educational Measurement 39 (2002) 1-37
47. Yule G.H. Notes on the theory of association of attributes in statistics. Biometrika 2 (1903) 121-134