The importance of measurement invariance in neurocognitive ability testing

Clinical Neuropsychologist

Volumn 30, Issue 7, 2016, Pages 1006-1016

  Wicherts, Jelte M ^a  

^a TILBURG UNIVERSITY   (Netherlands)

Author keywords

differential item functioning; IQ tests; measurement equivalence; Measurement invariance; test fairness

Indexed keywords

ETHNICITY; GENDER; HUMAN; INTELLIGENCE QUOTIENT; PROFESSIONAL PRACTICE; ADULT; COGNITION; ETHNIC GROUP; FEMALE; INTELLIGENCE TEST; MALE; NEUROPSYCHOLOGICAL TEST; PSYCHOLOGY; REPRODUCIBILITY; STANDARDS; WECHSLER INTELLIGENCE SCALE;

ADULT; COGNITION; ETHNIC GROUPS; FEMALE; HUMANS; INTELLIGENCE TESTS; MALE; NEUROPSYCHOLOGICAL TESTS; REPRODUCIBILITY OF RESULTS; WECHSLER SCALES;

EID: 84976601003     PISSN: 13854046     EISSN: 17444144     Source Type: Journal    
DOI: 10.1080/13854046.2016.1205136     Document Type: Review

References (33)

1. F.J.Abad, M.A.Sorrel, F.J.Roman, & R.Colom, (in press). The relationships between WAIS-IV factor index scores and educational level:A bifactor model approach. Psychological Assessment. doi:10.1037/pas0000228
2. D.Borsboom, (2006). When does measurement invariance matter? Medical Care, 44, S176–S181. doi:10.1097/01.mlr.0000245143.08679.cc
3. D.Borsboom, G.J.Mellenbergh, & J.V.Heerden, (2004). The concept of validity. Psychological Review, 111, 1061–1071.10.1037/0033-295X.111.4.1061
4. B.M.Byrne, R.J.Shavelson, & B.Muthén, (1989). Testing for the equivalence of factor covariance and mean structures:The issue of partial measurement invariance. Psychological Bulletin, 105, 456–466.10.1037/0033-2909.105.3.456
5. H.Chen, O.Zhang, S.E.Raiford, J.Zhu, & L.G.Weiss, (2015). Factor invariance between genders on the Wechsler intelligence scale for children-fifth edition. Personality and Individual Differences, 86, 1–5. doi:10.1016/j.paid.2015.05.020
6. H.Chen, & J.Zhu, (2012). Measurement invariance of WISC-IV across normative and clinical samples. Personality and Individual Differences, 52, 161–166. doi:10.1016/j.paid.2011.10.006
7. C.V.Dolan, (2000). Investigating Spearman’s hypothesis by means of multi-group confirmatory factor analysis. Multivariate Behavioral Research, 35, 21–50. doi:10.1207/S15327906MBR3501_2
8. C.V.Dolan, R.Colom, F.J.Abad, J.M.Wicherts, D.J.Hessen, & S.van de Sluis, (2006). Multi-group covariance and mean structure modeling of the relationship between the WAIS-III common factors and sex and educational attainment in Spain. Intelligence, 34, 193–210. doi:10.1016/j.intell.2005.09.003
9. C.V.Dolan, W.Roorda, & J.M.Wicherts, (2004). Two failures of Spearman’s hypothesis:The GATB in Holland and the JAT in South Africa. Intelligence, 32, 155–173. doi:10.1016/j.intell.2003.09.001
10. A.Evers, J.Te Nijenhuis, & H.Van der Flier, (2005). Ethnic bias and fairness in personnel selection:Evidence and consequences. In A.Evers, N.Anderson, & O.F.Voskuijl (Eds.), The Blackwell handbook of personnel selection (pp. 306–328). Oxford:Blackwell.10.1111/b.9781405117029.2005.x
11. J.R.Flynn, (1984). The mean IQ of Americans:Massive gains 1932 to 1978. Psychological Bulletin, 95, 29–51.10.1037/0033-2909.95.1.29
12. J.R.Flynn, (1987). Massive IQ gains in 14 nations:What IQ tests really measure. Psychological Bulletin, 101, 171–191.10.1037/0033-2909.101.2.171
13. M.C.Fox, & A.L.Mitchum, (2012). A knowledge-based theory of rising scores on “culture-free” tests. Journal of Experimental Psychology:General, 142, 979–1000. doi:10.1037/a0030155
14. P.W.Holland, & H.Wainer, (Eds.). (1993). Differential item functioning. Hillsdale, NJ:Lawrence Erlbaum Associates.
15. K.S.McGrew, (2009). CHC theory and the human cognitive abilities project:Standing on the shoulders of the giants of psychometric intelligence research. Intelligence, 37(1), 1–10. doi:10.1016/j.intell.2008.08.004
16. G.J.Mellenbergh, (1989). Item bias and item response theory. International Journal of Educational Research, 13, 127–143.10.1016/0883-0355(89)90002-5
17. W.Meredith, (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525–543. doi:10.1007/BF02294825
18. R.E.Millsap, (2009). Statistical approaches to measurement invariance. New York, NY:Routledge.
19. R.E.Millsap, & H.T.Everson, (1993). Methodology review:Statistical approaches for assessing measurement bias. Applied Psychological Measurement, 17, 297–334.10.1177/014662169301700401
20. R.E.Millsap, & O.M.Kwok, (2004). Evaluating the impact of partial factorial invariance on selection in two populations. Psychological Methods, 9, 93–115.10.1037/1082-989X.9.1.93
21. C.R.Niileksela, M.R.Reynolds, & A.S.Kaufman, (2013). An alternative Cattell–Horn–Carroll (CHC) factor structure of the WAIS-IV:Age invariance of an alternative model for ages 70–90. Psychological Assessment, 25, 391–404. doi:10.1037/a0031175
22. M.R.Reynolds, P.B.Ingram, J.S.Seeley, & K.D.Newby, (2013). Investigating the structure and invariance of the Wechsler adult intelligence scales, fourth edition in a sample of adults with intellectual disabilities. Research in Developmental Disabilities, 34, 3235–3245. doi:10.1016/j.ridd.2013.06.029
23. A.B.Shuttleworth Edwards, (in press). Generally representative is representative of none:Commentary on the pitfalls of IQ test standardization in multicultural settings. The Clinical Neuropsychologist.
24. N.Taylor, (2008). Raven’s standard and advanced progressive matrices among adults in South-Africa. In J.Raven & J.Raven (Eds.), Uses and abuses of intelligence. Studies advancing Spearman and Raven’s quest for non-arbitrary metrics (pp. 371–391). Unionville, NY:Royal Fireworks Press.
25. J.Te Nijenhuis, M.J.De Jong, A.Evers, & H.van der Flier, (2004). Are cognitive differences between immigrant and majority groups diminishing? European Journal of Personality, 18, 405–434.10.1002/(ISSN)1099-0984
26. M.Tommasi, L.Pezzuti, R.Colom, F.J.Abad, A.Saggino, & A.Orsini, (2015). Increased educational level is related with higher IQ scores but lower g-variance:Evidence from the standardization of the WAIS-R for Italy. Intelligence, 50, 68–74. doi:10.1016/j.intell.2015.02.005
27. S.van der Sluis, D.Posthuma, C.V.Dolan, E.J.C.de Geus, R.Colom, & D.I.Boomsma, (2006). Sex differences on the Dutch WAIS-III. Intelligence, 34, 273–289. doi:10.1016/j.intell.2005.08.002
28. D.Wechsler, (1997). Wechsler adult intelligence scale-third edition. San Antonio, TX:The Psychological Corporation.
29. D.Wechsler, (2014). Wechsler adult intelligence scale-fourth SA edition. London:NCS Pearson.
30. J.M.Wicherts, & C.V.Dolan, (2010). Measurement invariance in confirmatory factor analysis:An illustration using IQ test performance of minorities. Educational Measurement:Issues and Practice, 29, 39–47. doi:10.1111/j.1745-3992.2010.00182.x
31. J.M.Wicherts, C.V.Dolan, J.S.Carlson, & H.L.J.van der Maas, (2010). Raven’s test performance of sub-Saharan Africans:Average performance, psychometric properties, and the Flynn effect. Learning and Individual Differences, 20, 135–151. doi:10.1016/j.lindif.2009.12.001
32. J.M.Wicherts, C.V.Dolan, & D.J.Hessen, (2005). Stereotype threat and group differences in test performance:A question of measurement invariance. Journal of Personality and Social Psychology, 89, 696–716. doi:10.1037/0022-3514.89.5.696
33. J.M.Wicherts, C.V.Dolan, D.J.Hessen, P.Oosterveld, G.C.M.van Baal, D.I.Boomsma, M.M.Span,. (2004). Are intelligence tests measurement invariant over time? Investigating the nature of the Flynn effect. Intelligence, 32, 509–537. doi:10.1016/j.intell.2004.07.002