Item response theory analyses of the cambridge face memory test (CFMT)

Psychological Assessment

Volumn 27, Issue 2, 2015, Pages 552-566

  Cho, Sun Joo ^a   Wilmer, Jeremy ^b   Herzmann, Grit ^c   McGugin, Rankin Williams ^d   Fiset, Daniel ^e   Van Gulick, Ana E ^d   Ryan, Kaitlin F ^d   Gauthier, Isabel ^d  

^a VANDERBILT UNIVERSITY   (United States)

^b WELLESLEY COLLEGE   (United States)

^c 931 College Mall   (United States)

^d VANDERBILT UNIVERSITY   (United States)

^e UNIVERSITÉ DU QUÉBEC EN OUTAOUAIS   (Canada)

Author keywords

Cambridge face memory test; Differential item functioning; Dimensionality; Group difference; Item response theory

Indexed keywords

ADULT; AGE; ARTICLE; CAMBRIDGE FACE MEMORY TEST; CONTROLLED STUDY; FACIAL EXPRESSION; FEMALE; HUMAN; HUMAN EXPERIMENT; ITEM RESPONSE THEORY; MALE; MATHEMATICAL MODEL; NEUROPSYCHOLOGICAL TEST; PATTERN RECOGNITION; PSYCHOMETRY; RECOGNITION; SEX DIFFERENCE; YOUNG ADULT; ADOLESCENT; FACIAL RECOGNITION; FACTOR ANALYSIS; PSYCHOLOGICAL THEORY;

ADOLESCENT; ADULT; FACIAL RECOGNITION; FACTOR ANALYSIS, STATISTICAL; FEMALE; HUMANS; MALE; NEUROPSYCHOLOGICAL TESTS; PSYCHOLOGICAL THEORY; PSYCHOMETRICS; YOUNG ADULT;

EID: 84930765088     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/pas0000068     Document Type: Article

References (76)

1. Ansley, T. M., & Forsyth, R. A. (1985). An examination of the characteristics of unidimensional IRT parameter estimates derived from two dimensional data. Applied Psychological Measurement, 9, 37-48. http://dx.doi.org/10.1177/014662168500900104
2. Baker, F. (2001). The basics of item response theory. ERIC Clearinghouse on Assessment and Evaluation. College Park, MD: University of Maryland.
3. Baker, F. B., & Kim, S.-H. (2004). Item response theory: Parameter estimation techniques (2nd ed.). New York, NY: Dekker.
4. Bentler, P. M. (1990). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 107, 238-246. http://dx.doi.org/10.1037/0033-2909.107.2.238
5. Benton, A. L., Sivan, A. B., Hamsher, K., Varney, N. R., & Spreen, O. (1983). Benton facial recognition test. New York, NY: Oxford University Press.
6. Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee's ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores. Reading, MA: Addison Wesley.
7. Bolt, D. M. (2002). A Monte Carlo comparison of parametric and nonparametric polytomous DIF detection methods. Applied Measurement in Education, 15, 113-141. http://dx.doi.org/10.1207/S15324818AME1502_01
8. Bowles, D. C., McKone, E., Dawel, A., Duchaine, B., Palermo, R., Schmalzl, L., . . . Yovel, G. (2009). Diagnosing prosopagnosia: Effects of ageing, sex, and participant-stimulus ethnic match on the Cambridge Face Memory Test and Cambridge Face Perception Test. Cognitive Neuropsychology, 26, 423-455. http://dx.doi.org/10.1080/02643290903343149
9. Cohen, A. S., & Kim, S.-H. (1993). A comparison of Lord's Chi-square and Raju's area measures in detection of DIF. Applied Psychological Measurement, 17, 39-52. http://dx.doi.org/10.1177/014662169301700109
10. Curby, K. M., & Gauthier, I. (2007). A visual short-term memory advantage for faces. Psychonomic Bulletin & Review, 14, 620-628. http://dx.doi.org/10.3758/BF03196811
11. Curran, P. J., & Hussong, A. M. (2009). Integrative data analysis: The simultaneous analysis of multiple data sets. Psychological Methods, 14, 81-100. http://dx.doi.org/10.1037/a0015914
12. Davis, J. M., McKone, E., Dennett, H., O'Connor, K. B., O'Kearney, R., & Palermo, R. (2011). Individual differences in the ability to recognise facial identity are associated with social anxiety.. PLoS ONE, 6, e28800. http://dx.doi.org/10.1371/journal.pone.0028800
13. De Boeck, P., Cho, S.-J., & Wilson, M. (2011). Explanatory secondary dimension modelling of latent DIF. Applied Psychological Measurement, 35, 583-603. http://dx.doi.org/10.1177/0146621611428446
14. De Boeck, P., & Wilson, M. (2004). Explanatory item response models: A generalized linear and nonlinear approach. New York, NY: Springer. http://dx.doi.org/10.1007/978-1-4757-3990-9
15. DeGutis, J., Wilmer, J., Mercado, R. J., & Cohan, S. (2013). Using regression to measure holistic face processing reveals a strong link with face recognition ability. Cognition, 126, 87-100. http://dx.doi.org/10.1016/j.cognition.2012.09.004
16. Dennett, H. W., McKone, E., Tavashmi, R., Hall, A., Pidcock, M., Edwards, M., & Duchaine, B. (2012). The Cambridge Car Memory Test: A task matched in format to the Cambridge Face Memory Test, with norms, reliability, sex differences, dissociations from face memory, and expertise effects. Behavior Research Methods, 44, 587-605. http://dx.doi.org/10.3758/s13428-011-0160-2
17. Duchaine, B. C., & Nakayama, K. (2004). Developmental prosopagnosia and the Benton Facial Recognition Test. Neurology, 62, 1219-1220. http://dx.doi.org/10.1212/01.WNL.0000118297.03161.B3
18. Duchaine, B., & Nakayama, K. (2006). The Cambridge Face Memory Test: Results for neurologically intact individuals and an investigation of its validity using inverted face stimuli and prosopagnosic participants. Neuropsychologia, 44, 576-585. http://dx.doi.org/10.1016/j.neuropsychologia.2005.07.001
19. Duchaine, B. C., & Weidenfeld, A. (2003). An evaluation of two commonly used tests of unfamiliar face recognition. Neuropsychologia, 41, 713-720. http://dx.doi.org/10.1016/S0028-3932(02)00222-1
20. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence-Erlbaum.
21. Flowers, C. P., Oshima, T. C., & Raju, N. S. (1999). A description and demonstration of the polytomous-DFIT framework. Applied Psychological Measurement, 23, 309-326. http://dx.doi.org/10.1177/01466219922031437
22. Fox, J.-P. (2010). Bayesian item response modeling: Theory and applications. New York, NY: Springer. http://dx.doi.org/10.1007/978-1-4419-0742-4
23. Gauthier, I., McGugin, R. W., Richler, J. J., Herzmann, G., Speegle, M., & Van Gulick, A. (2014). Experience moderates overlap between object and face recognition, suggesting a common ability. Journal of Vision, 14, 7.
24. Germine, L. T., Duchaine, B., & Nakayama, K. (2011). Where cognitive development and aging meet: Face learning ability peaks after age 30. Cognition, 118, 201-210. http://dx.doi.org/10.1016/j.cognition.2010.11.002
25. Gibbons, R. D., & Hedeker, D. R. (1992). Full-information item bi-factor analysis. Psychometrika, 57, 423-436. http://dx.doi.org/10.1007/BF02295430
26. Glas, C. A. W., & Meijer, R. R. (2003). A Bayesian approach to person fit analysis in item response theory models. Applied Psychological Measurement, 27, 217-233. http://dx.doi.org/10.1177/0146621603027003003
27. Green, B. F., Bock, R. D., Humphreys, L. G., Linn, R. L., & Reckase, M. D. (1984). Technical guidelines for assessing computerized adaptive tests. Journal of Educational Measurement, 21, 347-360. http://dx.doi.org/10.1111/j.1745-3984.1984.tb01039.x
28. Haladyna, T. M. (2004). Developing and validating multiple-choice test items (3rd ed.). Mahwah, NJ: Erlbaum.
29. Hancock, G. R. (2001). Effect size, power, and sample size determination for structured means modeling and MIMIC approaches to betweengroups hypothesis testing of means on a single latent construct. Psychometrika, 66, 373-388. http://dx.doi.org/10.1007/BF02294440
30. Holdnack, J. A., & Delis, D. C. (2004). Parsing the recognition memory components of the WMS-III face memory subtest: Normative data and clinical findings in dementia groups. Journal of Clinical and Experimental Neuropsychology, 26, 459-483. http://dx.doi.org/10.1080/13803390490496687
31. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. http://dx.doi.org/10.1080/10705519909540118
32. Ivailo, I. (2013). Simple interface to the estimation and plotting of IRT models. Retrieved from http://cran.r-project.org/web/packages/irtoys/irtoys.pdf
33. Jennrich,R. I., & Bentler, P. M. (2011). Exploratory bi-factor analysis. Psychometrika, 76, 537-549. http://dx.doi.org/10.1007/s11336-011-9218-4
34. Jennrich, R. I., & Bentler, P. M. (2012). Exploratory bi-factor analysis: The oblique case. Psychometrika, 77, 442-454. http://dx.doi.org/10.1007/s11336-012-9269-1
35. Kang, T.-H., & Cohen, A. S. (2007). IRT model selection methods for dichotomous items. Applied Psychological Measurement, 31, 331-358. http://dx.doi.org/10.1177/0146621606292213
36. Kim, S.-H., Cohen, A. S., Alagoz, C., & Kim, S. (2007). DIF detection and effect size measures for polytomously scored items. Journal of Educational Measurement, 44, 93-116. http://dx.doi.org/10.1111/j.1745-3984.2007.00029.x
37. Konar, Y., Bennett, P. J., & Sekuler, A. B. (2010). Holistic processing is not correlated with face-identification accuracy. Psychological Science, 21, 38-43. http://dx.doi.org/10.1177/0956797609356508
38. Lewin, C., & Herlitz, A. (2002). Sex differences in face recognition-Women's faces make the difference. Brain and Cognition, 50, 121-128. http://dx.doi.org/10.1016/S0278-2626(02)00016-7
39. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillside, NJ: Erlbaum.
40. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison Wesley.
41. Lovén, J., Herlitz, A., & Rehnman, J. (2011). Women's own-gender bias in face recognition memory. Experimental Psychology, 58, 333-340. http://dx.doi.org/10.1027/1618-3169/a000100
42. Magis, D. (2013). Collection of methods to detect dichotomous differential item functioning (DIF) in psychometrics. Retrieved from http://cran.rproject.org/web/packages/difR/difR.pdf
43. McGugin, R. W., Richler, J. J., Herzmann, G., Speegle, M., & Gauthier, I. (2012). The Vanderbilt Expertise Test reveals domain-general and domain-specific sex effects in object recognition. Vision Research, 69, 10-22. http://dx.doi.org/10.1016/j.visres.2012.07.014
44. Millsap, R. E., & Everson, H. T. (1993). Methodology review: Statistical approaches for assessing measurement bias. Applied Psychological Measurement, 17, 297-334. http://dx.doi.org/10.1177/014662169301700401
45. Morgan, C. A., III, Hazlett, G., Baranoski, M., Doran, A., Southwick, S., & Loftus, E. (2007). Accuracy of eyewitness identification is significantly associated with performance on a standardized test of face recognition. International Journal of Law and Psychiatry, 30, 213-223. http://dx.doi.org/10.1016/j.ijlp.2007.03.005
46. Muthén, B., du Toit, S. H. C., & Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Unpublished manuscript. Retrieved from http://pp.gseis.ucla.edu/faculty/muthen/articles/Article_075.pdf
47. Muthén, L. K., & Muthén, B. O. (1998-2013). Mplus 7.1 [Computer program]. Los Angeles, CA: Muthén & Muthén.
48. Olsson, U. (1979). Maximum likelihood estimation of the polychoric correlation coefficient. Psychometrika, 44, 443-460. http://dx.doi.org/10.1007/BF02296207
49. Perline, R., Wright, B. D., & Wainer, H. (1979). The Rasch model as additive conjoint measurement. Applied Psychological Measurement, 3, 237-255. http://dx.doi.org/10.1177/014662167900300213
50. Raju, N. S. (1990). Determining the significance of estimated signed and unsigned areas between two item response functions. Applied Psychological Measurement, 14, 197-207. http://dx.doi.org/10.1177/014662169001400208
51. Raju, N. S., van der Linden, W. J., & Fleer, P. F. (1995). IRT-based internal measures of differential functioning of items and tests. Applied Psychological Measurement, 19, 353-368. http://dx.doi.org/10.1177/014662169501900405
52. Reckase, M. D. (1979). Unidimensional latent trait models applied to multifactor tests: Results and implications. Journal of Educational Statistics, 4, 207-230. http://dx.doi.org/10.2307/1164671
53. Reckase, M. D. (2009). Multidimensional item response theory. New York, NY: Springer. http://dx.doi.org/10.1007/978-0-387-89976-3
54. Reise, S. P., Moore, T. M., & Haviland, M. G. (2010). Bifactor models and rotations: Exploring the extent to which multidimensional data yield univocal scale scores. Journal of Personality Assessment, 92, 544-559. http://dx.doi.org/10.1080/00223891.2010.496477
55. Reise, S. P., Ventura, J., Keefe, R. S., Baade, L. E., Gold, J. M., Green, M. F., . . . Bilder, R. (2011). Bifactor and item response theory analyses of interviewer report scales of cognitive impairment in schizophrenia. Psychological Assessment, 23, 245-261. http://dx.doi.org/10.1037/a0021501
56. Richler, J. J., Cheung, O. S., & Gauthier, I. (2011). Holistic processing predicts face recognition. Psychological Science, 22, 464-471. http://dx.doi.org/10.1177/0956797611401753
57. Richler, J. J., Floyd, R. J., & Gauthier, I. (in press). The Vanderbilt Holistic Face Processing Test: A short and reliable measure of holistic face processing. Journal of Vision.
58. Rubin, D. B. (1984). Bayesianly justifiable and relevant frequency calculations for the applied statistician. Annals of Statistics, 12, 1151-1172. http://dx.doi.org/10.1214/aos/1176346785
59. Russell, R., Duchaine, B., & Nakayama, K. (2009). Super-recognizers: People with extraordinary face recognition ability. Psychonomic Bulletin & Review, 16, 252-257. http://dx.doi.org/10.3758/PBR.16.2.252
60. Sinharay, S. (2005). Assessing fit of unidimensional item response models using a Bayesian approach. Journal of Educational Measurement, 42, 375-394. http://dx.doi.org/10.1111/j.1745-3984.2005.00021.x
61. Smith, L. L., & Reise, S. P. (1998). Gender differences on negative affectivity: An IRT study of differential item functioning on the Multidimensional Personality Questionnaire Stress Reaction Scale. Journal of Personality and Social Psychology, 75, 1350-1362. http://dx.doi.org/10.1037/0022-3514.75.5.1350
62. Spiegelhalter, D. J., Thomas, A., Best, N. G., & Gilks, W. R. (1996). BUGS: Bayesian inference Using Gibbs Sampling, Version 0.5. Cambridge, UK: MRC Biostatistics Unit.
63. Spiegelhalter, D. J., Thomas, A., Best, N. G., & Lunn, D. (2003). Win-BUGS user manual. Cambridge, UK: MRC Biostatistics Unit, Institute of Public Health. Retrieved from http://www.mrc-bsu.cam.ac.uk/bugs/winbugs/manual14.pdf
64. Steiger, J. H., & Lind, J. (1980, May). Statistically-based tests for the number of common factors. Paper presented at the Annual Spring Meeting of the Psychometric Society, IA.
65. Tabachnick, B. G., & Fidell, L. S. (2001). Using multivariate statistics. Boston, MA: Allyn & Bacon.
66. Thissen, D. (2001). IRTLRDIF: Vol. 2. 0b: Software for the computation of the statistics involved in item response theory likelihood-ratio tests for differential item functioning. Chapel Hill, NC: L. L. Thurstone Psychometric Laboratory.
67. Thissen, D., Steinberg, L., & Wainer, H. (1988). Use of item response theory in the study of group differences in trace lines. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 147-169). Hillsdale, NJ: Erlbaum.
68. Thissen, D., & Wainer, H. (Eds.). (2001). Test scoring. Hillsdale, NJ: Erlbaum.
69. Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1-10. http://dx.doi.org/10.1007/BF02291170
70. Warrington, E. K. (1984). Recognition Memory Test. Windsor, UK: NFERNelson.
71. Way, W. D., Ansley, T. N., & Forsyth, R. A. (1988). The comparative effects of compensatory and non-compensatory two dimensional data on unidimensional IRT estimates. Applied Psychological Measurement, 12, 239-252. http://dx.doi.org/10.1177/014662168801200303
72. Wilhelm, O., Herzmann, G., Kunina, O., Danthiir, V., Schacht, A., & Sommer, W. (2010). Individual differences in perceiving and recognizing faces-One element of social cognition. Journal of Personality and Social Psychology, 99, 530-548. http://dx.doi.org/10.1037/a0019972
73. Wilmer, J. B., Germine, L., Chabris, C. F., Chatterjee, G., Gerbasi, M., & Nakayama, K. (2012). Capturing specific abilities as a window into human individuality: The example of face recognition. Cognitive Neuropsychology, 29, 360-392. http://dx.doi.org/10.1080/02643294.2012.753433
74. Wilmer, J. B., Germine, L., Chabris, C. F., Chatterjee, G., Williams, M., Loken, E., . . . Duchaine, B. (2010). Human face recognition ability is specific and highly heritable. Proceedings of the National Academy of Sciences of the United States of America, 107, 5238-5241. http://dx.doi.org/10.1073/pnas.0913053107
75. Yu, C. Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes (Unpublished doctoral dissertation). University of California, Los Angeles, CA.
76. Zimowski, M. F., Muraki, E., Mislevy, R. J., & Bock, R. D. (1996). BILOG-MG: Multiple-group IRT analysis and test maintenance for binary items [Computer program] Chicago, IL: Scientific Software International.