Measurement of latent cognitive abilities involved in concept identification learning

Journal of Clinical and Experimental Neuropsychology

Volumn 37, Issue 6, 2015, Pages 653-669

  Thomas, Michael L ^a   Brown, Gregory G ^a,b   Gur, Ruben C ^c,d   Moore, Tyler M ^c   Patt, Virginie M ^a   Nock, Matthew K ^e   Naifeh, James A ^f   Heeringa, Steven ^g   Ursano, Robert J ^f   Stein, Murray B ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b VA SAN DIEGO HEALTHCARE SYSTEM   (United States)

^c UNIVERSITY OF PENNSYLVANIA   (United States)

^d VETERANS AFFAIRS MEDICAL CENTER   (United States)

^e HARVARD UNIVERSITY   (United States)

^f UNIFORMED SERVICES UNIVERSITY OF THE HEALTH SCIENCES   (United States)

^g UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Army STARRS; Concept identification learning; Item response theory; Latent variable measurement; Neuropsychology; Penn Conditional Exclusion Test

Indexed keywords

ADULT; APTITUDE; COGNITION DISORDERS; CONCEPT FORMATION; EXECUTIVE FUNCTION; FEMALE; HUMAN; LEARNING; MALE; NEUROPSYCHOLOGICAL TEST; PHYSIOLOGY; PROCEDURES; PSYCHOMETRY; SOLDIER; STATISTICAL MODEL; STATISTICS AND NUMERICAL DATA; UNITED STATES; YOUNG ADULT;

ADULT; APTITUDE; COGNITION DISORDERS; CONCEPT FORMATION; EXECUTIVE FUNCTION; FEMALE; HUMANS; LEARNING; MALE; MILITARY PERSONNEL; MODELS, STATISTICAL; NEUROPSYCHOLOGICAL TESTS; PSYCHOMETRICS; UNITED STATES; YOUNG ADULT;

EID: 84943199208     PISSN: 13803395     EISSN: 1744411X     Source Type: Journal    
DOI: 10.1080/13803395.2015.1042358     Document Type: Article

References (78)

1. Amos, A. (2000) A computational model of information processing in the frontal cortex and basal ganglia. Journal of Cognitive Neuroscience, 12, 505-519
2. Andersen, E. B. (1985). Estimating latent correlations between repeated testings. Psychometrika, 50, 3-16
3. Ashby, F., Alfonso-Reese, L. A., Turken, U. U., &, Waldron, E. M. (1998) A neuropsychological theory of multiple systems in category learning. Psychological Review, 105, 442
4. Atkinson, R. C., Bower, G. H., &, Crothers, E. J. (1965). An introduction to mathematical learning theory. New York, NY: John Wiley & Sons
5. Axelrod, B. N., Goldman, R. S., Heaton, R. K., Curtiss, G., Thompson, L. L., Chelune, G. J., &, Kay, G. G. (1996). Discriminability of the Wisconsin Card Sorting Test using the standardization sample. Journal of Clinical and Experimental Neuropsychology, 18, 338-342
6. Batchelder, W. H., (1975). Individual differences and the all-or-none vs incremental learning controversy. Journal of Mathematical Psychology, 12, 53-74
7. Batchelder, W. H. (2010). Cognitive psychometrics: Using multinomial processing tree models as measurement tools. In S. E. Embretson. (Ed.), Measuring psychological constructs: Advances in model-based approaches (pp. 71-93). Washington, DC: American Psychological Association
8. Batchelder, W. H., Chosak-Reiter, J., Shankle, W. R., &, Dick, M. B. (1997) A multinomial modeling analysis of memory deficits in Alzheimers disease and vascular dementia. The Journals of Gerontology: Series B: Psychological Sciences and Social Sciences, 52, P206-P215
9. Berg, E. A. (1948) A simple objective technique for measuring flexibility in thinking. Journal of General Psychology, 39, 15-22
10. Bishara, A. J., Kruschke, J. K., Stout, J. C., Bechara, A., McCabe, D. P., &, Busemeyer, J. R. (2010). Sequential learning models for the Wisconsin Card Sort Task: Assessing processes in substance dependent individuals. Journal of Mathematical Psychology, 54, 5-13
11. Bondi, M., Salmon, D., &, Kaszniak, A. W. (2009). The neuropsychology of dementia. In I. Grant & K. Adams. (Eds.), Neuropsychological assessment of neuropsychiatric & neuromedical disorders (pp. 159-198). New York, NY: Oxford University Press
12. Brooks, S. P., &, Gelman, A. (1998). General methods for monitoring convergence of iterative simulations. Journal of Computational & Graphical Statistics, 7, 434
13. Brown, G. G., Lohr, J., Notestine, R., Turner, T., Gamst, A., &, Eyler, L. T. (2007). Performance of schizophrenia and bipolar patients on verbal and figural working memory tasks. Journal of Abnormal Psychology, 116, 741-753
14. Brown, G. G., Turner, T. H., Mano, Q. R., Bolden, K., &, Thomas, M. L. (2013). Experimental manipulation of working memory model parameters: An exercise in construct validity. Psychological Assessment, 25, 844-858
15. Burton, C. Z., Vella, L., Weller, J. A., &, Twamley, E. W. (2011). Differential effects of executive functioning on suicide effects. The Journal of Neuropsychiatry and Clinical Neurosciences, 23, 173-179
16. Chapman, L. J., &, Chapman, J. P. (1973). Disordered thought in schizophrenia. New York, NY: Appleton-Century-Crofts
17. Chib, S., &, Greenberg, E. (1995). Understanding the Metropolis-Hastings algorithm. American Statistician, 49, 327-335
18. Dehaene, S., &, Changeux, J. (1991). The Wisconsin Card Sorting Test: Theoretical analysis and modeling in a neuronal network. Cerebral Cortex, 1, 62-79
19. Embretson, S. E. (1991) A multidimensional latent trait model for measuring learning and change. Psychometrika, 56, 495-515
20. Embretson, S. E., &, Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates
21. Erikson, R. C. (1995) A review and critique of the process approach in neuropsychological assessment. Neuropsychology Review, 5, 223-243
22. Fischer, G. H. (1976). Some probabilistic models for measuring change. In D. N. M. de Gruijter & L. J. T. van der Kamp. (Eds.), Advances in psychological and educational measurement (pp. 97-110). New York, NY: John Wiley & Sons
23. Flowers, K. A., &, Robertson, C. (1985). The effect of Parkinsons disease on the ability to maintain a mental set. Journal of Neurology, Neurosurgery, and Psychiatry, 48, 517-529
24. Fox, J. (2010). Bayesian item response modeling. New York, NY: Springer
25. Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., &, Rubin, D. B. (2013). Bayesian data analysis (3rd ed.). Boca Raton, FL: Chapman and Hall/CRC
26. Gelman, A., &, Rubin, D. B. (1992). Inference from iterative simulation using multiple sequences. Statistical Science, 7, 457-511
27. Geweke, J. (1992). Evaluating the accuracy of sampling-based approaches to calculating posterior moments. In J. M. Bernardo, J. O. Berger, A. P. Dawid, & A. F. M. Smith. (Eds.), Bayesian statistics (Vol. 4, pp. 169-193). Oxford: Clarendon Press
28. Goldstein, K., &, Scheerer, M. (1941). Abstract and concrete behavior: An experimental study with special tests (. Psychological Monographs No. 239). Washington, DC: American Psychological Association
29. Grant, D. A., &, Berg, E. A. (1948) A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-Type card-sorting problem. Journal of Experimental Psychology, 38, 404-411
30. Gur, R. C., Richard, J., Hughett, P., Calkins, M. E., Macy, L., Bilker, W. B.,., Gur, R. E. (2010) A cognitive neuroscience-based computerized battery for efficient measurement of individual differences: Standardization and initial construct validation. Journal of Neuroscience Methods, 187, 254-262
31. Hanfmann, E., &, Kasanin, J. A. (1942). Conceptual thinking in schizophrenia. Nervous and Mental Disease Monographs, 67, 1-115
32. Heaton, R. K. (1981). The Wisconsin Card Sorting Test manual. Odessa, FL: Psychological Assessment Resources Inc
33. Heeringa, S. G., Gebler, N., Colpe, L. J., Fullerton, C. S., Hwang, I., Kessler, R. C.,., Ursano, R. J. (2013). Field procedures in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). International Journal of Methods in Psychiatric Research, 22 (4), 276-287
34. Hill, W. F. (1971). Learning: A survey of psychological interpretations (Rev. ed.). Scanton, PA: Chandler Publishing Company
35. Hoerger, M., Quirk, S. W., &, Weed, N. C. (2011). Development and validation of the Delaying Gratification Inventory. Psychological Assessment, 23, 725-738
36. Janowsky, J. S., Shimamura, A. P., Kritchevsky, M., &, Squire, L. R. (1989). Cognitive impairment following frontal lobe damage and its relevance to human amnesia. Behavioral Neuroscience, 103 (3), 548-560
37. Kendler, T. S. (1979). The development of discrimination learning: A levels-of-functioning explanation. Advances in Child Development and Behavior, 13, 83-117
38. Kessler, R. C., Colpe, L. J., Fullerton, C. S., Gebler, N., Naifeh, J. A., Nock, M. K.,., Heeringa, S. G. (2013). Design of the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). International Journal of Methods in Psychiatric Research, 22 (4), 267-275
39. Kessler, R. C., Heeringa, S. G., Colpe, L. J., Fullerton, C. S., Gebler, N., Hwang, I.,., Ursano, R. J. (2013). Response bias, weighting adjustments, and design effects in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). International Journal of Methods in Psychiatric Research, 22 (4), 288-302
40. Kim, J., &, Bolt, D. M. (2007). Estimating item response theory models using Markov chain Monte Carlo methods. Educational Measurement: Issues & Practice, 26, 38-51
41. Kongs, S. K., Thompson, L. L., Iverson, G. L., &, Heaton, R. K. (2000). Wisconsin Card Sorting Test-64 Card Version professional manual. Odessa, FL: Psychological Assessment Resources
42. Kurtz, M. M., Ragland, J. D., Moberg, P. J., &, Gur, R. C. (2004). The Penn Conditional Exclusion Test: A new measure of executive-function with alternate forms for repeat administration. Archives of Clinical Neuropsychology, 19, 191-201
43. Levine, D. S., &, Prueitt, P. S. (1989). Modeling some effects of frontal-lobe damage-Novelty and perseveration. Neural Networks, 2, 103-116
44. Levy, R. (2009). The rise of Markov chain Monte Carlo estimation for psychometric modeling. Journal of Probability and Statistics, 2009, 1-18
45. Lezak, M. D., Howieson, D. B., Bigler, E. D., &, Tranel, D. (2012). Neuropsychological assessment (4th ed.). New York, NY: Oxford University Press
46. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum Associates
47. Luria, A. R. (1973). The working brain: An introduction to neuropsychology. New York, NY: Basic Books
48. Martin, A. D., &, Quinn, K. M. (2002). Dynamic ideal point estimation via Markov chain Monte Carlo for the U.S. Supreme Court, 1953-1999. Political Analysis, 10, 134-153
49. Marzuk, P. M., Hartwell, N. N., Leon, A. C., &, Portera, L. L. (2005). Executive functioning in depressed patients with suicidal ideation. Acta Psychiatrica Scandinavica, 112, 294-301
50. McCarthy, R. A., &, Warrington, E. K. (1990). Cognitive neuropsychology: A clinical introduction. San Diego, CA: Academic Press
51. McKenna, B. S., Brown, G. G., Drummond, S. P. A., Turner, T. H., &, Mano, Q. R. (2013). Linking mathematical modeling with human neuroimaging to segregate verbal working memory maintenance processes from stimulus encoding. Neuropsychology, 27, 243-255
52. Metropolis, N., Rosenbluth, A., Rosenbluth, M., Teller, A., &, Teller, E. (1953). Equation of state calculations by fast computing machines. Journal of Chemical Physics, 21, 1087-1092
53. Milberg, W. P., Hebben, N., &, Kaplan, E. (2009). The Boston process approach to neuropsychological assessment. In I. Grant & K. M. Adams. (Eds.), Neuropsychological assessment of neuropsychiatric and neuromedical disorders (3rd ed., pp. 42-65). New York, NY: Oxford University Press
54. Millward, R. B., &, Wickens, T. D. (1974). Concept-identification models. In D. H. Krantz, R. C. Atkinson, R. D. Luce, & P. Suppes. (Eds.), Contemporary developments in mathematical psychology: I. Learning, memory and thinking (pp. 45-100). Oxford: W. H. Freeman
55. Milner, B. (1964). Some effects of frontal lobectomy in man. In J. M. Warren & K. Akert. (Eds.), The frontal granular cortex and behavior (pp. 313-334). New York, NY: McGraw-Hill
56. Monchi, O., Taylor, J. G., &, Dagher, A. (2000) A neural model of working memory processes in normal subjects, Parkinsons disease and schizophrenia for fMRI design and predictions. Neural Networks, 13, 953-973
57. Patz, R. J., &, Junker, B. W. (1999) A straightforward approach to Markov chain Monte Carlo methods for item response models. Journal of Educational and Behavioral Statistics, 24, 146-178
58. R Development Core Team. (2011). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org
59. Raijmakers, J. G. W. (1981) A general framework for the analysis of concept identification tasks. Acta Psychologica, 49, 233-261
60. Reitan, R. M., &, Wolfson, D. (2009). The Halstead-Reitan neuropsychological test battery for Adults-Theoretical, methodological, and validational bases. In I. Grant & K. M. Adams. (Eds.), Neuropsychological assessment of neuropsychiatric and neuromedical disorders (3rd ed., pp. 3-24). New York, NY: Oxford University Press
61. Sanislow, C. A., Pine, D. S., Quinn, K. J., Kozak, M. J., Garvey, M. A., Heinssen, R. K.,., Cuthbert, B. N. (2010). Developing constructs for psychopathology research: Research domain criteria. Journal of Abnormal Psychology, 119 (4), 631-639. doi: 10.1037/a0020909
62. Schmittmann, V. D., Visser, I., &, Raijmakers, M. E. J. (2006). Multiple learning modes in the development of performance on a rule-based category-learning task. Neuropsychologia, 44, 2079-2091
63. Su, C., Lin, Y., Kwan, A., &, Guo, N. (2008). Construct validity of the Wisconsin Card Sorting Test-64 in patients with stroke. The Clinical Neuropsychologist, 22 (2), 273-287
64. Testa, R., &, Pantelis, C. (2009). The role of executive functions in psychiatric disorders. In S. J. Wood, N. B. Allen, &, C. Pantelis. (Eds.), The neuropsychology of mental illness (pp. 117-137). Cambridge: Cambridge University Press
65. Thomas, M. L. (2011). The value of item response theory in clinical assessment: A review. Assessment, 18, 291-307
66. Thomas, M. L., Brown, G. G., Gur, R. C., Hansen, J. A., Nock, M. K., Heeringa, S.,., Stein, M. B. (2013). Parallel psychometric and cognitive modeling analyses of the Penn Face Memory Test in the Army Study to Assess Risk and Resilience in Servicemembers. Journal of Clinical and Experimental Neuropsychology, 35 (3), 225-245
67. Thomas, M. L., Brown, G. G., Thompson, W. K., Voyvodic, J., Greve, D. N., Turner, J. A.,., Potkin, S. G. (2013). An application of item response theory to fMRI data: Prospects and pitfalls. Psychiatry Research: Neuroimaging, 212, 167-174
68. Ursano, R. J., Colpe, L. J., Heeringa, S. G., Kessler, R. C., Schoenbaum, M., &, Stein, M. B. (2014). The Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). Psychiatry: Interpersonal and Biological Processes, 77 (2), 107-119
69. Verhelst, N. D., &, Glas, C. A. (1993) A dynamic generalization of the Rasch model. Psychometrika, 58, 395-415
70. Vygotsky, L. S. (1962). Thought and language (E. Hanfmann & G. Vakar., Eds. & Trans.). Cambridge, MA: MIT Press
71. Walsh, K. W. (1978). Neuropsychology: A clinical approach. Edinburgh: Churchill Livingstone
72. Weigl, E. (1941). On the psychology of so-called processes of abstraction. The Journal of Abnormal and Social Psychology, 36, 3-33
73. Westheide, J., Quednow, B. B., Kai-Uwe, K., Hoppe, C., Cooper-Mahkorn, D., Hawellek, B.,., Wagner, M. (2008). Executive performance of depressed suicide attempters: The role of suicidal ideation. European Archives of Psychiatry & Clinical Neuroscience, 258, 414-421
74. Whitely, S. E. (1983). Construct validity: Construct representation versus nomothetic span. Psychological Bulletin, 93, 179-197
75. Wickens, T. D. (1982). Models for behavior: Stochastic processes in psychology. San Francisco, CA: Freeman
76. Wickens, T. D., &, Millward, R. B. (1971). Attribute elimination strategies for concept identification with practiced subjects. Journal of Mathematical Psychology, 8, 453-489
77. Wilcox, R. R. (1997). Some practical reasons for reconsidering the Kolmogorov-Smirnov test. British Journal of Mathematical and Statistical Psychology, 50, 9-20
78. Zable, M., &, Harlow, H. F. (1946). The performance of rhesus monkeys on series of object-quality and positional discriminations and discrimination reversals. Journal of Comparative Psychology, 39, 13-23