Cognitive Psychology Meets Psychometric Theory: On the Relation Between Process Models for Decision Making and Latent Variable Models for Individual Differences

Psychological Review

Volumn 118, Issue 2, 2011, Pages 339-356

  Van der Maas, Han L J ^a   Molenaar, Dylan ^a   Maris, Gunter ^b   Kievit, Rogier A ^a   Borsboom, Denny ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b NONE

Author keywords

Ability; Diffusion model; Guessing; Item response theory; Response times

Indexed keywords

ARTICLE; COGNITION; DECISION MAKING; DECISION THEORY; HUMAN; INDIVIDUALITY; PSYCHOLOGICAL MODEL; PSYCHOMETRY; REACTION TIME;

COGNITION; DECISION MAKING; DECISION THEORY; HUMANS; INDIVIDUALITY; MODELS, PSYCHOLOGICAL; PSYCHOMETRICS; REACTION TIME;

EID: 79955004063     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0022749     Document Type: Article

References (84)

1. Bartholomew D.J. Latent variable models and factor analysis 1987, Griffin, London, England.
2. Bechger T.M., Maris G., Verstralen H.H.M. The Nedelsky model for multiple choice items. New developments in categorical data analysis for the social and behavioral sciences 2005, 187-206. Erlbaum, Mahwah, NJ. A. van der Ark, M. Croon, K. Sijtsma (Eds.).
3. Birnbaum A. Some latent trait models and their use in inferring an examinee's ability. Statistical theories of mental test scores. Reading 1968, 397-479. Addison-Wesley, Reading, MA. F.M. Lord, M.R. Novick (Eds.).
4. Bock D.R. Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika 1972, 37:29-51. doi: 10.1007/BF02291411.
5. Bogacz R., Brown E., Moehlis J., Holmes P., Cohen J.C. The physics of optimal decision making: A formal analysis of models of performance in two-alternative forced-choice tasks. Psychological Review 2006, 113:700-765. doi: 10.1037/0033-295X.113.4.700.
6. Borsboom D. The attack of the psychometricians. Psychometrika 2006, 71:425-440.
7. Borsboom D., Kievit R., Cervone D.P., Hood S.B. The two disciplines of scientific psychology, or: The disunity of psychology as a working hypothesis. Developmental process methodology in the social and developmental sciences 2009, 67-98. Springer, New York, NY. J. Valsiner, P.C.M. Molenaar, M.C.D.P. Lyra, N. Chaudary (Eds.).
8. Borsboom D., Mellenbergh G.J. Test validity and cognitive assessment. Cognitive diagnostic assessment for education: Theory and applications 2007, 85-116. Cambridge University Press, Cambridge, England, doi: 10.1017/CBO9780511611186.004. J. Leighton, M. Gierl (Eds.).
9. Borsboom D., Mellenbergh G.J., Van Heerden J. The theoretical status of latent variables. Psychological Review 2003, 110:203-219. doi: 10.1037/0033-295X.110.2.203.
10. Borsboom D., Mellenbergh G.J., Van Heerden J. The concept of validity. Psychological Review 2004, 111:1061-1071. doi: 10.1037/0033-295X.111.4.1061.
11. Borst G., Kievit R.A., Thompson W.L., Kosslyn S.M. Mental rotation is not easily cognitively penetrable. Journal of Cognitive Psychology 2011, 23:60-75.
12. Busemeyer J.R., Townsend J.T. Decision field theory: A dynamic-cognitive approach to decision making in an uncertain environment. Psychological Review 1993, 100:432-459. doi: 10.1037/0033-295X.100.3.432.
13. Cao J., Stokes S.L. Bayesian IRT guessing models for partial guessing behaviors. Psychometrika 2008, 73:209-230. doi: 10.1007/s11336-007-9045-9.
14. Cox D.R., Miller H.D. The theory of stochastic processes 1970, Chapman & Hall/CRC Press, London, England.
15. Cressie N., Holland P.W. Characterizing the manifest probabilities of latent trait models. Psychometrika 1983, 48:129-141. doi: 10.1007/BF02314681.
16. De Boeck P., Wilson M. Explanatory item response models: A generalized linear and nonlinear approach 2004, Springer, New York, NY.
17. de Groot A.D. Thought and choice in chess 1978, Mouton, The Hague, The Netherlands, (Original work published 1946).
18. de la Torre J. A cognitive diagnosis model for cognitively-based multiple-choice options. Applied Psychological Measurement 2009, 33:163-183. doi: 10.1177/0146621608320523.
19. Edwards W. Optimal strategies for seeking information: Models for statistics, choice reaction times, and human information processing. Journal of Mathematical Psychology 1965, 2:312-329. doi: 10.1016/0022-2496(65)90007-6.
20. Elo A. The rating of chessplayers, past and present 1978, Arco, New York, NY.
21. Embretson S.E. A general latent trait model for response processes. Psychometrika 1984, 49:175-186. doi: 10.1007/BF02294171.
22. Ferrando P.J. A Pearson-Type-VII item response model for assessing person fluctuation. Psychometrika 2007, 72:25-41. doi: 10.1007/s11336-004-1170-0.
23. Ferrando P.J., Lorenzo-Seva U. An item-response model incorporating response time data in binary personality items. Applied Psychological Measurement 2007, 31:525-543. doi: 10.1177/0146621606295197.
24. Fischer G.H. Derivations of the Rasch model. Rasch models: Foundations, recent developments, and applications 1995, 157-180. Springer, New York, NY. G.H. Fischer, I.W. Molenaar (Eds.).
25. Fischer G.H., Molenaar I.W. Rasch models: Foundations, recent developments, and applications 1995, Springer-Verlag, New York, NY.
26. Fox J.P., Klein Entink R.H., van der Linden W.J. Modeling of responses and response times with the package CIRT. Journal of Statistical Software 2007, 20(7):1-14.
27. Gelman A., Carlin J.B., Stern H.S., Rubin D.B. Bayesian data analysis 2004, Chapman & Hall, London, England.
28. Goodman L.A. Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika 1974, 61:215-231. doi: 10.1093/biomet/61.2.215.
29. Hamaker E.L., Nesselroade J.R., Molenaar P.C.M. The integrated state-space model. Journal of Research in Personality 2007, 41:295-315. doi: 10.1016/j.jrp.2006.04.003.
30. Harré R., Madden E.H. Causal powers 1975, Blackwell, Oxford, England.
31. Hessen D.J. A new class of parametric IRT models for dichotomous item scores. Journal of Applied Measurement 2004, 5:385-397.
32. Hessen D.J. Constant latent odds-ratios models and the Mantel-Haenszel null hypothesis. Psychometrika 2005, 70:497-516. doi: 10.1007/s11336-002-1040-6.
33. Hoskens M., De Boeck P. Multidimensional componential item response theory models for polytomous items. Applied Psychological Measurement 2001, 25:19-37. doi: 10.1177/01466216010251002.
34. Hutchinson T.P. Ability, partial information and guessing: Statistical modelling applied to multiple-choice tests 1991, Rumsby Scientific, Rundle Mall, South Australia.
35. Jöreskog K.G. Statistical analysis of sets of congeneric tests. Psychometrika 1971, 36:109-133. doi: 10.1007/BF02291393.
36. Kievit, R. A. (2010). Representational inertia: The influence of associative knowledge on 3D mental transformations. Unpublished manuscript, Department of Psychology, University of Amsterdam, The Netherlands.
37. Klein Entink R.H., Fox J.P., van der Linden W.J. A multivariate multilevel approach to simultaneous modeling of accuracy and speed on test items. Psychometrika 2009, 74:21-48. doi: 10.1007/s11336-008-9075-y.
38. Laming D.R.J. Information theory of choice-reaction times 1968, Academic Press, London, England.
39. Lawley D.N., Maxwell A.E. Factor analysis as a statistical method 1963, Butterworth, London, England.
40. Lazarsfeld P.F., Henry N.W. Latent structure analysis 1968, Houghton Mifflin, Boston, MA.
41. Link S.W. The wave theory of difference and similarity 1992, Erlbaum, Hillsdale, NJ.
42. Lord F.M. A theory of test scores 1952, Psychometric Society, New York, NY.
43. Lunn D.J. WinBUGS development interface (WBDev). ISBA Bulletin 2003, 10:10-11.
44. Maris E. Psychometric latent response models. Psychometrika 1995, 60:523-547. doi: 10.1007/BF02294327.
45. McLachlan G., Peel D. Finite mixture models 2000, Wiley, New York, NY.
46. McMillen T., Holmes P. The dynamics of choice among multiple alternatives. Journal of Mathematical Psychology 2006, 50:30-57. doi: 10.1016/j.jmp.2005.10.003.
47. Mellenbergh G.J. Generalized linear item response theory. Psychological Bulletin 1994, 115:300-307. doi: 10.1037/0033-2909.115.2.300.
48. Mislevy R.J. How cognitive science challenges the educational measurement tradition. Measurement: Interdisciplinary Research and Perspectives 2008, 6(1-2):124.
49. Mokken R.J. A theory and procedure of scale analysis with applications in political research 1971, Mouton, The Hague, The Netherlands.
50. Molenaar P.C.M. A manifesto on psychology as idiographic science: Bringing the person back into scientific psychology, this time forever. Measurement 2004, 2:201-218.
51. Ramsay J.O. A comparison of three simple test theory models. Psychometrika 1989, 54:487-499. doi: 10.1007/BF02294631.
52. Rasch G. Probabilistic models for some intelligence and attainment tests 1960, Danish Institute for Educational Research, Copenhagen, Denmark.
53. Ratcliff R. A theory of memory retrieval. Psychological Review 1978, 85:59-108. doi: 10.1037/0033-295X.85.2.59.
54. Ratcliff R. A diffusion model account of response time and accuracy in a brightness discrimination task: Fitting real data and failing to fit fake but plausible data. Psychonomic Bulletin & Review 2002, 9:278-291.
55. Ratcliff R. Modeling response signal and response time data. Cognitive Psychology 2006, 53:195-237. doi: 10.1016/j.cogpsych.2005.10.002.
56. Ratcliff R., Rouder J.N. Modeling response times for two-choice decisions. Psychological Science 1998, 9:347-356. doi: 10.1111/1467-9280.00067.
57. Ratcliff R., Thapar A., McKoon G. The effects of aging on reaction time in a signal detection task. Psychology and Aging 2001, 16:323-341. doi: 10.1037/0882-7974.16.2.323.
58. Ratcliff R., Van Zandt T., McKoon G. Comparing connectionists and diffusion models of reaction time. Psychological Review 1999, 106:261-300. doi: 10.1037/0033-295X.106.2.261.
59. Reise S.P. Using multilevel logistic regression to evaluate person-fit in IRT models. Multivariate Behavioral Research 2000, 35:543-568. doi: 10.1207/S15327906MBR3504_06.
60. Roskam E.E. Models for speed and time-limit tests. Handbook of modern item response theory 1997, 187-208. Springer, New York, NY. W.J. van der Linden, R.K. Hambleton (Eds.).
61. Roskam E.E., Jansen P.G.W. A new derivation of the Rasch model. Trends in mathematical psychology 1984, 293-307. Elsevier, Amsterdam, The Netherlands, doi: 10.1016/S0166-4115(08)62094-4. E. DeGreef, J. van Buggenhaut (Eds.).
62. San Martin E., del Pino G., De Boeck P. IRT models for ability based guessing. Applied Psychological Measurement 2006, 30:183-203.
63. SAS/STAT user's guide (Version 8) 2000, SAS Institute, SAS Institute, Cary, NC.
64. Simen P., Contreras D., Buck C., Hu P., Holmes P., Cohen J.D. Reward-rate optimization in two-alternative decision making: Empirical tests of theoretical predictions. Journal of Experimental Psychology: Human Perception and Performance 2009, 35:1865-1897. doi: 10.1037/a0016926.
65. Stone M. Models for choice-reaction time. Psychometrika 1960, 25:251-260. doi: 10.1007/BF02289729.
66. Strandmark N.L., Linn R.L. A generalized logistic item response model parameterizing test score inappropriateness. Applied Psychological Measurement 1987, 11:355-370. doi: 10.1177/014662168701100402.
67. Thissen D. Timed testing: An approach using item response theory. New horizons in testing: Latent trait test theory and computerized adaptive testing 1983, 179-203. Academic Press, New York, NY. D.J. Weiss (Ed.).
68. Tuerlinckx F., De Boeck P. Two interpretations of the discrimination parameter. Psychometrika 2005, 70:629-650. doi: 10.1007/s11336-000-0810-3.
69. Vandekerckhove J., Tuerlinckx F. Fitting the Ratcliff diffusion model to experimental data. Psychonomic Bulletin & Review 2007, 14:1011-1026.
70. van der Linden W.J. A hierarchical framework for modeling speed and accuracy on test items. Psychometrika 2007, 72:287-308. doi: 10.1007/s11336-006-1478-z.
71. van der Linden W.J. Conceptual issues in response-time modeling. Journal of Educational Measurement 2009, 46:247-272. doi: 10.1111/j.1745-3984.2009.00080.x.
72. van der Linden W.J., Hambleton R.K. Handbook of modern item response theory 1997, Springer, New York, NY.
73. van der Maas H.L.J., Dolan C.V., Grasman R.P.P.P., Wicherts J.M., Huizenga H.M., Raijmakers M.E.J. A dynamical model of general intelligence: The positive manifold of intelligence by mutualism. Psychological Review 2006, 113:842-861. doi: 10.1037/0033-295X.113.4.842.
74. van der Maas H.L.J., Kolstein R., van der Pligt J. Sudden jumps in attitudes. Sociological Methods & Research 2003, 32:125-152. doi: 10.1177/0049124103253773.
75. van der Maas H.L.J., Molenaar P.C.M. Stagewise cognitive development: An application of catastrophe theory. Psychological Review 1992, 99:395-417. doi: 10.1037/0033-295X.99.3.395.
76. van der Maas H.L.J., Wagenmakers E.J. The Amsterdam Chess Test: A psychometric analysis of chess expertise. American Journal of Psychology 2005, 118:29-60.
77. Verhelst N.D., Verstralen H.H.F.M., Jansen M.G. A logistic model for time-limit tests. Handbook of modern item response theory 1997, 169-185. Springer, New York, NY. W.J. van der Linden, R.K. Hambleton (Eds.).
78. Voss A., Voss J. Fast-dm: A free program for efficient diffusion model analysis. Behavior Research Methods 2007, 39:767-775.
79. Wagenmakers E.J., Grasman R., Molenaar P.C.M. On the relation between the mean and the variance of a diffusion model response time distribution. Journal of Mathematical Psychology 2005, 49:195-204. doi: 10.1016/j.jmp.2005.02.003.
80. Wagenmakers E.J., Ratcliff R., Gomez P., McKoon G. A diffusion model account of criterion shifts in the lexical decision task. Journal of Memory and Language 2008, 58:140-159. doi: 10.1016/j.jml.2007.04.006.
81. Wagenmakers E.J., van der Maas H.L.J., Grasman R.P. An EZ-diffusion model for response time and accuracy. Psychonomic Bulletin & Review 2007, 14:3-22.
82. Wald A. Sequential analysis 1947, Wiley, New York, NY.
83. Wang T., Hanson B.A. Development and calibration of an item response model that incorporates response time. Applied Psychological Measurement 2005, 29:323-339. doi: 10.1177/0146621605275984.
84. Wickelgren W.A. Speed-accuracy tradeoff and information processing dynamics. Acta Psychologica 1977, 41:67-85. doi: 10.1016/0001-6918(77)90012-9.