Methodological and empirical developments for the Ratcliff diffusion model of response times and accuracy

European Journal of Cognitive Psychology

Volumn 21, Issue 5, 2009, Pages 641-671

  Wagenmakers, Eric Jan ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Mathematical modelling; Random walk; RT distributions; Signal detection theory

Indexed keywords

ACCURACY; AGING; BAYES THEOREM; CLINICAL PRACTICE; COGNITION; HUMAN; INTELLIGENCE QUOTIENT; MATHEMATICAL MODEL; MEDICAL DECISION MAKING; METHODOLOGY; PERCEPTIVE DISCRIMINATION; PRIORITY JOURNAL; PSYCHOLOGICAL ASPECT; PSYCHOLOGIST; RATCLIFF DIFFUSION MODEL; RESPONSE TIME; REVIEW; VELOCITY;

EID: 70449640393     PISSN: 09541446     EISSN: 14640635     Source Type: Journal    
DOI: 10.1080/09541440802205067     Document Type: Review

References (116)

1. Batchelder,W. H. (2007, October). Cognitive psychometrics: Combining two psychological traditions. CSCA lecture, Amsterdam, The Netherlands.
2. Bernstein, I. H., Clark, M. H., & Edelstein, B. A. (1969). Effects of an auditory signal on visual reaction time. Journal of Experimental Psychology, 80, 567-569.
3. Bernstein, I. H., Rose, R. G., & Ashe, V. (1970). Energy integration in intersensory facilitation. Journal of Experimental Psychology, 86, 196-203.
4. Bogacz, R., & Gurney, K. (2007). The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Computation, 19, 442-477.
5. Bones, A. K., & Johnson, N. R. (2007). Measuring the immeasurable: Or "could Abraham Lincoln take the Implicit Association Test?". Perspectives on Psychological Science, 2, 406-411.
6. Brendl, C. M., Markman, A. B., & Messner, C. (2001). How do indirect measures of evaluation work? Evaluating the inference of prejudice in the Implicit Association Test. Journal of Personality and Social Psychology, 81, 760-773.
7. Brinley, J. F. (1965). Cognitive sets, speed and accuracy of performance in the elderly. In A. T. Welford & J. E. Birren (Eds.), Behavior, aging and the nervous system (pp. 114-149). Springfield, IL: Thomas.
8. Brown, J. W., Bullock, D., & Grossberg, S. (2004). How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades. Neural Networks, 17, 471-510.
9. Brown, S., & Heathcote, A. (2005). Practice increases the efficiency of evidence accumulation in perceptual choice. Journal of Experimental Psychology: Human Perception and Performance, 31, 289-298.
10. Cerella, J. (1985). Information processing rates in the elderly. Psychological Bulletin, 98, 67-83.
11. Coltheart, M., Rastle, K., Perry, C., Langdon, R., & Ziegler, J. (2001). DRC: A dual route cascaded model of visual word recognition and reading aloud. Psychological Review, 108, 204-256.
12. Cox, D. R., & Miller, H. D. (1970). The theory of stochastic processes. London: Methuen.
13. Coyle, T. R. (2003). A review of the worst performance rule: Evidence, theory, and alternative hypotheses. Intelligence, 31, 567-587.
14. Crossman, E. R. F. W. (1959). A theory of the acquisition of speed-skill. Ergonomics, 2, 153-166.
15. Diederich, A., & Busemeyer, J. R. (2006). Modeling the effects of payoff on response bias in a perceptual discrimination task: Bound-change, drift-rate-change, or two-stage-processing hypothesis. Perception and Psychophysics, 68, 194-207.
16. Dutilh, G., Wagenmakers, E.-J., Vandekerckhove, J., & Tuerlinckx, F. (2008). A diffusion model account of practice. Manuscript submitted for publication.
17. Edwards, W. (1965). Optimal strategies for seeking information: Models for statistics, choice reaction times, and human information processing. Journal of Mathematical Psychology, 2, 312-329.
18. Einstein, A. (1905). Über die von der molekularkinetischen Theorie der Wärme geforderte Bewegung von in ruhenden Flüssigkeiten suspendierten Teilchen [On the movement of small particles suspended in a stationary liquid demanded by the molecular-kinetic theory of heat]. Annalen der Physik, 17, 549-560.
19. Eriksen, B. A., & Eriksen, C. W. (1974). Effects of noise letters upon the identification of a target letter in a nonsearch task. Perception and Psychophysics, 16, 143-149.
20. Estes, W. K. (1956). The problem of inference from curves based on group data. Psychological Bulletin, 53, 134-140.
21. Estes, W. K. (2002). Traps in the route to models of memory and decision. Psychonomic Bulletin and Review, 9, 3-25.
22. Fazio, R. H., & Olson, M. A. (2003). Implicit measures in social cognition research: Their meaning and use. Annual Review of Psychology, 54, 297-327.
23. Frank, M. J. (2006). Hold your horses: A dynamic computational role for the subthalamic nucleus in decision making. Neural Networks, 19, 1120-1136.
24. Gardiner, C. W. (2004). Handbook of stochastic methods (3rd ed.). Berlin, Germany: Springer- Verlag.
25. Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models. Cambridge, UK: Cambridge University Press.
26. Gold, J. I., & Shadlen, M. N. (2007). The neural basis of decision making. Annual Review of Neuroscience, 30, 535-574.
27. Grainger, J., & Jacobs, A. M. (1996). Orthographic processing in visual word recognition: A multiple read-out model. Psychological Review, 103, 518-565.
28. Grasman, R. P. P. P., Wagenmakers, E.-J., & van der Maas, H. L. J. (2008). On the mean and variance of response times under the diffusion model with an application to parameter estimation. Manuscript submitted for publication.
29. Greenwald, A. G.,McGhee, D. E., & Schwartz, J. L. K. (1998). Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology, 74, 1464-1480.
30. Hackley, S. A., & Valle-Inclán, F. (1999). Accessory stimulus effects on response selection: Does arousal speed decision making? Journal of Cognitive Neuroscience, 11, 321-329.
31. Heathcote, A., Brown, S., & Mewhort, D. J. K. (2000). The power law repealed: The case for an exponential law of practice. Psychonomic Bulletin and Review, 7, 185-207.
32. Hoffman, L., & Rovine, M. J. (2007). Multilevel models for the experimental psychologist: Foundations and illustrative examples. Behavior Research Methods, 39, 101-117.
33. Honerkamp, J. (1994). Stochastic dynamical systems. New York: VCH Publishers.
34. Jeffreys, H. (1961). Theory of probability. Oxford, UK: Oxford University Press.
35. Jensen, A. R. (1998). The g factor. Westport, CT: Praeger Publishers.
36. Jensen, A. R. (2006). Clocking the mind: Mental chronometry and individual differences. Amsterdam: Elsevier.
37. Jepma, M., Wagenmakers, E.-J., Band, G. P. H., & Nieuwenhuis, S. (in press). The effects of accessory stimuli on information processing: Evidence from electrophysiology and a diffusion model analysis. Journal of Cognitive Neuroscience.
38. Kass, R. E., & Raftery, A. E. (1995). Bayes factors. Journal of the American Statistical Association, 90, 377-395.
39. Klauer, K. C., Voss, A., Schmitz, F., & Teige-Mocigemba, S. (2007). Process components of the implicit association test: A diffusion-model analysis. Journal of Personality and Social Psychology, 93, 353-368.
40. Laming, D. R. J. (1968). Information theory of choice-reaction times. London: Academic Press.
41. Larson, G. E., & Alderton, D. L. (1990). Reaction time variability and intelligence: A "worst performance" analysis of individual differences. Intelligence, 14, 309-325.
42. Lee, M., Vandekerckhove, J., Navarro, D. J., & Tuerlinckx, F. (2007, July). A hierarchical Bayesian account of human decision-making using Wiener diffusion. Paper presented at the 40th annual meeting of the Society for Mathematical Psychology, Irvine, USA.
43. Lee, M. D., Fuss, I., & Navarro, D. (2006). A Bayesian approach to diffusion models of decisionmaking and response time. In B. Schölkopf, J. Platt, & T. Hoffman (Eds.), Advances in neural information processing systems (Vol. 19 pp. 809-815). Cambridge, MA: MIT Press.
44. Lee, M. D., & Wagenmakers, E.-J. (2005). Bayesian statistical inference in psychology: Comment on Trafimow (2003). Psychological Review, 112, 662-668.
45. Lindley, D. V. (2000). The philosophy of statistics. The Statistician, 49, 293-337.
46. Link, S. W. (1992). The wave theory of difference and similarity. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
47. Link, S. W., & Heath, R. A. (1975). A sequential theory of psychological discrimination. Psychometrika, 40, 77-105.
48. Lo, C. C., & Wang, X. J. (2006). Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks. Nature Neuroscience, 9, 956-963.
49. Logan, G. D. (1988). Toward an instance theory of automatization. Psychological Review, 95, 492- 527.
50. Logan, G. D. (1992). Shapes of reaction-time distributions and shapes of learning curves: A test of the instance theory of automaticity. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 883-914.
51. Luce, R. D. (1986). Response times. New York: Oxford University Press.
52. Macmillan, N. A., & Creelman, C. D. (2005). Detection theory: A user's guide (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
53. Meng, X. L. (1994). Posterior predictive p-values. Annals of Statistics, 22, 1142-1160.
54. Myung, I. J., Forster, M. R., & Browne, M. W. (Eds.). (2000). Model selection [Special issue]. Journal of Mathematical Psychology, 44(1-2).
55. Newell, A., & Rosenbloom, P. S. (1981). Mechanisms of skill acquisition and the law of practice. In J. R. Anderson (Ed.), Cognitive skills and their acquisition (pp. 1-55). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
56. Norris, D. (2006). The Bayesian reader: Explaining word recognition as an optimal Bayesian decision process. Psychological Review, 113, 327-357.
57. Nosek, B. A., Greenwald, A. G., & Banaji, M. R. (2006). The Implicit Association Test at age 7: A methodological and conceptual review. In J. A. Bargh (Ed.), Social psychology and the unconscious: The automaticity of higher mental processes (pp. 265-292). London: Psychology Press.
58. Oberauer, K. (2005). Binding and inhibition in working memory: Individual and age differences in short-term recognition. Journal of Experimental Psychology: General, 134, 368-387.
59. Pachella, R. G. (1974). The interpretation of reaction time in information-processing research. In B. H. Kantowitz (Ed.), Human information processing: Tutorials in performance and cognition (pp. 41-82). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
60. Plaut, D. C. (1997). Structure and function in the lexical system: Insights from distributed models of word reading and lexical decision. Language and Cognitive Processes, 12, 765-805.
61. Posner, M. I. (1978). Chronometric explorations of mind. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
62. Raftery, A. E. (1995). Bayesian model selection in social research. In P. V. Marsden (Ed.), Sociological methodology (pp. 111-196). Cambridge, UK: Blackwells.
63. Ratcliff, R. (1978). A theory of memory retrieval. Psychological Review, 85, 59-108.
64. Ratcliff, R. (1981). A theory of order relations in perceptual matching. Psychological Review, 88, 552-572.
65. Ratcliff, R. (2002). A diffusion model account of response time and accuracy in a brightness discrimination task: Fitting real data and failing to fit fake but plausible data. Psychonomic Bulletin and Review, 9, 278-291.
66. Ratcliff, R. (in press). The EZ diffusion method: Too EZ? Psychonomic Bulletin and Review.
67. Ratcliff, R., Gomez, P., & McKoon, G. (2004a). Diffusion model account of lexical decision. Psychological Review, 111, 159-182.
68. Ratcliff, R., & McKoon, G. (2008). The diffusion decision model: Theory and data for two-choice decision tasks. Neural Computation, 20, 873-922.
69. Ratcliff, R., & Rouder, J. N. (1998). Modeling response times for two-choice decisions. Psychological Science, 9, 347-356.
70. Ratcliff, R., & Rouder, J. N. (2000). A diffusion model account of masking in two-choice letter identification. Journal of Experimental Psychology: Human Perception and Performance, 26, 127-140.
71. Ratcliff, R., Schmiedek, F., & McKoon, G. (2008). A diffusion model explanation of the worst performance rule for reaction time and IQ. Intelligence, 36, 10-17.
72. Ratcliff, R., & Smith, P. L. (2004). A comparison of sequential sampling models for two-choice reaction time. Psychological Review, 111, 333-367.
73. Ratcliff, R., Spieler, D., & McKoon, G. (2000). Explicitly modeling the effects of aging on response time. Psychonomic Bulletin and Review, 7, 1-25.
74. Ratcliff, R., Spieler, D., & McKoon, G. (2004b). Analysis of group differences in processing speed: Where are the models of processing? Psychonomic Bulletin and Review, 11, 755-769.
75. Ratcliff, R., Thapar, A., Gomez, P., & McKoon, G. (2004c). A diffusion model analysis of the effects of aging in the lexical-decision task. Psychology and Aging, 19, 278-289. (Pubitemid 38720873)
76. Ratcliff, R., Thapar, A., & McKoon, G. (2001). The effects of aging on reaction time in a signal detection task. Psychology and Aging, 16, 323-341.
77. Ratcliff, R., Thapar, A., & McKoon, G. (2003). A diffusion model analysis of the effects of aging on brightness discrimination. Perception and Psychophysics, 65, 523-535. (Pubitemid 37544859)
78. Ratcliff, R., Thapar, A., & McKoon, G. (2004d). A diffusion model analysis of the effects of aging on recognition memory. Journal of Memory and Language, 50, 408-424. (Pubitemid 38651595)
79. Ratcliff, R., Thapar, A., & McKoon, G. (2006a). Aging and individual differences in rapid twochoice decisions. Psychonomic Bulletin and Review, 13, 626-635.
80. Ratcliff, R., Thapar, A., & McKoon, G. (2006b). Aging, practice, and perceptual tasks: A diffusion model analysis. Psychology and Aging, 21, 353-371.
81. Ratcliff, R., Thapar, A., & McKoon, G. (2007). Application of the diffusion model to two-choice tasks for adults 75-90 years old. Psychology and Aging, 22, 56-66.
82. Ratcliff, R., & Tuerlinckx, F. (2002). Estimating parameters of the diffusion model: Approaches to dealing with contaminant reaction times and parameter variability. Psychonomic Bulletin and Review, 9, 438-481.
83. Ratcliff, R., van Zandt, T., & McKoon, G. (1999). Connectionist and diffusion models of reaction time. Psychological Review, 102, 261-300.
84. Rouder, J. N., & Lu, J. (2005). An introduction to Bayesian hierarchical models with an application in the theory of signal detection. Psychonomic Bulletin and Review, 12, 573-604.
85. Rouder, J. N., Lu, J., Speckman, P. L., Sun, D., & Jiang, Y. (2005). A hierarchical model for estimating response time distributions. Psychonomic Bulletin and Review, 12, 195-223.
86. Rouder, J. N., Lu, J., Sun, D., Speckman, P., Morey, R., & Naveh-Benjamin, M. (2007). Signal detection models with random participant and item effects. Psychometrika, 72, 621-642.
87. Rubenstein, H., Garfield, L., & Millikan, J. A. (1970). Homographic entries in the internal lexicon. Journal of Verbal Learning and Verbal Behavior, 9, 487-494.
88. Salthouse, T. A. (1996). The processing-speed theory of adult age differences in cognition. Psychological Review, 103, 403-428.
89. Sanders, A. F. (1980). Stage analysis of reaction process. In G. E. Stelmach & J. Requin (Eds.), Tutorials in motor behavior (pp. 331-354). Amsterdam: North-Holland.
90. Schmiedek, F., Oberauer, K., Wilhelm, O., Süß, H. M., & Wittmann, W. W. (2007). Individual differences in components of reaction time distributions and their relations to working memory and intelligence. Journal of Experimental Psychology: General, 136, 414-429.
91. Schouten, J. F., & Bekker, J. A. M. (1967). Reaction time and accuracy. Acta Psychologica, 27, 143- 153.
92. Shiffrin, R. M., Lee, M. D., Wagenmakers, E.-J., & Kim, W. J. (in press). Model evaluation and selection: Established methods and recent developments. Cognitive Science.
93. Smith, P. L. (2000). Stochastic dynamic models of response time and accuracy: A foundational primer. Journal of Mathematical Psychology, 44, 408-463.
94. Spaniol, J., Madden, D. J., & Voss, A. (2006). A diffusion model analysis of adult age differences in episodic and semantic long-term memory retrieval. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32, 101-117.
95. Spiegelhalter, D. J., Thomas, A., Best, N., & Lunn, D. (2003). WinBUGS version 1.4 user manual. Cambridge, UK: Medical Research Council Biostatistics Unit.
96. Stone, M. (1960). Models for choice-reaction time. Psychometrika, 25, 251-260.
97. Strong, E. K., Jr. (1912). The effect of length of series upon recognition memory. Psychological Review, 19, 447-462.
98. Thapar, A., Ratcliff, R., & McKoon, G. (2003). A diffusion model analysis of the effects of aging on letter discrimination. Psychology and Aging, 18, 415-429. (Pubitemid 37152061)
99. Townsend, J. T., & Ashby, F. G. (1983). Stochastic modeling of elementary psychological processes. London: Cambridge University Press.
100. Tuerlinckx, F. (2004). The efficient computation of the cumulative distribution and probability density functions in the diffusion model. Behavior Research Methods, Instruments, and Computers, 36, 702-716.
101. Vandekerckhove, J., & Tuerlinckx, F. (2007). Fitting the Ratcliff diffusion model to experimental data. Psychonomic Bulletin and Review, 14, 1011-1026.
102. Vandekerckhove, J., & Tuerlinckx, F. (2008). Diffusion model analysis with MATLAB: A DMAT primer. Behavior Research Methods, 40, 61-72.
103. Vandekerckhove, J., Tuerlinckx, F., & Lee, M. D. (in press). A Bayesian approach to diffusion process models of decision-making. Proceedings of the 30th annual conference of the Cognitive Science Society.
104. Voss, A., Rothermund, K., & Voss, J. (2004). Interpreting the parameters of the diffusion model: An empirical validation. Memory and Cognition, 32, 1206-1220.
105. Voss, A., & Voss, J. (2007). Fast-dm: A free program for efficient diffusion model analysis. Behavior Research Methods, 39, 767-775.
106. Voss, A., & Voss, J. (2008). A fast numerical algorithm for the estimation of diffusion model parameters. Journal of Mathematical Psychology, 52, 1-9.
107. Wagenmakers, E.-J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin and Review, 14, 779-804.
108. Wagenmakers, E.-J., & Brown, S. (2007). On the linear relation between the mean and the standard deviation of a response time distribution. Psychological Review, 114, 830-841.
109. Wagenmakers, E.-J., Grasman, R. P. P. P., & Molenaar, P. C.M. (2005). On the relation between the mean and the variance of a diffusion model response time distribution. Journal of Mathematical Psychology, 49, 195-204.
110. Wagenmakers, E.-J., Ratcliff, R., Gomez, P., & McKoon, G. (2008). A diffusion model account of criterion shifts in the lexical decision task. Journal of Memory and Language, 58, 140-159.
111. Wagenmakers, E.-J., Steyvers, M., Raaijmakers, J. G. W., Shiffrin, R. M., van Rijn, H., & Zeelenberg, R. (2004). A model for evidence accumulation in the lexical decision task. Cognitive Psychology, 48, 332-367.
112. Wagenmakers, E- J., van der Maas, H. J. L., & Grasman, R. P. P. P. (2007). An EZ-diffusion model for response time and accuracy. Psychonomic Bulletin and Review, 14, 3-22.
113. Wagenmakers, E.-J., & Waldorp, L. (Eds.). (2006). Model selection: Theoretical developments and applications [Special issue]. Journal of Mathematical Psychology, 50(2).
114. Weeda, W. D., Wagenmakers, E.-J., & Huizenga, H. M. (2007). Empirical support for a diffusion model account of the worst performance rule. Manuscript submitted for publication.
115. Wickelgren, W. A. (1977). Speed-accuracy tradeoff and information processing dynamics. Acta Psychologica, 41, 67-85.
116. Yap, M. J., Balota, D. A., Cortese,M. J., &Watson, J. M. (2006). Single versus dual process models of lexical decision performance: Insights from RT distributional analysis. Journal of Experimental Psychology: Human Perception and Performance, 32, 1324-1344.