Of monkeys and men: Impatience in perceptual decision-making

Psychonomic Bulletin and Review

Volumn 23, Issue 3, 2016, Pages 738-749

  Boehm, Udo ^a   Hawkins, Guy E ^b   Brown, Scott ^c   van Rijn, Hedderik ^a   Wagenmakers, Eric Jan ^b  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

^c UNIVERSITY OF NEWCASTLE   (Australia)

Author keywords

Collapsing bounds; Decision making; Drift diffusion model; Reward rate maximization; Single cell recordings

Indexed keywords

ANIMAL; ANIMAL BEHAVIOR; BRAIN; DECISION MAKING; HAPLORHINI; HUMAN; NERVE CELL; PHYSIOLOGY; REWARD; SIGNAL NOISE RATIO;

ANIMALS; BEHAVIOR, ANIMAL; BRAIN; DECISION MAKING; HAPLORHINI; HUMANS; NEURONS; REWARD; SIGNAL-TO-NOISE RATIO;

EID: 84945580619     PISSN: 10699384     EISSN: 15315320     Source Type: Journal    
DOI: 10.3758/s13423-015-0958-5     Document Type: Review

References (111)

1. Adelson, E.H., & Bergen, J.R. (1985). Spatiotemporal energy models for the perception of motion. Journal of the Optical Society of America. A, Optics and Image Science, 2(2), 284–299. doi:10.1364/JOSAA.2.000284.
2. Ashby, F.G. (1983). A biased random walk model for two choice reaction times. Journal of Mathematical Psychology, 27, 277–297.
3. Balci, F., Simen, P., Niyogi, R., Saxe, A., Hughes, J.A., Holmes, P., & Cohen, J.D. (2011). Acquisition of decision making criteria: Reward rate ultimately beats accuracy. Attention, Perception & Psychophysics, 73(2), 640–657.
4. Boehm, U., Van Maanen, L., Forstmann, B., & Van Rijn, H. (2014). Trial-by-trial fluctuations in CNV amplitude reflect anticipatory adjustment of response caution. NeuroImage, 96, 95–105.
5. Bogacz, R., Brown, E., Moehlis, J., Holmes, P., & Cohen, J.D. (2006). The physics of optimal decision making: A formal analysis of models of performance in two-alternative forced-choice tasks. Psychological Review, 113(4), 700–765.
6. Bowman, N.E., Kording, K.P., & Gottfried, J.A. (2012). Temporal integration of olfactory perceptual evidence in human orbitofrontal cortex. Neuron, 75(5), 916–27.
7. Brázdil, M., Roman, R., Daniel, P., & Rektor, I. (2003). Intracerebral somatosensory event-related potentials: Effect of response type (button pressing versus mental counting) on P3-like potentials within the human brain. Clinical Neurophysiology, 114, 1489–1496.
8. Britten, K.H., Shadlen, M.N., Newsome, W.T., & Movshon, A.J. (1992). The analysis of visual motion: A comparison of neuronal and psychophysical performance. Journal of Neuroscience, 12(12), 4745–4765.
9. Britten, K.H., Shadlen, M.N., Newsome, W.T., & Movshon, A.J. (1993). Responses of neurons in macaque MT to stochastic motion signals. Visual Neuroscience, 10, 1157–1169.
10. Brown, S., Steyvers, M., & Wagenmakers, E.J. (2009). Observing evidence accumulation during multi-alternative decisions. Journal of Mathematical Psychology, 53(6), 453–462.
11. Busemeyer, J.R., & Rapoport, A. (1988). Psychological models of deferred decision making. Journal of Mathematical Psychology, 32(2), 91–134.
12. Cain, N., & Shea-Brown, E. (2012). Computational models of decision making: integration, stability, and noise. Current Opinion in Neurobiology, 22(6), 1047–1053.
13. Cavanagh, J.F., Wiecki, T.V., Cohen, M.X., Figueroa, C.M., Samanta, J., Sherman, S.J., & Frank, M.J. (2011). Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold. Nature Neuroscience, 14(11), 1462–1467.
14. Churchland, A.K., Kiani, R., Chaudhuri, R., Wang, X.J., Pouget, A., & Shadlen, M.N. (2011). Variance as a signature of neural computations during decision making. Neuron, 69(4), 818–831.
15. Churchland, A.K., Kiani, R., & Shadlen, M.N. (2008). Decision-making with multiple alternatives. Nature Neuroscience, 11(6), 693–702.
16. Cisek, P., Puskas, G.A., & El-Murr, S. (2009). Decisions in changing conditions: The urgency-gating model. Journal of Neuroscience, 29(37), 11560–11571.
17. Deco, G., Rolls, E.T., & Romo, R. (2009). Stochastic dynamics as a principle of brain function. Progress in Neurobiology, 88(1), 1–16.
18. Deneve, S. (2012). Making decisions with unknown sensory reliability. Frontiers in Neuroscience, 6. doi:10.3389/fnins.2012.00075.
19. Ditterich, J. (2006). Evidence for time-variant decision making. The European Journal of Neuroscience, 24 (12), 3628–3641.
20. Ditterich, J. (2006). Stochastic models of decisions about motion direction: Behavior and physiology. Neural Networks, 19(8), 981–1012.
21. Ditterich, J. (2010). A comparison between mechanisms of multi-alternative perceptual decision making: Ability to explain human behavior, predictions for neurophysiology, and relationship with decision theory. Frontiers in Neuroscience, 4. doi:10.3389/fnins.2010.00184.
22. Donner, T.H., Siegel, M., Fries, P., & Engel, A.K. (2009). Buildup of choice-predictive activity in human motor cortex during perceptual decision making. Current Biology, 19(18), 1581–1585.
23. Drugowitsch, J., Moreno-Bote, R., Churchland, A.K., Shadlen, M.N., & Pouget, A. (2012). The cost of accumulating evidence in perceptual decision making. Journal of Neuroscience, 32(11), 3612–3628.
24. Edwards, W. (1965). Optimal strategies for seeking information: Models for statistics, choice reaction time, and human information processing. Journal of Mathematical Psychology, 2, 312–329.
25. Forstmann, B.U., Ratcliff, R., & Wagenmakers, E. (in press). Sequential sampling models in cognitive neuroscience: Advantages, applications, and extensions. Annual Review of Psychology.
26. Frazier, P.I., & Yu, A.J. (2008). Sequential hypothesis testing under stochastic deadlines. In J. Platt, D. Koller, Y. Singer, & S. Roweis (Eds.), Advances in Neural Information Processing Systems 20 (pp. 465–472). Cambridge: MIT Press.
27. Gluth, S., Rieskamp, J., & Büchel, C. (2012). Deciding when to decide: Time-variant sequential sampling models explain the emergence of value-based decisions in the human brain. Journal of Neuroscience, 32(31), 10686–10698.
28. Gluth, S., Rieskamp, J., & Büchel, C. (2013). Classic EEG motor potentials track the emergence of value-based decisions. NeuroImage, 79, 394–403.
29. Gluth, S., Rieskamp, J., & Büchel, C. (2013). Deciding not to decide: Computational and neural evidence for hidden behavior in sequential choice. PLoS Computational Biology, 9(10), e1003309.
30. Gold, J.I., & Shadlen, M.N. (2007). The neural basis of decision making. Annual Review of Neuroscience, 30, 535–574.
31. Gold, J.I., Shadlen, M.N., & Sales, T. (2002). Banburismus and the brain: Decoding the relationship between sensory stimuli, decisions, and reward. Neuron, 36, 299–308.
32. Hanes, D.P., & Schall, J.D. (1996). Neural control of voluntary movement initiation. Science, 274(5286), 427– 430.
33. Hanks, T.D., Kiani, R., & Shadlen, M.N. (2014). A neural mechanism of speed-accuracy tradeoff in macaque area LIP. eLife, 3, e02260. doi:10.7554/eLife.02260.
34. Hanks, T.D., Mazurek, M.E., Kiani, R., Hopp, E., & Shadlen, M.N. (2011). Elapsed decision time affects the weighting of prior probability in a perceptual decision task. Journal of Neuroscience, 31(17), 6339–63352.
35. Hawkins, G.E., Brown, S.D., Steyvers, M., & Wagenmakers, E.-J. (2012a). An optimal adjustment procedure to minimize experiment time in decisions with multiple alternatives. Psychonomic Bulletin & Review, 19(2), 339–348.
36. Hawkins, G.E., Brown, S.D., Steyvers, M., & Wagenmakers, E.-J. (2012b). Context effects in multi-alternative decision making: Empirical data and a Bayesian model. Cognitive Science, 36(3), 498–516.
37. Hawkins, G.E., Brown, S.D., Steyvers, M., & Wagenmakers, E.-J. (2012c). Decision speed induces context effects in choice. Experimental Psychology, 59, 206–215.
38. Hawkins, G.E., Forstmann, B.U., Wagenmakers, E.-J., Ratcliff, R., & Brown, S.D. (2015). Revisiting the evidence for collapsing boundaries and urgency signals in perceptual decision-making. Journal of Neuroscience, 35(6), 2476–2484.
39. Hawkins, G.E., Wagenmakers, E.-J., Ratcliff, R., & Brown, S.D. (2015). Discriminating evidence accumulation from urgency signals in speeded decision making. Journal of Neurophysiology, 114(1), 40–47. doi:10.1152/jn.00088.2015.
40. Heath, R.A. (1981). A tandem random-walk model for psychological discrimination. British Journal of Mathematical and Statistical Psychology, 34, 76–92.
41. Heath, R.A. (1992). A general nonstationary diffusion model for two-choice decision-making. Mathematical Social Sciences, 23, 283–309.
42. Heekeren, H.R., Marrett, S., & Ungerleider, L.G. (2008). The neural systems that mediate human perceptual decision making. Nature Reviews Neuroscience, 9(6), 467–479.
43. Heitz, R.P., & Schall, J.D. (2012). Neural mechanisms of speed-accuracy tradeoff. Neuron, 76(3), 616–628.
44. Huang, Y., & Rao, R.P.N. (2013). Reward optimization in the primate brain: A probabilistic model of decision making under uncertainty. PLoS One, 8(1), e53344. doi:10.1371/journal.pone.0053344.
45. Huk, A.C., & Shadlen, M.N. (2005). Neural activity in macaque parietal cortex reflects temporal integration of visual motion signals during perceptual decision making. Journal of Neuroscience, 25(45), 10420–10436.
46. Janssen, P., & Shadlen, M.N. (2005). A representation of the hazard rate of elapsed time in macaque area LIP. Nature Neuroscience, 8(2), 234–41.
47. Jeffreys, H. (1961). Theory of Probability. Oxford: Oxford University Press.
48. Jentzsch, I., & Sommer, W. (2001). Sequence-sensitive subcomponents of P300: Topographical analyses and dipole source localization. Psychophysiology, 38, 607–621.
49. Jones, M., & Dzhafarov, E.N. (2014). Unfalsifiability and mutual translatability of major modeling schemes for choice reaction time. Psychological Review, 121(1), 1–32.
50. Kelly, S.P., & O’Connell, R.G. (2013). Internal and external influences on the rate of sensory evidence accumulation in the human brain. Journal of Neuroscience, 33(50), 19434– 19441.
51. Kiani, R., Hanks, T.D., & Shadlen, M.N. (2008). Bounded integration in parietal cortex underlies decisions even when viewing duration is dictated by the environment. The Journal of Neuroscience, 28(12), 3017–3029. doi:10.1523/JNEUROSCI.4761-07.2008.
52. Lang, W., Cheyne, D., Kristeva, R., Beisteiner, R., Lindinger, G., & Deecke, L. (1991). Three-dimensional localization of SMA activity preceding voluntary movement. A study of electric and magnetic fields in a patient with infarction of the right supplementary motor area. Experimental Brain Research, 87, 688– 695.
53. Leon, M.I., & Shadlen, M.N. (2003). Representation of time by neurons in the posterior parietal cortex of the macaque. Neuron, 38, 317–327.
54. Leuthold, H., & Jentzsch, I. (2002). Distinguishing neural sources of movement preparation and execution: An electrophysiological analysis. Biological Psychology, 60, 173–198.
55. Lo, C.-C., Boucher, L., Paré, M., Schall, J.D., & Wang, X.-J. (2009). Proactive inhibitory control and attractor dynamics in countermanding action: A spiking neural circuit model. Journal of Neuroscience, 29(28), 9059–9071.
56. Maddox, W.T., & Bohil, C.J. (1998). Base-rate and payoff effects in multidimensional perceptual categorization. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24(6), 1459–1482.
57. Mantini, D., Hasson, U., Betti, V., Perrucci, M.G., Romani, G.L., Corbetta, M., Orban, G.A., & Vanduffel, W. (2012). Interspecies activity correlations reveal functional correspondence between monkey and human brain areas. Nature Methods, 9(3), 277–282.
58. Martin, T., Huxlin, K.R., & Kavcic, V. (2010). Motion-onset visual evoked potentials predict performance during a global direction discrimination task. Neuropsychologia, 48(12), 3563–3572.
59. Miller, P., & Katz, D.B. (2013). Accuracy and response-time distributions for decision-making: Linear perfect integrators versus nonlinear attractor-based neural circuits. Journal of Computational Neuroscience, 35(3), 261–294.
60. Milosavljevic, M., Malmaud, J., & Huth, A. (2010). The Drift Diffusion Model can account for the accuracy and reaction time of value-based choices under high and low time pressure. Judgment and Decision Making, 5(6), 437–449.
61. Mulder, M.J., Wagenmakers, E.-J., Ratcliff, R., Boekel, W., & Forstmann, B.U. (2012). Bias in the brain: A diffusion model analysis of prior probability and potential payoff. Journal of Neuroscience, 32, 2335–2343.
62. Niyogi, R.K., & Wong-Lin, K. (2013). Dynamic excitatory and inhibitory gain modulation can produce flexible, robust and optimal decision-making. PLoS Computational Biology, 9(6), e1003099. doi:10.1371/journal.pcbi.1003099.
63. O’Connell, R.G., Dockree, P.M., & Kelly, S.P. (2012). A supramodal accumulation-to-bound signal that determines perceptual decisions in humans. Nature Neuroscience, 15(12), 1729–1735.
64. Orban, G.A., Van Essen, D., & Vanduffel, W. (2004). Comparative mapping of higher visual areas in monkeys and humans. Trends in Cognitive Sciences, 8(7), 315–324.
65. Ossmy, O., Moran, R., Pfeffer, T., Tsetsos, K., Usher, M., & Donner, T.H. (2013). The timescale of perceptual evidence integration can be adapted to the environment. Current Biology, 23(11), 981–986. doi:10.1016/j.cub.2013.04.039.
66. Petrides, M., Tomaiuolo, F., Yeterian, E.H., & Pandya, D.N. (2012). The prefrontal cortex: Comparative architectonic organization in the human and the macaque monkey brains. Cortex, 48(1), 46– 57.
67. Philiastides, M.G., & Sajda, P. (2006). Temporal characterization of the neural correlates of perceptual decision making in the human brain. Cerebral Cortex, 16, 509–518.
68. Pike, A.R. (1968). Latency and relative frequency of response in psychophysical discrimination. British Journal of Mathematical and Statistical Psychology, 21(2), 161–182.
69. Pitz, G.F. (1968). Information seeking when available information is limited. Journal of Experimental Psychology, 76(1), 25–34.
70. Polich, J. (2007). Updating P300: An integrative theory of P3a and P3b. Clinical Neurophysiology, 118, 2128– 2148.
71. Purcell, B.A., Heitz, R.P., Cohen, J.Y., Schall, J.D., Logan, G.D., & Palmeri, T.J. (2010). Neurally constrained modeling of perceptual decision making. Psychological Review, 117(4), 1113– 1143.
72. Purcell, B.A., Schall, J.D., Logan, G.D., & Palmeri, T.J. (2012). From salience to saccades: Multiple-alternative gated stochastic accumulator model of visual search. Journal of Neuroscience, 32(10), 3433–3446.
73. Rao, R.P.N. (2010). Decision making under uncertainty: A neural model based on partially observable markov decision processes. Frontiers in Computational Neuroscience, 4. doi:10.3389/fncom.2010.00146.
74. Rapoport, A., & Burkheimer, G.J. (1971). Models for deferred decision making. Journal of Mathematical Psychology, 8, 508–538.
75. Ratcliff, R. (1978). A theory of memory retrieval. Psychological Review, 85(2), 59–108.
76. Ratcliff, R., Hasegawa, Y.T., Hasegawa, R.P., Childers, R., Smith, P.L., & Segraves, M.A. (2011). Inhibition in superior colliculus neurons in a brightness discrimination task? Neural Computation, 23, 1790–1820.
77. Ratcliff, R., Hasegawa, Y.T., Hasegawa, R.P., Smith, P.L., & Segraves, M.A. (2007). Dual diffusion model for single-cell recording data from the superior colliculus in a brightness-discrimination task. Journal of Neurophysiology, 97, 1756–1774.
78. Ratcliff, R., & McKoon, G. (2008). The diffusion decision model: Theory and data for two-choice decision tasks. Neural Computation, 20, 873–922.
79. Ratcliff, R., Philiastides, M.G., & Sajda, P. (2009). Quality of evidence for perceptual decision making is indexed by trial-to-trial variability of the EEG. Proceedings of the National Academy of Sciences, 106, 6539–6544.
80. Ratcliff, R., & Smith, P.L. (2004). A comparison of sequential sampling models for two-choice reaction time. Psychological Review, 111(2), 333–367.
81. Resulaj, A., Kiani, R., Wolpert, D.M., & Shadlen, M.N. (2009). Changes of mind in decision-making. Nature, 461(7261), 263–266.
82. Roitman, J.D., & Shadlen, M.N. (2002). Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. Journal of Neuroscience, 22(21), 9475–9989.
83. Sanders, A.F., & Ter Linden, W. (1967). Decision making during paced arrival of probabilistic information. Acta Psychologica, 27, 170–177.
84. Shadlen, M.N., & Kiani, R. (2013). Decision making as a window on cognition. Neuron, 80(3), 791–806.
85. Shadlen, M.N., & Newsome, W.T. (2001). Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. Journal of Neurophysiology, 86(4), 1916–1936.
86. Siegel, M., Engel, A.K., & Donner, T.H. (2011). Cortical network dynamics of perceptual decision-making in the human brain. Frontiers in Human Neuroscience, 5. doi:10.3389/fnhum.2011.00021.
87. Simen, P., Contreras, D., Buck, C., Hu, P., Holmes, P., & Cohen, J.D. (2009). Reward rate optimization in two-alternative decision making: Empirical tests of theoretical predictions. Journal of Experimental Psychology: Human Perception and Performance, 35(6), 1865–97.
88. Smith, P.L. (1995). Psychophysically principled models of visual simple reaction time. Psychological Review, 102(3), 567–593.
89. Smith, P.L. (2010). From Poisson shot noise to the integrated Ornstein-Uhlenbeck process: Neurally principled models of information accumulation in decision-making and response time. Journal of Mathematical Psychology, 54 (2), 464–465. doi:10.1016/j.jmp.2010.07.004.
90. Standage, D., You, H., Wang, D.-H., & Dorris, M.C. (2011). Gain modulation by an urgency signal controls the speed-accuracy trade-off in a network model of a cortical decision circuit. Frontiers in Computational Neuroscience, 5. doi:10.3389/fncom.2011.00007.
91. Starns, J.J., & Ratcliff, R. (2010). The effects of aging on the speed-accuracy compromise: Boundary optimality in the diffusion model. Psychology and Aging, 25(2), 377–390.
92. Starns, J.J., & Ratcliff, R. (2012). Age-related differences in diffusion model boundary optimality with both trial-limited and time-limited tasks. Psychonomic Bulletin & Review, 19, 139–145.
93. Stone, M. (1960). Models for choice-reaction time. Psychometrika, 25, 251–260.
94. Summerfield, C., & Tsetsos, K. (2012). Building bridges between perceptual and economic decision-making: Neural and computational mechanisms. Frontiers in Neuroscience, 6. doi:10.3389/fnins.2012.00070.
95. Sutton, S., Braren, M., Zubin, J., & John, E. (1965). Evoked potential correlates of stimulus uncertainty. Science, 150, 1187– 1188.
96. Swensson, R.G., & Thomas, R.E. (1974). Fixed and optional stopping models for two-choice discrimination times. Journal of Mathematical Psychology, 11, 213–236.
97. Thomas, N.W.D., & Paré, M. (2007). Temporal processing of saccade targets in parietal cortex area LIP during visual search. Journal of Neurophysiology, 97(1), 942–947.
98. Thura, D., Beauregard-Racine, J., Fradet, C.-W., & Cisek, P. (2012). Decision making by urgency gating: Theory and experimental support. Journal of Neurophysiology, 108(11), 2912–2930.
99. Thura, D., & Cisek, P. (2014). Deliberation and commitment in the premotor and primary motor cortex during dynamic decision making. Neuron, 81(6), 1401–1416.
100. Thura, D., Cos, I., Trung, J., & Cisek, P. (2014). Context-dependent urgency influences speed-accuracy trade-offs in decision-making and movement execution. Journal of Neuroscience, 34(49), 16442–16454.
101. Usher, M., & McClelland, J.L. (2001). The time course of perceptual choice: The leaky, competing accumulator model. Psychological Review, 108(3), 550–592.
102. Van Vugt, M.K., Simen, P., Nystrom, L.E., Holmes, P., & Cohen, J.D. (2012). EEG oscillations reveal neural correlates of evidence accumulation. Frontiers in Neuroscience, 6. doi:10.3389/fnins.2012.00106.
103. Vandekerckhove, J., Matzke, D., & Wagenmakers, E.-J. (2015). Model comparison and the principle of parsimony. In J. Busemeyer, J. Townsend, Z.J. Wang, & A. Eidels (Eds.), Oxford Handbook of Computational and Mathematical Psychology. Oxford: Oxford University Press.
104. Vickers, D. (1979). Decision Processes in Visual Perception. London: Academic Press.
105. Wallsten, T.S. (1968). Failure of predictions from subjectively expected utility theory in a Bayesian decision task. Organizational Behavior and Human Performance, 3, 239–252.
106. Wang, X.-J. (2002). Probabilistic decision making by slow reverrberation in cortical circuits. Neuron, 36(5), 955–968.
107. Watson, A.B., & Ahumada, A.J. (1985). Model of human visual-motion sensing. Journal of the Optical Society of America. A, Optics and Image Science, 2(2), 322–342.
108. Winkel, J., Keuken, M.C., Van Maanen, L., Wagenmakers, E.-J., & Forstmann, B.U. (2014). Early evidence affects later decisions: Why evidence accumulation is required to explain response time data. Psychonomic Bulletin & Review, 21(3), 777–784.
109. Wyart, V., de Gardelle, V., Scholl, J., & Summerfield, C. (2012). Rhythmic fluctuations in evidence accumulation during decision making in the human brain. Neuron, 76(4), 847– 858.
110. Zandbelt, B., Purcell, B.A., Palmeri, T.J., Logan, G.D., & Schall, J.D. (2014). Response times from ensembles of accumulators. Proceedings of the National Academy of Sciences, 111(7), 2848–2853.
111. Zhang, S., Lee, M.D., Vandekerckhove, J., Maris, G., & Wagenmakers, E.-J. (2014). Time-varying boundaries for diffusion models of decision making and response time. Frontiers in Psychology, 5. doi:10.3389/fpsyg.2014.01364.