Accuracy and response-time distributions for decision-making: Linear perfect integrators versus nonlinear attractor-based neural circuits

Journal of Computational Neuroscience

Volumn 35, Issue 3, 2013, Pages 261-294

  Miller, Paul ^a   Katz, Donald B ^a  

^a BRANDEIS UNIVERSITY   (United States)

Author keywords

Decision; Hidden Markov model; Ramping; State sequence; Transitions; Urgency gating

Indexed keywords

ECONOMIC AND SOCIAL EFFECTS; ELECTROPHYSIOLOGY; HIDDEN MARKOV MODELS; INTEGRATION; TIMING CIRCUITS;

CONDITION; DECISION; DECISIONS MAKINGS; HIDDEN-MARKOV MODELS; PERFECT INTEGRATORS; RAMPING; STABLE ATTRACTORS; STATE SEQUENCES; TRANSITION; URGENCY-GATING;

DECISION MAKING;

ACCURACY; ARTICLE; DECISION MAKING; LINEAR PERFECT INTEGRATOR; MATHEMATICAL MODEL; NERVE CELL; NERVE POTENTIAL; NERVOUS SYSTEM PARAMETERS; NONLINEAR ATTRACTOR BASED NEURAL CIRCUIT; PRIORITY JOURNAL; RESPONSE TIME; STIMULUS RESPONSE; ALGORITHM; ARTIFICIAL NEURAL NETWORK; COMPARATIVE STUDY; COMPUTER SIMULATION; ELECTROPHYSIOLOGY; HUMAN; NONLINEAR SYSTEM; PH; PHYSIOLOGY; PROBABILITY; PSYCHOMOTOR PERFORMANCE; REACTION TIME; REWARD; SENSORY GATING; STATISTICAL MODEL;

ALGORITHMS; COMPUTER SIMULATION; DECISION MAKING; ELECTROPHYSIOLOGICAL PROCESSES; HUMANS; HYDROGEN-ION CONCENTRATION; LINEAR MODELS; NEURAL NETWORKS (COMPUTER); NEURONS; NONLINEAR DYNAMICS; PROBABILITY; PSYCHOMOTOR PERFORMANCE; REACTION TIME; REWARD; SENSORY GATING;

EID: 84886600600     PISSN: 09295313     EISSN: 15736873     Source Type: Journal    
DOI: 10.1007/s10827-013-0452-x     Document Type: Article

References (108)

1. Abeles, M.; Bergman, H.; Gat, I.; Meilijson, I.; Seidemann, E.; Tishby, N.; & Vaadia, E. (1995). Cortical activity flips among quasi-stationary states. Proceedings of the National Academy of Sciences of the United States of America, 92, 8616-8620.
2. Balci, F.; Simen, P.; Niyogi, R.; Saxe, A.; Hughes, J. A.; Holmes, P.; & Cohen, J. D. (2011). Acquisition of decision making criteria: reward rate ultimately beats accuracy. Attention, Perception, & Psychophysics, 73, 640-657.
3. Beck, J. M.; Ma, W. J.; Kiani, R.; Hanks, T.; Churchland, A. K.; Roitman, J.; Shadlen, M. N.; Latham, P. E.; & Pouget, A. (2008). Probabilistic population codes for Bayesian decision making. Neuron, 60, 1142-1152.
4. Bertsekas, D. P. (2005). Dynamic Programming and Optimal Control. Belmont: Athena Scientific.
5. Bogacz, R.; Brown, E.; Moehlis, J.; Holmes, P.; & Cohen, J. D. (2006). The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychological Review, 113, 700-765.
6. Bogacz, R.; Hu, P. T.; Holmes, P. J.; & Cohen, J. D. (2010). Do humans produce the speed-accuracy trade-off that maximizes reward rate? Quarterly Journal of Experimental Psychology, 63, 863-891.
7. Bollimunta, A.; Totten, D.; & Ditterich, J. (2012). Neural dynamics of choice: single-trial analysis of decision-related activity in parietal cortex. The Journal of neuroscience: the official journal of the Society for Neuroscience, 32, 12684-12701.
8. Bouvrie, J.; Slotine, J.J. (2011). Synchronization and Redundancy: Implications for Robustness of Neural Learning and Decision Making. Neural Computation 23, 2915-2941.
9. Broderick, T.; Wong-Lin, K. F.; & Holmes, P. (2009). Closed-form approximations of first-passage distributions for a stochastic decision-making model. Applied Mathematical Research Express, 2009, 123-141.
10. Brody, C. D.; Hernández, A.; Zainos, A.; Lemus, L.; & Romo, R. (2003). Timing and neural encoding of somatosensory parametric working memory in macaque prefrontal cortex. Cerebral Cortex, 13, 1196-1207.
11. Brown, E.; Gao, J.; Holmes, P.; Bogacz, R.; Gilzenrat, M.; & Cohen, J. D. (2005). Simple neural networks that optimize decisions. International Journal of Bifurcation and Chaos, 15, 803-826.
12. Churchland, A. K.; Kiani, R.; & Shadlen, M. N. (2008). Decision-making with multiple alternatives. Nature Neuroscience, 11, 693-702.
13. Churchland, A. K.; Kiani, R.; Chaudhuri, R.; Wang, X. J.; Pouget, A.; & Shadlen, M. N. (2011). Variance as a signature of neural computations during decision making. Neuron, 69, 818-831.
14. Cisek, P.; Puskas, G. A.; & El-Murr, S. (2009). Decisions in changing conditions: the urgency-gating model. Journal of Neuroscience, 29, 11560-11571.
15. Compte, A.; Brunel, N.; Goldman-Rakic, P. S.; & Wang, X. J. (2000). Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. Cerebral Cortex, 10, 910-923.
16. Deco, G.; & Marti, D. (2007). Extended method of moments for deterministic analysis of stochastic multistable neurodynamical systems. Physical Review. E, Statistical, Nonlinear, and Soft Matter Physics, 75, 031913.
17. Deco, G.; & Rolls, E. T. (2006). Decision-making and Weber's law: a neurophysiological model. European Journal of Neuroscience, 24, 901-916.
18. Deco, G.; Rolls, E. T.; & Romo, R. (2009). Stochastic dynamics as a principle of brain function. Progress in Neurobiology, 88, 1-16.
19. Deco, G.; Rolls, E. T.; Albantakis, L.; Romo, R. (2013). Brain mechanisms for perceptual and reward-related decision-making. Progress in Neurobiology, 103, 194-213.
20. Ditterich, J. (2006). Evidence for time-variant decision making. The European Journal of Neuroscience, 24, 3628-3641.
21. Drugowitsch, J.; Moreno-Bote, R.; Churchland, A. K.; Shadlen, M. N.; & Pouget, A. (2012). The cost of accumulating evidence in perceptual decision making. The Journal of neuroscience: the official journal of the Society for Neuroscience, 32, 3612-3628.
22. Eckhoff, P.; Holmes, P.; Law, C.; Connolly, P. M.; & Gold, J. I. (2008). On diffusion processes with variable drift rates as models for decision making during learning. New Journal of Physics, 10, nihpa49499.
23. Eckhoff, P.; Wong-Lin, K. F.; & Holmes, P. (2009). Optimality and robustness of a biophysical decision-making model under norepinephrine modulation. The Journal of neuroscience: the official journal of the Society for Neuroscience, 29, 4301-4311.
24. Eckhoff, P.; Wong-Lin, K.; & Holmes, P. (2011). Dimension reduction and dynamics of a spiking neural network model for decision making under neuromodulation. SIAM Journal on Applied Dynamical Systems, 10, 148-188.
25. Farkas, Z.; & Fülöp, T. (2001). One-dimensional drift-diffusion between two absorbing boundaries: application to granular segregation. Journal of Physics AA: Mathematical and General, 34, 3191-3198.
26. Feng, S.; Holmes, P.; Rorie, A.; & Newsome, W. T. (2009). Can monkeys choose optimally when faced with noisy stimuli and unequal rewards? PLoS Computational Biology, 5, e1000284.
27. Frazier, P. I.; Yu, A. J. (2007). Sequential hypothesis testing under stochastic deadlines. In J. C. Platt, et al. (Eds.), Advances in Neural Information Processing Systems (NIPS), vol. 20 (p. 953).
28. Gammaitoni, L.; & Hänggi, P. (1998). Stochastic Resonance. Reviews of Modern Physics, 70, 223-287.
29. Gat, I.; Tishby, N.; Abeles, M. (1997). Hidden markov modeling of simultaneously recorded cells in the associative cortex of behaving monkeys.
30. Genovesio, A.; Tsujimoto, S.; & Wise, S. P. (2006). Neuronal activity related to elapsed time in prefrontal cortex. Journal of Neurophysiology, 95, 3281-3285.
31. Glimcher, P. W. (2001). Making choices: the neurophysiology of visual-saccadic decision making. Trends in Neurosciences, 24, 654-659.
32. Glimcher, P. W. (2003). The neurobiology of visual-saccadic decision making. Annual Review of Neuroscience, 26, 133-179.
33. Gluckman, B. J.; So, P.; Netoff, T. I.; Spano, M. L.; & Schiff, S. J. (1998). Stochastic resonance in mammalian neuronal networks. Chaos, 8, 588-598.
34. Gold, J. I.; & Shadlen, M. N. (2000). Representation of a perceptual decision in developing oculomotor commands. Nature, 404, 390-394.
35. Gold, J. I.; & Shadlen, M. N. (2001). Neural computations that underlie decisions about sensory stimuli. Trends in Cognitive Sciences, 5, 10-16.
36. Gold, J. I.; & Shadlen, M. N. (2003). The influence of behavioral context on the representation of a perceptual decision in developing oculomotor commands. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 23, 632-651.
37. Gold, J. I.; & Shadlen, M. N. (2007). The neural basis of decision making. Annual Review of Neuroscience, 30, 535-574.
38. Goldman, M. S.; Levine, J. H.; Major, G.; Tank, D. W.; & Seung, H. S. (2003). Robust persistent neural activity in a model integrator with multiple hysteretic dendrites per neuron. Cerebral Cortex, 13, 1185-1195.
39. Huk, A. C.; & Shadlen, M. N. (2005). Neural activity in macaque parietal cortex reflects temporal integration of visual motion signals during perceptual decision making. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 25, 10420-10436.
40. Janssen, P.; & Shadlen, M. N. (2005). A representation of the hazard rate of elapsed time in macaque area LIP. Nature Neuroscience, 8, 234-241.
41. Jones, L. M.; Fontanini, A.; Sadacca, B. F.; Miller, P.; & Katz, D. B. (2007). Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles. Proceedings of the National Academy of Sciences of the United States of America, 104, 18772-18777.
42. Jun, J. K.; Miller, P.; Hernandez, A.; Zainos, A.; Lemus, L.; Brody, C. D.; & Romo, R. (2010). Heterogenous population coding of a short-term memory and decision task. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 30, 916-929.
43. Kiani, R.; Hanks, T. D.; & Shadlen, M. N. (2008). Bounded integration in parietal cortex underlies decisions even when viewing duration is dictated by the environment. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 28, 3017-3029.
44. Koulakov, A. A.; Raghavachari, S.; Kepecs, A.; & Lisman, J. E. (2002). Model for a robust neural integrator. Nature Neuroscience, 5, 775-782.
45. Larsen, T.; & Bogacz, R. (2010). Initiation and termination of integration in a decision process. Neural Networks, 23, 322-333.
46. Leon, M. I.; & Shadlen, M. N. (2003). Representation of time by neurons in the posterior parietal cortex of the macaque. Neuron, 38, 317-327.
47. Lo, C. C.; & Wang, X. J. (2006). Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks. Nature Neuroscience, 9, 956-963.
48. Luce, R. D. (1986). Response Times. New York: Oxford University Press.
49. Luna, R.; Hernández, A.; Brody, C.D.; Romo, R. (2005). Neural codes for perceptual discrimination in primary somatosensory cortex. Nature Neuroscience 8, 1210-1219.
50. Machens, C. K.; Romo, R.; & Brody, C. D. (2005). Flexible control of mutual inhibition: a neural model of two-interval discrimination. Science, 307, 1121-1124.
51. Marti, D.; Deco, G.; Mattia, M.; Gigante, G.; & Del Giudice, P. (2008). A fluctuation-driven mechanism for slow decision processes in reverberant networks. PLoS One, 3, e2534.
52. Mazurek, M. E.; Roitman, J. D.; Ditterich, J.; & Shadlen, M. N. (2003). A role for neural integrators in perceptual decision making. Cerebral Cortex, 13, 1257-1269.
53. McDonnell, M. D.; & Abbott, D. (2009). What Is Stochastic Resonance? Definitions, Misconceptions, Debates, and Its Relevance to Biology. PLoS Computational Biology, 5, e1000348.
54. Meyer-Baese, A.; Koshkouei, A. J.; Emmett, M. R.; & Goodall, D. P. (2009). Global stability analysis and robust design of multi-time-scale biological networks under parametric uncertainties. Neural Networks: the Official Journal of the International Neural Network Society, 22, 658-663.
55. Miller, P.; & Katz, D. B. (2010). Stochastic transitions between neural states in taste processing and decision-making. Journal of Neuroscience, 30, 2559-2570.
56. Miller, P.; & Katz, D. B. (2011). Stochastic Transitions between States of Neural Activity. In M. Ding & D. L. Glanzman (Eds.), The Dynamic Brain: An Exploration of Neuronal Variability and Its Functional Significance (pp. 29-46). New York: Oxford University Press.
57. Miller, P.; Brody, C. D.; Romo, R.; & Wang, X. J. (2003). A recurrent network model of somatosensory parametric working memory in the prefrontal cortex. Cerebral Cortex, 13, 1208-1218.
58. Mita, A.; Mushiake, H.; Shima, K.; Matsuzaka, Y.; & Tanji, J. (2009). Interval time coding by neurons in the presupplementary and supplementary motor areas. Nature Neuroscience, 12, 502-507.
59. Moreno-Bote, R.; Rinzel, J.; & Rubin, N. (2007). Noise-induced alternations in an attractor network model of perceptual bistability. Journal of Neurophysiology, 98, 1125-1139.
60. Nigoyi, R.; & Wong-Lin, K. (2010). Time-varying gain modulation on neural circuit dynamics and performance in perceptual decisions. In Abstract #246 Computational and Systems Neuroscience (CoSyNe). Salt Lake City: Frontiers in Neuroscience.
61. Okamoto, H.; Isomura, Y.; Takada, M.; & Fukai, T. (2007). Temporal integration by stochastic recurrent network dynamics with bimodal neurons. Journal of Neurophysiology, 97, 3859-3867.
62. Platt, M. L.; & Glimcher, P. W. (1999). Neural correlates of decision variables in parietal cortex. Nature, 400, 233-238.
63. Ponce-Alvarez, A.; Nacher, V.; Luna, R.; Riehle, A.; & Romo, R. (2012). Dynamics of cortical neuronal ensembles transit from decision making to storage for later report. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 32, 11956-11969.
64. Purcell, B. A.; Heitz, R. P.; Cohen, J. Y.; Schall, J. D.; Logan, G. D.; & Palmeri, T. J. (2010). Neurally constrained modeling of perceptual decision making. Psychological Review, 117, 1113-1143.
65. Ratcliff, R. (1978). A theory of memory retrieval. Psychological Review, 85, 59-108.
66. Ratcliff, R. (2008). Modeling aging effects on two-choice tasks: response signal and response time data. Psychology and Aging, 23, 900-916.
67. Ratcliff, R.; & McKoon, G. (2008). The diffusion decision model: theory and data for two-choice decision tasks. Neural Computation, 20, 873-922.
68. Ratcliff, R.; & Rouder, J. N. (1998). Modeling response times for two-choice decisions. Psychological Science, 9, 347-356.
69. Ratcliff, R.; Cherian, A.; & Segraves, M. (2003). A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. Journal of Neurophysiology, 90, 1392-1407.
70. Renart, A.; Song, P.; & Wang, X. J. (2003). Robust spatial working memory through homeostatic synaptic scaling in heterogeneous cortical networks. Neuron, 38, 473-485.
71. Resulaj, A.; Kiani, R.; Wolpert, D. M.; & Shadlen, M. N. (2009). Changes of mind in decision-making. Nature, 461, 263-266.
72. Roitman, J. D.; & Shadlen, M. N. (2002). Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. Journal of Neuroscience, 22, 9475-9489.
73. Romo, R.; Brody, C. D.; Hernández, A.; & Lemus, L. (1999). Neuronal correlates of parametric working memory in the prefrontal cortex. Nature, 399, 470-474.
74. Romo, R.; Hernández, A.; Zainos, A.; Lemus, L.; & Brody, C. D. (2002). Neuronal correlates of decision-making in secondary somatosensory cortex. Nature Neuroscience, 5, 1217-1225.
75. Romo, R.; Hernández, A.; & Zainos, A. (2004). Neuronal correlates of a perceptual decision in ventral premotor cortex. Neuron, 41, 165-173.
76. Roxin, A.; & Ledberg, A. (2008). Neurobiological models of two-choice decision making can be reduced to a one-dimensional nonlinear diffusion equation. PLoS Computational Biology, 4, e1000046.
77. Rüter, J.; Marcille, N.; Sprekeler, H.; Gerstner, W.; & Herzog, M. H. (2012). Paradoxical evidence integration in rapid decision processes. PLoS Computational Biology, 8, e1002382.
78. Sakai, Y.; Okamoto, H.; & Fukai, T. (2006). Computational algorithms and neuronal network models underlying decision processes. Neural Networks, 19, 1091-1105.
79. Salinas, E.; Shankar, S.; Costello, M. G.; Zhu, D.; & Stanford, T. R. (2010). Waiting is the Hardest Part: Comparison of Two Computational Strategies for Performing a Compelled-Response Task. Frontiers in Computational Neuroscience, 4, 153.
80. Seidemann, E.; Meilijson, I.; Abeles, M.; Bergman, H.; & Vaadia, E. (1996). Simultaneously recorded single units in the frontal cortex go through sequences of discrete and stable states in monkeys performing a delayed localization task. Journal of Neuroscience, 16, 752-768.
81. Seung, H. S. (1996). How the brain keeps the eyes still. Proceedings of the National Academy of Sciences of the United States of America, 93, 13339-13344.
82. Seung, H. S.; Lee, D. D.; Reis, B. Y.; & Tank, D. W. (2000). The autapse: a simple illustration of short-term analog memory storage by tuned synaptic feedback. Journal of Computational Neuroscience, 9, 171-185.
83. Shadlen, M. N.; & Newsome, W. T. (1996). Motion perception: seeing and deciding. Proceedings of the National Academy of Sciences of the United States of America, 93, 628-633.
84. Shadlen, M. N.; & Newsome, W. T. (2001). Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. Journal of Neurophysiology, 86, 1916-1936.
85. Shankar, S.; Massoglia, D. P.; Zhu, D.; Costello, M. G.; Stanford, T. R.; & Salinas, E. (2011). Tracking the temporal evolution of a perceptual judgment using a compelled-response task. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 31, 8406-8421.
86. Shea-Brown, E.; Gilzenrat, M. S.; & Cohen, J. D. (2008). Optimization of decision making in multilayer networks: the role of locus coeruleus. Neural Computation, 20, 2863-2894.
87. Silver, M. R.; Grossberg, S.; Bullock, D.; Histed, M. H.; & Miller, E. K. (2012). A neural model of sequential movement planning and control of eye movements: Item-Order-Rank working memory and saccade selection by the supplementary eye fields. Neural Networks: the Official Journal of the International Neural Network Society, 26, 29-58.
88. Simen, P.; Cohen, J. D.; & Holmes, P. (2006). Rapid decision threshold modulation by reward rate in a neural network. Neural Networks: the Official Journal of the International Neural Network Society, 19, 1013-1026.
89. Simen, P.; Contreras, D.; Buck, C.; Hu, P.; Holmes, P.; & Cohen, J. D. (2009). Reward rate optimization in two-alternative decision making: empirical tests of theoretical predictions. Journal of Experimental Psychology. Human Perception and Performance, 35, 1865-1897.
90. Smith, P. L.; & Ratcliff, R. (2004). Psychology and neurobiology of simple decisions. Trends in Neurosciences, 27, 161-168.
91. Song, P.; & Wang, X. J. (2005). Angular Path Integration by Moving "Hill of Activity": A Spiking Neuron Model without Recurrent Excitation of the Head-Direction System. Journal of Neuroscience, 25, 1002-1014.
92. Standage, D.; You, H.; Wang, D. H.; & Dorris, M. C. (2011). Gain modulation by an urgency signal controls the speed-accuracy trade-off in a network model of a cortical decision circuit. Frontiers in Computational Neuroscience, 5, 7.
93. Stanford, T. R.; Shankar, S.; Massoglia, D. P.; Costello, M. G.; & Salinas, E. (2010). Perceptual decision making in less than 30 milliseconds. Nature Neuroscience, 13, 379-385.
94. Swensson, R. G. (1972). The elusive tradeoff: speed versus accuracy in visual discrimination tasks. Perception & Psychophysics, 12, 16-32.
95. Theodoni, P.; Kovacs, G.; Greenlee, M. W.; & Deco, G. (2011a). Neuronal adaptation effects in decision making. Journal of Neuroscience, 31, 234-246.
96. Theodoni, P.; Panagiotaropoulos, T. I.; Kapoor, V.; Logothetis, N. K.; & Deco, G. (2011b). Cortical microcircuit dynamics mediating binocular rivalry: the role of adaptation in inhibition. Frontiers in Human Neuroscience, 5, 145.
97. Usher, M.; & McClelland, J. L. (2001). The time course of perceptual choice: the leaky, competing accumulator model. Psychological Review, 108, 550-592.
98. Wald, A. (1947). Sequential analysis. New York: Wiley.
99. Wald, A.; & Wolfowitz, J. (1948). Optimum character of the sequential probability ratio test. Annals of Mathematical Statistics, 19, 326-339.
100. Wang, X. J. (2001). Synaptic reverberation underlying mnemonic persistent activity. Trends in Neurosciences, 24, 455-463.
101. Wang, X. J. (2002). Probabilistic decision making by slow reverberation in cortical circuits. Neuron, 36, 955-968.
102. Wong, K. F.; & Wang, X. J. (2006). A recurrent network mechanism of time integration in perceptual decisions. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 26, 1314-1328.
103. Wong, K. F.; Huk, A. C.; Shadlen, M. N.; & Wang, X. J. (2007). Neural circuit dynamics underlying accumulation of time-varying evidence during perceptual decision making. Frontiers in Computational Neuroscience, 1, 6.
104. Yoshida, T.; & Katz, D. B. (2011). Control of prestimulus activity related to improved sensory coding within a discrimination task. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 31, 4101-4112.
105. Zhang, K. (1996). Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 16, 2112-2126.
106. Zhang, J.; & Bogacz, R. (2010). Bounded Ornstein-Uhlenbeck models for two-choice time controlled tasks. Journal of Mathematical Psychology, 54, 322-333.
107. Zhang, J.; Bogacz, R.; & Holmes, P. (2009). A comparison of bounded diffusion models for choice in time controlled tasks. Journal of Mathematical Psychology, 53, 231-241.
108. Zhou, X.; Wong-Lin, K.; & Philip, H. (2009). Time-varying perturbations can distinguish among integrate-to-threshold models for perceptual decision making in reaction time tasks. Neural Computation, 21, 2336-2362.