Simple neural networks that optimize decisions

International Journal of Bifurcation and Chaos in Applied Sciences and Engineering

Volumn 15, Issue 3, 2005, Pages 803-826

  Brown, Eric ^a   Gao, Juan ^b   Holmes, Philip ^a,b   Bogacz, Rafal ^a   Gilzenrat, Mark ^a   Cohen, Jonathan D ^a  

^a PRINCETON UNIVERSITY   (United States)

^b Princeton University   (United States)

Author keywords

Decision task; Gain; Locus coeruleus; Matched filter; Neural network model; Optimal speed and accuracy; Reaction time; Stochastic differential equation

Indexed keywords

COMPUTER SIMULATION; DECISION THEORY; DIFFERENTIAL EQUATIONS; FUNCTIONS; HUMAN REACTION TIME; MATHEMATICAL MODELS; NEUROLOGY; OPTIMIZATION; PSYCHOPHYSIOLOGY; STATISTICAL METHODS; STOCHASTIC PROGRAMMING;

DECISION TASKS; GAIN; LOCUS COERULEUS; MATCHED FILTERS; NEURAL NETWORK MODELS; OPTIMAL SPEED AND ACCURACY; STOCHASTIC DIFFERENTIAL EQUATIONS;

NEURAL NETWORKS;

EID: 21144433353     PISSN: 02181274     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218127405012478     Document Type: Conference Paper

References (59)

1. Abbott, L. [1991] "Firing-rate models for neural populations," in Neural Networks: From Biology to High-Energy Physics, eds. Benhar, O., Bosio, C., Del Giudice, P. & Tabat, E. (ETS Editrice, Pisa), pp. 179-196.
2. Amit, D. & Tsodyks, M. [1991] "Quantitative study of attractor neural network retrieving at low spike rates: I. Substrate-spikes, rates, and neuronal gain," Network 2, 259-273.
3. Anderson, J. [1990] The Adaptive Character of Thought (Lawrence Erlbaum, Hillsdale, NJ).
4. Arnold, L. [1974] Stochastic Differential Equations (John Wiley, NY).
5. Arnold, L. [1998] Random Dynamical Systems (Springer, Heidelberg).
6. Aston-Jones, G., Rajkowski, J., Kubiak, P. & Alexinsky, T. [1994] "Locus coeruleus neurons in the monkey are selectively activated by attended stimuli in a vigilance task," J. Neurosci. 14, 4467-4480.
7. Bialek, W., Rieke, F., de Reuter van Steveninck, R. & Warland, D. [1991] "Reading a neural code," Science 252, 1854-1857.
8. Bogacz, R., Brown, E., Moehlis, J., Hu, P., Holmes, P. & Cohen, J. D. [2004] "The physics of optimal decision making: A formal analysis of models of performance in two alternative forced choice tasks," Psych. Rev., in review.
9. Boxler, P. [1991] "How to construct stochastic center manifolds on the level of vector fields," in Lyapunov Exponents, eds. Arnold, L., Crauel, H. & Eckmann, J.-P., Lecture Notes in Mathematics, Vol. 1486 (Springer, Heidelberg), pp. 141-158.
10. Britten, K. H., Shadlen, M. N., Newsome, W. T. & Movshon, J. A. [1993] "Responses of neurons in macaque MT to stochastic motion signals," Vis. Neurosci. 10, 1157-1169.
11. Brown, E. & Holmes, P. [2001] "Modeling a simple choice task: stochastic dynamics of mutually inhibitory neural groups," Stochast. Dyn. 1, 159-191.
12. Brown, E., Gilzenrat, M. S. & Cohen, J. D. [2004a] "The locus coeruleus, adpative gain, and the optimization of simple decision tasks," Technical Report #04-02, Center for the Study of Mind, Brain, and Behavior, Princeton University.
13. Brown, E., Moehlis, J., Holmes, P., Clayton, E., Rajkowski, J. & Aston-Jones, G. [2004b] "The influence of spike rate and stimulus duration on noradrenergic neurons," J. Comput. Neurosci 17, 5-21.
14. Brunel, N., Chance, F., Fourcaud, N. & Abbott, L. F. [2001] "Effects of synaptic noise and filtering on the frequency response of spiking neurons," Phys. Rev. Lett. 86, 2186-2189.
15. Chance, F. S., Abbott, L. F. & Reyes, A. D. [2002] "Gain modulation from background synaptic input," Neuron 35, 773-782.
16. Cho, R., Nystrom, L., Brown, E., Jones, A., Braver, T., Holmes, P. & Cohen, J. D. [2002] "Mechanisms underlying performance dependencies on stimulus history in a two-alternative forced choice task," Cogn. Affect. Behav. Neurosci. 2, 283-299.
17. Clayton, E., Rajkowski, J., Cohen, J. D. & Aston-Jones, G. [2004] "Decision-related activation of monkey locus coeruleus neurons in a forced choice task," under preparation.
18. Cohen, J. D., Dunbar, K. & McClelland, J. L. [1990] "On the control of automatic processes: A parallel distributed processing model of the Stroop effect," Psychol Rev. 97, 332-361.
19. Cohen, J. D., Servan-Schreiber, D. & McClelland, J. L. [1992] "A parallel distributed processing approach to automaticity," Amer. J. Psychol. 105, 239-269.
20. Cohen, J. D. & Huston, T. A. [1994] "Progress in the use of interactive models for understanding attention and performance," in Attention and Performance XV, eds. Umilta, C. & Moscovitch, M. (MIT Press, Cambridge), pp. 453-476.
21. Ermentrout, G. B. [1994] "Reduction of conductance-based models with slow synapses to neural nets," Neur. Comput. 6, 679-695.
22. Fairhall, A., Lewen, G., Bialek, W. & de Ruyter van Steveninck, R. [2001] "Effciency and ambiguity in an adaptive neural code," Nature 412, 787-792.
23. Gardiner, C. W. [1985] Handbook of Stochastic Methods, 2nd edition (Springer, NY).
24. Gerstner, W. & Kistler, W. [2002] Spiking Neuron Models (Cambridge University Press, Cambridge, UK).
25. Gilzenrat, M. S., Holmes, B. D., Rajkowski, J., Aston-Jones, G. & Cohen, J. D. [2002] "Simplified dynamics in a model of noradrenergic modulation of cognitive performance," Neural Networks 15, 647-663.
26. Gold, J. I. & Shadlen, M. N. [2001] "Neural computations that underlie decisions about sensory stimuli," Trends Cogn. Sci. 5, 10-16.
27. Gold, J. I. & Shadlen, M. N. [2002] "Banburismus and the brain: Decoding the relationship between sensory stimuli, decisions, and reward," Neuron 36, 299-308.
28. Grossberg, S. [1988] "Nonlinear neural networks: Principles, mechanisms, and architectures," Neural Networks 1, 17-61.
29. Guckenheimer, J. & Holmes, P. J. [1983] Nonlinear Osculations, Dynamical Systems and Bifurcations of Vector Fields (Springer-Verlag, NY).
30. Hertz, J., Krough, A. & Palmer, R. [1991] Introduction to the Theory of Neural Computation (Perseus Book Group, NY).
31. Hopfield, J. J. [1984] "Neurons with graded response have collective computational properties like those of two-state neurons," Proc. Natl. Acad. Sci. USA 82, 3088-3092.
32. Huk, A., Palmer, J. & Shadlen, M. [2002] "Temporal integration of motion energy underlies perceptual decisions and response times," Annual Society for Neuroscience Meeting, Orlando, FL, Nov 2-7, 2002, Abstract No. 353.5.
33. Knobloch, E. & Weisenfeld, K. A. [1983] "Bifurcations in fluctuating systems: The center manifold approach," J. Stat. Phys. 33, 611-637.
34. Laming, D. R. J. [1968] Information Theory of Choice-Reaction Times (Academic Press, NY).
35. Lehmann, E. L. [1959] Testing Statistical Hypotheses (John Wiley, NY).
36. McClelland, J. L. [1979] "On the time relations of mental processes: An examination of systems of processes in cascade," Psychol Rev. 86, 287-330.
37. Mozer, M. [1998] "A connectionist model of selective attention in visual perception," in Proc. Tenth Ann. Conf. Cognitive Science Society (Erlbaum, Hillsdale, NJ), pp. 195-201.
38. Omurtag, A., Kaplan, E., Knight, B. W. & Sirovich, L. [2000] "A population approach to cortical dynamics with an application to orientation tuning," Network 11, 247-260.
39. Papoulis, A. [1977] Signal Analysis (McGraw-Hill, NY).
40. Platt, M. L. & Glimcher, P. W. [2001] "Neural correlates of decision variable in parietal cortex," Nature 400, 233-238.
41. Ratcliff, R. [1978] "A theory of memory retrieval," Psych. Rev. 85, 59-108.
42. Ratcliff, R., Van Zandt, T. & McKoon, G. [1999] "Connectionist and diffusion models of reaction time," Psych. Rev. 106, 261-300.
43. Roitman, J. & Shadlen, M. [2002] "Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task," J. Neurosci. 22, 9475-9489.
44. Schall, J. D. [2001] "Neural basis of deciding, choosing, and acting," Nature Rev.: Neurosci. 2, 33-42.
45. Schall, J., Stuphorn, V. & Brown, J. [2002] "Monitoring and control of action by the frontal lobes," Neuron 36, 309-322.
46. Servan-Schreiber, D., Printz, H. & Cohen, J. D. [1990] "A network model of catecholamine effects: Gain, signal-to-noise ratio, and behavior," Science 249, 892-895.
47. Shadlen, M. N. & Newsome, W. T. [2001] "Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey," J. Neurophysiol. 86, 1916-1936.
48. Shelley, M. & McLaughlin, D. [2002] "Coarse-grained reduction and analysis of a network model of cortical response. I. drifting grating stimuli," J. Comput. Neurosci. 12, 97-122.
49. Shin, J., Koch, C. & Douglas, R. [1999] "Adaptive neural coding dependent on the time varying statistics of the somatic input current," Neural Comput. 11, 1083-1913.
50. Smith, P. L. & Ratcliff, R. [2004] "Psychology and neurobiology of simple decisions," Trends in Neurosci. 27, 161-168.
51. Stone, M. [1960] "Models for choice-reaction time," Psychometrika 25, 251-260.
52. Usher, M., Cohen, J. D., Servan-Schreiber, D., Rajkowsky, J. & Aston-Jones, G. [1999] "The role of locus coeruleus in the regulation of cognitive performance," Science 283, 549-554.
53. Usher, M. & McClelland, J. L. [2001] "On the time course of perceptual choice: The leaky competing accumulator model," Psych. Rev. 108, 550-592.
54. von Neumann, J. [1958] The Computer and the Brain (Yale University Press, New Haven, CT); 2nd edition [2000], with a foreword by Paul and Patricia Churchland.
55. Wald, A. [1947] Sequential Analysis (John Wiley, NY).
56. Wang, X.-J. [2002] "Probabilistic decision making by slow reverberation in cortical circuits," Neuron 36, 955-968.
57. Waterhouse, B., Moises, H. & Woodward, D. [1998] "Phasic activation of the locus coeruleus enhances responses of primary sensory cortical neurons to peripheral receptive field stimulation," Brain Res. 790, 33-44.
58. Wickelgren, W. A. [1977] "Speed-accuracy tradeoff and information processing dynamics," Acta Psychol. 41, 67-85.
59. Wilson, H. & Cowan, J. [1972] "Excitatory and inhibitory interactions in localized populations of model neurons," Biophys. J. 12, 1-24.