Dimension reduction and dynamics of a spiking neural network model for decision making under neuromodulation

SIAM Journal on Applied Dynamical Systems

Volumn 10, Issue 1, 2011, Pages 148-188

  Eckhoff, Philip ^a   Wong Lin, Kong Fatt ^a   Holmes, Philip ^b  

^a PRINCETON UNIVERSITY   (United States)

^b Princeton University   (United States)

Author keywords

Attractor neural networks; Averaging; Bifurcation; Decision making; Dimension reduction; Integrateand fire neuronal model; Mean field theory; Neuromodulation; Optimal reward rate; Stochastic ODEs

Indexed keywords

ATTRACTOR NEURAL NETWORKS; AVERAGING; BIFURCATION; DIMENSION REDUCTION; INTEGRATE AND FIRES; MEAN FIELD; NEUROMODULATION; OPTIMAL REWARD; STOCHASTIC ODES;

BIFURCATION (MATHEMATICS); COMPUTER SIMULATION; DECISION MAKING; DECISION THEORY; MEAN FIELD THEORY; NETWORKS (CIRCUITS); OPTIMIZATION; ORDINARY DIFFERENTIAL EQUATIONS; PHYSIOLOGICAL MODELS; STATISTICAL MECHANICS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS;

NEURAL NETWORKS;

EID: 79955649192     PISSN: None     EISSN: 15360040     Source Type: Journal    
DOI: 10.1137/090770096     Document Type: Article

References (49)

1. L. F. Abbott and E. S. Chance, Drivers and modulators from push-pull and balanced synaptic input, Prog. Brain Res., 149 (2005), pp. 147-155.
2. D. J. Amit and N. Brunel, Dynamics of a recurrent network of spiking neurons before and following learning, Netw. Comput. Neural Syst., 8 (1997), pp. 373-404. (Pubitemid 127717691)
3. D. J. Amit and N. Brunel, Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex, Cereb. Cortex, 7 (1997), pp. 237-274.
4. D. J. Amit and M. V. Tsodyks, Quantitative study of attractor neural network retrieving at low spike rates I: Substrate-spikes, rates and neuronal gain, Network, 2 (1991), pp. 259-274.
5. G. Aston-Jones and J. D. Cohen, An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance, Annu. Rev. Neurosci., 28 (2005), pp. 403-450. (Pubitemid 41098911)
6. C. W. Berridge and E. D. Abercrombie, Relationship between locus coeruleus discharge rates and rates of norepinephrine release within neocortex as assessed by in vivo microdialysis, Neuroscience, 93 (1999), pp. 1263-1270. (Pubitemid 29397554)
7. C. W. Berridge and B. D. Waterhouse, The locus coeruleus-noradrenergic system: Modulation of behavioral state and state-dependent cognitive processes, Brain Res. Rev., 42 (2003), pp. 33-84. (Pubitemid 36369264)
8. R. Bogacz, E. Brown, J. Moehlis, P. Holmes, and J. D. Cohen, The physics of optimal decision making: A formal analysis of models of performance in two alternative forced choice tasks, Psychological Review, 113 (2006), pp. 700-765. (Pubitemid 44629916)
9. S. Bouret and S. J. Sara, Network reset: A simplified overarching theory of locus coeruleus noradrenaline function, Trends Neurosci., 28 (2005), pp. 574-582. (Pubitemid 41476687)
10. K. H. Britten, M. N. Shadlen, W. T. Newsome, and J. A. Movshon, The analysis of visual motion: A comparison of neuronal and psychophysical performance, J. Neurosci., 12 (1992), pp. 4745-4765.
11. K. H. Britten, M. N. Shadlen, W. T. Newsome, and J. A. Movshon, Response of neurons in macaque MT to stochastic motion signals, Vis. Neurosci., 10 (1993), pp. 1157-1169. (Pubitemid 2001372)
12. N. Brunel, F. S. Chance, N. Fourcaud, and L. F. Abbott, Effects of synaptic noise and filtering on the frequency response of spiking neurons, Phys. Rev. Lett., 86 (2001), pp. 2186-2189. (Pubitemid 32254792)
13. N. Brunel and X.-J. Wang, Effects of neurmodulation in a cortical network model of object working memory dominated by recurrent inhibition, J. Comput. Neurosci., 11 (2001), pp. 63-85. (Pubitemid 32926844)
14. P. Dayan and L. F. Abbott, Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems, MIT Press, Cambridge, MA, 2001.
15. G. Deco and E. T. Rolls, Decision-making and Weber's law: A neurophysiological model, Eur. J. Neurosci., 24 (2006), pp. 901-906.
16. D. M. Devilbiss and B. D. Waterhouse, The effects of tonic locus ceruleus output on sensory-evoked responses of ventral posterior medial thalamic and barrel field cortical neurons in the awake rat, J. Neurosci., 24 (2004), pp. 10773-10785. (Pubitemid 39602389)
17. K. Doya, Modulators of decision making, Nat. Neurosci., 11 (2008), pp. 410-416. (Pubitemid 351441891)
18. P. Eckhoff, P. Holmes, C. Law, P. M. Connolly, and J. I. Gold, On diffusion processes with variable drift rates as models for decision making during learning, New J. Phys., 10 (2008), 015006.
19. P. Eckhoff, K.-F. Wong, and P. Holmes, Optimality and robustness of a biophysical decision-making model under norepinephrine modulation, J. Neurosci., 29 (2009), pp. 4301-4311.
20. B. Ermentrout, Simulating, Analyzing, and Animating Dynamical Systems: A Guide to XPPAUT for Researchers and Students, Software Environ. Tools 14, SIAM, Philadelphia, 2002.
21. B. Ermentrout, Phase-plane analysis of neural nets, in The Handbook of Brain Theory and Neural Networks, M. A. Arbib, ed., MIT Press, Cambridge, MA, 2003, pp. 881-885.
22. W. Feller, An Introduction to Probability Theory and Its Applications, 2nd ed., Wiley, New York, 1957.
23. C. W. Gardiner, Handbook of Stochastic Methods, 2nd ed., Springer, New York, 1985.
24. M. G. Gilzenrat, B. D. Holmes, J. Rajkowski, G. Aston-Jones, and J. D. Cohen, Simplified dynamics in a model of noradrenergic modulation of cognitive performance, Neural Networks, 15 (2002), pp. 647-663. (Pubitemid 34947466)
25. J. I. Gold and M. N. Shadlen, Neural computations that underlie decisions about sensory stimuli, Trends in Cognitive Science, 5 (2001), pp. 10-16. (Pubitemid 32063334)
26. J. I. Gold and M. N. Shadlen, Banburismus and the brain: Decoding the relationship between sensory stimuli, decisions, and reward, Neuron, 36 (2002), pp. 299-308. (Pubitemid 35217893)
27. J. Guckenheimer and P. J. Holmes, Nonlinear Oscillations, Dynamical Systems and Bifurcations of Vector Fields, Springer-Verlag, New York, 1983.
28. G. D. Horwitz and W. T. Newsome, Separate signals for target selection and movement specification in the superior colliculus, Science, 284 (1999), pp. 1158-1161. (Pubitemid 29288403)
29. G. D. Horwitz and W. T. Newsome, Target selection for saccadic eye movements: Prelude activity in the superior colliculus during a direction-discrimination task, J. Neurophysiol., 86 (2001), pp. 2543-2558. (Pubitemid 34000613)
30. C. K. R. T. Jones, Geometric singular perturbation theory, in Dynamical Systems (Montecatini Terme, 1994), Lecture Notes in Math. 1609, Springer, Berlin, 1995, pp. 44-118.
31. J. N. Kim and M. N. Shadlen, Neural correlates of a decision in the dorsolateral prefrontal cortex, Nat. Neurosci., 2 (1999), pp. 176-185. (Pubitemid 30491319)
32. D. Marti, G. Deco, M. Mattia, G. Gigante, and P. Del Giudice, A fluctuation-driven mechanism for slow decision processes in reverberant networks, PLoS ONE, 3 (2008), e2534.
33. J. Palmer, A. C. Huk, and M. N. Shadlen, The effect of stimulus strength on the speed and accuracy of a perceptual decision, J. Vis., 5 (2005), pp. 376-404. (Pubitemid 41519235)
34. J. Rajkowski, H. Majczynski, E. Clayton, and G. Aston-Jones, Activation of monkey locus coeruleus neurons varies with difficulty and performance in a target detection task, J. Neurophysiol., 92 (2004), pp. 361-371. (Pubitemid 38802258)
35. A. Renart, N. Brunel, and X.-J. Wang, Mean-field theory of irregularly spiking neuronal populations and working memory in recurrent cortical networks, in Computational Neuroscience: A Comprehensive Approach, J. Feng, ed., Chapman and Hall/CRC, Boca Raton, FL, 2004, pp. 431-490.
36. L. M. Ricciardi, Diffusion Processes and Related Topics in Biology, Springer, Berlin, 1977.
37. J. Roitman and M. Shadlen, Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task, J. Neurosci., 22 (2002), pp. 9475-9489. (Pubitemid 35356190)
38. S. J. Sara, The locus coeruleus and noradrenergic modulation of cognition, Nat. Rev. Neuro., 10 (2009), pp. 211-223.
39. D. Servan-Schreiber, H. Printz, and J. D. Cohen, A network model of catecholamine effects: Gain, signal-to-noise ratio, and behavior, Science, 249 (1990), pp. 892-895.
40. M. N. Shadlen and W. T. Newsome, Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey, J. Neurophysiol., 86 (2001), pp. 1916-1936. (Pubitemid 32953239)
41. E. Shea-Brown, J. Gao, P. Holmes, R. Bogacz,M. S. Gilzenrat, and J. D. Cohen, Simple neural networks that optimize decisions, Internat. J. Bifur. Chaos Appl. Sci. Engrg., 15 (2005), pp. 803-826. (Pubitemid 40878385)
42. E. Shea-Brown, M. Gilzenrat, and J. D. Cohen, Optimization of decision making in multilayer networks: The role of locus coeruleus, Neural Comput., 20 (2008), pp. 2863-2894.
43. E. Shea-Brown, J. Moehlis, P. Holmes, E. Clayton, J. Rajkowski, and G. Aston-Jones, The influence of spike rate and stimulus duration on noradrenergic neurons, J. Comput. Neurosci., 17 (2004), pp. 13-29.
44. P. Simen, J. D. Cohen, and P. Holmes, Rapid decision threshold modulation by reward rate in a neural network, Neural Networks, 19 (2006), pp. 1013-1026. (Pubitemid 44466344)
45. M. Usher, J. D. Cohen, D. Servan-Schreiber, J. Rajkowski, and G. Aston-Jones, The role of locus coeruleus in the regulation of cognitive performance, Science, 283 (1999), pp. 549-554.
46. M. Usher and J. L. McClelland, On the time course of perceptual choice: The leaky competing accumulator model, Psych. Rev., 108 (2001), pp. 550-592. (Pubitemid 33604137)
47. X.-J. Wang, Probabilistic decision making by slow reverberation in cortical circuits, Neuron, 36 (2002), pp. 955-968. (Pubitemid 35447866)
48. B. D. Waterhouse, D. Devilbiss, D. Fleischer, F. M. Sessler, and K. L. Simpson, New perspectives on the functional organization and postsynaptic influences of the locus ceruleus efferent projection system, Adv. Pharmacol., 42 (1998), pp. 749-754.
49. K. F.Wong and X.-J.Wang, A recurrent network mechanism of time integration in perceptual decisions, J. Neurosci., 26 (2006), pp. 1314-1328. (Pubitemid 43237063)