Optimal decisions: From neural spikes, through stochastic differential equations, to behavior

IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

Volumn E88-A, Issue 10, 2005, Pages 2496-2502

  Holmes, Philip ^a,b   Shea Brown, Eric ^a,f,j   Moehlis, Jeff ^c   Bogacz, Rafal ^d,g   Gao, Juan ^a,b   Aston Jones, Gary ^e   Clayton, Ed ^e,h   Rajkowski, Janusz ^e   Cohen, Jonathan D ^a,i,j  

^a PRINCETON UNIVERSITY   (United States)

^b Princeton University   (United States)

^c University of California   (United States)

^d UNIVERSITY OF BRISTOL   (United Kingdom)

^e UNIVERSITY OF PENNSYLVANIA   (United States)

^f NEW YORK UNIVERSITY   (United States)

^g Department of Computer Science ^*

^h NATIONAL INSTITUTES OF HEALTH   (United States)

ⁱ Mind and Behavior   (United States)

^j Program in Neuroscience

more..

Author keywords

Decision making models; Drift diffusion process; Dynamical systems; Phase oscillators; Stochastic differential equations

Indexed keywords

CELLS; DECISION MAKING; DECISION THEORY; DIFFERENTIAL EQUATIONS; EYE MOVEMENTS; RANDOM PROCESSES; STATISTICAL METHODS;

DECISION-MAKING MODELS; DRIFT-DIFFUSION PROCESS; DYNAMICAL SYSTEMS; PHASE OSCILLATORS; STOCHASTIC DIFFERENTIAL EQUATIONS;

NEUROLOGY;

EID: 27844431735     PISSN: 09168508     EISSN: 17451337     Source Type: Journal    
DOI: 10.1093/ietfec/e88-a.10.2496     Document Type: Conference Paper

References (44)

1. D.R.J. Laming, Information Theory of Choice-Reaction Times, Academic Press, New York, 1968.
2. A. Wald, Sequential Analysis, Wiley, New York, 1947.
3. E.L. Lehmann, Testing Statistical Hypotheses, Wiley, New York, 1959.
4. R. Ratcliff, "A theory of memory retrieval," Psych. Rev., vol.85, pp.59-108, 1978.
5. R. Ratcliff, T. Van Zandt, and G. McKoon, "Connectionist and diffusion models of reaction time," Psych. Rev., vol.106, no.2, pp.261-300, 1999.
6. J.D. Schall, "Neural basis of deciding, choosing and acting," Nature Neurosci., vol.2, pp.33-42, 2001.
7. J.D. Roitman and M.N. Shadlen, "Response of neurons in the lateral interparietal area during a combined visual discrimination reaction time task," J. Neurosci., vol.22, no.1, pp.9475-9489, 2002.
8. R. Ratcliff, A. Cherian, and M.A. Segraves, "A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two choice decisions," J. Neurophysiol., vol.90, pp.1392-1407, 2003.
9. C.W. Gardiner, Handbook of Stochastic Methods, Second Edition, Springer Verlag, New York, 1985.
10. J.I. Gold and M.N. Shadlen, "Banburismus and the brain: Decoding the relationship between sensory stimuli, decisions, and reward," Neuron, vol.36, pp.299-308, 2002.
11. R. Bogacz, E. Brown, J. Moehlis, P. Hu, P. Holmes, and J.D. Cohen, "The physics of optimal decision making: A formal analysis of performance in two-alternative forced choice tasks," Submitted, 2005.
12. J. Myung and J.R. Busemeyer, "Criterion learning in a deferred decision-making task," American J. Psychology, vol.102, no.1, pp.1-16, 1989.
13. W.T. Maddox and C.J. Bohil, "Base-rate and payoff effects in multidimensional perceptual categorization," J. Experimental Psychology, vol.24, no.6, pp.1459-1482, 1998.
14. C.J. Bohil and W.T. Maddox, "On the generality of optimal versus objective classifier feedback effects on decision criterion learning in perceptual categorization," Memory & Cognition, vol.31, no.2, pp.181-198, 2003.
15. D.E. Rumelhart and J.L. McClelland, eds., Parallel distributed processing: Explorations in the microstructure of cognition, MIT Press, Cambridge, MA, 1986.
16. S. Grossberg, "Nonlinear neural networks: Principles, mechanisms, and architectures," Neural Netw., vol.1, pp.17-61, 1988.
17. M. Usher and J.L. McClelland, "On the time course of perceptual choice: The leaky competing accumulator model," Psych. Rev., vol.108, pp.550-592, 2001.
18. E. Brown, J. Gao, P. Holmes, R. Bogacz, M. Gilzenrat, and J.D. Cohen, "Simple neural networks that optimize decisions," Int. J. Bifurcation and Chaos, vol.15, pp.803-826, 2005.
19. L.F. Abbott, "Single Neuron Dynamics," in Neural Modeling and Neural Networks, ed. F. Ventriglia, pp.57-78, Pergamon Press, Oxford, UK, 1994.
20. J. Keener and J. Sneyd, Mathematical Physiology, Springer-Verlag, New York, 1998.
21. H. Wilson and J.D. Cowan, "Excitatory and inhibitory interactions in localized populations of model neurons," Biophys. J., vol.12, pp.1-24, 1972.
22. G.B. Ermentrout, "Reduction of conductance-based models with slow synapses to neural nets," Neural Comp., vol.6, pp.679-695, 1994.
23. A. Herrmann and W. Gerstner, "Noise and the PSTH response to current transients: I. General Theory and application to the Integrate-and-Fire Neuron," J. Comp. Neurosci., vol.11, pp.135-151, 2001.
24. A. Renart, N. Brunel, and X.-J. Wang, "Mean-field theory of irregu larly spiking neuronal populations and working memory in recurrent cortical networds," in Computational Neuroscience: A Comprehensive Approach, ed. J. Feng, CRC Press, Boca Raton, EL, 2004.
25. G. Aston-Jones and J.D. Cohen, "An integrative theory of locus coeruleus norepinephrine function: Adaptive gain and optimal performance," Ann. Rev. Neurosci, vol.28, pp.403-450, 2005.
26. G. Aston-Jones, J. Rajkowski, P. Kubiak, and T. Alexinsky, "Locus coeruleus neurons in the monkey are selectively activated by attended stimuli in a vigilance task," J. Neurosci., vol.14, pp.4467-4480, 1994.
27. M. Usher, J.D. Cohen, D. Servan-Schreiber, J. Rajkowski, and G. Aston-Jones, "The role of locus coeruleus in the regulation of cognitive performance," Science, vol.283, pp.549-554, 1999.
28. J. Connor, D. Walter, and R. McKown, "Neural repetitive firing: Modifications of the Hodgkin-Huxley axon suggested by experimental results from crustacean axons," Biophys. J., vol.18, pp.81-102, 1977.
29. R. Rose and J. Hindmarsh, "The assembly of ionic currents in a thalamic neuron I. The three-dimensional model," Proc. R. Soc. Lond. B, vol.237, pp.267-288, 1989.
30. E. Brown, J. Moehlis, P. Holmes, E. Clayton, J. Rajkowski, and G. Aston-Jones, "The influence of spike rate and stimulus duration on brainstem noradrenergic neurons," J. Comp. Neurosci., vol.17, no.1, pp.13-29, 2004.
31. A. Hodgkin and A. Huxley, "A quantitative description of membrane current and its application to conduction and excitation in nerve," J. Physiol., vol.117, pp.500-544, 1952.
32. C.K.R.T. Jones, "Geometric singular perturbation theory," C.I.M.E. Lectures, Lecture Notes in Mathematics, vol.1609, Springer Verlag, Heidelberg, 1994.
33. G.B. Ermentrout, "Type I membranes, phase resetting curves, and synchrony," Neural Comp., vol.8, pp.979-1001, 1996.
34. F.C. Hoppensteadt and E.M. Izhikevich, Weakly Connected Neural Networks, Springer-Verlag, New York, 1997.
35. R.M. Ghigliazza and P. Holmes, "Minimal models of bursting neurons: The effects of multiple currents and timescales," SIAM J. Appl. Dyn. Syst., vol.3, no.4, pp.636-670, 2004.
36. R.M. Ghigliazza and P. Holmes, "A minimal model of a central pattern generator and motoneurons for insect locomotion," SIAM J. Appl. Dyn. Syst., vol.3, no.4, pp.671-700, 2004.
37. J. Guckenheimer and P. Holmes, Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields, Springer-Verlag, New York, 1983.
38. G.B. Ermentrout and N. Kopell, "Frequency plateaus in a chain of weakly coupled oscillators, I," SIAM J. Math. Anal., vol.15, pp.215-237, 1984.
39. E. Brown, J. Moehlis, and P. Holmes, "On the phase reduction and response dynamics of neural oscillator populations," Neural Comput., vol.16, no.4, pp.673-715, 2004.
40. E. Clayton, J. Rajkowski, J.D. Cohen, and G. Aston-Jones, "Phasic activation of monkey locus coeruleus neurons by simple decisions in a forced choice task," J. Neurosci., vol.24, pp.9914-9920, 2004.
41. C.W Berridge and B.D. Waterhouse, "The locus coeruleusnoradrenergic system: Modulation of behavioral state and state-dependent cognitive processes," Brain Res. Rev., vol.42, pp.892-895, 1990.
42. D. Servan-Schreiber, H. Printz, and J.D. Cohen, "A network model of catecholamine effects: Gain, signal-to-noise ratio, and behavior," Science, vol.249, pp.892-895, 1990.
43. L. Arnold, Random Dynamical Systems, Springer Verlag, Heidelberg, 1998.
44. A. Papoulis, Signal Analysis, McGraw-Hill, New York, 1977.