Can the apparent adaptation of dopamine neurons' mismatch sensitivities be reconciled with their computation of reward prediction errors?

Neuroscience Letters

Volumn 438, Issue 1, 2008, Pages 14-16

  Tan, Can Ozan ^a   Anderson, Eric ^a   Dranias, Mark ^a   Bullock, Daniel ^a  

^a BOSTON UNIVERSITY   (United States)

Author keywords

Basal ganglia; Computational model; Dopamine; Reinforcement learning

Indexed keywords

ADAPTATION; ARTICLE; DOPAMINERGIC NERVE CELL; ELECTROPHYSIOLOGY; MATHEMATICAL MODEL; MISMATCH NEGATIVITY; PREDICTION; PRIORITY JOURNAL; QUALITATIVE ANALYSIS;

ACTION POTENTIALS; ANIMALS; COMPUTER SIMULATION; CUES; DOPAMINE; HAPLORHINI; HUMANS; LEARNING; MODELS, STATISTICAL; NEURONS; REINFORCEMENT (PSYCHOLOGY); REWARD; SUBSTANTIA NIGRA; SYNAPTIC TRANSMISSION; VENTRAL TEGMENTAL AREA;

EID: 43549106065     PISSN: 03043940     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neulet.2008.04.059     Document Type: Article

References (15)

1. Brown J.W., Bullock D., and Grossberg S. How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. J. Neurosci. 19 (1999) 10502-10511
2. Brown J.W., Bullock D., and Grossberg S. How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades. Neur. Netw. 17 (2004) 471-510
3. Doya K. Metalearning and neuromodulation. Neur. Netw. 15 (2002) 495-506
4. Fiorillo C.D., Tobler P.N., and Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299 (2003) 1898-1902
5. Graybiel A.M. The basal ganglia: learning new tricks and loving it. Curr. Opin. Neurobiol. 15 (2005) 638-644
6. Houk J., Adams J., and Barto A. A model of how basal ganglia generate and use neural signals that predict reinforcement. In: Houk J., Davis J., and Beiser D. (Eds). Models of information processing in the basal ganglia (1995), MIT Press, Cambridge, MA 249-270
7. Nakahara H., Itoh H., Kawagoe R., Takikawa Y., and Hikosaka O. Dopamine neurons can represent context-dependent prediction error. Neuron 41 (2004) 269-280
8. Schultz W. Dopamine neurons and their role in reward mechanisms. Curr. Opin. Neurobiol. 7 (1997) 191-197
9. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80 (1998) 21-27
10. Schultz W. Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioral ecology. Curr. Opin. Neurobiol. 14 (2004) 139-147
11. Schultz W. Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol. 57 (2006) 87-115
12. Schultz W., Dayan P., and Montague P. A neural substrate of prediction and reward. Science 275 (1997) 1593-1598
13. C.O. Tan, D. Bullock, A local circuit model of learned striatal and dopamine cells responses under probabilistic schedules of reward, Technical Report CAS/CNS-TR-07-012, Boston University, 2007.
14. C.O. Tan, D. Bullock, Neuropeptide co-release with GABA may explain functional non-monotonic uncertainty responses of dopamine neurons, Neurosci. Lett., 430 (2008) 218-223.
15. Tobler P.N., Fiorillo C.D., and Schultz W. Adaptive coding of reward value by dopamine neurons. Science 307 (2005) 1642-1645