Evidence that the delay-period activity of dopamine neurons corresponds to reward uncertainty rather than backpropagating TD errors

Behavioral and Brain Functions

Volumn 1, Issue , 2005, Pages

  Fiorillo, Christopher D ^a   Tobler, Philippe N ^b   Schultz, Wolfram ^b  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYTICAL ERROR; BRAIN DEPTH STIMULATION; BRAIN FUNCTION; BRAIN REGION; CELL ACTIVATION; DOPAMINERGIC NERVE CELL; HUMAN; LEARNING; NEUROBIOLOGY; NOTE; PREDICTION; PRIORITY JOURNAL; SIGNAL DETECTION; SPIKE WAVE;

EID: 33646467129     PISSN: 17449081     EISSN: None     Source Type: Journal    
DOI: 10.1186/1744-9081-1-7     Document Type: Note

References (13)

1. Montague PR, Dayan P, Seinowski TJ: A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 1996, 16:1936-1947.
2. Schultz W, Dayan P, Montague PR: A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
3. Fiorillo CD, Tobler PN, Schultz W: Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
4. Niv Y, Duff MO, Dayan P: Dopamine, uncertainty and TD learning. Behav Brain Func 2005, 1:6.
5. Chergui K, Suaud-Chagny MF, Gonon F: Nonlinear relationship between impulse flow, dopamine release and dopamine elimination in the rat brain in vivo. Neuroscience 1994, 62:641-645.
6. Takikawa Y, Kawagoe R, Hikosaka O: Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons. J Neurophysiol 2002, 87:508-515.
7. Janssen P, Shadlen MN: A representation of the hazard rate of elapsed time in macaque area LIP. Nat Neurosci 2005, 8:234-241.
8. Tobler PN, Fiorillo CD, Schultz W: Adaptive coding of reward value by dopamine neurons. Science 2005, 307:1642-1645.
9. Sutton RS, Barto AG: Toward a modern theory of adaptive networks: expectation and prediction. Psychol Rev 1981, 88:135-170.
10. Suri RE, Schultz W: A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience 1999, 91:871-890.
11. Hollerman JR, Schultz W: Dopamine neurons report an error in the temporal prediction of reward during learning. Nature Neurosci 1998, 1:304-309.
12. Brown J, Bullock D, Grossberg S: How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. J Neurosci 1999, 19:10502-10511.
13. Kakade S, Dayan P: Dopamine: generalization and bonuses. Neural Networks 2002, 15:549-559.