Anticipatory responses of dopamine neurons and cortical neurons reproduced by internal model

Experimental Brain Research

Volumn 140, Issue 2, 2001, Pages 234-240

  Suri, Roland E ^a,b  

^a Institut de Physiologie University of Fribourg   (Switzerland)

^b SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

Author keywords

Associative chains; Prediction; Sensory preconditioning; TD model

Indexed keywords

DOPAMINE;

ANIMAL BEHAVIOR; ANTICIPATION; ARTICLE; BRAIN CELL; CELL ACTIVITY; CORPUS STRIATUM; DOPAMINERGIC NERVE CELL; ERROR; INSTRUMENTAL CONDITIONING; LEARNING; MODEL; NERVE CELL NETWORK; PREDICTION; PRIORITY JOURNAL; REWARD; SIMULATION; STATE DEPENDENT LEARNING;

ALGORITHMS; ANIMALS; ASSOCIATION LEARNING; CEREBRAL CORTEX; CONDITIONING (PSYCHOLOGY); DOPAMINE; MODELS, NEUROLOGICAL; NEURONS; REWARD; SENSATION;

EID: 0035726809     PISSN: 00144819     EISSN: None     Source Type: Journal    
DOI: 10.1007/s002210100814     Document Type: Article

References (39)

1. Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates
2. Adaptive critics and the basal ganglia
3. Conservation of hippocampal memory function in rats and humans
4. Temporal information transformed into a spatial code by a neural network with realistic properties
5. Improving generalization for temporal difference learning: The successor representation
6. Why the law of effect will not go away
7. Model predictive control: Theory and practice - A survey
8. Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward
9. Dopamine neurons report an error in the temporal prediction of reward during learning
10. A model of how the basal ganglia generate and use neural signals that predict reinforcement
11. Responses of monkey dopamine neurons during learning of behavioral reactions
12. A connectionist model may shed light on neural mechanisms for visually-guided reaching
13. Importance of unpredictability for reward responses in primate dopamine neurons
14. A framework for mesencephalic dopamine systems based on predictive hebbian learning
15. Dynamic model of visual recognition predicts neural response properties in the visual cortex
16. Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects
17. Computational consequences of temporally asymmetric learning rules: I. Differential hebbian learning
18. Predictive reward signal of dopamine neurons
19. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task
20. A neural substrate of prediction and reward
21. Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences
22. Dopamine-like reinforcement signal improves learning of sequential movements by neural network
23. A neural network learns a spatial delayed response task with a dopamine-like reinforcement signal
24. Temporal difference model reproduces anticipatory neural activity
25. Modeling functions of striatal dopamine modulation in learning and planning
26. An adaptive network that constructs and uses an internal model of its world
27. Time derivative models of Pavlovian reinforcement
28. The learning of world models by connectionist networks
29. The hippocampus as an associator of discontiguous events
30. Cellular models of reinforcement
31. An internal model for sensorimotor integration
32. Increased extracellular dopamine in the nucleus accumbens of the rat during associative learning of neutral stimuli