Modeling functions of striatal dopamine modulation in learning and planning

Neuroscience

Volumn 103, Issue 1, 2001, Pages 65-85

  Suri, R E ^a,c   Bargas, J ^b   Arbib, M A ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b UNIVERSIDAD NACIONAL AUTÓNOMA DE MÉXICO   (Mexico)

^c SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

Author keywords

Internal model; Novelty; Reinforcement learning; Striatum; Temporal difference learning

Indexed keywords

DOPAMINE 1 RECEPTOR; DOPAMINE RECEPTOR;

ARTICLE; CELL MEMBRANE DEPOLARIZATION; DOPAMINERGIC ACTIVITY; DOPAMINERGIC NERVE CELL; HYPERPOLARIZATION; LEARNING; NERVE CELL MEMBRANE POTENTIAL; PLANNING; PRIORITY JOURNAL; REACTION TIME; REINFORCEMENT; SENSORIMOTOR FUNCTION; SYNAPTIC TRANSMISSION; TASK PERFORMANCE;

ANIMALS; CEREBRAL CORTEX; CONDITIONING (PSYCHOLOGY); CORPUS STRIATUM; DOPAMINE; DOPAMINE AGONISTS; EXPLORATORY BEHAVIOR; GOALS; LEARNING; MEMBRANE POTENTIALS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); RATS; RECEPTORS, DOPAMINE D1; REINFORCEMENT (PSYCHOLOGY); REWARD; SYNAPTIC TRANSMISSION; THALAMUS;

EID: 0035961179     PISSN: 03064522     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0306-4522(00)00554-6     Document Type: Article

References (83)

1. The functional anatomy of basal ganglia disorders
2. Parallel organization of functionally segregated circuits linking basal ganglia and cortex
3. Functional architecture of basal ganglia circuits: Neural substrates of parallel processing
4. Neuronal activity in monkey striatum related to the expectation of predictable environmental events
5. Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates
6. How the basal ganglia make decisions
7. How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues
8. Long-term synaptic depression in the striatum: Physiological and pharmacological characterization
9. 1 receptor involvement
10. Long-term potentiation in the striatum is unmasked by removing the voltage-dependent magnesium block of NMDA receptor channels
11. Post-receptor mechanisms underlying striatal long-term depression
12. 2 receptors
13. Unilateral dopamine denervation blocks corticostriatal LTP
14. + conductance in medium-sized neostriatal neurons: Characterization using infrared videomicroscopy and whole cell patch-clamp recordings
15. Dopamine and N-methyl-D-aspartate receptor interactions in the neostriatum
16. Decreased probability of neurotransmitter release underlies striatal long-term depression and postnatal development of corticostriatal synapses
17. Exploration bonuses and dual control
18. The neurophysiological basis of motor imagery
19. Motivational control of goal-directed action
20. The updating of the representation of visual space in parietal cortex by intended eye movements
21. A neurocomputational theory of the dopaminergic modulation of working memory functions
22. Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex
23. Computational models of neuromodulation
24. Model predictive control: Theory and practice - A survey
25. Primate frontal eye fields. III. Maintenance of a spatially accurate saccade signal
26. 1 receptors in the rat striatum in vivo
27. Neurotransmitters and neuromodulators in the basal ganglia
28. A stochastic reinforcement algorithm for learning real valued functions
29. Dopamine modulates the afterhyperpolarization in neostriatal neurones
30. 2+ conductance
31. A model of how the basal ganglia generate and use neural signals that predict reinforcement
32. Slow rhythmic activity of caudate neurons in the cat: Statistical analysis of caudate neuronal spike trains
33. L-dopa withdrawal in Parkinson's disease selectively impairs cognitive performance in tests sensitive to frontal lobe dysfunction
34. Section 2: Edward C. Tolman
35. A framework for mesencephalic dopamine systems based on predictive Hebbian learning
36. Updating of the visual representation in monkey striate and extrastriate cortex during saccades
37. Contribution of a slowly inactivating potassium current to the transition to firing of neostriatal spiny projection neurons
38. +-sensitive conductance in neostriatal neurons
39. The ascending neuromodulatory systems in learning by reinforcement: Comparing computational conjectures with experimental findings
40. Charybdotoxin and apamin sensitivity of the calcium-dependent repolarization and the afterhyperpolarization in neostriatal neurons
41. Is the short-latency dopamine response too short to signal reward error?
42. Neural systems underlying arousal and attention. Implications for drug abuse
43. Responses of striatal neurons in the behaving monkey. 3. Effects of iontophoretically applied dopamine on normal responsiveness
44. An afterhyperpolarization recorded in striatal cells in vitro: Effect of dopamine administration
45. Complex motor and sensorimotor functions of striatal and accumbens dopamine: Involvement in instrumental behavior processes
46. Behavioral functions of nucleus accumbens dopamine: Empirical and conceptual problems with the anhedonia hypothesis
47. Predictive reward signal of dopamine neurons
48. Context-dependent activity in primate striatum reflecting past and future behavioral events
49. A neural substrate of prediction and reward
50. Dopamine and the mechanisms of cognition: Part I. A neural network model predicting dopamine effects on selective attention
51. The neural network of the basal ganglia as revealed by the study of synaptic connections of identified neurons
52. Spontaneous subthreshold membrane potential fluctuations and action potential variability of rat corticostriatal and striatal neurons in vivo
53. Modeling sensorimotor learning in striatal projection neurons
54. Learning of sequential movements by neural network model with dopamine-like reinforcement signal
55. A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task
56. 1 dopaminergic protein kinase/phosphatase cascade in rat neostriatal neurons
57. Dopamine receptor subtypes colocalize in rat striatonigral neurons
58. An adaptive network that constructs and uses an internal model of its world
59. Time derivative models of Pavlovian reinforcement
60. The learning of world models by connectionist networks
61. The neuropsychology of Parkinson's disease
62. A critical review of latent learning and related experiments
63. The role of exploration in learning control
64. Spatial processing in the monkey frontal eye field. I. Predictive visual responses
65. Neurons in the monkey superior colliculus predict the visual result of impending saccadic eye movements
66. Parkinson's disease patients' behaviour in a covered maze learning task
67. Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro
68. Regulation of action-potential firing in spiny neurons of the rat neostriatum in vivo
69. Concentration-dependent actions of stimulated dopamine release on neuronal activity in rat striatum
70. The generation of natural firing patterns in neostriatal neurons
71. Spontaneous firing patterns of identified spiny neurons in the rat neostriatum
72. The origins of two-state spontaneous membrane potential fluctuations of neostriatal spiny neurons
73. An internal model for sensorimotor integration
74. Increased extracellular dopamine in the nucleus accumbens of the rat during associative learning of neutral stimuli