How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues

Journal of Neuroscience

Volumn 19, Issue 23, 1999, Pages 10502-10511

  Brown, Joshua ^a   Bullock, Daniel ^a   Grossberg, Stephen ^a  

^a BOSTON UNIVERSITY   (United States)

Author keywords

Adaptive timing; Basal ganglia; Conditioning; Dopamine; Lateral hypothalamus; Pedunculopontine tegmental nucleus; Reward; Striosomes; Substantia nigra

Indexed keywords

CALCIUM; METABOTROPIC RECEPTOR;

ARTICLE; ASSOCIATION; BASAL GANGLION; CONDITIONING; HYPOTHALAMUS NUCLEUS; LEARNING; LIMBIC CORTEX; MEMBRANE POTENTIAL; PRIORITY JOURNAL; REINFORCEMENT; REWARD; SUBSTANTIA NIGRA;

EID: 0033508899     PISSN: 02706474     EISSN: None     Source Type: Journal    
DOI: 10.1523/jneurosci.19-23-10502.1999     Document Type: Article

References (58)

1. Berns G, Sejnowski T (1998) A computational model of how the basal ganglia produce sequences. J Cognit Neurosci 10:108-121.
2. Berridge K, Robinson T (1998) What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Rev 28:309-369.
3. Brog J, Salyapongse A, Deutch A, Zahm D (1993) The patterns of afferent innervation of the core and shell in the "accumbens" part of the rat ventral striatum: immunohistochemical detection of retrogradely transported fluoro-gold. J Comp Neurol 338:255-278.
4. Buonomano DV, Mauk MD (1994) Neural network model of the cerebellum: temporal discrimination and the timing of motor responses. Neural Comput 6:38-55.
5. Calabresi P, Maj R, Pisani A, Mercuri N, Bernardi G (1992a) Long-term synaptic depression in the striatum: physiological and pharmacological characterization. J Neurosci 12:4224-4233.
6. Calabresi P, Pisani A, Mercuri N, Bernardi G (1992b) Long-term potentiation in the striatum is unmasked by removing the voltage-dependent magnesium block of NMDA receptor channels. Eur J Neurosci 4:929-935.
7. Calabresi P, Pisani A, Mercuri N, Bernardi G (1994) Post-receptor mechanisms underlying striatal long-term depression. J Neurosci 14:4871-4881.
8. Carpenter G, Grossberg S (1987) ART 2: Self-organization of stable category recognition codes for analog input patterns. Appl Optics 26:4919-4930.
9. Conde H (1992) Organization and physiology of the substantia nigra. Exp Brain Res 88:233-248.
10. Conde H, Dormont J, Farin D (1998) The role of the pedunculopontine tegmental nucleus in relation to conditioned motor performance in the cat. II. Effects of reversible inactivation by intracerebral microinjections. Exp Brain Res 121:411-418.
11. Contreras-Vidal J, Schultz W (1997) A predictive reinforcement model of dopamine neurons for learning approach behavior. First International Conference on Vision, Recognition, and Action: Neural Models of Mind and Machine. Department of Cognitive and Neural Systems, Boston University, Boston, MA, May 1997.
12. Crepel F, Hemart N, Jaillard D, Daniel H (1996) Cellular mechanisms of long-term depression in the cerebellum. Behav Brain Sci 19:347-353.
13. Dias R, Robbins T, Roberts A (1996) Dissociation in prefrontal cortex of affective and attentional shifts. Nature 380:69-72.
14. Dormont J, Conde H, Farin D (1998) The role of the pedunculopontine tegmental nucleus in relation to conditioned motor performance in the cat I. Context-dependent and reinforcement-related single unit activity. Exp Brain Res 121:401-410.
15. Eblen F, Graybiel A (1995) Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey. J Neurosci 15:5999-6013.
16. Fiala J, Grossberg S, Bullock D (1996) Metabotropic glutamate receptor activation in cerebellar purkinje cells as substrate for adaptive timing of the classically conditioned eye-blink response. J Neurosci 16:3760-3774.
17. Finch EA, Augustine GJ (1998) Local calcium signalling by inositol-1,4,5-trisphosphate in Purkinje cell dendrites. Nature 396:753-756.
18. Funahashi S, Bruce CJ, Goldman-Rakic PS (1989) Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J Neurophysiol 61:331-349.
19. Futami T, Takakusaki K, Kitai S (1995) Glutamatergic and cholinergic inputs from the pedunculopontine tegmental nucleus to dopamine neurons in the substantia nigra pars compacta. Neurosci Res 21:331-342.
20. Gallagher M, Chiba A (1996) The amygdala and emotion. Curr Opin Neurobiol 6:221-227.
21. Garris PA, Kilpatrick M, Bunin MA, Michael D, Walker QD, Wightman RM (1999) Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation. Nature 398:67-69.
22. Gerfen C (1992) The neostriatal mosaic: multiple levels of compartmental organization in the basal ganglia. Annu Rev Neurosci 15:285-320.
23. Grossberg S, Merrill J (1992) A neural network model of adaptively timed reinforcement learning and hippocampal dynamics. Cognit Brain Res 1:3-38.
24. Grossberg S, Merrill J (1996) The hippocampus and cerebellum in adaptively timed learning, recognition, and movement. J Cogn Neurosci 8:257-277.
25. Grossberg S, Schmajuk N (1989) Neural dynamics of adaptive timing and temporal discrimination during associative learning. Neural Networks 2:79-102.
26. Hajos M, Greenfield S (1994) Synaptic connections between pars compacta and pars reticulata neurones: electrophysiological evidence for functional modules within the substantia nigra. Brain Res 660:216-224.
27. Hollerman J, Schultz W (1998) Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1:304-309.
28. Houk J, Adams J, Barto A (1995) A model of how the basal ganglia generate and use neural signals that predict reinforcement. In: Models of information processing in the basal ganglia (Houk J, Davis J, Beiser D, eds), pp 249-270. Cambridge, MA: MIT.
29. Jaeger D, Kita H, Wilson C (1994) Surround inhibition among projections neurons is weak or nonexistent in the rat neostriatum. J Neurosci 72:2555-2558.
30. Joiner WJ, Tang MD, Wang LY, Dworetzky SI, Boissard CG, Gan L, Gribkoff VK, Kaczmarek LK (1998) Formation of intermediate-conductance calcium-activated potassium channels by interaction of Slack and Slo subunits. Nat Neurosci 1:462-469.
31. Kita H (1992) Responses of globus pallidus neurons to cortical stimulation: intracellular study in the rat. Brain Res 589:84-90.
32. Kita H, Kitai S (1991) Intracellular study of rat globus pallidus neurons: membrane properties and responses to neostriatal, subthalamic and nigral stimulation. Brain Res 564:296-305.
33. Kojima J, Yamaji Y, Matsumura M, Nambu A, Inase M, Tokuno H, Takada M, Imai H (1997) Excitotoxic lesions of the pedunculopontine tegmental nucleus produce contralateral hemiparkinsonism in the monkey. Neurosci Lett 226:111-114.
34. Ljungberg T, Apicella P, Schultz W (1992) Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 67:145-163.
35. McDonald R, White N (1993) A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. Behav Neurosci 107:3-22.
36. Mirenowicz J, Schultz W (1994) Importance of unpredictability for reward responses in primate dopamine neurons. J Neurophysiol 72:1024-1027.
37. Mogenson G, Wu M (1986) Subpallidal projections to the mesencephalic locomotor region investigated with a combination of behavioral and electrophysiological recording techniques. Brain Res Bull 16:383-390.
38. Montague P, Dayan P, Sejnowski T (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-1947.
39. Nakamura K, Ono T (1986) Lateral hypothalamus neuron involvement in integration of natural and artificial rewards and cue signals. J Neurophysiol 55:163-181.
40. Pisani A, Calabresi P, Centonze D, Bernardi G (1996) Enhancement of NMDA responses by group I metabotropic glutamate receptor activation in striatal neurones. Br J Pharmacol 120:1007-1014.
41. Scarnati E, Hajdu F, Pacitti C, Tombol T (1988) An EM and Golgi study on the connection between the nucleus tegmenti pedunculopontinus and the pars compacta of the substantia nigra in the rat. J Hirnforsch 29:95-105.
42. Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80:1-27.
43. Schultz W, Apicelli P, Scarnati E, Ljungberg T (1992) Neuronal activity in monkey ventral striatum related to the expectation of reward. J Neurosci 12:4595-4610.
44. Schultz W, Apicella P, Ljungberg T (1993) Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J Neurosci 13:900-913.
45. Schultz W, Romo R, Ljungberg T, Mirenowicz J, Hollerman J, Dickinson A (1995) Reward-related signals carried by dopamine neurons. In: Models of information processing in the basal ganglia (Houk J, Davis J, Beiser D eds), pp 11-27. Cambridge, MA: MIT.
46. Schultz W, Dayan P, Montague P (1997) A neural substrate of prediction and reward. Science 275:1593-1598.
47. Semba K, Fibiger H (1992) Afferent connections of the laterodorsal and the pedunculopontine tegmental nuclei in the rat: a retro- and anterograde transport and immunohistochemical study. J Comp Neurol 323:387-410.
48. Smith I, Grace A (1992) Role of the subthalamic nucleus in the regulation of nigral dopamine neuron activity. Synapse 12:287-303.
49. Suri R, Schultz W (1998) Learning of sequential movements by neural network model with dopamine-like reinforcement signal. Exp Brain Res 121:350-354.
50. Takakusaki K, Shiroyama T, Kitai S (1997) Two types of cholinergic neurons in the rat tegmental pedunculopontine nucleus: electrophysiological and morphological characterization. Neuroscience 79:1089-1109.
51. Takechi H, Eilers J, Konnerth A (1998) A new class of synaptic response involving calcium release in dendritic spines. Nature 396:757-760.
52. Tepper J, Martin L, Anderson D (1995) GABAA receptor-mediated inhibition of rat substantia nigra dopaminergic neurons by pars reticulata projection neurons. J Neurosci 15:3092-3103.
53. Tremblay L, Schultz W (1999) Relative reward preference in primate orbitofrontal cortex. Nature 398:704-708.
54. Wickens J, Kotter R (1995) Cellular models of reinforcement. In: Models of information processing in the basal ganglia (Houk J, Davis J, Beiser D, eds), pp 187-214. Cambridge, MA: MIT.
55. Wickens J, Begg A, Arbuthnott G (1996) Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro. Neuroscience 70:1-5.
56. Wilkie DM (1987) Stimulus intensity affects pigeons' timing behavior: implications for an internal clock model. Anim Learn Behav 15:35-39.
57. Wilson C 1995 The contribution of cortical neurons to the firing pattern of striatal spiny neurons. In: Models of information processing in the basal ganglia (Houk J, Davis J, Beiser D, eds), pp 29-50. Cambridge, MA: MIT.
58. Yang C, Mogenson G (1987) Hippocampal signal transmission to the pedunculopontine nucleus and its regulation by dopamine D2 receptors in the nucleus accumbens: an electrophysiological and behavioural study. Neuroscience 23:1041-1055.