Novelty encoding by the output neurons of the basal ganglia

Frontiers in Systems Neuroscience

Volumn 3, Issue JAN, 2010, Pages

  Joshua, Mati ^a   Adler, Avital ^a   Bergman, Hagai ^a  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

Author keywords

Primate; Reinforcement learning; Spikes; Substantia nigra pars reticulata

Indexed keywords

EID: 84887123539     PISSN: 16625137     EISSN: None     Source Type: Journal    
DOI: 10.3389/neuro.06.020.2009     Document Type: Article

References (40)

1. Arkadir, D., Morris, G., Vaadia, E., and Bergman, H. (2004). Independent coding of movement direction and reward prediction by single pallidal neurons. J. Neurosci. 24, 10047-10056.
2. Bach, D. R., Seymour, B., and Dolan, R. J. (2009). Neural activity associated with the passive prediction of ambiguity and risk for aversive events. J. Neurosci. 29, 1648-1656.
3. Bayer, H. M., and Glimcher, P. W. (2005). Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47, 129-141.
4. Chevalier, G., and Deniau, J. M. (1990). Disinhibition as a basic process in the expression of striatal functions. Trends Neurosci. 13, 277-280.
5. DeLong, M. R., Crutcher, M. D., and Georgopoulos, A. P. (1983). Relations between movement and single cell discharge in the substantia nigra of the behaving monkey. J. Neurosci. 3, 1599-1606.
6. Fiorillo, C. D., Tobler, P. N., and Schultz, W. (2003). Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299, 1898-1902.
7. Gulley, J. M., Kosobud, A.-E. K., and Rebec, G. V. (2002). Behavior-related modulation of substantia nigra pars reticulata neurons in rats performing a conditioned reinforcement task. Neuroscience 111, 337-349.
8. Handel, A., and Glimcher, P. W. (2000). Contextual modulation of substantia nigra pars reticulata neurons. J. Neurophysiol. 83, 3042-3048.
9. Hikosaka, O., and Wurtz, R. H. (1983a). Visual and oculomotor functions of monkey substantia nigra pars reticulata. I. Relation of visual and auditory responses to saccades. J. Neurophysiol. 49, 1230-1253.
10. Hikosaka, O., and Wurtz, R. H. (1983b). Visual and oculomotor functions of monkey substantia nigra pars reticulata. III. Memory-contingent visual and saccade responses. J. Neurophysiol. 49, 1268-1284.
11. Hikosaka, O., and Wurtz, R. H. (1983c). Visual and oculomotor functions of monkey substantia nigra pars reticulata. IV. Relation of substantia nigra to superior colliculus. J. Neurophysiol. 49, 1285-1301.
12. Hollerman, J. R., and Schultz, W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nat. Neurosci. 1, 304-309.
13. Joshua, M., Adler, A., Mitelman, R., Vaadia, E., and Bergman, H. (2008). Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. J. Neurosci. 28, 11673-11684.
14. Joshua, M., Adler, A., Prut, Y., Vaadia, E., and Bergman, H. (2009a). Synchronization of midbrain dopaminergic neurons is enhanced by rewarding events. Neuron 62, 695-704.
15. Joshua, M., Adler, A., Rosin, B., Vaadia, E., and Bergman, H. (2009b). Encoding of probabilistic rewarding and aversive events by pallidal and nigral neurons. J. Neurophysiol. 101, 758-772.
16. Joshua, M., Elias, S., Levine, O., and Bergman, H. (2007). Quantifying the isolation quality of extracellularly recorded action potentials. J. Neurosci. Methods 163, 267-282.
17. Kimchi, E. Y., and Laubach, M. (2009). Dynamic encoding of action selection by the medial striatum. J. Neurosci. 29, 3148-3159.
18. Kita, H. (2007). Globus pallidus external segment. Prog. Brain Res. 160, 111-133.
19. Lau, B., and Glimcher, P. W. (2008). Value representations in the primate striatum during matching behavior. Neuron 58, 451-463.
20. Lauwereyns, J., Watanabe, K., Coe, B., and Hikosaka, O. (2002). A neural correlate of response bias in monkey caudate nucleus. Nature 418, 413-417.
21. Levesque, M., and Parent, A. (2005). The striatofugal fi ber system in primates: a reevaluation of its organization based on single-axon tracing studies. Proc. Natl. Acad. Sci. U.S.A. 102, 11888-11893.
22. Ljungberg, T., Apicella, P., and Schultz, W. (1992). Responses of monkey dopamine neurons during learning of behavioral reactions. J. Neurophysiol. 67, 145-163.
23. Mink, J. W. (1996). The basal ganglia: focused selection and inhibition of competing motor programs. Prog. Neurobiol. 50, 381-425.
24. Mitelman, R., Joshua, M., Adler, A., and Bergman, H. (2009). A noninvasive, fast and inexpensive tool for the detection of eye open/closed state in primates. J. Neurosci. Methods 178, 350-356.
25. Morris, G., Arkadir, D., Nevet, A., Vaadia, E., and Bergman, H. (2004). Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 43, 133-143.
26. Nishino, H., Ono, T., Fukuda, M., and Sasaki, K. (1985). Monkey substantia nigra (pars reticulata) neuron discharges during operant feeding. Brain Res. 334, 190-193.
27. O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., and Dolan, R. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304, 452-454.
28. Pasupathy, A., and Miller, E. K. (2005). Different time courses of learningrelated activity in the prefrontal cortex and striatum. Nature 433, 873-876.
29. Redgrave, P., and Gurney, K. (2006). The short-latency dopamine signal: a role in discovering novel actions? Nat. Rev. Neurosci. 7, 967-975.
30. Redgrave, P., Marrow, L., and Dean, P. (1992). Topographical organization of the nigrotectal projection in rat: evidence for segregated channels. Neuroscience 50, 571-595.
31. Reynolds, J. N., Hyland, B. I., and Wickens, J. R. (2001). A cellular mechanism of reward-related learning. Nature 413, 67-70.
32. Sato, M., and Hikosaka, O. (2002). Role of primate substantia nigra pars reticulata in reward-oriented saccadic eye movement. J. Neurosci. 22, 2363-2373.
33. Schultz, W. (1986). Activity of pars reticulata neurons of monkey substantia nigra in relation to motor, sensory, and complex events. J. Neurophysiol. 55, 660-677.
34. Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599.
35. Shen, W., Flajolet, M., Greengard, P., and Surmeier, D. J. (2008). Dichotomous dopaminergic control of striatal synaptic plasticity. Science 321, 848-851.
36. Sutton, R. S., and Barto, A. G. (1998). Reinforcement learning - an introduction. Cambridge, MA, The MIT Press.
37. Tan, C. O., and Bullock, D. (2008). A local circuit model of learned striatal and dopamine cell responses under probabilistic schedules of reward. J. Neurosci. 28, 10062-10074.
38. Wichmann, T., and Kliem, M. A. (2004). Neuronal activity in the primate substantia nigra pars reticulata during the performance of simple and memory-guided elbow movements. J. Neurophysiol. 91, 815-827.
39. Williams, Z. M., and Eskandar, E. N. (2006). Selective enhancement of associative learning by microstimulation of the anterior caudate. Nat. Neurosci. 9, 562-568.
40. Wittmann, B. C., Daw, N. D., Seymour, B., and Dolan, R. J. (2008). Striatal activity underlies novelty-based choice in humans. Neuron 58, 967-973.