Immediate changes in anticipatory activity of caudate neurons associated with reversal of position-reward contingency

Journal of Neurophysiology

Volumn 94, Issue 3, 2005, Pages 1879-1887

  Watanabe, Katsumi ^a,b   Hikosaka, Okihide ^b  

^a NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

^b NATIONAL EYE INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL CELL; ANIMAL EXPERIMENT; ANTICIPATION; ARTICLE; CAUDATE NUCLEUS; COGNITION; CONTROLLED STUDY; EYE MOVEMENT; LATENT PERIOD; MONKEY; MOTIVATION; NONHUMAN; POSITION REWARD CONTINGENCY; PRIORITY JOURNAL; RELIABILITY; REWARD; SACCADIC EYE MOVEMENT;

ACTION POTENTIALS; ANIMALS; BEHAVIOR, ANIMAL; CAUDATE NUCLEUS; EYE MOVEMENTS; MACACA MULATTA; MALE; NEURONS; PHOTIC STIMULATION; PREDICTIVE VALUE OF TESTS; REACTION TIME; REWARD;

EID: 23944501745     PISSN: 00223077     EISSN: None     Source Type: Journal    
DOI: 10.1152/jn.00012.2005     Document Type: Article

References (70)

1. Alexander GE, De Long MR, and Strick PL. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci 9: 357-381, 1986.
2. Aosaki T, Tsubokawa H, Ishida A, Watanabe K, Graybiel AM, and Kimura M. Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning. J Neurosci 14: 3969-3984, 1994.
3. Apicella P, Scarnati E, Ljungberg T, and Schultz W. Neuronal activity in monkey striatum related to the expectation of predictable environmental events. J Neurophysiol 68: 945-960, 1992.
4. Assad WF, Rainder G, and Miller EK. Neural activity in the primate prefrontal cortex during associative learning. Neuron 21: 1399-1407, 1998.
5. Assad WF, Rainder G, and Miller EK. Task-specific activity in the primate prefrontal cortex. J Neurophysiol 84: 451-459, 2000.
6. Bar-Gad I, Morris G, and Bergman H. Information processing, dimensionality reduction and reinforcement learning in the basal ganglia. Prog Neurobiol 71: 439-473, 2003.
7. Barto AG. Reinforcement learning control. Curr Opin Neurobiol 4: 888-893, 1994.
8. Bruce CJ and Goldberg ME. Primate frontal eye fields. I. Single neurons discharging before saccades. J Neurophysiol 53: 603-635, 1985.
9. Chen LL and Wise SP. Neuronal activity in the supplementary eye field during acquisition of conditional oculomotor associations. J Neurophysiol 73: 1101-1121, 1995a.
10. Chen LL and Wise SP. Supplementary eye field contrasted with the frontal eye field during acquisition of conditional oculomotor associations. J Neurophysiol 73: 1122-1134, 1995b.
11. Coe B, Tomihara K, Matsuzawa M, and Hikosaka O. Visual and anticipatory bias in three cortical eye fields of the monkey during an adaptive decision-making task. J Neurosci 22: 5081-5090, 2002.
12. Dorris M, Paré M, and Munoz DP. Immediate neural plasticity shapes motor performance. J Neurosci 20: 1-5, 2000.
13. Dorris MC, Taylor TL, Klein RM, and Munoz DP. Influence of previous visual stimulus or saccade on saccadic reaction times in monkey. J Neurophysiol 81: 2429-2436, 1999.
14. Fecteau JH and Munoz DP. Exploring the consequences of the previous trial. Nat Rev Neurosci 4: 1-9, 2003.
15. Harlow HF. The formation of learning sets. Psychol Rev 56: 51-65, 1949.
16. Harlow HF. Analysis of discrimination learning by monkeys. J Exp Psychol 40: 26-39, 1950.
17. Hikosaka O, Kawagoe R, and Takikawa Y. Role of the basal ganglia in the control of purposive saccadic eye movements. Physiol Rev 80: 953-978, 2000.
18. Hikosaka O, Sakamoto M, and Usui S. Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements. J Neurophysiol 61: 780-798, 1989a.
19. Hikosaka O, Sakamoto M, and Usui S. Functional properties of monkey caudate neurons. II. Visual and auditory responses. J Neurophysiol 61: 799-813, 1989b.
20. Hikosaka O, Sakamoto M, and Usui S. Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J Neurophysiol 61: 814-832, 1989c.
21. Hikosaka O and Wurtz RH. Visual and oculomotor functions of monkey substantia nigra pars reticulata. IV. Relation of substantia nigra to superior colliculus. J Neurophysiol 49: 1285-1301, 1983.
22. Hollerman JR and Schultz W. Dopamine neurons report an error in the temporal prediction reward during learning. Nat Neurosci 1: 304-309, 1998.
23. Hollerman JR, Tremblay L, and Schultz W. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J Neurophysiol 80: 947-963, 1998.
24. Houk JC and Wise SP. Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. Cereb Cortex 5: 95-110, 1995.
25. Ikeda T and Hikosaka O. Reward-dependent gain and bias of visual responses in primate superior colliculus. Neuron 39: 693-700, 2003.
26. Itoh H, Nakahara H, Hikosaka O, Kawagoe R, Takikawa Y, and Aihara K. Correlation of primate caudate neural activity and saccade parameters in reward-oriented behavior. J Neurophysiol 89: 1774-1783, 2003.
27. Judge SJ, Richmond BJ, and Chu FC. Implantation of magnetic search coils for measurement of eye position: an improved method. Vision Res 20: 535-538, 1980.
28. Kawagoe R, Takikawa Y, and Hikosaka O. Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci 1: 411-416, 1998.
29. Kawagoe R, Takikawa Y, and Hikosaka O. Reward-predicting activity of dopamine and caudate neurons: a possible mechanism of motivational control of saccadic eye movement. J Neurophysiol 91: 1013-1024, 2004.
30. Kimura M. The role of primate putamen neurons in the association of sensory stimuli with movement. Neurosci Res 3: 436-443, 1986.
31. Kobayashi S, Lauwereyns J, Koizumi M, Sakagami M, and Hikosaka O. Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. J Neurophysiol 87: 1488-1498, 2002.
32. Lauwereyns J, Takikawa Y, Kawagoe R, Kobayashi S, Koizumi M, Coe B, Sakagami M, and Hikosaka O. Feature-based anticipation of cues that predict reward in monkey caudate nucleus. Neuron 33: 463-473, 2002a.
33. Lauwereyns J, Watanabe K, Coe B, and Hikosaka O. A neural correlate of response bias in monkey caudate nucleus. Nature 418: 413-417, 2002b.
34. Meyer DR. Intraproblem-interproblem relationships in learning by monkeys. J Comp Physiol Psychol 44: 162-167, 1951.
35. Miller EK, Nieder A, Freeman DJ, and Wallis J. Neural correlates of categories and concepts. Curr Opin Neurobiol 13: 198-203, 2003.
36. Mitz AR, Godschalk M, and Wise SP. Learning-dependent neuronal activity in the premotor cortex: activity during the acquisition of conditional motor associations. J Neurosci 11: 1855-1872, 1991.
37. Montague PR, Dayan P, and Sejnowski TJ. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16: 1936-1947, 1996.
38. Nakamura K, Sakai K, and Hikosaka O. Neuronal activity in medial frontal cortex during learning of sequential procedures. J Neurophysiol 80: 2671-2687, 1998.
39. Niki H, Sugita S, and Watanabe M. Modification of the activity of primate frontal neurons during learning of a go/no-go discrimination and its reversal. In: Vision, Memory and the Temporal Lobe, edited by Iwai E and Mishkin M. New York: Elsevier, 1990, p. 295-304.
40. Parent A. Extrinsic connections of the basal ganglia. Trends Neurosci 13: 254-258, 1990.
41. Parthasarathy HB, Schall JD, and Graybiel AM. Distributed but convergent ordering of corticostriatal projections: analysis of the frontal eye field and the supplementary eye field in the macaque monkey. J Neurosci 12: 4468-4488, 1992.
42. Pasupathy A and Miller EK. Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433: 873-876, 2005.
43. Redgrave P, Prescott TJ, and Gurney K. The basal ganglia: a vertebrate to the selection problem? Neuroscience 89: 1009-1023, 1999.
44. Rolls ET. Neurophysiology and cognitive functions of the striatum. Rev Neurol (Paris) 150: 648-660, 1994.
45. Rolls ET, Critchley HD, Mason R, and Wakeman EA. Orbitofrontal cortex neurons: role in olfactory and visual association learning. J Neurophysiol 75: 1970-1981, 1996.
46. Sakagami M and Niki H. Encoding of behavioral significance of visual stimuli by primate prefrontal neurons: relation to relevant task conditions. Exp Brain Res 97: 423-436, 1994.
47. Sakagami M, Tsutsui K, Lauwereyns J, Koizumi M, Kobayashi S, and Hikosaka O. A code for behavioral inhibition on the basis of color, but not motion, in ventrolateral prefrontal cortex of macaque monkey. J Neurosci 21: 4801-4808, 2001.
48. Schultz W. Getting formal with dopamine and reward. Neuron 36: 241-263, 2002.
49. Schultz W, Apicella P, Scarnati E, and Ljungberg T. Neuronal activity in monkey ventral striatum related to the expectation of reward. J Neurosci 12: 4595-4610, 1992.
50. Schultz W, Dayan P, and Montague PR. A neural substrate of prediction and reward. Science 275: 1593-1599, 1997.
51. Schultz W, Tremblay L, and Hollerman JR. Changes in behavior-related neuronal activity in the striatum during learning. Trends Neurosci 26: 321-328, 2003.
52. Selemon LD and Goldman-Rakic PS. Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey. J Neurosci 5: 776-794, 1985.
53. Shima K and Tanji J. Role for cingulate motor area cells in voluntary movement selection based on reward. Science 282: 1335-1338, 1998.
54. Takikawa Y, Kawagoe R, and Hikosaka O. Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons. J Neurophysiol 87: 508-515, 2002.
55. Takikawa Y, Kawagoe R, and Hikosaka O. A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping. J Neurophysiol 92: 2520-2529, 2004.
56. Taylor AE and Satint-Cyr JA. The neuropsychology of Parkinson's disease. Brain Cogn 28: 281-296, 1995.
57. Thorpe SJ, Rolls ET, and Maddison S. Neuronal activity in the orbitofrontal cortex of the behaving monkey. Exp Brain Res 49: 93-115, 1983.
58. Treichler FR and Petros TV. Interference characteristics in concurrent discrimination performance by monkeys. Bull Psychol Soc 21: 206-208, 1983.
59. Tremblay L, Hollerman JR, and Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate striatum. J Neurophysiol 80: 964-977, 1998.
60. Tremblay L and Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. J Neurophysiol 83: 1877-1885, 2000.
61. Wallis JD, Anderson KC, and Miller EK. Single neurons in the prefrontal cortex encode abstract rules. Nature 411: 952-956, 2001.
62. Waelti P, Dickinson A, and Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 412: 43-48, 2001.
63. Wallis JD and Miller EK. From rules to responses: neuronal processes in the premotor and prefrontal cortex. J Neurophysiol 90: 1790-1808, 2003.
64. Watanabe K, Lauwereyns J, and Hikosaka O. Effects of motivational conflicts on visually elicited saccades in monkeys. Exp Brain Res 152: 361-367, 2003a.
65. Watanabe K, Lauwereyns J, and Hikosaka O. Neural correlates of rewarded and unrewarded eye movements in the primate caudate nucleus. J Neurosci 23: 10051-10057, 2003b.
66. Watanabe M. Prefrontal unit activity during associative learning in the monkey. Exp Brain Res 80: 296-309, 1990.
67. Watanabe M. Reward expectancy in primate prefrontal neurons. Nature 382: 629-632, 1996.
68. Watanabe M, Hikosaka K, Sakagami M, and Shirakawa S. Coding and monitoring of motivational context in the primate prefrontal cortex. J Neurosci 22: 2391-2400, 2002.
69. White IM and Wise SP. Rule-dependent neuronal activity in the prefrontal cortex. Exp Brain Res 126: 315-335, 1999.
70. Yeterian EH and Pandya DN. Prefrontostriatal connections in relation to cortical architectonic organization in rhesus monkeys. J Comp Neurol 312: 43-67, 1991.