Intrinsically motivated action-outcome learning and goal-based action recall: A system-level bio-constrained computational model

Neural Networks

Volumn 41, Issue , 2013, Pages 168-187

  Baldassarre, Gianluca ^a   Mannella, Francesco ^a   Fiore, Vincenzo G ^a   Redgrave, Peter ^b   Gurney, Kevin ^b   Mirolli, Marco ^a  

^a INSTITUTE OF COGNITIVE SCIENCES AND TECHNOLOGIES   (Italy)

^b UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Attention; Basal ganglia selection; Dopamine; Intrinsic motivations; Parietal, premotor, prefrontal cortex; Repetition bias; Striato cortical loops; Superior colliculus; Trial and error learning

Indexed keywords

ATTENTION; BASAL GANGLIA; DOPAMINE; INTRINSIC MOTIVATION; PREFRONTAL CORTEX; REPETITION BIAS; STRIATO-CORTICAL LOOPS; SUPERIOR COLLICULUS; TRIAL-AND-ERROR LEARNING;

AMINES; ANIMALS; C (PROGRAMMING LANGUAGE); MOTIVATION; NEUROPHYSIOLOGY;

ASSOCIATION REACTIONS;

DOPAMINE;

ARTICLE; CALCULATION; GAZE; LEARNING; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MOTIVATION; PRIORITY JOURNAL; PROCESS DEVELOPMENT;

ANIMALS; ARTIFICIAL INTELLIGENCE; ATTENTION; CHILD; CORPUS STRIATUM; DOPAMINE; FEEDBACK; GOALS; HAPLORHINI; HUMANS; MENTAL RECALL; MODELS, NEUROLOGICAL; MOTIVATION; MOTOR CORTEX; NEURAL NETWORKS (COMPUTER); PARIETAL LOBE; PREFRONTAL CORTEX; PROBLEM-BASED LEARNING; REINFORCEMENT (PSYCHOLOGY); SUPERIOR COLLICULI;

EID: 84875892345     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2012.09.015     Document Type: Article

References (123)

1. Alexander G.E., DeLong M.R., Strick P.L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience 1986, 9:357-381.
2. Anastasio T.J. Tutorial on neural systems modelling 2010, Sinauer Associated, Sunderland, MA.
3. Ashby F.G., Turner B.O., Horvitz J.C. Cortical and basal ganglia contributions to habit learning and automaticity. Trends in Cognitive Sciences 2010, 14(5):208-215.
4. Balcita-Pedicino J.J., Omelchenko N., Bell R., Sesack S.R. The inhibitory influence of the lateral habenula on midbrain dopamine cells: ultrastructural evidence for indirect mediation via the rostromedial mesopontine tegmental nucleus. Journal of Comparative Neurology 2011, 519(6):1143-1164.
5. Baldassarre, G. (2002). Planning with neural networks and reinforcement learning. Ph.D. Thesis. Computer Science Department, University of Essex, Colchester, UK.
6. Baldassarre G. Forward and bidirectional planning based on reinforcement learning and neural networks in a simulated robot. Lecture notes in artificial intelligence 2003, vol. 2684:179-200. Springer Verlag, Berlin. M. Butz, O. Sigaud, P. Gérard (Eds.).
7. Baldassarre G. What are intrinsic motivations? A biological perspective. Proceedings of the international conference on development and learning and epigenetic robotics 2011, E1-E8. IEEE, New York. A. Cangelosi, J. Triesch, I. Fasel, K. Rohlfing, F. Nori, P.-Y. Oudeyer, M. Schlesinger, Y. Nagai (Eds.).
8. Baldassarre, G., & Mirolli, M. (2012). Deciding which skill to learn when: temporal-difference competence-based intrinsic motivation (TD-CB-IM), a mechanism that uses the td-error as intrinsic reinforcement in hierarchical systems. In: G. Baldassarre & M. Mirolli (Eds.), Intrinsically motivated learning in natural and artificial systems, Berlin: Springer-Verlag (in press).
9. Balleine B.W., Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 1998, 37(4-5):407-419.
10. Balleine B.W., Killcross S.A., Dickinson A. The effect of lesions of the basolateral amygdala on instrumental conditioning. Journal of Neuroscience 2003, 23(2):666-675.
11. Berlyne D.E. Curiosity and exploration. Science 1966, 143:25-33.
12. Berridge K.C., Aldridge J.W., Houchard K.R., Zhuang X. Sequential super-stereotypy of an instinctive fixed action pattern in hyper-dopaminergic mutant mice: a model of obsessive compulsive disorder and Tourette's. BMC Biology 2005, 3:4.
13. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Research Reviews 1998, 28(3):309-369.
14. Bojak I., Oostendorp T., Reid A., Kotter R. Connecting mean field models of neural activity to eeg and fmri data. Brain Topography 2003, 23:139-149.
15. Bolado-Gomez, R., Chambers, J., & Gurney, K. (2009). The basal ganglia and the 3-factor learning rule: reinforcement learning during operant conditioning. In: J. Triesch, J. Lücke, G. Pipa, C. Rothkopf, and J. Zhu (Eds.). In Frontiers in computational neuroscience, conference abstracts: Bernstein conference on computational neuroscience (pp. 154-155).
16. Brown J., Bullock D., Grossberg S. How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. Journal of Neuroscience 1999, 19(23):10502.
17. Brunel N., Wang X. Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. Journal of Computational Neuroscience 2001, 11(1):63-85.
18. Calabresi P., Picconi B., Tozzi A., Filippo M.D. Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends in Neurosciences 2007, 30(5):211-219.
19. Caligiore D., Borghi A., Parisi D., Baldassarre G. TRoPICALS: a computational embodied neuroscience model of compatibility effects. Psychological Review 2010, 117:1188-1228.
20. Cardinal R.N., Parkinson J.A., Hall J., Everitt B.J. Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neuroscience & Biobehavioral Reviews 2002, 26(3):321-352.
21. Carelli R.M., Wolske M., West M.O. Loss of lever press-related firing of rat striatal forelimb neurons after repeated sessions in a lever pressing task. Journal of Neuroscience 1997, 17(5):1804-1814.
22. Chevalier G., Deniau J.M. Disinhibition as a basic process in the expression of striatal functions. Trends in Neurosciences 1990, 13(7):277-280.
23. Cisek P., Kalaska J.F. Neural mechanisms for interacting with a world full of action choices. Annual Review of Neuroscience 2010, 33:269-298.
24. Comoli E., Coizet V., Boyes J., Bolam J.P., Canteras N.S., Quirk R.H. A direct projection from superior colliculus to substantia nigra for detecting salient visual events. Nature Neuroscience 2003, 6(9):974-980.
25. Cope, A., & Gurney, K. N. (2011). A biologically based model of active vision. In Proceedings of AISB'11-architectures for active vision. New York, UK.
26. Crabtree J.W., Isaac J.T.R. New intrathalamic pathways allowing modality-related and cross-modality switching in the dorsal thalamus. Journal of Neuroscience 2002, 22(19):8754-8761.
27. Daw N.D., Niv Y., Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience 2005, 8(12):1704-1711.
28. Dayan P., Abbott L. Theoretical neuroscience: computational and mathematical modeling of neural systems 2001, MIT Press, Boston, MA.
29. Dommett E., Coizet V., Blaha C.D., Martindale J., Lefebvre V., Walton N. How visual stimuli activate dopaminergic neurons at short latency. Science 2005, 307(5714):1476-1479.
30. Doya K. What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?. Neural Networks 1999, 12(7-8):961-974.
31. Fuster J.M. The prefrontal cortex 2008, Elsevier, Oxford. 4th ed.
32. Goodale M.A., Milner A.D. Separate visual pathways for perception and action. Trends in Neurosciences 1992, 15(1):20-25.
33. Grill-Spector K., Malach R. The human visual cortex. Annual Review of Neuroscience 2004, 27:649-677.
34. Gurney K.N. Reverse engineering the vertebrate brain: Methodological principles for a biologically grounded programme of cognitive modelling. Cognitive Computation 2009, 1(1):29-41.
35. Gurney K., Humphries M., Redgrave P. Cortico-striatal plasticity for action-outcome learning using spike timing dependent eligibility. BMC Neuroscience 2009, 10:E135.
36. Gurney, K., Lepora, N., Shah, A., Koene, A., & Redgrave, P. (2012). Action discovery and intrinsic motivation: a biologically constrained formalisation. In: G. Baldassarre & M. Mirolli (Eds.), Intrinsically motivated learning in natural and artificial systems, Berlin: Springer-Verlag (in press).
37. Gurney K., Prescott T., Redgrave P. A computational model of action selection in the basal ganglia I: a new functional anatomy. Biological Cybernetics 2001, 84:401-410.
38. Gurney K., Prescott T., Redgrave P. A computational model of action selection in the basal ganglia II: analysis and simulation of behaviour. Biological Cybernetics 2001, 84:411-423.
39. Gurney K., Prescott T., Wickens J., Redgrave P. Computational models of the basal ganglia: from robots to membranes. Trends in Neurosciences 2004, 27(8):453-459.
40. Haber S.N. The primate basal ganglia: parallel and integrative networks. Journal of Chemical Neuroanatomy 2003, 26:317-330.
41. Harlow H.F. Learning and satiation of response in intrinsically motivated complex puzzle performance by monkeys. Journal of Comparative and Physiological Psychology 1950, 43:289-294.
42. Hart S., Grupen R. Learning generalizable control programs. IEEE Transactions on Autonomous Mental Development 2011, 3(1):216-231.
43. Hikosaka O. Neural systems for control of voluntary action-a hypothesis. Advances in Biophysics 1998, 35:81-102.
44. Hikosaka O., Takikawa Y., Kawagoe R. Role of the basal ganglia in the control of purposive saccadic eye movements. Physiological Reviews 2000, 80(3):953-978.
45. Houk J.C., Adams J.L., Andrew G.B. A model of how the basal ganglia generate and use neural signals ghat predict reinforcement. Models of information processing in the basal ganglia 1995, 249-270. The MIT Press, Cambridge, MA. J.C. Houk, J.L. Davids, D.G. Beiser (Eds.).
46. Models of information processing in the basal ganglia 1995, The MIT Press, Cambridge, MA. J.C. Houk, J.L. Davids, D.G. Beiser (Eds.).
47. Huang Y.-Y., Simpson E., Kellendonk C., Kandel E.R. Genetic evidence for the bidirectional modulation of synaptic plasticity in the prefrontal cortex by d1 receptors. Proceedings of the National Academy of Sciences of the United States of America 2004, 101(9):3236-3241.
48. Hull C.L. Principles of behavior 1943, Appleton-Century-Crofts, New York, NY.
49. Humphries M., Gurney K. The role of intra-thalamic and thalamocortical circuits in action selection. Network: Computation in Neural Systems 2002, 13:131-156.
50. Jaeger D., Gilman S., Aldridge J.W. Primate basal ganglia activity in a precued reaching task: preparation for movement. Experimental Brain Research 1993, 95(1):51-64.
51. Jay M.F., Sparks D.L. Sensorimotor integration in the primate superior colliculus. I. Motor convergence. Journal of Neurophysiology 1987, 57(1):22-34.
52. Jeannerod M. Visuomotor channels: their integration in goal-directed prehension. Human Movement Science 1999, 18(2-3):201-218.
53. Joel D., Niv Y., Ruppin E. Actor-critic models of the basal ganglia: new anatomical and computational perspectives. Neural Networks 2002, 15(4-6):535-547.
54. Kakade S., Dayan P. Dopamine: generalization and bonuses. Neural Networks 2002, 15(4-6):549-559.
55. Kandel E.R., Schwartz J.H., Jessell T.M. Principles of neural science 2000, McGraw-Hill, New York, USA. 4th ed.
56. Kish G. Learning when the onset of illumination is used as the reinforcing stimulus. Journal of Comparative and Physiological Psychology 1955, 48(4):261-264.
57. Kumaran D., Maguire E.A. Which computational mechanisms operate in the hippocampus during novelty detection?. Hippocampus 2007, 17(9):735-748.
58. Leblois A., Boraud T., Meissner W., Bergman H., Hansel D. Competition between feedback loops underlies normal and pathological dynamics in the basal ganglia. Journal of Neuroscience 2006, 26(13):3567-3583.
59. Lieberman D.A. Learning: behavior and cognition 1993, Brooks, Cole Publishing Company, Pacific Grove, CA. 2nd ed.
60. Lisman J.E., Grace A.A. The hippocampal-vta loop: controlling the entry of information into long-term memory. Neuron 2005, 46(5):703-713.
61. Luppino G., Rizzolatti G. The organization of the frontal motor cortex. News in Physiological Sciences 2000, 15:219-224.
62. Mannella F., Mirolli M., Baldassarre G. The interplay of pavlovian and instrumental processes in devaluation experiments: a computational embodied neuroscience model tested with a simulated rat. Modelling perception with artificial neural networks 2010, Cambridge University Press, Cambridge. C. Tosh, G. Ruxton (Eds.).
63. May P.J., McHaffie J.G., Stanford T.R., Jiang H., Costello M.G., Coizet V. Tectonigral projections in the primate: a pathway for pre-attentive sensory input to midbrain dopaminergic neurons. European Journal of Neuroscience 2009, 29(3):575-587.
64. Middleton F.A., Strick P.L. Basal-ganglia 'projections' to the prefrontal cortex of the primate. Cerebral Cortex 2002, 12(9):926-935.
65. Miller E.K., Cohen J.D. An integrative theory of prefrontal cortex function. Annual Review of Neuroscience 2001, 24:167-202.
66. Mirolli, M., & Baldassarre, G. (0000). Functions and mechanisms of intrinsic motivations. In G. Baldassarre and M. Mirolli (Eds.), Intrinsically motivated learning in natural and artificial systems. Berlin: Springer-Verlag (in press).
67. Mirolli, M., Baldassarre, G., & Santucci, V. G. (0000). Phasic dopamine as a prediction error of intrinsic and extrinsic reinforcement driving both action acquisition and reward maximization: a simulated robotic study. Neural Networks (submitted for publication).
68. Mirolli M., Mannella F., Baldassarre G. The roles of the amygdala in the affective regulation of body, brain, and behaviour. Connection Science 2010, 22(3):215-245.
69. Mishkin M., Ungerleider L.G. Contribution of striate inputs to the visuospatial functions of parieto-preoccipital cortex in monkeys. Behavioural Brain Research 1982, 6(1):57-77.
70. Nambu A., Tokuno H., Takada M. Functional significance of the cortico-subthalamo-pallidal 'hyperdirect' pathway. Neuroscience Research 2002, 43(2):111-117.
71. Otani S., Daniel H., Roisin M.-P., Crepel F. Dopaminergic modulation of long-term synaptic plasticity in rat prefrontal neurons. Cerebral Cortex 2003, 13(11):1251-1256.
72. Oudeyer P.-Y., Kaplan F. What is intrinsic motivation? A typology of computational approaches. Frontiers in Neurorobotics 2007, 1:6.
73. Oudeyer P., Kaplan F., Hafner V. Intrinsic motivation systems for autonomous mental development. IEEE Transactions on Evolutionary Computation 2007, 11(2):265-286.
74. Panksepp J. Affective neuroscience: the foundations of human and animal emotions 1998, Oxford University Press, Oxford.
75. Pennartz C.M.A., Ito R., Verschure P.F.M.J., Battaglia F.P., Robbins T.W. The hippocampal-striatal axis in learning, prediction and goal-directed behavior. Trends in Neurosciences 2011, 34(10):548-559.
76. Pitkänen A., Savander V., LeDoux J.E. Organization of intra-amygdaloid circuitries in the rat: an emerging framework for understanding functions of the amygdala. Trends in Neurosciences 1997, 20(11):517-523.
77. Redgrave P., Gurney K. The short-latency dopamine signal: a role in discovering novel actions?. Nature Reviews Neuroscience 2006, 7(12):967-975.
78. Redgrave P., Prescott T.J., Gurney K. The basal ganglia: a vertebrate solution to the selection problem?. Neuroscience 1999, 89(4):1009-1023.
79. Redgrave P., Vautrelle N., Reynolds J.N.J. Functional properties of the basal ganglia's re-entrant loop architecture: selection and reinforcement. Neuroscience 2011, 198:138-151.
80. Reynolds J.N.J., Wickens J.R. Dopamine-dependent plasticity of corticostriatal synapses. Neural Networks 2002, 15(4-6):507-521. PMID: 12371508.
81. Rizzolatti G., Fogassi L., Gallese V. Motor and cognitive functions of the ventral premotor cortex. Current Opinion in Neurobiology 2002, 12(2):149-154.
82. Rizzolatti G., Matelli M. Two different streams form the dorsal visual system: anatomy and functions. Experimental Brain Research 2003, 153(2):146-157.
83. Rolls E.T., Treves A. Neural networks and brain function 1998, Oxford University Press, Oxford.
84. Romanelli P., Esposito V., Schaal D.W., Heit G. Somatotopy in the basal ganglia: experimental and clinical evidence for segregated sensorimotor channels. Brain Research Reviews 2005, 48:112-128.
85. Santucci V.G., Baldassarre G., Mirolli M. Biological cumulative learning through intrinsic motivations: a simulated robotic study on development of visually-guided reaching. Proceedings of the tenth international conference on epigenetic robotics 2010, 121-128. Lund University, Lund, Sweden. B. Johansson, E. Sahin, C. Balkenius (Eds.).
86. Sara S.J. The locus coeruleus and noradrenergic modulation of cognition. Nature Reviews Neuroscience 2009, 10(3):211-223.
87. Sara S.J., Vankov A., Hervé A. Locus coeruleus-evoked responses in behaving rats: a clue to the role of noradrenaline in memory. Brain Research Bulletin 1994, 35(5-6):457-465.
88. Schembri M., Mirolli M., Baldassarre G. Evolution and learning in an intrinsically motivated reinforcement learning robot. Lecture notes in artificial intelligence 2007, Vol. 4648:294-333. Springer-Verlag, Berlin. L.M. Rocha, F. Almeida e Costa, I. Harvey, A. Coutinho (Eds.).
89. Schembri, M., Mirolli, M., & Baldassarre, G. (2007b). Evolving childhood's length and learning parameters in an intrinsically motivated reinforcement learning robot, L. Berthouze, P.G. Dhristiopher, M. Littman, H. Kozima, C. Balkenius, In Proceedings of the seventh international conference on epigenetic robotics, vol. 134, Lund, Lund University (pp. 141-148).
90. Schembri M., Mirolli M., Baldassarre G. Evolving internal reinforcers for an intrinsically motivated reinforcement-learning robot. Proceedings of the 6th international conference on development and learning 2007, E1-E6. IEEE, Piscataway, NJ. Y. Demiris, D. Mareschal, B. Scassellati, J. Weng (Eds.).
91. Schmidhuber, J. (1991a). Curious model-building control systems. In Proceedings of the international joint conference on neural networks. Vol. 2 (pp. 1458-1463).
92. Schmidhuber J. A possibility for implementing curiosity and boredom in model-building neural controllers. Proceedings of the international conference on simulation of adaptive behavior: from animals to animats 1991, 222-227. MIT Press/Bradford Books, Cambridge, MA. J.A. Meyer, S.W. Wilson (Eds.).
93. Schmidhuber, J. (1999). Artificial curiosity based on discovering novel algorithmic predictability through coevolution. In Evolutionary computation, 1999. CEC 99. Proceedings of the 1999 congress on, Vol. 3.
94. Schmidhuber J. Formal theory of creativity, fun, and intrinsic motivation (1990-2010). IEEE Transactions on Autonomous Mental Development 2010, 2(3):230-247.
95. Schultz W. Predictive reward signal of dopamine neurons. Journal of Neurophysiology 1998, 80:1-27.
96. Schultz W. Dopamine signals for reward value and risk: basic and recent data. Behavioral and Brain Functions 2010, 6(1):24.
97. Shah A., Gurney K. Dopamine-mediated action discovery promotes optimal behavior for free. BMC Neuroscience 2011, 12(Suppl 1):P138.
98. Shen W., Flajolet M., Greengard P., Surmeier D.J. Dichotomous dopaminergic control of striatal synaptic plasticity. Science 2008, 321(5890):848-851. (New York, NY).
99. Shepherd G., Grillner S. Handbook of brain microcircuits 2010, Oxford University Press, Oxford.
100. Simon O., Mangin J.F., Cohen L., Bihan D.L., Dehaene S. Topographical layout of hand, eye, calculation, and language-related areas in the human parietal lobe. Neuron 2002, 33(3):475-487.
101. Singh S., Barto A.G., Chentanez N. Intrinsically motivated reinforcement learning. Advances in neural information processing systems 17: proceedings of the 2004 conference 2005, The MIT Press, Cambridge, MA. L.K. Saul, Y. Weiss, L. Bottou (Eds.).
102. Singh S., Lewis R.L., Barto A.G., Sorg J. Intrinsically motivated reinforcement learning: an evolutionary perspective. IEEE Transactions on Autonomous Mental Development 2010, 2(2):70-82.
103. Skinner B. The behavior of organisms 1938, Appleton-Century-Crofts, New York, NY.
104. Smith Y., Raju D.V., Pare J.-F., Sidibe M. The thalamostriatal system: a highly specific network of the basal ganglia circuitry. Trends in Neurosciences 2004, 27(9):520-527.
105. Snyder L.H., Batista A.P., Andersen R.A. Intention-related activity in the posterior parietal cortex: a review. Vision Research 2000, 40(10-12):1433-1441.
106. Sparks D.L. Translation of sensory signals into commands for control of saccadic eye movements: role of primate superior colliculus. Physiological Reviews 1986, 66(1):118-171.
107. Sutton R.S., Barto A.G. Reinforcement learning: an introduction 1998, The MIT Press, Cambridge MA.
108. Taffoni, F., Formica, D., Schiavone, M., Scorcia, G., Tomasetti, A., & Polizzi di Sorrentino, E. (0000). The mechatronic board: a tool to study intrinsic motivations in humans, monkeys, and humanoid robots. In G. Baldassarre and M. Mirolli (Eds.). Intrinsically motivated learning in natural and artificial systems. Berlin: Springer-Verlag (in press).
109. Taffoni F., Vespignani M., Formica D., Cavallo G., Polizzi di Sorrentino E., Sabbatini G., et al. A mechatronic platform for behavioural analysis of non human primates. Journal of Integrative Neuroscience 2012, 11(1):87-101.
110. Trappenberg T.P. Fundamentals of computational neuroscience 2010, Oxford University Press, Oxford. 2nd ed.
111. von Hofsten C. Eye-hand coordination in newborns. Developmental Psychology 1982, 18(3):450-461.
112. Voorn P., Vanderschuren L.J.M.J., Groenewegen H.J., Robbins T.W., Pennartz C.M.A. Putting a spin on the dorsal-ventral divide of the striatum. Trends in Neurosciences 2004, 27(8):468-474.
113. Wallis J.D. Orbitofrontal cortex and its contribution to decision-making. Annual Review of Neuroscience 2007, 30:31-56.
114. White R.W. Motivation reconsidered: the concept of competence. Physiological Reviews 1959, 66:297-333.
115. Wickens J.R. Synaptic plasticity in the basal ganglia. Behavioural Brain Research 2009, 199(1):119-128.
116. Wickens J.R., Reynolds J.N.J., Hyland B.I. Neural mechanisms of reward-related motor learning. Current Opinion in Neurobiology 2003, 13(6):685-690.
117. Willshaw D.J., von der Malsburg C. How patterned neural connections can be set up by self-organization. Proceedings of the Royal Society of London B Biological Sciences 1976, 194(1117):431-445.
118. Wilson H., Cowan J. Excitatory and inhibitory interactions in localized populations of model neurons. Biophysical Journal 1972, 12(1):1-24.
119. Wise S.P., Boussaoud D., Johnson P.B., Caminiti R. Premotor and parietal cortex: corticocortical connectivity and combinatorial computations. Annual Review of Neuroscience 1997, 20:25-42.
120. Wurtz R.H., Albano J.E. Visual-motor function of the primate superior colliculus. Annual Review of Neuroscience 1980, 3:189-226.
121. Yeterian E.H., Pandya D.N., Tomaiuolo F., Petrides M. The cortical connectivity of the prefrontal cortex in the monkey brain. Cortex 2011, 48(1):58-81.
122. Yin H.H., Knowlton B.J. The role of the basal ganglia in habit formation. Nature Reviews Neuroscience 2006, 7:464-476.
123. Yu A., Dayan P. Expected and unexpected uncertainty: ACh and NE in the neocortex. Advances in neural information processing systems 15: proceedings of the 2002 conference 2003, 157-164. The MIT Press, Cambridge, MA.