Multiple levels of spatial organization: World Graphs and spatial difference learning

Adaptive Behavior

Volumn 20, Issue 4, 2012, Pages 287-303

  Arbib, Michael A ^a,b   Bonaiuto, James J ^b  

^a University of Southern California ^*  (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

affordances; cognitive map; Hippocampus; navigation; reinforcement learning

Indexed keywords

RATTUS;

EID: 84864021384     PISSN: 10597123     EISSN: 17412633     Source Type: Journal    
DOI: 10.1177/1059712312449545     Document Type: Article

References (40)

1. Amari S.,Arbib M.Systems neuroscience. Metzler J., ed. New York, NY: Academic Press; 1977:119-166.
2. Arbib M. A.From visual affordances in monkey parietal cortex to hippocampo-parietal interactions underlying rat navigation.Philosophical Transactions of the Royal Society B: Biological Sciences. 1997a;352:1429-1436.
3. Arbib M. A.Handbook of neuropsychology, Volume 11, Section 16: Action and cognition. Jeannerod M., ed. Amsterdam, The Netherlands: Elsevier; 1997b:65-90.
4. Arbib M. A.,Lieblich I.Systems neuroscience. Metzler J., ed. New York, NY: Academic Press; 1977:221-239.
5. Bonaiuto J. B.,Arbib M. A.Extending the mirror neuron system model, II: What did I just do? A new role for mirror neurons.Biological Cybernetics. 2010;102:341-359.
6. Borgland S. L.,Storm E.,Bonci A.Orexin B/hypocretin 2 increases glutamatergic transmission to ventral tegmental area neurons.European Journal of Neuroscience. 2008;28:1545-1556.
7. Calton J. L.,Taube J. S.Where am I and how will I get there from here? A role for posterior parietal cortex in the integration of spatial information and route planning.Neurobiology of Learning and Memory. 2009;91:186-196.
8. Colby C. L.Action-oriented spatial reference frames in cortex.Neuron. 1998;20:15-24.
9. Dominey P. F.,Arbib M. A.A cortico-subcortical model for generation of spatially accurate sequential saccades.Cerebral Cortex. 1992;2:153-175.
10. Erlhagen W.,Schoner G.Dynamic field theory of movement preparation.Psychological Review. 2002;109:545-572.
11. Gibson J. J.The optical expansion-pattern in aerial location.American Journal of Psychology. 1955;68:480-484.
12. Goldman A.Simulating minds: The philosophy, psychology, and neuroscience of mindreading. Oxford, UK/New York, NY: Oxford University Press; 2006:.
13. Guazzelli A.,Corbacho F. J.,Bota M.,Arbib M. A.Affordances, motivation, and the World Graph Theory.Adaptive Behavior. 1998;6:435-471.
14. Guazzelli A.,Bota M.,Arbib M.A.Competitive Hebbian learning and the hippocampal place cell system: modeling the interaction of visual and path integration cues.Hippocampus. 2001;11 (3): 216-239.
15. Lieblich I.,Arbib M. A.Multiple representations of space underlying behavior.The Behavioral and Brain Sciences. 1982;5:627-659.
16. McNaughton B. L.,Leonard B.,Chen L.Cortical-hippocampal interactions and cognitive mapping: A hypothesis based on reintegration of the parietal and inferotemporal pathways for visual processing.Psychobiology. 1989;17:236-246.
17. McNaughton B. L.,Mizumori S. J.,Barnes C. A.,Leonard B. J.,Marquis M.,Green E. J.Cortical representation of motion during unrestrained spatial navigation in the rat.Cerebral Cortex. 1994;4:27-39.
18. Mel B.Synaptic integration in an excitable dendritic tree.Journal of Neurophysiology. 1993;70:1086-1101.
19. Milford M.,Schulz R.,Prasser D.,Wyeth G.,Wiles J.Learning spatial concepts from RatSLAM representations.Robotics and Autonomous Systems - From Sensors to Human Spatial Concepts. 2007;55:403-410.
20. Milford M.,Wyeth G.Persistent navigation and mapping using a biologically inspired SLAM system.The International Journal of Robotics Research. 2010;29:1131-1153.
21. Milford M.,Wyeth G.,Prasser D.IEEE International Conference on Robotics and Automation; 2004New Orleans, USA; 2004. 403.
22. Nitz D.Parietal cortex, navigation, and the construction of arbitrary reference frames for spatial information.Neurobiology of Learning and Memory. 2009;91:179-185.
23. O'Keefe J.Neurobiology of the Hippocampus. Seifert W., ed. New York, NY: Academic Press; 1983:375-403.
24. O'Keefe J.,Dostrovsky J.The hippocampus as a spatial map: Preliminary evidence from unit activity in the freely moving rat.Brain Research. 1971;34:171-175.
25. O'Keefe J.,Nadel L.The hippocampus as a cognitive map. Oxford, UK: Oxford University Press; 1978:.
26. Pan W. X.,Schmidt R.,Wickens J. R.,Hyland B. I.Dopamine cells respond to predicted events during classical conditioning: Evidence for eligibility traces in the reward-learning network.Journal of Neuroscience. 2005;25:6235-6242.
27. Sakurai T.Roles of orexins and orexin receptors in central regulation of feeding behavior and energy homeostasis.CNS & Neurological Disorders-Drug Targets. 2006;5:313-325.
28. Salinas E.,Abbott L.A model of multiplicative neural responses in parietal cortex.Proceedings of the National Academy of Sciences of the USA. 1996;93:11956-11961.
29. Save E.,Paz-Villagran V.,Alexinsky T.,Poucet B.Functional interaction between the associative parietal cortex and hippocampal place cell firing in the rat.European Journal of Neuroscience. 2005;21:522-530.
30. Singh S. P.,Sutton R. S.Reinforcement learning with replacing eligibility traces.Machine Learning. 1996;22:123-158.
31. Srinivasan M. V.,Zhang S.,Altwein M.,Tautz J.Honeybee navigation: Nature and calibration of the "odometer".Science. 2000;287:851-853.
32. SuttonR. S. (1984). Temporal credit assignment in reinforcement learning. Doctoral dissertation, Computer and Information Science, University of Massachusetts.
33. Sutton R. S.,Barto A. G.Reinforcement learning: An introduction. Cambridge, MA: The MIT Press; 1998:.
34. Swanson L.,Mogenson G.Neural mechanisms for the functional coupling of automatic endocrine and somatomotor responses in adaptive behavior.Brain Research Reviews. 1981;3:1-34.
35. Swanson L. W.Cerebral hemisphere regulation of motivated behavior.Brain Research. 2000;886:113-164.
36. Swanson L. W.Anatomy of the soul as reflected in the cerebral hemispheres: Neural circuits underlying voluntary control of basic motivated behaviors.Journal of Comparative Neurology. 2005;493:122-131.
37. Vittoz N. M.,Berridge C. W.Hypocretin/orexin selectively increases dopamine efflux within the prefrontal cortex: Involvement of the ventral tegmental area.Neuropsychopharmacology. 2006;31:384-395.
38. Voicu H.,Schmajuk N.Exploration, navigation and cognitive mapping.Adaptive Behavior. 2000;8:207-223.
39. Weitzenfeld A.,Arbib M. A.,Alexander A.The neural simulation language: A system for brain modeling. Cambridge, MA: The MIT Press; 2002:.
40. Wu S.,Amari S.,Nakahara H.Population coding and decoding in a neural field: A computational study.Neural Computation. 2002;14:999-1026.