Mental imagery in the navigation domain: A computational model of sensory-motor simulation mechanisms

Adaptive Behavior

Volumn 21, Issue 4, 2013, Pages 251-262

  Chersi, Fabian ^a   Donnarumma, Francesco ^a   Pezzulo, Giovanni ^a,b  

^a INSTITUTE OF COGNITIVE SCIENCES AND TECHNOLOGIES   (Italy)

^b CNR   (Italy)

Author keywords

forward sweeps; hippocampus; Mental simulations; neural network; sensory motor transformations; ventral striatum

Indexed keywords

EID: 84881050188     PISSN: 10597123     EISSN: 17412633     Source Type: Journal    
DOI: 10.1177/1059712313488789     Document Type: Article

References (51)

1. Antzoulatos E. G.,Miller E. K.Differences between neural activity in prefrontal cortex and striatum during learning of novel abstract categories.Neuron. 2011;71 (2): 243-249.
2. Bar M.The proactive brain: Memory for predictions.Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences. 2009;364 (1521): 1235-1243.
3. Buckner R. L.,Carroll D. C.Self-projection and the brain.Trends in Cognitive Sciences. 2007;11 (2): 49-57.
4. Butz M. V.,Shirinov E.,Reif K. L.Self-organizing sensorimotor maps plus internal motivations yield animal-like behavior.Adaptive Behavior. 2010;18 (3-4): 315-337.
5. Chersi F.,Pezzulo G.Using hippocampal-striatal loops for spatial navigation and goal-directed decision-making.Cognitive Processing. 2012;13:S125-129.
6. Corbit L. H.,Balleine B. W.The role of prelimbic cortex in instrumental conditioning.Behavioural Brain Research. 2003;146:145-157.
7. Daw N. D.,Niv Y.,Dayan P.Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control.Nature Neuroscience. 2005;8 (12): 1704-1711.
8. Dayan P.,Abbott L. F.Theoretical Neuroscience. Computational and Mathematical Modelling of Neural Systems. Cambridge, MA: MIT Press; 2001:.
9. Dragoi G.,Tonegawa S.Preplay of future place cell sequences by hippocampal cellular assemblies.Nature. 2011;469 (7330): 397-401.
10. Erdem U. M.,Hasselmo M.A goal-directed spatial navigation model using forward trajectory planning based on grid cells.The European Journal of Neuroscience. 2012;35 (6): 916-931.
11. Floresco S. B.Dopaminergic regulation of limbic-striatal interplay.Journal of Psychiatry & Neuroscience. 2007;32 (6): 400-411.
12. Gershman S. J.,Markman A. B.,Otto A. R.Retrospective revaluation in sequential decision making: A tale of two systems.Journal of Experimental Psychology. General. 2012 2012;:.
13. Grush R.The emulation theory of representation: Motor control, imagery, and perception.The Behavioral and Brain Sciences. 2004;27 (3): 377-396.
14. Gupta A. S.,van der Meer M. A. A.,Touretzky D. S.,Redish A. D.Hippocampal replay is not a simple function of experience.Neuron. 2010;65 (5): 695-705.
15. Hassabis D.,Kumaran D.,Maguire E. A.Using imagination to understand the neural basis of episodic memory.The Journal of Neuroscience: The Official Journal of the Society for Neuroscience. 2007;27 (52): 14365-14374.
16. Hasselmo M. E.A model of episodic memory: Mental time travel along encoded trajectories using grid cells.Neurobiology of Learning and Memory. 2009;92 (4): 559-573.
17. Ivey R.,Bullock D.,Grossberg S.A neuromorphic model of spatial lookahead planning.Neural Networks: the Official Journal of the International Neural Network Society. 2011;24 (3): 257-266.
18. Jeannerod M.Motor cognition: What actions tell the self. Oxford, UK: Oxford University Press; 2006:.
19. Johnson A.,Redish A. D.Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point.The Journal of Neuroscience: The Official Journal of the Society for Neuroscience. 2007;27 (45): 12176-12189.
20. Kohonen T.Self-organizing maps. Heidelberg, Germany: Springer; 2001:.
21. Kosslyn S. M.,Ganis G.,Thompson W. L.Neural foundations of imagery.Nature Reviews Neuroscience. 2001;2 (9): 635-642.
22. Kurth-NelsonZ.RedishA. D. (2012). Modeling decision-making systems in addiction. In GutkinB.AhmedS. H. (Eds.), Computational Neuroscience of Drug Addiction (pp. 163-187). New York: Springer. Retrieved from http://link.springer.com/chapter/10.1007/978-1-4614-0751-5_6.
23. Lei G.A neuron model with fluid properties for solving labyrinthian puzzle.Biological Cybernetics. 1990;64 (1): 61-67.
24. Leutgeb S.,Leutgeb J. K.,Barnes C. A.,Moser E. I.,McNaughton B. L.,Moser M.-B.Independent codes for spatial and episodic memory in hippocampal neuronal ensembles.Science. 2005;309 (5734): 619-623.
25. Lisman J.,Redish A. D.Prediction, sequences and the hippocampus.Philosophical transactions of the Royal Society of London. Series B, Biological Sciences. 2009;364 (1521): 1193-1201.
26. Martinet L.-E.,Sheynikhovich D.,Benchenane K.,Arleo A.Spatial learning and action planning in a prefrontal cortical network model.PLoS Computational Biology. 2011;7 (5):.
27. Moulton S. T.,Kosslyn S. M.Imagining predictions: mental imagery as mental emulation.Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences. 2009;364 (1521): 1273-1280.
28. Muller R. U.,Kubie J. L.,Bostock E. M.,Taube J. S.,Quirk G. J.Brain and Space. Paillard J., ed. New York: Oxford University Press; 1991:.
29. O'Keefe J.,Dostrovsky J.The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat.Brain Research. 1971;34 (1): 171-175.
30. O'Keefe J.,Burgess N.Dual phase and rate coding in hippocampal place cells: theoretical significance and relationship to entorhinal grid cells.Hippocampus. 2005;15 (7): 853-866.
31. Packard M. G.,McGaugh J. L.Double dissociation of fornix and caudate nucleus lesions on acquisition of two water maze tasks: Further evidence for multiple memory systems.Behavioral Neuroscience. 1992;106 (3): 439-446.
32. Papale A. E.,Stott J. J.,Powell N. J.,Regier P. S.,Redish A. D.Interactions between deliberation and delay-discounting in rats.Cognitive, Affective & Behavioral Neuroscience. 2012;12 (3): 513-526.
33. Pastalkova E.,Itskov V.,Amarasingham A.,Buzsáki G.Internally generated cell assembly sequences in the rat hippocampus.Science (New York, N.Y.). 2008;321 (5894): 1322-1327.
34. Pennartz C. M. A.,Ito R.,Verschure P. F. M. J.,Battaglia F. P.,Robbins T. W.The hippocampal-striatal axis in learning, prediction and goal-directed behavior.Trends in Neurosciences. 2011;34 (10): 548-559.
35. Pezzulo G.,Butz M. V.,Castelfranchi C.,Falcone R.The challenge of anticipation - A unifying framework for the analysis and design of artificial. Berlin, Germany: Springer; 2008:.
36. Pezzulo G.,Castelfranchi C.The symbol detachment problem.Cognitive Processing. 2007;8 (2): 115-131.
37. Pezzulo G.,Rigoli F.The value of foresight: How prospection affects decision-making.Frontiers in Neuroscience. 2011;5:79.
38. Pezzulo G.,Rigoli F.,Chersi F.The mixed instrumental controller: Using value of information to combine habitual choice and mental simulation.Frontiers in Psychology. 2013;4:92.
39. Redish A. D.Cognitive search: Evolution, algorithms, and the brain. Todd P. M.Hills T. T.Robbins T. W., ed. Cambridge, MA: MIT Press; 2012:81-95.
40. Rennó-Costa C.,Lisman J. E.,Verschure P. F. M. J.The mechanism of rate remapping in the dentate gyrus.Neuron. 2010;68 (6): 1051-1058.
41. Schacter D. L.,Addis D. R.,Hassabis D.,Martin V. C.,Spreng R. N.,Szpunar K. K.The future of memory: remembering, imagining, and the brain.Neuron. 2012;76 (4): 677-694.
42. Solway A.,Botvinick M. M.Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates.Psychological Review. 2012;119 (1): 120-154.
43. Suddendorf T.,Addis D. R.,Corballis M. C.Mental time travel and the shaping of the human mind.Philosophical Transactions of the Royal Society B: Biological Sciences. 2009;364 (1521): 1317-1324.
44. Sutton R. S.Integrated architectures for learning, planning, and reacting based on approximating dynamic programming. Proceedings of the Seventh International Conference on Machine Learning; 1990Burlington, MA: Morgan Kaufmann; 1990. 216.
45. Sutton R. S.,Barto A. G.Reinforcement learning: An introduction. Cambridge, MA: MIT Press; 1998:.
46. Tolman E. C.Cognitive maps in animals and man.Psychological Review. 1948;55:189-208.
47. Toussaint M.A sensorimotor map: Modulating lateral interactions for anticipation and planning.Neural Computation. 2006;18 (5): 1132-1155.
48. Van der Meer M. A. A.,Redish A. D.Covert expectation-of-reward in rat ventral striatum at decision points.Frontiers in Integrative Neuroscience. 2009;3:1.
49. Van der Meer M. A. A.,Redish A. D.Expectancies in decision making, reinforcement learning, and ventral striatum.Frontiers in Neuroscience. 2010;4:6.
50. Voorn P.,Vanderschuren L. J.,Groenewegen H. J.,Robbins T. W.,Pennartz C. M.Putting a spin on the dorsal-ventral divide of the striatum.Trends in Neuroscience. 2004;27 (8): 468-474.
51. Yin H. H.,Knowlton B. J.The role of the basal ganglia in habit formation.Nat Rev Neurosci. 2006;7 (6): 464-476.