The neuroscience of learning: Beyond the hebbian synapse

Annual Review of Psychology

Volumn 64, Issue , 2013, Pages 169-200

  Gallistel, C R ^a   Matzel, Louis D ^b  

^a RUTGERS UNIVERSITY   (United States)

^b RUTGERS UNIVERSITY   (United States)

Author keywords

Bayesian inference; cognitive map; geometric module; information theory; LTP; spatial learning

Indexed keywords

EID: 84872438390     PISSN: 00664308     EISSN: 15452085     Source Type: Book Series    
DOI: 10.1146/annurev-psych-113011-143807     Document Type: Review

References (185)

1. Abraham WC. 2003. How long will long-term potentiation last? Philos. Trans. R. Soc. Lond. B Biol. Sci. 358(1432):735-44 (Pubitemid 36536704)
2. Andersen RA, Essick GK, Siegel RM. 1985. Encoding of spatial location by posterior parietal neurons. Science 230:456-58 (Pubitemid 16192560)
3. Angelaki DE, Yakusheva TA, Green AM, Dickman JD, Blazquez PM. 2010. Computation of egomotion in the macaque cerebellar vermis. Cerebellum 9:174-82
4. Antle MC, Silver R. 2005. Orchestrating time: Arrangements of the brain circadian clock. Trends Neurosci. 28:145-51 (Pubitemid 40320760)
5. Arcediano F, Escobar M, Miller RR. 2003. Temporal integration and temporal backward associations in humans and nonhuman subjects. Learn. Behav. 31:242-56 (Pubitemid 37214579)
6. Baird AL, Putter JE, Muir JL, Aggleton JP. 2004. On the transience of egocentric working memory: evidence from testing the contribution of limbic brain regions. Behav. Neurosci. 118:785-97 (Pubitemid 38970499)
7. Balsam PD, Drew MR, Gallistel CR. 2010. Time and associative learning. Comp. Cogn. Behav. Rev. 5:1-22
8. Balsam PD, Fairhurst S, Gallistel CR. 2006. Pavlovian contingencies and temporal information. J. Exp. Psychol. : Anim. Behav. Proc. 32:284-94 (Pubitemid 44157638)
9. Balsam PD, Gallistel CR. 2009. Temporal maps and informativeness in associative learning. Trends Neurosci. 32:73-78
10. Barnet RC, Grahame NJ, Miller RR. 1996. Temporal encoding as a determinant of inhibitory control. Learn. Motiv. 27:73-91 (Pubitemid 126159588)
11. Beck JM, Latham P, Pouget A. 2011. Marginalization in neural circuits with divisive normalization. J. Neurosci. 31:15310-19
12. Bermudez MA, Schultz W. 2010. Responses of amygdala neurons to positive reward-predicting stimuli depend on background reward (contingency) rather than stimulus-reward pairing (contiguity). J. Neurophysiol. 103:1158-70
13. Berridge KC. 2012. From prediction error to incentive salience: mesolimbic computation of rewardmotivation. Eur. J. Neurosci. 35:1124-43
14. Biegler R. 2000. Possible uses of path integration in animal navigation. Anim. Learn. Behav. 25:257-77
15. Blair HT, Sharp PE. 1996. Visual and vestibular influences on head-direction cells in the anterior thalamus of the rat. Behav. Neurosci. 110:643-60 (Pubitemid 26262442)
16. Blaisdell AP, Denniston JC, Miller RR. 1998. Temporal encoding as a determinant of overshadowing. J. Exp. Psychol. : Anim. Behav. Proc. 24:72-83 (Pubitemid 128738260)
17. Bouton ME, Garcia-Gutierrez A. 2006. Intertrial interval as a contextual stimulus. Behav. Proc. 71:307-17 (Pubitemid 43163027)
18. Britten KH. 2008. Mechanism of self-motion perception. Annu. Rev. Neurosci. 31:389-410
19. Brooks RA. 1991. Intelligence without representation. Artif. Intell. 47:139-59
20. Brun VH, Solstad T, Kjelstrup KB, Fyhn M, Witter MP, et al. 2008. Progressive increase in grid scale from dorsal to ventral medial entorhinal cortex. Hippocampus 18:1200-12
21. Budzynski CA, Bingman VP. 1999. Time-of-day discriminative learning in homing pigeons, Columbia livia. Anim. Learn. Behav. 27:295-301
22. Buhusi CV, Meck WH. 2005. What makes us tick? Functional and neural mechanisms of interval timing. Nat. Rev. Neurosci. 6:755-65 (Pubitemid 41679238)
23. Burger DC, Denniston JC, Miller RR. 2001. Temporal coding in conditioned inhibition: retardation tests. Anim. Learn. Behav. 29:281-90 (Pubitemid 34746717)
24. Burgess N. 2008. Spatial cognition and the brain. Ann. N. Y. Acad. Sci. 1124:77-97 (Pubitemid 351506780)
25. Cajal SR. 1894. La fine structure des centres nerveux. Proc. R. Soc. Lond. 55:444-68
26. Caporale N, Dan Y. 2008. Spike timing-dependent plasticity: A Hebbian learning rule. Annu. Rev. Neurosci. 31:25-46
27. Carr H. 1917. Maze studies with the white rat. J. Anim. Behav. 7:259-306
28. Cartwright BA, Collett TS. 1983. Landmark learning in bees: experiments and models. J. Comp. Physiol. A 151:521-43
29. Castro CA, Silbert LH, McNaughton BL, Barnes CA. 1989. Recovery of spatial learning deficits following decay of electrically-induced synaptic enhancement in the hippocampus. Nature 342:545-58
30. Chater N, Tenenbaum JB, Yuille A. 2006. Probabilistic models of cognition: conceptual foundations. Trends Cogn. Sci. 10:287-91 (Pubitemid 44094229)
31. Chemero A. 2011. Radical Embodied Cognitive Science. Cambridge, MA: MIT Press
32. Cheng K. 1986. A purely geometric module in the rat's spatial representation. Cognition 23:149-78
33. Cheng K. 2008. Whither geometry? Troubles of the geometric module. Trends Cogn. Sci. 12:355-61
34. Cheng K, Newcombe NS. 2005. Is there a geometric module for spatial orientation? Squaring theory and evidence. Psychon. Bull. Rev. 12:1-23 (Pubitemid 40900491)
35. Cheng K, Shettleworth SJ, Huttenlocher J, Rieser JJ. 2007. Bayesian integration of spatial information. Psychol. Bull. Rev. 133:625-37
36. Cheng S, Frank LM. 2011. The structure of networks that produce the transformation from grid cells to place cells. J. Neurosci. 197:293-306
37. Cheung A, Vickerstaff R. 2010. Finding the way with a noisy brain. PLoS Comput. Biol. 6:e1000992
38. Cheung A, Zhang S, Stricker C. 2008. Animal navigation: general properties of directed walks. Biol. Cybern. 99:197-217
39. Chomsky N. 1975. Reflections on Language. New York: Pantheon
40. Clark B, Taube JS. 2009. Deficits in landmark navigation and path integration after lesions of the interpeduncular nucleus. Behav. Neurosci. 123:490-503
41. Cole RP, Barnet RC, Miller RR. 1995. Temporal encoding in trace conditioning. Anim. Learn. Behav. 23:144-53
42. Colgin LL, Moser EI, Moser M-B. 2008. Understanding memory through hippocampal remapping. Trends Neurosci. 31:469-77
43. Collett M, Collett TS. 2009a. The learning and maintenance of local vectors in desert ant navigation. J. Exp. Biol. 212:895-900
44. Collett M, Collett TS. 2009b. Local and global navigational coordinate systems in desert ants. J. Exp. Biol. 212:901-5
45. Collett TS, Collett M. 2004. How do insects represent familiar terrain? J. Physiol. Paris 98:259-64 (Pubitemid 39345376)
46. Collett TS, Fauria K, Dale K, Baron J. 1997. Places and patterns-a study of context learning in honeybees. J. Comp. Physiol. A 181:343-53 (Pubitemid 27414151)
47. Collett TS, Graham P. 2004. Animal navigation: path integration, visual landmarks and cognitive maps. Curr. Biol. 14:R475-77 (Pubitemid 38791581)
48. Collett TS, Kelber A. 1988. The retrieval of visuo-spatial memories by honeybees. J. Comp. Physiol. Ser. A 163:145-50
49. Crystal JD. 2001. Circadian time perception. J. Exp. Psychol. : Anim. Behav. Proc. 27:68-78 (Pubitemid 33775417)
50. Dayan P, Daw ND. 2008. Decision theory, reinforcement learning, and the brain. Cogn. Affect. Behav. Neurosci. 8:429-53
51. de Jonge M, Racine RJ. 1985. The effects of repeated induction of long-term potentiation in the dentate gyrus. Brain Res. 328:181-85 (Pubitemid 15146781)
52. Dennis W. 1932. Multiple visual discrimination in the block elevatedmaze. J. Comp. Physiol. Psychol. 13:391-96
53. Denniston JC, Blaisdell AP, Miller RR. 2004. Temporal coding in conditioned inhibition: Analysis of associative structure of inhibition. J. Exp. Psychol. : Anim. Behav. Proc. 30:190-202 (Pubitemid 38956338)
54. Derdikman D, Moser EI. 2010. A manifold of spatial maps in the brain. Trends Cogn. Sci. 14:561-69
55. Derdikman D, Whitlock JR, Tsao A, Fyhn M, Hafting T, et al. 2009. Fragmentation of grid cell maps in a multicompartment environment. Nat. Neurosci. 12:1325-32
56. Diba K, Buzśaki G. 2008. Hippocampal network dynamics constrain the time lag between pyramidal cells across modified environments. J. Neurosci. 28:13448-56
57. Douglas RJ. 1966. Cues for spontaneous alternation. J. Comp. Physiol. Psychol. 62:171-83
58. Dudchenko PA, Davidson M. 2002. Rats use a sense of direction to alternate on T-mazes located in adjacent rooms. Anim. Cogn. 5:115-18
59. Dudchenko PA, Zinyuk LE. 2005. The formation of cognitive maps of adjacent environments: evidence from the head direction cell system. Behav. Neurosci. 119:1511-23 (Pubitemid 43145723)
60. Durgin FH, Akagi M, Gallistel CR, Haiken W. 2009. The precision of human odometery. Exp. Brain Res. 193:429-36
61. Dyer FC, Dickinson JA. 1994. Development of sun compensation by honeybees: how partially experienced bees estimate the sun's course. Proc. Natl. Acad. Sci. USA 91:4471-74 (Pubitemid 24143455)
62. Edelman GM. 1989. Neural Darwinism. New York: Oxford Univ. Press
63. Elman JL, Zipser D. 1988. Learning the hidden structure of speech. J. Acoust. Soc. Am. 83:1615-26
64. Epstein RA. 2008. Parahippocampal and retrosplenial contributions to human spatial navigation. Trends Cogn. Sci. 12:388-96
65. Epstein RA. 2011. Cognitive neuroscience: scene layout from vision and touch. Curr. Biol. 21:R437-38
66. Etienne A, Maurer R, Saucy F, Teroni E. 1986. Short-distance homing in the golden hamster after a passive outward journey. Anim. Behav. 34:696-715
67. Fiorillo CD, Tobler CD, Schultz W. 2003. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-902 (Pubitemid 36356659)
68. Flagel SB, Clark JJ, Robinson TE, Mayo L, Czuj A, et al. 2011. Aselective role for dopamine in stimulus-reward learning. Nature 469:53-57
69. Foa A, Basaglia F, Beltrami G, Carnacina M, Moretto E, Bertolucci C. 2009. Orientation of lizards in aMorris water-maze: roles of the sun compass and the parietal eye. J. Exp. Biol. 212:2918-24
70. Frank LM, Brown EN, Wilson M. 2000. Trajectory encoding in the hippocampus and entorhinal cortex. Neuron 27:169-78
71. Fyhn M, Hafting T, Treves A, Moser M-B, Moser EI. 2007. Hippocampal remapping and grid realignment in entorhinal cortex. Nature 446:190-94 (Pubitemid 46398668)
72. Gagliardo A, Vallortigara G, Nardi D, Bingman VP. 2005. A lateralized avian hippocampus: preferential role of the left hippocampal formation in homing pigeon sun compass-based spatial learning. Eur. J. Neurosci. 22:2549-59 (Pubitemid 41758997)
73. Galletti C, Battaglini PP. 1989. Gaze-dependent visual neurons in area V3A of monkey prestriate cortex. J. Neurosci. 9:1112-25
74. Gallistel CR. 1990. The Organization of Learning. Cambridge, MA: Bradford Books/MIT Press. 648 pp.
75. Gallistel CR. 1999. The replacement of general-purpose learning models with adaptively specialized learning modules. In The Cognitive Neurosciences, ed. MS Gazzaniga, pp. 1179-91. Cambridge, MA: MIT Press. 2nd ed.
76. Gallistel CR. 2012. Extinction from a rationalist perspective. Behav. Proc. 90:66-88
77. Gallistel CR, Gibbon J. 2000. Time, rate, and conditioning. Psychol. Rev. 107:289-344
78. Gallistel CR, King AP. 2009. Memory and the Computational Brain: Why Cognitive Science Will Transform Neuroscience. New York:Wiley/Blackwell
79. Gibbon J, Balsam P. 1981. Spreading associations in time. In Autoshaping and Conditioning Theory, ed. CM Locurto, HS Terrace, J Gibbon, pp. 219-53. New York: Academic
80. Giocomo LM, Moser M-B, Moser EI. 2011. Computational models of grid cells. Neuron 71:589-603
81. Golob EJ, Taube JS. 1999. Head direction cells in rats with hippocampal or overlying neocortical lesions: evidence for impaired angular path integration. J. Neurosci. 19:7198-211 (Pubitemid 29380144)
82. Gothard KM, Skaggs WE, McNaughton BL. 1996a. Dynamics of mismatch correction in the hippocamapal ensemble code for space: interaction between path integration and environmental cues. J. Neurosci. 16:8027-40
83. Gothard KM, Skaggs WE, Moore KM, McNaughton BL. 1996b. Binding of hippocampal CA1 neural activity to multiple reference frames in a landmark-based navigation task. J. Neurosci. 16:823-35 (Pubitemid 26028838)
84. Gottlieb DA. 2008. Is the number of trials a primary determinant of conditioned responding? J. Exp. Psychol. : Anim. Behav. Proc. 34:185-201 (Pubitemid 351671858)
85. Graham M, Good MA, McGregor A, Pearce JM. 2006. Spatial learning based on the shape of the environment is influenced by properties of the objects forming the shapes. J. Exp. Psychol. : Anim. Behav. Proc. 32:44-59 (Pubitemid 43145707)
86. Griffiths TL, Chater N, Kemp C, Perfors A, Tenenbaum JB. 2010. Probabilisticmodels of cognition: exploring representations and inductive biases. Trends Cogn. Sci. 14:357-64
87. Groh JM, Trause AS, Underhill AM, Clark KR, Inati S. 2001. Eye position influences auditory responses in primate inferior colliculus. Neuron 29:509-18 (Pubitemid 32206487)
88. Gwinner E. 1996. Circadian and cirannual programmes in avian migration. J. Exp. Biol. 199:39-48 (Pubitemid 126603935)
89. Harvey CD, Coen P, Tank DW. 2012. Choice-specific sequences in parietal cortex during virtual-navigation decision task. Nature 484:62-68
90. Hebb DO. 1949. The Organization of Behavior: A Neuropsychological Theory. New York:Wiley
91. Heeger DJ. 1992. Normalization of cell responses in cat striate cortex. Vis. Neurosci. 9:181-97
92. Heinze S, Reppert SM. 2011. Sun compass integration of skylight cues in migratory monarch butterflies. Neuron 69:345-58
93. Hull CL. 1930. Knowledge and purpose as habit mechanisms. Psychol. Rev. 37:511-25
94. Hull CL. 1952. A Behavior System. New Haven, CT: Yale Univ. Press
95. Jezek K, Henriksen EJ, Treves A, Moser EI, Moser M-B. 2011. Theta-paced flickering between place-cell maps in the hippocampus. Nature 478:246-49
96. Jung MW, Wiener SI, McNaughton BL. 1994. Comparison of spatial firing characteristics of units in dorsal and ventral hippocampus of the rat. J. Neurosci. 14:7347-56 (Pubitemid 24379745)
97. Kaplan P. 1984. Importance of relative temporal parameters in trace autoshaping: from excitation to inhibition. J. Exp. Psychol. : Anim. Behav. Proc. 10:113-26
98. Kjelstrup KB, Solstad T, Brun VH, Hafting1 T, Leutgeb S, et al. 2008. Finite scale of spatial representation in the hippocampus. Science 321:140-43 (Pubitemid 351956252)
99. Komorowski RW, Manns JR, Eichenbaum H. 2009. Robust conjunctive item-place coding by hippocampal neurons parallels learning what happens where. J. Neurosci. 29:9918-29
100. Langston RF, Ainge JA, Couey JJ, Canto CB, Bjerknes TL, et al. 2010. Development of the spatial representation system in the rat. Science 328:1576-80
101. Lattal KM. 1999. Trial and intertrial durations in Pavlovian conditioning: issues of learning and performance. J. Exp. Psychol. : Anim. Behav. Proc. 25:433-50
102. Legge ELG, Spetch ML, Cheng K. 2010. Not using the obvious: Desert ants, Melophorus bagoti, learn local vectors but not beacons in an arena. Anim. Cogn. 13:849-60
103. Leutgeb S, Leutgeb JK, Barnes CA, Moser EI, McNaughton BL, MoserM-B. 2004. Distinct ensemble codes in hippocampal areas CA3 and CA1. Science 305:1295-98 (Pubitemid 39129235)
104. Leutgeb S, Leutgeb JK, Barnes CA, Moser EI, McNaughton BL, Moser M-B. 2005. Independent codes for spatial and episodic memory in hippocampal neuronal ensembles. Science 309:619-23 (Pubitemid 41033647)
105. Jeewajee A, O'Keefe J, Burgess N. 2009. Boundary vector cells in the subiculum of the hippocampal formation. J. Neurosci. 29:9771-77
106. Loomis JM, Klatzky RL, Golledge RG, Philbeck JW. 1998. Humannavigation by path integration. In Wayfinding: CognitiveMapping and Spatial Behavior, ed. RG Golledge, pp. 121-51. Baltimore, MD: Johns Hopkins Univ. Press
107. MacDonald CJ, Lepage KQ, Eden UT, Eichenbaum H. 2011. Hippocampal "time cells" bridge the gap in memory for discontiguous events. Neuron 71:737-49
108. MacEvoy SP, Epstein RA. 2011. Constructing scenes from objects in human occipitotemporal cortex. Nat. Neurosci. 14:1323-29
109. Manns J, Eichenbaum H. 2009. A cognitive map for objectmemory in the hippocampus. Learn. Mem. 16:616-24
110. Margules J, Gallistel CR. 1988. Heading in the rat: determination by environmental shape. Anim. Learn. Behav. 16:404-10
111. Markman AB, Dietrich E. 2000. In defense of representation. Cogn. Psychol. 40:138-71
112. Markus EJ, Qin Y-L, Beonard B, Skaggs WE, McNaughton BL, Barnes CA. 1995. Interactions between location and task affect the spatial and directional firing of hippocampal neurons. J. Neurosci. 15:7079-94
113. Marr D. 1982. Vision. San Francisco, CA: Freeman
114. Martin SJ, Grimwood PD, Morris RGM. 2000. Synaptic plasticity and memory: An evaluation of the hypothesis. Annu. Rev. Neurosci. 23:649-711 (Pubitemid 30350057)
115. Martin SJ, Morris RGM. 2002. New life in an old idea: The synaptic plasticity and memory hypothesis revisited. Hippocampus 12:609-36 (Pubitemid 35363956)
116. Matzel LD, Held FP, Miller RR. 1988. Information and expression of simultaneous and backward associations: implications for contiguity theory. Learn. Motiv. 19:317-44
117. Matzel LD, Shors TJ. 2001. Long-term potentiation and associative learning: Can the mechanism subserve the process? In Neuronal Mechanisms of Memory Formation: Concepts of Long-Term Potentiation and Beyond, ed. C Holshcer, pp. 294-324. London: Cambridge Univ. Press
118. McNaughton BL, Barnes CA, Gerrard JL, Gothard K, Jung MW, et al. 1996. Deciphering the hippocamapal polyglot: The hippocampus as a path integration system. J. Exp. Biol. 199:173-85 (Pubitemid 126603950)
119. McNaughton BL, Battaglia FP, Jensen O, Moser EI, Moser M-B. 2006. Path integration and the neural basis of the "cognitive map. " Nat. Rev. Neurosci. 7:663-78 (Pubitemid 44106748)
120. Meck WH, ed. 2003. Functional and Neural Mechanisms of Interval Timing. New York: CRC
121. Menzel R, Greggers U, Smith A, Berger S, Brandt R, et al. 2005. Honey bees navigate according to a map-like spatial memory. Proc. Natl. Acad. Sci. USA 102:3040-45 (Pubitemid 40299912)
122. Merkle T, Wehner JM. 2008. Landmark guidance and vector navigation in outbound desert ants. J. Exp. Biol. 211:3370-77
123. Miller RR, Kasprow WJ, Schachtman TR. 1986. Retrieval variability: sources and consequences. Am. J. Psychol. 99:145-218
124. Mittelstaedt ML, Mittelstaedt H. 1980. Homing by path integration in a mammal. Naturwissenschaften 67:566-67
125. Morgan LK, MacEvoy SP, Aguirre GK, Epstein RA. 2010. Distances between real-world locations are represented in the human hippocampus. J. Neurosci. 31:1238-45
126. Moser EI, Kripff E, Moser M-B. 2008. Place cells, grid cells, and the brain's spatial representation system. Annu. Rev. Neurosci. 31:69-89
127. Muller RU, Kubie JL. 1987. The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells. J. Neurosci. 7:1951-68 (Pubitemid 17114920)
128. Napier RM, Macrae M, Kehoe EJ. 1992. Rapid reacquisition in conditioning of the rabbit's nictitating membrane response. J. Exp. Psychol. : Anim. Behav. Proc. 18:182-92
129. O'Keefe J, Speakman A. 1987. Single unit activity in the rat hippocampus during a spatial memory task. Exp. Brain Res. 68:1-27 (Pubitemid 17153678)
130. O'Keefe JO, Conway DH. 1978. Hippocampal place units in the freely moving rat: why they fire where they fire. Exp. Brain Res. 31:573-90 (Pubitemid 8308505)
131. Olsen SR, Bhandawat V, Wilson RI. 2010. Divisive normalization in olfactory population codes. Neuron 66:287-99
132. Pearce JM, Graham M, Good MA, Jones PM, McGregor A. 2006. Potentiation, overshadowing, and blocking of spatial learning based on the shape of the environment. J. Exp. Psychol. : Anim. Behav. Proc. 32:201-14 (Pubitemid 44157632)
133. Power JM, Thompson LT, Moyer JR, Disterhoft JF. 1997. Enhanced synaptic transmission in CA1 hippocampus after eyeblink conditioning. J. Neurophysiol. 78:1184-87 (Pubitemid 27353580)
134. Quinn WG. 2005. Nematodes learn: Now what? Nat. Neurosci. 8:1639-40 (Pubitemid 41683186)
135. Quirk GJ, Muller RU, Kubie JL. 1990. The firing of hippocampal place cells in the dark depends on the rat's recent experience. J. Neurosci. 10:2008-17
136. Redish AD, Jensen S, Johnson A, Kurth-Nelson A. 2007. Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. Psychol. Rev. 114:784-805
137. Redish AD, Rosenzweig ES, Bohanick JD, McNaughton BL, Barnes CA. 2000. Dynamics of hippocampal ensemble activity realignment: time versus space. J. Neurosci. 20:9298-309 (Pubitemid 32042934)
138. Rescorla RA. 1967. Pavlovian conditioning and its proper control procedures. Psychol. Rev. 74:71-80
139. Rescorla RA. 1968. Probability of shock in the presence and absence of CS in fear conditioning. J. Comp. Physiol. Psychol. 66:1-5
140. Rieke F, Warland D, deRuyter van Steveninck R, Bialek W. 1997. Spikes: Exploring theNeuralCode. Cambridge, MA: MIT Press. 395 pp.
141. Rivard B, Lenck-Santini PP, Poucet B, Muller RU. 2004. Representation of objects in space by two classes of hippocampal pyramidal cells. J. Gen. Physiol. 124:9-25 (Pubitemid 38931927)
142. Rochefort C, Arabo A, Andŕe M, Poucet B, Save E, Rondi L. 2011. Cerebellum shapes hippocampal spatial code. Science 334:385-89
143. Rumelhart DE.,McClelland JL . 1986.Parallel Distributed Processing. Cambridge, MA: MIT Press
144. Russell NA, Horii A, Smith PF, Darlington CL, Bilkey DK. 2003. Long-term effects of permanent vestibular lesions on hippocampal spatial firing. J. Neurosci. 23:6490-98 (Pubitemid 36909875)
145. Sauman I, Briscoe AD, Zhu H, Shi D, Froy O, et al. 2005. Connecting the navigational clock to sun compass input in monarch butterfly brain. Neuron 46:457-67 (Pubitemid 40616889)
146. Savastano HI, Miller RR. 1998. Time as content in Pavlovian conditioning. Behav. Proc. 44:147-62 (Pubitemid 29050814)
147. Save E, Cressant A, Thinus-Blanc C, Poucet B. 1998. Spatial firing of hippocampal place cells in blind rats. J. Neurosci. 18:1818-26 (Pubitemid 28103089)
148. Schultz W. 2006. Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol. 57:87-115 (Pubitemid 43237228)
149. Shannon CE. 1948. A mathematical theory of communication. Bell Syst. Tech. J. 27:379-423, 623-56
150. Shapiro ML, Tanila H, Eichenbaum H. 1997. Cues that hippocampal place cells encode: dynamic and hierarchical representation of local and distal stimuli. Hippocampus 7:624-42 (Pubitemid 28021648)
151. Sharp PE, Blair HT, Etkin D, Tzanetos DB. 1995. Influences of vestibular and visual motion information on the spatial firing patterns of hippocampal place cells. J. Neurosci. 15:173-89
152. Shastri L, Ajjanagadde V. 1993. From simple associations to systematic reasoning: A connectionist representation of rules, variables, and dynamic bindings using temporal synchrony. Behav. Brain Sci. 16:417-94
153. Sheynikhovich D, Chavarriaga R, Str össlin T, Arleo A, Gerstner W. 2009. Is there a geometric module for spatial orientation? Insights from a rodent navigation model. Psychol. Rev. 116:540-66
154. Simoncelli EP, Heeger DJ. 1998. A model of neuronal responses in visual area MT. Vis. Res. 38:743-61 (Pubitemid 28081676)
155. Skaggs WE, McNaughton BL. 1998. Spatial firing properties of hippocampal CA1 populations in an environment containing two visually identical regions. J. Neurosci. 18:8455-66 (Pubitemid 28465020)
156. Skinner BF. 1938. The Behavior of Organisms. New York: Appleton-Century-Crofts
157. Smolensky P. 1986. Information processing in dynamical systems: foundations of harmony theory. In Parallel Distributed Processing: Foundations, ed. DE Rumelhart, JL McClelland, pp. 194-281. Cambridge, MA: MIT Press
158. Solstad T, Boccara CN, Kropff E, Moser M-B, Moser EI. 2008. Representation of geometric borders in the entorhinal cortex. Science 322:1865-68
159. Sommer S, Beeren Cv, Wehner R. 2008. Multiroute memories in desert ants. Proc. Natl. Acad. Sci. USA 105:317-22
160. Stackman RW, Clark AS, Taube JS. 2002. Hippocampal spatial representations require vestibular input. Hippocampus Online 12:291-303 (Pubitemid 34700391)
161. Stackman RW, Golob EJ, Bassett JP, Taube JS. 2003. Passive transport disrupts directional path integration by rat head direction cells. J. Neurophysiol. 90:2862-74 (Pubitemid 37429989)
162. Sutton RS, Barto AG. 1998. Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press
163. Tanila H, Shapiro ML, Eichenbaum H. 1997. Discordance of spatial representation in ensembles of hippocampal place cells. Hippocampus 7:613-23 (Pubitemid 28021647)
164. Tanzi E. 1893. I fatti e le induzioni nell'odierna istologia del sistema nervoso. Riv. Sper. Freniatr. Med. Legale 19:419-72
165. Taube JS. 2007. The head direction signal: origins and sensory-motor integration. Annu. Rev. Neurosci. 30:259-88
166. Taube JS, Burton HL. 1995. Head direction cell activity monitored in a novel environment and during a cue conflict situation. J. Neurophysiol. 74:1953-71
167. Tcheang L, B̈ ulthoff HH, Burgess N. 2011. Visual influence on path integration in darkness indicates a multimodal representation of large-scale space. Proc. Natl. Acad. Sci. USA 108:1152-57
168. Thompson SM, Mattison HA. 2009. Secret of synapse specificity. Nature 458:296-97
169. Usherwood PNR. 1993. Memories are made of this. Trends Neurosci. 16:427-29
170. Vallortigara G. 2009. Animals as natural geometers. In Cognitive Biology: Evolutionary and Developmental Perspectives onMind, Brain and Behavior, ed. L Tommasi, L Nadel, MPeterson, pp. 83-104. Cambridge, MA: MIT Press
171. Vickerstaff RJ, Cheung A. 2010. Which coordinate system for modelling path integration? J. Theor. Biol. 263:242-61
172. Ward RD, Gallistel CR, Jensen G, Richards VL, Fairhurst S, Balsam PD. 2012. Conditioned stimulus informativeness governs conditioned stimulus-unconditioned stimulus associability. J. Exp. Psychol. : Anim. Behav. Proc. 38:217-32
173. Wehner R, Srinivasan MV. 2003. Path integration in insects. In The Neurobiology of Spatial Behaviour, ed. KJ Jeffery, pp. 9-30. London: Oxford Univ. Press
174. Wehner R. 1984. Astronavigation in insects. Annu. Rev. Entomol. 29:277-98
175. Wehner R, M̈ uller M (Pubitemid 23221164)
176. Werner-Reiss U, Kelly KA, Trause AS, Underhill AM, Groh JM. 2003. Eye position affects activity in primary auditory cortex of primates. Curr. Biol. 13:554-62 (Pubitemid 36391932)
177. Wills TJ, Cacucci F, Burgess N, O'Keefe J. 2010. Development of the hippocampal cognitivemap in preweanling rats. Science 328:1573-76
178. Wittlinger M, Wehner R, Wolf H. 2006. The ant odometer: stepping on stilts and stumps. Science 312:1965-67 (Pubitemid 43993725)
179. Worden R. 1992. Navigation by fragment fitting: A theory of hippocampal function. Hippocampus 2:165-87
180. Wystrach A, Cheng K, Sosa S, Beugnon G. 2011. Geometry, features, and panoramic views: Ants in rectangular arenas. J. Exp. Psychol. : Anim. Behav. Proc. 37:420-35
181. Yoder RM, Clark BJ, Taube JS. 2011. Origins of landmark encoding in the brain. Trends Neurosci. 34:561-71
182. Yoganarasimha D, Yu X, Knierim JJ. 2006. Head direction cell representations maintain internal coherence during conflicting proximal and distal cue rotations: comparison with hippocampal place cells. J. Neurosci. 26:622-31 (Pubitemid 43237127)
183. Zhang J, Berridge KC, Tindell AJ, Smith KS, Aldridge JW. 2009. A neural computational model of incentive salience. PLoS Comput. Biol. 5:1-14
184. Zhang S, Schwarz S, Pahl M, Shu M, Tautz J. 2006. Honeybee memory: A honeybee knows what to do and when. J. Exp. Biol. 209:4420-28 (Pubitemid 44974423)
185. Zugaro MB, Berthoz A, Wiener SI. 2001. Background, but not foreground, spatial cues are taken as references for head direction responses by rat anterodorsal thalamus neurons. J. Neurosci. 21:RC154