The hippocampus and exploration: Dynamically evolving behavior and neural representations

Frontiers in Human Neuroscience

Volumn , Issue JULY, 2012, Pages

  Johnson, Adam ^a   Varberg, Zachary ^b   Benhardus, James ^c   Maahs, Anthony ^a   Schrater, Paul ^c  

^a BETHEL UNIVERSITY   (United States)

^b University of Minnesota   (United States)

^c UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Hippocampus; Information foraging; Memory; Memory consolidation; Place cell; Recollection; Statistical learning; Vicarious trial and error

Indexed keywords

ANIMAL BEHAVIOR; ARTICLE; BRAIN REGION; EVOLUTIONARY DEVELOPMENTAL BIOLOGY; EXPLORATORY BEHAVIOR; FORAGING BEHAVIOR; HIPPOCAMPUS; HUMAN; MAZE TEST; MEMORY CONSOLIDATION; NONHUMAN; PATTERN RECOGNITION; STATE DEPENDENT LEARNING; TASK PERFORMANCE; THEORETICAL STUDY;

EID: 84933676443     PISSN: 16625161     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2012.00216     Document Type: Article

References (102)

1. Addis, D. R., Wong, A. T., and Schacter, A. L. (2007). Remembering the past and imagining the future: common and distinct neural substrates during event construction and elaboration. Neuropsychologia 45, 1363-1377.
2. Adhikari, A., Topiwala, M. A., and Gordon, J. A. (2010). Synchronized activity between the ventral hippocampus and the medial prefrontal cortex during anxiety. Neuron 65, 257-269.
3. Adhikari, A., Topiwala, M. A., and Gordon, J. A. (2011). Single units in the medial prefrontal cortex with anxiety-related firing patterns are preferentially influenced by ventral hippocampal activity. Neuron 71, 898-910.
4. Ainge, J. A., Heron-Maxwell, C., Theofilas, P., Wright, P., de Hoz, L., and Wood, E. R. (2002). The role of the hippocampus in object recognition in rats: examination of the influence of task parameters and lesion size. Behav. Brain Res. 167, 183-195.
5. Baillargeon, R., Spelke, E. S., and Wasserman, S. (1985). Object permanence in five-month-old infants. Cognition 20, 191-208.
6. Balleine, B. W., and Dickinson, A. (1998). Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37, 407-419.
7. Berlyne, D. E., Koenig, I. D., and Hirota, T. (1966). Novelty, arousal, and the reinforcement of diversive exploration in the rat. J. Comp. Physiol. Psychol. 62, 222-226.
8. Bethus, I., Tse, D., and Morris, R. G. M. (2010). Dopamine and memory: modulation ofthe persistence ofmemory for novel hippocampal nmda receptor-dependent paired associates. J. Neurosci. 30, 1610-1618.
9. Blumenthal, A., Steiner, A., Seeland, K., and Redish, A. D. (2011). Effects of pharmacological manipulations of nmda-receptors on deliberation in the multiple-t task. Neurobiol. Learn. Mem. 95, 376-384.
10. Brown, M. W., and Aggleton, J. P. (1996). Recognition memory: what are the roles of the perirhinal cortex and hippocampus? Nat. Rev. Neurosci. 2,51-61.
11. Buckner, R. L., and Carroll, D. C. (2003). Self-projection and the brain. Trends Cogn. Sci. 11, 49-57.
12. Burns, B., and Brock, O. (2005). "Toward optimal configuration space sampling, " in Proceedings of Robotics: Science and Systems (Cambridge, MA: MIT Press), 1-8.
13. Bussey, T. J., Muir, J. L., and Aggleton, J. P. (1999). Functionally dissociating aspects of event memory: the effects of combined perirhinal and postrhinal cortex lesions on object and place memory in the rat. J. Neurosci. 19, 495-502.
14. Churchwell, J. C., Morris, A. M., Musso, N. D., and Kesner, R. P. (2010). Prefrontal and hippocampal contributions to encoding and retrieval ofspatial memory. Neurobiol. Learn. Mem. 93,415-421.
15. Cimadevilla, J. M., Wesierska, M., Fenton, A. A., and Bures, J. (2001). Inactivating one hippocampus impairs avoidance of a stable room-defined place during dissociation of arena cues from room cues by rotation of the arena. Proc. Natl. Acad. Sci. U.S.A. 98, 3531-3536.
16. Corbit, L. H., and Balleine, B. W. (2003). Instrumental and pavlovian incentive processes have dissociable effects on components of a heterogeneous instrumental chain. J. Exp. Psychol. Anim. Behav. Process. 29, 99-106.
17. Cowen, S. L., and McNaughton, B. L. (2007). Selective delay activity in the medial prefrontal cortex of the rat: contribution of sensorimotor information and contingency. J. Neurophysiol. 98, 303-316.
18. Day, M., Langston, R., and Morris, R. A. M. (2003). Glutamate-receptormediated encoding and retrieval of paired-associate learning. Nature 424, 205-209.
19. de Wit, S., Kosaki, Y., Balleine, B. W., and Dickinson, A. (2006). Dorsomedial prefrontal cortex resolves response conflict in rats. J. Neurosci. 26, 5224-5229.
20. Dix, S. L., and Aggleton, J. P. (1999). Extending the spontaneous preference test of recognition: evidence of object-location and object-context recognition. Behav. Brain Res. 99, 191-200.
21. Dunlosky, J., and Hertzog, C. (1998). Metacognition in Educational Theory and Practice, Chap. Training Programs to Improve Learning in Later Adulthood: Helping Older Adults Educate Themselves. Mahwah, NJ: Erlbaum.
22. Eacott, M. J., Easton, A., and Zinkivskay, A. (2005). Recollection in an episodic-like memory task in the rat. Learn. Mem. 12, 221-223.
23. Eacott, M. J., and Norman, G. (2004). Integrated memory for object, place, and context in rats: a possible model of episodic-like memory? J. Neurosci. 24, 1948-1953.
24. Easton, A., and Eacott, M. (2008). "A new working definition of episodic memory: replacing 'when' with 'which,'" in Handbook of Episodic Memory, Vol. 18, eds E. Dere, A. Easton, L. Nadel, and J. P. Huston (Amsterdam: Elsevier), 185-196.
25. Easton, A., and Eacott, M. J. (2010). Recollection of episodic memory within the medial temporal lobe: behavioural dissociations from other types of memory. Behav. Brain Res. 215, 310-317.
26. Easton, A., Zinkivskay, A., and Eacott, M. J. (2009). Recollection is impaired, but familiarity remains intact in rats with lesions of the fornix. Hippocampus 19, 837-843.
27. Eichenbaum, H., Dudchenko, P., Wood, E., Shapiro, M., and Tanila, B. (1999). The hippocampus, memory, and place cells: is it spatial memory or a memory space? Neuron 23, 209-226.
28. Eichenbaum, H., Yonelinas, A. P., and Ranganath, C. (2007). The medial temporal lobe and recognition memory. Annu. Rev. Neurosci. 30, 123-152.
29. Ennaceur, A., and Delacour, J. (1988). A new one-trial test for neurobiological studies of memory in rats. I, Behavioral data. Behav. Brain Res. 31, 47-59.
30. Fenton, A. A., Lytton, W. W., Barry, J. M., Lenck-Santini, P. P., Zinyuk, L. E., Kubik, S., Bures, J., Poucet, A., Muller, R. U., and Olypher, A. V. (2010). Attention-like modulation of hippocampus place cell discharge. J. Neurosci. 30, 4613-4625.
31. Fenton, A. A., Wsierska, M., Kaminsky, Y., and Bures, J. (1998). Both here and there: simultaneous expression of autonomous spatial memories in rats. Proc. Natl. Acad. Sci. U.S.A. 95, 11493-11498.
32. Fortin, N. J., Agster, K. L., and Eichenbaum, H. B. (2002). Critical role of the hippocampus in memory for sequences of events. Nat. Neurosci. 5, 458-462.
33. Fortin, N. J., Wright, S. P., and Eichenbaum, H. B. (2004). Recollection-like memory retrieval in rats is dependent on the hippocampus. Nature 431, 188-191.
34. Gold, J. I., and Shadlen, M. N. (2000). Representation of a perceptual decision in developing oculomotor commands. Nature 404, 390-394.
35. Gold, J. I., and Shadlen, M. N. (2002). Banburismus and the brain: decoding the relationship between sensory stimuli, decisions, and reward. Neuron 36, 299-308.
36. Gold, J. I., and Shadlen, M. N. (2003). The influence of behavioral context on the representation of a perceptual decision in developing oculomotor commands. J. Neurosci. 23, 632-651.
37. Granon, S., and Poucet, B. (1995). Medial prefrontal lesions in the rat and spatial navigation: evidence for impaired planning. Behav. Neurosci. 107, 474-484.
38. Gupta, A. (2011). Behavioral Correlates of Hippocampal Neural Sequences. Ph.D. thesis, Pittsburgh, PA: Carnegie Mellon University.
39. Guthrie, E. R. (1952). The Psychology of Learning, 2nd Edn. New York, NY: Harper.
40. Hartley, T., Maguire, E. A., Spiers, H. J., and Burgess, N. (2003). The well-worn route and the path less traveled: distinct neural bases of route following and wayfinding in humans. Neuron 37, 877-888.
41. Hassabis, D., Kumaran, D., and Maguire, E. A. (2007a). Using imagination to understand the neural basis of episodic memory. J. Neurosci. 27, 14365-14374.
42. Hassabis, D., Kumaran, D., Vann, S. A., and Maguire, E. A. (2007b). Patients with hippocampal amnesia cannot imagine new experiences. Proc. Natl. Acad. Sci. U.S.A. 104, 1726-1731.
43. Hasselmo, M. E. (1993). Acetylcholine and learning in a cortical associative memory. Neural Comput. 5, 32-44.
44. Hok, V., Save, E., Lenck-Santini, P., and Poucet, B. (2005). Coding for spatial goals in the prelimbic/infralimbic area of the rat frontal cortex. Proc. Natl. Acad. Sci. U.S.A. 102, 4602-4607.
45. Hu, D., and Amsel, A. (1995). A simple test of the vicarious trial-and-error hypothesis of hippocampal function. Proc. Natl. Acad. Sci. U.S.A. 92, 5506-5509.
46. Hu, D., Xu, X., and Gonzalez-Lima, A. (2006). Vicarious trial-anderror behavior and hippocampal cytochrome oxidase activity during Y-maze discrimination learning in the rat. Int. J. Neurosci. 116, 265-280.
47. Hyman, J. M., Zilli, E. A., Paley, A. M., and Hasselmo, M. E. (2005). Medial prefrontal cortex cells show dynamic modulation with the hippocampal theta rhythm dependent on behavior. Hippocampus 15, 739-749.
48. Hyman, J. M., Zilli, E. A., Paley, A. M., and Hasselmo, M. E. (2010). Working memory performance correlates with prefrontal-hippocampal theta interactions but not with prefrontal neuron firing rates. Front. Integr. Neurosci. 4:2. doi: 10.3389/neuro.07.002.2010
49. Jackson, J., and Redish, A. D. (2007). Network dynamics of hippocampal cell-assemblies resemble multiple spatial maps within single tasks. Hippocampus 17, 1209-1229.
50. Johnson, A., Fenton, A. A., Kentros, C., and Redish, A. D. (2009). Looking for cognition in the structure within the noise. Trends Cogn. Sci. 13, 55-64.
51. Johnson, A., and Redish, A. D. (2007). Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J. Neurosci. 27, 12176-12189.
52. Jones, M., and Wilson, M. (2005). Theta rhythms coordinate hippocampal-prefrontal interactions in a spatial memory task. PLo S Biol. 3:e402. doi: 10.1371/journal.pbio.0030402
53. Kaesermann, H. P. (1986). Stretched attend posture, a non-social form of ambivalence, is sensitive to a conflict-reducing drug action. Psychopharmacology (Berl.) 89, 31-37.
54. Kelemen, E., and Fenton, A. A. (2010). Dynamic grouping of hippocampal neural activity during cognitive control of two spatial frames. PLo S Biol. 8:e1000403. doi: 10.1371/journal.pbio.1000403
55. Kumaran, D., and Maguire, E. A. (2006). An unexpected sequence of events: mismatch detection in the human hippocampus. PLo S Biol. 4:e424. doi: 10.1371/journal.pbio.0040424
56. Kyd, R. J., and Bilkey, D. K. (2003). Prefrontal cortex lesions modify the spatial properties of hippocampal place cells. Cereb. Cortex 13, 444-451.
57. Li, L., Miller, E. K., and Desimone, R. (1990). The representation of stimulus familiarity in anterior inferior temporal cortex. J. Neurophysiol. 69, 1918-1929.
58. Loewenstein, G. (1994). The psychology of curiosity: a review and reinterpretation. Psychol. Bull. 116, 75-98.
59. Maviel, T., Durkin, T. P., Menzaghi, F., and Bontempi, B. (2004). Sites of neocortical reorganization critical for remote spatial memory. Science 305, 96-99.
60. Mazurek, M. E., Roitman, J. D., Ditterich, J., and Shadlen, M. N. (2003). A role for neural integrators in perceptual decision making. Cereb. Cortex 13, 1257-1269.
61. Metcalfe, J. (2009). Metacognitive judgments and control of study. Curr. Dir. Psychol. Sci. 18, 159-163.
62. Metcalfe, J., and Kornell, N. (2005). A region of proximal learning model of study time allocation. J. Mem. Lang. 52, 463-477.
63. Morris, R. G. M. (2006). Elements of a neurobiological theory of hippocampal function: the role of synaptic plasticity, synaptic tagging and schemas. Eur. J. Neurosci. 23, 2829-2846.
64. Morris, R. G. M., Garrud, P., Rawlins, J. N. P., and O'Keefe, J. (1982). Place navigation impaired in rats with hip pocampal lesions. Nature 297, 681-683.
65. Muenzinger, K. F. (1938). Vicarious trial and error at a point of choice: a general survey of its relation to learning efficiency. J. Genet. Psychol. 53, 75-86.
66. Mumby, D. G., Gaskin, S., Glenn, M. J., Schramek, T. E., and Lehmann, D. (2002). Hippocampal damage and exploratory preferences in rats: memory for objects, places, and contexts. Learn. Mem. 9, 49-57.
67. Nadel, L., and Moscovitch, M. (1997). Memory consolidation, retrograde amnesia and the hippocampal complex. Curr. Opin. Neurobiol. 7, 217-227.
68. O'Keefe, J., and Nadel, L. (1978). The Hippocampus as a Cognitive Map. Oxford: Clarendon Press.
69. Ostlund, S. B., and Balleine, B. W. (2002). Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goaldirected learning. J. Neurosci. 25, 7763-7770.
70. Packard, M. G., and McGaugh, J. L. (1994). Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiol. Learn. Mem. 65, 65-72.
71. Redish, A. D. (1999). Beyond the Cognitive Map: From Place Cells to Episodic Memory. Cambridge, MA: MIT Press.
72. Rich, E. L., and Shapiro, M. (2009). Rat prefrontal cortical neurons selectively code strategy switches. J. Neurosci. 29, 7208-7219.
73. Rich, E. L., and Shapiro, M. L. (2007). Prelimbic/infralimbic inactivation impairs memory for multiple task switches, but not flexible selection of familiar tasks. J. Neurosci. 27, 4747-4755.
74. Rolls, E. T., Cahusac, P. M., Feigenbaum, J. D., and Miyashita, Y. (1993). Responses of single neurons in the hippocampus of the macaque related to recognition memory. Exp. Brain Res. 93, 299-306.
75. Santos, L. R. (2004). Core knowledges: a dissociation between spatiotemporal knowledge and contact-mechanics in a non-human primate? Dev. Sci. 7, 167-174.
76. Schacter, D. L., and Addis, D. R. (2001). The cognitive neuroscience of constructive memory: remembering the past and imagining the future. Philos. Trans. R. Soc. Lond. B Biol. Sci. 362, 773-786.
77. Schacter, D. L., Addis, D. R., and Buckner, R. L. (2007). Remembering the past to imagine the future: the prospective brain. Nat. Rev. Neurosci. 8, 657-661.
78. Shadlen, M. N., and Newsome, W. T. (2001). Neural basis of a perceptual decision in the parietal cortex (area lip) of the rhesus monkey. J. Neurophysiol. 86, 1916-1936.
79. Siapas, A. G., Lubenov, E. V., and Wilson, M. A. (2005). Prefrontal phase locking to hippocampal theta oscillations. Neuron 46, 141-151.
80. Spelke, E. S., and Kinzler, K. D. (2007). Core knowledge. Dev. Sci. 10, 89-96.
81. Squire, L. R., and Alvarez, P. (1995). Retrograde amnesia and memory consolidation: a neurobiological perspective. Curr. Opin. Neurobiol. 3, 169-177.
82. Squire, L. R., Stark, C. E. L., and Clark, R. E. (2004). The medial temporal lobe. Annu. Rev. Neurosci. 27, 279-306.
83. Summerfield, J. J., Hassabis, D., and Maguire, E. A. (2010). Differential engagement of brain regions within a 'core' network during scene construction. Neuropsychologia 48, 1501-1509.
84. Teng, E., and Squire, L. R. (1999). Memory for places learned long ago is intact after hippocampal damage. Nature 400, 675-677.
85. Tolman, E. C. (1939). Prediction of vicarious trial and error bymeans of the schematic sowbug. Psychol. Rev. 46, 318-336.
86. Tolman, E. C. (1948). Cognitive maps in rats and men. Psychol. Rev. 55, 189-208.
87. Tolman, E. C. (1954). Freedom and the cognitive mind. Am. Psychol. 9, 536-538.
88. Tse, D., Langston, R. F., Kakeyama, M., Bethus, I., Spooner, P. A., Wood, B. R., Witter, M. P., and Morris, R. G. M. (2007). Schemas and memory consolidation. Science 316, 76-82.
89. Tse, D., Takeuchi, T., Kakeyama, M., Kajii, Y., Okuno, H., Tohyama, B., Bito, H., and Morris, R. G. M. (2011). Schema-dependent gene activation and memory encoding in neocortex. Science 333, 891-895.
90. Voss, J. L., Galvan, A., and Gonsalves, B. D. (2011a). Cortical regions recruited for complex activelearning strategies and action planning exhibit rapid reactivation during memory retrieval. Neuropsychologia 49, 3956-3966.
91. Voss, J. L., Gonsalves, B. D., Federmeier, K. D., Tranel, D., and Cohen, N. J. (2011b). Hippocampal brainnetwork coordination during volitional exploratory behavior enhances learning. Nat. Neurosci. 12, 115-120.
92. Voss, J. L., Warren, D. E., Gonsalves, B. D., Federmeier, K. D., Tranel, C., and Cohen, N. J. (2011c). Spontaneous revis-itation during visual exploration as a link among strategic behavior, learning, and the hippocampus. Proc. Natl. Acad. Sci. U.S.A. 108, E402-E409.
93. Warburton, E. C., and Aggleton, J. P. (1999). Differential deficits in the morris water maze following cytotoxic lesions ofthe anterior thalamus and fornix transection. Behav. Brain Res. 98,27-38.
94. Wesierska, M., Dockery, C., and Fenton, A. A. (2005). Beyond memory, navigation, and inhibition: behavioral evidence for hippocampus-dependent cognitive coordination in the rat. J. Neurosci. 24, 2413-2419.
95. Winters, B., and Bussey, T. (2005). Transient inactivation of perirhinal cortex disrupts encoding, retrieval, and consolidation of object recognition. J. Neurosci. 25, 52-61.
96. Winters, B., Forwood, S., Cowell, R., Saksida, L., and Bussey, T. (2004). Double dissociation between the effects of peri-postrhinal cortex and hippocampal lesions on tests of object recognition and spatial memory: heterogeneity of function within the temporal lobe. J. Neurosci. 24, 5901-5908.
97. Xiang, J. Z., and Brown, M. W. (1998). Differential neuronal encoding of novelty, familiarity and recency in regions of the anterior temporal lobe. Neuropharmacology 37, 657-676.
98. Yang, T., and Shadlen, M. N. (2007). Probabilistic reasoning by neurons. Nature 447, 1075-1080.
99. Yonelinas, A. P. (2001). Components of episodic memory: the contribution of recollection and familiarity. Philos. Trans. R. Soc. Lond. B Biol. Sci. 356, 1363-1374.
100. Zhou, W., and Crystal, J. D. (2009). Evidence for remembering when events occurred in a rodent model of episodic memory. Proc. Natl. Acad. Sci. U.S.A. 106, 9525-9529.
101. Zhu, X. O., Brown, M. W., and Aggleton, J. P. (1995). Neuronal signalling of information important to visual recognition memory in rat rhinal and neighbouring cortices. Eur. J. Neurosci. 7, 753-765.
102. Zola-Morgan, S., and Squire, L. R. (1990). The primate hippocampal formation: evidence for a timelimited role in memory storage. Science 250, 288-290.