Decoding the cognitive map: Ensemble hippocampal sequences and decision making

Current Opinion in Neurobiology

Volumn 32, Issue , 2014, Pages 8-15

  Wikenheiser, Andrew M ^a,b   Redish, A David ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

^b NATIONAL INSTITUTE ON DRUG ABUSE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE BEHAVIOR; BRAIN FUNCTION; BRAIN REGION; COGNITION; DECISION MAKING; HIPPOCAMPUS; HIPPOCAMPUS THETA RHYTHM; HUMAN; LEARNING; MEMORY CONSOLIDATION; NERVE CELL NETWORK; NONHUMAN; PLANNING; REVIEW; ANIMAL; MEMORY; PHYSIOLOGY; PYRAMIDAL NERVE CELL; THETA RHYTHM;

ADAPTATION, PSYCHOLOGICAL; ANIMALS; DECISION MAKING; HIPPOCAMPUS; MEMORY; PYRAMIDAL CELLS; THETA RHYTHM;

EID: 84908229701     PISSN: 09594388     EISSN: 18736882     Source Type: Journal    
DOI: 10.1016/j.conb.2014.10.002     Document Type: Review

References (77)

1. Tolman E.C. Purposive Behavior in Animals and Men 1932, Appleton-Century-Crofts, New York.
2. Tolman E.C. Cognitive maps in rats and men. Psychol Rev 1948, 55:189-208.
3. Johnson A., Crowe D. Revisiting Tolman: theories and cognitive maps. Cogn Crit 2009, 1:43-72.
4. O'Keefe J., Nadel L. The Hippocampus as a Cognitive Map 1978, Clarendon Press, Oxford.
5. Redish A.D. Beyond the Cognitive Map: From Place Cells to Episodic Memory 1999, MIT Press, Cambridge, MA.
6. McNaughton B.L., Battaglia F.P., Jensen O., Moser E.I., Moser M.B. Path integration and the neural basis of the 'cognitive map'. Nat Rev Neurosci 2006, 7:663-678.
7. Cohen N.J., Eichenbaum H. Memory, Amnesia, and the Hippocampal System 1993, MIT Press, Cambridge, MA.
8. Schacter D., Addis D. On the nature of medial temporal lobe contributions to the constructive simulation of future events. Philos Trans R Soc B Biol Sci 2009, 364:1245.
9. Hassabis D., Maguire E. The construction system of the brain. Philos Trans R Soc B Biol Sci 2009, 364:1263-1271.
10. Buckner R. The role of the hippocampus in prediction and imagination. Annu Rev Psychol 2010, 61:27-48.
11. Addis D., Cheng T., Roberts R., Schacter D. Hippocampal contributions to the episodic simulation of specific and general future events. Hippocampus 2011, 21:1045-1052.
12. Wilson M.A., McNaughton B.L. Dynamics of the hippocampal ensemble code for space. Science 1993, 261:1055-1058.
13. Hasselmo M.E., Bower J.M. Acetylcholine and memory. Trends Neurosci 1993, 16:218-222.
14. Kentros C.G., Agnihotri N.T., Streater S., Hawkins R.D., Kandel E.R. Increased attention to spatial context increases both place field stability and spatial memory. Neuron 2004, 42:283-295.
15. Amemiya S., Noji T., Kubota N., Nishijima T., Kita I. Noradrenergic modulation of vicarious trial-and-error behavior during a spatial decision-making task in rats. Neuroscience 2014, 265:291-301.
16. Green J., Arduini A. Hippocampal electrical activity in arousal. J Neurophysiol 1954, 17:531-557.
17. Vanderwolf C. Hippocampal electrical activity and voluntary movement in the rat. Electroencephalogr Clin Neurophysiol 1969, 26:407-418.
18. Buzsáki G., Leung L.W., Vanderwolf C.H. Cellular bases of hippocampal EEG in the behaving rat. Brain Res 1983, 287:139-171.
19. Carr M., Frank L. A single microcircuit with multiple functions: state dependent information processing in the hippocampus. Curr Opin Neurobiol 2012, 22:704-708.
20. Carr M.F., Jadhav S.P., Frank L.M. Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval. Nat Neurosci 2011, 14:147-153.
21. Buhry L., Azizi A.H., Cheng S. Reactivation, replay and preplay: how it might all fit together. Neural Plast 2011, 2011:1-11.
22. O'Keefe J., Recce M. Phase relationship between hippocampal place units and the EEG theta rhythm. Hippocampus 1993, 3:317-330.
23. Skaggs W.E., McNaughton B.L., Wilson M.A., Barnes C.A. Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences. Hippocampus 1996, 6:149-173.
24. Maurer A.P., McNaughton B.L. Network and intrinsic cellular mechanisms underlying theta phase precession of hippocampal neurons. Trends Neurosci 2007, 30:325-333.
25. Lisman J., Redish A.D. Prediction, sequences and the hippocampus. Philos Trans R Soc B Biol Sci 2009, 364:1193-1201.
26. Redish A.D., Ekstrom A.D. Hippocampus and related areas: what the place cell literature tells us about cognitive maps in rats and humans. Handbook of Spatial Cognition 2013, 14-34. APA. D.A. Waller, L. Nadel (Eds.).
27. Skaggs W.E., McNaughton B.L. Replay of neuronal firing sequences in rat hippocampus during sleep following spatial experience. Science 1996, 271:1870-1873.
28. Dragoi G., Buzsaki G. Temporal encoding of place sequences by hippocampal cell assemblies. Neuron 2006, 50:145-157.
29. Johnson A., Fenton A.A., Kentros C., Redish A.D. Looking for cognition in the structure in the noise. Trends Cogn Sci 2009, 13:55-64.
30. Jackson J.C., Redish A.D. Detecting dynamical changes within a simulated neural ensemble using a measure of representational quality. Network 2003, 14:629-645.
31. Johnson A., Jackson J., Redish A.D. Measuring distributed properties of neural representations beyond the decoding of local variables-implications for cognition. Mechanisms of Information Processing in the Brain: Encoding of Information in Neural Populations and Networks 2008, 95-119. Cambridge University Press. C. Hölscher, M.H.J. Munk (Eds.).
32. Foster D.J., Wilson M.A. Reverse replay of behavioural sequences in hippocampal place cells during the awake state. Nature 2006, 440:680-683.
33. Diba K., Buzsáki G. Forward and reverse hippocampal place-cell sequences during ripples. Nat Neurosci 2007, 10:1241-1242.
34. Davidson T.J., Kloosterman F., Wilson M.A. Hippocampal replay of extended experience. Neuron 2009, 63:497-507.
35. Johnson A., Redish A.D. Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J Neurosci 2007, 27:12176-12189.
36. Pfeiffer B., Foster D. Hippocampal place-cell sequences depict future paths to remembered goals. Nature 2013, 497:74-79.
37. Dragoi G., Tonegawa S. Distinct preplay of multiple novel spatial experiences in the rat. Proc Natl Acad Sci U S A 2013, 110:9100-9105.
38. Dragoi G., Tonegawa S. Preplay of future place cell sequences by hippocampal cellular assemblies. Nature 2011, 469:397-401.
39. Jackson J.C., Johnson A., Redish A.D. Hippocampal sharp waves and reactivation during awake states depend on repeated sequential experience. J Neurosci 2006, 26:12415-12426.
40. Karlsson M.P., Frank L.M. Awake replay of remote experiences in the hippocampus. Nat Neurosci 2009, 12:913-918.
41. Buzsáki G. Two-stage model of memory trace formation: a role for "noisy" brain states. Neuroscience 1989, 31:551-570.
42. Pavlides C., Winson J. Influences of hippocampal place cell firing in the awake state on the activity of these cells during subsequent sleep episodes. J Neurosci 1989, 9:2907-2918.
43. Wilson M.A., McNaughton B.L. Reactivation of hippocampal ensemble memories during sleep. Science 1994, 265:676-679.
44. Girardeau G., Benchenane K., Wiener S.I., Buzsaki G., Zugaro M.B. Selective suppression of hippocampal ripples impairs spatial memory. Nat Neurosci 2009, 12:1222-1223.
45. Ego-Stengel V., Wilson M.A. Disruption of ripple-associated hippocampal activity during rest impairs spatial learning in the rat. Hippocampus 2010, 20:1-10.
46. Girardeau G., Zugaro M. Hippocampal ripples and memory consolidation. Curr Opin Neurobiol 2011, 21:452-459.
47. Gupta A.S., van der Meer M.A.A., Touretzky D.S., Redish A.D. Hippocampal replay is not a simple function of experience. Neuron 2010, 65:695-705.
48. Zeithamova D., Dominick A.L., Preston A.R. Hippocampal and ventral medial prefrontal activation during retrieval-mediated learning supports novel inference. Neuron 2012, 75:168-179.
49. Barron H., Dolan R., Behrens T. Online evaluation of novel choices by simultaneous representation of multiple memories. Nat Neurosci 2013, 16:1492-1498.
50. Bornstein A.M., Daw N.D. Cortical and hippocampal correlates of deliberation during model-based decisions for rewards in humans. PLoS Comput Biol 2013, 9:e1003387.
51. Gaesser B., Spreng R.N., McLelland V.C., Addis D.R., Schacter D.L. Imagining the future: evidence for a hippocampal contribution to constructive processing. Hippocampus 2013, 23:1150-1161.
52. Singer A., Carr M., Karlsson M., Frank L. Hippocampal SWR activity predicts correct decisions during the initial learning of an alternation task. Neuron 2013, 77:1163-1173.
53. Johnson A., van der Meer M.A.A., Redish A.D. Integrating hippocampus and striatum in decision-making. Curr Opin Neurobiol 2007, 17:692-697.
54. van der Meer M.A.A., Redish A.D. Expectancies in decision making, reinforcement learning, and ventral striatum. Front Neurosci 2010, 4:29-37.
55. Jadhav S., Kemere C., German P., Frank L. Awake hippocampal sharp-wave ripples support spatial memory. Science 2013, 336:1454-1458.
56. Wikenheiser A.M., Redish A.D. The balance of forward and backward hippocampal sequences shifts across behavioral states. Hippocampus 2013, 23:22-29.
57. Foster D.J., Wilson M.A. Hippocampal theta sequences. Hippocampus 2007, 17:1093-1099.
58. Gupta A.S., van der Meer M.A.A., Touretzky D.S., Redish A.D. Segmentation of spatial experience by hippocampal theta sequences. Nat Neurosci 2012, 15:1032-1039.
59. Robbe D., Montgomery S.M., Thome A., Rueda-Orozco P.E., McNaughton B.L., Buzsaki G. Cannabinoids reveal importance of spike timing coordination in hippocampal function. Nat Neurosci 2006, 9:1526-1533.
60. Robbe D., Buzsaki G. Alteration of theta timescale dynamics of hippocampal place cells by a cannabinoid is associated with memory impairment. J Neurosci 2009, 29:12597-12605.
61. Siapas A.G., Lubenov E.V., Wilson M.A. Prefrontal phase locking to hippocampal theta oscillations. Neuron 2005, 46:141-151.
62. Jones M.W., Wilson M.A. Phase precession of medial prefrontal cortical activity relative to the hippocampal theta rhythm. Hippocampus 2005, 15:867-873.
63. Benchenane K., Peyrache A., Khamassi M., Tierny P.L., Gioanni Y., Battaglia F.P., Wiener S. Coherent theta oscillations and reorganization of spike timing in the hippocampal-prefrontal network upon learning. Neuron 2010, 66:921-936.
64. Hyman J.M., Zilli E.A., Paley A.M., Hasselmo M.E. Working memory performance correlates with prefrontal-hippocampal theta interactions but not with prefrontal neuron firing rates. Front Integr Neurosci 2010, 4. 10.3389/neuro.07.002.2010.
65. van der Meer M.A.A., Redish A.D. Covert expectation-of-reward in rat ventral striatum at decision points. Front Integr Neurosci 2009, 3:1-15.
66. van der Meer M.A.A., Redish A.D. Theta phase precession in rat ventral striatum links place and reward information. J Neurosci 2011, 31:2843-2854.
67. Siapas A.G., Wilson M.A. Coordinated interactions between hippocampal ripples and cortical spindles during slow-wave sleep. Neuron 1998, 21:1123-1128.
68. Hoffmann K.L., McNaughton B.L. Coordinated reactivation of distributed memory traces in primate neocortex. Science 2002, 297:2070-2073.
69. Lansink C.S., Goltstein P.M., Lankelma J.V., Joosten R.N.J.M.A., McNaughton B.L., Pennartz C.M.A. Preferential reactivation of motivationally relevant information in the ventral striatum. J Neurosci 2008, 28:6372-6382.
70. Lansink C.S., Goltstein P.M., Lankelma J.V., McNaughton B.L., Pennartz C.M.A. Hippocampus leads ventral striatum in replay of place-reward information. PLoS Biol 2009, 7:e1000173.
71. Peyrache A., Khamassi M., Benchenane K., Wiener S.I., Battaglia F.P. Replay of rule learning related neural patterns in the prefrontal cortex during sleep. Nat Neurosci 2009, 12:919-926.
72. Logothetis N.K., Eschenko O., Murayama Y., Augath M., Steudel T., Evrard H., Besserve M., Oeltermann A. Hippocampal-cortical interaction during periods of subcortical silence. Nature 2012, 491:547-553.
73. Redish A.D., Touretzky D.S. The role of the hippocampus in solving the Morris water maze. Neural Comput 1998, 10:73-111.
74. Carr M., Karlsson M., Frank L. Transient slow gamma synchrony underlies hippocampal memory replay. Neuron 2012, 75:700-713.
75. Wang J.X., Cohen N.J., Voss J.L. Covert rapid action-memory simulation (CRAMS): a hypothesis of hippocampal-prefrontal interactions for adaptive behavior. Neurobiol Learn Mem 2014, in press.
76. Lee A.K., Wilson M.A. Memory of sequential experience in the hippocampus during slow-wave sleep. Neuron 2002, 36:1183-1194.
77. Zhang K., Ginzburg I., McNaughton B.L., Sejnowski T.J. Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. J Neurophysiol 1998, 79:1017-1044.