Suppression of Ventral Hippocampal Output Impairs Integrated Orbitofrontal Encoding of Task Structure

Neuron

Volumn 95, Issue 5, 2017, Pages 1197-1207.e3

  Wikenheiser, Andrew M ^a   Marrero Garcia, Yasmin ^a   Schoenbaum, Geoffrey ^a,b,c  

^a NATIONAL INSTITUTE ON DRUG ABUSE   (United States)

^b UNIVERSITY OF MARYLAND SCHOOL OF MEDICINE   (United States)

^c JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

decision making; decoding; electrophysiology; hippocampus; orbitofrontal

Indexed keywords

ANIMAL; CYTOLOGY; DECISION MAKING; HIPPOCAMPUS; MALE; NERVE CELL INHIBITION; PHYSIOLOGY; PREFRONTAL CORTEX; RAT; REWARD; TIME FACTOR;

ANIMALS; DECISION MAKING; HIPPOCAMPUS; MALE; NEURAL INHIBITION; PREFRONTAL CORTEX; RATS; REWARD; TIME FACTORS;

EID: 85027507242     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2017.08.003     Document Type: Article

References (75)

1. Abela, A.R., Chudasama, Y., Dissociable contributions of the ventral hippocampus and orbitofrontal cortex to decision-making with a delayed or uncertain outcome. Eur. J. Neurosci. 37 (2013), 640–647.
2. Barron, H.C., Dolan, R.J., Behrens, T.E.J., Online evaluation of novel choices by simultaneous representation of multiple memories. Nat. Neurosci. 16 (2013), 1492–1498.
3. Boorman, E.D., Rajendran, V.G., O'Reilly, J.X., Behrens, T.E., Two anatomically and computationally distinct learning signals predict changes to stimulus-outcome associations in hippocampus. Neuron 89 (2016), 1343–1354.
4. Bradfield, L.A., Dezfouli, A., van Holstein, M., Chieng, B., Balleine, B.W., Medial orbitofrontal cortex mediates outcome retrieval in partially observable task situations. Neuron 88 (2015), 1268–1280.
5. Buzsáki, G., Moser, E.I., Memory, navigation and theta rhythm in the hippocampal-entorhinal system. Nat. Neurosci. 16 (2013), 130–138.
6. Chalmers, E., Luczak, A., Gruber, A.J., Computational properties of the hippocampus increase the efficiency of goal-directed foraging through hierarchical reinforcement learning. Front. Comput. Neurosci., 10, 2016, 128.
7. Constantinescu, A.O., O'Reilly, J.X., Behrens, T.E.J., Organizing conceptual knowledge in humans with a gridlike code. Science 352 (2016), 1464–1468.
8. Cooch, N.K., Stalnaker, T.A., Wied, H.M., Bali-Chaudhary, S., McDannald, M.A., Liu, T.-L., Schoenbaum, G., Orbitofrontal lesions eliminate signalling of biological significance in cue-responsive ventral striatal neurons. Nat. Commun., 6, 2015, 7195.
9. Erdem, U.M., Hasselmo, M.E., A biologically inspired hierarchical goal directed navigation model. J. Physiol. Paris 108 (2014), 28–37.
10. Farovik, A., Place, R.J., McKenzie, S., Porter, B., Munro, C.E., Eichenbaum, H., Orbitofrontal cortex encodes memories within value-based schemas and represents contexts that guide memory retrieval. J. Neurosci. 35 (2015), 8333–8344.
11. Feierstein, C.E., Quirk, M.C., Uchida, N., Sosulski, D.L., Mainen, Z.F., Representation of spatial goals in rat orbitofrontal cortex. Neuron 51 (2006), 495–507.
12. Ferbinteanu, J., Shirvalkar, P., Shapiro, M.L., Memory modulates journey-dependent coding in the rat hippocampus. J. Neurosci. 31 (2011), 9135–9146.
13. Gershman, S.J., Niv, Y., Learning latent structure: carving nature at its joints. Curr. Opin. Neurobiol. 20 (2010), 251–256.
14. Ginther, M.R., Walsh, D.F., Ramus, S.J., Hippocampal neurons encode different episodes in an overlapping sequence of odors task. J. Neurosci. 31 (2011), 2706–2711.
15. Gluck, M.A., Myers, C.E., Hippocampal mediation of stimulus representation: a computational theory. Hippocampus 3 (1993), 491–516.
16. Honey, R.C., Iordanova, M.D., Good, M., Associative structures in animal learning: dissociating elemental and configural processes. Neurobiol. Learn. Mem. 108 (2014), 96–103.
17. Iordanova, M.D., Burnett, D.J., Aggleton, J.P., Good, M., Honey, R.C., The role of the hippocampus in mnemonic integration and retrieval: complementary evidence from lesion and inactivation studies. Eur. J. Neurosci. 30 (2009), 2177–2189.
18. Iordanova, M.D., Burnett, D.J., Good, M., Honey, R.C., Pattern memory involves both elemental and configural processes: evidence from the effects of hippocampal lesions. Behav. Neurosci. 125 (2011), 567–577.
19. Iordanova, M.D., Good, M., Honey, R.C., Retrieval-mediated learning involving episodes requires synaptic plasticity in the hippocampus. J. Neurosci. 31 (2011), 7156–7162.
20. Izquierdo, A., Suda, R.K., Murray, E.A., Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J. Neurosci. 24 (2004), 7540–7548.
21. Jeffery, K.J., Anand, R.L., Anderson, M.I., A role for terrain slope in orienting hippocampal place fields. Exp. Brain Res. 169 (2006), 218–225.
22. Johnson, A., Crowe, D., Revisiting Tolman: Theories and cognitive maps. Cognitive Critique 1 (2009), 43–72.
23. Johnson, A., Redish, A.D., Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J. Neurosci. 27 (2007), 12176–12189.
24. Johnson, A., van der Meer, M.A., Redish, A.D., Integrating hippocampus and striatum in decision-making. Curr. Opin. Neurobiol. 17 (2007), 692–697.
25. Jones, B., Mishkin, M., Limbic lesions and the problem of stimulus–reinforcement associations. Exp. Neurol. 36 (1972), 362–377.
26. Kennedy, P.J., Shapiro, M.L., Motivational states activate distinct hippocampal representations to guide goal-directed behaviors. Proc. Natl. Acad. Sci. USA 106 (2009), 10805–10810.
27. Kentros, C.G., Agnihotri, N.T., Streater, S., Hawkins, R.D., Kandel, E.R., Increased attention to spatial context increases both place field stability and spatial memory. Neuron 42 (2004), 283–295.
28. Koene, R.A., Gorchetchnikov, A., Cannon, R.C., Hasselmo, M.E., Modeling goal-directed spatial navigation in the rat based on physiological data from the hippocampal formation. Neural Netw. 16 (2003), 577–584.
29. Komorowski, R.W., Garcia, C.G., Wilson, A., Hattori, S., Howard, M.W., Eichenbaum, H., Ventral hippocampal neurons are shaped by experience to represent behaviorally relevant contexts. J. Neurosci. 33 (2013), 8079–8087.
30. Mack, M.L., Love, B.C., Preston, A.R., Dynamic updating of hippocampal object representations reflects new conceptual knowledge. Proc. Natl. Acad. Sci. USA 113 (2016), 13203–13208.
31. Markus, E.J., Qin, Y.L., Leonard, B., Skaggs, W.E., McNaughton, B.L., Barnes, C.A., Interactions between location and task affect the spatial and directional firing of hippocampal neurons. J. Neurosci. 15 (1995), 7079–7094.
32. McKenzie, S., Frank, A.J., Kinsky, N.R., Porter, B., Rivière, P.D., Eichenbaum, H., Hippocampal representation of related and opposing memories develop within distinct, hierarchically organized neural schemas. Neuron 83 (2014), 202–215.
33. McKenzie, S., Keene, C.S., Farovik, A., Bladon, J., Place, R., Komorowski, R., Eichenbaum, H., Representation of memories in the cortical-hippocampal system: Results from the application of population similarity analyses. Neurobiol. Learn. Mem. 134:Pt A (2016), 178–191.
34. Miller, E.K., The prefrontal cortex and cognitive control. Nat. Rev. Neurosci. 1 (2000), 59–65.
35. Miller, K.J., Botvinick, M.M., Brody, C.D., Dorsal hippocampus plays a causal role in model-based planning. Nat. Neurosci., 2016, 10.1038/nn.4613 Published online July 31, 2017.
36. Moita, M.A., Rosis, S., Zhou, Y., LeDoux, J.E., Blair, H.T., Hippocampal place cells acquire location-specific responses to the conditioned stimulus during auditory fear conditioning. Neuron 37 (2003), 485–497.
37. O'Keefe, J., Nadel, L., The Hippocampus as a Cognitive Map. 1978, Clarendon Press.
38. Otto, T., Eichenbaum, H., Complementary roles of the orbital prefrontal cortex and the perirhinal-entorhinal cortices in an odor-guided delayed-nonmatching-to-sample task. Behav. Neurosci. 106 (1992), 762–775.
39. Place, R., Farovik, A., Brockmann, M., Eichenbaum, H., Bidirectional prefrontal-hippocampal interactions support context-guided memory. Nat. Neurosci. 19 (2016), 992–994.
40. Ramus, S.J., Davis, J.B., Donahue, R.J., Discenza, C.B., Waite, A.A., Interactions between the orbitofrontal cortex and the hippocampal memory system during the storage of long-term memory. Ann. N Y Acad. Sci. 1121 (2007), 216–231.
41. Redish, A.D., Beyond the Cognitive Map: From Place Cells to Episodic Memory. 1999, MIT Press.
42. Redish, A.D., Vicarious trial and error. Nat. Rev. Neurosci. 17 (2016), 147–159.
43. Redish, A.D., Jensen, S., Johnson, A., Kurth-Nelson, Z., Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. Psychol. Rev. 114 (2007), 784–805.
44. Riceberg, J.S., Shapiro, M.L., Reward stability determines the contribution of orbitofrontal cortex to adaptive behavior. J. Neurosci. 32 (2012), 16402–16409.
45. Roesch, M.R., Taylor, A.R., Schoenbaum, G., Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51 (2006), 509–520.
46. Rudebeck, P.H., Murray, E.A., The orbitofrontal oracle: cortical mechanisms for the prediction and evaluation of specific behavioral outcomes. Neuron 84 (2014), 1143–1156.
47. Rudy, J.W., Sutherland, R.J., Configural association theory and the hippocampal formation: an appraisal and reconfiguration. Hippocampus 5 (1995), 375–389.
48. Saez, A., Rigotti, M., Ostojic, S., Fusi, S., Salzman, C.D., Abstract context representations in primate amygdala and prefrontal cortex. Neuron 87 (2015), 869–881.
49. Schmajuk, N.A., Blair, H.T., Stimulus configuration, spatial learning, and hippocampal function. Behav. Brain Res. 59 (1993), 103–117.
50. Schmajuk, N.A., DiCarlo, J.J., Stimulus configuration, classical conditioning, and hippocampal function. Psychol. Rev. 99 (1992), 268–305.
51. Schoenbaum, G., Chiba, A.A., Gallagher, M., Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning. J. Neurosci. 19 (1999), 1876–1884.
52. Schuck, N.W., Cai, M.B., Wilson, R.C., Niv, Y., Human orbitofrontal cortex represents a cognitive map of state space. Neuron 91 (2016), 1402–1412.
53. Shapiro, M.L., Riceberg, J.S., Seip-Cammack, K., Guise, K.G., Functional interactions of prefrontal cortex and the hippocampus in learning and memory. Derdikman, D., Knierim, J.J., (eds.) Space, Time and Memory in the Hippocampal Formation, 2014, Springer, 517–560.
54. Spellman, T., Rigotti, M., Ahmari, S.E., Fusi, S., Gogos, J.A., Gordon, J.A., Hippocampal-prefrontal input supports spatial encoding in working memory. Nature 522 (2015), 309–314.
55. Stachenfeld, K.L., Botvinick, M.M., Gershman, S.J., The hippocampus as a predictive map. bioRxiv, 2016, 10.1101/097170.
56. Stalnaker, T.A., Cooch, N.K., McDannald, M.A., Liu, T.-L., Wied, H., Schoenbaum, G., Orbitofrontal neurons infer the value and identity of predicted outcomes. Nat. Commun., 5, 2014, 3926.
57. Stalnaker, T.A., Cooch, N.K., Schoenbaum, G., What the orbitofrontal cortex does not do. Nat. Neurosci. 18 (2015), 620–627.
58. Stalnaker, T.A., Berg, B., Aujla, N., Schoenbaum, G., Cholinergic interneurons use orbitofrontal input to track beliefs about current state. J. Neurosci. 36 (2016), 6242–6257.
59. Steiner, A.P., Redish, A.D., The road not taken: neural correlates of decision making in orbitofrontal cortex. Front. Neurosci., 6, 2012, 131.
60. Sutherland, R.J., Rudy, J.W., Configural association theory: The role of the hippocampal formation in learning, memory, and amnesia. Psychobiology (Austin Tex.) 17 (1989), 129–144.
61. Sutton, R.S., Barto, A.G., Reinforcement Learning: An Introduction. 1998, MIT Press.
62. Tanaka, K.Z., Pevzner, A., Hamidi, A.B., Nakazawa, Y., Graham, J., Wiltgen, B.J., Cortical representations are reinstated by the hippocampus during memory retrieval. Neuron 84 (2014), 347–354.
63. Tavares, R.M., Mendelsohn, A., Grossman, Y., Williams, C.H., Shapiro, M., Trope, Y., Schiller, D., A map for social navigation in the human brain. Neuron 87 (2015), 231–243.
64. Thorpe, S.J., Rolls, E.T., Maddison, S., The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp. Brain Res. 49 (1983), 93–115.
65. Tsujimoto, S., Genovesio, A., Wise, S.P., Monkey orbitofrontal cortex encodes response choices near feedback time. J. Neurosci. 29 (2009), 2569–2574.
66. Wallis, J.D., Orbitofrontal cortex and its contribution to decision-making. Annu. Rev. Neurosci. 30 (2007), 31–56.
67. Walton, M.E., Behrens, T.E.J., Buckley, M.J., Rudebeck, P.H., Rushworth, M.F.S., Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65 (2010), 927–939.
68. Wikenheiser, A.M., Redish, A.D., Decoding the cognitive map: ensemble hippocampal sequences and decision making. Curr. Opin. Neurobiol. 32 (2015), 8–15.
69. Wikenheiser, A.M., Schoenbaum, G., Over the river, through the woods: cognitive maps in the hippocampus and orbitofrontal cortex. Nat. Rev. Neurosci. 17 (2016), 513–523.
70. Wilson, R.C., Takahashi, Y.K., Schoenbaum, G., Niv, Y., Orbitofrontal cortex as a cognitive map of task space. Neuron 81 (2014), 267–279.
71. Young, J.J., Shapiro, M.L., Dynamic coding of goal-directed paths by orbital prefrontal cortex. J. Neurosci. 31 (2011), 5989–6000.
72. Young, B.J., Fox, G.D., Eichenbaum, H., Correlates of hippocampal complex-spike cell activity in rats performing a nonspatial radial maze task. J. Neurosci. 14 (1994), 6553–6563.
73. Zhang, S., Manahan-Vaughan, D., Spatial olfactory learning contributes to place field formation in the hippocampus. Cereb. Cortex 25 (2015), 423–432.
74. Zhang, F., Wang, L.-P., Brauner, M., Liewald, J.F., Kay, K., Watzke, N., Wood, P.G., Bamberg, E., Nagel, G., Gottschalk, A., Deisseroth, K., Multimodal fast optical interrogation of neural circuitry. Nature 446 (2007), 633–639.
75. Zilli, E.A., Hasselmo, M.E., Modeling the role of working memory and episodic memory in behavioral tasks. Hippocampus 18 (2008), 193–209.