Human Orbitofrontal Cortex Represents a Cognitive Map of State Space

Neuron

Volumn 91, Issue 6, 2016, Pages 1402-1412

  Schuck, Nicolas W ^a   Cai, Ming Bo ^a   Wilson, Robert C ^b   Niv, Yael ^a  

^a PRINCETON UNIVERSITY   (United States)

^b The University of Arizona   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ADULT; ARTICLE; COGNITION; CONNECTOME; CONTROLLED STUDY; DECISION MAKING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; MALE; MEMORY; MOTOR ACTIVITY; NORMAL HUMAN; ORBITAL CORTEX; PRIORITY JOURNAL; RESPONSE TIME; SIGNAL NOISE RATIO; TASK PERFORMANCE; VISUAL STIMULATION; ADOLESCENT; BRAIN MAPPING; MARKOV CHAIN; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PREFRONTAL CORTEX; PSYCHOMOTOR PERFORMANCE; YOUNG ADULT;

ADOLESCENT; ADULT; BRAIN MAPPING; COGNITION; DECISION MAKING; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MARKOV CHAINS; PREFRONTAL CORTEX; PSYCHOMOTOR PERFORMANCE; YOUNG ADULT;

EID: 84991267273     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2016.08.019     Document Type: Article

References (45)

1. Alink, A., Walther, A., Krugliak, A., van den Bosch, J.J.F., Kriegeskorte, N., Mind the drift - improving sensitivity to fMRI pattern information by accounting for temporal pattern drift. bioRxiv, 2015, 032391.
2. Barbey, A.K., Koenigs, M., Grafman, J., Orbitofrontal contributions to human working memory. Cereb. Cortex 21 (2011), 789–795.
3. Bartra, O., McGuire, J.T., Kable, J.W., The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. Neuroimage 76 (2013), 412–427.
4. Bechara, A., Damasio, H., Damasio, A.R., Emotion, decision making and the orbitofrontal cortex. Cereb. Cortex 10 (2000), 295–307.
5. Bradfield, L.A., Dezfouli, A., van Holstein, M., Chieng, B., Balleine, B.W., Medial orbitofrontal cortex mediates outcome retrieval in partially observable task situations. Neuron 88 (2015), 1268–1280.
6. Cai, M.B., Schuck, N.W., Pillow, J., Niv, Y., A Bayesian method for reducing bias in neural representational similarity analysis. bioRxiv, 2016, 10.1101/073932.
7. Cavada, C., Compañy, T., Tejedor, J., Cruz-Rizzolo, R.J., Reinoso-Suárez, F., The anatomical connections of the macaque monkey orbitofrontal cortex. A review. Cereb. Cortex 10 (2000), 220–242.
8. Chang, C.-C., Lin, C.-J., LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2 (2011), 1–27.
9. Chase, H.W., Kumar, P., Eickhoff, S.B., Dombrovski, A.Y., Reinforcement learning models and their neural correlates: An activation likelihood estimation meta-analysis. Cogn. Affect. Behav. Neurosci. 15 (2015), 435–459.
10. Daw, N.D., Niv, Y., Dayan, P., Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8 (2005), 1704–1711.
11. Dayan, P., Improving generalization for temporal difference learning: the successor representation. Neural Comput. 5 (1993), 613–624.
12. Diedrichsen, J., Ridgway, G.R., Friston, K.J., Wiestler, T., Comparing the similarity and spatial structure of neural representations: a pattern-component model. Neuroimage 55 (2011), 1665–1678.
13. Duncan, J., An adaptive coding model of neural function in prefrontal cortex. Nat. Rev. Neurosci. 2 (2001), 820–829.
14. Ebner, N.C., Riediger, M., Lindenberger, U., FACES–a database of facial expressions in young, middle-aged, and older women and men: development and validation. Behav. Res. Methods 42 (2010), 351–362.
15. Farovik, A., Place, R.J., McKenzie, S., Porter, B., Munro, C.E., Eichenbaum, H., Orbitofrontal cortex encodes memories within value-based schemas and represents contexts that guide memory retrieval. J. Neurosci. 35 (2015), 8333–8344.
16. Frey, S., Petrides, M., Orbitofrontal cortex: A key prefrontal region for encoding information. Proc. Natl. Acad. Sci. USA 97 (2000), 8723–8727.
17. Gershman, S.J., Niv, Y., Learning latent structure: carving nature at its joints. Curr. Opin. Neurobiol. 20 (2010), 251–256.
18. Glover, G.H., Li, T.Q., Ress, D., Image-based method for retrospective correction of physiological motion effects in fMRI: RETROICOR. Magn. Reson. Med. 44 (2000), 162–167.
19. Grinband, J., Wager, T.D., Lindquist, M., Ferrera, V.P., Hirsch, J., Detection of time-varying signals in event-related fMRI designs. Neuroimage 43 (2008), 509–520.
20. Howard, J.D., Gottfried, J.A., Tobler, P.N., Kahnt, T., Identity-specific coding of future rewards in the human orbitofrontal cortex. Proc. Natl. Acad. Sci. USA 112 (2015), 5195–5200.
21. Kahnt, T., Chang, L.J., Park, S.Q., Heinzle, J., Haynes, J.D., Connectivity-based parcellation of the human orbitofrontal cortex. J. Neurosci. 32 (2012), 6240–6250.
22. Klein-Flügge, M.C., Barron, H.C., Brodersen, K.H., Dolan, R.J., Behrens, T.E., Segregated encoding of reward-identity and stimulus-reward associations in human orbitofrontal cortex. J. Neurosci. 33 (2013), 3202–3211.
23. Kriegeskorte, N., Goebel, R., Bandettini, P., Information-based functional brain mapping. Proc. Natl. Acad. Sci. USA 103 (2006), 3863–3868.
24. Kriegeskorte, N., Mur, M., Bandettini, P., Representational similarity analysis - connecting the branches of systems neuroscience. Front. Syst. Neurosci., 2, 2008, 4.
25. Kringelbach, M.L., The human orbitofrontal cortex: linking reward to hedonic experience. Nat. Rev. Neurosci. 6 (2005), 691–702.
26. Kringelbach, M.L., Rolls, E.T., The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Prog. Neurobiol. 72 (2004), 341–372.
27. Lamar, M., Yousem, D.M., Resnick, S.M., Age differences in orbitofrontal activation: an fMRI investigation of delayed match and nonmatch to sample. Neuroimage 21 (2004), 1368–1376.
28. McDannald, M.A., Esber, G.R., Wegener, M.A., Wied, H.M., Liu, T.L., Stalnaker, T.A., Jones, J.L., Trageser, J., Schoenbaum, G., Orbitofrontal neurons acquire responses to ‘valueless’ Pavlovian cues during unblocking. eLife, 3, 2014, e02653.
29. McKenzie, S., Frank, A.J., Kinsky, N.R., Porter, B., Rivière, P.D., Eichenbaum, H., Hippocampal representation of related and opposing memories develop within distinct, hierarchically organized neural schemas. Neuron 83 (2014), 202–215.
30. Meunier, M., Bachevalier, J., Mishkin, M., Effects of orbital frontal and anterior cingulate lesions on object and spatial memory in rhesus monkeys. Neuropsychologia 35 (1997), 999–1015.
31. Niv, Y., Reinforcement learning in the brain. J. Math. Psychol. 53 (2009), 139–154.
32. Niv, Y., Daniel, R., Geana, A., Gershman, S.J., Leong, Y.C., Radulescu, A., Wilson, R.C., Reinforcement learning in multidimensional environments relies on attention mechanisms. J. Neurosci. 35 (2015), 8145–8157.
33. Ongür, D., Price, J.L., The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb. Cortex 10 (2000), 206–219.
34. Padoa-Schioppa, C., Assad, J.A., Neurons in the orbitofrontal cortex encode economic value. Nature 441 (2006), 223–226.
35. Padoa-Schioppa, C., Assad, J.A., The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat. Neurosci. 11 (2008), 95–102.
36. R Core Development Team. R: A language and environment for statistical computing. 2014, R Foundation for Statistical Computing, Vienna, Austria https://www.R-project.org/.
37. Schoenbaum, G., Takahashi, Y., Liu, T.L., McDannald, M.A., Does the orbitofrontal cortex signal value?. Ann. N Y Acad. Sci. 1239 (2011), 87–99.
38. Schon, K., Tinaz, S., Somers, D.C., Stern, C.E., Delayed match to object or place: an event-related fMRI study of short-term stimulus maintenance and the role of stimulus pre-exposure. Neuroimage 39 (2008), 857–872.
39. Schuck, N.W., Gaschler, R., Wenke, D., Heinzle, J., Frensch, P.A., Haynes, J.D., Reverberi, C., Medial prefrontal cortex predicts internally driven strategy shifts. Neuron 86 (2015), 331–340.
40. Stalnaker, T.A., Cooch, N.K., Schoenbaum, G., What the orbitofrontal cortex does not do. Nat. Neurosci. 18 (2015), 620–627.
41. Sutton, R.S., Barto, A.G., Reinforcement Learning: An Introduction. 1998, Cambridge University Press, Cambridge.
42. Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O., Delcroix, N., Mazoyer, B., Joliot, M., Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15 (2002), 273–289.
43. Weiskopf, N., Hutton, C., Josephs, O., Turner, R., Deichmann, R., Optimized EPI for fMRI studies of the orbitofrontal cortex: compensation of susceptibility-induced gradients in the readout direction. MAGMA 20 (2007), 39–49.
44. Wilson, R.C., Takahashi, Y.K., Schoenbaum, G., Niv, Y., Orbitofrontal cortex as a cognitive map of task space. Neuron 81 (2014), 267–279.
45. Winston, J.S., Vlaev, I., Seymour, B., Chater, N., Dolan, R.J., Relative valuation of pain in human orbitofrontal cortex. J. Neurosci. 34 (2014), 14526–14535.