Back to basics: Making predictions in the orbitofrontal-amygdala circuit

Neurobiology of Learning and Memory

Volumn 131, Issue , 2016, Pages 201-206

  Sharpe, Melissa J ^a,b   Schoenbaum, Geoffrey ^a,c,d  

^a NATIONAL INSTITUTE ON DRUG ABUSE   (United States)

^b PRINCETON UNIVERSITY   (United States)

^c UNIVERSITY OF MARYLAND SCHOOL OF MEDICINE   (United States)

^d JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Associative learning; Basolateral amygdala; Orbitofrontal cortex; State specific learning

Indexed keywords

AMYGDALOID NUCLEUS; BASOLATERAL AMYGDALA; BEHAVIOR; HUMAN; HUMAN VERSUS ANIMAL COMPARISON; LEARNING; NERVE CELL; ORBITAL CORTEX; PREDICTION; STIMULUS; ANIMAL; ASSOCIATIVE LEARNING; PHYSIOLOGY; PREFRONTAL CORTEX;

ANIMALS; ASSOCIATION LEARNING; BASOLATERAL NUCLEAR COMPLEX; HUMANS; PREFRONTAL CORTEX;

EID: 84992302729     PISSN: 10747427     EISSN: 10959564     Source Type: Journal    
DOI: 10.1016/j.nlm.2016.04.009     Document Type: Review

References (59)

1. Aggleton J.P., Burton M.J., Passingham R.E. Cortical and subcortical afferents to the amygdala of the rhesus monkey (Macaca mulatta). Brain Research 1980, 190:347-368.
2. Baxter M.G., Parker A., Lindner C.C., Izquierdo A.D., Murray E.A. Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. Journal of Neuroscience 2000, 20:4311-4319.
3. Belova M.A., Paton J.J., Salzman C.D. Moment-to-moment tracking of state value in the amygdala. Journal of Neuroscience 2008, 28:10023-10030.
4. Bermudez M.A., Schultz W. Responses of amygdala neurons to positive reward-predicting stimuli depend on background reward (contingency) rather than stimulus-reward pairing (contiguity). Journal of Neurophysiology 2009, 103:1158-1170.
5. Blundell P., Hall G., Killcross S. Lesions of the basolateral amygdala disrupt selective aspects of reinforcer representation in rats. Journal of Neuroscience 2001, 21:9018-9026.
6. Bouret S., Richmond B.J. Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. Journal of Neuroscience 2010, 30:8591-8601.
7. Bradfield L.A., Dezfouli A., van Holstein M., Chieng B., Balleine B.W. Medial orbitofrontal cortex mediates outcome retrieval in partially observable task situations. Neuron 2015, 88:1268-1280.
8. Butter C.M. Perseveration in extinction and in discrimination reversal tasks following selective frontal ablations in Macaca mulatta. Physiology & Behavior 1969, 4:163-171.
9. Critchley H.D., Rolls E.T. Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. Journal of Neurophysiology 1996, 75:1673-1686.
10. Falls W.A., Miserendino M.J.D., Davis M. Extinction of fear-potentiated startle - Blockade by infusion of an NMDA antagonist into the amygdala. Journal of Neuroscience 1992, 12:854-863.
11. Gottfried J.A. Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science 2003, 301:1104-1107.
12. Gottfried J.A., Dolan R.J. Human orbitofrontal cortex mediates extinction learning while accessing conditioned representations of value. Nature Neuroscience 2004, 7:1144-1152.
13. Hampton A.N., Adolphs R., Tyszka J.M., O'Doherty J.P. Contributions of the amygdala to reward expectancy and choice signals in human prefrontal cortex. Neuron 2007, 55:545-555.
14. Howard J.D., Gottfried J.A., Tobler P.N., Kahnt T. Identity-specific coding of future rewards in the human orbitofrontal cortex. Proceedings of the National Academy of Science 2015, 112:5195-5200.
15. Jang A.I., Costa V.D., Rudebeck P.H., Chudasama Y., Murray E.A., Averbeck B.B. The role of frontal cortical and medial-temporal lobe brain areas in learning a Bayesian prior belief on reversals. Journal of Neuroscience 2015, 35:11751-11760.
16. Johnson A.W., Gallagher M., Holland P.C. The basolateral amygdala is critical to the expression of pavlovian and instrumental outcome-specific reinforcer devaluation effects. Journal of Neuroscience 2009, 29:696-704.
17. Jones J.L., Esber G.R., McDannald M.A., Gruber A.J., Hernandez A., Mirenzi A., Schoenbaum G. Orbitofrontal cortex supports behavior and learning using inferred but not cached values. Science 2012, 338:953-956.
18. Kennerley S.W., Wallis J.D. Encoding of reward and space during a working memory task in the orbitofrontal cortex and anterior cingulate sulcus. Journal of Neurophysiology 2009, 102:3352-3364.
19. Killcross S., Robbins T.W., Everitt B.J. Different types of fear-conditioned behaviour mediated by separate nuclei within amygdala. Nature 1997, 388:377-380.
20. Klein-Flugge M.C., Barron H.C., Brodersen K.H., Dolan R.J., Behrens T.E.J. Segregated encoding of reward-identity and stimulus-reward associations in human orbitofrontal cortex. Journal of Neuroscience 2013, 33:3202-3211.
21. Laurent V., Westbrook R.F. Distinct contributions of the basolateral amygdala and the medial prefrontal cortex to learning and relearning extinction of context conditioned fear. Learning & Memory 2008, 15:657-666.
22. Lingawi N.W., Balleine B.W. Amygdala central nucleus interacts with dorsolateral striatum to regulate the acquisition of habits. Journal of Neuroscience 2012, 32:1073-1081.
23. Lopatina N., McDannald M.A., Styer C.V., Sadacca B.F., Cheer J.F., Schoenbaum G. Lateral orbitofrontal neurons acquire responses to upshifted, downshifted, or blocked cues during unblocking. eLife 2015, 4.
24. Lucantonio F., Gardner M.P.H., Mirenzi A., Newman L.E., Takahashi Y.K., Schoenbaum G. Neural estimates of imagined outcomes in basolateral amygdala depend on orbitofrontal cortex. Journal of Neuroscience 2015, 35:16521-16530.
25. Machado C.J., Bachevalier J. The effects of selective amygdala, orbital frontal cortex or hippocampal formation lesions on reward assessment in nonhuman primates. European Journal of Neuroscience 2007, 25:2885-2904.
26. McDannald M.A., Esber G.R., Wegener M.A., Wied H.M., Liu T.-L., Stalnaker T.A., Schoenbaum G. Orbitofrontal neurons acquire responses to 'valueless' Pavlovian cues during unblocking. eLife 2014, 3.
27. McDannald M.A., Lucantonio F., Burke K.A., Niv Y., Schoenbaum G. Ventral striatum and orbitofrontal cortex are both required for model-based, but not model-free, reinforcement learning. Journal of Neuroscience 2011, 31:2700-2705.
28. Morecraft R.J., Geula C., Mesulam M.M. Cytoarchitecture and neural afferents of orbitofrontal cortex in the brain of the monkey. The Journal of Comparative Neurology 1992, 323:341-358.
29. Ostlund S.B., Balleine B.W. Orbitofrontal cortex mediates outcome encoding in pavlovian but not instrumental conditioning. Journal of Neuroscience 2007, 27:4819-4825.
30. Padoa-Schioppa C., Assad J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 2006, 441:223-226.
31. Panayi M.C., Killcross S. Orbitofrontal cortex inactivation impairs between- but not within-session Pavlovian extinction: An associative analysis. Neurobiology of Learning and Memory 2014, 108:78-87.
32. Parkes S.L., Balleine B.W. Incentive memory: Evidence the basolateral amygdala encodes and the insular cortex retrieves outcome values to guide choice between goal-directed actions. Journal of Neuroscience 2013, 33:8753-8763.
33. Paton J.J., Belova M.A., Morrison S.E., Salzman C.D. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 2006, 439:865-870.
34. Pickens C.L., Saddoris M.P., Gallagher M., Holland P.C. Orbitofrontal lesions impair use of cue-outcome associations in a devaluation task. Behavioral Neuroscience 2005, 119:317-322.
35. Pickens C.L., Saddoris M.P., Setlow B., Gallagher M., Holland P.C., Schoenbaum G. Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. Journal of Neuroscience 2003, 23:11078-11084.
36. Rolls E.T. The orbitofrontal cortex. Philosophical Transactions of the Royal Society of London B 1996, 351:1433-1443.
37. Rolls E.T., Critchley H.D., Mason R., Wakeman E.A. Orbitofrontal cortex neurons: Role in olfactory and visual association learning. Journal of Neurophysiology 1996, 75:1970-1981.
38. Rudebeck P.H., MItz A.R., Chacko R.V., Murray E.A. Effects of amygdala lesions on reward-value coding in orbital and medial prefrontal cortex. Neuron 2013, 80:1519-1531.
39. Rudebeck P.H., Mitz A.R., Chacko R.V., Murray E.A. Effects of amygdala lesions on reward-value coding in orbital and medial prefrontal cortex. Neuron 2013, 80:1519-1531.
40. Rudebeck P.H., Murray E.A. Amygdala and orbitofrontal cortex lesions differentially influence choices during object reversal learning. Journal of Neuroscience 2008, 28:8338-8343.
41. Rudebeck P.H., Murray E.A. Dissociable effects of subtotal lesions within the macaque orbital prefrontal cortex on reward-guided behavior. Journal of Neuroscience 2011, 31:10569-10578.
42. Rudebeck P.H., Saunders R.C., Prescott A.T., Chau L.S., Murray E.A. Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating. Nature Neuroscience 2013, 16:1140-1145.
43. Samuelsen C.L., Gardner M.P.H., Fontanini A. Effects of cue-triggered expectation on cortical processing of taste. Neuron 2012, 74:410-422.
44. Schoenbaum G., Chiba A.A., Gallagher M. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nature Neuroscience 1998, 1:155-159.
45. Schoenbaum G., Chiba A.A., Gallagher M. Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning. Journal of Neuroscience 1999, 19:1876-1884.
46. Schoenbaum G., Chiba A.A., Gallagher M. Changes in functional connectivity in orbitofrontal cortex and basolateral amygdala during learning and reversal training. Journal of Neuroscience 2000, 20:5179-5189.
47. Schoenbaum G., Eichenbaum H. Information coding in the rodent prefrontal cortex. 1. Single-neuron activity in orbitofrontal cortex compared with that in pyriform cortex. Journal of Neurophysiology 1995, 74:733-750.
48. Schoenbaum G., Nugent S.L., Saddoris M.P., Setlow B. Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations. NeuroReport 2002, 13:885-890.
49. Schoenbaum G., Setlow B., Saddoris M.P., Gallagher M. Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala. Neuron 2003, 39:855-867.
50. Schoenbaum G., Stalnaker T.A., Niv Y. How did the chicken cross the road? With her striatal cholinergic interneurons, of course. Neuron 2013, 79:3-6.
51. Sharpe M.J., Wikenheiser A.M., Niv Y., Schoenbaum G. The state of the orbitofrontal cortex. Neuron 2015, 88:1075-1077.
52. Thorpe S.J., Rolls E.T., Maddison S. The orbitofrontal cortex: Neuronal activity in the behaving monkey. Experimental Brain Research 1983, 49:93-115.
53. Tremblay L., Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 1999, 398:704-708.
54. Tremblay L., Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. Journal of Neurophysiology 2000, 83:1877-1885.
55. Wallis J.D., Miller E.K. Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. European Journal of Neuroscience 2003, 18:2069-2081.
56. Walton M.E., Behrens T.E.J., Buckley M.J., Rudebeck P.H., Rushworth M.F.S. Separable learning systems in the macaque brain and the role of the orbitofrontal cortex in contingent learning. Neuron 2010, 65:927-939.
57. Wellman L.L., Gale K., Malkova L. GABAA-mediated inhibition of basolateral amygdala blocks reward devaluation in macaques. Journal of Neuroscience 2005, 25:4577-4586.
58. West E.A., DesJardin J.T., Gale K., Malkova L. Transient inactivation of orbitofrontal cortex blocks reinforcer devaluation in macaques. Journal of Neuroscience 2011, 31:15128-15135.
59. Wilson R.C., Takahashi Y.K., Schoenbaum G., Niv Y. Orbitofrontal cortex as a cognitive map of task space. Neuron 2014, 81:267-279.