Representations of appetitive and aversive information in the primate orbitofrontal cortex

Annals of the New York Academy of Sciences

Volumn 1239, Issue 1, 2011, Pages 59-70

  Morrison, Sara E ^a,c   Salzman, C Daniel ^a,b  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b NEW YORK STATE PSYCHIATRIC INSTITUTE   (United States)

^c ALBERT EINSTEIN COLLEGE OF MEDICINE   (United States)

Author keywords

Aversive; Conditioning; Monkey; Orbitofrontal cortex; Reinforcement learning; Reward

Indexed keywords

AMYGDALOID NUCLEUS; APPETITE; ARTICLE; AVERSIVE BEHAVIOR; BRAIN DEPTH STIMULATION; BRAIN NERVE CELL; LEARNING; NONHUMAN; ORBITAL CORTEX; PRIMATE;

EID: 83155184722     PISSN: 00778923     EISSN: 17496632     Source Type: Book Series    
DOI: 10.1111/j.1749-6632.2011.06255.x     Document Type: Article

References (61)

1. Solomon, R.L. & J.D. Corbit. 1974. An opponent-process theory of motivation. I. Temporal dynamics of affect. Psychol. Rev. 81: 119-145.
2. Grossberg, S. 1984. Some normal and abnormal behavioral syndromes due to transmitter gating of opponent processes. Biol. Psychiatry 19: 1075-1118.
3. Daw, N.D., S. Kakade & P. Dayan. 2002. Opponent interactions between serotonin and dopamine. Neural Netw. 15: 603-616.
4. Paton, J., M. Belova, S. Morrison & C. Salzman. 2006. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439: 865-870.
5. Ghashghaei, H. & H. Barbas. 2002. Pathways for emotion: interactions of prefrontal and anterior temporal pathways in the amygdala of the rhesus monkey. Neuroscience 115: 1261-1279.
6. Carmichael, S.T. & J.L. Price. 1995. Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J. Comp. Neurol. 363: 615-641.
7. Ghashghaei, H.T., C.C. Hilgetag & H. Barbas. 2007. Sequence of information processing for emotions based on the anatomic dialogue between prefrontal cortex and amygdala. Neuroimage 34: 905-923.
8. Mainen, Z.F. & A. Kepecs. 2009. Neural representation of behavioral outcomes in the orbitofrontal cortex. Curr. Opin. Neurobiol. 19: 84-91.
9. Montague, P.R. & G.S. Berns. 2002. Neural economics and the biological substrates of valuation. Neuron 36: 265-284.
10. Izquierdo, A., R.K. Suda & E.A. Murray. 2004. Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J. Neurosci. 24: 7540-7548.
11. Murray, E.A. & S.P. Wise. 2010. Interactions between orbital prefrontal cortex and amygdala: advanced cognition, learned responses and instinctive behaviors. Curr. Opin. Neurobiol. 20: 212-220.
12. O'Doherty, J.P. 2007. Lights, camembert, action! The role of human orbitofrontal cortex in encoding stimuli, rewards, and choices. Ann. N. Y. Acad. Sci. 1121: 254-272.
13. Carmichael, S.T. & J.L. Price. 1995. Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol. 363: 642-664.
14. Cavada, C., T. Company, J. Tejedor, et al. 2000. The anatomical connections of the macaque monkey orbitofrontal cortex. A review. Cereb. Cortex 10: 220-242.
15. Romanski, L.M., J.F. Bates & P.S. Goldman-Rakic. 1999. Auditory belt and parabelt projections to the prefrontal cortex in the rhesus monkey. J. Comp. Neurol. 403: 141-157.
16. Haber, S.N., K. Kunishio, M. Mizobuchi & E. Lynd-Balta. 1995. The orbital and medial prefrontal circuit through the primate basal ganglia. J. Neurosci. 15: 4851-4867.
17. Kondo, H., K.S. Saleem & J.L. Price. 2005. Differential connections of the perirhinal and parahippocampal cortex with the orbital and medial prefrontal networks in macaque monkeys. J. Comp. Neurol. 493: 479-509.
18. Barbas, H. & G.J. Blatt. 1995. Topographically specific hippocampal projections target functionally distinct prefrontal areas in the rhesus monkey. Hippocampus 5: 511-533.
19. Ongur, D., X. An & J.L. Price. 1998. Prefrontal cortical projections to the hypothalamus in macaque monkeys. J. Comp. Neurol. 401: 480-505.
20. Rempel-Clower, N.L. & H. Barbas. 1998. Topographic organization of connections between the hypothalamus and prefrontal cortex in the rhesus monkey. J. Comp. Neurol. 398: 393-419.
21. Morrison, S.E. & C.D. Salzman. 2009. The convergence of information about rewarding and aversive stimuli in single neurons. J. Neurosci. 29: 11471-11483.
22. Belova, M.A., J.J. Paton & C.D. Salzman. 2008. Moment-to-moment tracking of state value in the amygdala. J. Neurosci. 28: 10023-10030.
23. Chudasama, Y. & T.W. Robbins. 2003. Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J. Neurosci. 23: 8771-8780.
24. Fellows, L.K. & M.J. Farah. 2003. Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. Brain 126: 1830-1837.
25. Schoenbaum, G., B. Setlow, S.L. Nugent, et al. 2003. Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. Learn Mem. 10: 129-140.
26. Iversen, S.D. & M. Mishkin. 1970. Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity. Exp. Brain Res. 11: 376-386.
27. Ongur, D. & J.L. Price. 2000. The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb. Cortex 10: 206-219.
28. Salzman, C.D. & S. Fusi. 2010. Emotion, cognition, and mental state representation in amygdala and prefrontal cortex. Annu. Rev. Neurosci. 33: 173-202.
29. Thorpe, S.J., E.T. Rolls & S. Maddison. 1983. The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp. Brain Res. 49: 93-115.
30. Schoenbaum, G., A. Chiba & M. Gallagher. 1998. Orbitalfrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat. Neurosci. 1: 155-159.
31. Tremblay, L. & W. Schultz. 1999. Relative reward preference in primate orbitofrontal cortex. Nature 398: 704-708.
32. Tremblay, L. & W. Schultz. 2000. Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J. Neurophysiol. 83: 1864-1876.
33. Wallis, J.D. & E.K. Miller. 2003. Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur. J. Neurosci. 18: 2069-2081.
34. Roesch, M.R. & C.R. Olson. 2004. Neuronal activity related to reward value and motivation in primate frontal cortex. Science 304: 307-310.
35. Padoa-Schioppa, C. & J.A. Assad. 2006. Neurons in the orbitofrontal cortex encode economic value. Nature 441: 223-226.
36. Kennerley, S.W., A.F. Dahmubed, A.H. Lara & J.D. Wallis. 2009. Neurons in the frontal lobe encode the value of multiple decision variables. J. Cogn. Neurosci. 21: 1162-1178.
37. Padoa-Schioppa, C. & J.A. Assad. 2008. The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat. Neurosci. 11: 95-102.
38. Roesch, M.R., A.R. Taylor & G. Schoenbaum. 2006. Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation [see comment]. Neuron 51: 509-520.
39. Roesch, M.R. & C.R. Olson. 2005. Neuronal activity in primate orbitofrontal cortex reflects the value of time. J. Neurophysiol. 94: 2457-2471.
40. Feierstein, C.E., M.C. Quirk, N. Uchida, et al. 2006. Representation of spatial goals in rat orbitofrontal cortex [see comment]. Neuron 51: 495-507.
41. Burke, K.A., T.M. Franz, D.N. Miller & G. Schoenbaum. 2008. The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards. Nature 454: 340-344.
42. Kennerley, S.W. & J.D. Wallis. 2009. Encoding of reward and space during a working memory task in the orbitofrontal cortex and anterior cingulate sulcus. J. Neurophysiol. 102: 3352-3364.
43. Hosokawa, T., K. Kato, M. Inoue & A. Mikami. 2007. Neurons in the macaque orbitofrontal cortex code relative preference of both rewarding and aversive outcomes. Neurosci. Res. 57: 434-445.
44. Kim, H., S. Shimojo & J.P. O'Doherty. 2006. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol. 4: e233.
45. Seymour, B. et al. 2005. Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat. Neurosci. 8: 1234-1240.
46. Belova, M.A., J.J. Paton, S.E. Morrison & C.D. Salzman. 2007. Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala. Neuron 55: 970-984.
47. Morrison, S.E., A. Saez, B. Lau & C.D. Salzman. 2011. Different time courses for learning-related changes in amygdala and orbitofrontal cortex. Neuron 71: 1127-1140.
48. Sutton, R. & A. Barto. 1998. Reinforcement Learning. MIT Press. Cambridge, MA.
49. Dayan, P. & L.F. Abbott. 2001. Theoretical Neuroscience. MIT Press. Cambridge, MA.
50. Dayan, P. & B.W. Balleine. 2002. Reward, motivation, and reinforcement learning. Neuron 36: 285-298.
51. Dayan, P. & Y. Niv. 2008. Reinforcement learning: the good, the bad and the ugly. Curr. Opin. Neurobiol. 18: 185-196.
52. Burke, K.A., T.M. Franz, D.N. Miller & G. Schoenbaum. 2007. Conditioned reinforcement can be mediated by either outcome-specific or general affective representations. Front. Integr. Neurosci. 1: 2.
53. Daw, N.D., Y. Niv & P. Dayan. 2005. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8: 1704-1711.
54. Preuss, T.M. 1995. Do rats have prefrontal cortex? The Rose-Woolsey-Akert program reconsidered. J. Cogn. Neurosci. 7: 1-24.
55. Schoenbaum, G. & M. Roesch. 2005. Orbitofrontal cortex, associative learning, and expectancies. Neuron 47: 633-636.
56. Schoenbaum, G., M.R. Roesch, T.A. Stalnaker & Y.K. Takahashi. 2009. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat. Rev. Neurosci. 10: 885-892.
57. Wise, S.P. 2008. Forward frontal fields: phylogeny and fundamental function. Trends Neurosci. 31: 599-608.
58. Rangel, A., C. Camerer & P.R. Montague. 2008. A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9: 545-556.
59. Sugrue, L.P., G.S. Corrado & W.T. Newsome. 2005. Choosing the greater of two goods: neural currencies for valuation and decision making. Nat. Rev. Neurosci. 6: 363-375.
60. Kable, J.W. & P.W. Glimcher. 2009. The neurobiology of decision: consensus and controversy. Neuron 63: 733-745.
61. Ishiwari, K., S.M. Weber, S. Mingote, et al. 2004. Accumbens dopamine and the regulation of effort in food-seeking behavior: modulation of work output by different ratio or force requirements. Behav. Brain Res. 151: 83-91.