Complexity and competition in appetitive and aversive neural circuits

Frontiers in Neuroscience

Volumn , Issue NOV, 2012, Pages

  Barberini, Crista L ^a   Morrison, Sara E ^b   Saez, Alex ^a   Lau, Brian ^c   Salzman, C Daniel ^a,d  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b ALBERT EINSTEIN COLLEGE OF MEDICINE   (United States)

^c INSTITUT DU CERVEAU ET DE LA MOELLE ÉPINIÈRE   (France)

^d NEW YORK STATE PSYCHIATRIC INSTITUTE   (United States)

Author keywords

Amygdala; Orbitofrontal cortex; Punishment; Reward; Value processing

Indexed keywords

AMYGDALOID NUCLEUS; APPETITE; ARTICLE; AVERSION; COMPETITION; DECISION MAKING; HUMAN; LEARNING; NONHUMAN; ORBITAL CORTEX; PUNISHMENT; REINFORCEMENT; REWARD;

EID: 84870953124     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2012.00170     Document Type: Article

References (94)

1. Amaral, D. G., Behniea, H., and Kelly, J. L. (2003). Topographic organization of projections from the amygdala to the visual cortex in the macaque monkey. Neuroscience 118, 1099-1120.
2. Amemori, K., and Graybiel, A. M. (2012). Localized microstimulation of primate pregenual cingulate cortex induces negative decision-making. Nat. Neurosci. 15, 776-785.
3. Anderson, A. K. (2005). Affective influences on the attentional dynamics supporting awareness. J. Exp. Psy-chol. Gen. 134,258-281.
4. Anderson, B. A., Laurent, P. A., and Yantis, S. (2011). Value-driven attentional capture. Proc. Natl. Acad. Sci. U.S.A. 108, 10367-10371.
5. Armony, J. L., and Dolan, R. J. (2002). Modulation of spatial attention by fear-conditioned stimuli: an event-related fMRI study. Neuropsycholo-gia 40, 814-826.
6. Baxter, M., and Murray, E. A. (2002). The amygdala and reward. Nat. Rev. Neurosci. 3, 563-573.
7. Bechara, A., Damasio, H., and Dama-sio, A. R. (2000). Emotion, decision making and the orbitofrontal cortex. Cereb. Cortex 10,295-307.
8. Belova, M. A., Paton, J. J., Morrison, S. E., and Salzman, C. D. (2007). Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala. Neuron 55, 970-984.
9. Belova, M. A., Paton, J. J., and Salzman, C. D. (2008). Moment-to-moment tracking of state value in the amygdala. J. Neurosci. 28, 10023-10030.
10. Berlin, H. A., Rolls, E. T., and Iversen, S. D. (2005). Borderline personality disorder, impulsivity, and the orbitofrontal cortex. Am. J. Psychi-atry 162,2360-2373.
11. Bisley, J. W., Krishna, B. S., and Goldberg, M. E. (2004). A rapid and precise on-response in posterior parietal cortex. J. Neurosci. 24, 1833-1838.
12. Brosch, T., Sander, D., Pourtois, G., and Scherer, K. R. (2008). Beyond fear: rapid spatial orienting toward positive emotional stimuli. Psychol Sci. 19, 362-370.
13. Brovelli, A., Ding, M., Ledberg, A., Chen, Y., Nakamura, R., and Bressler, S. L. (2004). Beta oscillations in a large-scale sensorimotor cortical network: directional influences revealed by Granger causality. Proc. Natl Acad. Sci. U.S.A. 101, 9849-9854.
14. Carmichael, S. T., and Price, J. L. (1995). Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J. Comp. Neurol. 363, 615-641.
15. Chamberlain, S. R., Menzies, L., Hampshire, A., Suckling, J., Fineberg, N. A., Del Campo, N., et al. (2008). Orbitofrontal dysfunction in patients with obsessive-compulsive disorder and their unaffected relatives. Science 321, 421-422.
16. Chudasama, Y., and Robbins, T. W. (2003). Dissociable contributions of the orbitofrontal and infralim-bic cortex to pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J. Neurosci. 23, 8771-8780.
17. Damasio, A. R. (1994). Descartes Error. New York: G.P. Putnam.
18. Damasio, H., Grabowski, T., Frank, R., Galaburda, A. M., and Damasio, A. R. (1994). The return of Phineas Gage: clues about the brain from the skull of a famous patient. Science 264, 1102-1105.
19. Davis, M. (1992)."The role of the amygdala in conditioned fear," in The Amygdala: Neurological Aspects of Emotion, Memory, and Mental Dysfunction, ed. J. Aggleton (Hoboken, NJ: John Wiley & Sons), 255-306.
20. Daw, N. D., Kakade, S., and Dayan, P. (2002). Opponent interactions between serotonin and dopamine. NeuralNetw. 15,603-616.
21. De Martino, B., Kumaran, D., Seymour, B., and Dolan, R. J. (2006). Frames, biases, and rational decision-making in the human brain. Science 313, 684-687.
22. Dickinson, A., and Dearing, M. F. (1979). "Appetitive-aversive interactions and inhibitory processes," in Mechanisms of Learning and Motivation, eds A. Dickinson and R. A. Boakes (Hillsdale, NJ: Erlbaum), 203-231.
23. Everitt, B. J., Cardinal, R. N., Parkinson, J. A., and Robbins, T. W. (2003). Appetitive behaviour: impact of amygdala-dependent mechanisms of emotional learning. Ann. N Y. Acad. Sci. 985, 233-250.
24. Fellows, L. K., and Farah, M. J. (2003). Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. Brain 126,1830-1837.
25. Freese, J. L., and Amaral, D. G. (2005). The organization of projections from the amygdala to visual cortical areas TE and V1 in the macaque monkey. J. Comp. Neurol. 486,295-317.
26. Ghahremani, D. G., Monterosso, J., Jentsch, J. D., Bilder, R. M., and Pol-drack, R. A. (2010). Neural components underlying behavioral flexibility in human reversal learning. Cereb. Cortex20,1843-1852.
27. Ghashghaei, H. T., Hilgetag, C. C., and Barbas, H. (2007). Sequence of information processing for emotions based on the anatomic dialogue between prefrontal cortex and amygdala. Neuroimage 34, 905-923.
28. Granger, C. W. J. (1969). Investigating causal relationships by econometric models and cross-spectral methods. Econometrica 37, 424-438.
29. Greene, J., and Haidt, J. (2002). How (and where) does moral judgment work? Trends Cogn. Sci. (Regul. Ed.) 6,517-523.
30. Grossberg, A. (1984). Some normal and abnormal behavioral syndromes due to transmitter gating of opponent processes. Biol Psychiatry 19, 1075-1118.
31. Hampshire, A., Gruszka, A., Fallon, S. J., and Owen, A. M. (2008). Inefficiency in self-organized attentional switching in the normal aging population is associated with decreased activity in the ventrolateral prefrontal cortex. J. Cogn. Neurosci. 20, 1670-1686.
32. Hasegawa, R. P., Peterson, B. W., and Goldberg, M. E. (2004). Prefrontal neurons coding suppression of specific saccades. Neuron 43,415-425.
33. Holland, P. C., and Gallagher, M. (1999). Amygdala circuitry in attentional and representational processes. Trends Cogn. Sci. (Regul. Ed.) 3, 65-73.
34. Hornak, J., O'Doherty, J., Bramham, J., Rolls, E. T., Morris, R. G., Bullock, P. R., et al. (2004). Reward-related reversal learning after surgical excisions in orbito-frontal or dorsolat-eral prefrontal cortex in humans. J. Cogn. Neurosci. 16, 463-478.
35. Ilango, A., Wetzel, W., Scheich, H., and Ohl, F. W. (2010). The combination of appetitive and aversive reinforcers and the nature of their interaction during auditory learning. Neuroscience 166, 752-762.
36. Iversen, S. D., and Mishkin, M. (1970). Perseverative interference in monkeys following selective lesions of inferior prefrontal convexity. Exp. Brain Res. 11,376-386.
37. Izquierdo, A., and Murray, E. A. (2007). Selective bilateral amygdala lesions in rhesus monkeys fail to disrupt object reversal learning. J. Neurosci. 27,1054-1062.
38. Izquierdo, A., Suda, R. K., and Murray, E. A. (2004). Bilateral orbital prefrontal cortexlesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J. Neurosci. 24, 7540-7548.
39. Kable, J. W., and Glimcher, P. W. (2007). The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10,1625-1633.
40. Kahneman, D., and Tversky, A. (2000). Choices, Values and Frames. New York: Cambridge University Press.
41. Kim, H., Shimogo, S., and O'Doherty, J. P. (2006). Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol. 4, e233. doi:10.1371/journal.pbio.0040233
42. Konorski, J. (1967). Integrative Activity of the Brain: An Interdisciplinary Approach. Chicago, IL: University of Chicago Press.
43. Lang, P. J., and Davis, M. (2006). Emotion, motivation, and the brain: reflex foundations in animal and human research. Prog. Brain Res. 156, 3-29.
44. LeDoux, J. E. (2000). Emotion circuits in the brain. Annu. Rev. Neurosci. 23, 155-184.
45. Loewenstein, G. F., Weber, E. U., Hsee, C K., and Welch, N. (2001). Risk as feelings. Psychol. Bull. 127, 267-286.
46. Maren, S., and Quirk, G. J. (2004). Neu-ronal signalling of fear memory. Nat. Rev. Neurosci. 5, 844-852.
47. Matsumoto, M., and Hikosaka, O. (2007). Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447, 1111-1115.
48. Matsumoto, M., and Hikosaka, O. (2008). Negative motivational control of saccadic eye movement by the lateral habenula. Prog. Brain Res. 171, 399-402.
49. Matsumoto, M., and Hikosaka, O. (2009). Representation of negative motivational value in the primate lateral habenula. Nat. Neurosci. 12, 77-84.
50. McClure, S. M., Ericson, K. M., Laibson, D I., Loewenstein, G., and Cohen, J. D. (2007). Time discounting for primary rewards. J. Neurosci. 27, 5796-5804.
51. McClure, S. M., Laibson, D. I., Loewenstein, G., and Cohen, J. D. (2004). Separate neural systems value immediate and delayed monetary rewards. Science 306, 503-507.
52. McDonald, A. J. (1991). Organization of amygdaloid projections to the prefrontal cortex and associated stria-tum in the rat. Neuroscience 44, 1-44.
53. McDonald, A. J. (1998). Cortical pathways to the mammalian amygdala. Prog. Neurobiol. 55, 257-332.
54. McNeil, B. J., Pauker, S. G., Sox, H. C. Jr., and Tversky, A. (1982). On the elicitation of preferences for alternative therapies. N Engl. J. Med. 306, 1259-1262.
55. Mirenowicz, J., and Schultz, W. (1996). Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379,449-451.
56. Morrison, S. E., Saez, A., Lau, B., and Salzman, C. D. (2011). Different time courses for learning-related changes in amygdala and orbitofrontal cortex. Neuron 71, 1127-1140.
57. Morrison, S. E., and Salzman, C. D. (2009). The convergence of information about rewarding and aversive stimuli in single neurons. J. Neurosci. 29,11471-11483.
58. Morrison, S. E., and Salzman, C. D. (2010). Re-valuing the amygdala. Curr. Opin. Neurobiol. 20, 221-230.
59. Morrison, S. E., and Salzman, C. D (2011). Representations of appetitive and aversive informa tion in the primate orbitofrontal cortex. Ann. N Y. Acad. Sci. 1239, 59-70.
60. Nishijo, H., Hori, E., Tazumi, T., and Ono, T. (2008). Neural correlates to both emotion and cognitive functions in the monkey amygdala. Behav. Brain Res. 188, 14-23.
61. Nishijo, H., Ono, T., and Nishino, H. (1988). Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance. J. Neurosci. 8, 3570-3583.
62. Ochsner, K. N., and Gross, J. J. (2005). The cognitive control of emotion. Trends Cogn. Sci. (Reugul. Ed.) 9, 242-249.
63. O'Doherty, J., Kringelbach, M. L., Rolls, E T., Hornak, J., and Andrews, C. (2001). Abstract reward and punish ment representations in the human orbitofrontal cortex. Nat. Neurosci. 4, 95-102.
64. Padoa-Schioppa, C. (2009). Range-adapting representation of economic value in the orbitofrontal cortex. J. Neurosci. 29,14004-14014.
65. Padoa-Schioppa, C. (2011). Neurobi-ology of economic choice: a good-based model. Annu. Rev. Neurosci. 34, 333-359.
66. Padoa-Schioppa, C., and Assad, J. A. (2006). Neurons in the orbitofrontal cortex encode economic value. Nature 441,223-226.
67. Paton, J. J., Belova, M. A., Morrison, S. E., and Salzman, C. D. (2006). The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439, 865-870.
68. Peck, C. J., Jangraw, D. C., Suzuki, M., Efem, R., and Gottlieb, J. (2009). Reward modulates attention independently of action value in posterior parietal cortex. J. Neurosci. 29, 11182-11191.
69. Phelps, E. A., Ling, S., and Carrasco, M. (2006). Emotion facilitates perception and potentiates the perceptual benefits of attention. Psychol. Sci. 17, 292-299.
70. Pinkham, A. E., Griffin, M., Baron, R., Sasson, N. J., and Gur, R. C. (2010). The face in the crowd effect: anger superiority when using real faces and multiple identities. Emotion 10, 141-146.
71. Roberts, N. A., Beer, J. S., Werner, K. H., Scabini, D., Levens, S. M., Knight, R. T., et al. (2004). The impact of orbitofrontal prefrontal cortex damage on emotional activation to unanticipated and anticipated acoustic startle stimuli. Cogn. Affect. Behav. Neurosci. 4, 307-316.
72. Rolls, E. (2000). "Neurophysiology and functions of the primate amygdala, and the neural basis of emotion," in The Amygdala: A Functional Analy-sis, ed. J.Aggleton (New York: Oxford University Press), 447-478.
73. Rolls, E. T. (1996). The orbitofrontal cortex. Philos. Trans. R. Soc. Lond. B Biol. Sci. 351,1433-1443.
74. Romanski, L. M., Clugnet, M. C., Bordi, F., and LeDoux, J. E. (1993). Somatosensory and auditory convergence in the lateral nucleus of the amygdala. Behav. Neurosci. 107, 444-450.
75. Saddoris, M. P., Gallagher, M., and Schoenbaum, G. (2005). Rapid associative encoding in basolateral amygdala depends on connections with orbitofrontal cortex. Neuron 46,321-331.
76. Salzman, C. D., and Fusi, S. (2010). Emotion, cognition, and mental state representation in amygdala and prefrontal cortex. Annu. Rev. Neurosci. 33, 173-202.
77. Salzman, C. D., Paton, J. J., Belova, M. A., and Morrison, S. E. (2007). Flexible neural representations of value in the primate brain. Ann. N. Y.Acad. Sci. 1121,336-354.
78. Sanghera, M. K., Rolls, E. T., and Roper-Hall, A. (1979). Visual responses of neurons in the dorsolateral amygdala of the alert monkey. Exp. Neurol. 63, 610-626.
79. Schoenbaum, G., Chiba, A., and Gallagher, M. (1998). Orbitalfrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat. Neurosci. 1, 155-159.
80. Schoenbaum, G., Nugent, S. L., Saddoris, M. P., and Setlow, B. (2002). Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations. Neu-roreport 13, 885-890.
81. Schoenbaum, G., Setlow, B., Saddoris, M. P., and Gallagher, M. (2003). Encoding predicted outcome and acquired value in orbitofrontal cortex during due sampling depends upon input from basolateral amygdala. Neuron 39, 855-867.
82. Schoer, R., Paton, J. J., and Salzman, C. D. (2009). Activity of amygdala and orbitofrontal cortical neurons during contrast revaluation of reward predicting stimuli. Program No. 784.17. 2009 Neuroscience Meeting Planner. Chicago, IL: Society for Neuroscience Abstracts Online.
83. Schoer, R., Saez, A., and Salzman, C. D. (2011). Amygdala neurons adap-tively encode the motivational significance of conditioned stimuli in a relative manner. Program No. 515.16. 2011 Neuroscience Meeting Planner. Washington, DC: Society for Neuroscience Abstracts Online.
84. Seymour, B., Singer, T., and Dolan, R. (2007). The neurobiology of punishment. Nat. Rev. Neurosci. 8, 300-311.
85. Solomon, R. L., and Corbit, J. D. (1974). An opponent-process theory of motivation. 1. Temporal dynamics of affect. Psychol. Rev. 81, 119-145.
86. Stefanacci, L., and Amaral,D. G. (2000). Topographic organization of cortical inputs to the lateral nucleus of the macaque monkey amygdala: a retrograde tracing study. J. Comp. Neurol. 421,52-79.
87. Stefanacci, L., and Amaral, D. G. (2002). Some observations on cortical inputs to the macaque monkey amygdala: an anterograde tracing study.J. Comp.Neurol.451,301-323.
88. Sugase-Miyamoto, Y., and Richmond, B. J. (2005). Neuronal signals in the monkey basolateral amygdala during reward schedules. J. Neurosci. 25, 11071-11083.
89. Thorpe, S. J., Rolls, E. T., and Maddi-son, S. (1983). The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp. Brain Res. 49, 93-115.
90. Tremblay, L., and Schultz, W. (2000). Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J. Neurophysiol. 83,1864-1876.
91. Wallis, J. D. (2007). Orbitofrontal cortex and its contribution to decision-making. Annu. Rev. Neurosci. 30, 31-56.
92. Wilson, E A., and Rolls, E. T. (2005). The primate amygdala and reinforcement: a dissociation between rule-based and associatively-mediated memory revealed in neuronal activity. Neuroscience 133, 1061-1072.
93. Yamada, H., Matsumoto, N., and Kimura, M. (2004). Tonically active neurons in the primate caudate nucleus and putamen differentially encode instructed motivational outcomes of action. J. Neurosci. 24, 3500-3510.
94. Young, L., Bechara, A., Tranel, D., Dama-sio, H., Hauser, M., and Dama-sio, A. (2010). Damage to ven-tromedial prefrontal cortex impairs judgment of harmful intent. Neuron 65,845-851.