A comparison of neural responses to appetitive and aversive stimuli in humans and other mammals

Neuroscience and Biobehavioral Reviews

Volumn 45, Issue , 2014, Pages 350-368

  Hayes, Dave J ^a,b   Duncan, Niall W ^a,c,d   Xu, Jiameng ^a   Northoff, Georg ^a,d,e,f  

^a UNIVERSITY OF OTTAWA   (Canada)

^b UNIVERSITY OF TORONTO   (Canada)

^c CARLETON UNIVERSITY   (Canada)

^d HANGZHOU NORMAL UNIVERSITY   (China)

^e TAIPEI MEDICAL UNIVERSITY   (Taiwan)

^f NATIONAL CHENGCHI UNIVERSITY   (Taiwan)

Author keywords

Affective neuroscience; Aversion; Electrophysiology; Emotion; FMRI; Human; Meta analysis; Monkey; Motivation; Mouse; Neuroimaging; Punishment; Rat; Reinforcement; Reward; Valence

Indexed keywords

DOPAMINE; GLUTAMIC ACID; NORADRENALIN; 4 AMINOBUTYRIC ACID;

ANTERIOR INSULA; APPETITIVE STIMULUS; AVERSION; AVERSIVE STIMULUS; BASOLATERAL AMYGDALA; BRAIN FUNCTION; COMPARATIVE STUDY; ELECTROENCEPHALOGRAM; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GABAERGIC SYSTEM; HUMAN; NERVE CELL NETWORK; NERVE POTENTIAL; NEUROANATOMY; NEUROIMAGING; NEUROTRANSMISSION; NEUROTRANSMITTER RELEASE; NONHUMAN; NUCLEUS ACCUMBENS; ORBITAL CORTEX; PERIAQUEDUCTAL GRAY MATTER; POSTERIOR CINGULATE; PREMOTOR CORTEX; PRIORITY JOURNAL; REVIEW; REWARD; STIMULUS; SUPPLEMENTARY MOTOR AREA; VENTRAL TEGMENTUM; VENTROMEDIAL PREFRONTAL CORTEX; ANIMAL; BRAIN; META ANALYSIS; NERVE TRACT; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; POSITRON EMISSION TOMOGRAPHY; REINFORCEMENT; AMYGDALOID NUCLEUS; APPETITE; CELL POPULATION; CINGULATE GYRUS; CORPUS STRIATUM; ELECTROPHYSIOLOGY; GUSTATORY CORTEX; HUMAN VERSUS ANIMAL COMPARISON; NERVE CELL; PRIMATE; RODENT; SENSORY STIMULATION; STIMULUS RESPONSE;

ANIMALS; BRAIN; HUMANS; MAGNETIC RESONANCE IMAGING; NEURAL PATHWAYS; POSITRON-EMISSION TOMOGRAPHY; REINFORCEMENT (PSYCHOLOGY);

EID: 84904903561     PISSN: 01497634     EISSN: 18737528     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2014.06.018     Document Type: Review

References (187)

1. Accolla R., Carleton A. Internal body state influences topographical plasticity of sensory representations in the rat gustatory cortex. Proc. Natl. Acad. Sci. U.S.A. 2008, 105:4010-4015.
2. Accolla R., Bathellier B., Petersen C.C., Carleton A. Differential spatial representation of taste modalities in the rat gustatory cortex. J. Neurosci. 2007, 27:1396-1404.
3. Albrechet-Souza L., Borelli K.G., Carvalho M.C., Brandao M.L. The anterior cingulate cortex is a target structure for the anxiolytic-like effects of benzodiazepines assessed by repeated exposure to the elevated plus maze and Fos immunoreactivity. Neuroscience 2009, 164:387-397.
4. Albrechet-Souza L., Carvalho M.C., Brandao M.L. D1-like receptors in the nucleus accumbens shell regulate the expression of contextual fear conditioning and activity of the anterior cingulate cortex in rats. Int. J. Neuropsychopharmacol. 2012, 1-13.
5. Aleksandrov V.G., Fedorova K.P. Structure of the insular region of the rat neocortex. Neurosci. Behav. Physiol. 2003, 33:199-202.
6. Amemori K., Graybiel A.M. Localized microstimulation of primate pregenual cingulate cortex induces negative decision-making. Nat. Neurosci. 2012, 15:776-785.
7. Amir S., Stewart J. Conditioned and unconditioned aversive stimuli enhance light-induced fos expression in the primary visual cortex. Neuroscience 1999, 89:323-327.
8. Anstrom K.K., Woodward D.J. Restraint increases dopaminergic burst firing in awake rats. Neuropsychopharmacology 2005, 30:1832-1840.
9. Anstrom K.K., Miczek K.A., Budygin E.A. Increased phasic dopamine signaling in the mesolimbic pathway during social defeat in rats. Neuroscience 2009, 161:3-12.
10. Apitz T., Bunzeck N. Reward modulates the neural dynamics of early visual category processing. Neuroimage 2012, 63:1614-1622.
11. Augustine J.R. Circuitry and functional aspects of the insular lobe in primates including humans. Brain Res. Brain Res. Rev. 1996, 22:229-244.
12. Barberini C.L., Morrison S.E., Saez A., Lau B., Salzman C.D. Complexity and competition in appetitive and aversive neural circuits. Front. Neurosci. 2012, 6:170.
13. Barrett L.F., Satpute A.B. Large-scale brain networks in affective and social neuroscience: towards an integrative functional architecture of the brain. Curr. Opin. Neurobiol. 2013.
14. Barrett L.F., Mesquita B., Ochsner K.N., Gross J.J. The experience of emotion. Annu. Rev. Psychol. 2007, 58:373-403.
15. Baxter M.G., Murray E.A. The amygdala and reward. Nat. Rev. Neurosci. 2002, 3:563-573.
16. Belcheva I., Bryer J.B., Starkstein S.E., Honig M., Moran T.H., Robinson R.G. Hemispheric asymmetry in behavioral response to D1 and D2 receptor agonists in the nucleus accumbens. Brain Res. 1990, 533:286-291.
17. Belova M.A., Paton J.J., Morrison S.E., Salzman C.D. Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala. Neuron 2007, 55:970-984.
18. Belova M.A., Paton J.J., Salzman C.D. Moment-to-moment tracking of state value in the amygdala. J. Neurosci. 2008, 28:10023-10030.
19. Berdyyeva T.K., Olson C.R. Relation of ordinal position signals to the expectation of reward and passage of time in four areas of the macaque frontal cortex. J. Neurophysiol. 2011, 105:2547-2559.
20. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Res. Brain Res. Rev. 1998, 28:309-369.
21. Berridge K.C., Robinson T.E. Parsing reward. Trends Neurosci. 2003, 26:507-513.
22. Besson C., Louilot A. Asymmetrical involvement of mesolimbic dopaminergic neurons in affective perception. Neuroscience 1995, 68:963-968.
23. Bissonette G.B., Gentry R.N., Padmala S., Pessoa L., Roesch M.R. Impact of appetitive and aversive outcomes on brain responses: linking the animal and human literatures. Front. Syst. Neurosci. 2014, 8:24.
24. Blood A.J., Iosifescu D.V., Makris N., Perlis R.H., Kennedy D.N., Dougherty D.D., Kim B.W., Lee M.J., Wu S., Lee S., Calhoun J., Hodge S.M., Fava M., Rosen B.R., Smoller J.W., Gasic G.P., Breiter H.C. Microstructural abnormalities in subcortical reward circuitry of subjects with major depressive disorder. PLoS One 2010, 5:e13945.
25. Borgomaneri S., Gazzola V., Avenanti A. Temporal dynamics of motor cortex excitability during perception of natural emotional scenes. Soc. Cogn. Affect Neurosci. 2013.
26. Borsook D., Becerra L., Carlezon W.A., Shaw M., Renshaw P., Elman I., Levine J. Reward-aversion circuitry in analgesia and pain: implications for psychiatric disorders. Eur. J. Pain 2007, 11:7-20.
27. Brischoux F., Chakraborty S., Brierley D.I., Ungless M.A. Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc. Natl. Acad. Sci. U.S.A. 2009, 106:4894-4899.
28. Bromberg-Martin E.S., Matsumoto M., Hikosaka O. Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 2010, 68:815-834.
29. Broom S.L., Yamamoto B.K. Effects of subchronic methamphetamine exposure on basal dopamine and stress-induced dopamine release in the nucleus accumbens shell of rats. Psychopharmacology (Berl) 2005, 181:467-476.
30. Brown M.T., Tan K.R., O'Connor E.C., Nikonenko I., Muller D., Luscher C. Ventral tegmental area GABA projections pause accumbal cholinergic interneurons to enhance associative learning. Nature 2012, 492:452-456.
31. Budilin S.Y., Midzyanovskaya I.S., Shchegolevskii N.V., Ioffe M.E., Bazyan A.S. Asymmetry in dopamine levels in the nucleus accumbens and motor preference in rats. Neurosci. Behav. Physiol. 2008, 38:991-994.
32. Cabanac M. Physiological role of pleasure. Science 1971, 173:1103-1107.
33. Carelli R.M., Ijames S.G., Crumling A.J. Evidence that separate neural circuits in the nucleus accumbens encode cocaine versus "natural" (water and food) reward. J. Neurosci. 2000, 20:4255-4266.
34. Carleton A., Accolla R., Simon S.A. Coding in the mammalian gustatory system. Trends Neurosci. 2010, 33:326-334.
35. Carlezon W.A., Thomas M.J. Biological substrates of reward and aversion: a nucleus accumbens activity hypothesis. Neuropharmacology 2009, 56(Suppl. 1):122-132.
36. Cohen J.Y., Haesler S., Vong L., Lowell B.B., Uchida N. Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 2012, 482:85-88.
37. Concha M.L., Bianco I.H., Wilson S.W. Encoding asymmetry within neural circuits. Nat. Rev. Neurosci. 2012, 13:832-843.
38. Costa V.D., Lang P.J., Sabatinelli D., Versace F., Bradley M.M. Emotional imagery: assessing pleasure and arousal in the brain's reward circuitry. Hum. Brain Mapp. 2010, 31:1446-1457.
39. Cybulska-Klosowicz A., Zakrzewska R., Kossut M. Brain activation patterns during classical conditioning with appetitive or aversive UCS. Behav. Brain Res. 2009, 204:102-111.
40. Dalley J.W., Cardinal R.N., Robbins T.W. Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates. Neurosci. Biobehav. Rev. 2004, 28:771-784.
41. D'Ardenne K., McClure S.M., Nystrom L.E., Cohen J.D. BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 2008, 319:1264-1267.
42. Day J.J., Jones J.L., Carelli R.M. Nucleus accumbens neurons encode predicted and ongoing reward costs in rats. Eur. J. Neurosci. 2011, 33:308-321.
43. Deadwyler S.A. Electrophysiological correlates of abused drugs: relation to natural rewards. Ann. N. Y. Acad. Sci. 2010, 1187:140-147.
44. Delgado M.R., Jou R.L., Phelps E.A. Neural systems underlying aversive conditioning in humans with primary and secondary reinforcers. Front. Neurosci. 2011, 5:71.
45. Faure A., Reynolds S.M., Richard J.M., Berridge K.C. Mesolimbic dopamine in desire and dread: enabling motivation to be generated by localized glutamate disruptions in nucleus accumbens. J. Neurosci. 2008, 28:7184-7192.
46. Flores J.A., Galan-Rodriguez B., Ramiro-Fuentes S., Fernandez-Espejo E. Role for dopamine neurons of the rostral linear nucleus and periaqueductal gray in the rewarding and sensitizing properties of heroin. Neuropsychopharmacology 2006, 31:1475-1488.
47. Frank M.J., Surmeier D.J. Do substantia nigra dopaminergic neurons differentiate between reward and punishment?. J. Mol. Cell Biol. 2009, 1:15-16.
48. Fride E., Weinstock M. Prenatal stress increases anxiety related behavior and alters cerebral lateralization of dopamine activity. Life Sci. 1988, 42:1059-1065.
49. Gansler D.A., McLaughlin N.C., Iguchi L., Jerram M., Moore D.W., Bhadelia R., Fulwiler C. A multivariate approach to aggression and the orbital frontal cortex in psychiatric patients. Psychiatry Res. 2009, 171:145-154.
50. Geddes R.I., Han L., Baldwin A.E., Norgren R., Grigson P.S. Gustatory insular cortex lesions disrupt drug-induced, but not lithium chloride-induced, suppression of conditioned stimulus intake. Behav. Neurosci. 2008, 122:1038-1050.
51. Gottfried J.A., O'Doherty J., Dolan R.J. Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. J. Neurosci. 2002, 22:10829-10837.
52. Grupe D.W., Oathes D.J., Nitschke J.B. Dissecting the anticipation of aversion reveals dissociable neural networks. Cereb. Cortex 2012, 23:1874-1883.
53. Guarraci F.A., Kapp B.S. An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav. Brain Res. 1999, 99:169-179.
54. Gutierrez R., Simon S.A., Nicolelis M.A. Licking-induced synchrony in the taste-reward circuit improves cue discrimination during learning. J. Neurosci. 2010, 30:287-303.
55. Hamann S., Mao H. Positive and negative emotional verbal stimuli elicit activity in the left amygdala. Neuroreport 2002, 13:15-19.
56. Haney R.Z., Calu D.J., Takahashi Y.K., Hughes B.W., Schoenbaum G. Inactivation of the central but not the basolateral nucleus of the amygdala disrupts learning in response to overexpectation of reward. J. Neurosci. 2010, 30:2911-2917.
57. Hayes D.J., Huxtable A.G. Interpreting deactivations in neuroimaging. Front. Psychol. 2012, 3:27.
58. Hayes D.J., Northoff G. Identifying a network of brain regions involved in aversion-related processing: a cross-species translational investigation. Front. Integr. Neurosci. 2011, 5:49.
59. Hayes D.J., Northoff G. Common brain activations for painful and nonpainful aversive stimuli. BMC Neurosci. 2012, 13:60.
60. Hayes D.J., Hoang J., Greenshaw A.J. The role of nucleus accumbens shell GABA receptors on ventral tegmental area intracranial self-stimulation and a potential role for the 5-HT2C receptor. J. Psychopharmacol. 2011, 25:1661-1675.
61. Hayes D.J., Duncan N.W., Wiebking C., Pietruska K., Qin P., Lang S., Gagnon J., Gravel P., Verhaeghe J., Kostikov A.P., et al. GABA(A) receptors predict aversion-related brain responses: an fMRI-PET investigation in healthy humans. Neuropsychopharmacology 2013, 38:1438-1450.
62. Hikosaka K., Watanabe M. Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. Cereb. Cortex 2000, 10:263-271.
63. Hillman K.L., Bilkey D.K. Neural encoding of competitive effort in the anterior cingulate cortex. Nat. Neurosci. 2012, 15:1290-1297.
64. Holahan M.R. Complementary roles for the amygdala and hippocampus during different phases of appetitive information processing. Neurobiol. Learn. Mem. 2005, 84:124-131.
65. Imperato A., Angelucci L., Casolini P., Zocchi A., Puglisi-Allegra S. Repeated stressful experiences differently affect limbic dopamine release during and following stress. Brain Res. 1992, 577:194-199.
66. Jennings J.H., Sparta D.R., Stamatakis A.M., Ung R.L., Pleil K.E., Kash T.L., Stuber G.D. Distinct extended amygdala circuits for divergent motivational states. Nature 2013, 496:224-228.
67. Ji G., Neugebauer V. Pain-related deactivation of medial prefrontal cortical neurons involves mGluR1 and GABA(A) receptors. J. Neurophysiol. 2011, 106:2642-2652.
68. Johnson P.I., Stellar J.R., Paul A.D. Regional reward differences within the ventral pallidum are revealed by microinjections of a mu opiate receptor agonist. Neuropharmacology 1993, 32:1305-1314.
69. Josselyn S.A., Falls W.A., Gewirtz J.C., Pistell P., Davis M. The nucleus accumbens is not critically involved in mediating the effects of a safety signal on behavior. Neuropsychopharmacology 2005, 30:17-26.
70. Kelly C., Toro R., Di Martino A., Cox C.L., Bellec P., Castellanos F.X., Milham M.P. A convergent functional architecture of the insula emerges across imaging modalities. Neuroimage 2012, 61:1129-1142.
71. Kim Y.B., Matthews M., Moghaddam B. Putative gamma-aminobutyric acid neurons in the ventral tegmental area have a similar pattern of plasticity as dopamine neurons during appetitive and aversive learning. Eur. J. Neurosci. 2010, 32:1564-1572.
72. Kim Y., Wood J., Moghaddam B. Coordinated activity of ventral tegmental neurons adapts to appetitive and aversive learning. PLoS One 2012, 7:e29766.
73. Klein-Flugge M.C., Hunt L.T., Bach D.R., Dolan R.J., Behrens T.E. Dissociable reward and timing signals in human midbrain and ventral striatum. Neuron 2011, 72:654-664.
74. Knapska E., Walasek G., Nikolaev E., Neuhausser-Wespy F., Lipp H.P., Kaczmarek L., Werka T. Differential involvement of the central amygdala in appetitive versus aversive learning. Learn. Mem. 2006, 13:192-200.
75. Knoll A.T., Muschamp J.W., Sillivan S.E., Ferguson D., Dietz D.M., Meloni E.G., Carroll F.I., Nestler E.J., Konradi C., Carlezon W.A. Kappa opioid receptor signaling in the basolateral amygdala regulates conditioned fear and anxiety in rats. Biol. Psychiatry 2011, 70:425-433.
76. Kobayashi M. Macroscopic connection of rat insular cortex: anatomical bases underlying its physiological functions. Int. Rev. Neurobiol. 2011, 97:285-303.
77. Kumar S., Forster H.M., Bailey P., Griffiths T.D. Mapping unpleasantness of sounds to their auditory representation. J. Acoust. Soc. Am. 2008, 124:3810-3817.
78. Kurth F., Zilles K., Fox P.T., Laird A.R., Eickhoff S.B. A link between the systems: functional differentiation and integration within the human insula revealed by meta-analysis. Brain Struct. Funct. 2010, 214:519-534.
79. Lak A., Stauffer W.R., Schultz W. Dopamine prediction error responses integrate subjective value from different reward dimensions. Proc. Natl. Acad. Sci. U.S.A. 2014.
80. Lammel S., Ion D.I., Roeper J., Malenka R.C. Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli. Neuron 2011, 70:855-862.
81. Lammel S., Lim B.K., Ran C., Huang K.W., Betley M.J., Tye K.M., Deisseroth K., Malenka R.C. Input-specific control of reward and aversion in the ventral tegmental area. Nature 2012, 491:212-217.
82. Lammel S., Lim B.K., Malenka R.C. Reward and aversion in a heterogeneous midbrain dopamine system. Neuropharmacology 2014, 76 pt B:351-359.
83. Larsen J.T., McGraw A.P. Further evidence for mixed emotions. J. Pers. Soc. Psychol. 2011, 100:1095-1110.
84. LeDoux J. Fear and the brain: where have we been, and where are we going?. Biol. Psychiatry 1998, 44:1229-1238.
85. Leknes S., Berna C., Lee M.C., Snyder G.D., Biele G., Tracey I. The importance of context: when relative relief renders pain pleasant. Pain 2013, 154:402-410.
86. Levita L., Hare T.A., Voss H.U., Glover G., Ballon D.J., Casey B.J. The bivalent side of the nucleus accumbens. Neuroimage 2009, 44:1178-1187.
87. Levita L., Hoskin R., Champi S. Avoidance of harm and anxiety: a role for the nucleus accumbens. Neuroimage 2012, 62:189-198.
88. Lindquist K.A., Barrett L.F. A functional architecture of the human brain: emerging insights from the science of emotion. Trends Cogn. Sci. 2012, 16:533-540.
89. Ludascher P., Bohus M., Lieb K., Philipsen A., Jochims A., Schmahl C. Elevated pain thresholds correlate with dissociation and aversive arousal in patients with borderline personality disorder. Psychiatry Res. 2007, 149:291-296.
90. Madan C.R. Toward a common theory for learning from reward, affect, and motivation: the SIMON framework. Front. Syst. Neurosci. 2013, 7:59.
91. Mahler S.V., Berridge K.C. Which cue to "want?" Central amygdala opioid activation enhances and focuses incentive salience on a prepotent reward cue. J. Neurosci. 2009, 29:6500-6513.
92. Maril S., Hassin-Baer S., Cohen O.S., Tomer R. Effects of asymmetric dopamine depletion on sensitivity to rewarding and aversive stimuli in Parkinson's disease. Neuropsychologia 2013, 51:818-824.
93. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459:837-841.
94. McBride W.J., Murphy J.M., Ikemoto S. Localization of brain reinforcement mechanisms: intracranial self-administration and intracranial place-conditioning studies. Behav. Brain Res. 1999, 101:129-152.
95. McCabe C., Cowen P.J., Harmer C.J. Neural representation of reward in recovered depressed patients. Psychopharmacology (Berl) 2009, 205:667-677.
96. McCabe C., Huber A., Harmer C.J., Cowen P.J. The D2 antagonist sulpiride modulates the neural processing of both rewarding and aversive stimuli in healthy volunteers. Psychopharmacology (Berl) 2011, 217:271-278.
97. McCullough L.D., Salamone J.D. Anxiogenic drugs beta-CCE and FG 7142 increase extracellular dopamine levels in nucleus accumbens. Psychopharmacology (Berl) 1992, 109:379-382.
98. McCutcheon J.E., Ebner S.R., Loriaux A.L., Roitman M.F. Encoding of aversion by dopamine and the nucleus accumbens. Front. Neurosci. 2012, 6:137.
99. Mileykovskiy B., Morales M. Duration of inhibition of ventral tegmental area dopamine neurons encodes a level of conditioned fear. J. Neurosci. 2011, 31:7471-7476.
100. Mirenowicz J., Schultz W. Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 1996, 379:449-451.
101. Miserendino M.J., Coons E.E. Electrical stimulation of the medial prefrontal cortex supports both 'pure reward' and 'reward-escape' behavior in rats. Brain Res. 1989, 483:226-232.
102. Mogenson G.J., Jones D.L., Yim C.Y. From motivation to action: functional interface between the limbic system and the motor system. Prog. Neurobiol. 1980, 14:69-97.
103. Monosov I.E., Hikosaka O. Regionally distinct processing of rewards and punishments by the primate ventromedial prefrontal cortex. J. Neurosci. 2012, 32:10318-10330.
104. Morrison S.E., Salzman C.D. The convergence of information about rewarding and aversive stimuli in single neurons. J. Neurosci. 2009, 29:11471-11483.
105. Morrison S.E., Salzman C.D. Representations of appetitive and aversive information in the primate orbitofrontal cortex. Ann. N. Y. Acad. Sci. 2011, 1239:59-70.
106. Morrison S.E., Saez A., Lau B., Salzman C.D. Different time courses for learning-related changes in amygdala and orbitofrontal cortex. Neuron 2011, 71:1127-1140.
107. Mota-Ortiz S.R., Sukikara M.H., Bittencourt J.C., Baldo M.V., Elias C.F., Felicio L.F., Canteras N.S. The periaqueductal gray as a critical site to mediate reward seeking during predatory hunting. Behav. Brain Res. 2012, 226:32-40.
108. Mueller D., Porter J.T., Quirk G.J. Noradrenergic signaling in infralimbic cortex increases cell excitability and strengthens memory for fear extinction. J. Neurosci. 2008, 28:369-375.
109. Mullett T.L., Tunney R.J. Value representations by rank order in a distributed network of varying context dependency. Brain Cogn. 2013, 82:76-83.
110. O'Doherty J.P. Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr. Opin. Neurobiol. 2004, 14:769-776.
111. Oleson E.B., Gentry R.N., Chioma V.C., Cheer J.F. Subsecond dopamine release in the nucleus accumbens predicts conditioned punishment and its successful avoidance. J. Neurosci. 2012, 32:14804-14808.
112. Ongur D., Price J.L. The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb. Cortex 2000, 10:206-219.
113. Panksepp J. Affectvie Neuroscience: The Foundations of Human and Animal Emotions 1998, Oxford University Press, New York.
114. Panksepp J. The basic emotional circuits of mammalian brains: do animals have affective lives?. Neurosci. Biobehav. Rev. 2011, 35:1791-1804.
115. Pappata S., Dehaene S., Poline J.B., Gregoire M.C., Jobert A., Delforge J., Frouin V., Bottlaender M., Dolle F., Di Giamberardino L., Syrota A. In vivo detection of striatal dopamine release during reward: a PET study with [(11)C]raclopride and a single dynamic scan approach. Neuroimage 2002, 16:1015-1027.
116. Parsana A.J., Li N., Brown T.H. Positive and negative ultrasonic social signals elicit opposing firing patterns in rat amygdala. Behav. Brain Res. 2012, 226:77-86.
117. Paton J.J., Belova M.A., Morrison S.E., Salzman C.D. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 2006, 439:865-870.
118. Phelps E.A., LeDoux J.E. Contributions of the amygdala to emotion processing: from animal models to human behavior. Neuron 2005, 48:175-187.
119. Phillips A.G., Fibiger H.C. Dopaminergic and noradrenergic substrates of positive reinforcement: differential effects of d- and l-amphetamine. Science 1973, 179:575-577.
120. Phillips A.G., Coury A., Fiorino D., LePiane F.G., Brown E., Fibiger H.C. Self-stimulation of the ventral tegmental area enhances dopamine release in the nucleus accumbens: a microdialysis study. Ann. N. Y. Acad. Sci. 1992, 654:199-206.
121. Porat O., Hassin-Baer S., Cohen O.S., Markus A., Tomer R. Asymmetric dopamine loss differentially affects effort to maximize gain or minimize loss. Cortex 2014, 51:82-91.
122. Price J.L. Comparative aspects of amygdala connectivity. Ann. N. Y. Acad. Sci. 2003, 985:50-58.
123. Price J.L. Definition of the orbital cortex in relation to specific connections with limbic and visceral structures and other cortical regions. Ann. N. Y. Acad. Sci. 2007, 1121:54-71.
124. Ramot A., Akirav I. Cannabinoid receptors activation and glucocorticoid receptors deactivation in the amygdala prevent the stress-induced enhancement of a negative learning experience. Neurobiol. Learn. Mem. 2012, 97:393-401.
125. Reichling D.B., Kwiat G.C., Basbaum A.I. Anatomy, physiology and pharmacology of the periaqueductal gray contribution to antinociceptive controls. Prog. Brain Res. 1988, 77:31-46.
126. Reyes-Lopez J., Nunez-Jaramillo L., Moran-Guel E., Miranda M.I. Differential effects of beta-adrenergic receptor blockade in the medial prefrontal cortex during aversive and incidental taste memory formation. Neuroscience 2010, 169:195-202.
127. Reynolds S.M., Berridge K.C. Fear and feeding in the nucleus accumbens shell: rostrocaudal segregation of GABA-elicited defensive behavior versus eating behavior. J. Neurosci. 2001, 21:3261-3270.
128. Reynolds S.M., Berridge K.C. Positive and negative motivation in nucleus accumbens shell: bivalent rostrocaudal gradients for GABA-elicited eating, taste "liking"/"disliking" reactions, place preference/avoidance, and fear. J. Neurosci. 2002, 22:7308-7320.
129. Richard J.M., Berridge K.C. Metabotropic glutamate receptor blockade in nucleus accumbens shell shifts affective valence towards fear and disgust. Eur. J. Neurosci. 2011, 33:736-747.
130. Richard J.M., Berridge K.C. Nucleus accumbens dopamine/glutamate interaction switches modes to generate desire versus dread: D1 alone for appetitive eating but D1 and D2 together for fear. J. Neurosci. 2011, 31:12866-12879.
131. Roitman M.F., Wheeler R.A., Carelli R.M. Nucleus accumbens neurons are innately tuned for rewarding and aversive taste stimuli, encode their predictors, and are linked to motor output. Neuron 2005, 45:587-597.
132. Roitman M.F., Wheeler R.A., Wightman R.M., Carelli R.M. Real-time chemical responses in the nucleus accumbens differentiate rewarding and aversive stimuli. Nat. Neurosci. 2008, 11:1376-1377.
133. Roitman M.F., Wheeler R.A., Tiesinga P.H., Roitman J.D., Carelli R.M. Hedonic and nucleus accumbens neural responses to a natural reward are regulated by aversive conditioning. Learn. Mem. 2010, 17:539-546.
134. Rosen G.D., Finklestein S., Stoll A.L., Yutzey D.A., Denenberg V.H. Neurochemical asymmetries in the albino rat's cortex, striatum, and nucleus accumbens. Life Sci. 1984, 34:1143-1148.
135. Sakurai Y., Takahashi S. Conditioned enhancement of firing rates and synchrony of hippocampal neurons and firing rates of motor cortical neurons in rats. Eur. J. Neurosci. 2013, 37:623-639.
136. Salamone J.D. The involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behav. Brain Res. 1994, 61:117-133.
137. Salamone J.D., Correa M. The mysterious motivational functions of mesolimbic dopamine. Neuron 2012, 76:470-485.
138. Salamone J.D., Correa M. Dopamine and food addiction: lexicon badly needed. Biol. Psychiatry 2013, 73:e15-e24.
139. Salzman C.D., Paton J.J., Belova M.A., Morrison S.E. Flexible neural representations of value in the primate brain. Ann. N. Y. Acad. Sci. 2007, 1121:336-354.
140. Sangha S., Chadick J.Z., Janak P.H. Safety encoding in the Basal amygdala. J. Neurosci. 2013, 33:3744-3751.
141. Sarkamo T., Soto D. Music listening after stroke: beneficial effects and potential neural mechanisms. Ann. N. Y. Acad. Sci. 2012, 1252:266-281.
142. Schneider L.H., Murphy R.B., Coons E.E. Lateralization of striatal dopamine (D2) receptors in normal rats. Neurosci. Lett. 1982, 33:281-284.
143. Schoenbaum G., Chiba A.A., Gallagher M. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat. Neurosci. 1998, 1:155-159.
144. Scott T.R., Plata-Salaman C.R. Taste in the monkey cortex. Physiol. Behav. 1999, 67:489-511.
145. Setlow B., Schoenbaum G., Gallagher M. Neural encoding in ventral striatum during olfactory discrimination learning. Neuron 2003, 38:625-636.
146. Shabel S.J., Janak P.H. Substantial similarity in amygdala neuronal activity during conditioned appetitive and aversive emotional arousal. Proc. Natl. Acad. Sci. U.S.A. 2009, 106:15031-15036.
147. Shi W.X., Rayport S. GABA synapses formed in vitro by local axon collaterals of nucleus accumbens neurons. J. Neurosci. 1994, 14:4548-4560.
148. Shuler M.G., Bear M.F. Reward timing in the primary visual cortex. Science 2006, 311:1606-1609.
149. Simmons D.A., Brooks B.M., Neill D.B. GABAergic inactivation of basolateral amygdala alters behavioral processes other than primary reward of ventral tegmental self-stimulation. Behav. Brain Res. 2007, 181:110-117.
150. Slopsema J.S., van der Gugten J., de Bruin J.P. Regional concentrations of noradrenaline and dopamine in the frontal cortex of the rat: dopaminergic innervation of the prefrontal subareas and lateralization of prefrontal dopamine. Brain Res. 1982, 250:197-200.
151. Smith S.M., Jenkinson M., Woolrich M.W., Beckmann C.F., Behrens T.E., Johansen-Berg H., Bannister P.R., De Luca M., Drobnjak I., Flitney D.E., Niazy R.K., Saunders J., Vickers J., Zhang Y., De Stefano N., Brady J.M., Matthews P.M. Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage 2004, 23(Suppl. 1):S208-S219.
152. Solomon R.L., Corbit J.D. An opponent-process theory of motivation. I. Temporal dynamics of affect. Psychol. Rev. 1974, 81:119-145.
153. Sorg B.A., Kalivas P.W. Effects of cocaine and footshock stress on extracellular dopamine levels in the ventral striatum. Brain Res. 1991, 559:29-36.
154. Stalnaker T.A., Berridge C.W. AMPA receptor stimulation within the central nucleus of the amygdala elicits a differential activation of central dopaminergic systems. Neuropsychopharmacology 2003, 28:1923-1934.
155. Stamatakis A.M., Jennings J.H., Ung R.L., Blair G.A., Weinberg R.J., Neve R.L., Boyce F., Mattis J., Ramakrishnan C., Deisseroth K., Stuber G.D. A unique population of ventral tegmental area neurons inhibits the lateral habenula to promote reward. Neuron 2013, 80:1039-1053.
156. Steffensen S.C., Lee R.S., Stobbs S.H., Henriksen S.J. Responses of ventral tegmental area GABA neurons to brain stimulation reward. Brain Res. 2001, 906:190-197.
157. Sukikara M.H., Mota-Ortiz S.R., Baldo M.V., Felicio L.F., Canteras N.S. The periaqueductal gray and its potential role in maternal behavior inhibition in response to predatory threats. Behav. Brain Res. 2010, 209:226-233.
158. Sul J.H., Jo S., Lee D., Jung M.W. Role of rodent secondary motor cortex in value-based action selection. Nat. Neurosci. 2011, 14:1202-1208.
159. Thorpe S.J., Rolls E.T., Maddison S. The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp. Brain Res. 1983, 49:93-115.
160. Tidey J.W., Miczek K.A. Social defeat stress selectively alters mesocorticolimbic dopamine release: an in vivo microdialysis study. Brain Res. 1996, 721:140-149.
161. Tindell A.J., Smith K.S., Pecina S., Berridge K.C., Aldridge J.W. Ventral pallidum firing codes hedonic reward: when a bad taste turns good. J. Neurophysiol. 2006, 96:2399-2409.
162. Uylings H.B., Groenewegen H.J., Kolb B. Do rats have a prefrontal cortex?. Behav. Brain Res. 2003, 146:3-17.
163. van Duuren E., Escamez F.A., Joosten R.N., Visser R., Mulder A.B., Pennartz C.M. Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task. Learn. Mem. 2007, 14:446-456.
164. van Wingerden M., Vinck M., Lankelma J.V., Pennartz C.M. Learning-associated gamma-band phase-locking of action-outcome selective neurons in orbitofrontal cortex. J. Neurosci. 2010, 30:10025-10038.
165. Veldhuizen M.G., Albrecht J., Zelano C., Boesveldt S., Breslin P., Lundstrom J.N. Identification of human gustatory cortex by activation likelihood estimation. Hum. Brain Mapp. 2011, 32:2256-2266.
166. Ventura R., Latagliata E.C., Morrone C., La Mela I., Puglisi-Allegra S. Prefrontal norepinephrine determines attribution of "high" motivational salience. PLoS One 2008, 3:e3044.
167. Vertes R.P. Interactions among the medial prefrontal cortex, hippocampus and midline thalamus in emotional and cognitive processing in the rat. Neuroscience 2006, 142:1-20.
168. Vianna D.M., Brandao M.L. Anatomical connections of the periaqueductal gray: specific neural substrates for different kinds of fear. Braz. J. Med. Biol. Res. 2003, 36:557-566.
169. Vogt B.A., Paxinos G. Cytoarchitecture of mouse and rat cingulate cortex with human homologies. Brain Struct. Funct. 2012.
170. Vuilleumier P., Pourtois G. Distributed and interactive brain mechanisms during emotion face perception: evidence from functional neuroimaging. Neuropsychologia 2007, 45:174-194.
171. Wager T.D., Lindquist M.A., Nichols T.E., Kober H., Van Snellenberg J.X. Evaluating the consistency and specificity of neuroimaging data using meta-analysis. Neuroimage 2009, 45:S210-S221.
172. Walton M.E., Croxson P.L., Behrens T.E., Kennerley S.W., Rushworth M.F. Adaptive decision making and value in the anterior cingulate cortex. Neuroimage 2007, 36(Suppl. 2):T142-T154.
173. Wang D.V., Tsien J.Z. Convergent processing of both positive and negative motivational signals by the VTA dopamine neuronal populations. PLoS One 2011, 6:e17047.
174. Wang H., Ren W.H., Zhang Y.Q., Zhao Z.Q. GABAergic disinhibition facilitates polysynaptic excitatory transmission in rat anterior cingulate cortex. Biochem. Biophys. Res. Commun. 2005, 338:1634-1639.
175. Wang J.Y., Zhang H.T., Chang J.Y., Woodward D.J., Baccala L.A., Luo F. Anticipation of pain enhances the nociceptive transmission and functional connectivity within pain network in rats. Mol. Pain 2008, 4:34.
176. Wang Z., Bradesi S., Charles J.R., Pang R.D., Maarek J.M., Mayer E.A., Holschneider D.P. Functional brain activation during retrieval of visceral pain-conditioned passive avoidance in the rat. Pain 2011, 152:2746-2756.
177. Waraczynski M., Carlton E., Perkins M. Midbrain periaqueductal lesions do not degrade medial forebrain bundle stimulation reward. Behav. Brain Res. 1998, 95:167-177.
178. Weil R.S., Furl N., Ruff C.C., Symmonds M., Flandin G., Dolan R.J., Driver J., Rees G. Rewarding feedback after correct visual discriminations has both general and specific influences on visual cortex. J. Neurophysiol. 2010, 104:1746-1757.
179. Weis T., Puschmann S., Brechmann A., Thiel C.M. Positive and negative reinforcement activate human auditory cortex. Front. Hum. Neurosci. 2013, 7:842.
180. Wilson-Mendenhall C.D., Barrett L.F., Barsalou L.W. Neural evidence that human emotions share core affective properties. Psychol. Sci. 2013, 24:947-956.
181. Wise R.A. Dopamine, learning and motivation. Nat. Rev. Neurosci. 2004, 5:483-494.
182. Wise R.A. Dual roles of dopamine in food and drug seeking: the drive-reward paradox. Biol. Psychiatry 2013, 73:819-826.
183. Wu C.W., Bichot N.P., Kaas J.H. Converging evidence from microstimulation, architecture, and connections for multiple motor areas in the frontal and cingulate cortex of prosimian primates. J. Comp. Neurol. 2000, 423:140-177.
184. Yamamoto T., Matsuo R., Kiyomitsu Y., Kitamura R. Taste responses of cortical neurons in freely ingesting rats. J. Neurophysiol. 1989, 61:1244-1258.
185. Young A.M. Increased extracellular dopamine in nucleus accumbens in response to unconditioned and conditioned aversive stimuli: studies using 1 min microdialysis in rats. J. Neurosci. Methods 2004, 138:57-63.
186. Zarrindast M.R., Ahmadi S., Haeri-Rohani A., Rezayof A., Jafari M.R., Jafari-Sabet M. GABA(A) receptors in the basolateral amygdala are involved in mediating morphine reward. Brain Res. 2004, 1006:49-58.
187. Zhu W., Pan Z.Z. Synaptic properties and postsynaptic opioid effects in rat central amygdala neurons. Neuroscience 2004, 127:871-879.