Dopaminergic and non-dopaminergic value systems in conditioning and outcome-specific revaluation

Brain Research

Volumn 1238, Issue , 2008, Pages 239-287

  Dranias, Mark R ^a   Grossberg, Stephen ^a   Bullock, Daniel ^a  

^a BOSTON UNIVERSITY   (United States)

Author keywords

Amygdala; Basal ganglia; Cognitive emotional interactions; Conditioning; Decision making; Devaluation; Discrimination learning; Dopamine; Food specific satiety; Inferotemporal cortex; Lateral hypothalamus; Motivation; Orbitofrontal cortex; Rhinal cortex

Indexed keywords

AMYGDALOID NUCLEUS; ARTICLE; BASAL GANGLION; COGNITION; CONDITIONING; DECISION MAKING; DISCRIMINATION LEARNING; DOPAMINERGIC SYSTEM; EMOTION; HYPOTHALAMUS; MODEL; ORBITAL CORTEX; PEDUNCULOPONTINE TEGMENTAL NUCLEUS; PRIORITY JOURNAL; SATIETY; SENSORY CORTEX; SUBSTANTIA NIGRA; VISUAL DISCRIMINATION;

ANIMALS; BRAIN; COGNITION; CONDITIONING (PSYCHOLOGY); DOPAMINE; EMOTIONS; MODELS, NEUROLOGICAL; NEURONS;

ANIMALIA;

EID: 55349119476     PISSN: 00068993     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.brainres.2008.07.013     Document Type: Article

References (191)

1. Amaral D.G., and Price J.L. Amygdalo-cortical projections in the monkey (Macaca fascicularis) J. Comp. Neurol. 230 1984 465 496
2. Amsel A. Secondary reinforcement and frustration Psychol. Bull. 69 1968 278
3. Balliene B.W. Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits Physiol. Behav. 86 2005 717 730
4. Balleine B.W., Garner C., Gonzalez F., and Dickinson A. Motivational control of heterogeneous instrumental chains J. Exp. Psychol., Anim. Behav. Processes 21 1995 203 217
5. Barbas H. Architecture and cortical connections of the prefrontal cortex in the rhesus monkey Adv. Neurol. 57 1992 91 115
6. Barbas H. Organization of cortical afferent input to orbitofrontal areas in the rhesus monkey Neuroscience 56 1993 841 864
7. Barbas H. Connections underlying the synthesis of cognition, memory, and emotion in primate prefrontal cortices Brain Res. Bull. 52 2000 319 330
8. Barbas H., Ghashghaei H., Dombrowski S.M., and Rempel-Clower N.L. Medial prefrontal cortices are unified by common connections with superior temporal cortices and distinguished by input from memory-related areas in the rhesus monkey J. Comp. Neurol. 410 1999 343 367
9. Barbas H., Saha S., Rempel-Clower N., and Ghashghaei T. Serial pathways from primate prefrontal cortex to autonomic areas may influence emotional expression BMC Neurosci. 4 2003 25
10. Barefoot H.C., Baker H.F., and Ridley R.M. Synergistic effects of unilateral immunolesions of the cholinergic projections from the basal forebrain and contralateral ablations of the inferotemporal cortex and hippocampus in monkeys Neuroscience 98 2000 243 251
11. Baxter M.G., Parker A., Lindner C.C., Izquierdo A.D., and Murray E.A. Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex J. Neurosci. 20 2000 4311 4319
12. Baylis L.L., and Gaffan D. Amygdalectomy and ventromedial prefrontal ablation produce similar deficits in food choice and in simple object discrimination learning for an unseen reward Exp. Brain Res. 86 1991 617 622
13. Bergen H.T., Monkman N., and Mobbs C.V. Injection with gold thioglucose impairs sensitivity to glucose: evidence that glucose-responsive neurons are important for long-term regulation of body weight Brain Res. 734 1996 332 336
14. Bernardis L.L., and Bellinger L.L. The lateral hypothalamic area revisited: Ingestive behavior Neurosci. Biobehav. Rev. 20 1996 189 287
15. Berridge K.C. Reward learning: reinforcement, incentives, and expectations Medin The Psychology of Learning and Motivation. Advances in Research and Theory Vol 40 2001 Academic Press San Diego 223 278
16. Berridge K.C., and Robinson T.E. What is the role of dopamine in reward: Hedonic impact, reward learning, or incentive salience? Brain Res. Rev. 28 1998 309 369
17. Bertrand D., and Changeux J.P. Nicotinic receptor: an allosteric protein specialized for intercellular communication Semin. Neurosci. 7 1995 75 90
18. Bichot N.P., Thompson K.G., Chenchal Rao S., and Schall J.D. Reliability of macaque frontal eye field neurons signaling saccade targets during visual search J. Neurosci. 21 2001 713 725
19. Braesicke K., Parkinson J.A., Reekie Y., Man M.S., Hopewell L., Pears A., Crofts H., Schnell C.R., and Roberts A.C. Autonomic arousal in an appetitive context in primates: a behavioural and neural analysis Eur. J. Neurosci. 21 2005 1733 1740
20. Brown J.W., Bullock D., and Grossberg S. How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues J. Neurosci. 19 1999 10502 10511
21. Brown J.W., Bullock D., and Grossberg S. How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades Neural Netw. 17 2004 471 510
22. Brown T.H., Kairiss E.W., and Keenan C.L. Hebbian synapses: biophysical mechanisms and algorithms Annu. Rev. Neurosci. 13 1990 475 511
23. Buffalo E.A., Ramus S.J., Clark R.E., Teng E., Squire L.R., and Zola S.M. Dissociation between the effects of damage to perirhinal cortex and area TE Learn. Mem. 6 1999 572 599
24. Bullier J., Schall J.D., and Morel A. Functional streams in occipito-frontal connections in the monkey Behav. Brain Res. 76 1996 89 97
25. Burwell R.D., and Amaral D.G. Cortical afferents of the perirhinal, postrhinal, and entorhinal cortices of the rat J. Comp. Neurol. 398 1998 179 205
26. Busemeyer J.R., Townsend J.T., and Stout J.C. Motivational Underpinnings of Utility in Decision Making: Decision Field Theory Analysis of Deprivation and Satiation 2002 John Benjamins Amsterdam
27. Cabanac M., and Lafrance L. Duodenal preabsorptive origin of gustatory alliesthesia in rats Am. J. Physiol. 263 1992 R1013 1017
28. Cardinal R.N., Parkinson J.A., Hall J., and Everitt B.J. Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex Neurosci. Biobehav. Rev. 26 2002 321 352
29. Carmichael S.T., and Price J.L. Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys J. Comp. Neurol. 363 1995 615 641
30. Carpenter G., and Grossberg S. A massively parallel architecture for a self-organizing neural pattern recognition machine Comput. Vis. Graph. Image Process. 37 1987 54 115
31. Carpenter G.A., and Grossberg S. Pattern Recognition by Self-Organizing Neural Networks 1991 MIT Press Cambridge MA
32. Chance F.S., Abbott L.F., and Reyes A.D. Gain modulation from background synaptic input Neuron 35 2002 773 782
33. Cohen J.D., McClure S.M., and Yu A.J. Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration Philos. Trans. R. Soc. Lond., B Biol. Sci. 362 2007 933 942
34. Conover K.L., and Shizgal P. Differential effects of postingestive feedback on the reward value of sucrose and lateral hypothalamic stimulation in rats Behav. Neurosci. 108 1994 559 572
35. Conover K.L., Woodside B., and Shizgal P. Effects of sodium depletion on competition and summation between rewarding effects of salt and lateral hypothalamic stimulation in the rat Behav. Neurosci. 108 1994 549 558
36. Corbit L.H., and Balleine B.W. Instrumental and Pavlovian incentive processes have dissociable effects on components of a heterogenous instrumental chain J. Exp. Psych., Anim. Behav. Processes 29 2003 99 106
37. Corbit L.H., and Balleine B.W. Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer J. Neurosci. 25 2005 962 970
38. Corbit L.H., Muir J.L., and Balleine B.W. The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell J. Neurosci. 21 2001 3251 3260
39. Critchley H.D., and Rolls E.T. Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex J. Neurophysiol. 75 1996 1673 1686
40. Davidson T.L., Altizer A.M., Benoit S.C., Walls E.K., and Powley T.L. Encoding and selective activation of "metabolic memories' in the rat Behav. Neurosci. 111 1997 1014 1030
41. Dayan P. Motivated reinforcement learning NIPS 14 2001 11 18
42. Deco G., and Rolls E.T. Synaptic and spiking dynamics underlying reward reversal in the orbitofrontal cortex Cereb. Cortex 15 2005 15 30
43. DeFalco J., Tomishima M., Liu H., Zhao C., Cai X., Marth J.D., Enquist L., and Friedman J.M. Virus-assisted mapping of neural inputs to a feeding center in the hypothalamus Science 291 2001 2608 2613
44. Denny M.R. Relaxation theory and experiments FR Brush Aversive Conditioning and Learning 1970 Academic Press New York
45. Dickinson A., and Dearing M.F. Appetitive-Aversive Interactions and Inhibitory Processes 1979 Erlbaum Hillsdale NJ
46. Dickinson A., and Balleine B.W. The role of learning in the operation of motivational systems HE Pashler R Gallistel Steven's Handbook Of Experimental Psychology 3 rd Edition 2001 John Wiley & Sons New York 497 533
47. Dranias M.R., Bullock D., and Grossberg S. A neural network model of conditioning and outcome-specific revaluation: interactions of the orbitofrontal cortex, amygdala, hypothalamus, and basal ganglia Soc. Neurosci. 2006 2006. 216.13. Atlanta, GA
48. Dranias M.R., Bullock D., and Grossberg S. Emotional and Behavioral Responses to the Devaluation of Stimuli by Satiation: A Computational Model 2007 Computat and Systems Neurosci. III-68 Salt Lake City, UT
49. Dranias M.R., Bullock D., and Grossberg S. Neural Dynamics of Conditioning and Outcome-Specific Revaluation: Cortical, Amygdala, Hypothalamic, and Basal Ganglia. Interactions 2007 Eleventh Internatl Conf on Cognit and Neural Syst Boston, MA
50. Dunn L.T., and Everitt B.J. Double dissociations of the effects of amygdala and insular cortex lesions on conditioned taste aversion, passive avoidance, and neophobia in the rat using the excitotoxin ibotenic acid Behav. Neurosci. 102 1988 3 23
51. Easton A., and Gaffan D. Comparison of perirhinal cortex ablation and crossed unilateral lesions of the medial forebrain bundle from the inferior temporal cortex in the rhesus monkey: Effects on learning and retrieval Behav. Neurosci. 114 2000 1041 1057
52. Ferry A.T., Lu X.M., and Price J.L. Effects of excitotoxic lesions in the ventral striatopallidal-thalamocortical pathway on odor reverse learning: inability to extinguish an incorrect response Exp. Brain Res. 131 1999 320 335
53. Ferry A.T., Ongur D., An X., and Price J.L. Prefrontal cortical projections to the striatum in macaque monkeys: evidence for an organization related to prefrontal networks J. Comp. Neurol. 425 2000 447 470
54. Fiala J.C., Grossberg S., and Bullock D. Metabotropic glutamate receptor activation in cerebellar Purkinje cells as substrate for adaptive timing of the classically conditioned eye-blink response J. Neurosci. 16 1996 3760 3774
55. Fiorillo C.D., Tobler P.N., and Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons Science 299 2003 1899 1902
56. Fiorillo C.D., Tobler P.N., and Schultz W. Evidence that the delay-period activity of dopamine neurons corresponds to reward uncertainty rather than backpropagating TD errors Behav. Brain Func. 1 2005 7
57. Frank M.J., and Claus E.D. Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal Psychol. Rev. 113 2006 300 326
58. Friedman D.P., Aggleton J.P., and Saunders R.C. Comparison of hippocampal, amygdala, and perirhinal projections to the nucleus accumbens: combined anterograde and retrograde tracing study in the macaque brain J. Comp. Neurol. 450 2002 345 365
59. Fukuda M., Ono T., and Nakamura K. Functional relations among inferotemporal cortex, amygdala, and lateral hypothalamus in monkey operant feeding behavior J. Neurophysiol. 57 1987 1060 1077
60. Gaffan D. Dissociated effects of perirhinal cortex ablation, fornix transection and amygdalectomy: evidence for multiple memory systems in the primate temporal lobe Exp. Brain Res. 99 1994 411 422
61. Gallagher M., McMahan R.W., and Schoenbaum G. Orbitofrontal cortex and representation of incentive value in associative learning J. Neurosci. 19 1999 6610 6614
62. Garris P.A., and Rebec G.V. Modeling fast dopamine neurotransmission in the nucleus accumbens during behavior Behav. Brain Res. 137 2002 47 63
63. Ghashghaei H.T., and Barbas H. Pathways for emotion: interactions of prefrontal and anterior temporal pathways in the amygdala of the rhesus monkey Neuroscience 115 2002 1261 1279
64. Gove A., Mingolla E., and Grossberg S. Brightness perception, illusory contours, and corticogeniculate feedback Vis. Neurosci. 12 1995 1027 1052
65. Grossberg S. Some nonlinear networks capable of learning a spatial pattern of arbitrary complexity Proc. Natl. Acad. Sci. 59 1968 368 372
66. Grossberg S. On the dynamics of operant conditioning J. Theor. Biol. 33 1971 225 255
67. Grossberg S. A neural theory of punishment and avoidance: I. Qualitative theory Math Biosci. 15 1972 39 67
68. Grossberg S. A neural theory of punishment and avoidance: II. Quantitative theory Math Biosci. 15 1972 253 285
69. Grossberg S. Contour enhancement, short-term memory, and constancies in reverberating neural networks Stud. Appl. Math. 52 1973 213 257
70. Grossberg S. A neural model of attention, reinforcement and discrimination learning Int. Rev. Neurobiol. 18 1975 263 327
71. Grossberg S. Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors Biol. Cybern. 23 1976 121 134
72. Grossberg S. How does a brain build a cognitive code? Psychol. Rev. 87 1980 1 51
73. Grossberg S. Processing of expected and unexpected events during conditioning and attention: a psychophysiological theory Psychol. Rev. 89 1982 529 572
74. Grossberg S. Some psychophysiological and pharmacological correlates of a developmental, cognitive, and motivational theory R Karrer J Cohen P Tueting Brain and Information: Event Related Potentials 1984 New York Academy of Sciences New York 58 142
75. Grossberg S. Nonlinear neural networks: principles, mechanisms, and architectures Neural Nets 1 1988 17 61
76. Grossberg S. How does the cerebral cortex work? Learning, attention and grouping by the laminar circuits of visual cortex Spat. Vis. 12 1999 163 186
77. Grossberg S. The imbalanced brain: from normal behavior to schizophrenia Biol. Psychiatry 48 2000 81 98
78. Grossberg S. The complementary brain: unifying brain dynamics and modularity Trends Cogn. Sci. 4 2000 233 246
79. Grossberg S. How does the cerebral cortex work? Development, learning, attention, and 3D vision by laminar circuits of visual cortex Behav. Cogn. Neurosci. Rev. 2 2003 47 76
80. Grossberg, S., Bullock, D., Dranias, M.R., in press. Neural dynamics underlying impaired autonomic and conditioned responses following amygdala and orbiotfrontal lesions. Behav. Neuro.
81. Grossberg S., and Gutowski W.E. Neural dynamics of decision making under risk: affective balance and cognitive-emotional interactions Psychol. Rev. 94 1987 300 318
82. Grossberg S., and Levine D.S. Neural dynamics of attentionally modulated Pavlovian conditioning: blocking, inter-stimulus interval, and secondary reinforcement Appl. Opt. 26 1987 5015 5030
83. Grossberg S., Levine D., and Schmajuk N. Predictive regulation of associative learning in a neural network by reinforcement and attentive feedback Int. J. Neurol. 21-22 1987 83 104
84. Grossberg S., and Merrill J.W. A neural network model of adaptively timed reinforcement learning and hippocampal dynamics Cogn. Brain Res. 1 1992 3 38
85. Grossberg S., and Merrill J.W.L. The hippocampus and cerebellum in adaptively timed learning, recognition, and movement J. Cogn. Neurosci. 8 1996 257 277
86. Grossberg S., and Schmajuk N.A. Neural dynamics of attentionally modulated Pavlovian conditioning: conditioned reinforcement, inhibition, and opponent processing Psychobiology 15 1987 195 240
87. Grossberg S., and Schmajuk N.A. Neural dynamics of adaptive timing and temporal discrimination during associative learning Neural Netw. 2 1989 79 102
88. Haber S.N., Lynd-Balta E., and Mitchell S.J. The organization of the descending ventral pallidal projections in the monkey J. Comp. Neurol. 329 1993 111 128
89. Haber S.N., Fudge J.L., and McFarland N.R. Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum J. Neurosci. 20 2000 2369 2382
90. Hall G. Conditioning H.E. Pashler Steven's Handbook of Experimental Psychology 2001 John Wiley & Sons New York 4
91. Hatfield T., Han J.S., Conley M., Gallagher M., and Holland P. Neurotoxic lesions of basolateral, but not central, amygdala interfere with pavlovian second-order conditioning and reinforcer devaluation effects J. Neurosci. 16 1996 5256 5265
92. Hikosaka K., and Watanabe M. Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards Cereb. Cortex 10 2000 263 271
93. Hodgkin A.L., and Huxley A.F. A quantitative description of membrane current and its application to conduction and excitation in nerve J. Physiol. 117 1952 500 544
94. Hosokawa T., Kato K., Inoue M., and Mikami A. Neurons in the orbitofrontal cortex code both visual shapes and reward types NeuroReport 15 2004 1493 1496
95. Insausti R., Amaral D.G., and Cowan W.M. The entorhinal cortex of the monkey: II. Cortical afferents J. Comp. Neurol. 264 1987 356 395
96. Jagadeesh B., Chelazzi L., Mishkin M., and Desimone R. Learning increases stimulus salience in anterior inferior temporal cortex of the macaque J. Neurophysiol. 86 2001 290 303
97. Kahneman D., and Tversky A. Prospect theory: an analysis of decision under risk Econometrica 47 1979 263 291
98. Kantak K.M., Green-Jordan K., Valencia E., Kremin T., and Eichenbaum H.B. Cognitive task performance after lidocaine-induced inactivation of different sites within the basolateral amygdala and dorsal striatum Behav. Neurosci. 115 2001 589 601
99. Karadi Z., Oomura Y., Nishino H., Scott T.R., Lenard L., and Aou S. Responses of lateral hypothalamic glucose-sensitive and glucose-insensitive neurons to chemical stimuli in behaving rhesus monkeys J. Neurophysiol. 67 1992 389 400
100. Kobayashi Y., Inoue Y., Yamamoto M., Isa T., and Aizawa H. Contribution of pedunculopontine tegmental nucleus neurons to performance of visually guided saccade tasks in monkeys J. Neurophysiol. 88 2002 715 731
101. Kondoh T., Mori M., Ono T., and Torii K. Mechanisms of umami taste preference and aversion in rats J. Nutr. 130 2000 966S 970S
102. Lauwereyns J., Watanabe K., Coe B., and Hikosaka O. A neural correlate of response bias in monkey caudate nucleus Nature 418 2002 413 417
103. Lavoie B., and Parent A. Pedunculopontine nucleus in the squirrel monkey: cholinergic and glutamatergic projections to the substantia nigra J. Comp. Neurol. 344 1994 232 241
104. Liu Z., and Richmond B.J. Response differences in monkey TE and perirhinal cortex: stimulus association related to reward schedules J. Neurophysiol. 83 2000 1677 1692
105. Ljungberg T., Apicella P., and Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions J. Neurophysiol. 67 1992 145 163
106. Luck S.J., Chelazzi L., Hillyard S.A., and Desimone R. Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex J. Neurophysiol. 77 1997 24 42
107. Malkova L., Gaffan D., and Murray E.A. Excitotoxic lesions of the amygdala fail to produce impairment in visual learning for auditory secondary reinforcement but interfere with reinforcer devaluation effects in rhesus monkeys J. Neurosci. 17 1997 6011 6020
108. McDonald A.J. Cortical pathways to the mammalian amygdala Prog. Neurobiol. 55 1998 257 332
109. Mogami T., and Tanaka K. Reward association affects neuronal responses to visual stimuli in macaque TE and perirhinal cortices J. Neurosci. 26 2006 6761 6770
110. Muramoto K., Ono T., Nishijo H., and Fukuda M. Rat amygdaloid neuron responses during auditory discrimination Neuroscience 52 1993 621 636
111. Murray E.A., and Mishkin M. Object recognition and location memory in monkeys with excitotoxic lesions of the amygdala and hippocampus J. Neurosci. 18 1998 6568 6582
112. Murray E.A., Gaffan E.A., and Flint R.W. Jr. Anterior rhinal cortex and amygdala: dissociation of their contributions to memory and food preference in rhesus monkeys Behav. Neurosci. 110 1996 30 42
113. Nakamura K., and Ono T. Lateral hypothalamus neuron involvement in integration of natural and artificial rewards and cue signals J. Neurophysiol. 55 1986 163 181
114. Nakamura K., Ono T., and Tamura R. Central sites involved in lateral hypothalamus conditioned neural responses to acoustic cues in the rat J. Neurophysiol. 58 1987 1123 1148
115. Nakamura K., Ono T., Fukuda M., and Uwano T. Paraventricular neuron chemosensitivity and activity related to blood pressure control in emotional behavior J. Neurophysiol. 67 1992 255 264
116. Nakano Y., Oomura Y., Lenard L., Nishino H., Aou S., Yamamoto T., and Aoyagi K. Feeding-related activity of glucose- and morphine-sensitive neurons in the monkey amygdala Brain Res. 399 1986 167 172
117. Nishijo H., Ono T., and Nishino H. Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance J. Neurosci. 8 1988 3570 3583
118. Nishijo H., Ono T., and Nishino H. Topographic distribution of modality-specific amygdalar neurons in alert monkey J. Neurosci. 8 1988 3556 3569
119. Niv Y., Duff M.O., and Dayan P. Dopamine, uncertainty, and TD learning Behav. Brain Func. 1 2005 6
120. Oakman S.A., Faris P.L., Kerr P.E., Cozzari C., and Hartman B.K. Distribution of pontomesencephalic cholinergic neurons projecting to substantia nigra differs significantly from those projecting to ventral tegmental area J. Neurosci. 15 1995 5859 5869
121. Olson S., and Grossberg S. A neural network model for the development of simple and complex cell receptive fields within cortical maps of orientation and ocular dominance Neural Netw. 11 1998 189 208
122. Ongur D., and Price J.L. The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans Cereb. Cortex 10 2000 206 219
123. Ono T., Nakamura K., Nishijo H., and Fukuda M. Hypothalamic neuron involvement in integration of reward, aversion, and cue signals J. Neurophysiol. 56 1986 63 79
124. Ono T., Sasaki K., Nishino H., Fukuda M., and Shibata R. Feeding and diurnal related activity of lateral hypothalamic neurons in freely behaving rats Brain Res. 373 1986 92 102
125. Owens D.F., and Kriegstein A.R. Is there more to GABA than synaptic inhibition? Nat. Rev., Neurosci. 3 2002 715 727
126. Padoa-Schioppa C., and Assad J.A. Neurons in the orbitofrontal cortex encode economic value Nature 441 2006 223 226
127. Papini M.R. Comparative psychology of surprising nonreward Brain Behav. Evol. 62 2003 83 95
128. Parker A., and Gaffan D. Lesions of the primate rhinal cortex cause deficits in flavour-visual associative memory Behav. Brain Res. 93 1998 99 105
129. Paton J.J., Belova M.A., Morrison S.E., and Salzman C.D. The primate amygdala represents the positive and negative value of visual stimuli during learning Nature 439 2006 865 870
130. Pecina S., and Berridge K.C. Brainstem mediates diazepam enhancement of palatability and feeding: microinjections into fourth ventricle versus lateral ventricle Brain Res. 727 1996 22 30
131. Petrovich G.D., Canteras N.S., and Swanson L.W. Combinatorial amygdalar inputs to hippocampal domains and hypothalamic behavior systems Brain Res. Rev. 38 2001 247 289
132. Peyron C., Tighe D.K., van den Pol A.N., de Lecea L., Heller H.C., Sutcliffe J.G., and Kilduff T.S. Neurons containing hypocretin (orexin) project to multiple neuronal systems J. Neurosci. 18 1998 9996 10015
133. Price J.L. Comparative aspects of amygdala connectivity Ann. N. Y. Acad. Sci. 985 2003 50 58
134. Reep R.L., Corwin J.V., and King V. Neuronal connections of orbital cortex in rats: topography of cortical and thalamic afferents Exp. Brain Res. 111 1996 215 232
135. Rempel-Clower N.L., and Barbas H. The laminar pattern of connections between prefrontal and anterior temporal cortices in the rhesus monkey is related to cortical structure and function Cereb. Cortex 10 2000 851 865
136. Rescorla R.A. Retraining of extinguished pavlovian stimuli J. Exp. Psychol., Anim. Behav. Processes 27 2001 115 124
137. Reynolds S.M., and Berridge K.C. Positive and negative emotion in nucleus accumbens shell: bivalent rostrocaudal gradients for GABA-elicited eating, taste "liking"/"disliking" reactions, place preference/avoidance, and fear J. Neurosci. 22 2002 7308 7320
138. Richmond B.J., and Sato T. Enhancement of inferior temporal neurons during visual discrimination J. Neurophysiol. 58 1987 1292 1306
139. Risold P.Y., Thompson R.H., and Swanson L.W. The structural organization of connections between the hypothalamus anad cerebral cortex Brain Res. Rev. 24 1997 197 254
140. Roesch M.R., and Olson C.R. Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex J. Neurophysiol. 90 2003 1766 1789
141. Roesch M.R., and Olson C.R. Neuronal activity related to reward value and motivation in primate frontal cortex Science 304 2004 307 310
142. Rolls E.T. The orbitofrontal cortex and reward Cereb. Cortex 10 2000 284 294
143. Rolls E.T., and Baylis L.L. Gustatory, olfactory, and visual convergence within the primate orbitofrontal cortex J. Neurosci. 14 1994 5437 5452
144. Rolls E.T., Critchley H.D., Mason R., and Wakeman E.A. Orbitofrontal cortex neurons: role in olfactory and visual association learning J. Neurophysiol. 75 1996 1970 1981
145. Rolls E.T., Murzi E., Yaxley S., Thorpe S.J., and Simpson S.J. Sensory-specific satiety: food-specific reduction in responsiveness of ventral forebrain neurons after feeding in the monkey Brain Res. 368 1986 79 86
146. Rolls E.T., Critchley H.D., Browning A.S., Hernadi I., and Lenard L. Responses to the sensory properties of fat of neurons in the primate orbitofrontal cortex J. Neurosci. 19 1999 1532 1540
147. Rolls E.T., Sanghera M.K., and Roper-Hall A. The latency of activation of neurons in the lateral hypothalamus and substantia innominata during feeding in the monkey Brain Res. 164 1979 121 135
148. Russchen F.T. Cortical and subcortical afferents of the amygdaloid complex Adv. Exp. Med. Biol. 203 1986 35 52
149. Sah P., Faber E.S., Lopez De Armentia M., and Power J. The amygdaloid complex: anatomy and physiology Physiol. Rev. 83 2003 803 834
150. Saleem K.S., and Tanaka K. Divergent projections from the anterior inferotemporal area TE to the perirhinal and entorhinal cortices in the macaque monkey J. Neurosci. 16 1996 4757 4775
151. Salinas E., and Their P. Gain modulation: a major computational principle of the central nervous system Neuron 27 2000 15 21
152. Sato T., Murthy A., Thompson K.G., and Schall J.D. Search efficiency but not response interference affects visual selection in frontal eye field Neuron 30 2001 583 591
153. Schall J.D., and Thompson K.G. Neural selection and control of visually guided eye movements Annu. Rev. Neurosci. 22 1999 241 259
154. Schoenbaum G., Setlow B., Saddoris M.P., and Gallagher M. Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala Neuron 39 2003 855 867
155. Schultz W. Behavioral dopamine signals Trends Neurosci. 30 2007 203 210
156. Schultz W., Tremblay L., and Hollerman J.R. Reward processing in primate orbitofrontal cortex and basal ganglia Cereb. Cortex 10 2000 272 284
157. Sclafani A. Oral and postoral determinants of food reward Physiol. Behav. 81 2004 773 779
158. Scott T.R., Yan J., and Rolls E.T. Brain mechanisms of satiety and taste in macaques Neurobiology (Bp) 3 1995 281 292
159. Semba K., and Fibiger H.C. Afferent connections of the laterodorsal and the pedunculopontine tegmental nuclei in the rat: a retro- and antero-grade transport and immunohistochemical study J. Comp. Neurol. 323 1992 387 410
160. Sewards T.V., and Sewards M.A. Cortical association areas in the gustatory system Neurosci. Biobehav. Rev. 25 2001 395 407
161. Shi C.J., and Cassell M.D. Cortical, thalamic, and amygdaloid projections of rat temporal cortex J. Comp. Neurol. 382 1997 153 175
162. Shimizu N., Oomura Y., and Sakata T. Modulation of feeding by endogenous sugar acids acting as hunger or satiety factors Am. J. Physiol. Regul. Integr. Comp. Physiol. 246 1984 542 550
163. Small D.M., Bender G., Veldhuizen M.G., Rudenga K., Nachtigal D., and Felsted J. The Role of the Human Orbitofrontal Cortex in Taste and Flavor Processing Ann. N. Y. Acad. Sci. 2007 Annals PrePrint, published online ahead of print. doi: 10.1196/annals.1401.002 from the Annals volume Linking Affect to Action: Critical Contributions of the Orbitofrontal Cortex http://www. annalsnyas.org/cgi/rapidpdf/annals.1401.002v1 retrieved 9-29-2007
164. Smith K.S., and Berridge K.C. The ventral pallidum and hedonic reward: Neurochemical maps of sucrose "liking" and food intake J. Neurosci. 25 2005 8637 8649
165. Solomon R.L. The opponent process theory of acquired motivation Am. Psychol. 35 1980 691 712
166. Spooren W.P., Lynd-Balta E., Mitchell S., and Haber S.N. Ventral pallidostriatal pathway in the monkey: evidence for modulation of basal ganglia circuits J. Comp. Neurol. 370 1996 295 312
167. Suzuki W., Saleem K.S., and Tanaka K. Divergent backward projections from the anterior part of the inferotemporal cortex (area TE) in the macaque J. Comp. Neurol. 422 2000 206 228
168. Suzuki W.A., Miller E.K., and Desimone R. Object and place memory in the macaque entorhinal cortex J. Neurophysiol. 78 1997 1062 1081
169. Swanson L.W. Cerebral hemisphere regulation of motivated behavior Brain Res. 886 2000 113 164
170. Tan C.O., and Bullock D. Neuropeptide co-release with GABA may explain functional non-monotonic uncertainty responses in dopamine neurons Neurosci. Lett. 430 2008 218 223
171. Tan, C.O. and Bullock, D., 2008b. A local circuit model of learned striatal and dopamine cell responses under probabilistic schedules of reward. J. Neurosci. Submitted for publication.
172. Thorpe S.J., Rolls E.T., and Maddison S. The orbitofrontal cortex: neuronal activity in the behaving monkey Exp. Brain Res. 49 1983 93 115
173. Torii K., Kondoh T., Mori M., and Ono T. Hypothalamic control of amino acid appetite Ann. N. Y. Acad. Sci. 855 1998 417 425
174. Touzani K., and Sclafani A. Lateral hypothalamic lesions impair flavour-nutrient and flavour-toxin trace learning in rats Eur. J. Neurosci. 16 2002 2425 2433
175. Tremblay L., and Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex J. Neurophysiol. 83 2000 1877 1885
176. Tremblay L., and Schultz W. Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex J. Neurophysiol. 83 2000 1864 1876
177. van den Pol A.N., and Trombley P.Q. Glutamate neurons in hypothalamus regulate excitatory transmission J. Neurosci. 13 1993 2829 2836
178. Veazey R.B., Amaral D.G., and Cowan W.M. The morphology and connections of the posterior hypothalamus in the cynomolgus monkey (Macaca fascicularis): II. Efferent connections J. Comp. Neurol. 207 1982 135 156
179. Voytko M.L. Visual learning and retention examined with reversible cold lesions of the anterior temporal lobe Behav. Brain Res. 22 1986 25 39
180. Wachsmuth E., Oram M.W., and Perrett D.I. Recognition of objects and their component parts: responses of single units in the temporal cortex of the macaque Cereb. Cortex 4 1994 509 522
181. Wagner A.R., Mazur J.E., Donegan N.H., and Pfautz P.L. Evaluation of blocking and conditioned inhibition to a CS signaling a decrease in US intensity J. Exp. Psychol. Anim. Behav. Processes 6 1980 376 385
182. Weiss S.J., Thomas D.A., and Weissman R.D. Combining operant-baseline- derived conditioned excitors and inhibitors from the same and different incentive classes: an investigation of appetitive-aversive interactions Q. J. Exp. Psychol., B 49 1996 357 381
183. Wickens J.R., Begg A.J., and Arbuthnott G.W. Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro Neuroscience 70 1996 1 5
184. Wilson F.A., and Rolls E.T. The effects of stimulus novelty and familiarity on neuronal activity in the amygdala of monkeys performing recognition memory tasks Exp. Brain Res. 93 1993 367 382
185. Xiang J.Z., and Brown M.W. Differential neuronal responsiveness in primate perirhinal cortex and hippocampal formation during performance of a conditional visual discrimination task Eur. J. Neurosci. 11 1999 3715 3724
186. Yan J., and Scott T.R. The effect of satiety on responses of gustatory neurons in the amygdala of alert cynomolgus macaques Brain Res. 740 1996 193 200
187. Yonemori M., Nishijo H., Uwano T., Tamura R., Furuta I., Kawasaki M., Takashima Y., and Ono T. Orbital cortex neuronal responses during an odor-based conditioned associative task in rats Neuroscience 95 2000 691 703
188. Zahm D.S. Functional-anatomical implications of the nucleus accumbens core and shell subterritories Ann. N. Y. Acad. Sci. 877 1999 113 128
189. Zahm D.S. An integrative neuroanatomical perspective on some subcortical substrates of adaptive responding with emphasis on the nucleus accumbens Neurosci. Biobehav. Rev. 24 2000 85 105
190. Zhang S., Blache D., Vercoe P.E., Adam C.L., Blackberry M.A., Findlay P.A., Eidne K.A., and Martin G.B. Expression of orexin receptors in the brain and peripheral tissues of the male sheep Regul. Pept. 124 2005 81 87
191. Zhang W., Sakurai T., Fukuda Y., and Kuwaki T. Orexin neuron-mediated skeletal muscle vasodilation and shift of baroreflex during defense response in mice Am. J. Physiol. Regul. Integr. Comp. Physiol. 290 2006 R1654 1663