Responses of amygdala neurons to positive reward-predicting stimuli depend on background reward (contingency) rather than stimulus-reward pairing (contiguity)

Journal of Neurophysiology

Volumn 103, Issue 3, 2010, Pages 1158-1170

  Bermudez, Maria A ^a   Schultz, Wolfram ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AMYGDALOID NUCLEUS; ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; BRAIN REGION; MALE; NONHUMAN; PREDICTION; PRIORITY JOURNAL; REWARD; RHESUS MONKEY; STIMULUS; TASK PERFORMANCE;

AMYGDALA; ANIMALS; CONDITIONING, CLASSICAL; CUES; DATA INTERPRETATION, STATISTICAL; ELECTROPHYSIOLOGY; FIXATION, OCULAR; MACACA MULATTA; MALE; NEURONS; PHOTIC STIMULATION; REWARD; ROC CURVE;

EID: 77949742114     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.00933.2009     Document Type: Article

References (67)

1. Aggleton JP, Passingham RE. Stereotaxic surgery under X-ray guidance in the rhesus monkey, with special reference to the amygdala. Exp Brain Res 44: 271-276, 1981.
2. Baker AG. Conditioned inhibition arising from a between-sessions negative correlation. J Exp Psychol 3: 144-155, 1977.
3. Balsam PD, Fairhurst S, Gallistel CR. Pavlovian contingencies and temporal information. J Exp Psychol Anim Behav Proc 32: 284-294, 2006.
4. Balsam PD, Gallistel CR. Temporal maps and informativeness in associative learning. Trends Neurosci 32: 73-78, 2008.
5. Baxter MG, Parker A, Lindner CCC, Izquierdo AD, Murray EA. Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. J Neurosci 20: 4311-4319, 2000.
6. Belova MA, Paton JJ, Morrison SE, Salzman CD. Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala. Neuron 55: 970-984, 2007.
7. Belova MA, Paton JJ, Salzman CD. Moment-to-moment tracking of state value in the amygdala. J Neurosci 28: 10023-10030, 2008.
8. Bouton ME, Rosengard C, Achenbach GG, Peck CA, Brooks DC. Effects of contextual conditioning and unconditional stimulus presentation on performance in appetitive conditioning. Q J Exp Psychol B 46: 63-95, 1993.
9. Britten KH, Newsome WT, Shadlen MN, Celebrini S, Movshon JA. A relationship between behavioral choice and the visual responses of neurons in macaque MT. Vis Neurosci 13: 87-100, 1996.
10. Carelli RM, Williams JG, Hollander JA. Basolateral amygdala neurons encode cocaine self-administration and cocaine-associated cues. J Neurosci 23: 8204-8211, 2003.
11. Cromwell HC, Schultz W. Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J Neurophysiol 89: 2823-2838, 2003.
12. Delamater AR. Outcome selective effects of intertrial reinforcement in a Pavlovian appetitive conditioning paradigm with rats. Anim Learn Behav 23: 31-39, 1995.
13. Dias R, Robbins TW, Roberts AC. Dissociation in prefrontal cortex of affective and attentional shifts. Nature 380: 69-72, 1996.
14. Dickinson A. Contemporary Animal Learning Theory. Cambridge, UK: Cambridge Univ. Press, 1980.
15. Dweck CS, Wagner AR. Situational cues and the correlation between CS and US as determinants of the conditioned emotional response. Psychon Science 18: 145-147, 1970.
16. Egger MD, Miller NE. Secondary reinforcement in rats as a function of information value and reliability of the stimulus. J Exp Psychol 64: 97-104, 1962.
17. Everitt BJ, Cardinal RN, Parkinson JA, Robbins TW. Appetitive behavior: impact of amygdala-dependent mechanisms of emotional learning. Ann NY Acad Sci 985: 233-250, 2003.
18. Everitt BJ, Morris KA, O'Brien A, Robbins TW. The basolateral amygdala-ventral striatal system and conditioned place preference: further evidence of limbic-striatal interactions underlying reward-related processes. Neuroscience 42: 1-18, 1991.
19. Falls WA, Davis M. Lesions of the central nucleus of the amygdala block conditioned excitation, but not conditioned inhibition of fear as measured with the fear-potentiated startle effect. Behav Neurosci 109: 379-387, 1995.
20. Gaffan D, Murray EA, Fabre-Thorpe M. Interaction of the amygdala with the frontal lobe in reward memory. Eur J Neurosci 5: 968-975, 1993.
21. Gallistel CR. Conditioning from an information processing perspective. Behav Proc 62: 89-101, 2003.
22. Gibbon J, Balsam P. Spreading Association in Time. New York: Academic, 1981.
23. Goldberg ME, Wurtz RH. Activity of superior colliculus in behaving monkey. II. Effect of attention on neuronal responses. J Neurophysiol 35: 560-574, 1972.
24. Green DM, Swets JA. Signal Detection Theory and Psychophysics. New York: Wiley, 1966.
25. Han JS, McMahan RW, Holland P, Gallagher M. The role of an amygdalo-nigrostriatal pathway in associative learning. J Neurosci 17: 3913-3919, 1997.
26. Hatfield T, Han JS, Conley M, Gallagher M, Holland P. Neurotoxic lesions of basolateral, but not central, amygdala interfere with Pavlovian second-order conditioning and reinforcer devaluation effects. J Neurosci 16: 5256-5265, 1996.
27. Histed MH, Pasupathy A, Miller EK. Learning substrates in the primate prefrontal cortex and striatum: sustained activity related to successful actions. Neuron 63: 244-253, 2009.
28. Houk JC, Adams JL, Barto AG. A model of how the basal ganglia generate and use neural signals that predict reinforcement. In: Models of Information Processing in the Basal Ganglia, edited by Houk JC, Davis JL, Beiser DG. Cambridge, MA: MIT Press, 1995, p. 249-270.
29. Janssen P, Shadlen MN. A representation of the hazard rate of elapsed time in macaque area LIP. Nat Neurosci 8: 234-241, 2005.
30. Leon MI, Shadlen MN. Effect of expected reward magnitude on the responses of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 24: 415-425, 1999.
31. Luce RD. Response Times: Their Role in Inferring Elementary Mental Organization. New York: Oxford, 1986.
32. Málková L, Gaffan D, Murray EA. Excitotoxic lesions of the amygdala fail to produce impairments in visual learning for auditory secondary reinforcement but interfere with reinforcer devaluation effects in rhesus monkeys. J Neurosci 17: 6011-6020, 1997.
33. Maren S, Fanselow MS. Synaptic plasticity in the basolateral amygdala induced by hippocampal formation stimulation in vivo. J Neurosci 15: 7548-7564, 1995.
34. Maunsell JHR. Neuronal representations of cognitive state: reward or attention? Trends Neurosci 8: 261-265, 2004.
35. Miller RR, Schachtman TR. The several roles of context at the time of retrieval. In: Context and Learning, edited by Balsam PD, Tomie A. Hillsdale, NJ: Lawrence Erlbaum, 1985, p. 167-194.
36. Montague PR, Dayan P, Sejnowski TJ. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16: 1936-1947, 1996.
37. Musallam S, Corneil BD, Greger B, Scherberger H, Andersen RA. Cognitive control signals for neural prosthetics. Science 305: 258-262, 2004.
38. Ono T, Nishijo H, Uwano T. Amygdala role in conditioned associative learning. Prog Neurobiol 46: 401-422, 1995.
39. Ostlund SB, Balleine BW. Differential involvement of the basolateral amygdala and mediodorsal thalamus in instrumental action selection. J Neurosci 28: 4398-4405, 2008.
40. Paton JJ, Belova MA, Morrison SE, Salzman CD. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439: 865-870.
41. Pavlov IP. Conditioned Reflexes. London: Oxford, 1927.
42. Paxinos G, Huang X, Toga AW. The Rhesus Monkey Brain in Stereotaxic Coordinates. New York: Academic, 2000.
43. Phelps EA. Human emotion and memory: interactions of the amygdala and hippocampal complex. Curr Opin Neurobiol 14: 198-202, 2004.
44. PitkäA, Pikkarainen M, Nurminen N, Ylinen A. Reciprocal connections between the amygdala and the hippocampal formation, perirhinal cortex, and postrhinal cortex in rat. A review. Ann NY Acad Sci 911: 369-391, 2000.
45. Platt ML, Glimcher PW. Neural correlates of decision variables in parietal cortex. Nature 400: 233-238, 1999.
46. Pratt WE, Mizumori SJY. Characteristics of basolateral amygdala neuronal firing on a spatial memory task involving differential reward. Behav Neurosci 112: 554-570, 1998.
47. Rescorla RA. Pavlovian conditioning and its proper control procedures. Psychol Rev 74: 71-80, 1967.
48. Rescorla RA. Probability of shock in the presence and absence of CS in fear conditioning. J Comp Physiol Psychol 66: 1-5, 1968.
49. Rescorla RA. Conditioned inhibition of fear resulting from negative CS-US contingencies. J Comp Physiol Psychol 67: 504-509, 1969.
50. Rescorla RA, Wagner AR. A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In: Classical Conditioning II: Current Research and Theory, edited by Black AH, Prokasy WF. New York: Appleton-Century-Crofts, 1972, p. 64-99.
51. Richardson MP, Strange BA, Dolan RJ. Encoding of emotional memory depends on amygdala and hippocampus and their interactions. Nat Neurosci 7: 278-285, 2004.
52. Saddoris MP, Gallagher M, Schoenbaum G. Rapid associative encoding in basolateral amygdala depends on connections with orbitofrontal cortex. Neuron 46: 321-331, 2005.
53. Sanghera MK, Rolls ET, Roper-Hall A. Visual responses of neurons in the dorsolateral amygdala of the alert monkey. Exp Neurol 63: 610-626, 1979.
54. Schoenbaum G, Chiba AA, Gallagher M: Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning. J Neurosci 19: 1876-1884, 1999.
55. Schultz W, Apicella P, Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J Neurosci 13: 900-913, 1993.
56. Schultz W, Romo R. Role of primate basal ganglia and frontal cortex in the internal generation of movements. I. Preparatory activity in the anterior striatum. Exp Brain Res 91: 363-384, 1992.
57. Sesack SR, Deutch AY, Roth RH, Bunney BS. Topographical organization of the efferent projections of the medial prefrontal cortex in the rat: an anterograde tract-tracing study with Phaseolus vulgaris leucoagglutinin. J Comp Neurol 290: 213-242, 1989.
58. Setlow B, Holland PC, Gallagher M. Disconnection of the basolateral amygdala complex and nucleus accumbens impairs appetitive Pavlovian second-order conditioned responses. Behav Neurosci 116: 267-275, 2002.
59. Shima K, Tanji J. Role for cingulate motor area cells in voluntary movement selection based on reward. Science 282: 1335-1338, 1998.
60. Smith APR, Stephan KE, Rugg MD, Dolan RJ. Task and content modulate amygdala-hippocampal connectivity in emotional retrieval. Neuron 49: 631-638, 2006.
61. Sugase-Miyamoto Y, Richmond BJ. Neuronal signals in the monkey basolateral amygdala during reward schedules. J Neurosci 25: 11071-11083, 2005.
62. Suri R, Schultz W. A neural network with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience 91: 871-890, 1999.
63. Sutton RS, Barto AG. Reinforcement Learning. Cambridge, MA: MIT Press, 1998.
64. Tobler PN, Fiorillo CD, Schultz W. Adaptive coding of reward value by dopamine neurons. Science 307: 1642-1645, 2005.
65. Tye KM, Janak PH. Amygdala neurons differentially encode motivation and reinforcement. J Neurosci 27: 3937-3945, 2007.
66. Waelti P, Dickinson A, Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 412: 43-48, 2001.
67. White IM, Wise SP. Rule-dependent neuronal activity in the prefrontal cortex. Exp Brain Res 126: 315-335, 1999.