Planning activity for internally generated reward goals in monkey amygdala neurons

Nature Neuroscience

Volumn 18, Issue 3, 2015, Pages 461-473

  Hernádi, István ^a,b   Grabenhorst, Fabian ^a   Schultz, Wolfram ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY OF PÉCS   (Hungary)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTATION; AMYGDALOID NUCLEUS; ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; BEHAVIORAL SCIENCE; HAPLORHINI; MALE; NERVE CELL; NONHUMAN; PRIORITY JOURNAL; REWARD; RHESUS MONKEY; TASK PERFORMANCE; AMYGDALA; ANIMAL; ASSOCIATION; CYTOLOGY; DECISION MAKING; MOTIVATION; PHYSIOLOGY; REACTION TIME; STATISTICAL MODEL;

AMYGDALA; ANIMALS; CHOICE BEHAVIOR; CUES; GOALS; LINEAR MODELS; MACACA MULATTA; MALE; NEURONS; REACTION TIME; REWARD;

EID: 84923669166     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.3925     Document Type: Article

References (57)

1. Benhabib, J. & Bisin, A. Modeling internal commitment mechanisms and self-control: A neuroeconomics approach to consumption-saving decisions. Games Econ. Behav. 52, 460-492 (2005).
2. Dickinson, A. & Balleine, B. Motivational control of goal-directed action. Anim. Learn. Behav. 22, 1-22 (1994).
3. Berkman, E.T. & Lieberman, M.D. The neuroscience of goal pursuit. in The Psychology of Goals (eds. Moskowitz, G. & Grant, H.) 98-126 (Guilford, New York, 2009).
4. Tanji, J. Sequential organization of multiple movements: involvement of cortical motor areas. Annu. Rev. Neurosci. 24, 631-651 (2001).
5. Andersen, R.A. & Cui, H. Intention, action planning, and decision making in parietalfrontal circuits. Neuron 63, 568-583 (2009).
6. Passingham, R.E. & Wise, S.P. The Neurobiology of the Prefrontal Cortex (Oxford Univ. Press, 2012).
7. Mushiake, H., Saito, N., Sakamoto, K., Itoyama, Y. & Tanji, J. Activity in the lateral prefrontal cortex reflects multiple steps of future events in action plans. Neuron 50, 631-641 (2006).
8. Saito, N., Mushiake, H., Sakamoto, K., Itoyama, Y. & Tanji, J. Representation of immediate and final behavioral goals in the monkey prefrontal cortex during an instructed delay period. Cereb. Cortex 15, 1535-1546 (2005).
9. Shima, K., Isoda, M., Mushiake, H. & Tanji, J. Categorization of behavioural sequences in the prefrontal cortex. Nature 445, 315-318 (2007).
10. Shima, K., Mushiake, H., Saito, N. & Tanji, J. Role for cells in the presupplementary motor area in updating motor plans. Proc. Natl. Acad. Sci. USA 93, 8694-8698 (1996).
11. Lee, I.H., Seitz, A.R. & Assad, J.A. Activity of tonically active neurons in the monkey putamen during initiation and withholding of movement. J. Neurophysiol. 95, 2391-2403 (2006).
12. Okano, K. & Tanji, J. Neuronal activities in the primate motor fields of the agranular frontal cortex preceding visually triggered and self-paced movement. Exp. Brain Res. 66, 155-166 (1987).
13. Romo, R. & Schultz, W. Neuronal activity preceding self-initiated or externally timed arm movements in area 6 of monkey cortex. Exp. Brain Res. 67, 656-662 (1987).
14. Kurata, K. & Wise, S.P. Premotor and supplementary motor cortex in rhesus monkeys: neuronal activity during externally- and internally-instructed motor tasks. Exp. Brain Res. 72, 237-248 (1988).
15. Rolls, E.T. Emotion and Decision-Making Explained (Oxford Univ. Press, 2014).
16. Baxter, M.G. & Murray, E.A. The amygdala and reward. Nat. Rev. Neurosci. 3, 563-573 (2002).
17. Cardinal, R.N., Parkinson, J.A., Hall, J. & Everitt, B.J. Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev. 26, 321-352 (2002).
18. Seymour, B. & Dolan, R. Emotion, decision making, and the amygdala. Neuron 58, 662-671 (2008).
19. Murray, E.A. & Rudebeck, P.H. The drive to strive: goal generation based on current needs. Front. Neurosci. 7, 112 (2013).
20. Schultz, W. Multiple reward signals in the brain. Nat. Rev. Neurosci. 1, 199-207 (2000).
21. Paton, J.J., Belova, M.A., Morrison, S.E. & Salzman, C.D. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439, 865-870 (2006).
22. Schoenbaum, G., Chiba, A.A. & Gallagher, M. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat. Neurosci. 1, 155-159 (1998).
23. Price, J.L. Comparative aspects of amygdala connectivity. Ann. NY Acad. Sci. 985, 50-58 (2003).
24. Belova, M.A., Paton, J.J., Morrison, S.E. & Salzman, C.D. Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala. Neuron 55, 970-984 (2007).
25. Bermudez, M.A., Gobel, C. & Schultz, W. Sensitivity to temporal reward structure in amygdala neurons. Curr. Biol. 22, 1839-1844 (2012).
26. A-mediated inhibition of basolateral amygdala blocks reward devaluation in macaques. J. Neurosci. 25, 4577-4586 (2005).
27. Rudebeck, P.H. & Murray, E.A. Amygdala and orbitofrontal cortex lesions differentially influence choices during object reversal learning. J. Neurosci. 28, 8338-8343 (2008).
28. Grabenhorst, F., Rolls, E.T., Parris, B.A. & D'Souza, A. How the brain represents the reward value of fat in the mouth. Cereb. Cortex 20, 1082-1091 (2010).
29. Grabenhorst, F., Schulte, F.P., Maderwald, S. & Brand, M. Food labels promote healthy choices by a decision bias in the amygdala. Neuroimage 74, 152-163 (2013).
30. De Martino, B., Kumaran, D., Seymour, B. & Dolan, R.J. Frames, biases, and rational decision-making in the human brain. Science 313, 684-687 (2006).
31. Bechara, A., Damasio, H., Damasio, A.R. & Lee, G.P. Different contributions of the human amygdala and ventromedial prefrontal cortex to decision-making. J. Neurosci. 19, 5473-5481 (1999).
32. Brand, M., Grabenhorst, F., Starcke, K., Vandekerckhove, M.M. & Markowitsch, H.J. Role of the amygdala in decisions under ambiguity and decisions under risk: evidence from patients with Urbach-Wiethe disease. Neuropsychologia 45, 1305-1317 (2007).
33. Sugase-Miyamoto, Y. & Richmond, B.J. Neuronal signals in the monkey basolateral amygdala during reward schedules. J. Neurosci. 25, 11071-11083 (2005).
34. Grabenhorst, F., Hernadi, I. & Schultz, W. Prediction of economic choice by primate amygdala neurons. Proc. Natl. Acad. Sci. USA 109, 18950-18955 (2012).
35. Padoa-Schioppa, C. Neurobiology of economic choice: a good-based model. Annu. Rev. Neurosci. 34, 333-359 (2011).
36. Lee, D., Seo, H. & Jung, M.W. Neural basis of reinforcement learning and decision making. Annu. Rev. Neurosci. 35, 287-308 (2012).
37. Kennerley, S.W., Behrens, T.E. & Wallis, J.D. Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat. Neurosci. 14, 1581-1589 (2011).
38. Hayden, B.Y., Pearson, J.M. & Platt, M.L. Neuronal basis of sequential foraging decisions in a patchy environment. Nat. Neurosci. 14, 933-939 (2011).
39. Sugrue, L.P., Corrado, G.S. & Newsome, W.T. Matching behavior and the representation of value in the parietal cortex. Science 304, 1782-1787 (2004).
40. Belova, M.A., Paton, J.J. & Salzman, C.D. Moment-to-moment tracking of state value in the amygdala. J. Neurosci. 28, 10023-10030 (2008).
41. Lak, A., Stauffer, W.R. & Schultz, W. Dopamine prediction error responses integrate subjective value from different reward dimensions. Proc. Natl. Acad. Sci. USA 111, 2343-2348 (2014).
42. Kable, J.W. & Glimcher, P.W. The neurobiology of decision: consensus and controversy. Neuron 63, 733-745 (2009).
43. Shima, K. & Tanji, J. Role for cingulate motor area cells in voluntary movement selection based on reward. Science 282, 1335-1338 (1998).
44. Daw, N.D., Gershman, S.J., Seymour, B., Dayan, P. & Dolan, R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 69, 1204-1215 (2011).
45. Gersch, T.M., Foley, N.C., Eisenberg, I. & Gottlieb, J. Neural correlates of temporal credit assignment in the parietal lobe. PLoS ONE 9, e88725 (2014).
46. Dragoi, G. & Tonegawa, S. Preplay of future place cell sequences by hippocampal cellular assemblies. Nature 469, 397-401 (2011).
47. Pfeiffer, B.E. & Foster, D.J. Hippocampal place-cell sequences depict future paths to remembered goals. Nature 497, 74-79 (2013).
48. Rudebeck, P.H., Mitz, A.R., Chacko, R.V. & Murray, E.A. Effects of amygdala lesions on reward-value coding in orbital and medial prefrontal cortex. Neuron 80, 1519-1531 (2013).
49. Pessoa, L. & Adolphs, R. Emotion processing and the amygdala: from a 'low road' to 'many roads' of evaluating biological significance. Nat. Rev. Neurosci. 11, 773-783 (2010).
50. Bechara, A. Decision making, impulse control and loss of willpower to resist drugs: a neurocognitive perspective. Nat. Neurosci. 8, 1458-1463 (2005).
51. Bermudez, M.A. & Schultz, W. Reward magnitude coding in primate amygdala neurons. J. Neurophysiol. 104, 3424-3432 (2010).
52. Aggleton, J.P. & Passingham, R.E. Stereotaxic surgery under X-ray guidance in the rhesus monkey, with special reference to the amygdala. Exp. Brain Res. 44, 271-276 (1981).
53. Watanabe, M. et al. Behavioral reactions reflecting differential reward expectations in monkeys. Exp. Brain Res. 140, 511-518 (2001).
54. O'Neill, M. & Schultz, W. Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 68, 789-800 (2010).
55. Draper, N.R. & Smith, H. Applied Regression Analysis (Wiley-Interscience, 1998).
56. Kutner, M.H., Nachtsheim, C.J., Neter, J. & Li, W. Applied Linear Statistical Models (McGraw-Hill Irwin, New York, 2004).
57. Smith, D.V. & Travers, J.B. A metric for the breadth of tuning of gustatory neurons. Chem. Senses 4, 215-219 (1979).