Interactions Between the Prefrontal Cortex and Amygdala During Delay Discounting and Reversal

Behavioral Neuroscience

Volumn 123, Issue 6, 2009, Pages 1185-1196

  Churchwell, John C ^a   Morris, Andrea M ^a   Heurtelou, Nila M ^a   Kesner, Raymond P ^a  

^a UNIVERSITY OF UTAH   (United States)

Author keywords

amygdala; decision; discounting; prefrontal; reversal

Indexed keywords

AMYGDALOID NUCLEUS; ANIMAL EXPERIMENT; ANIMAL TISSUE; ANTICIPATION; ARTICLE; BEHAVIOR CHANGE; BEHAVIORAL SCIENCE; BRAIN FUNCTION; COMPULSION; CONTROLLED STUDY; FLEXIBILITY; IMPULSIVENESS; LEARNING; MALE; NONHUMAN; PERSONALITY; PREFRONTAL CORTEX; RAT; REWARD; SELF CONTROL; TASK PERFORMANCE;

AMYGDALA; ANALYSIS OF VARIANCE; ANIMALS; BEHAVIOR, ANIMAL; CATHETERS, INDWELLING; CHOICE BEHAVIOR; DISCRIMINATION LEARNING; IMPULSIVE BEHAVIOR; MALE; MUSCIMOL; NEURAL PATHWAYS; NEURONS; PREFRONTAL CORTEX; RATS; RATS, LONG-EVANS; REWARD;

EID: 72249084178     PISSN: 07357044     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0017734     Document Type: Article

References (68)

1. Ainslie G. Breakdown of will (2001), Cambridge University Press, Cambridge, England
2. Allen T.A., Narayanan N.S., Kholodar-Smith D.B., Zhao Y., Laubach M., and Brown T.H. Imaging the spread of reversible brain inactivations using fluorescent muscimol. Journal of Neuroscience Methods 171 (2008) 30-38
3. Balleine B.W., and Dickinson A. Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology 37 (1998) 407-419
4. Balleine B.W., and Ostlund S.B. Still at the choice-point: Action selection and initiation in instrumental conditioning. Annals of the New York Academy of Sciences 1104 (2007) 147-171
5. Barratt E.S. The biological basis of impulsiveness: The significance of timing and rhythm disorders. Personality and Individual Differences 4 (1983) 387-391
6. Baxter M.G., Parker A., Lindner C.C., Izquierdo A.D., and Murray E.A. Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. Journal of Neuroscience 20 (2000) 4311-4319
7. Bechara A. Decision making, impulse control and loss of willpower to resist drugs: A neurocognitive perspective. Nature Neuroscience 8 (2005) 1458-1463
8. Belin D., Mar A.C., Dalley J.W., Robbins T.W., and Everitt B.J. High impulsivity predicts the switch to compulsive cocaine-taking. Science 320 (2008) 1352-1355
9. Berlin H.A., Rolls E.T., and Kischka U. Impulsivity, time perception, emotion and reinforcement sensitivity in patients with orbitofrontal cortex lesions. Brain 127 Pt. 5 (2004) 1108-1126
10. Cardinal R.N. Neural systems implicated in delayed and probabilistic reinforcement. Neural Networks 19 (2006) 1277-1301
11. Cardinal R.N., Pennicott D.R., Sugathapala C.L., Robbins T.W., and Everitt B.J. Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 292 (2001) 2499-2501
12. Cardinal R.N., Winstanley C.A., Robbins T.W., and Everitt B.J. Limbic corticostriatal systems and delayed reinforcement. Annals of the New York Academy of Sciences 1021 (2004) 33-50
13. Cavedini P., Gorini A., and Bellodi L. Understanding obsessive-compulsive disorder: Focus on decision making. Neuropsychology Review 16 (2006) 3-15
14. Chudasama Y., Passetti F., Rhodes S.E., Lopian D., Desai A., and Robbins T.W. Dissociable aspects of performance on the 5-choice serial reaction time task following lesions of the dorsal anterior cingulate, infralimbic and orbitofrontal cortex in the rat: Differential effects on selectivity, impulsivity and compulsivity. Behavioural Brain Research 146 (2003) 105-119
15. Clarke H.F., Robbins T.W., and Roberts A.C. Lesions of the medial striatum in monkeys produce perseverative impairments during reversal learning similar to those produced by lesions of the orbitofrontal cortex. Journal of Neuroscience 28 (2008) 10972-10982
16. Cohen M.X., Elger C.E., and Weber B. Amygdala tractography predicts functional connectivity and learning during feedback-guided decision-making. NeuroImage 39 (2008) 1396-1407
17. Dalley J.W., Cardinal R.N., and Robbins T.W. Prefrontal executive and cognitive functions in rodents: Neural and neurochemical substrates. Neuroscience and Biobehavioral Reviews 28 (2004) 771-784
18. de Wit H. Impulsivity as a determinant and consequence of drug use: A review of underlying processes. Addiction Biology 14 (2009) 22-31
19. Dickinson A., and Balleine B. Motivational control of goal-directed action. Animal Learning and Behavior 1 (1994) 1-18
20. Eagle D.M., and Robbins T.W. Lesions of the medial prefrontal cortex or nucleus accumbens core do not impair inhibitory control in rats performing a stop-signal reaction time task. Behavioral Brain Research 146 (2003) 131-144
21. Evenden J.L. Varieties of impulsivity. Psychopharmacology (Berl.) 146 (1999) 348-361
22. Everitt B.J., Belin D., Economidou D., Pelloux Y., Dalley J.W., and Robbins T.W. Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction [Review]. Philosophical Transactions of the Royal Society of London B Biological Science 363 (2008) 3125-3135
23. Everitt B.J., and Robbins T.W. Neural systems of reinforcement for drug addiction: From actions to habits to compulsion. Nature Neuroscience 8 (2005) 1481-1489
24. Floresco S.B., and Ghods-Sharifi S. Amygdala-prefrontal cortical circuitry regulates effort-based decision making. Cerebral Cortex 17 (2007) 251-260
25. Floresco S.B., St. Onge J.R., Ghods-Sharifi S., and Winstanley C.A. Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making. Cognitive, Affective and Behavioral Neuroscience 8 (2008) 375-389
26. Floresco S.B., Zhang Y., and Enomoto T. Neural circuits subserving behavioral flexibility and their relevance to schizophrenia. Behavioural Brain Research 204 (2008) 396-409
27. Ghods-Sharifi S., St. Onge J.R., and Floresco S.B. Fundamental contribution by the basolateral amygdala to different forms of decision making. Journal of Neuroscience 29 (2009) 5251-5259
28. Hahn T., Dresler T., Ehlis A.C., Plichta M.M., Heinzel S., Polak T., and Fallgatter A.J. Neural response to reward anticipation is modulated by Gray's impulsivity. NeuroImage 46 (2009) 1148-1153
29. Holland P.C., and Gallagher M. Amygdala-frontal interactions and reward expectancy. Current Opinion in Neurobiology 14 (2004) 148-155
30. Izquierdo A., and Murray E.A. Selective bilateral amygdala lesions in rhesus monkeys fail to disrupt object reversal learning. Journal of Neuroscience 27 (2007) 1054-1062
31. Jones B., and Mishkin M. Limbic lesions and the problem of stimulus-reinforcement associations. Experimental Neurology 36 (1972) 362-377
32. Kable J.W., and Glimcher P.W. The neural correlates of subjective value during intertemporal choice. Nature Neuroscience 10 (2007) 1625-1633
33. Kalenscher T., Windmann S., Diekamp B., Rose J., Gunturkun O., and Colombo M. Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task. Current Biology 15 (2005) 594-602
34. Kazama A., and Bachevalier J. Selective aspiration or neurotoxic lesions of orbital frontal areas 11 and 13 spared monkeys' performance on the object discrimination reversal task. Journal of Neuroscience 29 (2009) 2794-2804
35. Kheramin S., Body S., Mobini S., Ho M.Y., Velazquez-Martinez D.N., Bradshaw C.M., and Anderson I.M. Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: A quantitative analysis. Psychopharmacology (Berl.) 165 (2002) 9-17
36. Kim J., and Ragozzino M.E. The involvement of the orbitofrontal cortex in learning under changing task contingencies. Neurobiology of Learning and Memory 83 (2005) 125-133
37. Koch G., Oliveri M., Carlesimo G.A., and Caltagirone C. Selective deficit of time perception in a patient with right prefrontal cortex lesion. Neurology 59 (2002) 1658-1659
38. Mar A.C., and Robbins T.W. Delay discounting and impulsive choice in the rat. Current protocols in neuroscience (Unit 8.22) (2007), Wiley, New York doi: 10.1002/0471142301.ns0822s39
39. Mariano T.Y., Bannerman D.M., McHugh S.B., Preston T.J., Rudebeck P.H., Rudebeck S.R., and Campbell T.G. Impulsive choice in hippocampal but not orbitofrontal cortex-lesioned rats on a nonspatial decision-making maze task. European Journal of Neuroscience 30 (2009) 472-484
40. Matsumoto K., Suzuki W., and Tanaka K. Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science 301 (2003) 229-232
41. Meck W.H. Frontal cortex lesions eliminate the clock speed effect of dopaminergic drugs on interval timing. Brain Research 1108 (2006) 157-167
42. Mischel W., Ebbesen E.B., and Zeiss A.R. Cognitive and attentional mechanisms in delay of gratification. Journal of Personality and Social Psychology 21 (1972) 204-218
43. Mobini S., Body S., Ho M.Y., Bradshaw C.M., Szabadi E., Deakin J.F., and Anderson I.M. Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl.) 160 (2002) 290-298
44. Monterosso J., and Ainslie G. Beyond discounting: Possible experimental models of impulse control. Psychopharmacology (Berl.) 146 (1999) 339-347
45. Murray E.A., and Izquierdo A. Orbitofrontal cortex and amygdala contributions to affect and action in primates. Annals of the New York Academy of Sciences 1121 (2007) 273-296
46. Narayanan N.S., Horst N.K., and Laubach M. Reversible inactivations of rat medial prefrontal cortex impair the ability to wait for a stimulus. Neuroscience 139 (2006) 865-876
47. Paxinos G., and Watson C. The rat brain in stereotaxic coordinates. 5th ed. (2005), Elsevier/Academic Press, Amsterdam
48. Ragozzino M.E. The contribution of the medial prefrontal cortex, orbitofrontal cortex, and dorsomedial striatum to behavioral flexibility. Annals of the New York Academy of Sciences 1121 (2007) 355-375
49. Reynolds B., de Wit H., and Richards J. Delay of gratification and delay discounting in rats. Behavioral Processes 59 (2002) 157
50. Reynolds B., Penfold R.B., and Patak M. Dimensions of impulsive behavior in adolescents: Laboratory behavioral assessments. Experimental and Clinical Psychopharmacology 16 (2008) 124-131
51. Robinson E.S., Eagle D.M., Economidou D., Theobald D.E., Mar A.C., Murphy E.R., and Dalley J.W. Behavioural characterisation of high impulsivity on the 5-choice serial reaction time task: Specific deficits in "waiting" versus "stopping.". Behavioural Brain Research 196 (2009) 310-316
52. Roesch M.R., Calu D.J., Burke K.A., and Schoenbaum G. Should I stay or should I go? Transformation of time-discounted rewards in orbitofrontal cortex and associated brain circuits. Annals of the New York Academy of Sciences 1104 (2007) 21-34
53. Roesch M.R., Taylor A.R., and Schoenbaum G. Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51 (2006) 509-520
54. Rudebeck P.H., and Murray E.A. Amygdala and orbitofrontal cortex lesions differentially influence choices during object reversal learning. Journal of Neuroscience 28 (2008) 8338-8343
55. Rudebeck P.H., Walton M.E., Smyth A.N., Bannerman D.M., and Rushworth M.F. Separate neural pathways process different decision costs. Nature Neuroscience 9 (2006) 1161-1168
56. Saddoris M.P., Gallagher M., and Schoenbaum G. Rapid associative encoding in basolateral amygdala depends on connections with orbitofrontal cortex. Neuron 46 (2005) 321-331
57. Schoenbaum G., Roesch M.R., and Stalnaker T.A. Orbitofrontal cortex, decision-making and drug addiction. Trends in Neuroscience 29 (2006) 116-124
58. Schoenbaum G., Setlow B., Nugent S.L., Saddoris M.P., and Gallagher M. Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. Learning and Memory 10 (2003) 129-140
59. Schoenbaum G., Setlow B., Saddoris M.P., and Gallagher M. Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala. Neuron 39 (2003) 855-867
60. Schwartzbaum J.S., and Poulos D.A. Discrimination behavior after amygdalectomy in monkeys: Learning set and discrimination reversals. Journal of Comparative and Physiological Psychology 60 (1965) 320-328
61. Stalnaker T.A., Franz T.M., Singh T., and Schoenbaum G. Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments. Neuron 54 (2007) 51-58
62. Torregrossa M.M., Quinn J.J., and Taylor J.R. Impulsivity, compulsivity, and habit: The role of orbitofrontal cortex revisited. Biological Psychiatry 63 (2008) 253-255
63. Winstanley C.A., Dalley J.W., Theobald D.E., and Robbins T.W. Fractioning impulsivity: Contrasting effects of central 5-HT depletion on different measures of impulsive behavior. Neuropsychopharmacology 29 7 (2004) 1331-1343
64. Winstanley C.A., Eagle D.M., and Robbins T.W. Behavioral models of impulsivity in relation to ADHD: Translation between clinical and preclinical studies. Clinical Psychology Review 26 (2006) 379-395
65. Winstanley C.A., Theobald D.E., Cardinal R.N., and Robbins T.W. Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. Journal of Neuroscience 24 (2004) 4718-4722
66. Wittmann M., and Paulus M.P. Decision making, impulsivity and time perception. Trends in Cognitive Science 12 (2008) 7-12
67. Yin H.H., and Knowlton B.J. The role of the basal ganglia in habit formation. Nature Reviews Neuroscience 7 (2006) 464-476
68. Yin H.H., Ostlund S.B., and Balleine B.W. Reward-guided learning beyond dopamine in the nucleus accumbens: The integrative functions of cortico-basal ganglia networks. European Journal of Neuroscience 28 (2008) 1437-1448