Neural mechanisms regulating different forms of risk-related decision-making: Insights from animal models

Neuroscience and Biobehavioral Reviews

Volumn 58, Issue , 2015, Pages 147-167

  Orsini, Caitlin A ^a   Moorman, David E ^b   Young, Jared W ^c,d   Setlow, Barry ^a   Floresco, Stan B ^e  

^a UNIVERSITY OF FLORIDA COLLEGE OF MEDICINE   (United States)

^b UNIVERSITY OF MASSACHUSETTS   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d VA SAN DIEGO HEALTHCARE SYSTEM   (United States)

^e UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Decision making; Dopamine; Lateral habenula; Mania; Nucleus accumbens; Prefrontal cortex; Punishment; Uncertainty

Indexed keywords

DOPAMINE; DOPAMINE 2 RECEPTOR; DOPAMINE TRANSPORTER;

AMYGDALOID NUCLEUS; BASOLATERAL AMYGDALA; BRAIN FUNCTION; COGNITIVE BIAS; CONFUSION (UNCERTAINTY); CONNECTOME; DECISION MAKING; DOPAMINERGIC TRANSMISSION; HABENULA; HIGH RISK BEHAVIOR; LIMBIC CORTEX; MEDIAL PREFRONTAL CORTEX; MENTAL DISEASE; MENTAL TASK; MONOAMINERGIC SYSTEM; NEUROMODULATION; NEUROPHYSIOLOGY; NONHUMAN; NUCLEUS ACCUMBENS; PATHOLOGICAL GAMBLING; PRIORITY JOURNAL; PUNISHMENT; RAT MODEL; REVIEW; REWARD; STRIATE CORTEX; TRANSLATIONAL RESEARCH; VENTRAL STRIATUM; ANIMAL; BRAIN; HUMAN; PHYSIOLOGY;

ANIMALS; BRAIN; DECISION MAKING; HUMANS; RISK-TAKING; TRANSLATIONAL MEDICAL RESEARCH;

EID: 84947785455     PISSN: 01497634     EISSN: 18737528     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2015.04.009     Document Type: Review

References (260)

1. Ackerman J.P., McBee-Strayer S.M., Mendoza K., Stevens J., Sheftall A.H., Campo J.V., Bridge J.A. Risk-sensitive decision-making deficit in adolescent suicide attempters. J. Child Adolesc. Psychopharmacol. 2015, 25:109-113.
2. Adida M., Clark L., Pomietto P., Kaladjian A., Besnier N., Azorin J.M., Jeanningros R., Goodwin G.M. Lack of insight may predict impaired decision making in manic patients. Bipolar Disord. 2008, 10:829-837.
3. Adida M., Jollant F., Clark L., Besnier N., Guillaume S., Kaladjian A., Mazzola-Pomietto P., Jeanningros R., Goodwin G.M., Azorin J.M., Courtet P. Trait-related decision-making impairment in the three phases of bipolar disorder. Biol. Psychiatry 2011, 70:357-365.
4. Amitai N., Young J.W., Higa K., Sharp R.F., Geyer M.A., Powell S.B. Isolation rearing effects on probabilistic learning and cognitive flexibility in rats. Cogn. Affect. Behav. Neurosci. 2014, 14:388-406.
5. Anstrom K.K., Miczek K.A., Budygin E.A. Increased phasic dopamine signaling in the mesolimbic pathway during social defeat in rats. Neuroscience 2009, 161:3-12.
6. Aston-Jones G., Cohen J.D. An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Annu. Rev. Neurosci. 2005, 28:403-450.
7. Badrinarayan A., Wescott S.A., Vander Weele C.M., Saunders B.T., Couturier B.E., Maren S., Aragona B.J. Aversive stimuli differentially modulate real-time dopamine transmission dynamics within the nucleus accumbens core and shell. J. Neurosci. 2012, 32:15779-15790.
8. Balleine B.W., Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 1998, 37:407-419.
9. Balleine B.W., O'Doherty J.P. Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 2010, 35:48-69.
10. Bari A., Theobald D.E., Caprioli D., Mar A.C., Aidoo-Micah A., Dalley J.W., Robbins T.W. Serotonin modulates sensitivity to reward and negative feedback in a probabilistic reversal learning task in rats. Neuropsychopharmacology 2010, 35:1290-1301.
11. Bari A., Mar A.C., Theobald D.E., Elands S.A., Oganya K.C., Eagle D.M., Robbins T.W. Prefrontal and monoaminergic contributions to stop-signal task performance in rats. J. Neurosci. 2011, 31:9254-9263.
12. Bechara A., Damasio H., Damasio A.R. Emotion, decision making and the orbitofrontal cortex. Cereb. Cortex 2000, 10:295-307.
13. Bechara A., Damasio A.R., Damasio H., Anderson S.W. Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 1994, 50:7-15.
14. Bechara A., Damasio H., Damasio A.R., Lee G.P. Different contributions of the human amygdala and ventromedial prefrontal cortex to decision-making. J. Neurosci. 1999, 19:5473-5481.
15. Bechara A., Dolan S., Denburg N., Hindes A., Anderson S.W., Nathan P.E. Decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers. Neuropsychologia 2001, 39:376-389.
16. Bissonette G.B., Powell E.M., Roesch M.R. Neural structures underlying set-shifting: roles of medial prefrontal cortex and anterior cingulate cortex. Behav. Brain Res. 2013, 250:91-101.
17. Bornovalova M.A., Daughters S.B., Hernandez G.D., Richards J.B., Lejuez C.W. Differences in impulsivity and risk-taking propensity between primary users of crack cocaine and primary users of heroin in a residential substance-use program. Exp. Clin. Psychopharmacol. 2005, 13:311-318.
18. Bossert J.M., Stern A.L., Theberge F.R., Cifani C., Koya E., Hope B.T., Shaham Y. Ventral medial prefrontal cortex neuronal ensembles mediate context-induced relapse to heroin. Nat. Neurosci. 2011, 14:420-422.
19. Brambilla P., Perlini C., Bellani M., Tomelleri L., Ferro A., Cerruti S., Marinelli V., Rambaldelli G., Christodoulou T., Jogia J., Dima D., Tansella M., Balestrieri M., Frangou S. Increased salience of gains versus decreased associative learning differentiate bipolar disorder from schizophrenia during incentive decision making. Psychol. Med. 2013, 43:571-580.
20. Brischoux F., Chakraborty S., Brierley D.I., Ungless M.A. Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc. Natl. Acad. Sci. U. S. A. 2009, 106:4894-4899.
21. Broersen L.M., Uylings H.B. Visual attention task performance in Wistar and Lister hooded rats: response inhibition deficits after medial prefrontal cortex lesions. Neuroscience 1999, 94:47-57.
22. Bromberg-Martin E.S., Hikosaka O. Lateral habenula neurons signal errors in the prediction of reward information. Nat. Neurosci. 2011, 14:1209-1216.
23. Bromberg-Martin E.S., Matsumoto M., Hikosaka O. Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 2010, 68:815-834.
24. Burdick K.E., Braga R.J., Gopin C.B., Malhotra A.K. Dopaminergic influences on emotional decision making in euthymic bipolar patients. Neuropsychopharmacology 2014, 39:274-282.
25. Burgos-Robles A., Bravo-Rivera H., Quirk G.J. Prelimbic and infralimbic neurons signal distinct aspects of appetitive instrumental behavior. PLOS ONE 2013, 8:e57575.
26. Bussey T.J., Holmes A., Lyon L., Mar A.C., McAllister K.A., Nithianantharajah J., Oomen C.A., Saksida L.M. New translational assays for preclinical modelling of cognition in schizophrenia: the touchscreen testing method for mice and rats. Neuropharmacology 2012, 62:1191-1203.
27. Cardinal R.N. Neural systems implicated in delayed and probabilistic reinforcement. Neural Netw. 2006, 19:1277-1301.
28. Cardinal R.N., Howes N.J. Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats. BMC Neurosci. 2005, 6:37.
29. Cardinal R.N., Pennicott D.R., Sugathapala C.L., Robbins T.W., Everitt B.J. Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 2001, 292:2499-2501.
30. Cassaday H.J., Nelson A.J., Pezze M.A. From attention to memory along the dorsal-ventral axis of the medial prefrontal cortex: some methodological considerations. Front. Syst. Neurosci. 2014, 8:160.
31. Cassotti M., Houde O., Moutier S. Developmental changes of win-stay and loss-shift strategies in decision making. Child Neuropsychol. 2011, 17:400-411.
32. Cavedini P., Riboldi G., Keller R., D'Annucci A., Bellodi L. Frontal lobe dysfunction in pathological gambling patients. Biol. Psychiatry 2002, 51:334-341.
33. Chen B.T., Yau H.J., Hatch C., Kusumoto-Yoshida I., Cho S.L., Hopf F.W., Bonci A. Rescuing cocaine-induced prefrontal cortex hypoactivity prevents compulsive cocaine seeking. Nature 2013, 496:359-362.
34. Christoph G.R., Leonzio R.J., Wilcox K.S. Stimulation of the lateral habenula inhibits dopamine-containing neurons in the substantia nigra and ventral tegmental area of the rat. J. Neurosci. 1986, 6:613-619.
35. Chudasama Y. Animal models of prefrontal-executive function. Behav. Neurosci. 2011, 125:327-343.
36. Chudasama Y., Passetti F., Rhodes S.E., Lopian D., Desai A., Robbins T.W. Dissociable aspects of performance on the 5-choice serial reaction time task following lesions of the dorsal anterior cingulate, infralimbic and orbitofrontal cortex in the rat: differential effects on selectivity, impulsivity and compulsivity. Behav. Brain Res. 2003, 146:105-119.
37. Clark L., Iversen S.D., Goodwin G.M. A neuropsychological investigation of prefrontal cortex involvement in acute mania. Am. J. Psychiatry 2001, 158:1605-1611.
38. Clark L., Dombrovski A.Y., Siegle G.J., Butters M.A., Shollenberger C.L., Sahakian B.J., Szanto K. Impairment in risk-sensitive decision-making in older suicide attempters with depression. Psychol. Aging 2011, 26:321-330.
39. Cohen M.R., Newsome W.T. What electrical microstimulation has revealed about the neural basis of cognition. Curr. Opin. Neurobiol. 2004, 14:169-177.
40. Cooper S.E., Goings S.P., Kim J.Y., Wood R.I. Testosterone enhances risk tolerance without altering motor impulsivity in male rats. Psychoneuroendocrinology 2014, 40:201-212.
41. Crowley T.J., Dalwani M.S., Mikulich-Gilbertson S.K., Du Y.P., Lejuez C.W., Raymond K.M., Banich M.T. Risky decisions and their consequences: neural processing by boys with Antisocial Substance Disorder. PLoS ONE 2010, 5:e12835.
42. Cuthbert B.N., Insel T.R. Toward new approaches to psychotic disorders: the NIMH Research Domain Criteria project. Schizophr. Bull. 2010, 36:1061-1062.
43. Dagher A., Robbins T.W. Personality, addiction, dopamine: insights from Parkinson's disease. Neuron 2009, 61:502-510.
44. Dale C.L., Findlay A.M., Adcock R.A., Vertinski M., Fisher M., Genevsky A., Aldebot S., Subramaniam K., Luks T.L., Simpson G.V., Nagarajan S.S., Vinogradov S. Timing is everything: neural response dynamics during syllable processing and its relation to higher-order cognition in schizophrenia and healthy comparison subjects. Int. J. Psychophysiol. 2010, 75:183-193.
45. Dalley J.W., Cardinal R.N., Robbins T.W. Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates. Neurosci. Biobehav. Rev. 2004, 28:771-784.
46. Dalton G.L., Phillips A.G., Floresco S.B. Preferential involvement by nucleus accumbens shell in mediating probabilistic learning and reversal shifts. J. Neurosci. 2014, 34:4618-4626.
47. Danna C.L., Shepard P.D., Elmer G.I. The habenula governs the attribution of incentive salience to reward predictive cues. Front. Hum. Neurosci. 2013, 7:781.
48. Danner U.N., Ouwehand C., van Haastert N.L., Hornsveld H., de Ridder D.T. Decision-making impairments in women with binge eating disorder in comparison with obese and normal weight women. Eur. Eat. Disord. Rev. 2012, 20:e56-e62.
49. Day J.J., Jones J.L., Wightman R.M., Carelli R.M. Phasic nucleus accumbens dopamine release encodes effort- and delay-related costs. Biol. Psychiatry 2010, 68:306-309.
50. De Bruin J.P., Feenstra M.G., Broersen L.M., Van Leeuwen M., Arens C., De Vries S., Joosten R.N. Role of the prefrontal cortex of the rat in learning and decision making: effects of transient inactivation. Prog. Brain Res. 2000, 126:103-113.
51. DeVito E.E., Blackwell A.D., Kent L., Ersche K.D., Clark L., Salmond C.H., Dezsery A.M., Sahakian B.J. The effects of methylphenidate on decision making in attention-deficit/hyperactivity disorder. Biol. Psychiatry 2008, 64:636-639.
52. Ding L., Gold J.I. The basal ganglia's contributions to perceptual decision making. Neuron 2013, 79:640-649.
53. Durstewitz D., Seamans J.K. The dual-state theory of prefrontal cortex dopamine function with relevance to catechol-o-methyltransferase genotypes and schizophrenia. Biol. Psychiatry 2008, 64:739-749.
54. Durstewitz D., Seamans J.K., Sejnowski T.J. Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. J. Neurophysiol. 2000, 83:1733-1750.
55. Edge M.D., Miller C.J., Muhtadie L., Johnson S.L., Carver C.S., Marquinez N., Gotlib I.H. People with bipolar I disorder report avoiding rewarding activities and dampening positive emotion. J. Affect. Disord. 2013, 146:407-413.
56. Ernst M., Kimes A.S., London E.D., Matochik J.A., Eldreth D., Tata S., Contoreggi C., Leff M., Bolla K. Neural substrates of decision making in adults with attention deficit hyperactivity disorder. Am. J. Psychiatry 2003, 160:1061-1070.
57. Ersche K.D., Roiser J.P., Robbins T.W., Sahakian B.J. Chronic cocaine but not chronic amphetamine use is associated with perseverative responding in humans. Psychopharmacology (Berl.) 2008, 197:421-431.
58. Euston D.R., Gruber A.J., McNaughton B.L. The role of medial prefrontal cortex in memory and decision making. Neuron 2012, 76:1057-1070.
59. Evenden J.L., Ryan C.N. The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology (Berl.) 1996, 128:161-170.
60. Everitt B.J., Morris K.A., O'Brien A., Robbins T.W. The basolateral amygdala-ventral striatal system and conditioned place preference: further evidence of limbic-striatal interactions underlying reward-related processes. Neuroscience 1991, 42:1-18.
61. Felsen G., Mainen Z.F. Midbrain contributions to sensorimotor decision making. J. Neurophysiol. 2012, 108:135-147.
62. Fishbein D.H., Eldreth D.L., Hyde C., Matochik J.A., London E.D., Contoreggi C., Kurian V., Kimes A.S., Breeden A., Grant S. Risky decision making and the anterior cingulate cortex in abstinent drug abusers and nonusers. Brain Res. Cogn. Brain Res. 2005, 23:119-136.
63. Flagel S.B., Cameron C.M., Pickup K.N., Watson S.J., Akil H., Robinson T.E. A food predictive cue must be attributed with incentive salience for it to induce c-fos mRNA expression in cortico-striatal-thalamic brain regions. Neuroscience 2011, 196:80-96.
64. Floresco S.B. Dopaminergic regulation of limbic-striatal interplay. J. Psychiatry Neurosci. 2007, 32:400-411.
65. Floresco S.B., Ghods-Sharifi S. Amygdala-prefrontal cortical circuitry regulates effort-based decision making. Cereb. Cortex 2007, 17:251-260.
66. Floresco S.B., Blaha C.D., Yang C.R., Phillips A.G. Dopamine D1 and NMDA receptors mediate potentiation of basolateral amygdala-evoked firing of nucleus accumbens neurons. J. Neurosci. 2001, 21:6370-6376.
67. Floresco S.B., Onge J.R.S., Ghods-Sharifi S., Winstanley C.A. Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making. Cogn. Affect. Behav. Neurosci. 2008, 8:375-389.
68. Floresco S.B., Tse M.T., Ghods-Sharifi S. Dopaminergic and glutamatergic regulation of effort- and delay-based decision making. Neuropsychopharmacology 2008, 33:1966-1979.
69. Fond G., Bayard S., Capdevielle D., Del-Monte J., Mimoun N., Macgregor A., Boulenger J.P., Gely-Nargeot M.C., Raffard S. A further evaluation of decision-making under risk and under ambiguity in schizophrenia. Eur. Arch. Psychiatry Clin. Neurosci. 2013, 263:249-257.
70. Fowler S.C., Pinkston J., Vorontsova E. Timing and space usage are disrupted by amphetamine in rats maintained on DRL 24-s and DRL 72-s schedules of reinforcement. Psychopharmacology (Berl.) 2009, 204:213-225.
71. Frank M.J., Surmeier D.J. Do substantia nigra dopaminergic neurons differentiate between reward and punishment?. J. Mol. Cell Biol. 2009, 1:15-16.
72. Friedman A.S. Substance use/abuse as a predictor to illegal and violent behavior: a review of the relevant literature. Aggress. Violent Behav. 1998, 3:339-355.
73. Gass J.T., Chandler L.J. The plasticity of extinction: contribution of the prefrontal cortex in treating addiction through inhibitory learning. Front. Psychiatry 2013, 4:46.
74. Gee S., Ellwood I., Patel T., Luongo F., Deisseroth K., Sohal V.S. Synaptic activity unmasks dopamine D2 receptor modulation of a specific class of layer V pyramidal neurons in prefrontal cortex. J. Neurosci. 2012, 32:4959-4971.
75. Ghods-Sharifi S., Floresco S.B. Differential effects on effort discounting induced by inactivations of the nucleus accumbens core or shell. Behav. Neurosci. 2010, 124:179-191.
76. Ghods-Sharifi S., St Onge J.R., Floresco S.B. Fundamental contribution by the basolateral amygdala to different forms of decision making. J. Neurosci. 2009, 29:5251-5259.
77. Giorgetta C., Grecucci A., Rattin A., Guerreschi C., Sanfey A.G., Bonini N. To play or not to play: a personal dilemma in pathological gambling. Psychiatry Res. 2014, 219:562-569.
78. Gold J.I., Shadlen M.N. The neural basis of decision making. Annu. Rev. Neurosci. 2007, 30:535-574.
79. Gold J.M., Waltz J.A., Prentice K.J., Morris S.E., Heerey E.A. Reward processing in schizophrenia: a deficit in the representation of value. Schizophr. Bull. 2008, 34:835-847.
80. Gonzalez R., Bechara A., Martin E.M. Executive functions among individuals with methamphetamine or alcohol as drugs of choice: preliminary observations. J. Clin. Exp. Neuropsychol. 2007, 29:155-159.
81. Gowin J.L., Mackey S., Paulus M.P. Altered risk-related processing in substance users: imbalance of pain and gain. Drug Alcohol Depend. 2013, 132:13-21.
82. Grace A.A. Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia. Neuroscience 1991, 41:1-24.
83. Grace A.A., Floresco S.B., Goto Y., Lodge D.J. Regulation of firing of dopaminergic neurons and control of goal-directed behaviors. Trends Neurosci. 2007, 30:220-227.
84. Hayden B., Pasternak T. Linking neural activity to complex decisions. Vis. Neurosci. 2013, 30:331-342.
85. Hearing M.C., Miller S.W., See R.E., McGinty J.F. Relapse to cocaine seeking increases activity-regulated gene expression differentially in the prefrontal cortex of abstinent rats. Psychopharmacology (Berl.) 2008, 198:77-91.
86. Heidbreder C.A., Groenewegen H.J. The medial prefrontal cortex in the rat: evidence for a dorso-ventral distinction based upon functional and anatomical characteristics. Neurosci. Biobehav. Rev. 2003, 27:555-579.
87. Hong S., Jhou T.C., Smith M., Saleem K.S., Hikosaka O. Negative reward signals from the lateral habenula to dopamine neurons are mediated by rostromedial tegmental nucleus in primates. J. Neurosci. 2011, 31:11457-11471.
88. Ineichen C., Sigrist H., Spinelli S., Lesch K.P., Sautter E., Seifritz E., Pryce C.R. Establishing a probabilistic reversal learning test in mice: evidence for the processes mediating reward-stay and punishment-shift behaviour and for their modulation by serotonin. Neuropharmacology 2012, 63:1012-1021.
89. Insel T., Cuthbert B., Garvey M., Heinssen R., Pine D.S., Quinn K., Sanislow C., Wang P. Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am. J. Psychiatry 2010, 167:748-751.
90. Ishikawa A., Ambroggi F., Nicola S.M., Fields H.L. Dorsomedial prefrontal cortex contribution to behavioral and nucleus accumbens neuronal responses to incentive cues. J. Neurosci. 2008, 28:5088-5098.
91. Ishikawa A., Ambroggi F., Nicola S.M., Fields H.L. Contributions of the amygdala and medial prefrontal cortex to incentive cue responding. Neuroscience 2008, 155:573-584.
92. Janak P.H., Tye K.M. From circuits to behaviour in the amygdala. Nature 2015, 517:284-292.
93. Jentsch J.D., Woods J.A., Groman S.M., Seu E. Behavioral characteristics and neural mechanisms mediating performance in a rodent version of the Balloon Analog Risk Task. Neuropsychopharmacology 2010, 35:1797-1806.
94. Jhou T.C., Fields H.L., Baxter M.G., Saper C.B., Holland P.C. The rostromedial tegmental nucleus (RMTg), a GABAergic afferent to midbrain dopamine neurons, encodes aversive stimuli and inhibits motor responses. Neuron 2009, 61:786-800.
95. Ji H., Shepard P.D. Lateral habenula stimulation inhibits rat midbrain dopamine neurons through a GABA(A) receptor-mediated mechanism. J. Neurosci. 2007, 27:6923-6930.
96. Jonkman S., Mar A.C., Dickinson A., Robbins T.W., Everitt B.J. The rat prelimbic cortex mediates inhibitory response control but not the consolidation of instrumental learning. Behav. Neurosci. 2009, 123:875-885.
97. Joseph J.E., Liu X., Jiang Y., Lynam D., Kelly T.H. Neural correlates of emotional reactivity in sensation seeking. Psychol. Sci. 2009, 20:215-223.
98. Kantak K.M., Black Y., Valencia E., Green-Jordan K., Eichenbaum H.B. Dissociable effects of lidocaine inactivation of the rostral and caudal basolateral amygdala on the maintenance and reinstatement of cocaine-seeking behavior in rats. J. Neurosci. 2002, 22:1126-1136.
99. Kaye W.H., Wierenga C.E., Bailer U.F., Simmons A.N., Bischoff-Grethe A. Nothing tastes as good as skinny feels: the neurobiology of anorexia nervosa. Trends Neurosci. 2013, 36:110-120.
100. Kepecs A., Uchida N., Zariwala H.A., Mainen Z.F. Neural correlates, computation and behavioural impact of decision confidence. Nature 2008, 455:227-231.
101. Kesner R.P., Churchwell J.C. An analysis of rat prefrontal cortex in mediating executive function. Neurobiol. Learn. Mem. 2011, 96:417-431.
102. Kheramin D., Body S., Mobini S., Ho M.Y., Velazquez-Martinez D.N., Bradshaw C.M., Szabadi E., Deakin J.F., Anderson I.M. Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: a quantitative analysis. Psychopharmacology (Berl.) 2002, 165:9-17.
103. Killcross A.S., Everitt B.J., Robbins T.W. Symmetrical effects of amphetamine and alpha-flupenthixol on conditioned punishment and conditioned reinforcement: contrasts with midazolam. Psychopharmacology (Berl.) 1997, 129:141-152.
104. Killcross S., Coutureau E. Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb. Cortex 2003, 13:400-408.
105. Kim Y.T., Lee K.U., Lee S.J. Deficit in decision-making in chronic, stable schizophrenia: from a reward and punishment perspective. Psychiatry Investig. 2009, 6:26-33.
106. Klein R.G., Mannuzza S., Olazagasti M.A., Roizen E., Hutchison J.A., Lashua E.C., Castellanos F.X. Clinical and functional outcome of childhood attention-deficit/hyperactivity disorder 33 years later. Arch. Gen. Psychiatry 2012, 69:1295-1303.
107. Koya E., Uejima J.L., Wihbey K.A., Bossert J.M., Hope B.T., Shaham Y. Role of ventral medial prefrontal cortex in incubation of cocaine craving. Neuropharmacology 2009, 56(Suppl. 1):177-185.
108. Kraplin A., Dshemuchadse M., Behrendt S., Scherbaum S., Goschke T., Buhringer G. Dysfunctional decision-making in pathological gambling: pattern specificity and the role of impulsivity. Psychiatry Res. 2014, 215:675-682.
109. Kravitz A.V., Tye L.D., Kreitzer A.C. Distinct roles for direct and indirect pathway striatal neurons in reinforcement. Nat. Neurosci. 2012, 15:816-818.
110. Kroyzer N., Gross-Tsur V., Pollak Y. Risk taking in adolescents with attention deficit hyperactivity disorder on a probabilistic choice task. J. Nerv. Ment. Dis. 2014, 202:247-252.
111. Kruschwitz J.D., Simmons A.N., Flagan T., Paulus M.P. Nothing to lose: processing blindness to potential losses drives thrill and adventure seekers. Neuroimage 2012, 59:2850-2859.
112. Kvitsiani D., Ranade S., Hangya B., Taniguchi H., Huang J.Z., Kepecs A. Distinct behavioural and network correlates of two interneuron types in prefrontal cortex. Nature 2013, 498:363-366.
113. LaLumiere R.T., Niehoff K.E., Kalivas P.W. The infralimbic cortex regulates the consolidation of extinction after cocaine self-administration. Learn. Mem. 2010, 17:168-175.
114. Lammel S., Lim B.K., Malenka R.C. Reward and aversion in a heterogeneous midbrain dopamine system. Neuropharmacology 2014, 76(Pt B):351-359.
115. Lammel S., Lim B.K., Ran C., Huang K.W., Betley M.J., Tye K.M., Deisseroth K., Malenka R.C. Input-specific control of reward and aversion in the ventral tegmental area. Nature 2012, 491:212-217.
116. Larimer M.E., Neighbors C., Lostutter T.W., Whiteside U., Cronce J.M., Kaysen D., Walker D.D. Brief motivational feedback and cognitive behavioral interventions for prevention of disordered gambling: a randomized clinical trial. Addiction 2012, 107:1148-1158.
117. Lasseter H.C., Xie X., Ramirez D.R., Fuchs R.A. Prefrontal cortical regulation of drug seeking in animal models of drug relapse. Curr. Top. Behav. Neurosci. 2010, 3:101-117.
118. Le Berre A.P., Rauchs G., La Joie R., Mezenge F., Boudehent C., Vabret F., Segobin S., Viader F., Allain P., Eustache F., Pitel A.L., Beaunieux H. Impaired decision-making and brain shrinkage in alcoholism. Eur. Psychiatry 2014, 29:125-133.
119. Lecourtier L., Defrancesco A., Moghaddam B. Differential tonic influence of lateral habenula on prefrontal cortex and nucleus accumbens dopamine release. Eur. J. Neurosci. 2008, 27:1755-1762.
120. Lee D., Rushworth M.F., Walton M.E., Watanabe M., Sakagami M. Functional specialization of the primate frontal cortex during decision making. J. Neurosci. 2007, 27:8170-8173.
121. Lee A.T., Vogt D., Rubenstein J.L., Sohal V.S. A class of GABAergic neurons in the prefrontal cortex sends long-range projections to the nucleus accumbens and elicits acute avoidance behavior. J. Neurosci. 2014, 34:11519-11525.
122. Lejuez C.W., Bornovalova M.A., Daughters S.B., Curtin J.J. Differences in impulsivity and sexual risk behavior among inner-city crack/cocaine users and heroin users. Drug Alcohol Depend. 2005, 77:169-175.
123. Leland D.S., Paulus M.P. Increased risk-taking decision-making but not altered response to punishment in stimulant-using young adults. Drug Alcohol Depend. 2005, 78:83-90.
124. Lenz J.D., Lobo M.K. Optogenetic insights into striatal function and behavior. Behav. Brain Res. 2013, 255:44-54.
125. Linnet J., Moller A., Peterson E., Gjedde A., Doudet D. Dopamine release in ventral striatum during Iowa Gambling Task performance is associated with increased excitement levels in pathological gambling. Addiction 2011, 106:383-390.
126. Linnet J., Moller A., Peterson E., Gjedde A., Doudet D. Inverse association between dopaminergic neurotransmission and Iowa Gambling Task performance in pathological gamblers and healthy controls. Scand. J. Psychol. 2011, 52:28-34.
127. Lobo D.S., Souza R.P., Tong R.P., Casey D.M., Hodgins D.C., Smith G.J., Williams R.J., Schopflocher D.P., Wood R.T., el-Guebaly N., Kennedy J.L. Association of functional variants in the dopamine D2-like receptors with risk for gambling behaviour in healthy Caucasian subjects. Biol. Psychol. 2010, 85:33-37.
128. Manes F., Sahakian B., Clark L., Rogers R., Antoun N., Aitken M., Robbins T. Decision-making processes following damage to the prefrontal cortex. Brain 2002, 125:624-639.
129. Maren S., Quirk G.J. Neuronal signalling of fear memory. Nat. Rev. Neurosci. 2004, 5:844-852.
130. Martin-Garcia E., Courtin J., Renault P., Fiancette J.F., Wurtz H., Simonnet A., Levet F., Herry C., Deroche-Gamonet V. Frequency of cocaine self-administration influences drug seeking in the rat: optogenetic evidence for a role of the prelimbic cortex. Neuropsychopharmacology 2014, 39:2317-2330.
131. Matsumoto M., Hikosaka O. Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 2007, 447:1111-1115.
132. Matsumoto M., Hikosaka O. Representation of negative motivational value in the primate lateral habenula. Nat. Neurosci. 2009, 12:77-84.
133. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459:837-841.
134. McClure S.M., Ericson K.M., Laibson D.I., Loewenstein G., Cohen J.D. Time discounting for primary rewards. J. Neurosci. 2007, 27:5796-5804.
135. McCutcheon J.E., Ebner S.R., Loriaux A.L., Roitman M.F. Encoding of aversion by dopamine and the nucleus accumbens. Front. Neurosci. 2012, 6:137.
136. McDowell J.E., Clementz B.A., Wixted J.T. Timing and amplitude of saccades during predictive saccadic tracking in schizophrenia. Psychophysiology 1996, 33:93-101.
137. McFarland K., Lapish C.C., Kalivas P.W. Prefrontal glutamate release into the core of the nucleus accumbens mediates cocaine-induced reinstatement of drug-seeking behavior. J. Neurosci. 2003, 23:3531-3537.
138. McFarland K., Davidge S.B., Lapish C.C., Kalivas P.W. Limbic and motor circuitry underlying footshock-induced reinstatement of cocaine-seeking behavior. J. Neurosci. 2004, 24:1551-1560.
139. McLaughlin R.J., Floresco S.B. The role of different subregions of the basolateral amygdala in cue-induced reinstatement and extinction of food-seeking behavior. Neuroscience 2007, 146:1484-1494.
140. McLaughlin J., See R.E. Selective inactivation of the dorsomedial prefrontal cortex and the basolateral amygdala attenuates conditioned-cued reinstatement of extinguished cocaine-seeking behavior in rats. Psychopharmacology (Berl.) 2003, 168:57-65.
141. Mihindou C., Guillem K., Navailles S., Vouillac C., Ahmed S.H. Discriminative inhibitory control of cocaine seeking involves the prelimbic prefrontal cortex. Biol. Psychiatry 2013, 73:271-279.
142. Mitchell M.R., Vokes C.M., Blankenship A.L., Simon N.W., Setlow B. Effects of acute administration of nicotine, amphetamine, diazepam, morphine, and ethanol on risky decision-making in rats. Psychopharmacology (Berl.) 2011, 218:703-712.
143. Mitchell M.R., Weiss V.G., Beas B.S., Morgan D., Bizon J.L., Setlow B. Adolescent risk taking, cocaine self-administration, and striatal dopamine signaling. Neuropsychopharmacology 2014, 39:955-962.
144. Mobini D., Body S., Ho M.Y., Bradshaw C.M., Szabadi E., Deakin J.F., Anderson I.M. Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl.) 2002, 160:290-298.
145. Moorman D.E., James M.H., McGlinchey E.M., Aston-Jones G. Differential roles of medial prefrontal subregions in the regulation of drug seeking. Brain Res. 2014, 10.1016/j.brainres.2014.12.024.
146. Morales M., Root D.H. Glutamate neurons within the midbrain dopamine regions. Neuroscience 2014, 282C:60-68.
147. Morgan M.A., LeDoux J.E. Differential contribution of dorsal and ventral medial prefrontal cortex to the acquisition and extinction of conditioned fear in rats. Behav. Neurosci. 1995, 109:681-688.
148. Morris G., Nevet A., Arkadir D., Vaadia E., Bergman H. Midbrain dopamine neurons encode decisions for future action. Nat. Neurosci. 2006, 9:1057-1063.
149. Morris S.E., Cuthbert B.N. Research Domain Criteria: cognitive systems, neural circuits, and dimensions of behavior. Dialogues Clin. Neurosci. 2012, 14:29-37.
150. Murphy E.R., Dalley J.W., Robbins T.W. Local glutamate receptor antagonism in the rat prefrontal cortex disrupts response inhibition in a visuospatial attentional task. Psychopharmacology (Berl.) 2005, 179:99-107.
151. Murphy E.R., Fernando A.B., Urcelay G.P., Robinson E.S., Mar A.C., Theobald D.E., Dalley J.W., Robbins T.W. Impulsive behaviour induced by both NMDA receptor antagonism and GABAA receptor activation in rat ventromedial prefrontal cortex. Psychopharmacology (Berl.) 2012, 219:401-410.
152. Must A., Horvath S., Nemeth V.L., Janka Z. The Iowa Gambling Task in depression - what have we learned about sub-optimal decision-making strategies?. Front. Psychol. 2013, 4:732.
153. Narayanan N.S., Laubach M. Top-down control of motor cortex ensembles by dorsomedial prefrontal cortex. Neuron 2006, 52:921-931.
154. Narayanan N.S., Laubach M. Delay activity in rodent frontal cortex during a simple reaction time task. J. Neurophysiol. 2009, 101:2859-2871.
155. Narayanan N.S., Horst N.K., Laubach M. Reversible inactivations of rat medial prefrontal cortex impair the ability to wait for a stimulus. Neuroscience 2006, 139:865-876.
156. Navas J.F., Torres A., Vilar R., Verdejo-Garcia A., Catena A., Perales J.C. Nonmonetary decision-making indices discriminate between different behavioral components of gambling. J. Gambl. Stud. 2014, 10.1007/s10899-014-9482-1.
157. Nejtek V.A., Kaiser K.A., Zhang B., Djokovic M. Iowa Gambling Task scores predict future drug use in bipolar disorder outpatients with stimulant dependence. Psychiatry Res. 2013, 210:871-879.
158. O'Neill M., Schultz W. Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 2010, 68:789-800.
159. Oleson E.B., Gentry R.N., Chioma V.C., Cheer J.F. Subsecond dopamine release in the nucleus accumbens predicts conditioned punishment and its successful avoidance. J. Neurosci. 2012, 32:14804-14808.
160. Orsini C.A., Trotta R.T., Bizon J.L., Setlow B. Dissociable roles for the basolateral amygdala and orbitofrontal cortex in decision-making under risk of punishment. J. Neurosci. 2015, 35:1368-1379.
161. Orsini C.A., Kim J.H., Knapska E., Maren S. Hippocampal and prefrontal projections to the basal amygdala mediate contextual regulation of fear after extinction. J. Neurosci. 2011, 31:17269-17277.
162. Ostrander S., Cazares V.A., Kim C., Cheung S., Gonzalez I., Izquierdo A. Orbitofrontal cortex and basolateral amygdala lesions result in suboptimal and dissociable reward choices on cue-guided effort in rats. Behav. Neurosci. 2011, 125:350-359.
163. Pais-Vieira M., Lima D., Galhardo V. Orbitofrontal cortex lesions disrupt risk assessment in a novel serial decision-making task for rats. Neuroscience 2007, 145:225-231.
164. Papageorgiou C., Karanasiou I.S., Kapsali F., Stachtea X., Kyprianou M., Tsianaka E.I., Karakatsanis N.A., Rabavilas A.D., Uzunoglu N.K., Papadimitriou G.N. Temporal processing dysfunction in schizophrenia as measured by time interval discrimination and tempo reproduction tasks. Prog. Neuropsychopharmacol. Biol. Psychiatry 2013, 40:173-179.
165. Paulus M.P. Decision-making dysfunctions in psychiatry - altered homeostatic processing?. Science 2007, 318:602-606.
166. Paulus M.P., Rogalsky C., Simmons A., Feinstein J.S., Stein M.B. Increased activation in the right insula during risk-taking decision making is related to harm avoidance and neuroticism. Neuroimage 2003, 19:1439-1448.
167. Pearson J.M., Watson K.K., Platt M.L. Decision making: the neuroethological turn. Neuron 2014, 82:950-965.
168. Peters J., De Vries T.J. d-Cycloserine administered directly to infralimbic medial prefrontal cortex enhances extinction memory in sucrose-seeking animals. Neuroscience 2013, 230:24-30.
169. Peters J., LaLumiere R.T., Kalivas P.W. Infralimbic prefrontal cortex is responsible for inhibiting cocaine seeking in extinguished rats. J. Neurosci. 2008, 28:6046-6053.
170. Peters J., Kalivas P.W., Quirk G.J. Extinction circuits for fear and addiction overlap in prefrontal cortex. Learn. Mem. 2009, 16:279-288.
171. Pi H.J., Hangya B., Kvitsiani D., Sanders J.I., Huang Z.J., Kepecs A. Cortical interneurons that specialize in disinhibitory control. Nature 2013, 503:521-524.
172. Preuschoff K., Bossaerts P., Quartz S.R. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 2006, 51:381-390.
173. Pulido J., Barrio G., Lardelli P., Bravo M.J., Regidor E., de la Fuente L. Association between cannabis and cocaine use, traffic injuries and use of protective devices. Eur. J. Public Health 2011, 21:753-755.
174. Quartz S.R. Reason, emotion and decision-making: risk and reward computation with feeling. Trends Cogn. Sci. 2009, 13:209-215.
175. Quednow B.B., Kuhn K.U., Hoppe C., Westheide J., Maier W., Daum I., Wagner M. Elevated impulsivity and impaired decision-making cognition in heavy users of MDMA ("Ecstasy"). Psychopharmacology (Berl.) 2007, 189:517-530.
176. Quirk G.J., Mueller D. Neural mechanisms of extinction learning and retrieval. Neuropsychopharmacology 2008, 33:56-72.
177. Ramos Olazagasti M.A., Klein R.G., Mannuzza S., Belsky E.R., Hutchison J.A., Lashua-Shriftman E.C., Castellanos F.X. Does childhood attention-deficit/hyperactivity disorder predict risk-taking and medical illnesses in adulthood?. J. Am. Acad. Child Adolesc. Psychiatry 2013, 52:153-162. e154.
178. Reddy L.F., Lee J., Davis M.C., Altshuler L., Glahn D.C., Miklowitz D.J., Green M.F. Impulsivity and risk taking in bipolar disorder and schizophrenia. Neuropsychopharmacology 2014, 39:456-463.
179. Rhodes S.E., Killcross A.S. Lesions of rat infralimbic cortex enhance renewal of extinguished appetitive Pavlovian responding. Eur. J. Neurosci. 2007, 25:2498-2503.
180. Riga D., Matos M.R., Glas A., Smit A.B., Spijker S., Van den Oever M.C. Optogenetic dissection of medial prefrontal cortex circuitry. Front. Syst. Neurosci. 2014, 8:230.
181. Risterucci C., Terramorsi D., Nieoullon A., Amalric M. Excitotoxic lesions of the prelimbic-infralimbic areas of the rodent prefrontal cortex disrupt motor preparatory processes. Eur. J. Neurosci. 2003, 17:1498-1508.
182. Rivalan M., Ahmed S.H., Dellu-Hagedorn F. Risk-prone individuals prefer the wrong options on a rat version of the Iowa Gambling Task. Biol. Psychiatry 2009, 66:743-749.
183. Rivalan M., Coutureau E., Fitoussi A., Dellu-Hagedorn F. Inter-individual decision-making differences in the effects of cingulate, orbitofrontal, and prelimbic cortex lesions in a rat gambling task. Front. Behav. Neurosci. 2011, 5:22.
184. Roesch M.R., Taylor A.R., Schoenbaum G. Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 2006, 51:509-520.
185. Rogers R.D., Owen A.M., Middleton H.C., Williams E.J., Pickard J.D., Sahakian B.J., Robbins T.W. Choosing between small, likely rewards and large, unlikely rewards activates inferior and orbital prefrontal cortex. J. Neurosci. 1999, 19:9029-9038.
186. Rogers R.D., Everitt B.J., Baldacchino A., Blackshaw A.J., Swainson R., Wynne K., Baker N.B., Hunter J., Carthy T., Booker E., London M., Deakin J.F., Sahakian B.J., Robbins T.W. Dissociable deficits in the decision-making cognition of chronic amphetamine abusers, opiate abusers, patients with focal damage to prefrontal cortex, and tryptophan-depleted normal volunteers: evidence for monoaminergic mechanisms. Neuropsychopharmacology 1999, 20:322-339.
187. Roitman M.F., Wheeler R.A., Tiesinga P.H., Roitman J.D., Carelli R.M. Hedonic and nucleus accumbens neural responses to a natural reward are regulated by aversive conditioning. Learn. Mem. 2010, 17:539-546.
188. Romo R. Conversion of sensory signals into perceptions, memories and decisions. Prog. Neurobiol. 2013, 103:1-2.
189. Rygula R., Clarke H.F., Cardinal R.N., Cockcroft G.J., Xia J., Dalley J.W., Robbins T.W., Roberts A.C. Role of central serotonin in anticipation of rewarding and punishing outcomes: effects of selective amygdala or orbitofrontal 5-HT depletion. Cereb. Cortex 2014, 10.1093/cercor/bhu102.
190. Salamone J.D. The involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behav. Brain Res. 1994, 61:117-133.
191. Salzman C.D., Britten K.H., Newsome W.T. Cortical microstimulation influences perceptual judgements of motion direction. Nature 1990, 346:174-177.
192. Sangha S., Chadick J.Z., Janak P.H. Safety encoding in the basal amygdala. J. Neurosci. 2013, 33:3744-3751.
193. Sangha S., Robinson P.D., Greba Q., Davies D.A., Howland J.G. Alterations in reward, fear and safety cue discrimination after inactivation of the rat prelimbic and infralimbic cortices. Neuropsychopharmacology 2014, 39:2405-2413.
194. Schneider S., et al. Risk taking and the adolescent reward system: a potential common link to substance abuse. Am. J. Psychiatry 2012, 169:39-46.
195. Schultz W. Subjective neuronal coding of reward: temporal value discounting and risk. Eur. J. Neurosci. 2010, 31:2124-2135.
196. Schultz W. Updating dopamine reward signals. Curr. Opin. Neurobiol. 2013, 23:229-238.
197. Schultz W., O'Neill M., Tobler P.N., Kobayashi S. Neuronal signals for reward risk in frontal cortex. Ann. N. Y. Acad. Sci. 2011, 1239:109-117.
198. Seamans J.K., Yang C.R. The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog. Neurobiol. 2004, 74:1-58.
199. Seong H.J., Carter A.G. D1 receptor modulation of action potential firing in a subpopulation of layer 5 pyramidal neurons in the prefrontal cortex. J. Neurosci. 2012, 32:10516-10521.
200. Setlow B., Roozendaal B., McGaugh J.L. Involvement of a basolateral amygdala complex-nucleus accumbens pathway in glucocorticoid-induced modulation of memory consolidation. Eur. J. Neurosci. 2000, 12:367-375.
201. Setlow B., Holland P.C., Gallagher M. Disconnection of the basolateral amygdala complex and nucleus accumbens impairs appetitive pavlovian second-order conditioned responses. Behav. Neurosci. 2002, 116:267-275.
202. Shadlen M.N., Newsome W.T. Motion perception: seeing and deciding. Proc. Natl. Acad. Sci. U. S. A. 1996, 93:628-633.
203. Shadlen M.N., Kiani R. Decision making as a window on cognition. Neuron 2013, 80:791-806.
204. Shafiei N., Gray M., Viau V., Floresco S.B. Acute stress induces selective alterations in cost/benefit decision-making. Neuropsychopharmacology 2012, 37:2194-2209.
205. Shimp K.G., Mitchell M.R., Beas B.S., Bizon J.L., Setlow B. Affective and cognitive mechanisms of risky decision making. Neurobiol. Learn. Mem. 2015, 117:60-70.
206. Simon N.W., Setlow B. Modeling risky decision making in rodents. Methods Mol. Biol. 2012, 829:165-175.
207. Simon N.W., Gilbert R.J., Mayse J.D., Bizon J.L., Setlow B. Balancing risk and reward: a rat model of risky decision making. Neuropsychopharmacology 2009, 34:2208-2217.
208. Simon N.W., Montgomery K.S., Beas B.S., Mitchell M.R., LaSarge C.L., Mendez I.A., Banuelos C., Vokes C.M., Taylor A.B., Haberman R.P., Bizon J.L., Setlow B. Dopaminergic modulation of risky decision-making. J. Neurosci. 2011, 31:17460-17470.
209. Smith K.S., Graybiel A.M. A dual operator view of habitual behavior reflecting cortical and striatal dynamics. Neuron 2013, 79:361-374.
210. Smith K.S., Virkud A., Deisseroth K., Graybiel A.M. Reversible online control of habitual behavior by optogenetic perturbation of medial prefrontal cortex. Proc. Natl. Acad. Sci. U. S. A. 2012, 109:18932-18937.
211. Sotres-Bayon F., Quirk G.J. Prefrontal control of fear: more than just extinction. Curr. Opin. Neurobiol. 2010, 20:231-235.
212. Sparta D.R., Hovelso N., Mason A.O., Kantak P.A., Ung R.L., Decot H.K., Stuber G.D. Activation of prefrontal cortical parvalbumin interneurons facilitates extinction of reward-seeking behavior. J. Neurosci. 2014, 34:3699-3705.
213. St Onge J.R., Floresco S.B. Dopaminergic modulation of risk-based decision making. Neuropsychopharmacology 2009, 34:681-697.
214. St Onge J.R., Floresco S.B. Prefrontal cortical contribution to risk-based decision making. Cereb. Cortex 2010, 20:1816-1828.
215. St Onge J.R., Chiu Y.C., Floresco S.B. Differential effects of dopaminergic manipulations on risky choice. Psychopharmacology (Berl.) 2010, 211:209-221.
216. St Onge J.R., Abhari H., Floresco S.B. Dissociable contributions by prefrontal D1 and D2 receptors to risk-based decision making. J. Neurosci. 2011, 31:8625-8633.
217. St Onge J.R., Ahn S., Phillips A.G., Floresco S.B. Dynamic fluctuations in dopamine efflux in the prefrontal cortex and nucleus accumbens during risk-based decision making. J. Neurosci. 2012, 32:16880-16891.
218. St Onge J.R., Stopper C.M., Zahm D.S., Floresco S.B. Separate prefrontal-subcortical circuits mediate different components of risk-based decision making. J. Neurosci. 2012, 32:2886-2899.
219. Stamatakis A.M., Jennings J.H., Ung R.L., Blair G.A., Weinberg R.J., Neve R.L., Boyce F., Mattis J., Ramakrishnan C., Deisseroth K., Stuber G.D. A unique population of ventral tegmental area neurons inhibits the lateral habenula to promote reward. Neuron 2013, 80:1039-1053.
220. Stamatakis A.M., Stuber G.D. Activation of lateral habenula inputs to the ventral midbrain promotes behavioral avoidance. Nat. Neurosci. 2012, 15:1105-1107.
221. Stefanik M.T., Moussawi K., Kupchik Y.M., Smith K.C., Miller R.L., Huff M.L., Deisseroth K., Kalivas P.W., LaLumiere R.T. Optogenetic inhibition of cocaine seeking in rats. Addict. Biol. 2013, 18:50-53.
222. Steingroever H., Wetzels R., Horstmann A., Neumann J., Wagenmakers E.J. Performance of healthy participants on the Iowa Gambling Task. Psychol. Assess. 2013, 25:180-193.
223. Stopper C.M., Floresco S.B. Contributions of the nucleus accumbens and its subregions to different aspects of risk-based decision making. Cogn. Affect. Behav. Neurosci. 2011, 11:97-112.
224. Stopper C.M., Khayambashi S., Floresco S.B. Receptor-specific modulation of risk-based decision making by nucleus accumbens dopamine. Neuropsychopharmacology 2013, 38:715-728.
225. Stopper C.M., Green E.B., Floresco S.B. Selective involvement by the medial orbitofrontal cortex in biasing risky, but not impulsive, choice. Cereb. Cortex 2014, 24:154-162.
226. Stopper C.M., Tse M.T., Montes D.R., Wiedman C.R., Floresco S.B. Overriding phasic dopamine signals redirects action selection during risk/reward decision making. Neuron 2014, 84:177-189.
227. Stopper C.M., Floresco S.B. What's better for me? Fundamental role for lateral habenula in promoting subjective decision biases. Nat. Neurosci. 2014, 17:33-35.
228. Stout J.C., Busemeyer J.R., Lin A., Grant S.J., Bonson K.R. Cognitive modeling analysis of decision-making processes in cocaine abusers. Psychon. Bull. Rev. 2004, 11:742-747.
229. Stuber G.D., Sparta D.R., Stamatakis A.M., van Leeuwen W.A., Hardjoprajitno J.E., Cho S., Tye K.M., Kempadoo K.A., Zhang F., Deisseroth K., Bonci A. Excitatory transmission from the amygdala to nucleus accumbens facilitates reward seeking. Nature 2011, 475:377-380.
230. Sugam J.A., Day J.J., Wightman R.M., Carelli R.M. Phasic nucleus accumbens dopamine encodes risk-based decision-making behavior. Biol. Psychiatry 2012, 71:199-205.
231. Swainson R., Rogers R.D., Sahakian B.J., Summers B.A., Polkey C.E., Robbins T.W. Probabilistic learning and reversal deficits in patients with Parkinson's disease or frontal or temporal lobe lesions: possible adverse effects of dopaminergic medication. Neuropsychologia 2000, 38:596-612.
232. Tobler P.N., O'Doherty J.P., Dolan R.J., Schultz W. Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J. Neurophysiol. 2007, 97:1621-1632.
233. Toplak M.E., Sorge G.B., Benoit A., West R.F., Stanovich K.E. Decision-making and cognitive abilities: a review of associations between Iowa Gambling Task performance, executive functions, and intelligence. Clin. Psychol. Rev. 2010, 30:562-581.
234. Tritsch N.X., Ding J.B., Sabatini B.L. Dopaminergic neurons inhibit striatal output through non-canonical release of GABA. Nature 2012, 490:262-266.
235. Tye K.M., Janak P.H. Amygdala neurons differentially encode motivation and reinforcement. J. Neurosci. 2007, 27:3937-3945.
236. Tye K.M., Cone J.J., Schairer W.W., Janak P.H. Amygdala neural encoding of the absence of reward during extinction. J. Neurosci. 2010, 30:116-125.
237. Tzschentke T.M. The medial prefrontal cortex as a part of the brain reward system. Amino Acids 2000, 19:211-219.
238. Turnbull O.H., Evans C.E., Kemish K., Park S., Bowman C.H. A novel set-shifting modification of the Iowa Gambling Task: flexible emotion-based learning in schizophrenia. Neuropsychology 2006, 20:290-298.
239. Uchida N., Kepecs A., Mainen Z.F. Seeing at a glance, smelling in a whiff: rapid forms of perceptual decision making. Nat. Rev. Neurosci. 2006, 7:485-491.
240. van Aerde K.I., Feldmeyer D. Morphological and physiological characterization of pyramidal neuron subtypes in rat medial prefrontal cortex. Cereb. Cortex 2015, 25:788-805.
241. van den Bos R., Jolles J., van der Knaap L., Baars A., de Visser L. Male and female Wistar rats differ in decision-making performance in a rodent version of the Iowa Gambling Task. Behav. Brain Res. 2012, 234:375-379.
242. Van den Oever M.C., Spijker S., Smit A.B., De Vries T.J. Prefrontal cortex plasticity mechanisms in drug seeking and relapse. Neurosci. Biobehav. Rev. 2010, 35:276-284.
243. Van den Oever M.C., Rotaru D.C., Heinsbroek J.A., Gouwenberg Y., Deisseroth K., Stuber G.D., Mansvelder H.D., Smit A.B. Ventromedial prefrontal cortex pyramidal cells have a temporal dynamic role in recall and extinction of cocaine-associated memory. J. Neurosci. 2013, 33:18225-18233.
244. van Enkhuizen J., Geyer M.A., Young J.W. Differential effects of dopamine transporter inhibitors in the rodent Iowa gambling task: relevance to mania. Psychopharmacology (Berl.) 2013, 225:661-674.
245. van Enkhuizen J., Henry B.L., Minassian A., Perry W., Milienne-Petiot M., Higa K.K., Geyer M.A., Young J.W. Reduced dopamine transporter functioning induces high-reward risk-preference consistent with bipolar disorder. Neuropsychopharmacology 2014, 39:3112-3122.
246. Vertes R.P. Differential projections of the infralimbic and prelimbic cortex in the rat. Synapse 2004, 51:32-58.
247. Wadenberg M.L., Hicks P.B. The conditioned avoidance response test re-evaluated: is it a sensitive test for the detection of potentially atypical antipsychotics?. Neurosci. Biobehav. Rev. 1999, 23:851-862.
248. Waltz J.A., Gold J.M. Probabilistic reversal learning impairments in schizophrenia: further evidence of orbitofrontal dysfunction. Schizophr. Res. 2007, 93:296-303.
249. Waltz J.A., Frank M.J., Robinson B.M., Gold J.M. Selective reinforcement learning deficits in schizophrenia support predictions from computational models of striatal-cortical dysfunction. Biol. Psychiatry 2007, 62:756-764.
250. Wasserman J.I., Barry R.J., Bradford L., Delva N.J., Beninger R.J. Probabilistic classification and gambling in patients with schizophrenia receiving medication: comparison of risperidone, olanzapine, clozapine and typical antipsychotics. Psychopharmacology (Berl.) 2012, 222:173-183.
251. Wenzel J.M., Rauscher N.A., Cheer J.F., Oleson E.B. A role for phasic dopamine release within the nucleus accumbens in encoding aversion: a review of the neurochemical literature. ACS Chem. Neurosci. 2015, 6:16-26.
252. West E.A., Saddoris M.P., Kerfoot E.C., Carelli R.M. Prelimbic and infralimbic cortical regions differentially encode cocaine-associated stimuli and cocaine-seeking before and following abstinence. Eur. J. Neurosci. 2014, 39:1891-1902.
253. Willcocks A.L., McNally G.P. The role of medial prefrontal cortex in extinction and reinstatement of alcohol-seeking in rats. Eur. J. Neurosci. 2013, 37:259-268.
254. Winstanley C.A., Theobald D.E., Cardinal R.N., Robbins T.W. Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. J. Neurosci. 2004, 24:4718-4722.
255. Wittmann M., Leland D.S., Paulus M.P. Time and decision making: differential contribution of the posterior insular cortex and the striatum during a delay discounting task. Exp. Brain Res. 2007, 179:643-653.
256. Worthy D.A., Hawthorne M.J., Otto A.R. Heterogeneity of strategy use in the Iowa gambling task: a comparison of win-stay/lose-shift and reinforcement learning models. Psychon. Bull. Rev. 2013, 20:364-371.
257. Young J.W., Jentsch J.D., Bussey T.J., Wallace T.L., Hutcheson D.M. Consideration of species differences in developing novel molecules as cognition enhancers. Neurosci. Biobehav. Rev. 2013, 37:2181-2193.
258. Zack M., Poulos C.X. Effects of the atypical stimulant modafinil on a brief gambling episode in pathological gamblers with high vs. low impulsivity. J. Psychopharmacol. 2009, 23:660-671.
259. Zeeb F.D., Winstanley C.A. Lesions of the basolateral amygdala and orbitofrontal cortex differentially affect acquisition and performance of a rodent gambling task. J. Neurosci. 2011, 31:2197-2204.
260. Zeeb F.D., Robbins T.W., Winstanley C.A. Serotonergic and dopaminergic modulation of gambling behavior as assessed using a novel rat gambling task. Neuropsychopharmacology 2009, 34:2329-2343.