Affective and cognitive mechanisms of risky decision making

Neurobiology of Learning and Memory

Volumn 117, Issue , 2015, Pages 60-70

  Shimp, Kristy G ^a   Mitchell, Marci R ^b   Beas, B Sofia ^a   Bizon, Jennifer L ^a   Setlow, Barry ^a,c  

^a UNIVERSITY OF FLORIDA COLLEGE OF MEDICINE   (United States)

^b YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c Department of Psychiatry University of Florida College of Medicine ^*  (United States)

Author keywords

Choice; Decision making; Executive function; Impulsivity; Punishment; Rat; Reward; Risk taking; Set shifting; Working memory

Indexed keywords

AFFECT; ANIMAL EXPERIMENT; ANIMAL MODEL; ARTICLE; AVERSIVE BEHAVIOR; COGNITION; CONTROLLED STUDY; DECISION MAKING; DELAY DISCOUNTING; EXECUTIVE FUNCTION; HIGH RISK BEHAVIOR; IMPULSIVENESS; LONG EVANS RAT; MALE; NONHUMAN; PUNISHMENT; RAT; REWARD; RISKY DECISION MAKING; TASK PERFORMANCE; VISUAL DISCRIMINATION; WORKING MEMORY; ANIMAL; ELECTRIC SHOCK; INSTRUMENTAL CONDITIONING;

AFFECT; ANIMALS; COGNITION; CONDITIONING, OPERANT; DECISION MAKING; ELECTROSHOCK; EXECUTIVE FUNCTION; MALE; PUNISHMENT; RATS; RATS, LONG-EVANS; REWARD; RISK-TAKING;

EID: 84920950484     PISSN: 10747427     EISSN: 10959564     Source Type: Journal    
DOI: 10.1016/j.nlm.2014.03.002     Document Type: Article

References (55)

1. Beas B.S., Setlow B., Bizon J.L. Distinct manifestations of executive dysfunction in aged rats. Neurobiology of Aging 2013, 34(9):2164-2174. 10.1016/j.neurobiolaging.2013.03.019.
2. Bechara A., Dolan S., Denburg N., Hindes A., Anderson S.W., Nathan P.E. Decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers. Neuropsychologia 2001, 39(4):376-389.
3. Bickel W.K., Yi R., Landes R.D., Hill P.F., Baxter C. Remember the future: Working memory training decreases delay discounting among stimulant addicts. Biological Psychiatry 2011, 69(3):260-265. 10.1016/j.biopsych.2010.08.017.
4. Birrell J.M., Brown V.J. Medial frontal cortex mediates perceptual attentional set shifting in the rat. Journal of Neuroscience 2000, 20(11):4320-4324.
5. Brown V.J., Bowman E.M. Rodent models of prefrontal cortical function. Trends in Neurosciences 2002, 25(7):340-343.
6. Butler Gillian., Mathews Andrew. Anticipatory anxiety and risk perception. Cognitive Therapy and Research 1987, 11(5):551-565. 10.1007/bf01183858.
7. Cardinal R.N., Robbins T.W., Everitt B.J. The effects of d-amphetamine, chlordiazepoxide, alpha-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology (Berlin) 2000, 152(4):362-375.
8. Chamorro J., Bernardi S., Potenza M.N., Grant J.E., Marsh R., Wang S., et al. Impulsivity in the general population: A national study. Journal of Psychiatric Research 2012, 46(8):994-1001. 10.1016/j.jpsychires.2012.04.023.
9. Danner U.N., Sanders N., Smeets P.A., van Meer F., Adan R.A., Hoek H.W., et al. Neuropsychological weaknesses in anorexia nervosa: Set-shifting, central coherence, and decision making in currently ill and recovered women. International Journal of Eating Disorders 2012, 45(5):685-694. 10.1002/eat.22007.
10. DeVito E.E., Blackwell A.D., Kent L., Ersche K.D., Clark L., Salmond C.H., et al. The effects of methylphenidate on decision making in attention-deficit/hyperactivity disorder. Biological Psychiatry 2008, 64(7):636-639. 10.1016/j.biopsych.2008.04.017.
11. Dias R., Robbins T.W., Roberts A.C. Dissociation in prefrontal cortex of affective and attentional shifts. Nature 1996, 380(6569):69-72. 10.1038/380069a0.
12. Drechsler R., Rizzo P., Steinhausen H.C. Decision-making on an explicit risk-taking task in preadolescents with attention-deficit/hyperactivity disorder. Journal of Neural Transmission 2008, 115(2):201-209. 10.1007/s00702-007-0814-5.
13. Drechsler R., Rizzo P., Steinhausen H.C. Decision making with uncertain reinforcement in children with attention deficit/hyperactivity disorder (ADHD). Child Neuropsychology 2010, 16(2):145-161. 10.1080/09297040903190774.
14. Ernst M., Kimes A.S., London E.D., Matochik J.A., Eldreth D., Tata S., et al. Neural substrates of decision making in adults with attention deficit hyperactivity disorder. American Journal of Psychiatry 2003, 160(6):1061-1070.
15. Ersche K.D., Turton A.J., Pradhan S., Bullmore E.T., Robbins T.W. Drug addiction endophenotypes: Impulsive versus sensation-seeking personality traits. Biological Psychiatry 2010, 68(8):770-773. 10.1016/j.biopsych.2010.06.015.
16. Evenden J.L., Ryan C.N. The pharmacology of impulsive behaviour in rats: The effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology (Berlin) 1996, 128(2):161-170.
17. Floresco S.B., Block A.E., Tse M.T. Inactivation of the medial prefrontal cortex of the rat impairs strategy set-shifting, but not reversal learning, using a novel, automated procedure. [Research Support, Non-U.S. Gov't]. Behavioural Brain Research 2008, 190(1):85-96. 10.1016/j.bbr.2008.02.008.
18. Floresco S.B., Magyar O., Ghods-Sharifi S., Vexelman C., Tse M.T. Multiple dopamine receptor subtypes in the medial prefrontal cortex of the rat regulate set-shifting. Neuropsychopharmacology 2006, 31(2):297-309. 10.1038/sj.npp.1300825.
19. Ghods-Sharifi S., Haluk D.M., Floresco S.B. Differential effects of inactivation of the orbitofrontal cortex on strategy set-shifting and reversal learning. Neurobiology of Learning and Memory 2008, 89(4):567-573. 10.1016/j.nlm.2007.10.007.
20. Goldstein R.Z., Craig A.D., Bechara A., Garavan H., Childress A.R., Paulus M.P., et al. The neurocircuitry of impaired insight in drug addiction. Trends in Cognitive Science 2009, 13(9):372-380. 10.1016/j.tics.2009.06.004.
21. Groman S.M., Lee B., Seu E., James A.S., Feiler K., Mandelkern M.A., et al. Dysregulation of D(2)-mediated dopamine transmission in monkeys after chronic escalating methamphetamine exposure. Journal of Neuroscience 2012, 32(17):5843-5852. 10.1523/jneurosci.0029-12.2012.
22. Gunn R.L., Finn P.R. Impulsivity partially mediates the association between reduced working memory capacity and alcohol problems. Alcohol 2013, 47(1):3-8. 10.1016/j.alcohol.2012.10.003.
23. Hinson J.M., Jameson T.L., Whitney P. Impulsive decision making and working memory. Journal of Experimental Psychology. Learning, Memory, and Cognition 2003, 29(2):298-306.
24. Huckans M., Seelye A., Woodhouse J., Parcel T., Mull L., Schwartz D., et al. Discounting of delayed rewards and executive dysfunction in individuals infected with hepatitis C. Journal of Clinical and Experimental Neuropsychology 2011, 33(2):176-186. 10.1080/13803395.2010.499355.
25. Kagan D.M. Addictive personality factors. Journal of Psychology 1987, 121(6):533-538. 10.1080/00223980.1987.9712681.
26. Kaye W.H., Wierenga C.E., Bailer U.F., Simmons A.N., Bischoff-Grethe A. Nothing tastes as good as skinny feels: The neurobiology of anorexia nervosa. Trends in Neurosciences 2013, 36(2):110-120. 10.1016/j.tins.2013.01.003.
27. Lawrence A., Clark L., Labuzetta J.N., Sahakian B., Vyakarnum S. The innovative brain. Nature 2008, 456(7219):168-169. 10.1038/456168a.
28. Loos M., Pattij T., Janssen M.C., Counotte D.S., Schoffelmeer A.N., Smit A.B., et al. Dopamine receptor D1/D5 gene expression in the medial prefrontal cortex predicts impulsive choice in rats. Cerebral Cortex 2010, 20(5):1064-1070. 10.1093/cercor/bhp167.
29. McAlonan K., Brown V.J. Orbital prefrontal cortex mediates reversal learning and not attentional set shifting in the rat. Behavioural Brain Research 2003, 146(1-2):97-103.
30. Mendez I.A., Gilbert R.J., Bizon J.L., Setlow B. Effects of acute administration of nicotinic and muscarinic cholinergic agonists and antagonists on performance in different cost-benefit decision making tasks in rats. Psychopharmacology (Berlin) 2012, 224(4):489-499. 10.1007/s00213-012-2777-y.
31. Mitchell M.R., Mendez I.A., Vokes C.M., Damborsky J.C., Winzer-Serhan U.H., Setlow B. Effects of developmental nicotine exposure in rats on decision-making in adulthood. Behavioural Pharmacology 2012, 23(1):34-42. 10.1097/FBP.0b013e32834eb04a.
32. Mitchell M.R., Vokes C.M., Blankenship A.L., Simon N.W., Setlow B. Effects of acute administration of nicotine, amphetamine, diazepam, morphine, and ethanol on risky decision-making in rats. Psychopharmacology (Berlin) 2011, 218(4):703-712. 10.1007/s00213-011-2363-8.
33. Mitchell M.R., Weiss V.G., Beas B.S., Morgan D., Bizon J.L., Setlow B. Adolescent risk taking, cocaine self-administration, and striatal dopamine signaling. Neuropsychopharmacology 2014, 39(4):955-962. 10.1038/npp.2013.295.
34. Orsini, C. A., Trotta, R., Bizon, J. L., & Setlow, B. (2014). Adaptive risk-taking in the face of punishment requires the integrity of the basolateral amygdala (submitted for publication).
35. Ragozzino M.E., Ragozzino K.E., Mizumori S.J., Kesner R.P. Role of the dorsomedial striatum in behavioral flexibility for response and visual cue discrimination learning. Behavioral Neuroscience 2002, 116(1):105-115.
36. Reynolds E.K., Schreiber W.M., Geisel K., MacPherson L., Ernst M., Lejuez C.W. Influence of social stress on risk-taking behavior in adolescents. Journal of Anxiety Disorders 2013, 27(3):272-277. 10.1016/j.janxdis.2013.02.010.
37. Rogers R.D., Everitt B.J., Baldacchino A., Blackshaw A.J., Swainson R., Wynne K., et al. Dissociable deficits in the decision-making cognition of chronic amphetamine abusers, opiate abusers, patients with focal damage to prefrontal cortex, and tryptophan-depleted normal volunteers: Evidence for monoaminergic mechanisms. Neuropsychopharmacology 1999, 20(4):322-339. 10.1016/s0893-133x(98)00091-8.
38. Schoenbaum G., Saddoris M.P., Ramus S.J., Shaham Y., Setlow B. Cocaine-experienced rats exhibit learning deficits in a task sensitive to orbitofrontal cortex lesions. European Journal of Neuroscience 2004, 19(7):1997-2002. 10.1111/j.1460-9568.2004.03274.x.
39. Shamosh N.A., Deyoung C.G., Green A.E., Reis D.L., Johnson M.R., Conway A.R., et al. Individual differences in delay discounting: Relation to intelligence, working memory, and anterior prefrontal cortex. Psychological Science 2008, 19(9):904-911. 10.1111/j.1467-9280.2008.02175.x.
40. Shott M.E., Filoteo J.V., Bhatnagar K.A., Peak N.J., Hagman J.O., Rockwell R., et al. Cognitive set-shifting in anorexia nervosa. European Eating Disorders Review 2012, 20(5):343-349. 10.1002/erv.2172.
41. Simon N.W., Beas B.S., Montgomery K.S., Haberman R.P., Bizon J.L., Setlow B. Prefrontal cortical-striatal dopamine receptor mRNA expression predicts distinct forms of impulsivity. European Journal of Neuroscience 2013, 37(11):1779-1788. 10.1111/ejn.12191.
42. Simon, N. W., Busch, T. N., Richardson, A. J., Walls, K. J., & Setlow, B. (2007). Cocaine exposure and impulsive choice: A parametric analysis. Neuroscience meeting planner. Society for Neuroscience. Program No. 933.934 (Online).
43. Simon N.W., Gilbert R.J., Mayse J.D., Bizon J.L., Setlow B. Balancing risk and reward: A rat model of risky decision making. Neuropsychopharmacology 2009, 34(10):2208-2217. 10.1038/npp.2009.48.
44. Simon N.W., Mendez I.A., Setlow B. Cocaine exposure causes long-term increases in impulsive choice. Behavioral Neuroscience 2007, 121(3):543-549. 10.1037/0735-7044.121.3.543.
45. Simon N.W., Montgomery K.S., Beas B.S., Mitchell M.R., LaSarge C.L., Mendez I.A., et al. Dopaminergic modulation of risky decision-making. Journal of Neuroscience 2011, 31(48):17460-17470. 10.1523/jneurosci.3772-11.2011.
46. Sloan H.L., Good M., Dunnett S.B. Double dissociation between hippocampal and prefrontal lesions on an operant delayed matching task and a water maze reference memory task. Behavioural Brain Research 2006, 171(1):116-126. http://dx.doi.org/S0166-4328(06)00184-7 [pii]10.1016/j.bbr.2006.03.030.
47. St Onge J.R., Floresco S.B. Dopaminergic modulation of risk-based decision making. Neuropsychopharmacology 2009, 34(3):681-697. 10.1038/npp.2008.121.
48. Stanley, R. (2002). In D. H. Barlow (Ed.), Anxiety and its disorders-The nature and treatment of anxiety and panic (704pp). New York: The Guilford Press. (ISBN 1-57230-430-8. Stress and Health, 18(4), 193-194. ). doi:10.1002/smi.941.
49. Stefani M.R., Groth K., Moghaddam B. Glutamate receptors in the rat medial prefrontal cortex regulate set-shifting ability. Behavioral Neuroscience 2003, 117(4):728-737.
50. Steinglass J.E., Figner B., Berkowitz S., Simpson H.B., Weber E.U., Walsh B.T. Increased capacity to delay reward in anorexia nervosa. Journal of the International Neuropsychological Society 2012, 18(4):773-780. 10.1017/s1355617712000446.
51. Stopper C.M., Green E.B., Floresco S.B. Selective involvement by the medial orbitofrontal cortex in biasing risky, but not impulsive, choice. Cerebral Cortex 2014, 24(1):154-162. 10.1093/cercor/bhs297.
52. Volkow N.D., Fowler J.S., Wang G.J., Swanson J.M. Dopamine in drug abuse and addiction: Results from imaging studies and treatment implications. Mol Psychiatry 2004, 9(6):557-569. 10.1038/sj.mp.4001507.
53. Volkow N.D., Gur R.C., Wang G.J., Fowler J.S., Moberg P.J., Ding Y.S., et al. Association between decline in brain dopamine activity with age and cognitive and motor impairment in healthy individuals. American Journal of Psychiatry 1998, 155(3):344-349.
54. Winstanley C.A., Dalley J.W., Theobald D.E., Robbins T.W. Global 5-HT depletion attenuates the ability of amphetamine to decrease impulsive choice on a delay-discounting task in rats. Psychopharmacology (Berlin) 2003, 170(3):320-331. 10.1007/s00213-003-1546-3.
55. Winstanley C.A., Theobald D.E., Cardinal R.N., Robbins T.W. Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. Journal of Neuroscience 2004, 24(20):4718-4722. 10.1523/jneurosci.5606-03.2004.