Balancing risk and reward: A rat model of risky decision making

Neuropsychopharmacology

Volumn 34, Issue 10, 2009, Pages 2208-2217

  Simon, Nicholas W ^a   Gilbert, Ryan J ^a   Mayse, Jeffrey D ^a   Bizon, Jennifer L ^a   Setlow, Barry ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Amphetamine; Choice; Cocaine; Decision making; Punishment; Risk

Indexed keywords

AMPHETAMINE; COCAINE;

ADDICTION; ANIMAL EXPERIMENT; ARTICLE; ATTENTION DEFICIT DISORDER; DECISION MAKING; DOSE RESPONSE; FOOD; HIGH RISK BEHAVIOR; LONG EVANS CINNAMON RAT; MALE; NONHUMAN; PRIORITY JOURNAL; PUNISHMENT; RAT; REWARD; RISK; SATIETY;

AMPHETAMINE; ANALYSIS OF VARIANCE; ANIMALS; BEHAVIOR, ANIMAL; BIOPHYSICS; CENTRAL NERVOUS SYSTEM STIMULANTS; COCAINE; CONDITIONING, OPERANT; DECISION MAKING; DOPAMINE UPTAKE INHIBITORS; ELECTROSHOCK; MALE; MODELS, ANIMAL; PROBABILITY LEARNING; RATS; RATS, LONG-EVANS; REACTION TIME; REWARD; RISK-TAKING; SATIETY RESPONSE; TASK PERFORMANCE AND ANALYSIS; TIME FACTORS;

EID: 68949172540     PISSN: 0893133X     EISSN: None     Source Type: Journal    
DOI: 10.1038/npp.2009.48     Document Type: Article

References (59)

1. Ainslie G (1975). Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 82: 463-496.
2. Balleine BW, Dickinson A (1998). Goal-directed instrumental action: continency and incentive learning and their cortical substrates. Neuropharmacology 37: 407-419.
3. Bechara A, Dolan S, Denburg N, Hindes A, Anderson SW, Nathan PE (2001). Decision-making deficits, linked to dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers. Neuropsychologia 39: 376-389.
4. Bechara A, Tranel D, Damasio H (2000). Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions. Brain 123: 2189-2202.
5. Berridge CW, Devilbiss DM, Andrzejewski ME, Arnsten AF, Kelley AE, Schmeichel B et al (2006). Methylphenidate preferentially increases catecholamine neurotransmission within the prefrontal cortex at low doses that enhance cognitive function. Biol Psychiatry 60: 1111-1120.
6. Cardinal R, Howes N (2005). Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats. BMC Neurosci 6: 37.
7. Cardinal RN (2006). Neural systems implicated in delayed and probabilistic reinforcement. Neural Netw 19: 1277-1301.
8. Cardinal RN, Robbins TW, Everitt BJ (2000). The effects of d-amphetamine, chlordiazepoxide, α-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology (Berl) 152: 362-375.
9. Carlezon WA, Thomas MJ (2009). Biological substrates of reward and aversion: a nucleus accumbens activity hypothesis. Neuropharmacology 56: 122-132.
10. Chhatwal JP, Davis M, Maguschak KA, Ressler KJ (2004). Enhancing cannabinoid neurotransmission augments the extinction of conditioned fear. Neuropsychopharmacology 30: 516-524.
11. Clark L, Bechara A, Damasio H, Aitken MRF, Sahakian BJ, Robbins TW (2008). Differential effects of insular and ventromedial prefrontal cortex lesions on risky decision-making. Brain 131: 1311-1322.
12. Connor J, Makonnen E, Rostom A (2000). Comparison of analgesic effects of khat (Catha edulis Forsk) extract, d-amphetamine and ibuprofen in mice. J Pharm Pharmacol 52: 107-110.
13. Cools R, Robinson OJ, Sahakian B (2008). Acute tryptophan depletion in healthy volunteers enhances punishment prediction but does not affect reward prediction. Neuropsychopharmacology 33: 2291-2299.
14. Dalley JW, Laane K, Pena Y, Theobald DE, Everitt BJ, Robbins TW (2005). Attentional and motivational deficits in rats withdrawn from intravenous self-administration of cocaine or heroin. Psychopharmacology (Berl) 182: 579-587.
15. Daw ND, Kakade S, Dayan P (2002). Opponent interactions between serotonin and dopamine. Neural Netw 15: 603-616.
16. De Wit H, Enggasser JL, Richards JB (2002). Acute administration of d-amphetamine decreases impulsivity in healthy volunteers. Neuropsychopharmacology 27: 813-825.
17. DeVito EE, Blackwell AD, Kent L, Ersche KD, Clark L, Salmond CH et al (2008). The effects of methylphenidate on decision-making in attention-deficit/hyperactivity disorder. Biol Psychiatry 64: 636-639.
18. Drago F, Caccamo G, Continella G, Scapagnini U (1984). Amphetamine-induced analgesia does not involve brain opioids. Eur J Pharmacol 101: 267-269.
19. Drechsler R, Rizzo P, Steinhausen HC (2008). Decision-making on an explicit risk-taking task in preadolescents with attention-deficit/hyperactivity disorder. J Neural Transm 115: 201-209.
20. Ernst M, Kimes AS, London ED, Matochik JA, Eldreth D, Tata S et al (2003). Neural substrates of decision making in adults with attention deficit hyperactivity disorder. Am J Psychiatry 160: 1061-1070.
21. Ersche K, Roiser J, Robbins T, Sahakian B (2008). Chronic cocaine but not chronic amphetamine use is associated with perseverative responding in humans. Psychopharmacology (Berl) 197: 421-431.
22. Evenden JL, Ryan CN (1996). The pharmacology of impulsive behavior in rats: the effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology (Berl) 128: 161-170.
23. File SE, Lippa AS, Beer B, Lippa MT (2003). Animal tests of anxiety. Curr Protoc Neurosci 8: 3.
24. Floresco SB, St. Onge JR, Ghods-Sharifi S, Winstanley CA (2008). Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision-making. Cogn Affect Behav Neurosci 8: 375-389.
25. Gianotti LRR, Knoch D, Faber PL, Lehmann D, Pascual-Marqui RD, Diezi C et al (2009). Tonic activity level in the right prefrontal cortex predicts individuals' risk-taking. Psychol Sci 20: 33-38.
26. Goeders NE (1997). A neuroendocrine role in cocaine reinforcement. Psychoneuroendocrinology 22: 237-259.
27. Hayden BY, Platt ML (2007). Temporal discounting predicts risk sensitivity in Rhesus macaques. Curr Biol 17: 49-53.
28. Heerey EA, Bell-Warren KR, Gold JM (2008). Decision-making impairments in the context of intact reward sensitivity in schizophrenia. Biol Psychiatry 64: 62-69.
29. Johnson AW, Gallagher M, Holland PC (2009). The basolateral amygdala is critical to the expression of Pavlovian and instrumental outcome-specific reinforcer devaluation effects. J Neurosci 29: 696-704.
30. Killcross AS, Everitt BJ, Robbins TW (1997). Symmetrical effects of amphetamine and alpha-flupenthixol on conditioned punishment and conditioned reinforcement: contrasts with midazolam. Psychopharmacology (Berl) 129: 141-152.
31. Kobayashi S, Schultz W (2008). Influence of reward delays on responses of dopamine neurons. J Neurosci 28: 7837-7846.
32. Lejuez CW, Aklin WM, Zvolensky MJ, Pedulla CM (2003). Evaluation of the Balloon Analogue Risk Task (BART) as a predictor of adolescent real-world risk-taking behaviours. J Adolesc 26: 475-479.
33. Lejuez CW, Read JP, Kahler CW, Richards JB, Ramsey SE, Stuart GL et al (2002). Evaluation of risk taking: the Balloon Analogue Risk Task (BART). J Exp Psychol Appl 8: 75-84.
34. Leland DS, Paulus MP (2005). Increased risk-taking decision-making but not altered response to punishment in stimulant-using young adults. Drug Alcohol Depend 78: 83-90.
35. Liu Z-H, Shin R, Ikemoto S (2008). Dual role of medial A10 dopamine neurons in affective encoding. Neuropsychopharmacology 33: 3010-3020.
36. Mobini S, Chiang TJ, Ho MY, Bradshaw CM, Szabadi E (2000). Effects of central 5-hydroxytryptamine depletion on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl) 152: 390-397.
37. Negus S (2005). Effects of punishment on choice between cocaine and food in rhesus monkeys. Psychopharmacology (Berl) 181: 244-252.
38. Rahman S, Robbins TW, Hodges JR, Mehta MA, Nestor PJ, Clark L et al (2005). Methylphenidate ('Ritalin') can ameliorate abnormal risk-taking behavior in the frontal variant of frontotemporal dementia. Neuropsychopharmacology 31: 651-658.
39. Reyna V, Farley F (2006). Risk and rationality in adolescent decision-making: implications for theory, practice, and public policy. Psychol Sci Public Interest 7: 1-44.
40. Schultz W, Preuschoff K, Camerer C, Hsu M, Fiorillo CD, Tobler PN et al (2008). Review. Explicit neural signals reflecting reward uncertainty. Philos Trans R Soc Lond B Biol Sci 363: 3801-3811.
41. Setlow B, Schoenbaum G, Gallagher M (2003). Neural encoding in ventral striatum during olfactory discrimination learning. Neuron 38: 625-636.
42. Simon NW, Busch TN, Richardson AJ, Walls KJ, Setlow B (2007a). Cocaine exposure and impulsive choice: a parametric analysis. Society for Neuroscience Abstracts 933: 4/WW24.
43. Simon NW, Gilbert RJ, Mayse JD, Setlow B (2008a). A rat model of risky decision-making: the role of dopamine in balancing risk and reward. Society for Neuroscience Abstracts 875: 1/RR63.
44. Simon NW, LaSarge CL, Montgomery KS, Williams MT, Mendez IA, Setlow B et al (2008b). Good things come to those who wait: attenuated discounting of delayed rewards in aged Fischer 344 rats. Neurobiol Aging e-pub ahead of print 25 July 2008.
45. Simon NW, Mendez IA, Setlow B (2007b). Cocaine exposure causes long term increases in impulsive choice. Behav Neurosci 121: 543-549.
46. Sobanski E, Sabljic D, Alm B, Skopp G, Kettler N, Mattern R et al (2008). Driving-related risks and impact of methylphenidate treatment on driving in adults with attention-deficit/hyperactivity disorder (ADHD). J Neural Transm 115: 347-356.
47. St Onge JR, Floresco SB (2008). Dissociable roles for different subregions of the rat prefrontal cortex in risk-based decision making. Society for Neuroscience Abstracts 88: 15/SS11.
48. St Onge JR, Floresco SB (2009). Dopaminergic modulation of risk-based decision making. Neuropsychopharmacology 34: 681-697.
49. Stanis J, Marquez Avila H, White M, Gulley J (2008). Dissociation between long-lasting behavioral sensitization to amphetamine and impulsive choice in rats performing a delay-discounting task. Psychopharmacology (Berl) 199: 539-548.
50. Taylor Tavares JV, Clark L, Cannon DM, Erickson K, Drevets WC, Sahakian BJ (2007). Distinct profiles of neurocognitive function in unmedicated unipolar depression and bipolar II depression. Biol Psychiatry 62: 917-924.
51. Weber EU, Shafir S, Blais AR (2004). Predicting risk sensitivity in humans and lower animals: risk as variance or coefficient of variation. Psychol Rev 111: 430-445.
52. Wellman PJ, Ho D, Cepeda-Benito A, Bellinger L, Nation JR (2002). Cocaine-induced hypophagia and hyperlocomotion in rats are attenuated by prazosin. Eur J Pharmacol 455: 117-126.
53. Wellman PJ, Davis KW, Clifford PS, Rothman RB, Blough BE (2009). Changes in feeding and locomotion induced by amphetamine analogs in rats. Drug Alcohol Depend 100: 234-239.
54. White FJ, Kalivas PW (1998). Neuroadaptations involved in amphetamine and cocaine addiction. Drug Alcohol Depend 51: 141-153.
55. Winstanley CA, Dalley JW, Theobald DE, Robbins MJ (2003). Global 5-HT depletion attenuates the ability of amphetamine to decrease impulse choice on a delay-discounting task in rats. Psychopharmacology (Berl) 170: 320-331.
56. Winstanley CA, Eagle DM, Robbins TW (2006a). Behavioral models of impulsivity in relation to ADHD: translation between clinical and preclinical studies. Clin Psychol Rev 26: 379-395.
57. Winstanley CA, LaPlant Q, Theobald DE, Green TA, Bachtell RK, Perrotti LI et al (2007). DeltaFosB induction in orbitofrontal cortex mediates tolerance to cocaine-induced cognitive dysfunction. J Neurosci 27: 10497-10507.
58. Winstanley CA, Theobald DEH, Dalley JW, Cardinal RN, Robbins TW (2006b). Double dissociation between serotonergic and dopaminergic modulation of medial prefrontal and orbitofrontal cortex during a test of impulsive choice. Cereb Cortex 16: 106-114.
59. Yi R, de la Piedad X, Bickel WK (2006). The combined effects of delay and probability in discounting. Behav Processes 73: 149-155.