Impulsive actions and choices in laboratory animals and humans: Effects of high vs. low dopamine states produced by systemic treatments given to neurologically intact subjects

Frontiers in Behavioral Neuroscience

Volumn 8, Issue DEC, 2014, Pages

  D’Amour Horvat, Valérie ^a   Leyton, Marco ^a,b  

^a MCGILL UNIVERSITY   (Canada)

^b and Applied Physiology   (Canada)

Author keywords

Addiction; Compulsivity; Gambling; Impulsivity; Motivation

Indexed keywords

8 CHLORO 2,3,4,5 TETRAHYDRO 3 METHYL 5 PHENYL 1H 3 BENZAZEPIN 7 OL HYDROGEN MALEATE; AMPHETAMINE; COCAINE; DEXAMPHETAMINE; DOPAMINE; DOPAMINE 1 RECEPTOR; DOPAMINE 2 RECEPTOR; ETICLOPRIDE; FLUPENTIXOL; HALOPERIDOL; METHYLPHENIDATE; MODAFINIL; RACLOPRIDE; SULPIRIDE; VANOXERINE;

BEHAVIOR CONTROL; BRAIN FUNCTION; DECISION MAKING; DELAY DISCOUNTING; DOPAMINE BRAIN LEVEL; DOPAMINE RELEASE; DOPAMINERGIC TRANSMISSION; DOSE RESPONSE; DRUG EFFECT; HUMAN; IMPULSIVENESS; NERVE CONDUCTION; NEUROMODULATION; NONHUMAN; PSYCHOMOTOR PERFORMANCE; REINFORCEMENT; RESPONSE TIME; REVIEW; REWARD; SYSTEMIC THERAPY; TASK PERFORMANCE;

EID: 84919922198     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2014.00432     Document Type: Review

References (121)

1. Aarts, E., Wallace, D. L., Dang, L. C., Jagust, W. J., Cools, R., and D’esposito, M. (2014). Dopamine and the cognitive downside of a promised bonus. Psychol. Sci. 25, 1003–1009. doi: 10.1177/0956797613517240
2. Acheson, A., and de Wit, H. (2008). Bupropion improves attention but does not affect impulsive behavior in healthy young adults. Exp. Clin. Psychopharmacol. 16, 113–123. doi: 10.1037/1064-1297.16.2.113
3. Ainslie, G. (1975). Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol. Bull. 82, 463–496. doi: 10.1037/h0076860
4. Amalric, M., Berhow, M., Polis, I., and Koob, G. F. (1993). Selective effects of low-dose D2 dopamine receptor antagonism in a reaction-time task in rats. Neuropsychopharmacology 8, 195–200. doi: 10.1038/npp.1993.21
5. Amalric, M., and Koob, G. (1987). Depletion of dopamine in the caudate nucleus but not in nucleus accumbens impairs reaction-time performance in rats. J. Neurosci. 7, 2129–2134.
6. American Psychiatric Association. (2013). The Diagnostic and Statistical Manual of Mental Disorders: DSM 5. Washington, D.C.: American Psychiatric Association.
7. Aron, A. R., Dowson, J. H., Sahakian, B. J., and Robbins, T. W. (2003). Methylphenidate improves response inhibition in adults with attention-deficit/hyperactivity disorder. Biol. Psychiatry 54, 1465–1468. doi: 10.1016/s0006-3223(03)00609-7
8. Baarendse, P. J., and Vanderschuren, L. J. (2012). Dissociable effects of monoamine reuptake inhibitors on distinct forms of impulsive behavior in rats. Psychopharmacology (Berl) 219, 313–326. doi: 10.1007/s00213-011-2576-x
9. Baarendse, P. J., Winstanley, C. A., and Vanderschuren, L. J. (2013). Simultaneous blockade of dopamine and noradrenaline reuptake promotes disadvantageous decision making in a rat gambling task. Psychopharmacology (Berl) 225, 719–731. doi: 10.1007/s00213-012-2857-z
10. Bari, A., Eagle, D. M., Mar, A. C., Robinson, E. S. J., and Robbins, T. W. (2009). Dissociable effects of noradrenaline, dopamine and serotonin uptake blockade on stop task performance in rats. Psychopharmacology (Berl) 205, 273–283. doi: 10.1007/s00213-009-1537-0
11. Barrett, S. P., Pihl, R. O., Benkelfat, C., Brunelle, C., Young, S. N., and Leyton, M. (2008). The role of dopamine in alcohol self-administration in humans: individual differences. Eur. Neuropsychopharmacol. 18, 439–447. doi: 10.1016/j.euroneuro.2008.01.008
12. Baunez, C., Nieoullon, A., and Amalric, M. (1994). N-methyl-d-aspartate receptor blockade impairs behavioural performance of rats in a reaction time task: new evidence for glutamatergic-dopaminergic interactions in the striatum. Neuroscience 61, 521–531. doi: 10.1016/0306-4522(94)90431-6
13. Baunez, C., Nieoullon, A., and Amalric, M. (1995). Dopamine and complex sensorimotor integration: further studies in a conditioned motor task in the rat. Neuroscience 65, 375–384. doi: 10.1016/0306-4522(94)00498-t
14. Bechara, A., Damasio, A. R., Damasio, H., and Anderson, S.W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50, 7–15. doi: 10.1016/0010-0277(94)90018-3
15. Bizot, J.-C. (1998). Effects of various drugs including organophosphorus compounds (OPC) and therapeutic compounds against OPC on DRL responding. Pharmacol. Biochem. Behav. 59, 1069–1080. doi: 10.1016/s0091-3057(97)00519-4
16. Blokland, A., Sik, A., and Lieben, C. (2005). Evaluation of DOI, 8-OH-DPAT, eticlopride and amphetamine on impulsive responding in a reaction time task in rats. Behav. Pharmacol. 16, 93–100. doi: 10.1097/00008877-200503000-00004
17. Brewer, J. A., and Potenza, M. N. (2008). The neurobiology and genetics of impulse control disorders: relationships to drug addictions. Biochem. Pharmacol. 75, 63–75. doi: 10.1016/j.bcp.2007.06.043
18. Britton, K., and Koob, G. F. (1989). Effects of corticotropin releasing factor, desipramine and haloperidol on a DRL schedule of reinforcement. Pharmacol. Biochem. Behav. 32, 967–970. doi: 10.1016/0091-3057(89)90067-1
19. Canon, J. G., and Lippa, A. S. (1977). Use of DRL in differentiating anxiolytic and neuroleptic properties of CNS drugs. Pharmacol. Biochem. Behav. 6, 591–593. doi: 10.1016/0091-3057(77)90122-8
20. Cardinal, R. N., Robbins, T. W., and Everitt, B. J. (2000). The effects of d-amphetamine, chlordiazepoxide, α-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology (Berl) 152, 362–375. doi: 10.1007/s002130000536
21. Cawley, E. I., Park, S., aan het Rot, M., Sancton, K., Benkelfat, C., Young, S. N., et al. (2013). Dopamine and light: dissecting effects on mood and motivational states in women with subsyndromal seasonal affective disorder. J. Psychiatry Neurosci. 38, 388–397. doi: 10.1503/jpn.120181
22. Charrier, D., and Thiébot, M. H. (1996). Effects of psychotropic drugs on rat responding in an operant paradigm involving choice between delayed rein-forcers. Pharmacol. Biochem. Behav. 54, 149–157. doi: 10.1016/0091-3057(95)02114-0
23. Cheng, R., and Liao, R. (2007). Dopamine receptor antagonists reverse amphetamine-induced behavioral alteration on a differential reinforcement for low-rate (DRL) operant task in the rat. Chin. J. Physiol. 50, 77–88.
24. Cheng, R.-K., MacDonald, C. J., and Meck, W. H. (2006). Differential effects of cocaine and ketamine on time estimation: implications for neurobiological models of interval timing. Pharmacol. Biochem. Behav. 85, 114–122. doi: 10.1016/j.pbb.2006.07.019
25. Cocker, P. J., Hosking, J. G., Benoit, J., and Winstanley, C. A. (2012). Sensitivity to cognitive effort mediates psychostimulant effects on a novel rodent cost/benefit decision-making task. Neuropsychopharmacology 37, 1825–1837. doi: 10.1038/npp.2012.30
26. Cole, B. J., and Robbins, T. W. (1987). Amphetamine impairs the discriminative performance of rats with dorsal noradrenergic bundle lesions on a 5-choice serial reaction time task: new evidence for central dopaminergic-noradrenergic interactions. Psychopharmacology (Berl) 91, 458–466. doi: 10.1007/bf00216011
27. Collins, A. G., and Frank, M. J. (2014). Opponent actor learning (OpAL): modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive. Psychol. Rev. 121, 337–366. doi: 10.1037/a0037015
28. Colzato, L. S., Jongkees, B. J., Sellaro, R., and Hommel, B. (2013). Working memory reloaded: tyrosine repletes updating in the N-back task. Front. Behav. Neurosci. 7:200. doi: 10.3389/fnbeh.2013.00200
29. Colzato, L. S., Jongkees, B. J., Sellaro, R., van den Wildenberg, W. P., and Hommel, B. (2014). Eating to stop: tyrosine supplementation enhances inhibitory control but not response execution. Neuropsychologia 62, 398–402. doi: 10.1016/j.neuropsychologia.2013.12.027
30. Costa, A., Riedel, M., Pogarell, O., Menzel-Zelnitschek, F., Schwarz, M., Reiser, M., et al. (2013). Methylphenidate effects on neural activity during response inhibition in healthy humans. Cereb. Cortex 23, 1179–1189. doi: 10.1093/cercor/bhs107
31. Dagher, A., and Robbins, T. W. (2009). Personality, addiction, dopamine: insights from Parkinson’s disease. Neuron 61, 502–510. doi: 10.1016/j.neuron.2009.01.031
32. Dalley, J. W., Mar, A. C., Economidou, D., and Robbins, T. W. (2008). Neu-robehavioral mechanisms of impulsivity: fronto-striatal systems and functional neurochemistry. Pharmacol. Biochem. Behav. 90, 250–260. doi: 10.1016/j.pbb.2007.12.021
33. Denk, F., Walton, M. E., Jennings, K. A., Sharp, T., Rushworth, M. F. S., and Bannerman, D. M. (2005). Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort. Psychopharmacology (Berl) 179, 587–596. doi: 10.1007/s00213-004-2059-4
34. de Wit, H., Crean, J., and Richards, J. B. (2000). Effects of d-Amphetamine and ethanol on a measure of behavioral inhibition in humans. Behav. Neurosci. 114, 830–837. doi: 10.1037/0735-7044.114.4.830
35. de Wit, H., Enggasser, J., and Richards, J. B. (2002). Acute administration of d-amphetamine decreases impulsivity in healthy volunteers. Neuropsychopharma-cology 27, 813–825. doi: 10.1016/s0893-133x(02)00343-3
36. Eagle, D. M., and Baunez, C. (2010). Is there an inhibitory-response-control system in the rat? Evidence from anatomical and pharmacological studies of behavioral inhibition. Neurosci. Biobehav. Rev. 34, 50–72. doi: 10.1016/j.neubiorev.2009.07.003
37. Eagle, D. M., Lehmann, O., Theobald, D. E. H., Pena, Y., Zakaria, R., Ghosh, R., et al. (2009). Serotonin depletion impairs waiting but not stop-signal reaction time in rats: implications for theories of the role of 5-HT in behavioral inhibition. Neuropsychopharmacology 34, 1311–1321. doi: 10.1038/npp.2008.202
38. Eagle, D. M., and Robbins, T. W. (2003). Inhibitory control in rats performing a stop-signal reaction-time task: effects of lesions of the medial striatum and d-amphetamine. Behav. Neurosci. 117, 1302–1317. doi: 10.1037/0735-7044.117.6.1302
39. Eagle, D. M., Tufft, M. R. A., Goodchild, H. L., and Robbins, T. W. (2007). Differential effects of modafinil and methylphenidate on stop-signal reaction time task performance in the rat and interactions with the dopamine receptor antagonist cis-flupenthixol. Psychopharmacology (Berl) 192, 193–206. doi: 10.1007/s00213-007-0701-7
40. Evenden, J., and Ryan, C. (1996). The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology (Berl) 128, 161–170. doi: 10.1007/s002130050121
41. Fellows, L. K., and Farah, M. J. (2005). Different underlying impairments in decision-making following ventromedial and dorsolateral frontal lobe damage in humans. Cereb. Cortex 15, 58–63. doi: 10.1093/cercor/bhh108
42. Feola, T. W., de Wit, H., and Richards, J. B. (2000). Effects of d-Amphetamine and ethanol on a measure of behavioral inhibition in rats. Behav. Neurosci. 114, 838–848. doi: 10.1037/0735-7044.114.4.838
43. Ferguson, S. A., Cada, A. M., Gray, E. P., and Paule, M. G. (2001). No alterations in the performance of two interval timing operant tasks after α-difluoromethylornithine (DFMO)-induced cerebellar stunting. Behav. Brain Res. 126, 135–146. doi: 10.1016/s0166-4328(01)00259-5
44. Fernando, A. B., Economidou, D., Theobald, D. E., Zou, M.-F., Newman, A. H., Spoelder, M., et al. (2012). Modulation of high impulsivity and attentional performance in rats by selective direct and indirect dopaminergic and nora-drenergic receptor agonists. Psychopharmacology (Berl) 219, 341–352. doi: 10.1007/s00213-011-2408-z
45. Fillmore, M. T., Kelly, T. H., and Martin, C. A. (2005). Effects of d-amphetamine in human models of information processing and inhibitory control. Drug Alcohol Depend. 77, 151–159. doi: 10.1016/j.drugalcdep.2004.07.013
46. Fletcher, P., Rizos, Z., Noble, K., and Higgins, G. (2011). Impulsive action induced by amphetamine, cocaine and MK801 is reduced by 5-HT (2C) receptor stimulation and 5-HT (2A) receptor blockade. Neuropharmacology 61, 468–477. doi: 10.1016/j.neuropharm.2011.02.025
47. Floresco, S., Tse, M., and Ghods-Sharifi, S. (2008). Dopaminergic and glutamater-gic regulation of effort-and delay-based decision making. Neuropsychopharma-cology 33, 1966–1979. doi: 10.1038/sj.npp.1301565
48. Frank, M. J. (2005). Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmed-icated Parkinsonism. J. Cogn. Neurosci. 17, 51–72. doi: 10.1162/0898929052880093
49. Gallagher, D. A., O’Sullivan, S. S., Evans, A. H., Lees, A. J., and Schrag, A. (2007). Pathological gambling in Parkinson’s disease: risk factors and differences from dopamine dysregulation. An analysis of published case series. Mov. Disord. 22, 1757–1763. doi: 10.1002/mds.21611
50. Hamidovic, A., Kang, U. J., and de Wit, H. (2008). Effects of low to moderate acute doses of pramipexole on impulsivity and cognition in healthy volunteers. J. Clin. Psychopharmacol. 28, 45–51. doi: 10.1097/jcp.0b013e3181602fab
51. Harrison, A. A., Everitt, B. J., and Robbins, T. W. (1997). Central 5-HT depletion enhances impulsive responding without affecting the accuracy of attentional performance: interactionswith dopaminergic mechanisms. Psychopharmacology (Berl) 133, 329–342. doi: 10.1007/s002130050410
52. Helms, C. M., Reeves, J. M., and Mitchell, S. H. (2006). Impact of strain and d-amphetamine on impulsivity (delay discounting) in inbred mice. Psychopharmacology (Berl) 188, 144–151. doi: 10.1007/s00213-006-0478-0
53. Howe, M. W., Tierney, P. L., Sandberg, S. G., Phillips, P. E., and Graybiel, A. M. (2013). Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 500, 575–579. doi: 10.1038/nature12475
54. Isles, A. R., Humby, T., and Wilkinson, L. S. (2003). Measuring impulsivity in mice using a novel operant delayed reinforcement task: effects of behavioural manipulations and d-amphetamine. Psychopharmacology (Berl) 170, 376–382. doi: 10.1007/s00213-003-1551-6
55. Kelm, M. K., and Boettiger, C. A. (2013). Effects of acute dopamine precusor depletion on immediate reward selection bias and working memory depend on catechol-o-methyltransferase genotype. J. Cogn. Neurosci. 25, 2061–2071. doi: 10.1162/jocn_a_00464
56. Koffarnus, M. N., Newman, A. H., Grundt, P., Rice, K. C., and Woods, J. H. (2011). Effects of selective dopaminergic compounds on a delay discounting task. Behav. Pharmacol. 22, 300–311. doi: 10.1097/FBP.0b013e3283473bcb
57. Leyton, M. (2007). Conditioned and sensitized responses to stimulant drugs in humans. Prog. Neuropsychopharmacol. Biol. Psychiatry 31, 1601–1613. doi: 10.1016/j.pnpbp.2007.08.027
58. Leyton, M., aan het Rot, M., Booij, L., Baker, G. B., Young, S. N., and Benkelfat, C. (2007). Mood-elevating effects of d-amphetamine and incentive salience: the effect of acute dopamine precursor depletion. J. Psychiatry Neurosci. 32, 129–136.
59. Leyton, M., and Vezina, P. (2014). Dopamine ups and downs in vulnerability to addictions: a neurodevelopmental model. Trends Pharmacol. Sci. 35, 268–276. doi: 10.1016/j.tips.2014.04.002
60. Liao, R., and Cheng, R. (2005). Acute effects of d-amphetamine on the differential reinforcement of low-rate (DRL) schedule behavior in the rat: comparison with selective dopamine receptor antagonists. Chin. J. Physiol. 48, 41–50.
61. Logan, G. D., Cowan, W. B., and Davis, K. A. (1984). On the ability to inhibit simple and choice reaction time responses: a model and a method. J. Exp. Psychol. Hum. Percept. Perform. 10, 276–291. doi: 10.1037/0096-1523.10.2.276
62. Loos, M., Staal, J., Schoffelmeer, A. N. M., Smit, A. B., Spijker, S., and Pattij, T. (2010). Inhibitory control and response latency differences between C57BL/6J and DBA/2J mice in a Go/No-Go and 5-choice serial reaction time task and strain-specific responsivity to amphetamine. Behav. Brain Res. 214, 216–224. doi: 10.1016/j.bbr.2010.05.027
63. Lythe, K., Anderson, I., Deakin, J., Elliott, R., and Strickland, P. (2005). Lack of behavioural effects after acute tyrosine depletion in healthy volunteers. J. Psychopharmacol. 19, 5–11. doi: 10.1177/0269881105048886
64. Ma, F., Falk, J. L., and Lau, C. E. (1999). Cocaine pharmacodynamics after intravenous and oral administration in rats: relation to pharmacokinetics. Psychopharmacology (Berl) 144, 323–332. doi: 10.1007/s002130051014
65. Maguire, D. R., Henson, C., and France, C. P. (2014). Effects of amphetamine on delay discounting in rats depend upon the manner in which delay is varied. Neuropharmacology 87, 173–179. doi: 10.1016/j.neuropharm.2014.04.012. [Epub ahead of print].
66. Marrow, L., Overton, P., and Clark, D. (1993). Disruption of conditioned reaction time performance by dopamine receptor antagonists in the rat. Behav. Pharmacol. 4, 15–28. doi: 10.1097/00008877-199302000-00002
67. McLean, A., Rubinsztein, J. S., Robbins, T. W., and Sahakian, B. J. (2004). The effects of tyrosine depletion in normal healthy volunteers: implications for unipolar depression. Psychopharmacology (Berl) 171, 286–297. doi: 10.1007/s00213-003-1586-8
68. Milstein, J. A., Dalley, J. W., and Robbins, T. W. (2010). Methylphenidate-induced impulsivity: pharmacological antagonism by β-adrenoreceptor blockade. J. Psychopharmacol. 24, 309–321. doi: 10.1177/0269881108098146
69. Mitchell, M. R., Vokes, C. M., Blankenship, A. L., Simon, N. W., and Setlow, B. (2011). Effects of acute administration of nicotine, amphetamine, diazepam, morphine and ethanol on risky decision-making in rats. Psychopharmacology (Berl) 218, 703–712. doi: 10.1007/s00213-011-2363-8
70. Moore, T. J., Glenmullen, J., and Mattison, D. R. (2014). Reports of pathological gambling, hypersexuality and compulsive shopping associated with dopamine receptor agonist drugs. JAMA Intern. Med. doi: 10.1001/jamainternmed.2014.5262. [Epub ahead of print].
71. Navarra, R., Graf, R., Huang, Y., Logue, S., Comery, T., Hughes, Z., et al. (2008). Effects of atomoxetine and methylphenidate on attention and impulsivity in the 5-choice serial reaction time test. Prog. Neuropsychopharmacol. Biol. Psychiatry 32, 34–41. doi: 10.1016/j.pnpbp.2007.06.017
72. Paine, T. A., and Olmstead, M. C. (2004). Cocaine disrupts both behavioural inhibition and conditional discrimination in rats. Psychopharmacology (Berl) 175, 443–450. doi: 10.1007/s00213-004-1845-3
73. Paterson, N. E., Wetzler, C., Hackett, A., and Hanania, T. (2012). Impulsive action and impulsive choice are mediated by distinct neuropharmacologi-cal substrates in rat. Int. J. Neuropsychopharmacol. 15, 1473–1487. doi: 10.1017/S1461145711001635
74. Pattij, T., Janssen, M. C., Vanderschuren, L. J., Schoffelmeer, A. N., and van Gaalen, M. M. (2007). Involvement of dopamine D1 and D2 receptors in the nucleus accumbens core and shell in inhibitory response control. Psychopharmacology (Berl) 191, 587–598. doi: 10.1007/s00213-006-0533-x
75. Pine, A., Shiner, T., Seymour, B., and Dolan, R. J. (2010). Dopamine, time and impulsivity in humans. J. Neurosci. 30, 8888–8896. doi: 10.1523/JNEUROSCI.6028-09.2010
76. Ramdani, C., Carbonnell, L., Vidal, F., Béranger, C., Dagher, A., and Hasbroucq, T. (2014). Dopamine precursors depletion impairs impulse control in healthy volunteers. Psychopharmacology (Berl) doi: 10.1007/s00213-014-3686-z. [Epub ahead of print].
77. Riba, J., Krämer, U. M., Heldmann, M., Richter, S., and Münte, T. F. (2008). Dopamine agonist increases risk taking but blunts reward-related brain activity. PLoS One 3:e2479. doi: 10.1371/journal.pone.0002479
78. Richards, J. B., Sabol, K. E., and Seiden, L. S. (1993). DRL interresponse-time distributions: quantification by peak deviation analysis. J. Exp. Anal. Behav. 60, 361–385. doi: 10.1901/jeab.1993.60-361
79. Robbins, T. (2002). The 5-choice serial reaction time task: behavioural pharmacology and functional neurochemistry. Psychopharmacology (Berl) 163, 362–380. doi: 10.1007/s00213-002-1154-7
80. Roberts, D., Gabriele, A., and Zimmer, B. A. (2013). Conflation of cocaine seeking and cocaine taking responses in IV self-administration experiments in rats: methodological and interpretational considerations. Neurosci. Biobehav. Rev. 37, 2026–2036. doi: 10.1016/j.neubiorev.2013.04.017
81. Robinson, T. E., and Berridge, K. C. (2008). The incentive sensitization theory of addiction: some current issues. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363, 3137–3146. doi: 10.1098/rstb.2008.0093
82. Robinson, E. S. J., Eagle, D. M., Economidou, D., Theobald, D. E. H., Mar, A. C., Murphy, E. R., et al. (2009). Behavioural characterisation of high impulsivity on the 5-choice serial reaction time task: specific deficits in ‘wait-ing’versus ‘stopping’. Behav. Brain Res. 196, 310–316. doi: 10.1016/j.bbr.2008.09.021
83. Sabol, K. E., Richards, J. B., Layton, K., and Seiden, L. S. (1995). Amphetamine analogs have differential effects on DRL 36-s schedule performance. Psychophar-macology (Berl) 121, 57–65. doi: 10.1007/bf02245591
84. Salamone, J. D., Correa, M., Farrar, A. M., Nunes, E. J., and Pardo, M. (2009). Dopamine, behavioral economics and effort. Front. Behav. Neurosci. 3:13. doi: 10.3389/neuro.08.013.2009
85. Salamone, J. D., Steinpreis, R. E., McCullough, L. D., Smith, P., Grebel, D., and Mahan, K. (1991). Haloperidol and nucleus accumbens dopamine depletion suppress lever pressing for food but increase free food consumption in a novel food choice procedure. Psychopharmacology (Berl) 104, 515–521. doi: 10.1007/bf02245659
86. Salamone, J. D., Wisniecki, A., Carlson, B. B., and Correa, M. (2001). Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience 105, 863–870. doi: 10.1016/s0306-4522(01)00249-4
87. Sanger, D., Key, M., and Blackman, D. (1974). Differential effects of chlor-diazepoxide and d-amphetamine on responding maintained by a DRL schedule of reinforcement. Psychopharmacologia 38, 159–171. doi: 10.1007/bf00426110
88. Scarnà, A., McTavish, S. F. B., Cowen, P. J., Goodwin, G. M., and Rogers, R. D. (2005). The effects of a branched chain amino acid mixture supplemented with tryptophan on biochemical indices of neurotransmitter function and decision-making. Psychopharmacology (Berl) 179, 761–768. doi: 10.1007/s00213-004-2105-2
89. Seiden, L. S., Andresen, J., and Mac Phail, R. C. (1979). Methylphenidate and d-amphetamine: effects and interactions with alphamethyltyrosine and tetra-benazine on DRL performance in rats. Pharmacol. Biochem. Behav. 10, 577–584. doi: 10.1016/0091-3057(79)90236-3
90. Sevy, S., Hassoun, Y., Bechara, A., Yechiam, E., Napolitano, B., Burdick, K., et al. (2006). Emotion-based decision-making in healthy subjects: short-term effects of reducing dopamine levels. Psychopharmacology (Berl) 188, 228–235. doi: 10.1007/s00213-006-0450-z
91. Simon, N. W., Gilbert, R. J., Mayse, J. D., Bizon, J. L., and Setlow, B. (2009). Balancing risk and reward: a rat model of risky decision making. Neuropsy-chopharmacology 34, 2208–2217. doi: 10.1038/npp.2009.48
92. Simon, N. W., Montgomery, K. S., Beas, B. S., Mitchell, M. R., LaSarge, C. L., Mendez, I. A., et al. (2011). Dopaminergic modulation of risky decision-making. J. Neurosci. 31, 17460–17470. doi: 10.1523/JNEUROSCI.3772-11.2011
93. Smith, A. D., Smith, D. L., Zigmond, M. J., Amalric, M., and Koob, G. F. (2000). Differential effects of dopamine receptor subtype blockade on performance of rats in a reaction-time paradigm. Psychopharmacology (Berl) 148, 355–360. doi: 10.1007/s002130050063
94. Solanto, M. V., Abikoff, H., Sonuga-Barke, E., Schachar, R., Logan, G. D., Wigal, T., et al. (2001). The ecological validity of delay aversion and response inhibition as measures of impulsivity in AD/HD: a supplement to the NIMH multimodal treatment study of AD/HD. J. Abnorm. Child Psychol. 29, 215–228. doi: 10.1023/A:1010329714819
95. St Onge, J. R. S., Chiu, Y. C., and Floresco, S. B. (2010). Differential effects of dopaminergic manipulations on risky choice. Psychopharmacology (Berl) 211, 209–221. doi: 10.1007/s00213-010-1883-y
96. St Onge, J. R., and Floresco, S. B. (2009). Dopaminergic modulation of risk-based decision making. Neuropsychopharmacology 34, 681–697. doi: 10.1038/npp.2008.121
97. Symmonds, M., Wright, N.D., Fagan, E., and Dolan, R. J.(2013). Assaying the effect of Levodopa on the evaluation of risk in healthy humans. PLoS One 8:e68177. doi: 10.1371/journal.pone.0068177
98. Tai, L.-H., Lee, A. M., Benavidez, N., Bonci, A., and Wilbrecht, L. (2012). Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value. Nat. Neurosci. 15, 1281–1289. doi: 10.1038/nn.3188
99. Tanno, T., Maguire, D. R., Henson, C., and France, C. P. (2014). Effects of amphetamine and methylphenidate on delay discounting in rats: interactions with order of delay presentation. Psychopharmacology (Berl) 231, 85–95. doi: 10.1007/s00213-013-3209-3
100. Tannock, R., Schachar, R. J., Carr, R. P., Chajczyk, D., and Logan, G. D. (1989). Effects of methylphenidate on inhibitory control in hyperactive children. J. Abnorm. Child Psychol. 17, 473-491. doi: 10.1007/bf00916508
101. Tremblay, A. M., Desmond, R. C, Poulos, C. X., and Zack, M. (2011). Haloperi-dol modifies instrumental aspects of slot machine gambling in pathological gamblers and healthy controls. Addict. Biol. 16, 467-484. doi: 10.1111/j.1369-1600.2010.00208.x
102. Trifilieff, P., and Martinez, D. (2014). Imaging addiction: D2 receptors and dopamine signaling in the striatum as biomarkers for impulsivity. Neuropharmacology 76, 498-509. doi: 10.1016/j.neuropharm.2013.06.031
103. van Enkhuizen, J., Geyer, M. A., and Young, J. W. (2013). Differential effects of dopamine transporter inhibitors in the rodent Iowa gambling task. Psychophar-macology (Berl) 225, 661-674. doi: 10.1007/s00213-012-2854-2
104. van Gaalen, M. M., Brueggeman, R. J., Bronius, P. F., Schoffelmeer, A. N., and Vanderschuren, L. J. (2006b). Behavioral disinhibition requires dopamine receptor activation. Psychopharmacology (Berl) 187, 73-85. doi: 10.1007/s00213-006-0396-1
105. van Gaalen, M. M., Unger, L., Jongen-Rêlo, A.-L., Schoemaker, H., and Gross, G. (2009). Amphetamine decreases behavioral inhibition by stimulation of dopamine D2, but not D3, receptors. Behav. Pharmacol. 20, 484-491. doi: 10.1097/FBP.0b013e3283305e3b
106. van Gaalen, M. M., van Koten, R., Schoffelmeer, A. N., and Vanderschuren, L. J. (2006a). Critical involvement of dopaminergic neurotransmission in impulsive decision making. Biol. Psychiatry 60, 66-73. doi: 10.1016/j.biopsych.2005.06.005
107. van Hest, A., van Drimmelen, M., and Olivier, B. (1992). Flesinoxan shows antidepressant activity in a DRL 72-s screen. Psychopharmacology (Berl) 107, 474-479. doi: 10.1007/bf02245258
108. Venugopalan, V. V., Casey, K. F., O’Hara, C, O’Loughlin, J., Benkelfat, C, Fellows, L. K., et al. (2011). Acute phenylalanine/tyrosine depletion reduces motivation to smoke cigarettes across stages of addiction. Neuropsychopharmacology 36, 2469-2476. doi: 10.1038/npp.2011.135
109. Wade, T. R., deWit, H., and Richards, J. B. (2000). Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology (Berl) 150, 90-101. doi: 10.1007/s002130000402
110. Wang, Q., Simpao, A., Sun, L., Falk, J., and Lau, C. (2001). Contribution of the active metabolite, norcocaine, to cocaine’s effects after intravenous and oral administration in rats: pharmacodynamics. Psychopharmacology (Berl) 153, 341-352. doi: 10.1007/s002130000568
111. Wardle, M. C, Treadway, M. T., Mayo, L. M., Zald, D. H., and de Wit, H. (2011). Amping up effort: effects of d-amphetamine on human effort-based decisionmaking. J. Neurosci. 31, 16597-16602. doi: 10.1523/JNEUROSCI.4387-11.2011
112. Waters, K. A., Burnham, K. E., O’connor, D., Dawson, G. R., and Dias, R. (2005). Assessment of modafinil on attentional processes in a five-choice serial reaction time test in the rat. J. Psychopharmacol. 19, 149-158. doi: 10.1177/0269881105048995
113. Wenger, G. R., and Wright, D. W. (1990). Behavioral effects of cocaine and its interaction with d-amphetamine and morphine in rats. Pharmacol. Biochem. Behav. 35, 595-600. doi: 10.1016/0091-3057(90)90296-t
114. Wiley, J. L., Compton, A. D., and Golden, K. M. (2000). Separation of drug effects on timing and behavioral inhibition by increased stimulus control. Exp. Clin. Psychopharmacol. 8, 451-461. doi: 10.1037/1064-1297.8.4.451
115. Winstanley, C. A. (2011). The utility of rat models of impulsivity in developing pharmacotherapies for impulse control disorders. Br. J. Pharmacol. 164, 1301-1321. doi: 10.1111/j.1476-5381.2011.01323.x
116. Winstanley, C. A., Dalley, J. W., Theobald, D. E. H., and Robbins, T. W (2003). Global 5-HT depletion attenuates the ability of amphetamine to decrease impulsive choice on a delay-discounting task in rats. Psychopharmacology (Berl) 170, 320-331. doi: 10.1007/s00213-003-1546-3
117. Winstanley, C. A., Eagle, D. M., and Robbins, T. W. (2006). Behavioral models of impulsivity in relation to ADHD: translation between clinical and preclinical studies. Clin. Psychol. Rev. 26, 379-395. doi: 10.1016/j.cpr.2006.01.001
118. Winstanley, C. A., LaPlant, Q., Theobald, D. E. H., Green, T. A., Bachtell, R. K., Perrotti, L. I., et al. (2007). AFosB induction in orbitofrontal cortex mediates tolerance to cocaine-induced cognitive dysfunction. J. Neurosci. 27, 10497-10507. doi: 10.1523/jneurosci.2566-07.2007
119. Woolverton, W., Kandel, D., and Schuster, C. R. (1978). Effects of repeated administration of cocaine on schedule-controlled behavior of rats. Pharmacol. Biochem. Behav. 9, 327–337. doi: 10.1016/0091-3057(78)90293-9
120. Zack, M., and Poulos, C. X. (2007). A D2 antagonist enhances the rewarding and priming effects of a gambling episode in pathological gamblers. Neuropsy-chopharmacology 32, 1678–1686. doi: 10.1038/sj.npp.1301295
121. Zeeb, F. D., Robbins, T. W., and Winstanley, C. A. (2009). Serotonergic and dopaminergic modulation of gambling behavior as assessed using a novel rat gambling task. Neuropsychopharmacology 34, 2329–2343. doi: 10.1038/npp.2009.62