The role of dopamine in risk taking: A specific look at Parkinson's disease and gambling

Frontiers in Behavioral Neuroscience

Volumn 8, Issue MAY, 2014, Pages

  Clark, Crystal A ^a   Dagher, Alain ^a  

^a MCGILL UNIVERSITY   (Canada)

Author keywords

Impulse control disorders; Impulsivity; Insula; Loss aversion; Reward; Ventral striatum

Indexed keywords

DOPAMINE; DOPAMINE RECEPTOR STIMULATING AGENT;

ADDICTION; AVERSION; BRAIN FUNCTION; CORPUS STRIATUM; DECISION MAKING; DISEASE ASSOCIATION; DRUG WITHDRAWAL; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HIGH RISK BEHAVIOR; HUMAN; IMAGE ANALYSIS; IMAGE PROCESSING; IMAGE QUALITY; IMPULSE CONTROL DISORDER; INSULA; NEUROIMAGING; NEUROTRANSMITTER UPTAKE; NONHUMAN; PARKINSON DISEASE; PATHOLOGICAL GAMBLING; PROTEIN FUNCTION; REINFORCEMENT; REVIEW; REWARD; RISK ASSESSMENT;

EID: 84901820646     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2014.00196     Document Type: Review

References (161)

1. Abler, B., Walter, H., Erk, S., Kammerer, H., and Spitzer, M. (2006). Prediction error as a linear function of reward probability is coded in human nucleus accumbens. Neuroimage31, 790-795. doi: 10.1016/j.neuroimage.2006.01.001
2. Albin, R. L., Young, A. B., and Penney, J. B. (1989). The functional anatomy of basal ganglia disorders. Trends Neurosci.12, 366-375. doi: 10.1016/0166-2236(89)90074-x
3. Alexander, G. E., and Crutcher, M. D. (1990). Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trends Neurosci.13, 266-271. doi: 10.1016/0166-2236(90)90107-l
4. Ambermoon, P., Carter, A., Hall, W. D., Dissanayaka, N. N., and O'Sullivan, J. D. (2011). Impulse control disorders in patients with Parkinson's disease receiving dopamine replacement therapy: evidence and implications for the addictions field. Addiction106, 283-293. doi: 10.1111/j.1360-0443.2010.03218.x
5. American Psychiatric Association. (2000). Diagnostic and Statistical Manual of Mental Disorders.4th Edn., Text Revision, Washington, DC: APA.
6. Antonini, A., Siri, C., Santangelo, G., Cilia, R., Poletti, M., Canesi, M., et al. (2011). Impulsivity and compulsivity in drug-naive patients with Parkinson's disease. Mov. Disord.26, 464-468. doi: 10.1002/mds.23501
7. Averbeck, B. B., O'Sullivan, S. S., and Djamshidian, A. (2014). Impulsive and compulsive behaviors in Parkinson's disease. Annu. Rev. Clin. Psychol.10, 553-580. doi: 10.1146/annurev-clinpsy-032813-153705
8. Bartra, O., McGuire, J. T., and Kable, J. W. (2013). The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. Neuroimage76, 412-427. doi: 10.1016/j.neuroimage.2013.02.063
9. Bergh, C., Eklund, T., Sodersten, P., and Nordin, C. (1997). Altered dopamine function in pathological gambling. Psychol. Med.27, 473-475. doi: 10.1017/s0033291796003789
10. Boileau, I., Dagher, A., Leyton, M., Gunn, R. N., Baker, G. B., Diksic, M., et al. (2006). Modeling sensitization to stimulants in humans: an [11C]raclopride/positron emission tomography study in healthy men. Arch. Gen. Psychiatry63, 1386-1395. doi: 10.1001/archpsyc.63.12.1386
11. Brand, M., Labudda, K., Kalbe, E., Hilker, R., Emmans, D., Fuchs, G., et al. (2004). Decision-making impairments in patients with Parkinson's disease. Behav. Neurol.15, 77-85. doi: 10.1155/2004/578354
12. Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., and Shizgal, P. (2001). Functional imaging of neural responses to expectancy and experience of monetary gains and loses. Neuron30, 619-639. doi: 10.1016/s0896-6273(01)00303-8
13. Buckholtz, J. W., Treadway, M. T., Cowan, R. L., Woodward, N. D., Li, R., Ansari, M. S., et al. (2010). Dopaminergic network differences in human impulsivity. Science329:532. doi: 10.1126/science.1185778
14. Calabresi, P., Picconi, B., Tozzi, A., and Di Filippo, M. (2007). Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends Neurosci.30, 211-219. doi: 10.1016/j.tins.2007.03.001
15. Callesen, M. B., Scheel-Kruger, J., Kringelbach, M. L., and Moller, A. (2013). A systematic review of impulse control disorders in Parkinson's disease.J. Parkinsons Dis.3, 105-138. doi: 10.3233/JPD-120165
16. Campbell-Meiklejohn, D., Wakeley, J., Herbert, V., Cook, J., Scollo, P., Ray, M. K., et al. (2011). Serotonin and dopamine play complementary roles in gambling to recover losses. Neuropsychopharmacology36, 402-410. doi: 10.1038/npp.2010.170
17. Campbell-Meiklejohn, D. K., Woolrich, M. W., Passingham, R. E., and Rogers, R. D. (2008). Knowing when to stop: the brain mechanisms of chasing losses. Biol. Psychiatry63, 293-300. doi: 10.1016/j.biopsych.2007.05.014
18. Canessa, N., Crespi, C., Motterlini, M., Baud-Bovy, G., Chierchia, G., Pantaleo, G., et al. (2013). The functional and structural neural basis of individual differences in loss aversion.J. Neurosci.33, 14307-14317. doi: 10.1523/jneurosci.0497-13.2013
19. Castellani, B., and Rugle, L. (1995). A comparison of pathological gamblers to alcoholics and cocaine misusers on impulsivity, sensation seeking and craving. Int. J. Addict.30, 275-289. doi: 10.3109/10826089509048726
20. Cavedini, P., Riboldi, G., Keller, R., D'Annucci, A., and Bellodi, L. (2002). Frontal lobe dysfunction in pathological gambling patients. Biol. Psychiatry51, 334-341. doi: 10.1016/s0006-3223(01)01227-6
21. Chang, L. J., and Sanfey, A. G. (2009). Unforgettable ultimatums? Expectation violations promote enhanced social memory following economic bargaining. Front. Behav. Neurosci.3:36. doi: 10.3389/neuro.08.036.2009
22. Chikama, M., McFarland, N. R., Amaral, D. G., and Haber, S. N. (1997). Insular cortical projections to functional regions of the striatum correlate with cortical cytoarchitectonic organization in the primate.J. Neurosci.17, 9686-9705.
23. Christopoulos, G. I., Tobler, P. N., Bossaerts, P., Dolan, R. J., and Schultz, W. (2009). Neural correlates of value, risk, and risk aversion contributing to decision making under risk.J. Neurosci.29, 12574-12583. doi: 10.1523/JNEUROSCI.2614-09.2009
24. Cilia, R., Ko, J. H., Cho, S. S., van Eimeren, T., Marotta, G., Pellecchia, G., et al. (2010). Reduced dopamine transporter density in the ventral striatum of patients with Parkinson's disease and pathological gambling. Neurobiol. Dis.39, 98-104. doi: 10.1016/j.nbd.2010.03.013
25. Cilia, R., Siri, C., Marotta, G., Isaias, I. U., De Gaspari, D., Canesi, M., et al. (2008). Functional abnormalities underlying pathological gambling in parkinson disease. Arch. Neurol.65, 1604-1611. doi: 10.1001/archneur.65.12.1604
26. Clark, L., Bechara, A., Damasio, H., Aitken, M. R., Sahakian, B. J., and Robbins, T. W. (2008). Differential effects of insular and ventromedial prefrontal cortex lesions on risky decision-making. Brain131, 1311-1322. doi: 10.1093/brain/awn066
27. Cohen, M. X., and Frank, M. J. (2009). Neurocomputational models of basal ganglia function in learning, memory and choice. Behav. Brain Res.199, 141-156. doi: 10.1016/j.bbr.2008.09.029
28. Collins, G. T., and Woods, J. H. (2009). Influence of conditioned reinforcement on the response-maintaining effects of quinpirole in rats. Behav. Pharmacol.20, 492-504. doi: 10.1097/fbp.0b013e328330ad9b
29. Cools, R., Lewis, S. J. G., Clark, L., Barker, R. A., and Robbins, T. W. (2007). L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease. Neuropsychopharmacology32, 180-189. doi: 10.1038/sj.npp.1301153
30. Craig, A. D. (2002). How do you feel? Interoception: the sense of the physiological condition of the body. Nat. Rev. Neurosci.3, 655-666. doi: 10.1038/nrn894
31. Critchley, H. D., Mathias, C. J., and Dolan, R. J. (2001). Neural activity in the human brain relating to uncertainty and arousal during anticipation. Neuron29, 537-545. doi: 10.1016/s1053-8119(01)91735-5
32. Crockford, D. N., Goodyear, B., Edwards, J., Quickfall, J., and el-Guebaly, N. (2005). Cue-Induced brain activity in pathological gamblers. Biol. Psychiatry58, 787-795. doi: 10.1016/j.biopsych.2005.04.037
33. D'Ardenne, K., McClure, S. M., Nystrom, L. E., and Cohen, J. D. (2008). BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science319, 1264-1267. doi: 10.1126/science.1150605
34. Dagher, A., and Robbins, T. W. (2009). Personality, addiction, dopamine: insights from Parkinson's disease. Neuron61, 502-510. doi: 10.1016/j.neuron.2009.01.031
35. Davie, M. (2007). Pathological gambling associated with cabergoline therapy in a patient with a pituitary prolactinoma.J. Neuropsychiatry Clin. Neurosci.19, 473-474. doi: 10.1176/appi.neuropsych.19.4.473
36. De Martino, B., Camerer, C. F., and Adolphs, R. (2010). Amygdala damage eliminates monetary loss aversion. Proc. Natl. Acad. Sci. U S A107, 3788-3792. doi: 10.1073/pnas.0910230107
37. Di Chiara, G., and Imperato, A. (1988). Drugs abused by humans preferentially increase synaptic dopamine concentrations in the mesolimbic system of freely moving rats. Proc. Natl. Acad. Sci. U S A85, 5274-5278. doi: 10.1073/pnas.85.14.5274
38. Djamshidian, A., Jha, A., O'Sullivan, S. S., Silveira-Moriyama, L., Jacobson, C., Brown, P., et al. (2010). Risk and learning in impulsive and nonimpulsive patients with Parkinson's disease. Mov. Disord.25, 2203-2210. doi: 10.1002/mds.23247
39. Dodd, M. L., Klos, K. J., Bower, J. H., Geda, Y. E., Josephs, K. A., and Ahlskog, J. E. (2005). Pathological gambling caused by drugs used to treat Parkinson disease. Arch. Neurol.62, 1377-1381. doi: 10.1001/archneur.62.9.noc50009
40. Driver-Dunckley, E. D., Noble, B. N., Hentz, J. G., Evidente, V. G., Caviness, J. N., Parish, J., et al. (2007). Gambling and increased sexual desire with dopaminergic medications in restless legs syndrome. Clin. Neuropharmacol.30, 249-255. doi: 10.1097/wnf.0b013e31804c780e
41. Duncan, J., and Owen, A. M. (2000). Common regions of the human frontal lobe recruited by diverse cognitive demands. Trends Neurosci.23, 475-483. doi: 10.1016/s0166-2236(00)01633-7
42. Duvarci, I., and Varan, A. (2000). Descriptive features of Turkish pathological gamblers. Scand. J. Psychol.41, 253-260. doi: 10.1111/1467-9450.00195
43. Eckert, M. A., Menon, V., Walczak, A., Ahlstrom, J., Denslow, S., Horwitz, A., et al. (2009). At the heart of the ventral attention system: the right anterior insula. Hum. Brain Mapp.30, 2530-2541. doi: 10.1002/hbm.20688
44. Elliott, R., Friston, K. J., and Dolan, R. J. (2000). Dissociable neural responses in human reward systems.J. Neurosci.20, 6159-6165.
45. Evans, A. H., Pavese, N., Lawrence, A. D., Tai, Y. F., Appel, S., Doder, M., et al. (2006). Compulsive drug use linked to senstized ventral striatal dopamine transmission. Ann. Neurol.59, 852-858. doi: 10.1002/ana.20822
46. Falhammar, H., and Yarker, J. Y. (2009). Pathological gambling and hypersexuality in cabergoline-treated prolactinoma. Med. J. Aust.190, 97.
47. Frank, M. J., and O'Reilly, R. C. (2006). A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidol. Behav. Neurosci.120, 497-517. doi: 10.1037/0735-7044.120.3.497.supp
48. Frank, M. J., Samanta, J., Moustafa, A. A., and Sherman, S. J. (2007). Hold your horses: impulsivity, deep brain stimulation and medication in parkinsonism. Science318, 1309-1312. doi: 10.1126/science.1146157
49. Frank, M. J., Seeberger, L. C., and O'Reilly, R. C. (2004). By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science306, 1940-1943. doi: 10.1126/science.1102941
50. Frank, M. J. (2005). Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism.J. Cogn. Neurosci.17, 51-72. doi: 10.1162/0898929052880093
51. Frosini, D., Pesaresi, I., Cosottini, M., Belmonte, G., Rossi, C., Dell'Osso, L., et al. (2010). Parkinson's disease and pathological gambling: results from a functional MRI study. Mov. Disord.25, 2449-2453. doi: 10.1002/mds.23369
52. Gerdeman, G. L., Ronesi, J., and Lovinger, D. M. (2002). Postsynaptic endocannabinoid release is critical to long-term depression in the striatum. Nat. Neurosci.5, 446-451. doi: 10.1038/nn832
53. Giovannoni, G., O'Sullivan, J. D., Turner, K., Manson, A. J., and Lees, A. J. (2000). Hedonistic homeostatic dysregulation in patients with Parkinson's disease on dopamine replacement therapies.J. Neurol. Neurosurg. Psychiatry68, 423-428. doi: 10.1136/jnnp.68.4.423
54. Goodman, A. (2008). Neurobiology of addiction: an integrative review. Biochem. Pharmacol.75, 266-322. doi: 10.1016/j.bcp.2007.07.030
55. Gotham, A. M., Brown, R. G., and Marsden, C. D. (1988). 'Frontal' cognitive function in patients with Parkinson's disease 'on' and 'off' levodopa. Brain111(Pt. 2), 299-321. doi: 10.1093/brain/111.2.299
56. Goudriaan, A. E., Oosterlaan, J., de Beurs, E., and van den Brink, W. (2005). Decision making in pathological gambling: a comparison between pathological gamblers, alcohol dependents, persons with Tourette syndrome and normal controls. Brain Res. Cogn. Brain Res.23, 137-151. doi: 10.1016/j.cogbrainres.2005.01.017
57. Grace, A. A. (2000). The tonic/phasic model of dopamine system regulation and its implications for understanding alcohol and psychostimulant craving. Addiction95, 119-128. doi: 10.1046/j.1360-0443.95.8s2.1.x
58. Grant, J. E., Brewer, J. A., and Potenza, M. N. (2006). The neurobiology of substance and behavioural addictions. CNS Spectr.11, 924-930.
59. Gschwandtner, U., Aston, J., Renaud, S., and Fuhr, P. (2001). Pathologic gambling in patients with Parkinson's disease. Clin. Neuropharmacol.24, 170-172. doi: 10.1097/00002826-200105000-00009
60. Hakyemez, H. S., Dagher, A., Smith, S. D., and Zald, D. H. (2008). Striatal dopamine transmission in healthy humans during a passive monetary reward task. Neuroimage39, 2058-2065. doi: 10.1016/j.neuroimage.2007.10.034
61. Hernandez-Lopez, S., Tkatch, T., Perez-Garci, E., Galarraga, E., Bargas, J., Hamm, H., et al. (2000). D2 dopamine receptors in striatal medium spiny neurons reduce L-type Ca2+ currents and excitability via a novel PLC[beta]1-IP3-calcineurin-signaling cascade.J. Neurosci.20, 8987-9895.
62. Holman, A. (2009). Impulse control disorder behaviors associated with pramipexole used to treat fibromyalgia.J. Gambl. Stud.25, 425-431. doi: 10.1007/s10899-009-9123-2
63. Huettel, S. A., Stowe, C. J., Gordon, E. M., Warner, B. T., and Platt, M. L. (2006). Neural signatures of economic preferences for risk and ambiguity. Neuron49, 765-775. doi: 10.1016/j.neuron.2006.01.024
64. Kable, J. W., and Glimcher, P. W. (2007). The neural correlates of subjective value during intertemporal choice. Nat. Neurosci.10, 1625-1633. doi: 10.1038/nn2007
65. Kahneman, D., and Tversky, A. (1979). Prospect theory: an analysis of decision under risk. Econometrica47, 263-291. doi: 10.2307/1914185
66. Kahnt, T., Park, S. Q., Cohen, M. X., Beck, A., Heinz, A., and Wrase, J. (2009). Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions.J. Cogn. Neurosci.21, 1332-1345. doi: 10.1162/jocn.2009.21092
67. Kish, S. J., Shannak, K., and Hornykiewicz, O. (1988). Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson's disease. Pathophysiologic and clinical implications.N. Engl. J. Med.318, 876-880. doi: 10.1056/nejm198804073181402
68. Knutson, B., Adams, C. M., Fong, G. W., and Hommer, D. (2001a). Anticipation of increasing monetary reward selectively recruits nucleus accumbens.J. Neurosci.21:RC159.
69. Knutson, B., and Greer, S. M. (2008). Anticipatory affect: neural correlates and consequences for choice. Philos. Trans. R. Soc. Lond B Biol. Sci.363, 3771-3786. doi: 10.1098/rstb.2008.0155
70. Knutson, B., Delgado, M. R., and Phillips, P. E. M. (2008). "Representation of subjective value in the striatum, " inNeuroeconomics: Decision Making and the Brain, eds C. Camerer, P. W. Glimcher, E. Fehr and R. A. Poldrack (New York: Academic Press), 398-406.
71. Knutson, B., Fong, G. W., Adams, C. M., Varner, J. L., and Hommer, D. (2001b). Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport12, 3683-3687. doi: 10.1097/00001756-200112040-00016
72. Knutson, B., Taylor, J., Kaufman, M., Peterson, R., and Glover, G. (2005). Distributed neural representation of expected value.J. Neurosci.25, 4806-4812. doi: 10.1523/JNEUROSCI.0642-05.2005
73. Knutson, B., Westdorp, A., Kaiser, E., and Hommer, D. (2000). FMRI visualization of brain activity during a monetary incentive delay task. Neuroimage12, 20-27. doi: 10.1006/nimg.2000.0593
74. Ko, C. H., Liu, G. C., Hsiao, S., Yen, J. Y., Yang, M. J., Lin, W. C., et al. (2009). Brain activities associated with gaming urge of online gaming addiction.J. Psychiatr. Res.43, 739-747. doi: 10.1016/j.jpsychires.2008.09.012
75. Kreitzer, A. C., and Malenka, R. C. (2007). Endocannabinoid-mediated rescue of striatal LTD and motor deficits in Parkinson's disease models. Nature445, 643-647. doi: 10.1038/nature05506
76. Kuhnen, C. M., and Knutson, B. (2005). The neural basis of financial risk taking. Neuron47, 763-770. doi: 10.1016/j.neuron.2005.08.008
77. Labudda, K., Brand, M., Mertens, M., Ollech, I., Markowitsch, H. J., and Woermann, F. G. (2010). Decision making under risk condition in patients with Parkinson's disease: a behavioural and fMRI study. Behav. Neurol.23, 131-143. doi: 10.1155/2010/743141
78. Lawrence, A. D., Brooks, D. J., and Whone, A. L. (2013). Ventral striatal dopamine synthesis capacity predicts financial extravagance in Parkinson's disease. Front. Psychol.4:90. doi: 10.3389/fpsyg.2013.00090
79. Lawrence, A. D., Evans, A. H., and Lees, A. J. (2003). Compulsive use of dopamine replacement therapy in parkinson's disease: reward systems gone awry?Lancet Neurol.2, 595-604. doi: 10.1016/S1474-4422(03)00529-5
80. Lee, J. Y., Seo, S. H., Kim, Y. K., Yoo, H. B., Kim, Y. E., Song, I. C., et al. (2014). Extrastriatal dopaminergic changes in Parkinson's disease patients with impulse control disorders.J. Neurol. Neurosurg. Psychiatry85, 23-30. doi: 10.1136/jnnp-2013-305549
81. Litt, A., Plassmann, H., Shiv, B., and Rangel, A. (2011). Dissociating valuation and saliency signals during decision-making. Cereb. Cortex21, 95-102. doi: 10.1093/cercor/bhq065
82. Lobo, D. S., and Kennedy, J. L. (2006). The genetics of gambling and behavioural addictions. CNS Spectr.11, 931-939.
83. Loewenstein, G. F., Weber, E. U., Hsee, C. K., and Welch, N. (2001). Risk as feelings. Psychol. Bull.127, 267-286. doi: 10.1037/0033-2909.127.2.267
84. Mamikonyan, E., Siderowf, A. D., Duda, J. E., Potenza, M. N., Horn, S., Stern, M. B., et al. (2008). Long-term follow-up of impulse control disorders in Parkinson's disease. Mov. Disord.23, 75-80. doi: 10.1002/mds.21770
85. Marcellino, D., Kehr, J., Agnati, L. F., and Fuxe, K. (2012). Increased affinity of dopamine for D(2)-like versus D(1)-like receptors. Relevance for volume transmission in interpreting PET findings. Synapse66, 196-203. doi: 10.1002/syn.21501
86. Menza, M. A., Golbe, L. I., Cody, R. A., and Forman, N. E. (1993). Dopamine-related personality traits in parkinson's disease. Neurology43(Pt. 1), 505-508. doi: 10.1212/wnl.43.3_part_1.505
87. Menza, M. A. (2000). The personality associated with parkinson's disease. Curr. Psychiatry Rep.2, 421-426. doi: 10.1007/s11920-000-0027-1
88. Mink, J. W. (1996). The basal ganglia: focused selection and inhibition of competing motor programs. Prog. Neurobiol.50, 381-425. doi: 10.1016/s0301-0082(96)00042-1
89. Molina, J. A., Sainz-Artiga, M. J., Fraile, A., Jimenez-Jimenez, F. J., Villanueva, C., Orti-Pareja, M., et al. (2000). Pathologic gambling in Parkinson's disease: a behavioral manifestation of pharmacologic treatment?Mov. Disord.15, 869-872. doi: 10.1002/1531-8257(200009)15:5<869::aid-mds1016>3.0.co;2-i
90. Montague, P. R., and Berns, G. S. (2002). Neural economics and the biological substrates of valuation. Neuron36, 265-284. doi: 10.1016/s0896-6273(02)00974-1
91. Niv, Y., Daw, N. D., Joel, D., and Dayan, P. (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl)191, 507-520. doi: 10.1007/s00213-006-0502-4
92. O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., and Dolan, R. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science304, 452-454. doi: 10.1126/science.1094285
93. O'Doherty, J. P., Hampton, A., and Kim, H. (2007). Model-Based fMRI and its application to reward learning and decision making. Ann. N Y Acad. Sci.1104, 35-53. doi: 10.1196/annals.1390.022
94. O'Sullivan, S. S., Wu, K., Politis, M., Lawrence, A. D., Evans, A. H., Bose, S. K., et al. (2011). Cue-induced striatal dopamine release in Parkinson's disease-associated impulsive-compulsive behaviours. Brain134(Pt. 4), 969-978. doi: 10.1093/brain/awr003
95. Ochoa, C., Alvarez-Moya, E. M., Penelo, E., Aymami, M. N., Gomez-Pena, M., Fernandez-Aranda, F., et al. (2013). Decision-making deficits in pathological gambling: the role of executive functions, explicit knowledge and impulsivity in relation to decisions made under ambiguity and risk. Am. J. Addict.22, 492-499. doi: 10.1111/j.1521-0391.2013.12061.x
96. Packard, M. G., and Knowlton, B. J. (2002). Learning and memory functions of the Basal Ganglia. Annu. Rev. Neurosci.25, 563-593. doi: 10.1146/annurev.neuro.25.112701.142937
97. Paulus, M. P., Rogalsky, C., Simmons, A., Feinstein, J. S., and Stein, M. B. (2003). Increased activation in the right insula during risk-taking decision making is related to harm avoidance and neuroticism. Neuroimage19, 1439-1448. doi: 10.1016/s1053-8119(03)00251-9
98. Petry, N. M., Stinson, F. S., and Grant, B. F. (2005). Comorbidity of DSM-IV pathological gambling and other psychiatric disorders: results from the National epidemiologic survey on alcohol and related conditions.J. Clin. Psychiatry66, 564-574. doi: 10.4088/jcp.v66n0504
99. Petry, N. M. (2001a). Pathological gamblers, with and without substance use disorders, discount delayed rewards at high rates.J. Abnorm. Psychol.110, 482-487. doi: 10.1037//0021-843x.110.3.482
100. Petry, N. M. (2001b). Substance abuse, pathological gambling and impulsiveness. Drug Alcohol Depend.63, 29-38. doi: 10.1016/s0376-8716(00)00188-5
101. Pizzagalli, D., Evins, A., Schetter Erika, C., Frank, M. J., Pajtas, P., Santesso, D., et al. (2008). Single dose of a dopamine agonist impairs reinforcement learning in humans: behavioral evidence from a laboratory-based measure of reward responsiveness. Psychopharmacology (Berl)196, 221-232. doi: 10.1007/s00213-007-0957-y
102. Plassmann, H., O'Doherty, J., and Rangel, A. (2007). Orbitofrontal cortex encodes willingness to pay in everyday economic transactions.J. Neurosci.27, 9984-9988. doi: 10.1523/jneurosci.2131-07.2007
103. Politis, M., Loane, C., Wu, K., O'Sullivan, S. S., Woodhead, Z., Kiferle, L., et al. (2013). Neural response to visual sexual cues in dopamine treatment-linked hypersexuality in Parkinson's disease. Brain136(Pt. 2), 400-411. doi: 10.1093/brain/aws326
104. Pontone, G., Williams, J. R., Bassett, S. S., and Marsh, L. (2006). Clinical features associated with impulse control disorders in Parkinson disease. Neurology67, 1258-1261. doi: 10.1212/01.wnl.0000238401.76928.45
105. Potenza, M. N., Steinberg, M. A., Skudlarski, P., Fulbright, R. K., Lacadie, C. M., Wilber, M. K., et al. (2003). Gambling urges in pathological gambling: a functional magnetic resonance imaging study. Arch. Gen. Psychiatry60, 828-836. doi: 10.1001/archpsyc.60.8.828
106. Preuschoff, K., Quartz, S. R., and Bossaerts, P. (2008). Human insula activation reflects risk prediction errors as well as risk.J. Neurosci.28, 2745-2752. doi: 10.1523/jneurosci.4286-07.2008
107. Pritchard, T. C., Macaluso, D. A., and Eslinger, P. J. (1999). Taste perception in patients with insular cortex lesions. Behav. Neurosci.113, 663-671. doi: 10.1037//0735-7044.113.4.663
108. Quickfall, J., and Suchowersky, O. (2007). Pathological gambling associated with dopamine agonist use in restless legs syndrome. Parkinsonism Relat. Disord.13, 535-536. doi: 10.1016/j.parkreldis.2006.10.001
109. Rao, H., Mamikonyan, E., Detre, J. A., Siderowf, A. D., Stern, M. B., Potenza, M. N., et al. (2010). Decreased ventral striatal activity with impulse control disorders in Parkinson's disease. Mov. Disord.25, 1660-1669. doi: 10.1002/mds.23147
110. Ray, N. J., Miyasaki, J. M., Zurowski, M., Ko, J. H., Cho, S. S., Pellecchia, G., et al. (2012). Extrastriatal dopaminergic abnormalities of DA homeostasis in Parkinson's patients with medication-induced pathological gambling: a [11C] FLB-457 and PET study. Neurobiol. Dis.48, 519-525. doi: 10.1016/j.nbd.2012.06.021
111. Reuter, J., Raedler, T., Rose, M., Hand, I., Glascher, J., and Buchel, C. (2005). Pathological gambling is linked to reduced activation of the mesolimbic reward system. Nat. Neurosci.8, 147-148. doi: 10.1038/nn1378
112. Reynolds, J. N., Hyland, B. I., and Wickens, J. R. (2001). A cellular mechanism of reward-related learning. Nature413, 67-70. doi: 10.1038/35092560
113. Riba, J., Krämer, U. M., Heldmann, M., Richter, S., and Münte, T. F. (2008). Dopamine agonist increases risk taking but blunts reward-related brain activity. PLoS One3:e2479. doi: 10.1371/journal.pone.0002479
114. Rogers, R. D., Lancaster, M., Wakeley, J., and Bhagwagar, Z. (2004). Effects of beta-adrenoceptor blockade on components of human decision-making. Psychopharmacology (Berl)172, 157-164. doi: 10.1007/s00213-003-1641-5
115. Rolls, E. T., Mccabe, C., and Redoute, J. (2008). Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cereb. Cortex18, 652-663. doi: 10.1093/cercor/bhm097
116. Roy, A., Adinoff, B., Roehrich, L., Lamparski, D., Custer, R., Lorenz, V., et al. (1988). Pathological gambling. A psychobiological study. Arch. Gen. Psychiatry45, 369-373. doi: 10.1001/archpsyc.1988.01800280085011
117. Rutledge, R. B., Dean, M., Caplin, A., and Glimcher, P. W. (2010). Testing the reward prediction error hypothesis with an axiomatic model.J. Neurosci.30, 13525-13536. doi: 10.1523/jneurosci.1747-10.2010
118. Sanfey, A. G., Rilling, J. K., Aronson, J. A., Nystrom, L. E., and Cohen, J. D. (2003). The neural basis of economic decision-making in the Ultimatum Game. Science300, 1755-1758. doi: 10.1126/science.1082976
119. Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science275, 1593-1599. doi: 10.1126/science.275.5306.1593
120. Schultz, W., Tremblay, L. È., and Hollerman, J. R. (1998). Reward prediction in primate basal ganglia and frontal cortex. Neuropharmacology37, 421-429. doi: 10.1016/s0028-3908(98)00071-9
121. Schultz, W. (2002). Getting formal with dopamine and reward. Neuron36, 241-263. doi: 10.1016/s0896-6273(02)00967-4
122. Seedat, S., Kesler, S., Niehaus, D. J., and Stein, D. J. (2000). Pathological gambling behaviour: emergence secondary to treatment of Parkinson's disease with dopaminergic agents. Depress. Anxiety11, 185-186. doi: 10.1002/1520-6394(2000)11:4<185::aid-da8>3.3.co;2-8
123. Seeley, W. W., Menon, V., Schatzberg, A. F., Keller, J., Glover, G. H., Kenna, H., et al. (2007). Dissociable intrinsic connectivity networks for salience processing and executive control.J. Neurosci.27, 2349-2356. doi: 10.1523/jneurosci.5587-06.2007
124. Shaffer, H. J., Hall, M. N., and Vander Bilt, J. (1999). Estimating the prevalence of disordered gambling behavior in the United States and Canada: a research synthesis. Am. J. Public Health89, 1369-1376. doi: 10.2105/ajph.89.9.1369
125. Shen, W., Flajolet, M., Greengard, P., and Surmeier, D. J. (2008). Dichotomous dopaminergic control of striatal synaptic plasticity. Science321, 848-851. doi: 10.1126/science.1160575
126. Slutske, W. S., Eisen, S., True, W. R., Lyons, M. J., Goldberg, J., and Tsuang, M. (2000). Common genetic vulnerability for pathological gambling and alcohol dependence in men. Arch. Gen. Psychiatry57, 666-673. doi: 10.1001/archpsyc.57.7.666
127. Smeding, H., Goudriaan, A., Foncke, E., Schuurman, P., Speelman, J., and Schmand, B. (2007). Pathological gambling after bilateral STN stimulation in Parkinson disease.J. Neurol. Neurosurg. Psychiatry78, 517-519. doi: 10.1136/jnnp.2006.102061
128. St Onge, J. R., and Floresco, S. B. (2009). Dopaminergic modulation of risk-based decision making. Neuropsychopharmacology34, 681-697. doi: 10.1038/npp.2008.121
129. Steeves, T. D., Miyasaki, J., Zurowski, M., Lang, A. E., Pellecchia, G., Van Eimeren, T., et al. (2009). Increased striatal dopamine release in Parkinsonian patients with pathological gambling: a [11C] raclopride PET study. Brain132, 1376-1385. doi: 10.1093/brain/awp054
130. Surmeier, D. J., Shen, W., Day, M., Gertler, T., Chan, S., Tian, X., et al. (2010). The role of dopamine in modulating the structure and function of striatal circuits. Prog. Brain Res.183, 149-167. doi: 10.1016/s0079-6123(10)83008-0
131. Sutton, R. S., and Barto, A. G. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: The MIT Press.
132. Takahashi, H., Fujie, S., Camerer, C., Arakawa, R., Takano, H., Kodaka, F., et al. (2013). Norepinephrine in the brain is associated with aversion to financial loss. Mol. Psychiatry18, 3-4. doi: 10.1038/mp.2012.7
133. Thut, G., Schultz, W., Roelcke, U., Nienhusmeier, M., Missimer, J., Maguire, R. P., et al. (1997). Activation of the human brain by monetary reward. Neuroreport8, 1225-1228. doi: 10.1097/00001756-199703240-00033
134. Tippmann-Peikert, M., Park, J. G., Boeve, B. F., Shepard, J. W., and Silber, M. H. (2007). Pathologic gambling in patients with restless legs syndrome treated with dopaminergic agonists. Neurology68, 301-303. doi: 10.1212/01.wnl.0000252368.25106.b6
135. Tom, S. M., Fox, C. R., Trepel, C., and Poldrack, R. A. (2007). The neural basis of loss aversion in decision-making under risk. Science315, 515-518. doi: 10.1126/science.1134239
136. Tricomi, E. M., Delgado, M. R., and Fiez, J. A. (2004). Modulation of caudate activity by action contingency. Neuron41, 281-292. doi: 10.1016/s0896-6273(03)00848-1
137. van der Meer, M., Kurth-Nelson, Z., and Redish, A. D. (2012). Information processing in decision-making systems. Neuroscientist18, 342-359. doi: 10.1177/1073858411435128
138. van Eimeren, T., Ballanger, B., Pellecchia, G., Miyasaki, J. M., Lang, A. E., and Strafella, A. P. (2009). Dopamine agonists diminish value sensitivity of the orbitofrontal cortex: a trigger for pathological gambling in Parkinson's disease[quest]. Neuropsychopharmacology34, 2758-2766. doi: 10.1038/sj.npp.npp2009124
139. Vazey, E. M., and Aston-Jones, G. (2012). The emerging role of norepinephrine in cognitive dysfunctions of Parkinson's disease. Front. Behav. Neurosci.6:48. doi: 10.3389/fnbeh.2012.00048
140. Verdejo-Garcia, A., Lawrence, A. J., and Clark, L. (2008). Impulsivity as a vulnerability marker for substance-use disorders: review of findings from high-risk research, problem gamblers and genetic association studies. Neurosci. Biobehav. Rev.32, 777-810. doi: 10.1016/j.neubiorev.2007.11.003
141. Vickery, T. J., Chun, M. M., and Lee, D. (2011). Ubiquity and specificity of reinforcement signals throughout the human brain. Neuron72, 166-177. doi: 10.1016/j.neuron.2011.08.011
142. Vitaro, F., Arseneault, L., and Tremblay, R. E. (1999). Impulsivity predicts problem gambling in low SES adolescent males. Addiction94, 565-575. doi: 10.1046/j.1360-0443.1999.94456511.x
143. Voon, V., Gao, J., Brezing, C., Symmonds, M., Ekanayake, V., Fernandez, H., et al. (2011). Dopamine agonists and risk: impulse control disorders in Parkinson's; disease. Brain134(Pt. 5), 1438-1446. doi: 10.1093/brain/awr080
144. Voon, V., Pessiglione, M., Brezing, C., Gallea, C., Fernandez, H. H., Dolan, R. J., et al. (2010). Mechanisms underlying dopamine-mediated reward bias in compulsive behaviors. Neuron65, 135-142. doi: 10.1016/j.neuron.2009.12.027
145. Voon, V., Potenza, M. N., and Thomsen, T. (2007a). Medication-related impulse control and repetitive behaviors in Parkinson's disease. Curr. Opin. Neurol.20, 484-492. doi: 10.1097/WCO.0b013e32826fbc8f
146. Voon, V., Rizos, A., Chakravartty, R., Mulholland, N., Robinson, S., Howell, N. A., et al. (2014). Impulse control disorders in Parkinson's disease: decreased striatal dopamine transporter levels.J. Neurol. Neurosurg. Psychiatry85, 148-152. doi: 10.1136/jnnp-2013-305395
147. Voon, V., Thomsen, T., Miyasaki, J. M., de Souza, M., Shafro, A., Fox, S. H., et al. (2007b). Factors associated with dopaminergic drug-related pathological gambling in Parkinson disease. Arch. Neurol.64, 212-216. doi: 10.1001/archneur.64.2.212
148. Wager, T. D., Rilling, J. K., Smith, E. E., Sokolik, A., Casey, K. L., Davidson, R. J., et al. (2004). Placebo-induced changes in FMRI in the anticipation and experience of pain. Science303, 1162-1167. doi: 10.1126/science.1093065
149. Weintraub, D., Koester, J., Potenza, M. N., Siderowf, A. D., Stacy, M., Voon, V., et al. (2010). Impulse control disorders in Parkinson disease: a cross-sectional study of 3090 patients. Arch. Neurol.67, 589-595. doi: 10.1001/archneurol.2010.65
150. Weintraub, D., Siderowf, A. D., Potenza, M. N., Goveas, J., Morales, K. H., Duda, J. E., et al. (2006). Association of dopamine agonist use with impulse control disorders in Parkinson disease. Arch. Neurol.63, 969-973. doi: 10.1001/archneur.63.7.969
151. Weller, J. A., Levin, I. P., Shiv, B., and Bechara, A. (2009). The effects of insula damage on decision-making for risky gains and losses. Soc. Neurosci.4, 347-358. doi: 10.1080/17470910902934400
152. Wexler, B. E., Gottschalk, C. H., Fulbright, R. K., Prohovnik, I., Lacadie, C. M., Rounsaville, B. J., et al. (2001). Functional magnetic resonance imaging of cocaine craving. Am. J. Psychiatry158, 86-95. doi: 10.1176/appi.ajp.158.1.86
153. Wise, R. A., and Rompre, P. P. (1989). Brain dopamine and reward. Annu. Rev. Psychol.40, 191-225. doi: 10.1146/annurev.psych.40.1.191
154. Wise, R. A. (1996). Addictive drugs and brain stimulation reward. Annu. Rev. Neurosci.19, 319-340. doi: 10.1146/annurev.neuro.19.1.319
155. Wise, R. A. (2013). Dual roles of dopamine in food and drug seeking: the drive-reward paradox. Biol. Psychiatry73, 819-826. doi: 10.1016/j.biopsych.2012.09.001
156. Wray, I., and Dickerson, M. G. (1981). Cessation of high frequency gambling and withdrawal' symptoms. Br. J. Addict.76, 401-405. doi: 10.1111/j.1360-0443.1981.tb03238.x
157. Yacubian, J., Glascher, J., Schroeder, K., Sommer, T., Braus, D. F., and Buchel, C. (2006). Dissociable systems for gain-and loss-related value predictions and errors of prediction in the human brain.J. Neurosci.26, 9530-9537. doi: 10.1523/JNEUROSCI.2915-06.2006
158. Yarkoni, T., Poldrack, R. A., Nichols, T. E., Van Essen, D. C., and Wager, T. D. (2011). Large-scale automated synthesis of human functional neuroimaging data. Nat. Methods8, 665-670. doi: 10.1038/nmeth.1635
159. Ye, Z., Hammer, A., Camara, E., and Münte, T. F. (2010). Pramipexole modulates the neural network of reward anticipation. Hum. Brain Mapp.32, 800-811. doi: 10.1002/hbm.21067
160. Zald, D. H., Boileau, I., El-Dearedy, W., Gunn, R., McGlone, F., Dichter, G. S., et al. (2004). Dopamine transmission in the human striatum during monetary reward tasks.J. Neurosci.24, 4105-4112. doi: 10.1523/jneurosci.4643-03.2004
161. Zuckerman, M., and Neeb, M. (1979). Sensation seeking and psychopathology. Psychiatry Res.1, 255-264. doi: 10.1016/0165-1781(79)90007-6