Uncertainty about mapping future actions into rewards may underlie performance on multiple measures of impulsivity in behavioral addiction: Evidence from Parkinson's disease

Behavioral Neuroscience

Volumn 127, Issue 2, 2013, Pages 245-255

  Averbeck, Bruno B ^a   Djamshidian, Atbin ^b   O'Sullivan, Sean S ^b   Housden, Charlotte R ^c   Roiser, Jonathan P ^d   Lees, Andrew J ^b  

^a NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^d UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Dopamine; Impulsivity; Markov decision process; Parkinson's disease; Sequential decision making

Indexed keywords

DOPAMINE RECEPTOR STIMULATING AGENT; LEVODOPA;

ADULT; ARTICLE; BINGE EATING DISORDER; CONCEPTUAL FRAMEWORK; CONTROLLED STUDY; DOPAMINE DYSREGULATION SYNDROME; FEMALE; HUMAN; HYPERSEXUALITY; IMPULSE CONTROL DISORDER; IMPULSIVENESS; INFORMATION PROCESSING; MAJOR CLINICAL STUDY; MALE; MOTOR PERFORMANCE; NEUROPSYCHOLOGICAL TEST; PARKINSON DISEASE; REWARD; TASK PERFORMANCE; UNCERTAINTY;

ADULT; AGED; BEHAVIOR, ADDICTIVE; FEMALE; HUMANS; IMPULSIVE BEHAVIOR; MALE; MIDDLE AGED; PARKINSON DISEASE; REWARD; UNCERTAINTY;

EID: 84876062948     PISSN: 07357044     EISSN: 19390084     Source Type: Journal    
DOI: 10.1037/a0032079     Document Type: Article

References (68)

1. Ainslie, G., & Haslam, N. (1992). Hyperbolic discounting. In G. Loewenstein & N. Haslam (Eds.), Choice over time (pp. 57-92). New York, NY: Russell Sage Foundation.
2. American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
3. Averbeck, B. B., Evans, S., Chouhan, V., Bristow, E., & Shergill, S. S. (2011). Probabilistic learning and inference in schizophrenia. Schizophrenia Research, 127, 115-122.
4. ávila, A., Cardona, X., Martin-Baranera, M., Bello, J., & Sastre, F. (2011). Impulsive and compulsive behaviors in Parkinson's disease: A one-year follow-up study. Journal of the Neurological Sciences, 310, 197-201.
5. Barratt, E. S. (1965). Factor analysis of some psychometric measures of impulsiveness and anxiety. Psychological Reports, 16, 547-554.
6. Barratt, E. S., Patton, J., Olsson, N. G., & Zuker, G. (1981). Impulsivity and paced tapping. Journal of Motor Behavior, 13(4), 286-300
7. Beck, J. M., Ma, W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J.,... Pouget, A. (2008). Probabilistic population codes for Bayesian decision making. Neuron, 60, 1142-1152.
8. Cilia, R., Cho, S. S., van Eimeren, T., Marotta, G., Siri, C., Ko, J. H.,... Strafella, A. P. (2011). Pathological gambling in patients with Parkinson's disease is associated with fronto-striatal disconnection: A path modeling analysis. Movement Disorders: Official journal of the Movement Disorder Society, 26, 225-233.
9. Cilia, R., Ko, J. H., Cho, S. S., van Eimeren, T., Marotta, G., Pellecchia, G.,... Strafella, A. P. (2010). Reduced dopamine transporter density in the ventral striatum of patients with Parkinson's disease and pathological gambling. Neurobiology of Disease, 39, 98-104.
10. Clark, L., Robbins, T. W., Ersche, K. D., & Sahakian, B. J. (2006). Reflection impulsivity in current and former substance users. Biological Psychiatry, 60, 515-522.
11. Dalley, J. W., Everitt, B. J., & Robbins, T. W. (2011). Impulsivity, compulsivity, and top-down cognitive control. Neuron, 69, 680-694.
12. Dang, D., Cunnington, D., & Swieca, J. (2011). The emergence of devastating impulse control disorders during dopamine agonist therapy of the restless legs syndrome. Clinical Neuropharmacology, 34, 66-70.
13. Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441, 876-879.
14. DeGroot, M. H. (1970). Optimal statistical decisions. Hoboken, NJ: Wiley.
15. Ditterich, J. (2006). Stochastic models of decisions about motion direction: Behavior and physiology. Neural Networks: The Official Journal of the International Neural Network Society, 19, 981-1012.
16. Djamshidian, A., Jha, A., O'Sullivan, S. S., Silveira-Moriyama, L., Jacobson, C., Brown, P.,...Averbeck, B. B. (2010). Risk and learning in impulsive and nonimpulsive patients with Parkinson's disease. Movement Disorders: Official Journal of the Movement Disorder Society, 25, 2203-2210.
17. Djamshidian, A., O'Sullivan, S. S., Lees, A., & Averbeck, B. B. (2011). Stroop test performance in impulsive and non impulsive patients with Parkinson's disease. Parkinsonism & Related Disorders, 17, 212-214.
18. Djamshidian, A., O'Sullivan, S. S., Lees, A., & Averbeck, B. B. (2012). Effects of dopamine on sensitivity to social bias in Parkinson's disease. PLoS One, 7, e32889.
19. Djamshidian, A., O'Sullivan, S. S., Sanotsky, Y., Sharman, S., Matviyenko, Y., Foltynie, T.,...Averbeck, B. B. (2012). Decision making, impulsivity, and addictions: Do Parkinson's disease patients jump to conclusions? Movement Disorders: Official Journal of the Movement Disorder Society, 27, 1137-1145.
20. Djamshidian, A., O'Sullivan, S. S., Wittmann, B. C., Lees, A. J., & Averbeck, B. B. (2011). Novelty seeking behaviour in Parkinson's disease. Neuropsychologia, 49, 2483-2488.
21. Drugowitsch, J., Moreno-Bote, R., Churchland, A. K., Shadlen, M. N., & Pouget, A. (2012). The cost of accumulating evidence in perceptual decision making. The Journal of neuroscience: The official journal of the Society for Neuroscience, 32, 3612-3628.
22. Evans, A. H., Pavese, N., Lawrence, A. D., Tai, Y. F., Appel, S., Doder, M.,...Piccini, P. (2006). Compulsive drug use linked to sensitized ventral striatal dopamine transmission. Annals of Neurology, 59, 852- 858.
23. Eysenck, S. B., & Eysenck, H. J. (1977). The place of impulsiveness in a dimensional system of personality description. The British Journal of Social and Clinical Psychology, 16, 57-68.
24. Falhammar, H., & Yarker, J. Y. (2009). Pathological gambling and hypersexuality in cabergoline-treated prolactinoma. The Medical Journal of Australia, 190, 97.
25. Figner, B., Knoch, D., Johnson, E. J., Krosch, A. R., Lisanby, S. H., Fehr, E., & Weber, E. U. (2010). Lateral prefrontal cortex and self-control in intertemporal choice. Nature Neuroscience, 13, 538-539.
26. Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004). By carrot or by stick: Cognitive reinforcement learning in parkinsonism. Science, 306, 1940-1943.
27. Frederick, S., Loewenstein, G., & O'Donoghue, T. (2004). Time discounting and time preference: A critical review. In C. F. Camerer, G. Loewenstein, & M. Rabin (Eds.), Advances in behavioral economics (pp. 162-222). Princeton, NJ: Princeton University Press.
28. Furl, N., & Averbeck, B. B. (2011). Parietal cortex and insula relate to evidence seeking relevant to reward-related decisions. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 31, 17572-17582.
29. Gallagher, D. A., O'Sullivan, S. S., Evans, A. H., Lees, A. J., & Schrag, A. (2007). Pathological gambling in Parkinson's disease: Risk factors and differences from dopamine dysregulation. An analysis of published case series. Movement Disorders: Official Journal of the Movement Disorder Society, 22, 1757-1763.
30. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2004). Bayesian data analysis (2nd ed.). New York, NY: Chapman and Hall/CRC.
31. Gold, J. I., & Shadlen, M. N. (2001). Neural computations that underlie decisions about sensory stimuli. Trends in Cognitive Sciences, 5, 10-16.
32. Hassan, A., Bower, J. H., Kumar, N., Matsumoto, J. Y., Fealey, R. D., Josephs, K. A., & Ahlskog, J. E. (2011). Dopamine agonist-triggered pathological behaviors: Surveillance in the PD clinic reveals high frequencies. Parkinsonism & Related Disorders, 17, 260-264.
33. Holman, A. J. (2009). Impulse control disorder behaviors associated with pramipexole used to treat fibromyalgia. Journal of Gambling Studies/ Co-Sponsored by the National Council on Problem Gambling and Institute for the Study of Gambling and Commercial Gaming, 25, 425- 431.
34. Housden, C. R., O'Sullivan, S. S., Joyce, E. M., Lees, A. J., & Roiser, J. P. (2010). Intact reward learning but elevated delay discounting in Parkinson's disease patients with impulsive-compulsive spectrum behaviors. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology, 35, 2155-2164.
35. Kable, J. W., & Glimcher, P. W. (2007). The neural correlates of subjective value during intertemporal choice. Nature Neuroscience, 10, 1625- 1633.
36. Kable, J. W., & Glimcher, P. W. (2010). An "as soon as possible" effect in human intertemporal decision making: Behavioral evidence and neural mechanisms. Journal of Neurophysiology, 103, 2513-2531.
37. Kagan, J. (1966). Reflection-impulsivity: The generality and dynamics of conceptual tempo. Journal of Abnormal Psychology, 71, 17-24.
38. Keren, G., & Roelofsma, P. (1995). Immediacy and certainty in intertemporal choice. Organizational Behavior and Human Decision Processes, 63, 287-297.
39. Kirby, K. N., Petry, N. M., & Bickel, W. K. (1999). Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. Journal of Experimental Psychology: General, 128, 78-87.
40. Leroi, I., Ahearn, D. J., Andrews, M., McDonald, K. R., Byrne, E. J., & Burns, A. (2011). Behavioural disorders, disability, and quality of life in Parkinson's disease. Age and Ageing, 40, 614-621.
41. Levin, J. R., Serlin, R. C., & Seaman, M. A. (1994). A controlled, powerful multiple-comparison strategy for several situations. Psychological Bulletin, 115, 153-159.
42. Loewenstein, G. (2004). Out of control: Visceral influences on behavior. In C. F. Camerer, G. Loewenstein, & M. Rabin (Eds.), Advances in behavioral economics (pp. 689-724). Princeton, NJ: Princeton University Press.
43. McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004). Separate neural systems value immediate and delayed monetary rewards. Science, 306, 503-507.
44. McCourt, W. F., Gurrera, R. J., & Cutter, H. S. (1993). Sensation seeking and novelty seeking. Are they the same? The Journal of Nervous and Mental Disease, 181, 309-312.
45. Meda, S. A., Stevens, M. C., Potenza, M. N., Pittman, B., Gueorguieva, R., Andrews, M. M.,...Pearlson, G. D. (2009). Investigating the behavioral and self-report constructs of impulsivity domains using principal component analysis. Behavioural Pharmacology, 20(5-6), 390-399.
46. Milner, B. (1963). Effects of different brain lesions on card sorting. Archives of Neurology, 9, 100-110.
47. Mishkin, M. (1964). Perseveration of central sets after frontal lesions in monkeys. In J. M. Warren & K. Akert (Eds.), The frontal ganular cortex and behavior (pp. 219-241). New York, NY: McGraw-Hill.
48. Moutoussis, M., Bentall, R. P., El-Deredy, W., & Dayan, P. (2011). Bayesian modelling of Jumping-to-Conclusions bias in delusional patients. Cognitive Neuropsychiatry, 16, 422-447.
49. Newman-Tancredi, A., Cussac, D., Audinot, V., Nicolas, J. P., De Ceuninck, F., Boutin, J. A., & Millan, M. J. (2002). Differential actions of antiparkinson agents at multiple classes of monoaminergic receptor. II. Agonist and antagonist properties at subtypes of dopamine D(2)-like receptor and alpha(1)/alpha(2)-adrenoceptor. The Journal of Pharmacology and Experimental Therapeutics, 303, 805-814.
50. O'Sullivan, S. S., Wu, K., Politis, M., Lawrence, A. D., Evans, A. H., Bose, S.K.,...Piccini, P. (2011). Cue-induced striatal dopamine release in Parkinson's disease-associated impulsive-compulsive behaviours. Brain: A Journal of Neurology, 134, 969-978.
51. Pine, A., Seymour, B., Roiser, J. P., Bossaerts, P., Friston, K. J., Curran, H. V., & Dolan, R. J. (2009). Encoding of marginal utility across time in the human brain. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 29, 9575-9581.
52. Pine, A., Shiner, T., Seymour, B., & Dolan, R. J. (2010). Dopamine, time, and impulsivity in humans. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 30, 8888-8896.
53. Puterman, M. L. (1994). Markov decision processes: Discrete stochastic dynamic programming. New York, NY: Wiley.
54. Rao, H., Mamikonyan, E., Detre, J. A., Siderowf, A. D., Stern, M. B., Potenza, M. N., & Weintraub, D. (2010). Decreased ventral striatal activity with impulse control disorders in Parkinson's disease. Movement Disorders: Official Journal of the Movement Disorder Society, 25, 1660-1669.
55. Reynolds, B., Penfold, R. B., & Patak, M. (2008). Dimensions of impulsive behavior in adolescents: Laboratory behavioral assessments. Experimental and Clinical Psychopharmacology, 16(2), 124-131.
56. Robbins, T. W., Gillan, C. M., Smith, D. G., de Wit, S., & Ersche, K. D. (2012). Neurocognitive endophenotypes of impulsivity and compulsivity: Towards dimensional psychiatry. Trends in Cognitive Sciences, 16, 81-91.
57. Shiner, T., Seymour, B., Wunderlich, K., Hill, C., Bhatia, K. P., Dayan, P., & Dolan, R. J. (2012). Dopamine and performance in a reinforcement learning task: Evidence from Parkinson's disease. Brain: A Journal of Neurology, 135, 1871-1883.
58. Steeves, T. D., Miyasaki, J., Zurowski, M., Lang, A. E., Pellecchia, G., Van Eimeren, T.,...Strafella, A. P. (2009). Increased striatal dopamine release in Parkinsonian patients with pathological gambling: A [11C] raclopride PET study. Brain: A Journal of Neurology, 132, 1376-1385.
59. Verdejo-García, A., Lawrence, A. J., & Clark, L. (2008). Impulsivity as a vulnerability marker for substance-use disorders: Review of findings from high-risk research, problem gamblers and genetic association studies. Neuroscience and Biobehavioral Reviews, 32, 777-810.
60. Voon, V., Gao, J., Brezing, C., Symmonds, M., Ekanayake, V., Fernandez, H.,...Hallett, M. (2011). Dopamine agonists and risk: Impulse control disorders in Parkinson's disease. Brain: A Journal of Neurology, 134, 1438-1446.
61. Voon, V., Pessiglione, M., Brezing, C., Gallea, C., Fernandez, H. H., Dolan, R. J., & Hallett, M. (2010). Mechanisms underlying dopaminemediated reward bias in compulsive behaviors. Neuron, 65, 135-142.
62. Voon, V., Reynolds, B., Brezing, C., Gallea, C., Skaljic, M., Ekanayake, V.,...Hallett, M. (2010). Impulsive choice and response in dopamine agonist-related impulse control behaviors. Psychopharmacology, 207, 645-659.
63. Voon, V., Sohr, M., Lang, A. E., Potenza, M. N., Siderowf, A. D., Whetteckey, J.,...Stacy, M. (2011). Impulse control disorders in Parkinson disease: A multicenter case-control study. Annals of Neurology, 69, 986-996.
64. Weintraub, D., Koester, J., Potenza, M. N., Siderowf, A. D., Stacy, M., Voon, V.,...Lang, A. E. (2010). Impulse control disorders in Parkinson disease: A cross-sectional study of 3090 patients. Archives of Neurology, 67, 589-595.
65. Wilson, T. D., & Dunn, E. W. (2004). Self-knowledge: Its limits, value, and potential for improvement. Annual Review of Psychology, 55, 493- 518.
66. Winstanley, C. A., Eagle, D. M., & Robbins, T. W. (2006). Behavioral models of impulsivity in relation to ADHD: Translation between clinical and preclinical studies. Clinical Psychology Review, 26, 379-395.
67. Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008). Striatal activity underlies novelty-based choice in humans. Neuron, 58, 967- 973.
68. Wylie, S. A., Claassen, D. O., Huizenga, H. M., Schewel, K. D., Ridderinkhof, K. R., Bashore, T. R., & van den Wildenberg, W. P. (2012). Dopamine agonists and the suppression of impulsive motor actions in Parkinson disease. Journal of Cognitive Neuroscience, 24, 1709-1724.