Distinct roles of dopamine and subthalamic nucleus in learning and probabilistic decision making

Brain

Volumn 135, Issue 12, 2012, Pages 3721-3734

  Coulthard, Elizabeth J ^a   Bogacz, Rafal ^b   Javed, Shazia ^a   Mooney, Lucy K ^a   Murphy, Gillian ^a   Keeley, Sophie ^a   Whone, Alan L ^a  

^a NORTH BRISTOL NHS TRUST   (United Kingdom)

^b UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

decision making; mathematical modelling; memory; Parkinson's disease; reasoning

Indexed keywords

DOPAMINE; LEVODOPA;

ADULT; ARTICLE; BEHAVIOR; BRAIN DEPTH STIMULATION; CLINICAL ARTICLE; COGNITION; CONTROLLED STUDY; DECISION MAKING; HUMAN; IMPULSIVENESS; INFORMATION PROCESSING; LEARNING; MEMORY; PARKINSON DISEASE; PRIORITY JOURNAL; PROBABILITY; STIMULUS RESPONSE; SUBTHALAMIC NUCLEUS; TASK PERFORMANCE;

EID: 84871729802     PISSN: 00068950     EISSN: 14602156     Source Type: Journal    
DOI: 10.1093/brain/aws273     Document Type: Article

References (51)

1. Bethus I, Tse D, Morris RG. Dopamine and memory: modulation of the persistence of memory for novel hippocampal NMDA receptor-dependent paired associates. J Neurosci 2010; 30: 1610-18.
2. Bogacz R, Gurney K. The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput 2007; 19: 442-77.
3. Bogacz R, Larsen T. Integration of reinforcement learning and optimal decision-making theories of the basal ganglia. Neural Comput 2011; 23: 817-51.
4. Bogacz R, Brown E, Moehlis J, Holmes P, Cohen JD. The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psycholo Rev 2006; 113: 700-65.
5. Calabresi P, Saiardi A, Pisani A, Baik JH, Centonze D, Mercuri NB, et al. Abnormal synaptic plasticity in the striatum of mice lacking dopamine D2 receptors. J. Neurosci 1997; 17: 4536-44.
6. Cavanagh JF, Wiecki TV, Cohen MX, Figueroa CM, Samanta J, Sherman SJ, et al. Subthalamic nucleus stimulation reverses mediofron-tal influence over decision threshold. Nat Neurosci 2011; 14: 1462-7.
7. Cetonze D, Picconi B, Gubellini P, Bernardi G, Calabresi P. Dopaminergic control of synaptic plasticity in the dorsal striatum. Eur J Neurosci 2001; 13: 1071-7.
8. Cools R, Barker RA, Sahakian BJ, Robbins TW. Enhanced or impaired cognitive function in parkinson's disease as a function of dopaminergic medication and task demands. Cereb Cortex 2001; 11: 1136-43.
9. Cools R, Barker RA, Sahakian BJ, Robbins TW. L-Dopa medication remediates cognitive inflexibility, but increases impulsivity in patients with Parkinson's disease. Neuropsychologia 2003; 41: 1431-41.
10. Deuschl G, Schade-Brittinger C, Krack P, Volkmann J, Schäfer H, Bötzel K, et al. A randomized trial of deep-brain stimulation for Parkinson's disease. N Engl J Med 2006; 355: 896-908.
11. Dujardin K, Blairy S, Defebvre L, Krystkowiak P, Hess U, Blond S, et al. Subthalamic nucleus stimulation induces deficits in decoding emotional facial expressions in Parkinson's disease. J Neurol Neurosurg Psychiatry 2004; 75: 202-8.
12. Egelman DM, Person C, Montague PR. A computational role for dopa-mine delivery in human decision-making. J Cogn Neurosci 1998; 10: 623-30.
13. Fahn S, Elton RL. The Unified Parkinson's Disease Rating Scale. Recent developments in Parkinson's disease. 1987; In: Fahn S, Marsden CD, Calne D, Goldstein M, editors. Recent developments in Parkinson's disease. Florham Park, NJ: MacMillan Healthcare Information; 1987. p. 153-63.
14. Fiorillo CD, Tobler PN, Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003; 299: 1898-902.
15. Follett KA, Weaver FM, Stern M, Hur K, Harris CL, Luo P, et al. Pallidal versus subthalamic deep-brain stimulation for Parkinson's disease. N Engl J Med 2010; 362: 2077-91.
16. Folstein MF, Folstein SE, McHugh PR. Mini-mental state": a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 1975; 12: 189-98.
17. Frank MJ. Hold your horses: a dynamic computational role for the sub-thalamic nucleus in decision making. Neural Netw 2006; 19: 1120-36.
18. Frank MJ, Seeberger LC, O'Reilly RC. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 2004; 306: 1940-43.
19. Frank MJ, Samanta J, Moustafa AA, Sherman SJ. Hold your horses: im-pulsivity, deep brain stimulation, and medication in parkinsonism. Science 2007; 318: 1309-12.
20. German DC, Manaye K, Smith WK, Woodward DJ, Saper CB. Midbrain dopaminergic cell loss in Parkinson's disease: computer visualisation. Ann Neurol 1989; 26: 507-14.
21. Hälbig TD, Tse W, Frisina PG, Baker BR, Hollander E, Shapiro H, et al. Subthalamic deep brain stimulation and impulse control in Parkinson's disease. Eur J Neurol 2009; 16: 493-97.
22. Hälbig TD, Gruber D, Kopp UA, Scherer P, Schneider GH, Trottenberg T, et al. Subthalamic stimulation differentially modulates declarative and nondeclarative memory. NeuroReport 2004; 15: 539-43.
23. Hershey T, Campbell MC, Videen TO, Lugar HM, Weaver PM, Hartlein J, et al. Mapping Go-No-Go performance within the subtha-lamic nucleus region. Brain 2010; 133: 3625-34.
24. Hollerman JR, Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1998; 1: 304-09.
25. Isoda M, Hikosaka O. Role for subthalamic nucleus neurons in switching from automatic to controlled eye movement. J Neurosci 2008; 28: 7209-18.
26. Knowlton BJ, Mangels JA, Squire LR. A neostriatal habit learning system in humans. Science 1996; 273: 1399-402.
27. Lawrence AD, Calder AJ, McGowan SW, Grasby PM. Selective disruption of the recognition of facial expressions of anger. Neuroreport 2002; 13: 881-84.
28. Lisman JE, Grace AA. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 2005; 46: 703-13.
29. Mattau E, Dupré N, Langlois M, Jean L, Thivierge S, Provencher P, et al. Mattis dementia rating scale 2: screening for MCI and dementia. Am J Alzheimers Dis Other Demen 2011; 26: 389-98.
30. Parent A, Hazrati LN. Functional anatomy of the basal ganglia. II. Tha place of subthalamic nucleus and external pallidum in basal ganglai circuitry. Brain Res Brain Res Rev 1995; 20: 128-54.
31. Patel NK, Plaha P, Gill SS. Magnetic resonance imaging-directed method for functional neurosurgery using implantable guide tubes. Neurosurgery 2007; 61: 358-66.
32. Patton JH, Stanford MS, Barratt ES. Factor structure of the barratt impulsiveness scale. J Clin Psychol 1995; 51: 768-74.
33. Plaha P, Ben-Shlomo Y, Patel NK, Gill SS. Stimulation of the caudal zona incerta is superior to stimulation of the subthalamic nucleus in improving contralateral parkinsonism. Brain 2006; 129: 1732-47.
34. Poldrack RA, Packard MG. Competition among multiple memory systems: converging evidence from animal and human brain studies. Neuropsychologia 2003; 41: 245-51.
35. Ratcliff R, Frank MJ. Reinforcement-based decision making in corticos-triatal circuits: mutual constraints by neurocomputational and diffusion models. Neural Comput 2012; 24: 1186-29.
36. Redgrave P, Rodriguez M, Smith Y, Rodriguez-Oroz MC, Lehericy S, Bergman H, et al. Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease. Nat Rev Neurosci 2010; 11: 760-72.
37. Rodriguez-Oroz MC, Rodriguez M, Guridi J, Mewes K, Chockkman V, Vitek J, et al. The subthalamic nucleus in Parkinson's disease: soma-totopic organization and physiological characteristics. Brain 2001; 124: 1777-90.
38. Rodriguez-Oroz MC, López-Azcárate J, Garcia-Garcia D, Alegre M, Toledo J, Valencia M, et al. Involvement of the subthalamic nucleus in impulse control disorders associated with Parkinson's disease. Brain 2011; 134: 36-49.
39. Shiner T, Seymour B, Wunderlich K, Hill C, Bhatia KP, Dayan P, et al. Dopamine and performance in a reinforcement learning task: evidence from Parkinson's disease. Brain 2012; 135: 1871-83.
40. Shohamy D, Adcock R. Dopamine and adaptive memory. Trends Cogn Sci 2010; 14: 464-72.
41. Smith MA, Ghazizadeh A, Shadmehr R. Interacting adaptive processes with different timescales underlie short-term motor learning. PLoS Biol 2006; 4: e179.
42. Sockeel P, Dujardin K, Devos D, Denève C, Destée A, Defebvre L. The Lille apathy rating scale (LARS), a new instrument for detecting and quantifying apathy: validation in Parkinson's disease. J Neurol Neurosurg Psychiatry 2006; 77: 579-84.
43. Usher M, McClelland JL. The time course of perceptual choice: the leaky, competing accumulator model. Psycholog Rev 2001; 108: 550-92.
44. Voon V, Krack P, Lang AE, Lozano AM, Dujardin K, Schüpbach M, et al. A multicentre study on suicide outcomes following subthalamic stimulation for Parkinson's disease. Brain 2008; 131: 2720-8.
45. Weaver FM, Follett K, Stern M, Hur K, Harris C, Marks WJ Jr, et al. Bilateral deep brain stimulation vs best medical therapy for patients with advanced Parkinson disease. JAMA 2009; 301: 63-73.
46. Welberg L. Reward: dopamine's expanding universe. Nat Rev Neurosci 2009; 10: 624-5.
47. Williams A, Gill S, Varma T, Jenkinson C, Quinn N, Mitchell R, et al. Deep brain stimulation plus best medical therapy versus best medical therapy alone for advanced Parkinson's disease (PD SURG trial): a randomised, open-label trial. Lancet Neurol 2010; 9: 581-91.
48. Wylie SA, Ridderinkhof KR, Elias WJ, Frysinger RC, Bashore TR, Downs KE, et al. Subthalamic nucleus stimulation influences expression and suppression of impulsive behaviour in Parkinson's disease. Brain 2010; 133: 3611-24.
49. Yang T, Shadlen MN. Probabilistic reasoning by neurons. Nature 2007; 447: 1075-80.
50. Yin HH, Knowlton BJ. The role of the basal ganglia in habit formation. Nat Rev Neurosci 2006; 7: 464-76.
51. Zaghoul KA, Weidemann CT, Lega BC, Jaggi JL, Baltuch GH, Kahana MJ. Neuronal activity in the human subthalamic nucleus encodes decision conflict during action selection. J Neurosci 2012; 32: 2453-60.