Deep brain stimulation of the subthalamic nucleus improves reward-based decision-learning in Parkinson's disease

Frontiers in Human Neuroscience

Volumn , Issue APRIL, 2011, Pages

  van Wouwe, Nelleke C ^a   Ridderinkhof, K R ^b   van den Wildenberg, W P M ^b   Band, G P H ^a   Abisogun, A ^c   Elias, W J ^c   Frysinger, R ^c   Wylie, S A ^c  

^a LEIDEN UNIVERSITY   (Netherlands)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

^c UNIVERSITY OF VIRGINIA HEALTH SYSTEM   (United States)

Author keywords

Deep brain stimulation; Parkinson's disease; Probabilistic learning; Subthalamic nucleus

Indexed keywords

ACCURACY; ADULT; AGE; ARTICLE; BRAIN DEPTH STIMULATION; CLINICAL ARTICLE; COGNITION; DECISION MAKING; DISEASE DURATION; FEMALE; HUMAN; LEARNING; MALE; MENTAL HEALTH; MINI MENTAL STATE EXAMINATION; MOTOR PERFORMANCE; PARKINSON DISEASE; PREDICTION; PUTAMEN; REWARD; REWARD BASED DECISION LEARNING; REWARD PREDICTION; STIMULUS RESPONSE; SUBTHALAMIC NUCLEUS; TREATMENT OUTCOME;

EID: 84933677646     PISSN: 16625161     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2011.00030     Document Type: Article

References (57)

1. Albin, R. L., Young, A. B., and Penney, J. B. (1989). The functional-anatomy of basal ganglia disorders. Trends Neurosci. 12, 366-375.
2. Balaz, M., Srovnalova, H., Rektorova, I., and Rektor, I. (2010). The effect of cortical repetitive transcranial magnetic stimulation on cognitive event-related potentials recorded in the subthalamic nucleus. Exp. Brain Res. 203, 317-327.
3. Balleine, B. W., Delgado, M. R., and Hikosaka, O. (2007). The role of the dorsal striatum in reward and decision-making. J. Neurosci. 27, 8161-8165.
4. Baunez, C., Humby, T., Eagle, D., Ryan, L., Dunnett, S., and Robbins, T. (2001). Effects of STN lesions on simple vs choice reaction time tasks in the rat: preserved motor readiness, but impaired response selection. Eur. J. Neurosci. 13, 1609-1616.
5. Baunez, C., and Robbins, T. (1997). Bilateral lesions of the subthalamic nucleus induce multiple deficits in an attentional task in rats. Eur. J. Neurosci. 9, 2086-2099.
6. Benabid, A. L. (2003). Deep brain stimulation for Parkinson's disease. Curr. Opin. Neurobiol. 13, 696-706.
7. Benazzouz, A., and Hallett, M. (2000). Mechanism of action of deep brain stimulation. Neurology 55, S13-S16.
8. Bergman, H., Wichmann, T., and DeLong, M. (1990). Reversal of experimental parkinsonism by lesions of the subthalamic nucleus. Science 249, 1436-1438.
9. Bergman, H., Wichmann, T., Karmon, B., and DeLong, M. (1994). The primate subthalamic nucleus. II. Neuronal activity in the MPTP model of parkinsonism. J. Neurophysiol. 72, 507-520.
10. Bertsekas, D. P., and Tsitsiklis, J. N. (1996). Neuro-Dynamic Programming. Belmont, MA: Athena Scientific.
11. Bjorklund, A., and Dunnett, S. B. (2007). Dopamine neuron systems in the brain: an update. Trends Neurosci. 30, 194-202.
12. Boraud, T., Bezard, E., Bioulac, B., and Gross, C. (2002). From single extracellular unit recording in experimental and human Parkinsonism to the development of a functional concept of the role played by the basal ganglia in motor control. Prog. Neurobiol. 66, 265-283.
13. Charles, P. D., Van Blercom, N., Krack, P., Lee, S. L., Xie, J., Besson, G., Benabid, A.-L., and Pollak, P. (2002). Predictors of effective bilateral subthalamic nucleus stimulation for PD. Neurology 59, 932-934.
14. Cools, R., Barker, R. A., Sahakian, B. J., and Robbins, T. W. (2001). Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cereb. Cortex 11, 1136-1143.
15. Cooper, J. A., Sagar, H. J., Doherty, S. M., Jordan, N., Ridswell, P., and Sullivan, E. V. (1992). Different effects of dopaminergic and anticholineric therapies on cognitive and motor function in Parkinson's disease. Brain 115, 1701-1725.
16. Dayan, P., Kakade, S., and Montague, P. (2000). Learning and selective attention. Nat. Neurosci. 3, S1218-S1223.
17. El Massioui, N., Cheruel, F., Faure, A., and Conde, F. (2007). Learning and memory dissociation in rats with lesions to the subthalamic nucleus or to the dorsal striatum. Neuroscience 147, 906-918.
18. Elias, W., Fu, K., and Frysinger, R. (2007). Cortical and subcortical brain shift during stereotactic procedures. J. Neurosurg. 107, 983-988.
19. Faure, A., Haberland, U., Condé, F., and El Massioui, N. (2005). Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. J. Neurosci. 25, 2771-2780.
20. Folstein, M., Folstein, S., and McHugh, P. (1975). "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 12, 189-198.
21. Frank, M., Samanta, J., Moustafa, A., and Sherman, S. (2007). Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism. Science 318, 1309-1312.
22. Frank, M. J. (2005). Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. J. Cogn. Neurosci. 17, 51-72.
23. Funkiewiez, A., Ardouin, C., Cools, R., Krack, P., Fraix, V., Bair, A., Chabardès, S., Benabid, A. L., Robbins, T. W., and Pollak, P. (2006). Effects of levodopa and subthalamic nucleus stimulation on cognitive and affective functioning in Parkinson's disease. Mov. Disord. 21, 1656-1662.
24. Haruno, M., and Kawato, M. (2006a). Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action reward association learning. J. Neurophysiol. 95, 948-959.
25. Haruno, M., and Kawato, M. (2006b). Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning. Neural Networks 19, 1242-1254.
26. Hershey, T., Campbell, M. C., Videen, T. O., Lugar, H. M., Weaver, P. M., Hartlein, J., Karimi, M., Tabbal, S. D., and Perlmutter, J. S. (2010). Mapping go-no-go performance within the subthalamic nucleus region. Brain 133, 3625-3634.
27. Jahanshahi, M., Ardouin, C., Brown, R., Rothwell, J., Obeso, J., Albanese, A., Rodriguez-Oroz, M. C., Moro, E., Benabid, A. L., Pollak, P., and Limousin-Dowsey, P. (2000). The impact of deep brain stimulation on executive function in Parkinson's disease. Brain 123, 1142-1154.
28. Joel, D. (2001). Open interconnected model of basal ganglia-thalamocortical circuitry and its relevance to the clinical syndrome of Huntington's disease. Mov. Disord. 16, 407-423.
29. Kaasinen, V., and Rinne, J. O. (2002). Functional imaging studies of dopamine system and cognition in normal aging and Parkinson's disease. Neurosci. Biobehav. Rev. 26, 785-793.
30. Karachi, C., Yelnik, J., Tande, D., Tremblay, L., Hirsch, E. C., and Francois, C. (2005). The pallidosubthalamic projection: an anatomical substrate for nonmotor functions of the subthalamic nucleus in primates. Mov. Disord. 20, 172-180.
31. Kleiner-Fisman, G., Fisman, D. N., Sime, E., Saint-Cyr, J. A., Lozano, A. M., and Lang, A. E. (2003). Long-term follow up of bilateral deep brain stimulation of the subthalamic nucleus in patients with advanced Parkinson disease. J. Neurosurg. 99, 489-495.
32. Lang, A. E. (2000). Surgery for Parkinson disease. Arch. Neurol. 57, 1118-1125.
33. Lezak, M. D. (1995). Neuropsychological Assessment, 3rd Edn. New York: Oxford University Press.
34. Limousin, P., Pollak, P., Benazzouz, A., Hoffmann, D., Le Bas, J. F., Broussolle, E., Perret, J. E., and Benabid, A. L. (1995). Effect of parkinsonian signs and symptoms of bilateral subthalamic nucleus stimulation. Lancet 345, 91-95.
35. Liu, Y., Postupna, N., Falkenberg, J., and Anderson, M. E. (2006). High frequency deep brain stimulation: what are the therapeutic mechanisms? Neurosci. Biobehav. Rev. 32, 343-351.
36. Mallet, L., Schupbach, M., N'Diaye, K., Remy, P., Bardinet, E., Czernecki, V., Welter, M. L., Pelissolo, A., Ruberg, M., Agid, Y., and Yelnik, J. (2007). Stimulation of subterritories of the subthalamic nucleus reveals its role in the integration of the emotional and motor aspects of behavior. Proc. Natl. Acad. Sci. U.S.A. 104, 10661-10666.
37. Maurice, N., Deniau, J. M., Glowinski, J., and Thierry, A. M. (1998). Relationships between the prefrontal cortex and the basal ganglia in the rat: physiology of the corticosubthalamic circuits. J. Neurosci. 18, 9539-9546.
38. McAuley, J. H. (2003). The physiological basis of clinical deficits in Parkinson's disease. Prog. Neurobiol. 69, 27-48.
39. Meissner, W., Leblois, A., Hansel, D., Bioulac, B., Gross, C., Benazzouz, A., and Boraud, T. (2005). Subthalamic high frequency stimulation resets subthalamic firing and reduces abnormal oscillations. Brain 128, 2372-2382.
40. Nambu, A., Tokuno, H., Hamada, I., Kita, H., Imanishi, M., Akazawa, T., Ikeuchi, Y., and Hasegawa, N. (2000). Excitatory cortical inputs to pallidal neurons via the subthalamic nucleus in the monkey. J. Neurophysiol. 84, 289-300.
41. Pahwa, R., Factor, S. A., Lyons, K. E., Ondo, W. G., Gronseth, G., Bronte-Stewart, H., Hallett, M., Miyasaki, J., Stevens, J., and Weiner, W. J. (2006). Practice parameter: treatment of Parkinson disease with motor fluctuations and dyskinesia (an evidence-based review) Report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology 66, 983-995.
42. Saint-Cyr, J., Trépanier, L., Kumar, R., Lozano, A., and Lang, A. (2000). Neuropsychological consequences of chronic bilateral stimulation of the subthalamic nucleus in Parkinson's disease. Brain 123, 2091-2108.
43. Sato, F., Parent, M., Levesque, M., and Parent, A. (2000). Axonal branching pattern of neurons of the subthalamic nucleus in primates. J. Comp. Neurol. 424, 142-152.
44. Schroeder, U., Kuehler, A., Haslinger, B., Erhard, P., Fogel, W., Tronnier, V. M., Lange, K. W., Boecker, H., and Ceballos-Baumann, A. O. (2002). Subthalamic nucleus stimulation affects striato-anterior cingulate cortex circuit in a response conflict task: a PET study. Brain 125, 1995-2004.
45. Schupbach, W. M. M., Maltete, D., Houeto, J. L., du Montcel, S. T., Mallet, L., Welter, M. L., Gargiulo, M., Béhar, C., Bonnet, A. M., Czernecki, V., Pidoux, B., Navarro, S., Dormont, D., Cornu, P., and Agid, Y. (2007). Neurosurgery at an earlier stage of Parkinson disease: a randomized, controlled trial. Neurology 68, 267-271.
46. Shohamy, D., Myers, C. E., Kalanithi, J., and Gluck, M. A. (2008). Basal ganglia and dopamine contributions to probabilistic category learning. Neurosci. Biobehav. Rev. 32, 219-236.
47. Sutton, R. S., and Barto, A. G. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
48. Swainson, R., Rogers, R. D., Sahakian, B. J., Summers, B. A., Polkey, C. E., and Robbins, T. W. (2000). Probabilistic learning and reversal deficits in patients with Parkinson's disease or frontal or temporal lobe lesions: possible adverse effects of dopaminergic medication. Neuropsychologia 38, 596-612.
49. Uslaner, J. M., Dell'Orco, J. M., Pevzner, A., and Robinson, T. E. (2008). The influence of subthalamic nucleus lesions on sign-tracking to stimuli paired with food and drug rewards: facilitation of incentive salience attribution? Neuropsychopharmacology 33, 2352-2361.
50. Uslaner, J. M., and Robinson, T. (2006). Subthalamic nucleus lesions increase impulsive action and decrease impulsive choice - mediation by enhanced incentive motivation? Eur. J. Neurosci. 24, 2345-2354.
51. van den Wildenberg, W. P. M., van Boxtel, G. J. M., van der Molen, M. W., Bosch, D. A., Speelman, J. D., and Brunia, C.H. M. (2006). Stimulation of the subthalamic region facilitates the selection and inhibition of motor responses in Parkinson's disease. J. Cogn. Neurosci. 18, 626-636.
52. Voon, V., Kubu, C., Krack, P., Houeto, J. L., and Troster, A. I. (2006). Deep brain stimulation: neuropsychological and neuropsychiatric issues. Mov. Disord. 21, S305-S326.
53. Witt, K., Pulkowski, U., Herzog, J., Lorenz, D., Hamel, W., Deuschl, G., and Krack, P. (2004). Deep brain stimulation of the subthalamic nucleus improves cognitive flexibility but impairs response inhibition in Parkinson's disease. Arch. Neurol. 61, 697-700.
54. Wylie, S. A., Ridderinkhof, K. R., Elias, W. J., Frysinger, R. C., Bashore, T. R., Downs, K. E., van Wouwe, N. C., and van den Wildenberg, W. P. M. (2010). Subthalamic nucleus stimulation influences expression and suppression of impulsive behavior in Parkinson's disease. Brain 133, 3611-3624.
55. Wylie, S. A., van den Wildenberg, W. P., Ridderinkhof, K. R., Bashore, T., Powell, V., Manning, C. A., and Wooten, G. F. (2009a). The effect of Parkinson's disease on interference control during action selection. Neuropsychologia 47, 145-157.
56. Wylie, S. A., van den Wildenberg, W. P., Ridderinkhof, K. R., Bashore, T. R., Manning, C. A., and Wooten, G. F. (2009b). The effect of speed-accuracy strategy on response interference control in Parkinson's disease. Neuropsychologia 47, 1853-1944.
57. Young, P. (1984). Recursive Estimation and Time Series. New York: Springer-Verlag.