Reinforcement learning and Gilles de la Tourette syndrome: Dissociation of clinical phenotypes and pharmacological treatments

Archives of General Psychiatry

Volumn 68, Issue 12, 2011, Pages 1257-1266

  Worbe, Yulia ^a,b   Palminteri, Stefano ^a,b   Hartmann, Andreas ^a,b   Vidailhet, Marie ^a,b   Lehéricy, Stéphane ^a,b,c   Pessiglione, Mathias ^a,b  

^a SORBONNE UNIVERSITÉ   (France)

^b ASSISTANCE PUBLIQUE HÔPITAUX DE PARIS   (France)

^c PITIÉ SALPÊTRIÈRE HOSPITAL   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ARIPIPRAZOLE; BENZODIAZEPINE; DOPAMINE RECEPTOR BLOCKING AGENT; DOPAMINE RECEPTOR STIMULATING AGENT; HALOPERIDOL; NEUROLEPTIC AGENT; PIMOZIDE; RISPERIDONE; SEROTONIN UPTAKE INHIBITOR;

ADULT; ARTICLE; BASAL GANGLION; COMORBIDITY; CONTROLLED STUDY; FEMALE; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GILLES DE LA TOURETTE SYNDROME; HUMAN; MAJOR CLINICAL STUDY; MALE; MENTAL DISEASE; OBSESSIVE COMPULSIVE DISORDER; PHENOTYPE; REINFORCEMENT; REWARD; TIC;

ADULT; ANTIPSYCHOTIC AGENTS; BRAIN; CASE-CONTROL STUDIES; COMPUTER SIMULATION; FUNCTIONAL NEUROIMAGING; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; NEUROPSYCHOLOGICAL TESTS; OBSESSIVE-COMPULSIVE DISORDER; PHENOTYPE; PIPERAZINES; QUINOLONES; REINFORCEMENT (PSYCHOLOGY); TOURETTE SYNDROME;

EID: 83055169060     PISSN: 0003990X     EISSN: 15383636     Source Type: Journal    
DOI: 10.1001/archgenpsychiatry.2011.137     Document Type: Article

References (74)

1. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 4th ed, text revision. Washington, DC: American Psyciatric Association; 2000.
2. Robertson MM. Tourette syndrome, associated conditions and the complexities of treatment. Brain. 2000;123(pt 3):425-462. (Pubitemid 30099531)
3. Bloch MH, Leckman JF. Clinical course of Tourette syndrome. J Psychosom Res. 2009;67(6):497-501.
4. Cavanna AE, Servo S, Monaco F, Robertson MM. The behavioral spectrum of Gilles de la Tourette syndrome. J Neuropsychiatry Clin Neurosci. 2009;21(1): 13-23.
5. Grados MA, Mathews CA. Clinical phenomenology and phenotype variability in Tourette syndrome. J Psychosom Res. 2009;67(6):491-496.
6. Graybiel AM, Canales JJ. The neurobiology of repetitive behaviors: clues to the neurobiology of Tourette syndrome. Adv Neurol. 2001;85:123-131.
7. Mink JW. The basal ganglia and involuntary movements: impaired inhibition of competing motor patterns. Arch Neurol. 2003;60(10):1365-1368. (Pubitemid 37248796)
8. Singer HS. Tourette's syndrome: from behaviour to biology. Lancet Neurol. 2005; 4(3):149-159. (Pubitemid 40269145)
9. Leckman JF, Knorr AM, Rasmusson AM, Cohen DJ. Basal ganglia research and Tourette's syndromes [letter]. Trends Neurosci. 1991;14(3):94.
10. Singer HS, Minzer K. Neurobiology of Tourette's syndrome: concepts of neuroanatomic localization and neurochemical abnormalities. Brain Dev. 2003;25 (suppl 1):S70-S84. (Pubitemid 39658654)
11. Albin RL. Neurobiology of basal ganglia and Tourette syndrome: striatal and dopamine function. Adv Neurol. 2006;99:99-106.
12. Grabli D, McCairn K, Hirsch EC, Agid Y, Féger J, François C, Tremblay L. Behavioural disorders induced by external globus pallidus dysfunction in primates, I: behavioural study. Brain. 2004;127(pt 9):2039-2054. (Pubitemid 39150262)
13. McCairn KW, Bronfeld M, Belelovsky K, Bar-Gad I. The neurophysiological correlates of motor tics following focal striatal disinhibition. Brain. 2009;132(pt 8): 2125-2138.
14. Worbe Y, Baup N, Grabli D, Chaigneau M, Mounayar S, McCairn K, Féger J, Tremblay L. Behavioral and movement disorders induced by local inhibitory dysfunction in primate striatum. Cereb Cortex. 2009;19(8):1844-1856.
15. Worbe Y, Gerardin E, Hartmann A, Valabregue R, Chupin M, Tremblay L, Vidailhet M, Colliot O, Lehéricy S. Distinct structural changes underpin clinical phenotypes in Gilles de la Tourette syndrome patients. Brain. 2010;133(pt 12): 3649-3660.
16. Kawohl W, Schneider F, Vernaleken I, Neuner I. Aripiprazole in the pharmacotherapy of Gilles de la Tourette syndrome in adult patients. World J Biol Psychiatry. 2009;10(4, pt 3):827-831.
17. Singer HS, Szymanski S, Giuliano J, Yokoi F, Dogan AS, Brasic JR, Zhou Y, Grace AA, Wong DF. Elevated intrasynaptic dopamine release in Tourette's syndrome measured by PET. Am J Psychiatry. 2002;159(8):1329-1336. (Pubitemid 34832714)
18. Albin RL, Koeppe RA, Bohnen NI, Nichols TE, Meyer P, Wernette K, Minoshima S, Kilbourn MR, Frey KA. Increased ventral striatal monoaminergic innervation in Tourette syndrome. Neurology. 2003;61(3):310-315. (Pubitemid 36975957)
19. Gilbert DL, Christian BT, Gelfand MJ, Shi B, Mantil J, Sallee FR. Altered mesolimbocortical and thalamic dopamine in Tourette syndrome. Neurology. 2006; 67(9):1695-1697. (Pubitemid 44747951)
20. Wong DF, Brasić JR, Singer HS, Schretlen DJ, Kuwabara H, Zhou Y, Nandi A, Maris MA, Alexander M, Ye W, Rousset O, Kumar A, Szabo Z, Gjedde A, Grace AA. Mechanisms of dopaminergic and serotonergic neurotransmission in Tourette syndrome: clues from an in vivo neurochemistry study with PET. Neuropsychopharmacology. 2008;33(6):1239-1251. (Pubitemid 351521728)
21. Minzer K, Lee O, Hong JJ, Singer HS. Increased prefrontal D2 protein in Tourette syndrome: a postmortem analysis of frontal cortex and striatum. J Neurol Sci. 2004;219(1-2):55-61. (Pubitemid 38405998)
22. Yoon DY, Gause CD, Leckman JF, Singer HS. Frontal dopaminergic abnormality in Tourette syndrome: a postmortem analysis. J Neurol Sci. 2007;255(1-2):50-56. (Pubitemid 46415798)
23. Mink JW. Neurobiology of basal ganglia and Tourette syndrome: basal ganglia circuits and thalamocortical outputs. Adv Neurol. 2006;99:89-98.
24. Graybiel AM. Habits, rituals, and the evaluative brain. Annu Rev Neurosci. 2008; 31:359-387.
25. Schultz W. Dopamine neurons and their role in reward mechanisms. Curr Opin Neurobiol. 1997;7(2):191-197. (Pubitemid 27219855)
26. Bayer HM, Glimcher PW. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron. 2005;47(1):129-141. (Pubitemid 40922855)
27. Zaghloul KA, Blanco JA, Weidemann CT, McGill K, Jaggi JL, Baltuch GH, Kahana MJ. Human substantia nigra neurons encode unexpected financial rewards. Science. 2009;323(5920):1496-1499.
28. Tsai HC, Zhang F, Adamantidis A, Stuber GD, Bonci A, de Lecea L, Deisseroth K. Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science. 2009;324(5930):1080-1084.
29. Calabresi P, Pisani A, Mercuri NB, Bernardi G. The corticostriatal projection: from synaptic plasticity to dysfunctions of the basal ganglia. Trends Neurosci. 1996; 19(1):19-24. (Pubitemid 26014822)
30. Schultz W. Multiple dopamine functions at different time courses. Annu Rev Neurosci. 2007;30:259-288. (Pubitemid 47218758)
31. Reynolds JN, Hyland BI, Wickens JR. A cellular mechanism of reward-related learning. Nature. 2001;413(6851):67-70. (Pubitemid 32843488)
32. Palminteri S, Boraud T, Lafargue G, Dubois B, Pessiglione M. Brain hemispheres selectively track the expected value of contralateral options. J Neurosci. 2009;29(43):13465-13472.
33. Radua J, Mataix-Cols D. Voxel-wise meta-analysis of greymatter changes in obsessive- compulsive disorder. Br J Psychiatry. 2009;195(5):393-402.
34. Marsh R, Maia TV, Peterson BS. Functional disturbances within frontostriatal circuits across multiple childhood psychopathologies. Am J Psychiatry. 2009; 166(6):664-674.
35. Menzies L, Chamberlain SR, Laird AR, Thelen SM, Sahakian BJ, Bullmore ET. Integrating evidence from neuroimaging and neuropsychological studies of obsessive- compulsive disorder: the orbitofronto-striatal model revisited. Neurosci Biobehav Rev. 2008;32(3):525-549. (Pubitemid 351173336)
36. Palminteri S, Lebreton M, Worbe Y, Grabli D, Hartmann A, Pessiglione M. Pharmacological modulation of subliminal learning in Parkinson's and Tourette's syndromes. Proc Natl Acad Sci U S A. 2009;106(45):19179-19184.
37. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, Hergueta T, Baker R, Dunbar GC. The Mini-International Neuropsychiatric Interview (MINI): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(suppl 20):22-57.
38. Leckman JF, Riddle MA, Hardin MT, Ort SI, Swartz KL, Stevenson J, Cohen DJ. The Yale Global Tic Severity Scale: initial testing of a clinician-rated scale of tic severity. J Am Acad Child Adolesc Psychiatry. 1989;28(4):566-573. (Pubitemid 19196295)
39. Goodman WK, Price LH, Rasmussen SA, Mazure C, Delgado P, Heninger GR, Charney DS. The Yale-Brown Obsessive Compulsive Scale, II: validity. Arch Gen Psychiatry. 1989;46(11):1012-1016. (Pubitemid 19278230)
40. Goodman WK, Price LH, Rasmussen SA, Mazure C, Fleischmann RL, Hill CL, Heninger GR, Charney DS. The Yale-Brown Obsessive Compulsive Scale, I: development, use, and reliability. Arch Gen Psychiatry. 1989;46(11):1006-1011. (Pubitemid 19278229)
41. O'Doherty JP. Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr Opin Neurobiol. 2004;14(6):769- 776.
42. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature. 2006; 442(7106):1042-1045. (Pubitemid 44330261)
43. Daw ND, Doya K. The computational neurobiology of learning and reward. Curr Opin Neurobiol. 2006;16(2):199-204.
44. Mayka MA, Corcos DM, Leurgans SE, Vaillancourt DE. Three-dimensional locations and boundaries of motor and premotor cortices as defined by functional brain imaging: a meta-analysis. Neuroimage. 2006;31(4):1453-1474.
45. Lehéricy S, Benali H, Van de Moortele PF, Pélégrini- Issac M, Waechter T, Ugurbil K, Doyon J. Distinct basal ganglia territories are engaged in early and advanced motor sequence learning. Proc Natl Acad Sci U S A. 2005;102(35): 12566-12571. (Pubitemid 41266399)
46. Hare TA, O'Doherty J, Camerer CF, Schultz W, Rangel A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J Neurosci. 2008;28(22):5623-5630.
47. Haber SN, Knutson B. The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology. 2010;35(1):4-26.
48. Peters J, Büchel C. Episodic future thinking reduces reward delay discounting through an enhancement of prefrontal-mediotemporal interactions. Neuron. 2010; 66(1):138-148.
49. Alexander GE, DeLong MR, Strick PL. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci. 1986; 9:357-381.
50. Haber SN. The primate basal ganglia: parallel and integrative networks. J Chem Neuroanat. 2003;26(4):317-330.
51. Draganski B, Kherif F, Klöppel S, Cook PA, Alexander DC, Parker GJ, Deichmann R, Ashburner J, Frackowiak RS. Evidence for segregated and integrative connectivity patterns in the human basal ganglia. J Neurosci. 2008;28(28):7143- 7152.
52. Lehéricy S, Ducros M, Van de Moortele PF, Francois C, Thivard L, Poupon C, Swindale N, Ugurbil K, Kim DS. Diffusion tensor fiber tracking shows distinct corticostriatal circuits in humans. Ann Neurol. 2004;55(4):522-529. (Pubitemid 38391969)
53. Corlett PR, Murray GK, Honey GD, Aitken MR, Shanks DR, Robbins TW, Bullmore ET, Dickinson A, Fletcher PC. Disrupted prediction-error signal in psychosis: evidence for an associative account of delusions. Brain. 2007;130(pt 9): 2387-2400. (Pubitemid 47327635)
54. Voon V, Pessiglione M, Brezing C, Gallea C, Fernandez HH, Dolan RJ, Hallett M. Mechanisms underlying dopamine-mediated reward bias in compulsive behaviors. Neuron. 2010;65(1):135-142.
55. Thomalla G, Siebner HR, Jonas M, Bäumer T, Biermann-Ruben K, Hummel F, Gerloff C, Müller-Vahl K, Schnitzler A, Orth M, Münchau A. Structural changes in the somatosensory system correlate with tic severity in Gilles de la Tourette syndrome. Brain. 2009;132(pt 3):765-777.
56. Sowell ER, Kan E, Yoshii J, Thompson PM, Bansal R, Xu D, Toga AW, Peterson BS. Thinning of sensorimotor cortices in children with Tourette syndrome. Nat Neurosci. 2008;11(6):637-639. (Pubitemid 351748118)
57. Bohlhalter S, Goldfine A, Matteson S, Garraux G, Hanakawa T, Kansaku K, Wurzman R, Hallett M. Neural correlates of tic generation in Tourette syndrome: an event-related functional MRI study. Brain. 2006;129(pt 8):2029-2037. (Pubitemid 44289068)
58. Stern E SD, Chee KY, Holmes A, Robertson MM, Trimble M, Frith CD, Frackowiak RS, Dolan RJ. A functional neuroanatomy of tics in Tourette syndrome. Arch Gen Psychiatry. 2000;57(8):741-748. (Pubitemid 30650108)
59. Franzkowiak S, Pollok B, Biermann-Ruben K, Sudmeyer M, Paszek J, Jonas M, Thomalla G, Baumer T, Orth M, Munchau A, Schnitzler A. Altered pattern of motor cortical activation-inhibition during voluntary movements in Tourette syndrome. Mov Disord. 2010;25(12):1960-1968.
60. Heise KF, Steven B, Liuzzi G, Thomalla G, Jonas M, Müller-Vahl K, Sauseng P, Münchau A, Gerloff C, Hummel FC. Altered modulation of intracortical excitability during movement preparation in Gilles de la Tourette syndrome. Brain. 2010; 133(pt 2):580-590.
61. Rotge JY, Guehl D, Dilharreguy B, Tignol J, Bioulac B, Allard M, Burbaud P, Aouizerate B. Meta-analysis of brain volume changes in obsessive-compulsive disorder. Biol Psychiatry. 2009;65(1):75-83.
62. Rotge JY, Langbour N, Guehl D, Bioulac B, Jaafari N, Allard M, Aouizerate B, Burbaud P. Gray matter alterations in obsessive-compulsive disorder: an anatomic likelihood estimation meta-analysis. Neuropsychopharmacology. 2010;35(3): 686-691.
63. Gu BM, Park JY, Kang DH, Lee SJ, Yoo SY, Jo HJ, Choi CH, Lee JM, Kwon JS. Neural correlates of cognitive inflexibility during task-switching in obsessivecompulsive disorder. Brain. 2008;131(pt 1):155-164.
64. Nielen MM, den Boer JA, Smid HG. Patients with obsessive-compulsive disorder are impaired in associative learning based on external feedback. Psychol Med. 2009;39(9):1519-1526.
65. Juckel G, Schlagenhauf F, Koslowski M, Filonov D, Wüstenberg T, Villringer A, Knutson B, Kienast T, Gallinat J, Wrase J, Heinz A. Dysfunction of ventral striatal reward prediction in schizophrenic patients treated with typical, not atypical, neuroleptics. Psychopharmacology (Berl). 2006;187(2):222-228. (Pubitemid 44015616)
66. Schultz W. Getting formal with dopamine and reward. Neuron. 2002;36(2):241- 263.
67. Kawohl W, Schneider F, Vernaleken I, Neuner I. Chronic motor tic disorder and aripiprazole [letter]. J Neuropsychiatry Clin Neurosci. 2009;21(2):224.
68. Stip E, Tourjman V. Aripiprazole in schizophrenia and schizoaffective disorder: a review. Clin Ther. 2010;32(suppl 1):S3-S20.
69. Hirose T, Kikuchi T. Aripiprazole, a novel antipsychotic agent: dopamine D2 receptor partial agonist. J Med Invest. 2005;52(suppl):284-290. (Pubitemid 43051889)
70. Natesan S, Reckless GE, Nobrega JN, Fletcher PJ, Kapur S. Dissociation between in vivo occupancy and functional antagonism of dopamine D2 receptors: comparing aripiprazole to other antipsychotics in animal models. Neuropsychopharmacology. 2006;31(9):1854-1863.
71. Wood M, Reavill C. Aripiprazole acts as a selective dopamine D2 receptor partial agonist. Expert Opin Investig Drugs. 2007;16(6):771-775. (Pubitemid 46882352)
72. Strange PG. Antipsychotic drug action: antagonism, inverse agonism or partial agonism. Trends Pharmacol Sci. 2008;29(6):314-321.
73. Schlagenhauf F, Juckel G, Koslowski M, Kahnt T, Knutson B, Dembler T, Kienast T, Gallinat J, Wrase J, Heinz A. Reward system activation in schizophrenic patients switched from typical neuroleptics to olanzapine. Psychopharmacology (Berl). 2008;196(4):673-684.
74. Kapur S. How antipsychotics become anti-"psychotic": from dopamine to salience to psychosis. Trends Pharmacol Sci. 2004;25(8):402-406. (Pubitemid 38981555)