Similar improvement of reward and punishment learning by serotonin reuptake inhibitors in obsessive-compulsive disorder

Biological Psychiatry

Volumn 72, Issue 3, 2012, Pages 244-250

  Palminteri, Stefano ^a,b   Clair, Anne Hélène ^b   Mallet, Luc ^b   Pessiglione, Mathias ^a,b  

^a CNRS   (France)

^b INSTITUT DU CERVEAU ET DE LA MOELLE ÉPINIÈRE   (France)

Author keywords

Instrumental learning; obsessive compulsive disorder; punishment; reward; serotonin; subliminal perception

Indexed keywords

DOPAMINE RECEPTOR BLOCKING AGENT; ESCITALOPRAM; FLUOXETINE; MILNACIPRAN; PAROXETINE; SEROTONIN; SERTRALINE; VENLAFAXINE;

ADULT; ARTICLE; CONDITIONING; CONTROLLED STUDY; FEMALE; HUMAN; LEARNING; LEARNING DISORDER; MAJOR CLINICAL STUDY; MALE; OBSESSIVE COMPULSIVE DISORDER; PATHOLOGICAL GAMBLING; PRIORITY JOURNAL; PUNISHMENT; REINFORCEMENT; REWARD; TASK PERFORMANCE;

ADULT; CHOICE BEHAVIOR; CUES; DIAGNOSTIC AND STATISTICAL MANUAL OF MENTAL DISORDERS; DISCRIMINATION (PSYCHOLOGY); FEMALE; HUMANS; LEARNING; MALE; OBSESSIVE-COMPULSIVE DISORDER; PSYCHIATRIC STATUS RATING SCALES; PSYCHOMOTOR PERFORMANCE; PUNISHMENT; REWARD; RISK-TAKING; SEROTONIN UPTAKE INHIBITORS; SUBLIMINAL STIMULATION; VISUAL PERCEPTION;

EID: 84863719896     PISSN: 00063223     EISSN: 18732402     Source Type: Journal    
DOI: 10.1016/j.biopsych.2011.12.028     Document Type: Article

References (68)

1. Skinner BF (1991): The Behavior of Organisms. Actlon, MA: Copley Publishing Group.
2. Thorndike EL1 (2010): Animal intelligence; experimental studies. Charleston, SC: Nabu Press.
3. Pavlov IP (2003): Conditioned Reflexes. Mineola, NJ: Dover.
4. Rescorla RA (1988): Behavioral studies of Pavlovian conditioning. Annu Rev Neurosci 11:329-352.
5. Sutton RS, Barto AG (1998): Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
6. Schultz W, Dayan P, Montague PR (1997): A neural substrate of prediction and reward. Science 275:1593-1599. (Pubitemid 27120526)
7. Bayer HM, Glimcher PW (2005): Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47:129-141. (Pubitemid 40922855)
8. Zaghloul KA, Blanco JA, Weidemann CT, McGill K, Jaggi JL, Baltuch GH, et al. (2009): Human substantia nigra neurons encode unexpected financial rewards. Science 323:1496-1499.
9. Frank MJ, Seeberger LC, O'Reilly RC (2004): By carrot or by stick: Cognitive reinforcement learning in parkinsonism. Science 306:1940-1943. (Pubitemid 39627859)
10. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD (2006): Dopamine- dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442:1042-1045. (Pubitemid 44330261)
11. Cools R, Frank MJ, Gibbs SE, Miyakawa A, Jagust W, D'EspositoM(2009): Striatal dopamine predicts outcome-specific reversal learning and its sensitivity to dopaminergic drug administration. J Neurosci 29:1538-1543.
12. Bódi N, Kéri S, Nagy H, Moustafa A, Myers CE, Daw N, et al. (2009): Reward-learning and the novelty-seeking personality: A between-and within-subjects study of the effects of dopamine agonists on young Parkinson's patients. Brain 132:2385-2395.
13. Rutledge RB, Lazzaro SC, Lau B, Myers CE, Gluck MA, GlimcherPW(2009): Dopaminergic drugs modulate learning rates and perseveration in Parkinson's patients in a dynamic foraging task. J Neurosci 29:15104-15114.
14. Palminteri S, Lebreton M, Worbe Y, Grabli D, Hartmann A, PessiglioneM (2009): Pharmacological modulation of subliminal learning in Parkinson's and Tourette's syndromes. Proc Natl Acad Sci 106:19179-19184.
15. Grossberg S (1988): Neural Networks and Natural Intelligence. Cambridge, MA: MIT Press.
16. Guarraci FA, Kapp BS (1999): An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav Brain Res 99:169-179. (Pubitemid 29083443)
17. Coizet V, Dommett E, Redgrave P, Overton P (2006): Nociceptive responses of midbrain dopaminergic neurones are modulated by the superior colliculus in the rat. Neuroscience 139:1479-1493.
18. Matsumoto M, Hikosaka O (2009): Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459: 837-841.
19. Mirenowicz J, Schultz W (1996): Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379: 449-451. (Pubitemid 26039524)
20. Ungless MA, Magill PJ, Bolam JP (2004): Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303: 2040-2042. (Pubitemid 38393283)
21. Bromberg-Martin ES, Matsumoto M, Hikosaka O (2010): Distinct tonic and phasic anticipatory activity in lateral habenula and dopamine neurons. Neuron 67:144-155.
22. Soubrie P (1986): Reconciling the role of central serotonin neurons in human and animal behavior. Behav Brain Sci 9:319-335.
23. Deakin JFW, Graeff FG (1991): 5-HT and mechanisms of defence. J Psychopharmacol 5:305-315.
24. Abrams JK (2004): Anatomic and functional topography of the dorsal raphe nucleus. Ann N Y Acad Sci 1018:46-57.
25. Cools R, Roberts AC, Robbins TW (2008): Serotoninergic regulation of emotional and behavioural control processes. Trends Cogn Sci 12:31-40. (Pubitemid 50012215)
26. Lorrain DS, Riolo JV, Matuszewich L, Hull EM (1999): Lateral hypothalamic serotonin inhibits nucleus accumbens dopamine: Implications for sexual satiety. J Neurosci 19:7648-7652. (Pubitemid 29404620)
27. Jones S, Kauer JA (1999): Amphetamine depresses excitatory synaptic transmission via serotonin receptors in the ventral tegmental area. J Neurosci 19:9780-9787. (Pubitemid 30226651)
28. Daw ND, Kakade S, Dayan P (2002): Opponent interactions between serotonin and dopamine. Neural Netw 15:603-616. (Pubitemid 34951146)
29. Evers EAT, Cools R, Clark L, van der Veen FM, Jolles J, Sahakian BJ, et al. (2005): Serotonergic modulation of prefrontal cortex during negative feedback in probabilistic reversal learning. Neuropsychopharmacology 30:1138-1147. (Pubitemid 40720972)
30. Finger EC, Marsh AA, Buzas B, Kamel N, Rhodes R, Vythilingham M, et al. (2006): The impact of tryptophan depletion and 5-HTTLPR genotype on passive avoidance and response reversal instrumental learning tasks. Neuropsychopharmacology 32:206-215. (Pubitemid 44967799)
31. Cools R, Robinson OJ, Sahakian B (2007): Acute tryptophan depletion in healthy volunteers enhances punishment prediction but does not affect reward prediction. Neuropsychopharmacology 33:2291-2299. (Pubitemid 351992074)
32. Crockett MJ, Clark L, Robbins TW (2009): Reconciling the role of serotonin in behavioral inhibition and aversion: Acute tryptophan depletion abolishes punishment-induced inhibition in humans. J Neurosci 29:11993-11999.
33. Tanaka SC, Shishida K, Schweighofer N, Okamoto Y, Yamawaki S, Doya K (2009): Serotonin affects association of aversive outcomes to past actions. J Neurosci 29:15669-15674.
34. Pessiglione M, Petrovic P, Daunizeau J, Palminteri S, Dolan RJ, Frith CD (2008): Subliminal instrumental conditioning demonstrated in the human brain. Neuron 59:561-567.
35. Bloch MH, Leckman JF (2009): Clinical course of Tourette syndrome. J Psychosom Res 67:497-501.
36. Grados MA, Mathews CA (2009): Clinical phenomenology and phenotype variability in Tourette syndrome. J Psychosom Res 67:491-496.
37. Worbe Y, Mallet L, Golmard J, Béhar C, Durif F, Jalenques I, et al. (2010): Repetitive behaviours in patients with Gilles de la Tourette syndrome: Tics, compulsions, or both? PLoS ONE 5:e12959.
38. Endrass T, Kloft L, Kaufmann C, Kathmann N (2011): Approach and avoidance learning in obsessive-cumpulsive disorder. Depress Anxiety 28:166-172.
39. Schmidt L, d'Arc BF, Lafargue G, Galanaud D, Czernecki V, Grabli D, et al. (2008): Disconnecting force from money: Effects of basal ganglia damage on incentive motivation. Brain 1315:1303-1310.
40. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. (1998): The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 59(20 suppl):22-33. (Pubitemid 29001829)
41. Goodman WK, Price LH, Rasmussen SA, Mazure C, Fleischmann RL, Hill CL, et al. (1989): The Yale-Brown Obsessive Compulsive Scale. I. Development, use, and reliability. Arch Gen Psychiatry 46:1006-1011. (Pubitemid 19278229)
42. Zigmond AS, Snaith RP (1983): The Hospital Anxiety and Depression Scale. Acta Psychiatr Scand 67:361-370. (Pubitemid 13098606)
43. Aouizerate B, Guehl D, Cuny E, Rougier A, Bioulac B, Tignol J, et al. (2004): Pathophysiology of obsessive-compulsive disorder: A necessary link between phenomenology, neuropsychology, imagery and physiology. Prog Neurobiol 72:195-221. (Pubitemid 38591296)
44. Chamberlain S, Blackwell A, Fineberg N, Robbins T, Sahakian B (2005): The neuropsychology of obsessive compulsive disorder: The importance of failures in cognitive and behavioural inhibition as candidate endophenotypic markers. Neurosci Biobehav Rev 29:399-419. (Pubitemid 40488206)
45. Huey ED, Zahn R, Krueger F, Moll J, Kapogiannis D, Wassermann EM, et al. (2008): A psychological and neuroanatomical model of obsessivecompulsive disorder. J Neuropsychiatry Clin Neurosci 20:390-408.
46. Rotge J, Langbour N, Guehl D, Bioulac B, Jaafari N, Allard M, et al. (2009): Gray matter alterations in obsessive-compulsive disorder: An anatomic likelihood estimation meta-analysis. Neuropsychopharmacology 35: 686-691.
47. Remijnse PL, Nielen MMA, van Balkom AJLM, Cath DC, van Oppen P, Uylings HBM, et al. (2006): Reduced orbitofrontal-striatal activity on a reversal learning task in obsessive-compulsive disorder. Arch Gen Psychiatry 63:1225-1236. (Pubitemid 44708081)
48. Chamberlain SR, Menzies L, Hampshire A, Suckling J, Fineberg NA, del Campo N, et al. (2008): Orbitofrontal dysfunction in patients with obsessive- compulsive disorder and their unaffected relatives. Science 321: 421-422. (Pubitemid 352029981)
49. Cavanagh JF, Gründler TO, Frank MJ, Allen JJ (2010): Altered cingulate sub-region activation accounts for task-related dissociation in ERN amplitude as a function of obsessive-compulsive symptoms. Neuropsychologia 48:2098-2109.
50. Figee M, Vink M, de Geus F, Vulink N, Veltman DJ, Westenberg H, et al. (2011): Dysfunctional reward circuitry in obsessive-compulsive disorder. Biol Psychiatry 69:867-874.
51. Nielen MM, den Boer JA, Smid HGOM (2009): Patients with obsessive-compulsive disorder are impaired in associative learning based on external feedback. Psychol Med 39:1519-1526.
52. Worbe Y, Palminteri S, Hartmann A, Vidailhet M, Lehéricy S, Pessiglione M (2011): Reinforcement learning and Gilles de la Tourette syndrome: Dissociation of clinical phenotypes and pharmacological treatments. Arch Gen Psychiatry 68:1257-1266.
53. Clarke HF, Dalley JW, Crofts HS, Robbins TW, Roberts AC (2004): Cognitive inflexibility after prefrontal serotonin depletion. Science 304:878- 880.
54. Clarke HF, Walker SC, Crofts HS, Dalley JW, Robbins TW, Roberts AC (2005): Prefrontal serotonin depletion affects reversal learning but not attentional set shifting. J Neurosci 25:532-538. (Pubitemid 40105626)
55. Chamberlain SR, Müller U, Blackwell AD, Clark L, Robbins TW, Sahakian BJ (2006): Neurochemical modulation of response inhibition and probabilistic learning in humans. Science 311:861-863. (Pubitemid 43228852)
56. Ullsperger M (2010): Genetic association studies of performance monitoring and learning from feedback: The role of dopamine and serotonin. Neurosci Biobehav Rev 34:649-659.
57. Eagle DM, Bari A, RobbinsTW(2008): The neuropsychopharmacology of action inhibition: Cross-species translation of the stop-signal and go/ no-go tasks. Psychopharmacology 199 (3):439-456.
58. Pattij T, Vanderschuren LJ (2008): The neuropharmacology of impulsive behaviour. Trends Pharmacol Sci 29:192-199.
59. Rogers RD (2011): The roles of dopamine and serotonin in decision making: Evidence from pharmacological experiments in humans. Neuropsychopharmacology 36:114-132.
60. Cools R, Blackwell A, Clark L, Menzies L, Cox S, Robbins TW (2005): Tryptophan depletion disrupts the motivational guidance of goal-directed behavior as a function of trait impulsivity. Neuropsychopharmacology 30:1362-1373. (Pubitemid 40848090)
61. McCabe C, Mishor Z, Cowen PJ, Harmer CJ (2010): Diminished neural processing of aversive and rewarding stimuli during selective serotonin reuptake inhibitor treatment. Biol Psychiatry 67:439-445.
62. Rogers RD, Tunbridge EM, Bhagwagar Z, Drevets WC, Sahakian BJ, Carter CS (2002): Tryptophan depletion alters the decision-making of healthy volunteers through altered processing of reward cues. Neuropsychopharmacology 28:153-162.
63. Talbot PS, Watson DR, Barrett SL, Cooper SJ (2005): Rapid tryptophan depletion improves decision-making cognition in healthy humans without affecting reversal learning or set shifting. Neuropsychopharmacology 31:1519-1525.
64. Blair KS, Finger E, Marsh AA, Morton J, Mondillo K, Buzas B, et al. (2007): The role of 5-HTTLPR in choosing the lesser of two evils, the better of two goods: examining the impact of 5-HTTLPR genotype and tryptophan depletion in object choice. Psychopharmacology 196:29-38.
65. Artigas F, Romero L, de Montigny C, Blier P (1996): Acceleration of the effect of selected antidepressant drugs in major depression by 5-HT1A antagonists. Trends Neurosci 19:378-383. (Pubitemid 26270513)
66. Hjorth S, Bengtsson HJ, Kullberg A, Carlzon D, Peilot H, Auerbach SB (2000): Serotonin autoreceptor function and antidepressant drug action. J Psychopharmacol 14:177-185. (Pubitemid 30389492)
67. Schweighofer N, Bertin M, Shishida K, Okamoto Y, Tanaka SC, Yamawaki S, Doya K (2008): Low-serotonin levels increase delayed reward discounting in humans. J Neurosci 28:4528-4532.
68. Miyazaki K, Miyazaki KW, Doya K (2011): Activation of dorsal raphe serotonin neurons underlies waiting for delayed rewards. J Neurosci 31:469-479.