Valence-dependent influence of serotonin depletion on model-based choice strategy

Molecular Psychiatry

Volumn 21, Issue 5, 2016, Pages 624-629

  Worbe, Y ^a   Palminteri, S ^b,c   Savulich, G ^a,d   Daw, N D ^e   Fernandez Egea, E ^a,d,f   Robbins, T W ^a,d   Voon, V ^a,d  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c ECOLE NORMALE SUPÉRIEURE   (France)

^d UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^e NEW YORK UNIVERSITY   (United States)

^f CAMBRIDGESHIRE AND PETERBOROUGH NHS FOUNDATION TRUST   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

PLACEBO; SEROTONIN; TRYPTOPHAN;

ARTICLE; BEHAVIOR ASSESSMENT; BIOCHEMICAL ANALYSIS; DECISION MAKING; EATING DISORDER; HUMAN; MENTAL DISEASE; NEUROTRANSMISSION; OBSESSIVE COMPULSIVE DISORDER; PRIORITY JOURNAL; PUNISHMENT; REWARD; SEROTONIN RELEASE; SUBSTANCE ABUSE; TASK PERFORMANCE; ADULT; APPETITE; CONTROLLED STUDY; DEFICIENCY; DIET; DOUBLE BLIND PROCEDURE; FACTOR ANALYSIS; FEMALE; MALE; NEUROPSYCHOLOGICAL TEST; PHYSIOLOGY; PSYCHOLOGICAL MODEL; RANDOMIZED CONTROLLED TRIAL;

ADULT; APPETITIVE BEHAVIOR; CHOICE BEHAVIOR; DIET; DOUBLE-BLIND METHOD; FACTOR ANALYSIS, STATISTICAL; FEMALE; HUMANS; MALE; MODELS, PSYCHOLOGICAL; NEUROPSYCHOLOGICAL TESTS; PUNISHMENT; REWARD; SEROTONIN; TRYPTOPHAN;

EID: 84927932746     PISSN: 13594184     EISSN: 14765578     Source Type: Journal    
DOI: 10.1038/mp.2015.46     Document Type: Article

References (51)

1. Balleine BW, O'Doherty JP. Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 2010; 35: 48-69
2. Dickinson A. Actions and habits: the development of behavioural and autonomy. Philos Trans R Soc Lond B Biol Sci 1985; 308: 67-78
3. Dolan RJ, Dayan P. Goals and habits in the brain. Neuron 2013; 80: 312-325
4. Daw ND, Niv Y, Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 2005; 8: 1704-1711
5. Dezfouli A, Lingawi NW, Balleine BW. Habits as action sequences: hierarchical action control and changes in outcome value. Philos Trans R Soc Lond B Biol Sci 2014; 369: doi: 10.1098/rstb.2013.0482
6. Wunderlich K, Dayan P, Dolan RJ. Mapping value based planning and extensively trained choice in the human brain. Nat Neurosci 2012; 15: 786-791
7. Smittenaar P, Fitzgerald TH, Romei V, Wright ND, Dolan RJ. Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans. Neuron 2013; 80: 914-919
8. Frank MJ, Seeberger LC, O'Reilly RC. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 2004; 306: 1940-1943
9. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 2006; 442: 1042-1045
10. Worbe Y, Palminteri S, Hartmann A, Vidailhet M, Lehericy S, Pessiglione M. Reinforcement learning and gilles de la tourette syndrome: dissociation of clinical phenotypes and pharmacological treatments. Arch Gen Psychiatry 2011; 68: 1257-1266
11. Wunderlich K, Smittenaar P, Dolan RJ. Dopamine enhances model-based over model-free choice behavior. Neuron 2012; 75: 418-424
12. Boureau YL, Dayan P. Opponency revisited: competition and cooperation between dopamine and serotonin. Neuropsychopharmacology 2011; 36: 74-97
13. Dayan P, Huys QJ. Serotonin in affective control. Annu Rev Neurosci 2009; 32: 95-126
14. Palminteri S, Clair AH, Mallet L, Pessiglione M. Similar improvement of reward and punishment learning by serotonin reuptake inhibitors in obsessive-compulsive disorder. Biol Psychiatry 2012; 72: 244-250
15. Miyazaki KW, Miyazaki K, Doya K. Activation of dorsal raphe serotonin neurons is necessary for waiting for delayed rewards. J Neurosci 2012; 32: 10451-10457
16. Miyazaki KW, Miyazaki K, Tanaka KF, Yamanaka A, Takahashi A, Tabuchi S et al. Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards. Curr Biol 2014; 24: 2033-2040
17. Schweighofer N, Bertin M, Shishida K, Okamoto Y, Tanaka SC, Yamawaki S et al. Low-serotonin levels increase delayed reward discounting in humans. J Neurosci 2008; 28: 4528-4532
18. Den Ouden HE, Swart JC, Schmidt K, Fekkes D, Geurts DE, Cools R. Acute serotonin depletion releases motivated inhibition of response vigour. Psychopharmacology (Berl) 2014; 232: 1303-1312
19. Den Ouden HE, Daw ND, Fernandez G, Elshout JA, Rijpkema M, Hoogman M et al. Dissociable effects of dopamine and serotonin on reversal learning. Neuron 2013; 80: 1090-1100
20. Crockett MJ, Clark L, Robbins TW. Reconciling the role of serotonin in behavioral inhibition and aversion: acute tryptophan depletion abolishes punishmentinduced inhibition in humans. J Neurosci 2009; 29: 11993-11999
21. Geurts DE, Huys QJ, Den Ouden HE, Cools R. Serotonin and aversive Pavlovian control of instrumental behavior in humans. J Neurosci 2013; 33: 18932-18939
22. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ. Model-based influences on humans' choices and striatal prediction errors. Neuron 2011; 69: 1204-1215
23. Ardis TC, Cahir M, Elliott JJ, Bell R, Reynolds GP, Cooper SJ. Effect of acute tryptophan depletion on noradrenaline and dopamine in the rat brain. J Psychopharmacol 2009; 23: 51-55
24. Biggio G, Fadda F, Fanni P, Tagliamonte A, Gessa GL. Rapid depletion of serum tryptophan, brain tryptophan, serotonin and 5-hydroxyindoleacetic acid by a tryptophan-free diet. Life Sci 1974; 14: 1321-1329
25. Carpenter LL, Anderson GM, Pelton GH, Gudin JA, Kirwin PD, Price LH et al. Tryptophan depletion during continuous CSF sampling in healthy human subjects. Neuropsychopharmacology 1998; 19: 26-35
26. Cox SM, Benkelfat C, Dagher A, Delaney JS, Durand F, Kolivakis T et al. Effects of lowerd serotonin transmission on cocaine-induced striatal dopamine response: PET (11C)raclopride study in humans. Br J Psychiatry 2011; 199: 391-397
27. Daw N, Kakadeb S, Dayan P. Opponent interactions between serotonin and dopamine. Neural Networks 2002; 15: 603-616
28. Cools R, Nakamura K, Daw ND. Serotonin and dopamine: unifying affective, activational, and decision functions. Neuropsychopharmacology 2011; 36: 98-113
29. Niv Y, Daw ND, Joel D, Dayan P. Tonic dopamine: opportunity coast and the control of response vigor. Psychopharmacology 2007; 191: 507-520
30. Keramati M, Dezfouli A, Piray P. Speed/accuracy trade-off between the habitual and the goal-directed process. PLoS Comput Biol 2011; 7: e1002055
31. Dayan P. Instrumental vigor in punishment and reward. Eur J Neurosci 2012; 35: 1152-1168
32. Cowen P, Sherwood AC. The role of serotonin in cognitive function: evidence from recent studies and implications for understanding depression. J Psychopharmacol 2013; 27: 575-583
33. Otto AR, Raiob CM, Chiangb A, Phelpsa EA, Daw ND. Working-memory capacity protects model-based learning from stress. PNAS 2013; 110: 20941-20946
34. Courville AC, Daw N, Touretzk DS. Bayesian theories of conditioning in a changing world. Trends Cogn Sci 2006; 10: 294-300
35. Behrens TE, Woolrich MW, Walton ME, Rushworth MF. Learning the value of information in an uncertain world. Nat Neurosci 2007; 10: 1214-1221
36. Koot S, Zoratto F, Cassano T, Colangeli R, Laviola G, van Den Bos R et al. Compromised decision-making and increased gambling proneness following dietary serotonin depletion in rats. Neuropharmacology 2012; 62: 1640-1650
37. Long AB, Kuhn CM, Platt ML. Serotonin shapes risky decision making in monkeys. Soc Cogn Affect Neurosci 2009; 4: 346-356
38. Macoveanu J, Rowe JB, Hornboll B, Elliott R, Paulson OB, Knudsen GM et al. Playing it safe but losing anyway-serotonergic signaling of negative outcomes in dorsomedial prefrontal cortex in the context of risk-Aversion. Eur Neuropsychopharmacol 2013; 23: 919-930
39. Worbe Y, Savulich G, Voon V, Fernandez-Egea E, Robbins TW. Serotonin depletion induces 'waiting impulsivity' on the human four choice serial reaction time task: cross-species translational significance. Neuropsychopharmacology 2014; 39: 1519-1526
40. Crockett MJ, Clark L, Roiser JP, Robinson OJ, Cools R, Chase HW et al. Converging evidence for central 5-HT effects in acute tryptophan depletion. Mol Psychiatry 2012; 17: 121-123
41. Palminteri S, Lebreton M, Worbe Y, Grabli D, Hartmann A, Pessiglione M. Pharmacological modulation of subliminal learning in Parkinson's and Tourette's syndromes. Proc Natl Acad Sci USA 2009; 106: 19179-19184
42. McCabe C, Mishor Z, Cowen PJ, Harmer CJ. Diminished neural processing of aversive and rewarding stimuli during selective serotonin reuptake inhibitor treatment. Biol Psychiatry 2010; 67: 439-445
43. Seymour B, Daw ND, Roiser JD, Dayan P, Dolan R. Serotonin selectively modulates reward value in human decision-making. J Neurosci 2012; 31: 5833-5842
44. Tricomi EM, Balleine BW, O'Doherty JP. A specific role for posterior dorsolateral striatum in human habit learning. Eur J Neurosci 2009; 29: 2225-2232
45. Valentin VV, Dickinson A, O'Doherty JP. Determining the neural substrates of goaldirected learning in the human brain. J Neurosci 2007; 27: 4019-4026
46. Gläscher J, Daw N, Dayan P, O'Doherty J. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 2010; 66: 585-595
47. Killcross S, Coutoureau E. Coordination of action and habits in the medial prefrontal cortex of rats. Cereb Cortex 2003; 13: 400-408
48. Griffiths KR, Morris RW, Balleine BW. Translatinal studies of goal-directed action as a framework for classifying deficit across psychiatric disorders. Front Syst Neurosci 2014; 8: 101
49. Gillan CM, Robbins TW. Goal-directed learning and obsessive-compulsive disorders. Philos Trans R Soc Lond B Biol Sci 2014; 369: 560: doi: 10.1098/ rstb.2013.0475
50. Gillan CM, Papmeyer M, Morein-Zamir S, Sahakian BJ, Fineberg NA, Robbins TW et al. Disruption in the balance between goal-directed behavior and habit learning in obsessive-compulsive disorder. Am J Psychiatry 2011; 168: 718-726
51. Voon V, Derbyshire K, Rück C, Irvine MA, Worbe Y, Enander J et al. Disorders of compulsivity: a common bias towards learning habits. Mol Psychiatry 2014; 20: 345-352