The role of habit in compulsivity

European Neuropsychopharmacology

Volumn 26, Issue 5, 2016, Pages 828-840

  Gillan, Claire M ^a,b,c   Robbins, Trevor W ^b,c   Sahakian, Barbara J ^b,c   van den Heuvel, Odile A ^d,e   van Wingen, Guido ^f  

^a NEW YORK UNIVERSITY   (United States)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^d VU UNIVERSITY MEDICAL CENTER   (Netherlands)

^e HAUKELAND UNIVERSITY HOSPITAL   (Norway)

^f UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Compulsivity; Goal directed; Habit; Learning; OCD

Indexed keywords

ANXIETY; ARTICLE; BEHAVIOR CONTROL; COMPULSION; HABIT; HUMAN; PRIORITY JOURNAL; STIMULUS RESPONSE; STRESS; ANIMAL; BIOLOGICAL MODEL; COMPULSIVE PERSONALITY DISORDER; MENTAL STRESS; MULTIMODALITY CANCER THERAPY; OBSESSIVE COMPULSIVE DISORDER; PATHOPHYSIOLOGY; PSYCHOLOGY;

NEUROLEPTIC AGENT;

ANIMALS; ANTIPSYCHOTIC AGENTS; ANXIETY; COMBINED MODALITY THERAPY; COMPULSIVE BEHAVIOR; COMPULSIVE PERSONALITY DISORDER; HABITS; HUMANS; MODELS, NEUROLOGICAL; OBSESSIVE-COMPULSIVE DISORDER; STRESS, PSYCHOLOGICAL;

EID: 84953231771     PISSN: 0924977X     EISSN: 18737862     Source Type: Journal    
DOI: 10.1016/j.euroneuro.2015.12.033     Document Type: Article

References (146)

1. Adams C. Post-conditioning devaluation of an instrumental reinforcer has no effect on extinction performance. Q. J. Exp. Psychol. 1980, 32:447-458.
2. Adams C.D. Variations in the sensitivity of instrumental responding to reinforcer devaluation. Q. J. Exp. Psychol. Sect. B -Comp. Physiol. Psychol. 1982, 34:77-98.
3. Adler C.M., McDonough-Ryan P., Sax K.W., Holland S.K., Arndt S., Strakowski S.M. fMRI of neuronal activation with symptom provocation in unmedicated patients with obsessive compulsive disorder. J. Psychiatr. Res. 2000, 34:317-324.
4. Ahmari S., Spellman T., Douglass N., Kheirbek M., Simpson H., Deisseroth K., Gordon J., Hen R. Repeated cortico-striatal stimulation generates persistent OCD-like behavior. Science 2013, 340:1234-1239.
5. Alvares G.A., Balleine B.W., Guastella A.J. Impairments in goal-directed actions predict treatment response to cognitive-behavioral therapy in social anxiety disorder. Plos. One 2014, 9:e94778.
6. APA Diagnostic and statistical manual of mental disorders 2013, American Psychiatric Publishing, Arlington, VA.
7. Arnsten A.F. Stress signalling pathways that impair prefrontal cortex structure and function. Nat. Rev. Neurosci. 2009, 10:410-422.
8. Balleine B.W. Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiol. Behav. 2005, 86:717-730.
9. Balleine B.W., Liljeholm M., Ostlund S.B. The integrative function of the basal ganglia in instrumental conditioning. Behav. Brain Res. 2009, 199:43-52.
10. Balleine B.W., O'Doherty J.P. Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 2010, 35:48-69.
11. Bari A., Robbins T.W. Inhibition and impulsivity: behavioral and neural basis of response control. Prog. Neurobiol. 2013, 108:44-79.
12. Bartz J.A., Hollander E. Is obsessive-compulsive disorder an anxiety disorder?. Prog. Neuropsychopharmacol. Biol. Psychiatry 2006, 30:338-352.
13. Baxter L.R., Schwartz J.M., Bergman K.S., Szuba M.P., Guze B.H., Mazziotta J.C., Alazraki A., Selin C.E., Ferng H.K., Munford P., et al. Caudate glucose metabolic rate changes with both drug and behavior therapy for obsessive-compulsive disorder. Arch. Gen. Psychiatry 1992, 49:681-689.
14. Bernheimer H., Birkmayer W., Hornykiewicz O., Jellinger K., Seitelberger F. Brain dopamine and the syndromes of Parkinson and Huntington. Clinical, morphological and neurochemical correlations. J. Neurol. Sci. 1973, 20:415-455.
15. Bloch M.H., McGuire J., Landeros-Weisenberger A., Leckman J.F., Pittenger C. Meta-analysis of the dose-response relationship of SSRI in obsessive-compulsive disorder. Mol. Psychiatry 2010, 15:850-855.
16. Brodersen K.H., Deserno L., Schlagenhauf F., Lin Z., Penny W.D., Buhmann J.M., Stephan K.E. Dissecting psychiatric spectrum disorders by generative embedding. Neuroimage Clin. 2014, 4:98-111.
17. Burguiere E., Monteiro P., Feng G., Graybiel A. Optogenetic stimulation of lateral orbitofronto-striatal pathway suppresses compulsive behaviors. Science 2013, 340:1243-1246.
18. Burguière E., Monteiro P., Mallet L., Feng G., Graybiel A.M. Striatal circuits, habits and implications for obsessive-compulsive disorder. Curr. Opin. Neurobiol. 2015, 30:59-65.
19. Chamberlain S.R., Fineberg N.A., Blackwell A.D., Robbins T.W., Sahakian B.J. Motor inhibition and cognitive flexibility in obsessive-compulsive disorder and trichotillomania. Am. J. Psychiatry 2006, 163:1282-1284.
20. Chamberlain S.R., Fineberg N.A., Menzies L.A., Blackwell A.D., Bullmore E.T., Robbins T.W., Sahakian B.J. Impaired cognitive flexibility and motor inhibition in unaffected first-degree relatives of patients with obsessive-compulsive disorder. Am. J. Psychiatry 2007, 164:335-338.
21. Chambers C.D., Garavan H., Bellgrove M.A. Insights into the neural basis of response inhibition from cognitive and clinical neuroscience. Neurosci. Biobehav. Rev. 2009, 33:631-646.
22. Clair A.H., N'diaye K., Baroukh T., Pochon J.B., Morgiève M., Hantouche E., Falissard B., Pelissolo A., Mallet L. Excessive checking for non-anxiogenic stimuli in obsessive-compulsive disorder. Eur. Psychiatry 2013, 28:507-513.
23. Clarke H.F., Robbins T.W., Roberts A.C. Lesions of the medial striatum in monkeys produce perseverative impairments during reversal learning similar to those produced by lesions of the orbitofrontal cortex. J. Neurosci. 2008, 28:10972-10982.
24. Clarke H.F., Walker S.C., Crofts H.S., Dalley J.W., Robbins T.W., Roberts A.C. Prefrontal serotonin depletion affects reversal learning but not attentional set shifting. J. Neurosci. 2005, 25:532-538.
25. Cools R., D'Esposito M. Inverted-U-shaped dopamine actions on human working memory and cognitive control. Biol. Psychiatry 2011, 69:e113-e125.
26. Cools R., Robinson O.J., Sahakian B. Acute tryptophan depletion in healthy volunteers enhances punishment prediction but does not affect reward prediction. Neuropsychopharmacology 2008, 33:2291-2299.
27. Corbit L.H., Balleine B.W. The role of prelimbic cortex in instrumental conditioning. Behav. Brain Res. 2003, 146:145-157.
28. Corbit L.H., Nie H., Janak P.H. Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum. Biol. Psychiatry 2012, 72:389-395.
29. Crockett M.J., Clark L., Robbins T.W. Reconciling the role of serotonin in behavioral inhibition and aversion: acute tryptophan depletion abolishes punishment-induced inhibition in humans. J. Neurosci. 2009, 29:11993-11999.
30. Daruna J.H., Barnes P.A.G. A neurodevelopmental view of impulsivity and its relationship to the superfactors of personality. The impulsive client: theory, research and treatment 1993, American Psychological Association, Washington, DC. W. McCown (Ed.).
31. Davis M., Whalen P.J. The amygdala: vigilance and emotion. Mol. Psychiatry 2001, 6:13-34.
32. Daw N.D., Gershman S.J., Seymour B., Dayan P., Dolan R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 2011, 69(6).
33. de Wit S., Barker R.A., Dickinson A.D., Cools R. Habitual versus goal-directed action control in Parkinson disease. Journal of Cognitive Neuroscience 2011, 23(5):1218-1229.
34. de Wit S., Corlett P.R., Aitken M.R., Dickinson A., Fletcher P.C. Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans. J. Neurosci. 2009, 29:11330-11338.
35. de Wit S., Standing H.R., DeVito E.E., Robinson O.J., Ridderinkhof K.R., Robbins T.W., Sahakian B.J. Reliance on habits at the expense of goal-directed control following dopamine precursor depletion. Psychopharmacology 2012, 219:621-631.
36. de Wit S., Watson P., Harsay H.A., Cohen M.X., van de Vijver I., Ridderinkhof K.R. Corticostriatal connectivity underlies individual differences in the balance between habitual and goal-directed action control. J. Neurosci. 2012, 32:12066-12075.
37. de Wit S.J., de Vries F.E., van der Werf Y.D., Cath D.C., Heslenfeld D.J., Veltman E.M., van Balkom A.J., Veltman D.J., van den Heuvel O.A. Presupplementary motor area hyperactivity during response inhibition: a candidate endophenotype of obsessive-compulsive disorder. Am. J. Psychiatry 2012, 169:1100-1108.
38. Declercq M., De Houwer J. On the role of US expectancies in avoidance behavior. Psychon. Bull. Rev. 2008, 15:99-102.
39. Dek E.C., van den Hout M.A., Engelhard I.M., Giele C.L., Cath D.C. Perseveration causes automatization of checking behavior in obsessive-compulsive disorder. Behav. Res. Ther. 2015, 71:1-9.
40. Denys D., Zohar J., Westenberg H.G.M. The role of dopamine in obsessive-compulsive disorder: preclinical and clinical evidence. J. Clin. Psychiatry 2004, 65:11-17.
41. Deserno L., Huys Q.J., Boehme R., Buchert R., Heinze H.J., Grace A.A., Schlagenhauf F. Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making. Proceedings of the National Academy of Sciences 2015, 112(5):1595-1600.
42. Dias R., Robbins T.W., Roberts A.C. Dissociation in prefrontal cortex of affective and attentional shift. Nature 1996, 380:69-72.
43. Dias-Ferreira E., Sousa J.C., Melo I., Morgado P., Mesquita A.R., Cerqueira J.J., Costa R.M., Sousa N. Chronic stress causes frontostriatal reorganization and affects decision-making. Science 2009, 325:621-625.
44. Dickinson A. Actions and habits: the development of behavioural autonomy. Philos. Trans. R. Soc. Lond. Ser. B, Biol. Sci. 1985, 308:67-78.
45. Dickinson A., Balleine B. Motivational control of goal-directed action. Anim. Learn. Behav. 1994, 22:1-18.
46. Dickinson A., Nicholas D.J., Adams C.D. The effect of the instrumental training contingency on susceptibility to reinforcer devaluation. Q. J. Exp. Psychol. Sect. B -Comp. Physiol. Psychol. 1983, 35(1):35-51.
47. Dickinson A., Wood N., Smith J.W. Alcohol seeking by rats: action or habit?. Q. J. Exp. Psychol. B 2002, 55:331-348.
48. Dolan R.J., Dayan P. Goals and habits in the brain. Neuron 2013, 80:312-325.
49. El Mansari M., Blier P. Mechanisms of action of current and potential pharmacotherapies of obsessive-compulsive disorder. Prog. Neuro -Psychopharmacol. Biol. Psychiatry 2006, 30:362-373.
50. el Mansari M., Bouchard C., Blier P. Alteration of serotonin release in the guinea pig orbito-frontal cortex by selective serotonin reuptake inhibitors. Relevance to treatment of obsessive-compulsive disorder. Neuropsychopharmacology 1995, 13:117-127.
51. Ersche K.D., Jones P.S., Williams G.B., Turton A.J., Robbins T.W., Bullmore E.T. Abnormal brain structure implicated in stimulant drug addiction. Science 2012, 335:601-604.
52. Everitt B.J., Dickinson A., Robbins T.W. The neuropsychological basis of addictive behaviour. Brain Res. Brain Res. Rev. 2001, 36:129-138.
53. Everitt B.J., Robbins T.W. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 2005, 8:1481-1489.
54. Faulkner P., Deakin J.F. The role of serotonin in reward, punishment and behavioural inhibition in humans: insights from studies with acute tryptophan depletion. Neurosci. Biobehav. Rev. 2014, 46P3:365-378.
55. Faure A., Haberland U., Conde F., El Massioui N. Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. J. Neurosci. 2005, 25:2771-2780.
56. Figee M., Luigjes J., Smolders R., Valencia-Alfonso C.E., van Wingen G., de Kwaasteniet B., Mantione M., Ooms P., de Koning P., Vulink N., Levar N., Droge L., van den Munckhof P., Schuurman P.R., Nederveen A., van den Brink W., Mazaheri A., Vink M., Denys D. Deep brain stimulation restores frontostriatal network activity in obsessive-compulsive disorder. Nat. Neurosci. 2013, 16:386-387.
57. Fineberg N.A., Reghunandanan S., Brown A., Pampaloni I. Pharmacotherapy of obsessive-compulsive disorder: evidence-based treatment and beyond. Aust. N Z. J. Psychiatry 2013, 47:121-141.
58. Foa E.B., Goldstein A. Continuous exposure and complete response prevention in the treatment of obsessive-compulsive neurosis. Behav. Ther. 1978, 9:821-829.
59. Foa E.B., Liebowitz M.R., Kozak M.J., Davies S., Campeas R., Franklin M.E., Huppert J.D., Kjernisted K., Rowan V., Schmidt A.B., Simpson H.B., Tu X. Randomized, placebo-controlled trial of exposure and ritual prevention, clomipramine and their combination in the treatment of obsessive-compulsive disorder. Am. J. Psychiatry 2005, 162:151-161.
60. Friedel E., Koch S.P., Wendt J., Heinz A., Deserno L., Schlagenhauf F. Devaluation and sequential decisions: linking goal-directed and model-based behaviour. Front. Hum. Neurosci. 2014, 8.
61. Furlong T.M., Jayaweera H.K., Balleine B.W., Corbit L.H. Binge-like consumption of a palatable food accelerates habitual control of behavior and is dependent on activation of the dorsolateral striatum. J. Neurosci. 2014, 34:5012-5022.
62. Gerdeman G.L., Partridge J.G., Lupica C.R., Lovinger D.M. It could be habit forming: drugs of abuse and striatal synaptic plasticity. Trends Neurosci. 2003, 26:184-192.
63. Gillan C.M., Apergis-Schoute A.M., Morein-Zamir S., Urcelay G.P., Sule A., Fineberg N.A., Sahakian B.J., Robbins T.W. Functional neuroimaging of avoidance habits in obsessive-compulsive disorder. Am. J. Psychiatry 2015, 172:284-293.
64. Gillan C.M., Morein-Zamir S., Kaser M., Fineberg N.A., Sule A., Sahakian B.J., Cardinal R.N., Robbins T.W. Counterfactual processing of economic action-outcome alternatives in obsessive-compulsive disorder: further evidence of impaired goal-directed behavior. Biol. Psychiatry 2014, 75:639-646.
65. Gillan C.M., Morein-Zamir S., Urcelay G.P., Sule A., Voon V., Apergis-Schoute A.M., Fineberg N.A., Sahakian B.J., Robbins T.W. Enhanced avoidance habits in obsessive-compulsive disorder. Biol. Psychiatry 2014, 75:631-638.
66. Gillan C.M., Otto A.R., Phelps E.A., Daw N.D. Model-based learning protects against forming habits. Cognitive, Affective, & Behavioral Neuroscience 2015, 1-14.
67. Gillan C.M., Papmeyer M., Morein-Zamir S., Sahakian B.J., Fineberg N.A., Robbins T.W., de Wit S. Disruption in the balance between goal-directed behavior and habit learning in obsessive-compulsive disorder. Am. J. Psychiatry 2011, 168:718-726.
68. Gillan C.M., Robbins T.W. Goal-directed learning and obsessive-compulsive disorder. Philosophical Transactions of the Royal Society B. Biological Sciences 2014, 369(1655):20130475.
69. Gillan C.M., Sahakian B.J. Which is the driver, the obsessions or the compulsions, in OCD?. Neuropsychopharmacology 2015, 40:247-248.
70. Gläscher J., Daw N., Dayan P., O'Doherty J.P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 2010, 66(4):585-595.
71. Godier L.R., Park R.J. Compulsivity in anorexia nervosa: a transdiagnostic concept. Front. Psychol. 2014, 5:778.
72. Graybiel A.M., Rauch S.L. Toward a neurobiology of obsessive-compulsive disorder. Neuron 2000, 28:343-347.
73. Gremel C.M., Costa R.M. Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions. Nat. Commun. 2013, 4:2264.
74. Groenewegen H.J., van den Heuvel O.A., Cath D.C., Voorn P., Veltman D.J. Does an imbalance between the dorsal and ventral striatopallidal systems play a role in Tourette's syndrome? A neuronal circuit approach. Brain Dev. 2003, 25(Suppl 1):S3-S14.
75. Hogarth L., Attwood A., Bate H., Munafo M. Acute alcohol impairs human goal-directed action. Biol. Psychol. 2012, 90:154-160.
76. Hogarth L., Balleine B.W., Corbit L.H., Killcross S. Associative learning mechanisms underpinning the transition from recreational drug use to addiction. Ann. N Y. Acad. Sci. 2013, 1282:12-24.
77. Hollander E., Kaplan A., Stahl S.M. A double-blind, placebo-controlled trial of clonazepam in obsessive-compulsive disorder. World J. Biol. Psychiatry 2003, 4:30-34.
78. Insel T.R., Sahakian B.J. Drug research: a plan for mental illness. Nature 2012, 483:269.
79. Insel T.R., Voon V., Nye J.S., Brown V.J., Altevogt B.M., Bullmore E.T., Goodwin G.M., Howard R.J., Kupfer D.J., Malloch G., Marston H.M., Nutt D.J., Robbins T.W., Stahl S.M., Tricklebank M.D., Williams J.H., Sahakian B.J. Innovative solutions to novel drug development in mental health. Neurosci. Biobehav. Rev. 2013, 37:2438-2444.
80. Javaras K.N., Laird N.M., Reichborn-Kjennerud T., Bulik C.M., Pope H.G., Hudson J.I. Familiality and heritability of binge eating disorder: results of a case-control family study and a twin study. Int. J. Eat. Disord. 2008, 41:174-179.
81. Kim J.J., Lee H.J., Han J.S., Packard M.G. Amygdala is critical for stress-induced modulation of hippocampal long-term potentiation and learning. J. Neurosci. 2001, 21:5222-5228.
82. Korff S., Harvey B.H. Animal models of obsessive-compulsive disorder: rationale to understanding psychobiology and pharmacology. Psychiatr. Clin. North Am. 2006, 29:371-390.
83. Le Jeune F., Vérin M., N'Diaye K., Drapier D., Leray E., Du Montcel S.T., Baup N., Pelissolo A., Polosan M., Mallet L., Yelnik J., Devaux B., Fontaine D., Chereau I., Bourguignon A., Peron J., Sauleau P., Raoul S., Garin E., Krebs M.O., Jaafari N., Millet B., group, F.S.d.l.t.o.c.S.s. Decrease of prefrontal metabolism after subthalamic stimulation in obsessive-compulsive disorder: a positron emission tomography study. Biol. Psychiatry 2010, 68:1016-1022.
84. Lee S.W., Shimojo S., O'Doherty J.P. Neural computations underlying arbitration between model-based and model-free learning. Neuron 2014, 81:687-699.
85. Liljeholm M., Dunne S., O'Doherty J.P. Differentiating neural systems mediating the acquisition vs. expression of goal-directed and habitual behavioral control. Eur. J. Neurosci. 2015, 41:1358-1371.
86. Lingawi N.W., Balleine B.W. Amygdala central nucleus interacts with dorsolateral striatum to regulate the acquisition of habits. J. Neurosci. 2012, 32:1073-1081.
87. Mataix-Cols D., Cullen S., Lange K., Zelaya F., Andrew C., Amaro E., Brammer M.J., Williams S.C.R., Speckens A., Phillips M.L. Neural correlates of anxiety associated with obsessive-compulsive symptom dimensions in normal volunteers. Biol. Psychiatry 2003, 53:482-493.
88. Mataix-Cols D., Wooderson S., Lawrence N., Brammer M.J., Speckens A., Phillips M.L. Distinct neural correlates of washing, checking, and hoarding symptom dimensions in obsessive-compulsive disorder. Arch. Gen. Psychiatry 2004, 61:564-576.
89. McClernon F.J., Hiott F.B., Huettel S.A., Rose J.E. Abstinence-induced changes in self-report craving correlate with event-related FMRI responses to smoking cues. Neuropsychopharmacology 2005, 30:1940-1947.
90. Menzies L., Chamberlain S.R., Laird A.R., Thelen S.M., Sahakian B.J., Bullmore E.T. Integrating evidence from neuroimaging and neuropsychological studies of obsessive-compulsive disorder: the orbitofronto-striatal model revisited. Neurosci. Biobehav. Rev. 2008, 32:525-549.
91. Meunier D., Ersche K.D., Craig K.J., Fornito A., Merlo-Pich E., Fineberg N.A., Bullmore E.T. Brain functional connectivity in stimulant drug dependence and obsessive-compulsive disorder. Neuroimage 2012, 59(2):1461-1468.
92. Meyer V. Modification of expectations in cases with obsessional rituals. Behav. Res. Ther. 1966, 4:273-280.
93. Milad M.R., Furtak S.C., Greenberg J.L., Keshaviah A., Im J.J., Falkenstein M.J., Jenike M., Rauch S.L., Wilhelm S. Deficits in conditioned fear extinction in obsessive-compulsive disorder and neurobiological changes in the fear circuit. JAMA Psychiatry 2013, 70:608-618.
94. Montague P.R., Dolan R.J., Friston K.J., Dayan P. Computational psychiatry. Trends Cognit. Sci. 2012, 16.
95. Morein-Zamir S., Papmeyer M., Gillan C.M., Crockett M.J., Fineberg N.A., Sahakian B.J., Robbins T.W. Punishment promotes response control deficits in obsessive-compulsive disorder: evidence from a motivational go/no-go task. Psychol. Med. 2013, 43:391-400.
96. Morgiève M., N'Diaye K., Haynes W.I., Granger B., Clair A.H., Pelissolo A., Mallet L. Dynamics of psychotherapy-related cerebral haemodynamic changes in obsessive compulsive disorder using a personalized exposure task in functional magnetic resonance imaging. Psychol. Med. 2014, 44:1461-1473.
97. Morris R.W., Quail S., Griffiths K.R., Green M.J., Balleine B.W. Corticostriatal control of goal-directed action is impaired in schizophrenia. Biol. Psychiatry 2014.
98. Nakatani E., Nakgawa A., Ohara Y., Goto S., Uozumi N., Iwakiri M., Yamamoto Y., Motomura K., Iikura Y., Yamagami T. Effects of behavior therapy on regional cerebral blood flow in obsessive-compulsive disorder. Psychiatry Res. 2003, 124:113-120.
99. Nelson A., Killcross S. Amphetamine exposure enhances habit formation. J. Neurosci. 2006, 26:3805-3812.
100. Otto A.R., Gershman S.J., Markman A.B., Daw N.D. The curse of planning: dissecting multiple reinforcement-learning systems by taxing the central executive. Psychol. Sci. 2013, 24:751-761.
101. Otto A.R., Raio C.M., Chiang A., Phelps E.A., Daw N.D. Working-memory capacity protects model-based learning from stress. Proc. Natl. Acad. Sci. USA 2013, 110:20941-20946.
102. Otto A.R., Skatova A., Madlon-Kay S., Daw N.D. Cognitive control predicts use of model-based reinforcement learning. J. Cogn. Neurosci. 2014, 27(2):1-15.
103. Packard M.G., Cahill L., McGaugh J.L. Amygdala modulation of hippocampal-dependent and caudate nucleus-dependent memory processes. Proc. Natl. Acad. Sci. USA 1994, 91:8477-8481.
104. Packard M.G., Wingard J.C. Amygdala and "emotional" modulation of the relative use of multiple memory systems. Neurobiol. Learn. Mem. 2004, 82:243-252.
105. Palminteri S., Clair A.H., Mallet L., Pessiglione M. Similar improvement of reward and punishment learning by serotonin reuptake inhibitors in obsessive-compulsive disorder. Biol. Psychiatry 2012, 72:244-250.
106. Poyurovsky M., Koran L.M. Obsessive-compulsive disorder (OCD) with schizotypy vs. schizophrenia with OCD: diagnostic dilemmas and therapeutic implications. J. Psychiatr. Res. 2005, 39:399-408.
107. Qin S., Hermans E.J., van Marle H.J., Luo J., Fernandez G. Acute psychological stress reduces working memory-related activity in the dorsolateral prefrontal cortex. Biol. Psychiatry 2009, 66:25-32.
108. Rachman S. A cognitive theory of obsessions. Behav. Res. Ther. 1997, 35:793-802.
109. Rauch S.L., Jenike M.A., Alpert N.M., Baer L., Breiter H.C., Savage C.R., Fischman A.J. Regional cerebral blood flow measured during symptom provocation in obsessive-compulsive disorder using oxygen 15-labeled carbon dioxide and positron emission tomography. Arch. Gen. Psychiatry 1994, 51:62-70.
110. Robbins T.W., Everitt B.J. Drug addiction: bad habits add up. Nature 1999, 398:567-570.
111. Robbins T.W., Gillan C.M., Smith D.G., de Wit S., Ersche K.D. Neurocognitive endophenotypes of impulsivity and compulsivity: towards dimensional psychiatry. Trends Cogn. Sci. 2012, 16:81-91.
112. Robinson O.J., Cools R., Sahakian B.J. Tryptophan depletion disinhibits punishment but not reward prediction: implications for resilience. Psychopharmacol. (Berl.) 2012, 219:599-605.
113. Rubia K., Halari R., Cubillo A., Smith A.B., Mohammad A.M., Brammer M., Taylor E. Methylphenidate normalizes fronto-striatal underactivation during interference inhibition in medication-naïve boys with attention-deficit hyperactivity disorder. Neuropsychopharmacology 2011, 36:1575-1586.
114. Sahakian B.J. What do experts think we should do to achieve brain health?. Neurosci. Biobehav. Rev. 2014, 43:240-258.
115. Sahakian B.J., Malloch G., Kennard C., Group M.H.R. A UK strategy for mental health and wellbeing. Lancet 2010, 375:1854-1855.
116. Salkovskis P.M. Obsessional-compulsive problems: a cognitive-behavioural analysis. Behav. Res. Ther. 1985, 23:571-583.
117. Schneier F.R., Johnson J., Hornig C.D., Liebowitz M.R., Weissman M.M. Social phobia. Comorbidity and morbidity in an epidemiologic sample. Arch. Gen. Psychiatry 1992, 49:282-288.
118. Schwabe L., Hoffken O., Tegenthoff M., Wolf O.T. Preventing the stress-induced shift from goal-directed to habit action with a beta-adrenergic antagonist. J. Neurosci. 2011, 31:17317-17325.
119. Schwabe L., Tegenthoff M., Hoffken O., Wolf O.T. Concurrent glucocorticoid and noradrenergic activity shifts instrumental behavior from goal-directed to habitual control. J. Neurosci. 2010, 30:8190-8196.
120. Schwabe L., Wolf O.T. Stress prompts habit behavior in humans. J. Neurosci. 2009, 29:7191-7198.
121. Schwartz J.M., Stoessel P.W., Baxter L.R., Martin K.M., Phelps M.E. Systematic changes in cerebral glucose metabolic rate after successful behavior modification treatment of obsessive-compulsive disorder. Arch. Gen. Psychiatry 1996, 53:109-113.
122. Selye H. The evolution of the stress concept. Am. Sci. 1973, 61:692-699.
123. Sjoerds Z., de Wit S., van den Brink W., Robbins T.W., Beekman A.T., Penninx B.W., Veltman D.J. Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients. Transl. Psychiatry 2013, 3:e337.
124. Soares J.M., Sampaio A., Ferreira L.M., Santos N.C., Marques F., Palha J.A., Cerqueira J.J., Sousa N. Stress-induced changes in human decision-making are reversible. Transl. Psychiatry 2012, 2:e131.
125. Sutton R., Barto A. Reinforcement Learning: an Introduction 1998, MIT Press, Cambridge, Massachusetts.
126. Swedo S.E., Pietrini P., Leonard H.L., Schapiro M.B., Rettew D.C., Goldberger E.L., Rapoport S.I., Rapoport J.L., Grady C.L. Cerebral glucose metabolism in childhood-onset obsessive-compulsive disorder. Revisualization during pharmacotherapy. Arch. Gen. Psychiatry 1992, 49:690-694.
127. Thorndike A. Animal intelligence: Experimental Studies 1911, Macmillan, New York.
128. Tolman E.C. Cognitive maps in rats and men. Psychological review 1948, 55(4):189.
129. Tricomi E., Balleine B.W., O'Doherty J.P. A specific role for posterior dorsolateral striatum in human habit learning. Eur. J. Neurosci. 2009, 29:2225-2232.
130. Ulrich-Lai Y.M., Herman J.P. Neural regulation of endocrine and autonomic stress responses. Nat. Rev. Neurosci. 2009, 10:397-409.
131. Valentin V.V., Dickinson A., O'Doherty J.P. Determining the neural substrates of goal-directed learning in the human brain. J. Neurosci. 2007, 27:4019-4026.
132. van Marle H.J., Hermans E.J., Qin S., Fernández G. From specificity to sensitivity: how acute stress affects amygdala processing of biologically salient stimuli. Biol. Psychiatry 2009, 66:649-655.
133. van Velzen L.S., de Wit S.J., Ćurĉić-Blake B., Cath D.C., van Vries F.E., Veltman D.J., van der Werf Y.D., van den Heuvel O.A. Altered inhibition-related frontolimbic connectivity in obsessive-compulsive disorder. Hum. Brain Mapp 2015.
134. van Velzen L.S., Vriend C., de Wit S.J., van den Heuvel O.A. Response inhibition and interference control in obsessive-compulsive spectrum disorders. Front. Hum. Neurosci. 2014, 8:419.
135. van Wingen G.A., Geuze E., Caan M.W., Kozicz T., Olabarriaga S.D., Denys D., Vermetten E., Fernandez G. Persistent and reversible consequences of combat stress on the mesofrontal circuit and cognition. Proc. Natl. Acad. Sci. USA 2012, 109:15508-15513.
136. van Wingen G.A., Geuze E., Vermetten E., Fernández G. Perceived threat predicts the neural sequelae of combat stress. Mol. Psychiatry 2011, 16:664-671.
137. Voon V., Derbyshire K., Rück C., Irvine M.A., Worbe Y., Enander J., Schreiber L.R., Gillan C., Fineberg N.A., Sahakian B.J., Robbins T.W., Harrison N.A., Wood J., Daw N.D., Dayan P., Grant J.E., Bullmore E.T. Disorders of compulsivity: a common bias towards learning habits. Mol. Psychiatry 2015, 20(3):345-352.
138. Vriend C., Pattij T., van der Werf Y.D., Voorn P., Booij J., Rutten S., Berendse H.W., van den Heuvel O.A. Depression and impulse control disorders in Parkinson's disease: two sides of the same coin?. Neurosci. Biobehav. Rev. 2014, 38:60-71.
139. Weddington W.W., Brown B.S., Cone E.J., Haertzen C.A., Dax E.M., Herning R.I., Michaelson B.S. Changes in mood, craving and sleep during acute abstinence reported by male cocaine addicts. NIDA Res. Monogr. 1990, 105:453-454.
140. Whiteside S.P., Port J.D., Abramowitz J.S. A meta-analysis of functional neuroimaging in obsessive-compulsive disorder. Psychiatry Res.-Neuroimaging 2004, 132:69-79.
141. Worbe Y., Palminteri S., Savulich G., Daw N.D., Fernandez-Egea E., Robbins T.W., Voon V. Valence-dependent influence of serotonin depletion on model-based choice strategy. Mol. Psychiatry 2015, 10.1038/mp.2015.46.
142. Worbe Y., Savulich G., de Wit S., Fernandez-Egea E., Robbins T.W. Tryptophan depletion promotes habitual over goal-directed control of appetitive responding in humans. Int. J. Neuropsychopharmacol 2015, 10.1093/ijnp/pyv013.
143. Wunderlich K., Smittenaar P., Dolan R.J. Dopamine enhances model-based over model-free choice behavior. Neuron 2012, 75:418-424.
144. Yin H.H., Knowlton B.J., Balleine B.W. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur. J. Neurosci. 2004, 19:181-189.
145. Zapata A., Minney V.L., Shippenberg T.S. Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats. J. Neurosci. 2010, 30:15457-15463.
146. Zurowski B., Kordon A., Weber-Fahr W., Voderholzer U., Kuelz A.K., Freyer T., Wahl K., Büchel C., Hohagen F. Relevance of orbitofrontal neurochemistry for the outcome of cognitive-behavioural therapy in patients with obsessive-compulsive disorder. Eur. Arch. Psychiatry Clin. Neurosci. 2012, 262:617-624.