Excessive state switching underlies reversal learning deficits in cocaine users

Drug and Alcohol Dependence

Volumn 134, Issue 1, 2014, Pages 211-217

  Patzelt, Edward H ^a,b   Kurth Nelson, Zeb ^d   Lim, Kelvin O ^c   MacDonald, Angus W ^a,c  

^a UNIVERSITY OF MINNESOTA   (United States)

^b HARVARD UNIVERSITY   (United States)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

^d UNIVERSITY OF MINNESOTA MEDICAL SCHOOL   (United States)

Author keywords

Bayesian hidden Markov model; Cocaine; Decision making; Impulsivity; Reversal learning; State switching

Indexed keywords

ADULT; ARTICLE; BAYES THEOREM; BEHAVIOR; CLINICAL ARTICLE; COCAINE DEPENDENCE; CONTROLLED STUDY; DECISION MAKING; EXCESSIVE SWITCHING BEHAVIOR; FEEDBACK SYSTEM; FEMALE; HIDDEN MARKOV MODEL; HUMAN; LEARNING DISORDER; MALE; PRIORITY JOURNAL; TASK PERFORMANCE;

ANIMALIA;

BAYESIAN HIDDEN MARKOV MODEL; COCAINE; DECISION MAKING; IMPULSIVITY; REVERSAL LEARNING; STATE SWITCHING;

ADAPTATION, PSYCHOLOGICAL; ADULT; COCAINE-RELATED DISORDERS; DECISION MAKING; FEMALE; HUMANS; MALE; MIDDLE AGED; PSYCHOMOTOR PERFORMANCE; REVERSAL LEARNING;

EID: 84890235017     PISSN: 03768716     EISSN: 18790046     Source Type: Journal    
DOI: 10.1016/j.drugalcdep.2013.09.029     Document Type: Article

References (34)

1. Barrós-Loscertales A., Garavan H., Bustamante J.C., Ventura-Campos N., Llopis J.J., Belloch V., Parcet M.A., Avila C. Reduced striatal volume in cocaine-dependent patients. NeuroImage 2011, 56:1021-1026.
2. Calu D.J., Stalnaker T.A., Franz T.M., Singh T., Shaham Y., Schoenbaum G. Withdrawal from cocaine self-administration produces long-lasting deficits in orbitofrontal-dependent reversal learning in rats. Learn. Mem. 2007, 14:325-328.
3. Clarke H.F., Hill G.J., Robbins T.W., Roberts A.C. Dopamine, but not serotonin, regulates reversal learning in the marmoset caudate nucleus. J. Neurosci. 2011, 31:4290-4297.
4. Cools R., Clark L., Owen A. Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging. J. Neurosci. 2002, 22:4563-4567.
5. Cools R., Frank M., Gibbs S. Striatal dopamine predicts outcome-specific reversal learning and its sensitivity to dopaminergic drug administration. J. Neurosci. 2009, 29:1538-1543.
6. Ersche K.D., Roiser J.P., Abbott S., Craig K.J., Müller U., Suckling J., Ooi C., Shabbir S.S., Clark L., Sahakian B.J., Fineberg N., Merlo-Pich E.V., Robbins T.W., Bullmore E.T. Response perseveration in stimulant dependence is associated with striatal dysfunction and can be ameliorated by a D2/3 receptor agonist. Biol. Psychiatry 2011, 70:754-762.
7. Ersche K.D., Roiser J.P., Robbins T.W., Sahakian B.J. Chronic cocaine but not chronic amphetamine use is associated with perseverative responding in humans. Psychopharmacology 2008, 197:421-431.
8. Fillmore M.T.M., Rush C.R. Polydrug abusers display impaired discrimination-reversal learning in a model of behavioural control. J. Psychopharmacol. 2006, 20:24-32.
9. First M.B., Spitzer R.L., Williams J.B.W., Gibbon M. Structured Clinical Interview for DSM-IV SCID 1995, American Psychiatric Association, Washington, DC.
10. Hampton A.N., Bossaerts P., O'Doherty J.P. The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J. Neurosci. 2006, 26:8360-8367.
11. Heyman G. Addiction: A Disorder of Choice 2009, Harvard University Press, Cambridge, MA.
12. Jentsch J.D., Olausson P., De La Garza R., Taylor J.R. Impairments of reversal learning and response perseveration after repeated, intermittent cocaine administrations to monkeys. Neuropsychopharmacology 2002, 26:183-190.
13. Jocham G., Klein T.A., Neumann J., Von Cramon D.Y., Reuter M., Ullsperger M. Dopamine DRD2 polymorphism alters reversal learning and associated neural activity. J. Neurosci. 2009, 29:3695-3704.
14. Kehagia A., Murray G.K., Robbins T.W. Learning and cognitive flexibility: frontostriatal function and monoaminergic modulation. Curr. Opin. Neurobiol. 2010, 20:199-204.
15. Lee B., Groman S., London E.D., Jentsch J.D. Dopamine D2/D3 receptors play a specific role in the reversal of a learned visual discrimination in monkeys. Neuropsychopharmacology 2007, 32:2125-2134.
16. Liu S., Heitz R.P., Bradberry C.W. A touch screen based Stop Signal Response Task in rhesus monkeys for studying impulsivity associated with chronic cocaine self-administration. J. Neurosci. Methods 2009, 177:67-72.
17. Lucantonio F., Stalnaker T., Shaham Y., Niv Y., Schoenbaum G. The impact of orbitofrontal dysfunction on cocaine addiction. Nat. Neurosci. 2012, 15:358-366.
18. Meehl P. High school yearbooks: a reply to Schwarz. J. Abnorm. Psychol. 1971, 77:143-148.
19. Nader M.A., Morgan D., Gage H.D., Nader S.H., Calhoun T.L., Buchheimer N., Ehrenkau R., Mach R.H. PET imaging of dopamine D2 receptors during chronic cocaine self-administration in monkeys. Nat. Neurosci. 2006, 9:1050-1056.
20. Pohjalainen T., Rinne J.O., Någren K., Lehikoinen P., Anttila K., Syvälahti E.K., Hietala J. The A1 allele of the human D2 dopamine receptor gene predicts low D2 receptor availability in healthy volunteers. Mol. Psychiatry 1998, 3:256-260.
21. Porter J.N., Olsen A.S., Gurnsey K., Dugan B.P., Jedema H.P., Bradberry C.W. Chronic cocaine self-administration in rhesus monkeys: impact on associative learning, cognitive control, and working memory. J. Neurosci. 2011, 31:4926-4934.
22. Redish A.D., Jensen S., Johnson A. A unified framework for addiction: vulnerabilities in the decision process. Behav. Brain Sci. 2008, 31:415-437. discussion 415-437.
23. Schoenbaum G., Roesch M.R., Stalnaker T.A. Orbitofrontal cortex, decision-making and drug addiction. Trends Neurosci. 2006, 29:116-124.
24. Shumay E., Fowler J.S., Wang G.-J., Logan J., Alia-Klein N., Goldstein R.Z., Maloney T., Wong C., Volkow N.D. Repeat variation in the human PER2 gene as a new genetic marker associated with cocaine addiction and brain dopamine D2 receptor availability. Transl. Psychiatry 2012, 2:e86.
25. Sutton R.S., Barto A.G. Reinforcement Learning 1998, MIT Press, Cambridge, MA.
26. Swainson R., Rogers R., Sahakian B. Probabilistic learning and reversal deficits in patients with Parkinson's disease or frontal or temporal lobe lesions: possible adverse effects of dopaminergic medication. Neuropsychologia 2000, 38:596-612.
27. Thompson J., Thomas N., Singleton A., Piggott M., Lloyd S., Perry E.K., Morris C.M., Perry R.H., Ferrier I.N., Court J.A. D2 dopamine receptor gene DRD2 Taq1 A polymorphism: reduced dopamine D2 receptor binding in the human striatum associated with the A1 allele. Pharmacogenetics 1997, 7:479-484.
28. Tsuchida A., Doll B. Beyond reversal: a critical role for human orbitofrontal cortex in flexible learning from probabilistic feedback. J. Neurosci. 2010, 30:16868-16875.
29. Volkow N.D., Fowler J.S., Wang G.J., Baler R., Telang F. Imaging dopamine's role in drug abuse and addiction. Neuropharmacology 2009, 56:3-8.
30. Volkow N.D., Fowler J.S., Wang G.J., Hitzemann R., Logan J., Schlyer D.J., Dewey S.L., Wolf A.P. Decreased dopamine D2 receptor availability is associated with reduced frontal metabolism in cocaine abusers. Synapse 1993, 14:169-177.
31. Volkow N.D., Fowler J.S., Wang G-J., Swanson J.M., Telang F. Dopamine in drug abuse and addiction: results of imaging studies and treatment implications. Arch. Neurol. 2007, 64:1575-1579.
32. Waltz J.A., Gold J.M. Probabilistic reversal learning impairments in schizophrenia: further evidence of orbitofrontal dysfunction. Schizophr. Res. 2007, 93:296-303.
33. Woicik P.A., Moeller S.J., Alia-Klein N., Maloney T., Lukasik T.M., Yeliosof O., Wang G-J., Volkow N.D., Goldstein R.Z. The neuropsychology of cocaine addiction: recent cocaine use masks impairment. Neuropsychopharmacology 2009, 34:1112-1122.
34. Woicik P.A., Urban C., Alia-Klein N., Henry A., Maloney T., Telang F., Wang G-J., Volkow N.D., Goldstein R.Z. A pattern of perseveration in cocaine addiction may reveal neurocognitive processes implicit in the Wisconsin Card Sorting Test. Neuropsychologia 2011, 49:1660-1669.