Reversal learning and dopamine: A Bayesian perspective

Journal of Neuroscience

Volumn 35, Issue 6, 2015, Pages 2407-2416

  Costa, Vincent D ^a   Tran, Valery L ^a   Turchi, Janita ^a   Averbeck, Bruno B ^a  

^a NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

Author keywords

Bayesian; Dopamine; Haloperidol; L DOPA; Reinforcement learning; Reversal learning

Indexed keywords

DOPAMINE; HALOPERIDOL; LEVODOPA; DOPAMINE RECEPTOR BLOCKING AGENT; DOPAMINE RECEPTOR STIMULATING AGENT;

ANIMAL EXPERIMENT; ARTICLE; BAYES THEOREM; DECISION MAKING; LEARNING; LEARNING DISORDER; MALE; NONHUMAN; ORBITAL CORTEX; PRIORITY JOURNAL; REINFORCEMENT; RHESUS MONKEY; ALGORITHM; ANIMAL; DRUG EFFECTS; FEMALE; INSTRUMENTAL CONDITIONING; PHYSIOLOGY;

ALGORITHMS; ANIMALS; BAYES THEOREM; CHOICE BEHAVIOR; CONDITIONING, OPERANT; DOPAMINE; DOPAMINE AGENTS; DOPAMINE ANTAGONISTS; FEMALE; HALOPERIDOL; LEVODOPA; MACACA MULATTA; MALE; REVERSAL LEARNING;

EID: 84922572232     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.1989-14.2015     Document Type: Article

References (31)

1. Asaad WF, Eskandar EN (2008) A flexible software tool for temporallyprecise behavioral control in Matlab. J Neurosci Methods 174: 245-258. CrossRef Medline.
2. Berridge KC, Robinson TE, Aldridge JW (2009) Dissecting components of reward: "liking, " "wanting, " and learning. Curr Opin Pharmacol 9: 65-73. CrossRef Medline.
3. Chudasama Y, RobbinsTW (2003) Dissociable contributions of the orbitofrontal and infralimbic cortex to Pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J Neurosci 23: 8771-8780. Medline.
4. Clarke HF, Hill GJ, Robbins TW, Roberts AC (2011) Dopamine, but not serotonin, regulates reversal learning in the marmoset caudate nucleus. J Neurosci 31: 4290-4297. CrossRef Medline.
5. Clarke HF, Cardinal RN, Rygula R, Hong YT, Fryer TD, Sawiak SJ, Ferrari V, Cockcroft G, Aigbirhio FI, Robbins TW, Roberts AC (2014) Orbitofrontal dopamine depletion upregulates caudate dopamine and alters behavior via changes in reinforcement sensitivity. J Neurosci 34: 7663-7676. CrossRef Medline.
6. Cools R, Barker RA, Sahakian BJ, Robbins TW (2001) Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cereb Cortex 11: 1136-1143. CrossRef Medline.
7. Cools R, Altamirano L, D'Esposito M (2006) Reversal learning in Parkinson's disease depends on medication status and outcome valence. Neuropsychologia 44: 1663-1673. CrossRef Medline.
8. Dias R, Robbins TW, Roberts AC (1996) Primate analogue of the Wisconsin Card Sorting Test: effects of excitotoxic lesions of the prefrontal cortex in the marmoset. Behav Neurosci 110: 872-886. CrossRef Medline.
9. Fellows LK, Farah MJ (2003) Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. Brain 126: 1830-1837. CrossRef Medline.
10. Frank MJ, O'ReillyRC (2006) Amechanistic account of striataldopaminefunc-tion in human cognition: psychopharmacological studies with cabergoline and haloperidol. Behav Neurosci 120: 497-517. CrossRef Medline.
11. Graef S, Biele G, Krugel LK, Marzinzik F, Wahl M, Wotka J, Klostermann F, Heekeren HR (2010) Differential influence of levodopa on rewardbased learning in Parkinson's disease. Front Hum Neurosci 4: 169. CrossRef Medline.
12. Groman SM, Lee B, London ED, Mandelkern MA, James AS, Feiler K, Rivera R, Dahlbom M, Sossi V, Vandervoort E, Jentsch JD (2011) Dorsal striatal D2-like receptor availability covaries with sensitivity to positive reinforcement during discrimination learning. J Neurosci 31: 7291-7299. CrossRef Medline.
13. Hornak J, O'Doherty J, Bramham J, Rolls ET, Morris RG, Bullock PR, Polkey CE (2004) Reward-related reversal learning after surgical excisions in orbito-frontal or dorsolateral prefrontal cortex in humans. J Cogn Neurosci 16: 463-478. CrossRef Medline.
14. Izquierdo A, Suda RK, Murray EA (2004) Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J Neurosci 24: 7540-7548. CrossRef Medline.
15. Jones B, Mishkin M (1972) Limbic lesions and the problem of stimulus-reinforcement associations. Exp Neurol 36: 362-377. CrossRef Medline.
16. Kuroki T, Meltzer HY, Ichikawa J (1999) Effects of antipsychotic drugs on extracellular dopamine levels in rat medial prefrontal cortex and nucleus accumbens. J Pharmacol Exp Ther 288: 774-781. Medline.
17. Lee B, Groman S, London ED, Jentsch JD (2007) Dopamine D2/D3 receptors play a specific role in the reversal of a learned visual discrimination in monkeys. Neuropsychopharmacology 32: 2125-2134. CrossRef Medline.
18. Levin JR, Serlin RC, Seaman MA (1994) A controlled, powerful multiplecomparison strategy for several situations. Psychol Bull 115: 153-159. CrossRef.
19. Mehta MA, Swainson R, Ogilvie AD, Sahakian J, Robbins TW (2001) Improved short-term spatial memory but impaired reversal learning following the dopamine D(2) agonist bromocriptine in human volunteers. Psychopharmacology 159: 10-20. CrossRef Medline.
20. Mitz AR (2005) A liquid-delivery device that provides precise reward control for neurophysiological and behavioral experiments. J Neurosci Methods 148: 19-25. CrossRef Medline.
21. Nicola SM (2010) The flexible approach hypothesis: unification of effort and cue-responding hypotheses for the role of nucleus accumbens dopamine in the activation of reward-seeking behavior. J Neurosci 30: 16585-16600. CrossRef Medline.
22. Redgrave P, Gurney K, Reynolds J (2008) What is reinforced by phasic dopamine signals? Brain Res Rev 58: 322-339. CrossRef Medline.
23. Robinson DL, Venton BJ, Heien ML, Wightman RM (2003) Detecting subsecond dopamine release with fast-scan cyclic voltammetry in vivo. Clin Chem 49: 1763-1773. CrossRef Medline.
24. Rudebeck PH, Saunders RC, Prescott AT, Chau LS, Murray EA (2013) Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating. Nat Neurosci 16: 1140-1145. CrossRef Medline.
25. Rygula R, Walker SC, Clarke HF, Robbins TW, Roberts AC (2010) Differential contributions of the primate ventrolateral prefrontal and orbitofrontal cortex to serial reversal learning. J Neurosci 30: 14552-14559. CrossRef Medline.
26. Salamone JD, Correa M (2012) The mysterious motivational functions of mesolimbic dopamine. Neuron 76: 470-485. CrossRef Medline.
27. Schoenbaum G, Setlow B, Nugent SL, Saddoris MP, Gallagher M (2003) Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. Learn Mem 10: 129-140. CrossRef Medline.
28. Turchi J, Devan B, Yin P, Sigrist E, Mishkin M (2010) Pharmacological evidence that both cognitive memory and habit formation contribute to within-session learning of concurrent visual discriminations. Neuropsychologia 48: 2245-2250. CrossRef Medline.
29. Wilson CR, Gaffan D (2008) Prefrontal-inferotemporal interaction is not always necessary for reversal learning. J Neurosci 28: 5529-5538. CrossRef Medline.
30. Wu Q, Reith MEA, Walker QD, Kuhn CM, Carroll FI, Garris PA (2002) Concurrent autoreceptor-mediated control of dopamine release and uptake during neurotransmission: an in vivo voltammetric study. J Neurosci 22: 6272-6281. Medline.
31. Yu AJ, Dayan P (2005) Uncertainty, neuromodulation, and attention. Neuron 46: 681-692. CrossRef Medline.