Reversal learning in fronto-striatal circuits: A functional, autonomic, and neurochemical analysis

Decision Making, Affect, and Learning: Attention and Performance XXIII

Volumn , Issue , 2011, Pages

  Clarke, H F ^a   Roberts, A C ^b  

^a University of Cambridge   (United Kingdom)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Amygdala; Behavioural flexibility; Dopamine; Monkeys; Orbitofrontal cortex; Rats; Reversal learning; Serotonin; Striatum

Indexed keywords

EID: 84921676356     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1093/acprof:oso/9780199600434.003.0010     Document Type: Chapter

References (156)

1. Annett, L.E., McGregor, A., Robbins, T.W. (1989). The effects of ibotenic acid lesions of the nucleus accumbens on spatial learning and extinction in the rat. Behav Brain Res, 31: 231-42.
2. Azmitia, EC., Whitaker-Azmitia, P.M. (1995). Anatomy, cell biology and maturation of the serotonergic system: neurotrophic implications for the actions of psychotropic drugs. In: Psychopharmacology, fourth generation of progress (Bloom FE, Kupfer DJ, eds). New York: Raven Press. Accessed July 2009 from.
3. Baare, WF., Hulshoff Pol, H.E., Hijman, R., Mali, W.P., Viergever, M.A., Kahn, R.S. (1999). Volumetric analysis of frontal lobe regions in schizophrenia: relation to cognitive function and symptomatology. Biol Psychiatry, 45: 1597-605.
4. Bachevalier, J., Loveland, K.A. (2006). The orbitofrontal-amygdala circuit and selfregulation of social-emotional behavior in autism. Neurosci Biobehav Rev, 30: 97-117.
5. Barbas, H. (2007). Flow of information for emotions through temporal and orbitofrontal pathways. J Anat, 211: 237-49.
6. Blair, R.J., Colledge, E., Mitchell, D.G. (2001). Somatic markers and response reversal: is there orbitofrontal cortex dysfunction in boys with psychopathic tendencies? J Abnorm Child Psychol, 29: 499-511.
7. Block, AE., Dhanji, H., Thompson-Tardif, S.F., Floresco, S.B. (2007). Thalamicprefrontal cortical-ventral striatal circuitry mediates dissociable components of strategy set shifting. Cereb Cortex, 17: 1625-36.
8. Boulougouris, V., Dalley, J.W., Robbins, T.W. (2007). Effects of orbitofrontal, infralimbic and prelimbic cortical lesions on serial spatial reversal learning in the rat. Behav Brain Res, 179: 219-28.
9. Bouton, M.E. (2004). Context and behavioral processes in extinction. Learn Mem, 11:485-94.
10. Braesicke, K., Parkinson, J.A., Reekie, Y., Man, M.S., Hopewell, L., Pears, A. et al. (2005). Autonomic arousal in an appetitive context in primates: a behavioral and neural analysis. Eur J Neurosci, 21: 1733-40.
11. Brody, A.L., Saxena, S., Silverman, D.H.S., Alborzian, S., Fairbanks, L.A., Phelps, M.E. et al. (1999). Brain metabolic changes in major depressive disorder from pre-to post-treatment with paroxetine. Psychiatry Research-Neuroimaging, 91: 127-39.
12. Budhani, S., Blair, R.J. (2005). Response reversal and children with psychopathic tendencies: success is a function of salience of contingency change. J Child Psychol Psychiatry, 46: 972-81.
13. Budhani, S., Marsh, A.A., Pine, D.S., Blair, R.J. (2007). Neural correlates of response reversal: considering acquisition. Neuroimage, 34: 1754-65.
14. Burman, K.J., Rosa, M.G. (2009). Architectural subdivisions of medial and orbital frontal cortices in the marmoset monkey (Callithrix jacchus). J Comp Neurol, 514: 11-29.
15. Butter, C.M. (1969). Perseveration in extinction and in discrimination reversal tasks following selective frontal ablations in Macaca mulatta. Physiology and Behavior, 4: 163-71.
16. Carmichael, S.T., Price, J.L. (1994). Architectonic subdivision of the orbital and medial prefrontal cortex in the macaque monkey. Journal of Comparative Neurology, 346: 366-402.
17. Celada, P., Puig, M.V., Casanovas, J.M., Guillazo, G., Artigas, F. (2001). Control of dorsal raphe serotonergic neurons by the medial prefrontal cortex: Involvement of serotonin-1A, GABA(A), and glutamate receptors. J Neurosci, 21: 9917-29.
18. Cetin, T., Freudenberg, F., Fuchtemeier, M., Koch, M. (2004). Dopamine in the orbitofrontal cortex regulates operant responding under a progressive ratio of reinforcement in rats. Neurosci Lett, 370: 114-7.
19. Chamberlain, S.R., Menzies, L., Hampshire, A., Suckling, J., Fineberg, N.A., del Campo, N. et al. (2008). Orbitofrontal dysfunction in patients with obsessivecompulsive disorder and their unaffected relatives. Science, 321: 421-2.
20. Chudasama, Y., Robbins, T.W. (2003). Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal-learning:further evidence for the functional heterogeneity of the rodent frontal cortex. J Neurosci, 23: 8771-80.
21. Clarke, H.F., Dalley, J.W., Crofts, H.S., Robbins, T.W., Roberts, A.C. (2004). Cognitive inflexibility after prefrontal serotonin depletion. Science, 304: 878-80.
22. Clarke, H.F., Walker, S.C., Crofts, H.S., Dalley, J.W., Robbins, T.W., Roberts, A.C. (2005). Prefrontal serotonin depletion affects reversal learning but not attentional set shifting. J Neurosci, 25: 532-38.
23. Clarke, H.F., Walker, S.C., Dalley, J.W., Robbins, T.W., Roberts, A.C. (2007). Cognitive inflexibility after prefrontal serotonin depletion is behaviorally and neurochemically specific. Cereb Cortex, 17: 18-27.
24. Clarke, H.F., Robbins, T.W., Roberts, A.C. (2008). Lesions of the medial striatum in monkeys produce perseverative impairments during reversal learning similar to those produced by lesions of the orbitofrontal cortex. J Neurosci, 28: 10972-82.
25. Cools, R., Barker, R.A., Sahakian, B.J., Robbins, T.W. (2001). Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cereb Cortex, 11: 1136-43.
26. Cools, R., Clark, L., Owen, A.M., Robbins, T.W. (2002). Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging. J Neurosci, 22: 4563-67.
27. Cowen, P.J. (2008). Serotonin and depression: pathophysiological mechanism or marketing myth? Trends Pharmacol Sci, 29: 433-36.
28. Craig, A.D. (2002). How do you feel? Interoception: the sense of the physiological condition of the body. Nat Rev Neurosci, 3: 655-66.
29. Critchley, H.D., Wiens, S., Rotshtein, P., Ohman, A., Dolan, R.J. (2004). Neural systems supporting interoceptive awareness. Nat Neurosci, 7: 189-95.
30. Critchley, H.D., Lewis, P.A., Orth, M., Josephs, O., Deichmann, R., Trimble, M.R., Dolan, R.J. (2007). Vagus nerve stimulation for treatment-resistant depression:behavioral and neural effects on encoding negative material. Psychosom Med, 69: 17-22.
31. Crofts, H.S., Dalley, J.W., Collins, P., Van Denderen, J.C., Everitt, B.J., Robbins, T.W., Roberts, A.C. (2001). Differential effects of 6-OHDA lesions of the frontal cortex and caudate nucleus on the ability to acquire an attentional set. Cereb Cortex, 11: 1015-26.
32. Damasio, A. (2003). Feelings of emotion and the self. Ann NY Acad Sci 1001: 253-61.
33. Daw, N.D., Kakade, S., Dayan, P. (2002). Opponent interactions between serotonin and dopamine. Neural Netw, 15: 603-16.
34. Dias, R., Robbins, T.W., Roberts, A.C. (1996). Dissociation in prefrontal cortex of affective and attentional shifts. Nature, 380: 69-72.
35. Dias, R., Robbins, T.W., Roberts, A.C. (1997). Dissociable forms of inhibitory control within prefrontal cortex with an analog of the Wisconsin Card Sort Test: restriction to novel situations and independence from "on-line" processing. Journal of Neuroscience, 17: 9285-97.
36. Divac I., Rosvold, H.E., Szwarcbart, M.K. (1967). Behavioral effects of selective ablation of the caudate nucleus. J Comp Physiol Psychol, 63: 184-90.
37. Drevets, W.C. (2001). Neuroimaging and neuropathological studies of depression:implications for the cognitive-emotional features of mood disorders. Curr Opin Neurobiol, 11: 240-49.
38. Drevets, W.C. (2007). Orbitofrontal cortex function and structure in depression. Ann NY Acad Sci, 1121: 499-527.
39. Durstewitz, D., Seamans, J.K., Sejnowski, T.J. (2000). Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. J Neurophysiol, 83: 1733-50.
40. Elliott, R., McKenna, P.J., Robbins, T.W., Sahakian, B.J. (1995). Neuropsychological evidence for frontostriatal dysfunction in schizophrenia. Psychol Med, 25: 619-30.
41. Elliott, R., Rubinsztein, J.S., Sahakian, B.J., Dolan, R.J. (2002). The neural basis of mood-congruent processing biases in depression. Arch Gen Psychiatry, 59: 597-604.
42. Ersche, K.D., Roiser, J.P., Robbins, T.W., Sahakian, B.J. (2008). Chronic cocaine but not chronic amphetamine use is associated with perseverative responding in humans. Psychopharmacology (Berl), 197: 421-31.
43. Everitt, B.J., Robbins, T.W. (2005). Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat Neurosci, 8: 1481-89.
44. Faure, A., Haberland, U., Conde, F., El Massioui, N. (2005). Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. J Neurosci, 25: 2771-80.
45. Fellows, L.K., Farah, M.J. (2003). Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. Brain, 126: 1830-37.
46. Ferry, A.T., Lu, X.C., Price, J.L. (2000). Effects of excitotoxic lesions in the ventral striatopallidal-thalamocortical pathway on odor reversal learning: inability to extinguish an incorrect response. Exp Brain Res, 131: 320-35.
47. Fisher, P.M., Meltzer, C.C., Price, J.C., Coleman, R.L., Ziolko, S.K., Becker, C. et al. (2009). Medial prefrontal cortex 5-HT2A density is correlated with amygdala reactivity, response habituation, and functional coupling. Cereb Cortex, 19(11) 2499-507.
48. Floresco, S.B., Zhang, Y., Enomoto, T. (2008). Neural circuits subserving behavioral flexibility and their relevance to schizophrenia. Behav Brain Res, 204(2) 396-409.
49. Fuchs, R.A., Evans, K.A., Parker, M.P., See, R.E. (2004). Differential involvement of orbitofrontal cortex subregions in conditioned cue-induced and cocaine-primed reinstatement of cocaine seeking in rats. J Neurosci, 24: 6600-10.
50. Gallagher, M., McMahan, R.W., Schoenbaum, G. (1999). Orbitofrontal cortex and representation of incentive value in associative learning. J Neurosci, 19: 6610-14.
51. Gaykema, R.P., van Weeghel, R., Hersh, L.B., Luiten, P.G. (1991). Prefrontal cortical projections to the cholinergic neurons in the basal forebrain. J Comp Neurol, 303:563-83.
52. Ghashghaei, H.T., Hilgetag, C.C., Barbas, H. (2007). Sequence of information processing for emotions based on the anatomic dialogue between prefrontal cortex and amygdala. Neuroimage, 34: 905-23.
53. Ghods-Sharifi, S., Haluk, D.M., Floresco, S.B. (2008). Differential effects of inactivation of the orbitofrontal cortex on strategy set-shifting and reversal learning. Neurobiol Learn Mem, 89: 567-73.
54. Goldman-Rakic, P. (1987). Circuitry of primate prefrontal cortex and regulation of behavior by representational memory. In: Handbook of physiology: the nervous system (Mountcastle V, Plum F, Geiger S, eds) pp. 373-417. Bethesda, MD: American Physiological Society.
55. Goto, Y., Grace, A.A. (2005). Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior. Nat Neurosci, 8: 805-12.
56. Goto, Y., Otani, S., Grace, A.A. (2007). The Yin and Yang of dopamine release: a new perspective. Neuropharmacology, 53: 583-87.
57. Haluk, D.M., Floresco, S.B. (2009). Ventral striatal dopamine modulation of different forms of behavioral flexibility. Neuropsychopharmacology, 34: 2041-52.
58. Hampshire, A., Owen, A.M. (2006). Fractionating attentional control using eventrelated fMRI. Cereb Cortex, 16: 1679-89.
59. Hariri, A.R., Mattay, V.S., Tessitore, A., Kolachana, B., Fera, F., Goldman, D. et al. (2002). Serotonin transporter genetic variation and the response of the human amygdala. Science, 297: 400-3.
60. Heinz, A., Braus, D.F., Smolka, M.N., Wrase, J., Puls, I., Hermann, D. et al. (2005). Amygdala-prefrontal coupling depends on a genetic variation of the serotonin transporter. Nat Neurosci, 8: 20-1.
61. Hirstein, W., Iversen, P., Ramachandran, V.S. (2001). Autonomic responses of autistic children to people and objects. Proc Biol Sci 268: 1883-8.
62. Hitsman, B., Spring, B., Pingitore, R., Munafo, M., Hedeker, D. (2007). Effect of tryptophan depletion on the attentional salience of smoking cues. Psychopharmacology (Berl), 192: 317-24.
63. Holets, V.R. (1990). The anatomy and function of noradrenaline in the mammalian brain. In: The pharmacology of noradrenaline in the central nervous system (Heal DJ, Marsden CA, eds), pp 1-40. Oxford: Oxford University Press.
64. Hornak, J., O'Doherty, J., Bramham, J., Rolls, E.T., Morris, R.G., Bullock, P.R., Polkey, C.E. (2004). Reward-related reversal learning after surgical excisions in orbitofrontal or dorsolateral prefrontal cortex in humans. J Cogn Neurosci, 16: 463-78.
65. Ichikawa, J., Meltzer, H.Y. (1999). Relationship between dopaminergic and serotonergic neuronal activity in the frontal cortex and the action of typical and atypical antipsychotic drugs. Eur Arch Psychiatry Clin Neurosci, 249 Suppl 4: 90-8.
66. Ichikawa, J., Ishii, H., Bonaccorso, S., Fowler, W.L., O'Laughlin, I.A., Meltzer, H.Y. (2001). 5-HT(2A) and D(2) receptor blockade increases cortical DA release via 5-HT(1A) receptor activation: a possible mechanism of atypical antipsychotic-induced cortical dopamine release. J Neurochem, 76: 1521-31.
67. Iversen, S.D., Mishkin, M. (1970). Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity. Experimental Brain Research, 11:376-86.
68. Izquierdo, A., Murray, E.A. (2005). Opposing effects of amygdala and orbital prefrontal cortex lesions on the extinction of instrumental responding in macaque monkeys. Eur J Neurosci, 22: 2341-46.
69. Izquierdo, A., Murray, E.A. (2007). Selective bilateral amygdala lesions in rhesus monkeys fail to disrupt object reversal learning. J Neurosci, 27: 1054-62.
70. Izquierdo, A., Suda, R.K., Murray, E.A. (2003). Effects of selective amygdala and orbital prefrontal cortex lesions on object reversal learning in monkeys. Society for Neuroscience Abstracts, 90.2.
71. Izquierdo, A., Suda, R.K., Murray, E.A. (2004). Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J Neurosci, 24: 7540-48.
72. Izquierdo, A., Newman, T.K., Higley, J.D., Murray, E.A. (2007). Genetic modulation of cognitive flexibility and socioemotional behavior in rhesus monkeys. Proc Natl Acad Sci USA, 104: 14128-33.
73. Jodo, E., Chiang, C., Aston-Jones, G., (1998). Potent excitatory influence of prefrontal cortex activity on noradrenergic locus coeruleus neurons. Neuroscience, 83: 63-79.
74. Joel, D., Doljansky, J., Roz, N., Rehavi, M. (2005). Role of the orbital cortex and of the serotonergic system in a rat model of obsessive compulsive disorder. Neuroscience, 130: 25-36.
75. Jones, B., Mishkin, M. (1972). Limbic lesions and the problem of stimulus-reinforcement associations. Exp Neurol, 36: 362-77.
76. Kazama, A., Bachevalier, J. (2009). Selective aspiration or neurotoxic lesions of orbital frontal areas 11 and 13 spared monkeys' performance on the object discrimination reversal task. J Neurosci, 29: 2794-804.
77. Kheramin, S., Body, S., Ho, M.Y., Velazquez-Martinez, D.N., Bradshaw, C.M., Szabadi, E. et al. (2004). Effects of orbital prefrontal cortex dopamine depletion on inter-temporal choice: a quantitative analysis. Psychopharmacology (Berl), 175: 206-14.
78. Kim, J., Ragozzino, M.E. (2005). The involvement of the orbitofrontal cortex in learning under changing task contingencies. Neurobiol Learn Mem, 83: 125-33.
79. King, D., Zigmond, M.J., Finlay, J.M. (1997). Effects of dopamine depletion in the medial prefrontal cortex on the stress-induced increase in extracellular dopamine in the nucleus accumbens core and shell. Neuroscience, 77: 141-53.
80. Kurylo, D.D., Tanguay, S. (2003). Effects of quinpirole on behavioral extinction. Physiol Behav, 80: 1-7.
81. Lapiz-Bluhm, M.D., Soto-Piña, A.E., Hensler, J.G., Morilak, D.A. (2009). Chronic intermittent cold stress and serotonin depletion induce deficits of reversal learning in an attentional set-shifting test in rats. Psychopharmacology, 202: 329-41.
82. Lee, B., Groman, S., London, E.D., Jentsch, J.D. (2007). Dopamine D2/D3 receptors play a specific role in the reversal of a learned visual discrimination in monkeys. Neuropsychopharmacology, 32: 2125-34.
83. Macmillan, N.A., Creelman, C.D. (1991). Detection theory: a user's guide. Cambridge University Press.
84. Man, M.S., Clarke, H.F., Roberts, A.C. (2009). The role of the orbitofrontal cortex and medial striatum in the regulation of prepotent responses to food rewards. Cereb Cortex, 19: 899-906.
85. Mayberg, H.S. (2003). Modulating dysfunctional limbic-cortical circuits in depression:towards development of brain-based algorithms for diagnosis and optimised treatment. Br Med Bull, 65: 193-207.
86. McAlonan, K., Brown, V.J. (2003). Orbital prefrontal cortex mediates reversal learning and not attentional set shifting in the rat. Behav Brain Res, 146: 97-103.
87. McKirdy, J., Sussmann, J.E., Hall, J., Lawrie, S.M., Johnstone, E.C., McIntosh, A.M. (2008). Set shifting and reversal learning in patients with bipolar disorder or schizophrenia. Psychol Med, 1-5.
88. Mehta, M.A., Swainson, R., Ogilvie, A.D., Sahakian, J., Robbins, T.W. (2001). Improved short-term spatial memory but impaired reversal learning following the dopamine D(2) agonist bromocriptine in human volunteers. Psychopharmacology (Berl), 159: 10-20.
89. Meltzer, H.Y., Li, Z., Kaneda, Y., Ichikawa, J. (2003). Serotonin receptors: their key role in drugs to treat schizophrenia. Prog Neuropsychopharmacol Biol Psychiatry, 27:1159-72.
90. Menzies, L., Achard, S., Chamberlain, S.R., Fineberg, N., Chen, C.H., del Campo, N. et al. (2007). Neurocognitive endophenotypes of obsessive-compulsive disorder. Brain, 130: 3223-36.
91. Mesulam, M.M., Geula, C. (1992). Overlap between acetylcholinesterase-rich and choline acetyltransferase-positive (cholinergic) axons in human cerebral cortex. Brain Res, 577: 112-20.
92. Meunier, M., Bachevalier, J., Mishkin, M. (1997). Effects of orbital frontal and anterior cingulate lesions on object and spatial memory in rhesus monkeys. Neuropsychologia, 35: 999-1015.
93. Milad, M.R., Rauch, S.L. (2007). The role of the orbitofrontal cortex in anxiety disorders. Ann NY Acad Sci, 1121: 546-61.
94. Mitchell, J.B., Gratton, A. (1992). Partial dopamine depletion of the prefrontal cortex leads to enhanced mesolimbic dopamine release elicited by repeated exposure to naturally reinforcing stimuli. J Neurosci, 12: 3609-3618.
95. Murphy, F.C., Sahakian, B.J, Rubinsztein, J.S, Michael, A., Rogers, R.D, Robbins, T.W, Paykel, E.S. (1999). Emotional bias and inhibitory control processes in mania and depression. Psychol Med, 29: 1307-21.
96. Murray, E.A., Baxter, M.G., Gaffan, D. (1998). Monkeys with rhinal cortex damage or neurotoxic hippocampal lesions are impaired on spatial scene learning and object reversals. Behav Neurosci, 112: 1291-303.
97. Murray, G.K., Cheng, F., Clark, L., Barnett, J.H., Blackwell, A.D., Fletcher, P.C. et al. (2008). Reinforcement and reversal learning in first-episode psychosis. Schizophr Bull, 34: 848-55.
98. Nicotra, A., Critchley, H.D., Mathias, C.J., Dolan, R.J. (2006). Emotional and autonomic consequences of spinal cord injury explored using functional brain imaging. Brain, 129: 718-28.
99. O'Doherty, J., Kringelbach, M.L., Rolls, E.T., Hornak, J., Andrews, C. (2001). Abstract reward and punishment representations in the human orbitofrontal cortex. Nat Neurosci, 4: 95-102.
100. O'Doherty, J., Critchley, H., Deichmann, R., Dolan, R.J. (2003). Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. J Neurosci, 23: 7931-39.
101. O'Neill, M., Brown, V.J. (2007). The effect of striatal dopamine depletion and the adenosine A2A antagonist KW-6002 on reversal learning in rats. Neurobiol Learn Mem, 88: 75-81.
102. Ongur, D., Price, J.L. (2000). The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cerebral Cortex, 10: 206-19.
103. Ostlund, S.B., Balleine, B.W. (2007). Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. J Neurosci, 27: 4819-25.
104. Pagnoni, G., Zink, C.F., Montague, P.R., Berns, G.S. (2002). Activity in human ventral striatum locked to errors of reward prediction. Nat Neurosci, 5: 97-8.
105. Palfi, S., Ferrante, R.J., Brouillet, E., Beal, M.F., Dolan, R., Guyot, M.C. et al. (1996). Chronic 3-nitropropionic acid treatment in baboons replicates the cognitive and motor deficits of Huntington's disease. J Neurosci, 16: 3019-25.
106. Pantelis, C., Barber, F.Z., Barnes, T.R., Nelson, H.E., Owen, A.M., Robbins, T.W. (1999). Comparison of set-shifting ability in patients with chronic schizophrenia and frontal lobe damage. Schizophr Res, 37: 251-70.
107. Paulus, M.P., Stein, M.B. (2006). An insular view of anxiety. Biol Psychiatry, 60: 383-7.
108. Pavlov, I.P., (1927). Conditioned reflexes. Oxford: Oxford University Press.
109. Paxinos, G., Watson, C. (1997). The rat brain in stereotaxic coordinates, 2nd edn. Sydney: Academic.
110. Petrides, M., Pandya, D.N. (1994). Comparative architectonic analysis of the human and the macaque frontal cortex. In: Handbook of nuropsychology (Boller F, Grafman J, eds), pp 17-58. Amsterdam: Elsevier Science BV.
111. Pickens, C.L., Saddoris, M.P., Setlow, B., Gallagher, M., Holland, P.C., Schoenbaum, G. (2003). Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J Neurosci, 23: 11078-84.
112. Pickens, C.L., Saddoris, M.P., Gallagher, M., Holland, P.C. (2005). Orbitofrontal lesions impair use of cue-outcome associations in a devaluation task. Behav Neurosci, 119: 317-22.
113. Porrino, L.J., Goldman-Rakic, P.S. (1982). Brainstem innervation of prefrontal and anterior cingulate cortex in the rhesus monkey revealed by retrograde transport of HRP. J Comp Neurol, 205: 63-76.
114. Preuss, T.M., (1995). Do rats have prefrontal cortex? The Rose-Woolsey-Akert programme reconsidered. J Cog Neurosci, 7: 1-24.
115. Pycock, C.J., Kerwin, R.W., Carter, C.J., (1980). Effect of lesion of cortical dopamine terminals on subcortical dopamine receptors in rats. Nature, 286: 74-76.
116. Reading, P.J., Dunnett, S.B. (1991). The effects of excitotoxic lesions of the nucleus accumbens on a matching to position task. Behav Brain Research, 46: 17-29.
117. Reekie, Y.L., Braesicke, K., Man, M.S., Roberts, A.C. (2008). Uncoupling of behavioral and autonomic responses after lesions of the primate orbitofrontal cortex. Proc Natl Acad Sci USA, 105: 9787-92.
118. Remijnse, P.L., Nielen, M.M., van Balkom, A.J., Cath, D.C., van Oppen, P., Uylings, H.B., Veltman, D.J. (2006). Reduced orbitofrontal-striatal activity on a reversal-learning task in obsessive-compulsive disorder. Arch Gen Psychiatry, 63: 1225-36.
119. Remijnse, P.L., Nielen, M.M., van Balkom, A.J., Hendriks, G.J., Hoogendijk, W.J., Uylings, H.B., Veltman, D.J. (2009). Differential frontal-striatal and paralimbic activity during reversal learning in major depressive disorder and obsessive-compulsive disorder. Psychol Med, 39: 1503-18.
120. Rescorla, R.A. (2001). Experimental extinction. In: Handbook of contemporary learning theories (Mowrer RR, Klein SB, eds), pp 119-54. Mahwah: Lawrence Erlbaum Associates.
121. Robbins, T.W., Roberts, A.C. (2007). Differential regulation of fronto-executive function by the monoamines and acetylcholine. Cereb Cortex, 17 Suppl1:i151-60.
122. Roberts, A.C. (2006). Primate orbitofrontal cortex and adaptive behavior. TICS, 10: 83-90.
123. Roberts, A.C., Wallis, J.D. (2000). Inhibitory control and affective processing in the prefrontal cortex: neuropsychological studies in the common marmoset. Cereb Cortex, 10: 252-62.
124. Roberts, A.C., De Salvia, M.A., Wilkinson, L.S., Collins, P., Muir, J.L., Everitt, B.J., Robbins, T.W. (1994). 6-Hydroxydopamine lesions of the prefrontal cortex in monkeys enhance performance on an analog of the Wisconsin Card Sort Test: possible interactions with subcortical dopamine. J Neurosci, 14: 2531-44.
125. Roberts, A.C., Reekie, Y., Braesicke, K. (2007a). Synergistic and regulatory effects of orbitofrontal cortex on amygdala-dependent appetitive behavior. Ann NY Acad Sci, 1121: 297-319.
126. Roberts, A.C., Tomic DL, Parkinson, C.H., Roeling, T.A., Cutter, D.J., Robbins, T.W., Everitt, B.J. (2007b). Forebrain connectivity of the prefrontal cortex in the marmoset monkey (Callithrix jacchus): an anterograde and retrograde tract-tracing study. J Comp Neurol, 502: 86-112.
127. Rogers, R.D., Andrews, T.C., Grasby, P.M., Brooks, D.J., Robbins, T.W. (2000). Contrasting cortical and subcortical activations produced by attentional-set shifting and reversal learning in humans. J Cogn Neurosci, 12: 142-62.
128. Rolls, E.T., Hornak, J., Wade, D., McGrath, J. (1994). Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. J Neurol Neurosurg Psychiatry, 57: 1518-24.
129. Rosenkranz, J.A., Grace, A.A. (2001). Dopamine attenuates prefrontal cortical suppression of sensory inputs to the basolateral amygdala of rats. J Neurosci, 21: 4090-103.
130. Saxena, S., Rauch, S.L. (2000). Functional neuroimaging and the neuroanatomy of obsessive-compulsive disorder. Psychiatr Clin North Am, 23: 563-86.
131. Saxena, S., Brody, A.L., Maidment, K.M., Dunkin, J.J., Colgan, M., Alborzian, S., et al. (1999). Localized orbitofrontal and subcortical metabolic changes and predictors of response to paroxetine treatment in obsessive-compulsive disorder. Neuropsychopharm, 21: 683-93.
132. Schoenbaum, G., Setlow, B. (2003). Lesions of nucleus accumbens disrupt learning about aversive outcomes. J Neurosci, 23: 9833-41.
133. Schoenbaum, G., Chiba, A.A., Gallagher, M. (1998). Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat Neurosci, 1: 155-9.
134. Schoenbaum, G., Nugent, S.L., Saddoris, M.P., Setlow, B. (2002). Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations. Neurorep, 13: 885-90.
135. Schoenbaum, G., Setlow, B., Nugent, S.L., Saddoris, M.P., Gallagher, M. (2003). Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. Learn Mem, 10: 129-40.
136. Schoenbaum, G., Saddoris, M.P., Stalnaker, T.A. (2007). Reconciling the roles of orbitofrontal cortex in reversal learning and the encoding of outcome expectancies. Ann NY Acad Sci, 1121: 320-35.
137. Schultz, W. (2002). Getting formal with dopamine and reward. Neuron, 36: 241-63.
138. Sesack, S.R., Deutch, A.Y., Roth, R.H., Bunney, B.S. (1989). Topographical organization of the efferent projections of the medial prefrontal cortex in the rat: an anterograde tract-tracing study with Phaseolus vulgaris leucoagglutinin. J Comp Neurol, 290: 213-42.
139. Seymour, B., Daw, N., Dayan, P., Singer, T., Dolan, R. (2007). Differential encoding of losses and gains in the human striatum. J Neurosci, 27: 4826-31.
140. Stalnaker, T.A., Franz, T.M., Singh, T., Schoenbaum, G. (2007). Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments. Neuron, 54: 51-58.
141. Swainson, R., Rogers, R.D., Sahakian, B.J., Summers, B.A., Polkey, C.E., Robbins, T.W. (2000). Probabilistic learning and reversal deficits in patients with Parkinson's disease or frontal or temporal lobe lesions: possible adverse effects of dopaminergic medication. Neuropsychologia, 38: 596-612.
142. Tait, D.S., Brown, V.J. (2007). Difficulty overcoming learned non-reward during reversal learning in rats with ibotenic acid lesions of orbital prefrontal cortex. Ann NY Acad Sci, 1121: 407-20.
143. Thorpe, S.J., Rolls, E.T., Maddison, S. (1983). The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp Brain Res, 49: 93-115.
144. Tops, M., Russo, S., Boksem, M.A., Tucker, D.M. (2009). Serotonin: Modulator of a drive to withdraw. Brain Cogn, 71(3): 427-36.
145. Tremblay, L., Schultz, W. (2000). Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J Neurophysiol, 83: 1864-76.
146. Uylings, H.B.M., Groenewegen, H.J., Kolb, B. (2003). Do rats have a prefrontal cortex? Behav Brain Res, 146: 3-17.
147. Valerius, G., Lumpp, A., Kuelz, A.K., Freyer, T., Voderholzer, U. (2008). Reversal learning as a neuropsychological indicator for the neuropathology of obsessive compulsive disorder? A behavioral study. J Neuropsychiatry Clin Neurosci, 20: 210-8.
148. Volkow, N.D., Fowler, J.S. (2000). Addiction, a disease of compulsion and drive:involvement of the orbitofrontal cortex. Cereb Cortex, 10: 318-25.
149. Walker, S.C., Robbins, T.W., Roberts, A.C. (2009). Differential contributions of dopamine and serotonin to orbitofrontal cortex function in the marmoset. Cereb Cortex, 19: 889-98.
150. Walker, S.C., Mikheenko, Y.P., Argyle, L.D., Robbins, T.W., Roberts, A.C. (2006). Selective prefrontal serotonin depletion impairs acquisition of a detour-reaching task. Eur J Neurosci, 23: 3119-23.
151. Wallis, J.D., Dias, R., Robbins, T.W., Roberts, A.C. (2001). Dissociable contributions of the orbitofrontal and lateral prefrontal cortex of the marmoset to performance on a detour reaching task. Eur J Neurosci, 13: 1797-808.
152. Waltz, J.A., Gold, J.M. (2007). Probabilistic reversal learning impairments in schizophrenia: further evidence of orbitofrontal dysfunction. Schizophr Res, 93: 296-303.
153. Williams, L.M., Das, P., Liddell, B.J., Olivieri, G., Peduto, A.S., David, A.S., Gordon, E., Harris, A.W. (2007). Fronto-limbic and autonomic disjunctions to negative emotion distinguish schizophrenia subtypes. Psychiatry Res, 155: 29-44.
154. Wilson, J.M., Kalasinsky, K.S., Levey, A.I., Bergeron, C., Reiber, G., Anthony, R.M., Schmunk, G.A., Shannak, K., Haycock, J.W., Kish, S.J. (1996). Striatal dopamine nerve terminal markers in human, chronic methamphetamine users. Nat Med, 2: 699-703.
155. Yin, H.H., Knowlton, B.J., Balleine, B.W. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur J Neurosci, 19: 181-9.
156. Zaborszky, L., Gaykema, R.P., Swanson, D.J., Cullinan, W.E. (1997). Cortical input to the basal forebrain. Neurosci, 79: 1051-78.