The rat's not for turning: Dissociating the psychological components of cognitive inflexibility

Neuroscience and Biobehavioral Reviews

Volumn 56, Issue , 2015, Pages 1-14

  Nilsson, Simon R O ^a,b   Alsiö, Johan ^a,b,d   Somerville, Elizabeth M ^c   Clifton, Peter G ^c  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^c UNIVERSITY OF SUSSEX   (United Kingdom)

^d UPPSALA UNIVERSITY   (Sweden)

Author keywords

Animal models; Attentional set shifting; Cognitive flexibility; Discrimination learning; Reversal learning

Indexed keywords

DOPAMINE; DOPAMINE 1 RECEPTOR; DOPAMINE 2 RECEPTOR; PHOSPHOPROTEIN DARPP 32; SEROTONIN;

ASSOCIATION; ATTENTION; ATTENTION DEFICIT DISORDER; AVOIDANCE BEHAVIOR; COGNITIVE FLEXIBILITY; CONDITIONING; DISCRIMINATION LEARNING; EXECUTIVE FUNCTION; HUMAN; HUNTINGTON CHOREA; LEARNING; MOTIVATION; NONHUMAN; PARKINSON DISEASE; PERSEVERATION; PREFRONTAL CORTEX; PRIORITY JOURNAL; PROBLEM SOLVING; REINFORCEMENT; REVIEW; REWARD; SCHIZOPHRENIA; ANIMAL; COGNITION; PHYSIOLOGY; RAT;

ANIMALS; ATTENTION; COGNITION; DISCRIMINATION LEARNING; RATS; REVERSAL LEARNING; REWARD;

EID: 84947244039     PISSN: 01497634     EISSN: 18737528     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2015.06.015     Document Type: Review

References (164)

1. Abdul-Monim Z., Neill J.C., Reynolds G.P. Sub-chronic psychotomimetic phencyclidine induces deficits in reversal learning and alterations in parvalbumin-immunoreactive expression in the rat. J. Psychopharmacol. 2007, 21:198-205. 10.1177/0269881107067097.
2. Amsel A. The role of frustrative nonreward in noncontinuous reward situations. Psychol. Bull. 1958, 55:102-119.
3. Baker P.M., Thompson J.L., Sweeney J.A., Ragozzino M.E. Differential effects of 5-HT(2A) and 5-HT(2C) receptor blockade on strategy-switching. Behav. Brain Res. 2011, 219:123-131. 10.1016/j.bbr.2010.12.031.
4. Barch D.M. The cognitive neuroscience of schizophrenia. Annu. Rev. Clin. Psychol. 2005, 1:321-353. 10.1146/annurev.clinpsy.1.102803.143959.
5. Behar I. Learned avoidance of nonreward. Psychol. Rep. 1961, 9:34-52.
6. Bennett C.H., Maldonado A., Mackintosh N.J. Learned irrelevance is not the sum of exposure to CS and US. Q. J. Exp. Psychol., B 1995, 48:117-128. 10.1080/14640749508401442.
7. Bissonette G.B., Martins G.J., Franz T.M., Harper E.S., Schoenbaum G., Powell E.M. Double dissociation of the effects of medial and orbital prefrontal cortical lesions on attentional and affective shifts in mice. J. Neurosci. Res. 2008, 28:11124-11130. 10.1523/JNEUROSCI.2820-08.2008.
8. Bleuler E. Dementia Praecox or the Group of Schizophrenias 1950, International Universities Press, New York, NY.
9. Blomquist A.J., Deets A.C., Harlow H.F. Effects of list length and first-trial reward upon concurrent discrimination performance. Learn. Motiv. 1973, 4:28-39.
10. Boulougouris V., Dalley J.W., Robbins T.W. Effects of orbitofrontal, infralimbic and prelimbic cortical lesions on serial spatial reversal learning in the rat. Behav. Brain Res. 2007, 179:219-228. 10.1016/j.bbr.2007.02.005.
11. Boulougouris V., Glennon J.C., Robbins T.W. Dissociable effects of selective 5-HT2A and 5-HT2C receptor antagonists on serial spatial reversal learning in rats. Neuropsychopharmacology 2008, 33:2007-2019. 10.1038/sj.npp.1301584.
12. Boulougouris V., Robbins T.W. Enhancement of spatial reversal learning by 5-HT2C receptor antagonism is neuroanatomically specific. J. Neurosci. 2010, 30:930-938. 10.1523/JNEUROSCI.4312-09.2010.
13. Burke K.A., Takahashi Y.K., Correll J., Leon Brown P., Schoenbaum G. Orbitofrontal inactivation impairs reversal of Pavlovian learning by interfering with "disinhibition" of responding for previously unrewarded cues. Eur. J. Neurosci. 2009, 30:1941-1946. 10.1111/j.1460-9568.2009.06992.x.
14. Buss A.H. Rigidity as a function of reversal and non-reversal shifts in the learning of successive discriminations. J. Exp. Psychol. 1953, 45:75-81.
15. Buss A.H. Reversal and nonreversal shifts in concept formation with partial reinforcement eliminated. J. Exp. Psychol. 1956, 52:162-166.
16. Bussey T.J., Everitt B.J., Robbins T.W. Dissociable effects of cingulate and medial frontal cortex lesions on stimulus-reward learning using a novel Pavlovian autoshaping procedure for the rat: implications for the neurobiology of emotion. Behav. Neurosci. 1997, 111:908-919.
17. Cavanagh J.F., Masters S.E., Bath K., Frank M.J. Conflict acts as an implicit cost in reinforcement learning. Nat. Commun. 2014, 5:5394. 10.1038/ncomms6394.
18. Ceaser A.E., Goldberg T.E., Egan M.F., McMahon R.P., Weinberger D.R., Gold J.M. Set-shifting ability and schizophrenia: a marker of clinical illness or an intermediate phenotype?. Biol. Psychiatry 2008, 64:782-788. 10.1016/j.biopsych.2008.05.009.
19. Chamberlain S.R., Fineberg N.A., Blackwell A.D., Robbins T.W., Sahakian B.J. Motor inhibition and cognitive flexibility in obsessive-compulsive disorder and trichotillomania. Am. J. Psychiatry 2006, 163:1282-1284. 10.1176/appi.ajp.163.7.1282.
20. Choi J., Kurtz M.M. A comparison of remediation techniques on the Wisconsin Card Sorting Test in schizophrenia. Schizophrn. Res. 2009, 107:76-82. 10.1016/j.schres.2008.09.017.
21. Chudasama Y., Robbins T.W. Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J. Neurosci. 2003, 23:8771-8780.
22. Chudasama Y., Robbins T.W. Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J. Neurosci. 2003, 23:8771-8780.
23. Clark L., Iversen S.D., Goodwin G.M. A neuropsychological investigation of prefrontal cortex involvement in acute mania. Am. J. Psychiatry 2001, 158:1605-1611. 10.1176/appi.ajp.158.10.1605.
24. Clark L., Iversen S.D., Goodwin G.M. Sustained attention deficit in bipolar disorder. Br. J. Psychiatry 2002, 180:313-319. 10.1192/bjp.180.4.313.
25. Clark L., Sarna A., Goodwin G.M. Impairment of executive function but not memory in first-degree relatives of patients with bipolar I disorder and in euthymic patients with unipolar depression. Am. J. Psychiatry 2005, 162:1980-1982. 10.1176/appi.ajp.162.10.1980.
26. Clarke H.F., Hill G.J., Robbins T.W., Roberts A.C. Dopamine, but not serotonin, regulates reversal learning in the marmoset caudate nucleus. J. Neurosci. 2011, 31:4290-4297. 10.1523/JNEUROSCI.5066-10.2011.
27. Clarke H.F., Walker S.C., Dalley J.W., Robbins T.W., Roberts A.C. Cognitive inflexibility after prefrontal serotonin depletion is behaviorally and neurochemically specific. Cereb. Cortex 2007, 17:18-27. 10.1093/cercor/bhj120.
28. Clatworthy P.L., Lewis S.J.G., Brichard L., Hong Y.T., Izquierdo D., Clark L., Cools R., Aigbirhio F.I., Baron J.C., Fryer T.D., Robbins T.W. Dopamine release in dissociable striatal subregions predicts the different effects of oral methylphenidate on reversal learning and spatial working memory. J. Neurosci. 2009, 29:4690-4696. 10.1523/JNEUROSCI.3266-08.2009.
29. Coldren J.T., Halloran C. Spatial reversal as a measure of executive functioning in children with autism. J. Genet. Psychol. 2003, 164:29-41. 10.1080/00221320309597501.
30. Cools R. Dopaminergic modulation of cognitive function-implications for l-DOPA treatment in Parkinson's disease. Neurosci. Biobehav. Rev. 2006, 30:1-23. 10.1016/j.neubiorev.2005.03.024.
31. Cools R., Barker R.A., Sahakian B.J.B., Robbins T.W. Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cereb. Cortex 2001, 11:1136-1143. 10.1093/cercor/11.12.1136.
32. Cools R., Frank M.J., Gibbs S.E., Miyakawa A., Jagust W., D'Esposito M. Striatal dopamine predicts outcome-specific reversal learning and its sensitivity to dopaminergic drug administration. J. Neurosci. 2009, 29:1538-1543. 10.1523/JNEUROSCI.4467-08.2009.
33. Cools R., Robinson O.J., Sahakian B. Acute tryptophan depletion in healthy volunteers enhances punishment prediction but does not affect reward prediction. Neuropsychopharmacology 2008, 33:2291-2299. 10.1038/sj.npp.1301598.
34. Crider A. Perseveration in schizophrenia. Schizophr. Bull. 1997, 23:63-74. 10.1093/schbul/23.1.63.
35. Cross H.A., Brown L.T. Discrimination reversal learning in squirrel monkeys as a function of number of acquisition trials and prereversal experience. J. Comp. Physiol. Psychol. 1965, 59:429-431.
36. D'Cruz A.-M., Ragozzino M.E., Mosconi M.W., Shrestha S., Cook E.H., Sweeney J.A. Reduced behavioral flexibility in autism spectrum disorders. Neuropsychology 2013, 27:152-160. 10.1037/a0031721.
37. Dalley J.W., Everitt B.J., Robbins T.W. Impulsivity, compulsivity, and top-down cognitive control. Neuron 2011, 69:680-694. 10.1016/j.neuron.2011.01.020.
38. Daw N.D., Kakade S., Dayan P. Opponent interactions between serotonin and dopamine. Neural Netw. 2002, 15:603-616. 10.1016/S0893-6080(02)00052-7.
39. Dias R., Aggleton J.P. Effects of selective excitotoxic prefrontal lesions on acquisition of nonmatching- and matching-to-place in the T-maze in the rat: differential involvement of the prelimbic-infralimbic and anterior cingulate cortices in providing behavioural flexibility. Eur. J. Neurosci. 2000, 12:4457-4466. 10.1046/j.0953-816X.2000.01323.x.
40. Dias R., Robbins T.W., Roberts A.C. Dissociation in prefrontal cortex of affective and attentional shifts. Nature 1996, 380:69-72. 10.1038/380069a0.
41. Dickstein D.P., Treland J.E., Snow J., McClure E.B., Mehta M.S., Towbin K.E., Pine D.S., Leibenluft E. Neuropsychological performance in pediatric bipolar disorder. Biol. Psychiatry 2004, 55:32-39. 10.1016/S0006-3223(03)00701-7.
42. Downes J.J., Roberts A.C., Sahakian B.J., et al. Impaired extra-dimensional shift performance in medicated and unmedicated Parkinson's disease: evidence for a specific attentional dysfunction. Neuropsychologia 1989, 27:1329-1343.
43. Elliott R., McKenna P.J., Robbins T.W. Specific neuropsychological deficits in schizophrenic patients with preserved intellectual function. Cognit. Neuropsychiatry 1998, 3:45-70. 10.1080/135468098396242.
44. Elliott R., McKenna P.J., Robbins T.W., Sahakian B.J. Neuropsychological evidence for frontostriatal dysfunction in schizophrenia. Psychol. Med. 1995, 25:619-630.
45. Ersche K.D., Roiser J.P., Robbins T.W., Sahakian B.J. Chronic cocaine but not chronic amphetamine use is associated with perseverative responding in humans. Psychopharmacology 2008, 197:421-431. 10.1007/s00213-007-1051-1.
46. Floresco S.B., Ghods-Sharifi S., Vexelman C., Magyar O. Dissociable roles for the nucleus accumbens core and shell in regulating set shifting. J. Neurosci. 2006, 26:2449-2457. 10.1523/JNEUROSCI.4431-05.2006.
47. Frank M.J., Fossella J.A. Neurogenetics and pharmacology of learning, motivation, and cognition. Neuropsychopharmacology 2010, 36:133-152. 10.1038/npp.2010.96.
48. Frank M.J., Hutchison K. Genetic contributions to avoidance-based decisions: striatal D2 receptor polymorphisms. Neuroscience 2009, 164:131-140. 10.1016/j.neuroscience.2009.04.048.
49. Frank M.J., Moustafa A.A., Haughey H.M., Curran T., Hutchison K.E. Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proc. Natl. Acad. Sci. U.S.A. 2007, 104:16311-16316. 10.1073/pnas.0706111104.
50. Frank M.J., O'Reilly R.C. A mechanistic account of striatal dopamine function in human cognition: Psychopharmacological studies with cabergoline and haloperidol. Behav. Neurosci. 2006, 120:497-517. 10.1037/0735-7044.120.3.497.
51. Frank M.J., Samanta J., Moustafa A.A., Sherman S.J. Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism. Science 2007, 318:1309-1312. 10.1126/science.1146157.
52. Frank M.J., Santamaria A., O'Reilly R.C., Willcutt E. Testing computational models of dopamine and noradrenaline dysfunction in attention deficit/hyperactivity disorder. Neuropsychopharmacology 2006, 32:1583-1599. 10.1038/sj.npp.1301278.
53. Frank M.J., Seeberger L.C., O'Reilly R.C. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 2004, 306:1940-1943. 10.1126/science.1102941.
54. Freedman M., Oscar-Berman M. Spatial and visual learning deficits in Alzheimer's and Parkinson's disease. Brain. Cognit. 1989, 11:114-126. 10.1016/0278-2626(89)90009-2.
55. Freeman T., Gathercole C.E. Perseveration the clinical symptoms in chronic schizophrenia and organic dementia. Br. J. Psychiatry 1966, 112:27-32. 10.1192/bjp.112.482.27.
56. Gardner R.A., Coate W.B. Reward versus nonreward in a simultaneous discrimination. J. Exp. Psychol. 1965, 69:579-582. 10.1037/h0022057.
57. Garner J.P. Perseveration and stereotypy-systems-level insights from clinical psychology. Stereotypic Animal Behaviour-Fundamentals and Applications for Welfare 2006, 121-142. CABI, Trowbridge, UK. G. Mason, J. Rushen (Eds.).
58. Garner J.P., Thogerson C.M., Würbel H., Murray J.D., Mench J.A. Animal neuropsychology: validation of the intra-dimensional extra-dimensional set shifting task for mice. Behav. Brain Res. 2006, 173:53-61. 10.1016/j.bbr.2006.06.002.
59. Gau S.S.-F., Shang C.-Y. Executive functions as endophenotypes in ADHD: evidence from the Cambridge Neuropsychological Test Battery (CANTAB). J. Child Psychol. Psychiatry 2010, 51:838-849. 10.1111/j.1469-7610.2010.02215.x.
60. Gauntlett-Gilbert J., Roberts R.C.R., Brown V.J. Mechanisms underlying attentional set-shifting in Parkinson's disease. Neuropsychologia 1999, 37:605-616. 10.1016/S0028-3932(98)00049-9.
61. Geyer M.A., Tamminga C.A. Measurement and treatment research to improve cognition in schizophrenia: neuropharmacological aspects. Psychopharmacology 2004, 174:1-2. 10.1007/s00213-004-1846-2.
62. Ghods-Sharifi S., Haluk D.M., Floresco S.B. Differential effects of inactivation of the orbitofrontal cortex on strategy set-shifting and reversal learning. Neurobiol. Learn. Mem. 2008, 89:567-573. 10.1016/j.nlm.2007.10.007.
63. Gold J.M., Waltz J.A., Matveeva T.M., Kasanova Z., Strauss G.P., Herbener E.S., Collins A.G.E., Frank M.J. Negative symptoms and the failure to represent the expected reward value of actions: behavioral and computational modeling evidence. Arch. Gen. Psychiatry 2012, 69:129-138. 10.1001/archgenpsychiatry.2011.1269.
64. Gorrindo T., Blair K.S., Budhani S., Dickstein D.P., Pine D.S., Leibenluft E. Deficits on a probabilistic response-reversal task in patients with pediatric bipolar disorder. Am. J. Psychiatry 2005, 162:1975-1977. 10.1176/appi.ajp.162.10.1975.
65. Goulart P.R.K., Mendonça M.B., Barros R.S., Galvão O.F., McIlvane W.J. A note on select- and reject-controlling relations in the simple discrimination of capuchin monkeys (Cebus apella). Behav. Processes 2005, 69:295-302. 10.1016/j.beproc.2004.12.005.
66. Grabbe W., Campione J.C. A novelty interpretation of the Moss-Harlow effect in preschool children. Child Dev. 1969, 40:1077-1084.
67. Graybeal C., Feyder M., Schulman E., Saksida L.M., Bussey T.J., Brigman J.L., Holmes A. Paradoxical reversal learning enhancement by stress or prefrontal cortical damage: rescue with BDNF. Nat. Neurosci. 2011, 14:1507-1509. 10.1038/nn.2954.
68. Green M.F. Cognitive impairment and functional outcome in schizophrenia and bipolar disorder. J. Clin. Psychiatry 2006, 67(supl 9):3-8.
69. Harrow M., Friedman G.B. Comparing reversal and nonreversal shifts in concept formation with partial reinforcement controlled. J. Exp. Psychol. 1958, 55:592-598. 10.1037/h0043893.
70. Helmick J.W., Berg C.B. Perseveration in brain-injured adults. J. Commun. Disord. 1976, 9:143-156.
71. Holmes M.K., Erickson K., Luckenbaugh D.A., Drevets W.C., Bain E.E., Cannon D.M., Snow J., Sahakian B.J., Manji H.K., Zarate C.A. A comparison of cognitive functioning in medicated and unmedicated subjects with bipolar depression. Bipolar Disord. 2008, 10:806-815. 10.1111/j.1399-5618.2008.00628.x.
72. Horner A.E., Heath C.J., Hvoslef-Eide M., Kent B.A., Kim C.H., Nilsson S., Alsiö J., Oomen C.A., Holmes A., Saksida L.M., Bussey T.J. The touchscreen operant platform for testing learning and memory in rats and mice. Nat. Protoc. 2013, 8:1961-1984. 10.1038/nprot.2013.122.
73. Hughes C., Russell J., Robbins T.W. Evidence for executive dysfunction in autism. Neuropsychologia 1994, 32:477-492. 10.1016/0028-3932(94)90092-2.
74. Insel T., Cuthbert B., Garvey M., Heinssen R., Pine D.S., Quinn K., Sanislow C., Wang P. Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am. J. Psychiatry 2010, 167:748-751. 10.1176/appi.ajp.2010.09091379.
75. Itami S.S., Uno H.H. Orbitofrontal cortex dysfunction in attention-deficit hyperactivity disorder revealed by reversal and extinction tasks. NeuroReport 2002, 13:2453-2457. 10.1097/01.wnr.0000047687.08940.42.
76. Izquierdo A., Jentsch J.D. Reversal learning as a measure of impulsive and compulsive behavior in addictions. Psychopharmacology 2012, 219:607-620. 10.1007/s00213-011-2579-7.
77. James W. The Principles of Psychology 1890, Henry Holt & CO, New York, NY.
78. Jazbec S., Pantelis C., Robbins T.W., Weickert T., Weinberger D.R., Goldberg T.E. Intra-dimensional/extra-dimensional set-shifting performance in schizophrenia: impact of distractors. Schizophr. Res. 2007, 89:339-349. 10.1016/j.schres.2006.08.014.
79. Jentsch J.D., Olausson P., La Garza, De R., Taylor J.R. Impairments of reversal learning and response perseveration after repeated, intermittent cocaine administrations to monkeys. Neuropsychopharmacology 2002, 26:183-190. 10.1016/S0893-133X(01)00355-4.
80. Jocham G., Klein T.A., Ullsperger M. Dopamine-mediated reinforcement learning signals in the striatum and ventromedial prefrontal cortex underlie value-based choices. J. Neurosci. 2011, 31:1606-1613. 10.1523/JNEUROSCI.3904-10.2011.
81. Keeler J.F., Robbins T.W. Translating cognition from animals to humans. Biochem. Pharmacol. 2011, 81:1356-1366. 10.1016/j.bcp.2010.12.028.
82. Kempton S., Vance A., Maruff P., Luk E., Costin J., Pantelis C. Executive function and attention deficit hyperactivity disorder: stimulant medication and better executive function performance in children. Psychol. Med. 1999, 29:527-538. 10.1017/S0033291799008338.
83. Kendler H.H., D'Amato M.F. A comparison of reversal shifts and nonreversal shifts in human concept formation behavior. J. Exp. Psychol. 1955, 49:165.
84. Kim J., Ragozzino M.E. The involvement of the orbitofrontal cortex in learning under changing task contingencies. Neurobiol. Learn. Mem. 2005, 83:125-133. 10.1016/j.nlm.2004.10.003.
85. Kringelbach M.L. The human orbitofrontal cortex: linking reward to hedonic experience. Nat. Rev. Neurosci. 2005, 6:691-702. 10.1038/nrn1747.
86. Lange K.W., Sahakian B.J., Quinn N.P., Marsden C.D., Robbins T.W. Comparison of executive and visuospatial memory function in Huntington's disease and dementia of Alzheimer type matched for degree of dementia. J. Neurol. Neurosurg. Psychiatry 1995, 58:598-606.
87. Lawrence A.D., Hodges J.R., Rosser A.E., et al. Evidence for specific cognitive deficits in preclinical Huntington's disease. Brain 1998, 121(Pt 7):1329-1341.
88. Lawrence A.D., Sahakian B.J., Hodges J.R., et al. Executive and mnemonic functions in early Huntington's disease. Brain 1996, 119(Pt 5):1633-1645.
89. Lawrence A.D., Sahakian B.J., Rogers R.D., Hodge J.R., Robbins T.W. Discrimination, reversal, and shift learning in Huntington's disease: mechanisms of impaired response selection. Neuropsychologia 1999, 37:1359-1374. 10.1016/S0028-3932(99)00035-4.
90. Laws K.R. A meta-analytic review of wisconsin card sort studies in schizophrenia: general intellectual deficit in disguise?. Cognit. Neuropsychiatry 1999, 4:1-30. 10.1080/135468099396025.
91. Leeson V.C., Robbins T.W., Matheson E., Hutton S.B., Ron M.A., Barnes T.R.E., Joyce E.M. Discrimination learning, reversal, and set-shifting in first-episode schizophrenia: stability over six years and specific associations with medication type and disorganization syndrome. Biol. Psychiatr. 2009, 66:586-593. 10.1016/j.biopsych.2009.05.016.
92. Lovejoy E. Analysis of the overlearning reversal effect. Psychol. Rev. 1966, 73:87-103. 10.1037/h0022687.
93. Lubow R.E. Latent Inhibition and Conditioned Attention Theory 1989, Cambridge University Press, Cambridge, UK.
94. Luria A.R. Two kinds of motor perseveration in massive injury of the frontal lobes. Brain 1965, 88:1-10.
95. Mackintosh N.J. Selective attention in animal discrimination learning. Psychol. Bull. 1965, 64:124.
96. Mackintosh N.J. Further analysis of the overtraining reversal effect. J. Comp. Physiol. Psychol. 1969, 67:Suppl-Suppl18.
97. Mackintosh N.J. A search for contrast effects in discrete-trial discrimination learning by pigeons. Learn. Motiv. 1974, 5:311-327. 10.1016/0023-9690(74)90014-9.
98. Mackintosh N.J. A theory of attention: Variations in the associability of stimuli with reinforcement. Psychol. Rev. 1975, 82:276-298.
99. Mackintosh N.J. Conditioning and Associative Learning 1983, Oxford University Press, Oxford, UK.
100. Mackintosh N.J., McGonigle B., Holgate V., Vanderver V. Factors underlying improvement in serial reversal learning. Can. J. Psychol. 1968, 22:85-95.
101. Maes J.H.R., Damen M.D.C., Eling P.A.T.M. More learned irrelevance than perseveration errors in rule shifting in healthy subjects. Brain Cognit. 2004, 54:201-211. 10.1016/j.bandc.2004.01.003.
102. Maes J.H.R., Eling P.A.T.M. Do learned irrelevance and perseveration play a role during discrimination learning?. Learn. Motiv. 2009, 40:274-283. 10.1016/j.lmot.2009.02.001.
103. Malhotra A.K., Kestler L.J., Mazzanti C., Bates J.A., Goldberg T.E., Goldman D. A functional polymorphism in the COMT gene and performance on a test of prefrontal cognition. Am. J. Psychiatry 2002, 159:652-654. 10.1176/appi.ajp.159.4.652.
104. Mar A.C., Horner A.E., Nilsson S., Alsiö J., Kent B.A., Kim C.H., Holmes A., Saksida L.M., Bussey T.J. The touchscreen operant platform for assessing executive function in rats and mice. Nat. Protoc. 2013, 8:1985-2005. 10.1038/nprot.2013.123.
105. Martínez-Arán A., Vieta E., Reinares M., Colom F., Torrent C., Sánchez-Moreno J., Benabarre A., Goikolea J.M., Comes M., Salamero M. Cognitive function across manic or hypomanic, depressed, and euthymic states in bipolar disorder. Am. J. Psychiatry 2004, 161:262-270. 10.1176/appi.ajp.161.2.262.
106. McAlonan K., Brown V.J. Orbital prefrontal cortex mediates reversal learning and not attentional set shifting in the rat. Behav. Brain Res. 2003, 146:97-103. 10.1016/j.bbr.2003.09.019.
107. McCool M.F., Patel S., Talati R., Ragozzino M.E. Differential involvement of M1-type and M4-type muscarinic cholinergic receptors in the dorsomedial striatum in task switching. Neurobiol. Learn. Mem. 2008, 89:114-124. 10.1016/j.nlm.2007.06.005.
108. McEnaney K.W., Butter C.M. Perseveration of responding and nonresponding in monkeys with orbital frontal ablations. J. Comp. Physiol. Psychol. 1969, 68:558-561. 10.1037/h0027639.
109. McKirdy J., Sussmann J.E.D., Hall J., Lawrie S.M., Johnstone E.C., McIntosh A.M. Set shifting and reversal learning in patients with bipolar disorder or schizophrenia. Psychol. Med. 2009, 39:1289-1293. 10.1017/S0033291708004935.
110. Merriam E.P., Thase M.E., Haas G.L., Keshavan M.S., Sweeney J.A. Prefrontal cortical dysfunction in depression determined by Wisconsin Card Sorting Test performance. Am. J. Psychiatry 1999, 156:780-782.
111. Moss E.M., Harlow H.F. The role of reward in discrimination learning in monkeys. J. Comp. Physiol. Psychol. 1947, 40:333-342. 10.1037/h0058469.
112. Mullins G.P., Winefield A.H. The relative importance of responses to S+ and S- in simultaneous discrimination learning. Q. J. Exp. Psychol. 1979, 31:329-338. 10.1080/14640747908400731.
113. Murphy F.C., Sahakian B.J., Rubinsztein J.S., Michael A., Rogers R.D., Robbins T.W., Paykel E.S. Emotional bias and inhibitory control processes in mania and depression. Psychol. Med. 1999, 29:1307-1321.
114. Murray G.K., Cheng F., Clark L., Barnett J.H., Blackwell A.D., Fletcher P.C., Robbins T.W., Bullmore E.T., Jones P.B. Reinforcement and reversal learning in first-episode psychosis. Schizophr. Bull. 2008, 34:848-855. 10.1093/schbul/sbn078.
115. Nilsson S., Ripley T.L., Somerville E.M., Clifton P.G. Reduced activity at the 5-HT(2C) receptor enhances reversal learning by decreasing the influence of previously non-rewarded associations. Psychopharmacology 2012, 224:241-254. 10.1007/s00213-012-2746-5.
116. Nilsson S., Somerville E.M., Clifton P.G. Dissociable effects of 5-HT2C receptor antagonism and genetic inactivation on perseverance and learned non-reward in an egocentric spatial reversal task. PLoS ONE 2013, 8:e77762. 10.1371/journal.pone.0077762.
117. Nissen H.W. Description of the learned response in discrimination behavior. Psychol. Rev. 1950, 57:121-131.
118. Nonkes L.J.P., Maes J.H.R., Homberg J.R. Improved cognitive flexibility in serotonin transporter knockout rats is unchanged following chronic cocaine self-administration. Addict Biol. 2011, 10.1111/j.1369-1600.2011.00351.x.
119. Nonkes L.J.P., van de Vondervoort I.I.G.M., de Leeuw M.J.C., Wijlaars L.P., Maes J.H.R., Homberg J.R. Serotonin transporter knockout rats show improved strategy set-shifting and reduced latent inhibition. Learn. Mem. 2012, 19:190-193. 10.1101/lm.025908.112.
120. Oscar-Berman M., Zola-Morgan S.M. Comparative neuropsychology and Korsakoff's syndrome, I.-Spatial and visual reversal learning. Neuropsychologia 1980, 18:499-512. 10.1016/0028-3932(80)90152-9.
121. Ouden, den H.E.M., Daw N.D., Fernandez G., Elshout J.A., Rijpkema M., Hoogman M., Franke B., Cools R. Dissociable effects of dopamine and serotonin on reversal learning. Neuron 2013, 80:1090-1100. 10.1016/j.neuron.2013.08.030.
122. Owen A.M., Roberts A., Hodges J.R., Summers B., Polkey C.E., Robbins T.W. Contrasting mechanisms of impaired attentional set-shifting in patients with frontal lobe damage or Parkinson's disease. Brain 1993, 1159-1175. 10.1093/brain/116.5.1159.
123. Ozonoff S., Cook I., Coon H., Dawson G., Joseph R.M., Klin A., McMahon W.M., Minshew N., Munson J.A., Pennington B.F., Rogers S.J., Spence M.A., Tager-Flusberg H., Volkmar F.R., Wrathall D. Performance on Cambridge Neuropsychological Test Automated Battery subtests sensitive to frontal lobe function in people with autistic disorder: evidence from the collaborative programs of excellence in autism network. J. Autism Dev. Disord. 2004, 34:139-150. 10.1023/B:JADD.0000022605.81989.cc.
124. Ozonoff S., South M., Miller J.N. DSM-IV-defined Asperger syndrome: cognitive, behavioral and early history differentiation from high-functioning autism. Autism 2000, 4:29-46. 10.1177/1362361300041003.
125. Palencia C.A., Ragozzino M.E. The influence of NMDA receptors in the dorsomedial striatum on response reversal learning. Neurobiol. Learn. Mem. 2004, 82:81-89. 10.1016/j.nlm.2004.04.004.
126. Pantelis C., Barber F.Z., Barnes T.R., Nelson H.E., Owen A.M., Robbins T.W. Comparison of set-shifting ability in patients with chronic schizophrenia and frontal lobe damage. Schizophrn. Res. 1999, 37:251-270.
127. Parasuraman R. The attentive brain: issues and prospects. The Attentive Brain 1998, 3-16. MIT Press, Cambridge. R. Parasuraman (Ed.).
128. Pearce J.M., Hall G. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev. 1980, 87:532-552.
129. Ragozzino M.E. The contribution of the medial prefrontal cortex, orbitofrontal cortex, and dorsomedial striatum to behavioral flexibility. Ann. N.Y. Acad. Sci. 2007, 1121:355-375. 10.1196/annals.1401.013.
130. Reeve W.V., Schandler S.L. Frontal lobe functioning in adolescents with attention deficit hyperactivity disorder. Adolescence 2001, 36:749-765.
131. Reischies F.M. Pattern of disturbance of different ventral frontal functions in organic depression. Ann. N.Y. Acad. Sci. 1999, 877:775-780.
132. Remijnse P.L., Nielen M.A., van Balkom A.J.L.M., Cath D.C., van Oppen P., Uylings H.B.M., Veltman D.J. Reduced orbitofrontal-striatal activity on a reversal learning task in obsessive-compulsive disorder. Arch. Gen. Psychiatry 2006, 63:1225-1236. 10.1001/archpsyc.63.11.1225.
133. Rescorla R.A., Holland P.C. Behavioral studies of associative learning in animals. Annu. Rev. Psychol. 1982, 33:265-308.
134. Robbins T.W., Roberts A.C. Differential regulation of fronto-executive function by the monoamines and acetylcholine. Cereb. Cortex 2007, 17(Suppl 1):i151-i160. 10.1093/cercor/bhm066.
135. Roberts A.C. The importance of serotonin for orbitofrontal function. Biol. Psychiatry 2011, 69:1185-1191. 10.1016/j.biopsych.2010.12.037.
136. Robinson O.J., Cools R., Carlisi C.O., Sahakian B.J., Drevets W.C. Ventral striatum response during reward and punishment reversal learning in unmedicated major depressive disorder. Am. J. Psychiatry 2012, 169:152-159. 10.1176/appi.ajp.2011.11010137.
137. Robinson O.J., Frank M.J., Sahakian B.J., Cools R. Dissociable responses to punishment in distinct striatal regions during reversal learning. NeuroImage 2010, 51:1459-1467. 10.1016/j.neuroimage.2010.03.036.
138. Robinson O.J., Standing H.R., DeVito E.E., Cools R., Sahakian B.J. Dopamine precursor depletion improves punishment prediction during reversal learning in healthy females but not males. Psychopharmacology 2010, 211:187-195. 10.1007/s00213-010-1880-1.
139. Rossell S.L.S., David A.S.A. Improving performance on the WCST: variations on the original procedure. Schizophrn. Res. 1997, 28:63-76.
140. Rudebeck P.H., Saunders R.C., Prescott A.T., Chau L.S., Murray E.A. Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating. Nat. Publ. Group 2013, 16:1140-1145. 10.1038/nn.3440.
141. Sandson J., Albert M.L. Varieties of perseveration. Neuropsychologia 1984, 22:715-732. 10.1016/0028-3932(84)90098-8.
142. Sasaki M. Influence of prereversal experience on reversal learning in white rats. Annu. Anim. Psychol. 1969, 19:17-28.
143. Scheggia D., Bebensee A., Weinberger D.R., Papaleo F. The ultimate intra-/extra-dimensional attentional set-shifting task for mice. Biol. Psychiatry 2013, 1-11. 10.1016/j.biopsych.2013.05.021.
144. Schoenbaum G., Nugent S.L., Saddoris M.P., Setlow B. Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations. NeuroReport 2002, 13:885-890.
145. Schoenbaum G., Setlow B., Nugent S.L., Saddoris M.P., Gallagher M. Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. Learn. Mem. 2003, 10:129-140. 10.1101/lm.55203.
146. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 1998, 80:1-27.
147. Shamay-Tsoory S.G., Shur S., Harari H., Levkovitz Y. Neurocognitive basis of impaired empathy in schizophrenia. Neuropsychology 2007, 21:431-438. 10.1037/0894-4105.21.4.431.
148. Slabosz A., Lewis S.J.G., Smigasiewicz K., Szymura B., Barker R.A., Owen A.M. The role of learned irrelevance in attentional set-shifting impairments in Parkinson's disease. Neuropsychology 2006, 20:578-588. 10.1037/0894-4105.20.5.578.
149. Slamecka N.J. A methodological analysis of shift paradigms in human discrimination learning. Psychol. Bull. 1968, 69:423-438.
150. Spence K.W. The nature of discrimination learning in animals. Psychol. Rev. 1936, 43:427-449. 10.1037/h0056975.
151. Spence K.W. The differential response in animals to stimuli varying within a single dimension. Psychol. Rev. 1937, 44:430.
152. Stalnaker T.A., Cooch N.K., Schoenbaum G. What the orbitofrontal cortex does not do. Nat. Neurosci. 2015, 18:620-627. 10.1038/nn.3982.
153. Stevens D.A., Fechter L.D. Relative strengths of approach and avoidance tendencies in discrimination learning of rats trained under two types of reinforcement. J. Exp. Psychol. 1968, 76:489-491. 10.1037/h0025553.
154. Sutherland N.S., Mackintosh N.J. Mechanisms of Animal Discrimination Learning 1971, Academic Press, London.
155. Tait D.S., Brown V.J. Difficulty overcoming learned non-reward during reversal learning in rats with ibotenic acid lesions of orbital prefrontal cortex. Ann. N.Y. Acad. Sci. 2007, 1121:407-420. 10.1196/annals.1401.010.
156. Tait D.S., Chase E.A., Brown V.J. Attentional set-shifting in rodents: a review of behavioural methods and pharmacological results. Curr. Pharm. Des. 2014, 20:5046-5059.
157. Taylor Tavares J.V., Clark L., Cannon D.M., Erickson K., Drevets W.C., Sahakian B.J. Distinct profiles of neurocognitive function in unmedicated unipolar depression and bipolar II depression. Biol. Psychiatry 2007, 62:917-924. 10.1016/j.biopsych.2007.05.034.
158. Terrace H.S. Escape from S-. Learn. Motiv. 1971, 2:148-163.
159. Terrace H.S.H. Discrimination learning with and without "errors". J. Exp. Anal. Behav. 1963, 6:1-27. 10.1901/jeab.1963.6-1.
160. Ursu S., Carter C.S. Outcome representations, counterfactual comparisons and the human orbitofrontal cortex: implications for neuroimaging studies of decision-making. Cognit. Brain Res. 2005, 23:51-60. 10.1016/j.cogbrainres.2005.01.004.
161. Vaughter R.M., Cross H.A. Discrimination reversal performance in children as a function of prereversal experience and overlearning. Psychon. Sci. 1965, 2:363-364.
162. Waltz J.A., Frank M.J., Robinson B.M., Gold J.M. Selective reinforcement learning deficits in schizophrenia support predictions from computational models of striatal-cortical dysfunction. Biol. Psychiatry 2007, 62:756-764. 10.1016/j.biopsych.2006.09.042.
163. Watkins L.H., Sahakian B.J., Robertson M.M., Veale D.M., Rogers R.D., Pickard K.M., Aitken M.R.F., Robbins T.W. Executive function in Tourette's syndrome and obsessive-compulsive disorder. Psychol. Med. 2005, 35:571-582. 10.1017/S0033291704003691.
164. Worbe Y., Palminteri S., Savulich G., Daw N.D., Fernandez-Egea E., Robbins T.W., Voon V. Valence-dependent influence of serotonin depletion on model-based choice strategy. Mol. Psychiatry 2015, 10.1038/mp.2015.46.