Learning-related changes in response patterns of prefrontal neurons during instrumental conditioning

Behavioural Brain Research

Volumn 146, Issue 1-2, 2003, Pages 77-88

  Mulder, Antonius B ^a   Nordquist, Rebecca E ^a,b   Örgüt, Okyay ^a   Pennartz, Cyriel M A ^a  

^a NETHERLANDS INSTITUTE FOR NEUROSCIENCE   (Netherlands)

^b VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

Instrumental conditioning; Learning and memory; Operant behavior; Prefrontal cortex; Tetrode

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; BIOLOGICAL MONITORING; BRAIN NERVE CELL; CONDITIONING; CONTROLLED STUDY; CORRELATION ANALYSIS; INSTRUMENTATION; LEARNING; MALE; NONHUMAN; PREDICTION; PREFRONTAL CORTEX; PRIORITY JOURNAL; RAT; RECORDING; SENSORIMOTOR FUNCTION; TASK PERFORMANCE;

EID: 0344825375     PISSN: 01664328     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.bbr.2003.09.016     Document Type: Article

References (79)

1. Asaad W.F., Rainer G., Miller E.K. Neural activity in the primate prefrontal cortex during associative learning. Neuron. 21:1998;1399-1407.
2. Asaad W.F., Rainer G., Miller E.K. Task-specific activity in the primate prefrontal cortex. J. Neurophysiol. 84:2000;451-459.
3. Baldwin A.E., Holahan M.R., Sadeghian K., Kelley A.E. N-Methyl-D-aspartate receptor-dependent plasticity within a distributed corticostriatal network mediates appetitive instrumental learning. Behav. Neurosci. 114:2000;84-98.
4. Balleine B.W., Dickinson A. A goal-directed instrumental action, contingency and incentive learning and their cortical substrates. Neuropharmacology. 37:1998;407-419.
5. Balleine B.W., Dickinson A. The effect of lesions of the insular cortex on instrumental conditioning: evidence for a role in incentive memory. J. Neurosci. 20:2000;8954-8964.
6. Balleine B.W., Killcross A.S., Dickinson A. The effect of lesions of the basolateral amygdala on instrumental conditioning. J. Neurosci. 23:2003;666-675.
7. Berns G.S., Cohen J.D., Mintun M.A. Brain regions responsive to novelty in the absence of awareness. Science. 276:1997;1272-1275.
8. Birrell J.M., Brown V.J. Medial frontal cortex mediates perceptual attentional set shifting in the rat. J. Neurosci. 20:2000;4320-4324.
9. Broersen L.M. Attentional processes and learning and memory in rats: the prefrontal cortex and hippocampus compared. Prog. Brain Res. 126:2000;79-94.
10. Brown V.J., Bowman E.M. Rodent models of prefrontal cortical function. TINS. 25:2002;340-343.
11. Cardinal R.N., Parkinson J.A., Hall J., Everitt B.J. Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev. 26:2002;321-352.
12. Chen L.L., Wise S.P. Neuronal activity in the supplementary eye field during acquisition of conditional oculomotor associations. J. Neurophysiol. 73:1995;1101-1121.
13. Corbit L.H., Balleine B.W. The role of the hippocampus in instrumental conditioning. J. Neurosci. 20:2000;4233-4239.
14. Corbit L.H., Muir J.L., Balleine B.W. The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell. J. Neurosci. 21:2001;3251-3260.
15. Corbit L.H., Ostlund S.B., Balleine B.W. Sensitivity to instrumental contingency degradation is mediated by the entorhinal cortex and its efferents via the dorsal hippocampus. J. Neurosci. 22:2002;10976-10984.
16. De Borchgrave R., Rawlins J.N.P., Dickinson A., Balleine B.W. Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats. Exp. Brain Res. 144:2002;50-68.
17. De Bruin J.P.C., Sanchez-Santed F., Heinsbroek R.P.W., Donker A., Postmes P. A behavioral analysis of rats with damage to the prefrontal cortex using the Morris water maze: evidence for behavioral flexibility, but not for impaired spatial navigation. Brain Res. 652:1994;323-333.
18. De Bruin J.P.C., Feenstra M.G.P., Broersen L.M., Van Leeuwen M., Arens C., De Vries S.et al. Role of the prefrontal cortex of the rat in learning and decision making: effects of transient inactivation. Prog. Brain. Res. 126:2000;103-116.
19. Dias R., Robbins T.W., Roberts A.C. Dissociation in prefrontal cortex of affective and attentional shifts. Nature. 380:1996;69-72.
20. Duncan J., Owen A.M. Common regions of the human frontal lobe recruited by diverse cognitive demands. TINS. 23:2000;475-483.
21. Friedman H.R., Goldman-Rakic P.S. Coactivation of prefrontal cortex and inferior parietal cortex in working memory tasks revealed by 2DG functional mapping in the rhesus monkey. J. Neurosci. 14:1994;2775-2788.
22. Fuster J.M. Unit activity in prefrontal cortex during delayed response performance: neuronal correlates of transient memory. J. Neurophysiol. 36:1973;61-78.
23. Fuster JM. The prefrontal cortex. Anatomy, physiology and neuropsychology of the frontal lobe. New York: Raven Press; 1997.
24. Fuster J.M., Alexander G.E. Neuron activity related to short-term memory. Science. 13:1971;652-654.
25. Goldman P.S., Rosvold H.E. Localization of function within the dorsolateral prefrontal cortex of the rhesus monkey. Exp. Neurol. 27:1970;291-304.
26. Goldman P.S., Rosvold H.E., Vest B., Galkin T.W. Analysis of the delayed-alternation deficit produced by dorsolateral prefrontal lesions in rhesus monkey. J. Comp. Physiol. Psychol. 77:1971;212-220.
27. Goldman-Rakic P.S. The prefrontal landscape: implications of functional architecture for understanding human mentation and the central executive. Phil. Trans. R. Soc. Lond. B. 351:1996;1445-1453.
28. Gray C.M., Maldonado P.E., Wilson M., McNaughton B. Tetrodes markedly improve the reliability and yield of multiple single-unit isolation from multi-unit recordings in cat striate cortex. J. Neurosci. Methods. 63:1995;43-54.
29. Groenewegen H.J., Uylings H.B. The prefrontal cortex and the integration of sensory, limbic and autonomic information. Prog. Brain Res. 126:2000;3-28.
30. Hollerman J.R., Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat. Neurosci. 1:1998;304-309.
31. Hoshi E., Shima K., Tanji J. Task-dependent selectivity of movement related neuronal activity in the primate prefrontal cortex. J. Neurophysiol. 80:1998;3392-3397.
32. Iba M., Sawaguchi T. Neuronal activity representing visuospatial mnemonic processes associated with target selection in the monkey dorsolateral prefrontal cortex. Neurosci. Res. 43:2002;9-22.
33. Jenkins I.H., Brooks D.J., Nixon P.D., Frackowiak R.S.J., Passingham R.E. Motor sequence learning: a study with positron emission tomography. J. Neurosci. 14:1994;3775-3790.
34. Jueptner M., Stephan K.M., Frith C.D., Brooks D.J., Frackowiak R.S.J., Passingham R.E. Anatomy of motor learning. I. Frontal cortex and attention to action. J. Neurophysiol. 77:1997;1313-1324.
35. Kesner R.P. Subregional analysis of mnemonic functions of the prefrontal cortex in the rat. Psychobiology. 28:2000;219-228.
36. Kim J.J., Krupa D.J., Thompson R.F. Inhibitory cerebello-olivary projections and blocking effect in classical conditioning. Science. 279:1998;570-573.
37. Kojima S., Goldman-Rakic P.S. Delay-related activity of prefrontal neurons in rhesus monkeys performing delayed response tasks. Brain Res. 248:1982;43-49.
38. Kolb B. Functions of the frontal cortex of the rat: a comparative review. Brain Res. Rev. 8:1990;65-98.
39. Kolb B. Animals models for human PFC-related disorders. Prog. Brain Res. 85:1990;501-520.
40. Kolb B, Whishaw IQ. Human neuropsychology. New York: Freeman and Company; 1996.
41. Kubota K., Niki H. Prefrontal cortical unit activity and delayed alternation performance in monkeys. J. Neurophysiol. 34:1971;337-347.
42. Leon M.I., Shadlen M.N. Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron. 24:1999;415-425.
43. Lever C., Wills T., Cacucci F., Burgess N., O'Keefe J. Long-term plasticity in hippocampal place-cell representation of environmental geometry. Nature. 416:2002;90-94.
44. Lezak MD. Neuropsychological assessment. New York: Oxford University Press; 1995.
45. Miller E.K. The prefrontal cortex and cognitive control. Nat. Rev. 1:2000;59-65.
46. Mitz A.R., Godschalk M., Wise S.P. Learning-dependent neuronal activity in the premotor cortex: activity during the acquisition of conditional motor associations. J. Neurosci. 11:1991;1855-1872.
47. Niki H, Sugita S, Watanabe M. Modification of the activity of primate frontal neurons during learning of a GO/NO-GO discrimination and its reversal. A progress report. In: Iwai E, Mishkin M, editors. Vision, memory and the temporal lobe. Amsterdam: Elsevier; 1990. p. 295-304.
48. Ono T., Nishijo H., Uwano T. Amygdala role in conditioned associative learning. Prog. Neurobiol. 46:1995;401-422.
49. Paxinos G, Watson C. The rat brain in stereotaxic coordinates, compact. 3rd ed. San Diego: Academic Press; 1997.
50. Pantelis C., Barber F.Z., Barnes T.R.E., Nelson H.E., Owen A.M., Robbins T.W. Comparison of set-shifting ability in patients with chronic schizophrenia and frontal lobe damage. Schizophrenia Res. 37:1999;251-270.
51. Petrides M. Motor conditional associative-learning after selective prefrontal lesions in the monkey. Behav. Brain Res. 5:1982;407-413.
52. Petrides M. Deficits on conditional associative-learning tasks after frontal and temporal - lobe lesions in man. Neuropsychologia. 23:1985;601-614.
53. Preuss T.M. Do rats have prefrontal cortex? The Rose and Woolsey-Akert program reconsidered. J. Cogn. Neurosci. 7:1995;1-24.
54. Ragozzino M.E., Detrick S., Kesner R.P. Involvement of the prelimbic-infralimbic areas of the rodent prefrontal cortex in behavioral flexibility for place and response learning. J. Neurosci. 19:1999;4585-4594.
55. Raichle M.E., Fiez J.A., Videen T.O., MacLeod A.-M.K., Pardo J.V., Fox P.T.et al. Practice-related changes in human brain functional anatomy during nonmotor learning. Cereb. Cortex. 4:1994;8-26.
56. Robbins T.W. Dissociating executive functions of the prefrontal cortex. Phil. Trans. R. Soc. Lond. B. 351:1996;1463-1471.
57. Sawaguchi T., Matsumura M., Kubota K. Dopamine enhances the neuronal activity of spatial short-term memory task in the primate prefrontal cortex. Neurosci. Res. 5:1988;465-473.
58. Schall J.D., Thompson K.G. Neural selection and control of visually guided eye movements. Annu. Rev. Neurosci. 22:1999;241-259.
59. Schoenbaum G., Chiba A.A., Gallagher M. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat. Neurosci. 1:1998;155-159.
60. Schoenbaum G., Chiba A.A., Gallagher M. Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning. J. Neurosci. 19:1999;1876-1884.
61. Schoenbaum G., Setlow B. Integrating orbitofrontal cortex into prefrontal theory: common processing themes across species and subdivisions. Learn. Mem. 8:2001;134-147.
62. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science. 275:1997;1593-1599.
63. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80:1998;1-27.
64. Seamans J.K., Floresco S.B., Phillips A.G. Functional differences between the prelimbic and anterior cingulate regions of the rat prefrontal cortex. Behav. Neurosci. 109:1995;1063-1073.
65. Shindy W.W., Posley K.A., Fuster J.M. Reversible deficit in haptic delay tasks from cooling prefrontal cortex. Cereb. Cortex. 4:1994;443-450.
66. Thompson R.F., Krupa D.J. Organization of memory traces in the mammalian brain. Ann. Rev. Neurosci. 17:1994;519-549.
67. Thorpe C.M., Floresco S.B., Carr J.A.R., Wilkie D.M. Alterations in time place learning induced by lesions to the rat medial prefrontal cortex. Behav. Process. 59:2002;87-100.
68. Tremblay L., Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature. 398:1999;704-708.
69. Tremblay L., Schultz W. Reward-related neuronal activity during Go-NoGo task performance in primate orbitofrontal cortex. J. Neurophysiol. 83:2000;1864-1876.
70. Tsujimoto T., Ogawa M., Nishikawa S., Tsukada H., Kakiuchi T., Sasaki K. Activation of the prefrontal, occipital and parietal cortices during go/no-go discrimination tasks in the monkey as revealed by positron emission tomography. Neurosci. Lett. 224:1997;111-114.
71. Uylings H.B.M., Van Eden C.G. Qualitative and quantitative comparison of the prefrontal cortex in rats and primates, including humans. Prog. Brain Res. 85:1990;31-62.
72. Wallis J.D., Anderson K.C., Miller E.K. Single neurons in prefrontal cortex encode abstract rules. Nature. 411:2001;953-956.
73. Wallis J.D., Dias R., Robbins T.W., Roberts A.C. Dissociable contributions of the orbitofrontal and lateral prefrontal cortex of the marmoset to performance on a detour reaching task. Eur. J. Neurosci. 13:2001;1797-1808.
74. White I.M., Wise S.P. Rule-dependent neuronal activity in the prefrontal cortex. Exp. Brain Res. 126:1999;315-335.
75. Wiener S.I. Spatial and behavioral correlates of striatal neurons in rats performing a self-initiated navigation task. J. Neurosci. 13:1993;3802-3817.
76. Williams G.V., Goldman-Rakic P.S. Modulation of memory fields by dopamine D1 receptors in prefrontal cortex. Nature. 376:1995;572-575.
77. Wilson M.A., McNaughton B.L. Dynamics of the hippocampal ensemble code for space. Science. 261:1993;1055-1058.
78. Wise S.P., Murray E.A. Arbitrary associations between antecedents and actions. TINS. 23:2000;271-276.
79. Yamatani K., Ono T., Nishijo H., Takaku A. Activity and distribution of learning-related neurons in monkey Macaca fuscata prefrontal cortex. Behav. Neurosci. 104:1990;503-531.