Reward expectation, orientation of attention and locus coeruleus-medial frontal cortex interplay during learning

European Journal of Neuroscience

Volumn 20, Issue 3, 2004, Pages 791-802

  Bouret, Sebastien ^a   Sara, Susan J ^a  

^a Université Pierre et Marie Curie   (France)

Author keywords

Incentive; Motivation; Neuromodulation; Noradrenaline; Prefrontal cortex; Rat

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL TISSUE; ANTICIPATION; ARTICLE; ATTENTION; CONTROLLED STUDY; FRONTAL CORTEX; LEARNING; LIGHT; LIMBIC CORTEX; LOCUS CERULEUS; MALE; NERVE CELL; NERVE CELL PLASTICITY; NERVE CONDUCTION; NONHUMAN; OLFACTORY DISCRIMINATION; ORIENTATION; PRIORITY JOURNAL; RAT; REWARD;

ACTION POTENTIALS; ANIMALS; ATTENTION; BEHAVIOR, ANIMAL; CONDITIONING, CLASSICAL; CUES; ELECTROPHYSIOLOGY; LEARNING; LOCUS COERULEUS; MALE; ODORS; ORIENTATION; PREFRONTAL CORTEX; RATS; RATS, SPRAGUE-DAWLEY; REWARD; TIME FACTORS;

EID: 3843112439     PISSN: 0953816X     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2004.03526.x     Document Type: Article

References (45)

1. Akkal, D., Bioulac, B., Audin, J. & Burbaud, P. (2002) Comparison of neuronal activity in the rostral supplementary and cingulate motor areas during a task with cognitive and motor demands. Eur. J. Neurosci., 15, 887-904.
2. Arnsten, A.F. (1997) Catecholamine regulation of the prefrontal cortex. J. Psychopharmacol., 11, 151-162.
3. Aston-Jones, G. & Bloom, F.E. (1981) Norepinephrine-containing locus coeruleus neurons in behaving rats exhibit pronounced responses to non-noxious environmental stimuli. J. Neurosci., 1, 887-900.
4. Aston-Jones, G., Rajkowski, J. & Cohen, J. (1999) Role of locus coeruleus in attention and behavioral flexibility. Biol. Psychiatry, 46, 1309-1320.
5. Aston-Jones, G., Rajkowski, J. & Kubiak, P. (1997) Conditioned responses of monkey locus coeruleus neurons anticipate acquisition of discriminative behavior in a vigilance task. Neuroscience, 80, 697-715.
6. Aston-Jones, G., Rajkowski, J., Kubiak, P. & Alexinsky, T. (1994) Locus coeruleus neurons in monkey are selectively activated by attended cues in a vigilance task. J. Neurosci., 14, 4467-4480.
7. Balleine, B.W. & Dickinson, A. (1998) Goal directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology, 37, 407-419.
8. Berridge, C.W. & Waterhouse, B.D. (2003) The locus coeruleus-noradrenergic system: modulation of behavioral state and state-dependent cognitive processes. Brain Res. Brain Res. Rev., 42, 33-84.
9. Birrell, J.M. & Brown, V.J. (2000) Medial frontal cortex mediates perceptual attentional set shifting in the rat. J. Neurosci., 20, 4320-4324.
10. Bouret, S. & Sara, S.J. (2002) Locus coeruleus activation modulates firing rate and temporal organization of odour-induced single-cell responses in rat piriform cortex. Eur. J. Neurosci., 16, 2371-2382.
11. Bouyer, J.J., Tilquin, C., Delagrange, P., Rougeul, A. & Buser, P (1989) Regulation pathways of expectancy behavior in the cat: histologic study. C. R. Acad. Sci., III, 309, 637-646.
12. Cardinal, R.N., Parkinson, J.A., Marbini, H.D., Toner, A.J., Bussey, T.J., Robbins, T.W. & Everitt, B.J. (2003) Role of the anterior cingulate cortex in the control over behavior by Pavlovian conditioned stimuli in rats. Behav. Neurosci., 117, 566-587.
13. Coull, J.T., Buchel, C., Fristen, K.J. & Frith, C.D. (1999) Noradrenergically mediated plasticity in a human attentional neuronal network. Neuroimage, 10, 705-715.
14. De Bruin, J.P., Feenstra, M.G., Broersen, L.M., Van Leeuwen, M., Arens, C., De Vries, S. & Joosten, R.N. (2000) Role of the prefrontal cortex of the rat in learning and decision making: effects of transient inactivation. Prog. Brain Res., 126, 103-113.
15. Delagrange, P., Tadjer, D., Bouyer, J.J., Rougeul, A. & Conrath, M. (1989) Effect of DSP4, a neurotoxic agent, on attentive behaviour and related electrocortical activity in cat. Behav. Brain Res., 33, 33-43.
16. Delatour, B. & Gisquet-Verrier, P. (2000) Functional role of rat prefimbic-infralimbic cortices in spatial memory: evidence for their involvement in attention and behavioural flexibility. Behav. Brain Res., 109, 113-128.
17. Florin-Lechner, S.M., Druhan, J.P., Aston-Jones, G. & Valentine, R.J. (1996) Enhanced norepinephrine release in prefrontal cortex with burst stimulation of the locus coeruleus. Brain Res., 742, 89-97.
18. Gill, T.M., Sarter, M. & Givens, B. (2000) Sustained visual attention performance-associated prefrontal neuronal activity: evidence for cholinergic modulation. J. Neurosci., 20, 4745-4757.
19. Harley, C.W., Lacaille, J.C. & Galway. M. (1983) Hypothalamic afferents to the dorsal dentate gyrus contain acetylcholinesterase. Brain Res., 270, 335-339.
20. Killcross, S. & Coutureau, E. (2003) Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb. Cortex, 13, 400-408.
21. Koyama, T., Kato, K., Tanaka, Y.Z. & Mikami, A. (2001) Anterior cingulate activity during pain-avoidance and reward tasks in monkeys. Neurosci. Res., 39, 421-430.
22. Lecas, J.C. (2004) Locus coeruleus activation shortens synaptic drive, decreases latency and improves spike timing precision in sensorimotor cortex. Implication for neuronal integration. Eur. J. Neurosci., 19, 2519-2530.
23. Mantz, J., Mula, C., Glowinski, J. & Thierry, A.M. (1988) Differential effects of ascending neurons containing dopamine and noradrenaline in the control of spontaneous activity and of evoked responses in the rat prefrontal cortex. Neuroscience, 27, 517-526.
24. Mulder, A.B., Nordquist, B., Örgüt, O. & Pennartz, C.M.A. (2003) Learning-related changes in response patterns of prefrontal neurons during instrumental conditioning. Behav. Brain Res., 146, 77-88.
25. Passetti, F., Chudasama, Y. & Robbins, T.W. (2002) The frontal cortex of the rat and visual attentional performance: dissociable functions of distinct medial prefrontal subregions. Cereb. Cortex, 12, 1254-1268.
26. Pochon, J.B., Levy, R., Fossati, P., Lehericy, S., Poline, J.B., Pillon, B., Le Bihan, D. & Dubois, B. (2002) The neural system that bridges reward and cognition in humans: an fMRI study. Proc. Natl Acad. Sci. USA, 99, 5669-5674.
27. Pratt, W.E. & Mizumori, S.J. (2001) Neurons in rat medial prefrontal cortex show anticipatory rate changes to predictable differential rewards in a spatial memory task. Behav. Brain Res., 123, 165-183.
28. Ravel, N., Chabaud, P., Martin, C., Gaveau, V., Hugues, E., Tallon-Baudry, C., Bertrand, O. & Gervais, R. (2003) Olfactory learning modifies the expression of odour-induced oscillatory responses in the gamma (60-90 Hz) and beta (15-40 Hz) bands in the rat olfactory bulb. Eur. J. Neurosci., 17, 350-358.
29. Sara, S.J. & Segal, M. (1991) Plasticity of sensory responses of locus coeruleus neurons in the behaving rat: implications for cognition. Prog. Brain Res., 88, 571-585.
30. Sawaguchi, T. & Kikuchi, Y. (1998) Noradrenergic effects on activity of prefrontal cortical neurons in behaving monkeys. Adv. Pharmacol., 42, 759-763.
31. Schoenbaum, G., Chiba, A.A. & Gallagher, M. (1998) Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nature Neurosci., 1, 155-159.
32. Schoenbaum, G. & Eichenbaum, H. (1995a) Information coding in the rodent prefrontal cortex. I. Single- neuron activity in orbitofrontal cortex compared with that in pyriform cortex. J. Neurophysiol., 74, 733-750.
33. Schoenbaum, G. & Eichenbaum, H. (1995b) Information coding in the rodent prefrontal cortex. II. Ensemble activity in orbitofrontal cortex. J. Neurophysiol., 74, 751-762.
34. Schultz, W. (2001) Reward signaling by dopamine neurons. Neuroscientist, 7, 293-302.
35. Schultz, W. (2002) Getting formal with dopamine and reward. Neuron, 36, 241-263.
36. Shidara, M. & Richmond, B.J. (2002) Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science, 296, 1709-1711.
37. Shinba, T., Briois, L. & Sara, S.J. (2000) Spontaneous and auditory-evoked activity of medial agranular cortex as a function of arousal state in the freely moving rat: interaction with locus coeruleus activity. Brain Res., 887, 293-300.
38. Takenouchi, K., Nishijo, H., Uwano, T., Tamura, R., Takigawa, M. & Ono, T. (1999) Emotional and behavioral correlates of the anterior cingulate cortex during associative learning in rats. Neuroscience, 93, 1271-1287.
39. Tremblay, L. & Schultz, W. (2000) Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. J. Neurophysiol., 83, 1877-1885.
40. Tronel, S. & Sara, S.J. (2002) Mapping of olfactory memory circuits: region-specific c-fos activation after odor-reward associative learning or after its retrieval. Learn. Mem., 9, 105-111.
41. Valentino, R.J., Page, M.E. & Curtis, A.L. (1991) Activation of noradrenergic locus coeruleus neurons by hemodynamic stress is due to local release of corticotropin-releasing factor. Brain Res., 555, 25-34.
42. Vankov, A., Hervé-Minvielle, A. & Sara, S.J. (1995) Response to novelty and its rapid habituation in locus coeruleus neurons of the freely exploring rat. Eur. J. Neurosci., 7, 1180-1187.
43. Walling, S.G. & Harley, C.W. (2004) Locus ceruleus activation initiates delayed synaptic potentiation of perforant path input to the dentate gyrus in awake rats: a novel beta-adrene. J. Neurosci., 24, 598-604.
44. Waterhouse, B.D. & Woodward, D. (1980) Interaction of norepinephrine with cerebrocortical activity evoked by stimulation of somatosensory afferent pathways in the rat. Exp. Neurol., 67, 11-34.
45. Weiss, G.K., Ratner, A., Voltura, A., Savage, D., Lucero, K. & Castillo, N. (1994) The effect of two different types of stress on locus coeruleus alpha-2 receptor binding. Brain Res. Bull., 33, 219-221.