The influence of the noradrenergic system on optimal control of neural plasticity

Frontiers in Behavioral Neuroscience

Volumn , Issue NOV, 2013, Pages

  Silvetti, Massimo ^a,b   Seurinck, Ruth ^a   van Bochove, Marlies E ^a   Verguts, Tom ^a,b  

^a GHENT UNIVERSITY   (Belgium)

^b GHENT UNIVERSITY HOSPITAL   (Belgium)

Author keywords

ACC; Learning rate; Locus coeruleus; Norepinephrine; Plasticity; Prediction error; Reinforcement learning; Volatility

Indexed keywords

ADAPTATION; ANTERIOR CINGULATE; ARTICLE; DECISION MAKING; ENVIRONMENTAL CHANGE; FEEDBACK SYSTEM; FEMALE; HUMAN; HUMAN EXPERIMENT; LEARNING; LOCUS CERULEUS; MALE; MATHEMATICAL MODEL; NERVE CELL PLASTICITY; NEUROMODULATION; NORADRENERGIC SYSTEM; NORMAL HUMAN; PUPIL; REINFORCEMENT; REWARD; TASK PERFORMANCE; UNCERTAINTY;

EID: 84887868790     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2013.00160     Document Type: Article

References (26)

1. Alexander, W. H., and Brown, J. W. (2011). Medial prefrontal cortex as an action-outcome predictor. Nat. Neurosci. 14, 1338-1344. doi: 10. 1038/nn. 2921.
2. Aston-Jones, G., and Cohen, J. D. (2005a). Adaptive gain and the role of the locus coeruleus-norepinephrine system in optimal performance. J. Comp. Neurol. 493, 99-110. doi: 10. 1002/cne. 20723.
3. Aston-Jones, G., and Cohen, J. D. (2005b). An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Annu. Rev. Neurosci. 28, 403-450. doi: 10. 1146/annurev. neuro. 28. 061604. 135709.
4. Behrens, T. E., Woolrich, M. W., Walton, M. E., and Rushworth, M. F. (2007). Learning the value of information in an uncertain world. Nat. Neurosci. 10, 1214-1221. doi: 10. 1038/nn1954.
5. Breen, L. A., Burde, R. M., and Loewy, A. D. (1983). Brainstem connections to the Edinger-Westphal nucleus of the cat: a retrograde tracer study. Brain Res. 261, 303-306. doi: 10. 1016/0006-8993(83)90633-9.
6. Carpenter, G., and Grossberg, S. (1988). The art of adaptive pattern recognition by a self-organizing neural network. Computer 21, 77-88. doi: 10. 1109/2. 33.
7. Delorme, A., and Makeig, S. (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9-21. doi: 10. 1016/j. jneumeth. 2003. 10. 009.
8. Doya, K. (2002). Metalearning and neuromodulation. Neural Netw. 15, 495-506. doi: 10. 1016/s0893-6080(02)00044-8.
9. Guthrie, D., and Buchwald, J. S. (1991). Significance testing of difference potentials. Psychophysiology 28, 240-244. doi: 10. 1111/j. 1469-8986. 1991. tb00417. x.
10. Izumi, Y., and Zorumski, C. F. (1999). Norepinephrine promotes long-term potentiation in the adult rat hippocampus in vitro. Synapse 31, 196-202. doi: 10. 1002/(sici)1098-2396(19990301)31: 3<196:: aid-syn4>3. 0. co; 2-k.
11. Jepma, M., and Nieuwenhuis, S. (2011). Pupil diameter predicts changes in the exploration-exploitation trade-off: evidence for the adaptive gain theory. J. Cogn. Neurosci. 23, 1587-1596. doi: 10. 1162/jocn. 2010. 21548.
12. Jodo, E., Chiang, C., and Aston-Jones, G. (1998). Potent excitatory influence of prefrontal cortex activity on noradrenergic locus coeruleus neurons. Neuroscience83, 63-79. doi: 10. 1016/s0306-4522(97)00372-2.
13. Katsuki, H., Izumi, Y., and Zorumski, C. F. (1997). Noradrenergic regulation of synaptic plasticity in the hippocampal CA1 region. J. Neurophysiol. 77, 3013-3020.
14. Kennerley, S. W., Behrens, T. E., and Wallis, J. D. (2011). Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat. Neurosci. 14, 1581-1589. doi: 10. 1038/nn. 2961.
15. Livingston, R. B. (1967). "Brain circuitry relating to complex behavior, " in The Neuroscience: A Study Program, eds G. C. Quarton, T. Melne-chuck and F. O. Schmitt (New York: Rocke-feller University Press), 499-514.
16. Loewy, A. D., Araujo, J. C., and Kerr, F. W. (1973). Pupillodilator pathways in the brain stem of the cat: anatomical and electrophysiological identification of a central autonomic pathway. Brain Res. 60, 65-91. doi: 10. 1016/0006-8993(73)90851-2.
17. Nassar, M. R., Rumsey, K. M., Wilson, R. C., Parikh, K., Heasly, B., and Gold, J. I. (2012). Rational regulation of learning dynamics by pupil-linked arousal systems. Nat. Neurosci. 15, 1040-1046. doi: 10. 1038/nn. 3130.
18. Nieuwenhuis, S., De Geus, E. J., and Aston-Jones, G. (2011). The anatomical and functional relationship between the P3 and autonomic components of the orienting response. Psychophysiology 48, 162-175. doi: 10. 1111/j. 1469-8986. 2010. 01057. x.
19. O'reilly, J. X., Schuffelgen, U., Cuell, S. F., Behrens, T. E., Mars, R. B., and Rushworth, M. F. (2013). Dissociable effects of surprise and model update in parietal and anterior cingulate cortex. Proc. Natl. Acad. Sci. U S A 110, E3660-E3669. doi: 10. 1073/pnas. 1305373110.
20. Rajkowski, J., Kubiak, P., and Aston-Jones, G. (1993). Correlations between locus coeruleus (LC) neural activity, pupil diameter and behavior in monkey support a role of LC in attention. Soc. Neurosci. Abstr. 19: 974.
21. Samuels, E. R., and Szabadi, E. (2008). Functional neuroanatomy of the noradrenergic locus coeruleus: its roles in the regulation of arousal and autonomic function part I: principles of functional organisation. Curr. Neuropharmacol. 6, 235-253. doi: 10. 2174/157015908785777229.
22. Silvetti, M., Seurinck, R., and Verguts, T. (2011). Value and prediction error in the medial frontal cortex: integrating the single-unit and systems levels of analysis. Front. Hum. Neurosci. 5: 75. doi: 10. 3389/fnhum. 2011. 00075.
23. Silvetti, M., Seurinck, R., and Verguts, T. (2013). Value and prediction error estimation account for volatility effects in ACC: a model-based fMRI study. Cortex 49, 1627-1635. doi: 10. 1016/j. cortex. 2012. 05. 008.
24. Verguts, T., and Notebaert, W. (2009). Adaptation by binding: a learning account of cognitive control. Trends Cogn. Sci. 13, 252-257. doi: 10. 1016/j. tics. 2009. 02. 007.
25. Yoshitomi, T., Ito, Y., and Inomata, H. (1985). Adrenergic excitatory and cholinergic inhibitory innervations in the human iris dilator. Exp. Eye Res. 40, 453-459. doi: 10. 1016/0014-4835(85)90158-7.
26. Yu, A. J., and Dayan, P. (2005). Uncertainty, neuromodulation, and attention. Neuron 46, 681-692. doi: 10. 1016/j. neuron. 2005. 04. 026.