Pupil diameter predicts changes in the exploration-exploitation trade-off: Evidence for the adaptive gain theory

Journal of Cognitive Neuroscience

Volumn 23, Issue 7, 2011, Pages 1587-1596

  Jepma, Marieke ^a   Nieuwenhuis, Sander ^a  

^a LEIDEN UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

NORADRENALIN;

ADULT; ARTICLE; CONTROLLED STUDY; CORRELATION ANALYSIS; EXPLORATORY BEHAVIOR; FEMALE; HUMAN; INDIVIDUALIZATION; LOCUS CERULEUS; MALE; PARTICIPANT OBSERVATION; PRIORITY JOURNAL; PUPIL; REGULATORY MECHANISM;

ADAPTATION, PSYCHOLOGICAL; ADOLESCENT; ADULT; CHOICE BEHAVIOR; EXPLORATORY BEHAVIOR; FEMALE; GAMES, EXPERIMENTAL; HUMANS; LEARNING; LOCUS COERULEUS; MALE; MODELS, PSYCHOLOGICAL; NOREPINEPHRINE; PREDICTIVE VALUE OF TESTS; PUPIL; REFLEX, PUPILLARY; YOUNG ADULT;

EID: 79955847787     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn.2010.21548     Document Type: Article

References (43)

1. Abercrombie, E. D., & Jacobs, B. L. (1987). Single-unit response of noradrenergic neurons in the locus coeruleus of freely moving cats: II. Adaptation to chronically presented stressful stimuli. Journal of Neuroscience, 7, 2844-2848.
2. Aston-Jones, G., & Cohen, J. D. (2005). An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance. Annual Review of Neuroscience, 28, 403-450.
3. Aston-Jones, G., Ennis, M., Pieribone, V. A., Nickell, W. T., & Shipley, M. T. (1986). The brain nucleus locus coeruleus: Restricted afferent control of a broad efferent network. Science, 234, 734-737.
4. Aston-Jones, G., Rajkowski, J., & Kubiak, P. (1997). Conditioned responses of monkey locus coeruleus neurons anticipate acquisition of discriminative behavior in a vigilance task. Neuroscience, 80, 697-715.
5. Aston-Jones, G., Rajkowski, J., Lu, W., Zhu, Y., Cohen, J. D., & Morecraft, R. J. (2002). Prominent projections from the orbital prefrontal cortex to the locus coeruleus in monkey. Society for Neuroscience Abstracts, 28, 86-89.
6. Berridge, C. W., & Waterhouse, B. D. (2003). The locus coeruleus-noradrenergic system: Modulation of behavioral state and state-dependent cognitive processes. Brain Research, Brain Research Reviews, 42, 33-84.
7. Boorman, E. D., Behrens, T. E., Woolrich, M. W., & Rushworth, M. F. (2009). How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron, 62, 733-743.
8. Botvinick, M. M. (2007). Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulated function. Cognitive, Affective & Behavioral Neuroscience, 7, 356-366.
9. Bourdaud, N., Chavarriaga, R., Galan, F., & Millán, J. D. R. (2008). Characterizing the EEG correlates of exploratory behavior. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 16, 549-556.
10. Chamberlain, S. R., Müller, U., Blackwell, A. D., Clark, L., Robbins, T. W., & Sahakian, B. J. (2006). Neurochemical modulation of response inhibition and probabilistic learning in humans. Science, 311, 861-863.
11. Cohen, J. D., McClure, S. M., & Yu, A. J. (2007). Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 362, 933-942.
12. Critchley, H. D., Tang, J., Glaser, D., Butterworth, B., & Dolan, R. J. (2005). Anterior cingulate activity during error and autonomic response. Neuroimage, 27, 885-895.
13. Daw, N. D., Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441, 876-879.
14. Devauges, V., & Sara, S. J. (1990). Activation of the noradrenergic system facilitates an attentional shift in the rat. Behavioural Brain Research, 39, 19-28.
15. Doya, K. (2002). Metalearning and neuromodulation. Neural Networks, 15, 495-506.
16. Dreisbach, G., Müller, J., Goschke, T., Strobel, A., Schulze, K., Lesch, K. P., et al. (2005). Dopamine and cognitive control: The influence of spontaneous eyeblink rate and dopamine gene polymorphisms on perseveration and distractibility. Behavioral Neuroscience, 119, 483-490.
17. Einhäuser, W., Stout, J., Koch, C., & Carter, O. (2008). Pupil dilation reflects perceptual selection and predicts subsequent stability in perceptual rivalry. Proceedings of the National Academy of Sciences, U.S.A., 105, 1704-1709.
18. Elam, M., Svensson, T. H., & Thorén, P. (1986). Locus coeruleus neurons and sympathetic nerves: Activation by cutaneous sensory afferents. Brain Research, 366, 254-261.
19. Frank, M. J., Doll, B. B., Oas-Terpstra, J., & Moreno, F. (2009). Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nature Neuroscience, 12, 1062-1068.
20. Gilzenrat, M. S., Nieuwenhuis, S., Jepma, M., & Cohen, J. D. (2010). Pupil diameter tracks changes in control state predicted by the adaptive gain theory of locus coeruleus function. Cognitive, Affective & Behavioral Neuroscience, 10, 252-269.
21. Janisse, M. P. (1977). Pupillometry: The psychology of the pupillary response. Washington, D.C.: Hemisphere Publishing Co.
22. Lapiz, M. D., Bondi, C. O., & Morilak, D. A. (2007). Chronic treatment with desipramine improves cognitive performance of rats in an attentional set-shifting test. Neuropsychopharmacology (Berlin, Germany), 32, 1000-1010.
23. Lapiz, M. D., & Morilak, D. A. (2006). Noradrenergic modulation of cognitive function in rat medial prefrontal cortex as measured by attentional set shifting capability. Neuroscience, 137, 1039-1049.
24. Loewenfeld, I. (1993). The pupil: Anatomy, physiology, and clinical applications. Detroit: Wayne State University Press.
25. Lorch, R. F., & Myers, J. L. (1990). Regression-analyses of repeated measures data in cognitive research. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16, 149-157.
26. McClure, S., Gilzenrat, M., & Cohen, J. (2005). An exploration-exploitation model based on norepinepherine and dopamine activity. In Y. Weiss, B. Schölkopf, & J. Platt (Eds.), Advances in neural information processing systems (Vol. 18, pp. 867-874). Cambridge, MA: MIT Press.
27. Nieuwenhuis, S., de Geus, E. J., & Aston-Jones, G. (2011). The anatomical and functional relationship between the P3 and autonomic components of the orienting response. Psychophysiology, 48, 162-175.
28. Rajkowski, J., Kubiak, P., & Aston-Jones, G. (1993). Correlations between locus coeruleus (LC) neural activity, pupil diameter and behavior in monkey support a role of LC in attention. Society for Neuroscience Abstracts, 19, 974.
29. Rajkowski, J., Kubiak, P., & Aston-Jones, G. (1994). Locus coeruleus activity in monkey: Phasic and tonic changes are associated with altered vigilance. Brain Research Bulletin, 35, 607-616.
30. Rajkowski, J., Lu, W., Zhu, Y., Cohen, J. D., & Aston-Jones, G. (2000). Prominent projections from the anterior cingulated cortex to the locus coeruleus (LC) in rhesus monkey. Society for Neuroscience Abstracts, 26, 2230.
31. Reiner, P. B. (1986). Correlational analysis of central noradrenergic neuronal activity and sympathetic tone in behaving cats. Brain Research, 378, 86-96.
32. Ridderinkhof, K. R., Ullsperger, M., Crone, E. A., & Nieuwenhuis, S. (2004). The role of the medial frontal cortex in cognitive control. Science, 306, 443-447.
33. Robbins, T. W. (1997). Arousal systems and attentional processes. Biological Psychology, 45, 57-71.
34. Sara, S. J. (2009). The locus coeruleus and noradrenergic modulation of cognition. Nature Reviews Neuroscience, 10, 211-223.
35. Satterthwaite, T. D., Green, L., Myerson, J., Parker, J., Ramaratnam, M., & Buckner, R. L. (2007). Dissociable but inter-related systems of cognitive control and reward during decision making: Evidence from pupillometry and event-related fMRI. Neuroimage, 37, 1017-1031.
36. Servan-Schreiber, D., Printz, H., & Cohen, J. D. (1990). A network model of catecholamine effects: Gain, signal-to-noise atio, and behavior. Science, 249, 892-895.
37. Seu, E., Lang, A., Rivera, R. J., & Jentsch, J. D. (2008). Inhibition of the norepinephrine transporter improves behavioral lexibility in rats and monkeys. Psychopharmacology (Berlin, Germany), 202, 505-519.
38. Siegle, G. J., Steinhauer, S. R., Stenger, V. A., Konecky, R., & Carter, C. S. (2003). Use of concurrent pupil dilation assessment to inform interpretation and analysis of fMRI data. Neuroimage, 20, 114-124.
39. Steere, J. C., & Arnsten, A. F. (1997). The alpha-2A noradrenergic receptor agonist guanfacine improves visual object discrimination reversal performance in aged rhesus monkeys. Behavioral Neuroscience, 111, 883-891.
40. Tse, W. S., & Bond, A. J. (2002). Difference in serotonergic and noradrenergic regulation of human social behaviours. Psychopharmacology (Berlin, Germany), 159, 216-221.
41. Usher, M., Cohen, J. D., Servan-Schreiber, D., Rajkowski, J., & Aston-Jones, G. (1999). The role of locus coeruleus in the regulation of cognitive performance. Science, 283, 549-554.
42. Yu, A. J., & Dayan, P. (2005). Uncertainty, neuromodulation, and attention. Neuron, 46, 681-692.
43. Zhu, Y., Iba, M., Rajkowski, J., & Aston-Jones, G. (2004). Projection from the orbitofrontal cortex to the locus coeruleus in monkeys revealed by anterograde tracing. Society for Neuroscience Abstracts, 30, 211-213.