Pupil size signals mental effort deployed during multiple object tracking and predicts brain activity in the dorsal attention network and the locus coeruleus

Journal of Vision

Volumn 14, Issue 4, 2014, Pages

  Alnæs, Dag ^a   Sneve, Markus Handal ^a   Espeseth, Thomas ^a,b   Endestad, Tor ^a   van de Pavert, Steven Harry Pieter ^c   Laeng, Bruno ^a  

^a UNIVERSITY OF OSLO   (Norway)

^b OSLO UNIVERSITY HOSPITAL   (Norway)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Attention; Divided attention; Effort; fMRI; Locus coeruleus; Multifocal attention; Multiple object tracking; Norepinephrine; Pupillometry; Superior colliculus

Indexed keywords

NORADRENALIN;

ADULT; ARTICLE; ATTENTION; BRAIN; DIVIDED ATTENTION; EXERCISE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; LOCUS CERULEUS; MALE; MENTAL FUNCTION; MIDDLE AGED; MULTIFOCAL ATTENTION; MULTIPLE OBJECT TRACKING; NUCLEAR MAGNETIC RESONANCE IMAGING; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; PUPIL; PUPILLOMETRY; SUPERIOR COLLICULUS; YOUNG ADULT;

ATTENTION; DIVIDED ATTENTION; EFFORT; FMRI; LOCUS COERULEUS; MULTIFOCAL ATTENTION; MULTIPLE OBJECT TRACKING; NOREPINEPHRINE; PUPILLOMETRY; SUPERIOR COLLICULUS;

ADULT; ATTENTION; BRAIN; FEMALE; HUMANS; LOCUS COERULEUS; MAGNETIC RESONANCE IMAGING; MALE; MENTAL PROCESSES; MIDDLE AGED; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; PUPIL; YOUNG ADULT;

EID: 84899046167     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/14.4.1     Document Type: Article

References (85)

1. Ahern, S., & Beatty, J. (1979). Pupillary responses during information processing vary with Scholastic Aptitude Test scores. Science, 205, 1289-1292, doi: 10.1126/science.472746.
2. Ahern, S., & Beatty, J. (1981). Physiological evidence that demand for processing capacity varies with intelligence. In M. Friedman, J. P. Dos, & N. O'Connor (Eds.), Intelligence and learning. New York: Plenum Press.
3. Alvarez, G. A., & Franconeri, S. L. (2007). How many objects can you track? Evidence for a resourcelimited attentive tracking mechanism. Journal of Vision, 7(13):14, 1-10, http://www.journalofvision. org/content/7/13/14, doi:10.1167/7.13.14.
4. Aston-Jones, G., & Cohen, J. D. (2005). An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance. Annual Review of Neuroscience, 28, 403-450, doi:10.1146/ annurev.neuro.28.061604.135709.
5. Awh, E., Armstrong, K. M., & Moore, T. (2006). Visual and oculomotor selection: Links, causes and implications for spatial attention. Trends in Cognitive Sciences, 10(3), 124-130, doi:10.1016/j.tics. 2006.01.001.
6. Beatty, J. (1982). Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological Bulletin, 91(2), 276-292.
7. Beatty, J., & Kahneman, D. (1966). Pupillary changes in two memory tasks. Psychonomic Science, 5, 371- 372.
8. Berridge, C. W. (2008). Noradrenergic modulation of arousal. Brain Research Reviews, 58(1), 1-17, doi: 10.1016/j.brainresrev.2007.10.013.
9. Bland, J. M., & Altman, D. G. (1995). Calculating correlation coefficients with repeated observations: Part 2-correlation between subjects. BMJ, 310, 633, doi:10.1136/bmj.310.6980.633.
10. Bouret, S., & Sara, S. J. (2005). Network reset: A simplified overarching theory of locus coeruleus noradrenaline function. Trends in Neurosciences, 28(11), 574-582, doi:10.1016/j.tins.2005.09.002.
11. Bradshaw, J. L. (1968). Pupil size and problem solving. Quarterly Journal of Experimental Psychology, 20(2), 116-122, doi:http://dx.doi.org/10.1080/ 14640746808400139.
12. Brainard, D. H. (1997). The Psychophysics Toolbox. Spatial Vision, 10(4), 433-436.
13. Büttner-Ennever, J. A., Cohen, B., Pause, M., & Fries, W. (1988). Raphe nucleus of the pons containing omnipause neurons of the oculomotor system in the monkey, and its homologue in man. Journal of Comparative Neurology, 267(3), 307-321, doi:10. 1002/cne.902670302.
14. Cavanagh, P., & Alvarez, G. A. (2005). Tracking multiple targets with multifocal attention. Trends in Cognitive Sciences, 9(7), 349-354, doi:10.1016/j.tics. 2005.05.009.
15. Corbetta, M., Patel, G., & Shulman, G. L. (2008). The reorienting system of the human brain: From environment to theory of mind. Neuron, 58(3), 306-324, doi:10.1016/j.neuron.2008.04.017.
16. Corbetta, M., & Shulman, G. L. (2002). Control of goal-directed and stimulus-driven attention in the brain. Nature Reviews Neuroscience, 3(3), 201-215, doi:10.1038/nrn755.
17. Corbetta, M., & Shulman, G. L. (2011). Spatial neglect and attention networks. Annual Review of Neuroscience, 34, 569-599, doi:10.1146/ annurev-neuro-061010-113731.
18. Coull, J. T. (1998). Neural correlates of attention and arousal: Insights from electrophysiology, functional neuroimaging and psychopharmacology. Progress in Neurobiology, 55(4), 343-361.
19. Coull, J. T., Büchel, C., Friston, K. J., & Frith, C. D. (1999). Noradrenergically mediated plasticity in a human attentional neuronal network. NeuroImage, 10(6), 705-715, doi:10.1006/nimg.1999.0513.
20. Culham, J. C., Brandt, S. A., Cavanagh, P., Kanwisher, N. G., Dale, A. M., & Tootell, R. B. (1998). Cortical fMRI activation produced by attentive tracking of moving targets. Journal of Neurophysiology, 80(5), 2657-2670.
21. Culham, J. C., Cavanagh, P., & Kanwisher, N. G. (2001). Attention response functions: Characterizing brain areas using fMRI activation during parametric variations of attentional load. Neuron, 32(4), 737-745.
22. Desimone, R., & Duncan, J. (1995). Neural mechanisms of selective visual attention. Annual Review of Neuroscience, 18, 193-222, doi:10.1146/annurev.ne. 18.030195.001205.
23. Di Stasi, L., Catena, A., Cañas, J. J., Macknik, S. L.,& Martinez-Conde, S., (2013). Saccadic velocity as an arousal index in naturalistic tasks. Neuroscience & Biobehavioral Reviews, 37(5), 968-975, doi:10.1016/ j.neubiorev.2013.03.011.
24. Einhäuser, W., Koch, C., & Carter, O. L. (2010). Pupil dilation betrays the timing of decisions. Frontiers in Human Neuroscience, 4, 18, doi:10.3389/fnhum. 2010.00018.
25. Einhäuser, W., Stout, J., Koch, C., & Carter, O. (2008). Pupil dilation reflects perceptual selection and predicts subsequent stability in perceptual rivalry. Proceedings of the National Academy of Sciences, USA, 105(5), 1704-1709, doi:10.1073/pnas. 0707727105.
26. Espeseth, T., Christoforou, A., Lundervold, A. J., Steen, V. M., Le Hellard, S., & Reinvang, I. (2012). Imaging and cognitive genetics: The Norwegian Cognitive NeuroGenetics sample. Twin Research and Human Genetics, 15(3), 442-452, doi:10.1017/ thg.2012.8.
27. Everling, S., Paré, M., Dorris, M. C., Munoz, D. P.,& Pare, M. (1998). Comparison of the discharge characteristics of brain stem omnipause neurons and superior colliculus fixation neurons in monkey: Implications for control of fixation and saccade behavior comparison of the discharge characteristics of brain stem omnipause. Journal of Neurophysiology, 79(2), 511-528.
28. Foote, S. L., & Morrison, J. H. (1987). Extrathalamic modulation of cortical function. Annual Review of Neuroscience, 10, 67-95, doi:10.1146/annurev.ne. 10.030187.000435.
29. Franconeri, S. L., Alvarez, G. A., & Cavanagh, P. (2013). Flexible cognitive resources: Competitive content maps for attention and memory. Trends in Cognitive Sciences, 17(3), 134-141, doi:10.1016/j. tics.2013.01.010.
30. Franconeri, S. L., Lin, J. Y., Pylyshyn, Z. W., Fisher, B., & Enns, J. T. (2008). Evidence against a speed limit in multiple-object tracking. Psychonomic Bulletin & Review, 15(4), 802-808, doi:10.3758/ PBR.15.4.802.
31. Friston, K. (2009). The free-energy principle: A rough guide to the brain? Trends in Cognitive Sciences, 13(7), 293-301, doi:10.1016/j.tics.2009.04.005.
32. Friston, K. (2010). The free-energy principle: A unified brain theory?. Nature Reviews Neuroscience, 11(2), 127-138, doi:10.1038/nrn2787.
33. Gilzenrat, M. S., Nieuwenhuis, S., Jepma, M.,& Cohen, J. D. (2010). Pupil diameter tracks changes in control state predicted by the adaptive gain theory of locus coeruleus function. Cognitive, Affective, & Behavioral Neuroscience, 10(2), 252-269, doi:10.3758/CABN.10.2.252.
34. Hess, E. H., & Polt, J. M. (1964). Pupil size in relation to mental activity during simple problem-solving. Science, 140, 1190-1192, doi:10.1126/science.143. 3611.1190.
35. Howe, P. D., Horowitz, T. S., Morocz, I. A., Wolfe, J., & Livingstone, M. S. (2009). Using fMRI to distinguish components of the multiple object tracking task. Journal of Vision, 9(4):10, 1-11, http://www.journalofvision.org/content/9/4/10, doi:10.1167/9.4.10.
36. Hyönä, J., Tommola, J., & Alaja, A. M. (1995). Pupil dilation as a measure of processing load in simultaneous interpretation and other language tasks. Quarterly Journal of Experimental Psycholo-gy A: Human Experimental Psychology, 48(3), 598-612, doi:10.1080/14640749508401407.
37. Jans, B., Peters, J. C., & De Weerd, P. (2010). Visual spatial attention to multiple locations at once: The jury is still out. Psychological Review, 117(2), 637-684, doi:10.1037/a0019082.
38. Joshi, J., Kalwani, R. M., & Gold, J. I. (2013). The relationship between locus coeruleus neuronal activity and pupil diameter. [Abstract]. Society for Neuroscience Abstracts, Program No. 69.14/JJJ30.
39. Jovicich, J., Peters, R. J., Koch, C., Braun, J., Chang, L., & Ernst, T. (2001). Brain areas specific for attentional load in a motion-tracking task. Journal of Cognitive Neuroscience, 13(8), 1048-1058, doi:10. 1162/089892901753294347.
40. Just, M. A., & Carpenter, P. A. (1993). The intensity dimension of thought: Pupillometric indices of sentence processing. Canadian Journal of Experimental Psychology, 47(2), 310-339.
41. Just, M. A., Carpenter, P. A., & Miyake, A. (2003). Neuroindices of cognitive workload: Neuroimaging, pupillometric and event-related potential studies of brain work. Theoretical Issues in Ergonomics Science, 4(1-2), 56-88, doi:10.1080/ 14639220210159735.
42. Kahneman, D. (1973). Attention and effort. Engelwood Cliffs, NJ: Prentice Hall. doi:10.2307/1421603.
43. Kahneman, D. (2011). Thinking, fast and slow. New York: Farrar, Strauss, Giroux.
44. Kahneman, D., & Beatty, J. (1967). Pupillary responses in a pitch-discrimination task. Perception & Psychophysics, 2, 101-105.
45. Karatekin, C., Couperus, J. W., & Marcus, D. J. (2004). Attention allocation in the dual-task paradigm as measured through behavioral and psychophysiological responses. Psychophysiology, 41(2), 175-185, doi:10.1111/j.1469-8986.2004. 00147.x.
46. Kelley, T. A., Serences, J. T., Giesbrecht, B., & Yantis, S. (2008). Cortical mechanisms for shifting and holding visuospatial attention. Cerebral Cortex, 18(1), 114-125, doi:10.1093/cercor/bhm036.
47. Keren, N. I., Lozar, C. T., Harris, K. C., Morgan, P. S., & Eckert, M. A. (2009). In vivo mapping of the human locus coeruleus. NeuroImage, 47(4), 1261-1267, doi:10.1016/j.neuroimage.2009.06.012.
48. Koss, M. C. (1986). Pupillary dilation as an index of central nervous system alpha 2-adrenoceptor activation. Journal of Pharmacological Methods, 15(1), 1-19.
49. Kurby, C. A., & Zacks, J. M. (2008). Segmentation in the perception and memory of events. Trends in Cognitive Sciences, 12(2), 72-79, doi:10.1016/j.tics. 2007.11.004.
50. Laeng, B., Sirois, S., & Gredebäck, G. (2012). Pupillometry: A window to the preconscious? Perspectives on Psychological Science, 7(1), 18-27, doi:10.1177/1745691611427305.
51. Lauritzen, T. Z., D'Esposito, M., Heeger, D. J.,& Silver, M. A. (2009). Top-down flow of visual spatial attention signals from parietal to occipital cortex. Journal of Vision, 9(13):18, 1-14, http:// www.journalofvision.org/content/9/13/18, doi:10. 1167/9.13.18.
52. Lovejoy, L. P., & Krauzlis, R. J. (2010). Inactivation of primate superior colliculus impairs covert selection of signals for perceptual judgments. Nature Neuroscience, 13(2), 261-266, doi:10.1038/nn.2470.
53. Mouton, P. R., Pakkenberg, B., Gundersen, H. J.,& Price, D. L. (1994). Absolute number and size of pigmented locus coeruleus neurons in young and aged individuals. Journal of Chemical Neuroanatomy, 7(3), 185-190.
54. Munoz, D. P., & Wurtz, R. H. (1993). Fixation cells in monkey superior colliculus. I. Characteristics of cell discharge. Journal of Neurophysiology, 70(2), 559-575.
55. Murphy, P. R., O'Connell, R. G., O'Sullivan, M., Robertson, I. H., & Balsters, J. H. (2014). Pupil diameter covaries with BOLD activity in human locus coeruleus. Human Brain Mapping. Advance online publication, doi:10.1002/hbm.22466.
56. Oksama, L., & Hyönä, J. (2004). Is multiple object tracking carried out automatically by an early vision mechanism independent of higher-order cognition?. An individual difference approach. Visual Cognition, 11(5), 631-671, doi:10.1080/ 13506280344000473.
57. Parvizi, J., & Damasio, A. R. (2003). Neuroanatomical correlates of brainstem coma. Brain, 126(Pt 7), 1524-1536, doi:10.1093/brain/awg166.
58. Pelli, D. G. (1997). The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10(4), 437-442.
59. Phillips, M. A., Szabadi, E., & Bradshaw, C. M. (2000). Comparison of the effects of clonidine and yohimbine on spontaneous pupillary fluctuations in healthy human volunteers. Psychopharmacology, 150(1), 85-89.
60. Piquado, T., Isaacowitz, D., & Wingfield, A. (2010). Pupillometry as a measure of cognitive effort in younger and older adults. Psychophysiology, 47(3), 560-569, doi:10.1111/j.1469-8986.2009.00947.x.
61. Pylyshyn, Z. (1989). The role of location indexes in spatial perception: A sketch of the FINST spatialindex model. Cognition, 32(1), 65-97.
62. Pylyshyn, Z., & Storm, R. W. (1988). Tracking multiple independent targets: Evidence for a parallel tracking mechanism. Spatial Vision, 3(3), 179-197.
63. Raizada, R. D. S., & Poldrack, R. A. (2008). Challenge-driven attention: Interacting frontal and brainstem systems. Frontiers in Human Neuroscience, 1(March), 3, doi:10.3389/neuro.09.003.2007.
64. Rajkowski, K., Kubiak, P., & Aston-Jones, G. (1993). Correlations between locus coeruleus (LC) neural activity, pupil diameter and behavior in monkey support a role of LC in attention. Society of Neuroscience Abstracts, 19, 974.
65. Richer, F., & Beatty, J. (1985). Pupillary dilations in movement preparation and execution. Psychophysiology, 22(2), 204-207.
66. Roggeman, C., Fias, W., & Verguts, T. (2010). Salience maps in parietal cortex: Imaging and computational modeling. NeuroImage, 52(3), 1005-1014, doi:10.1016/j.neuroimage.2010.01.060.
67. Sara, S. J. (2009). The locus coeruleus and noradrenergic modulation of cognition. Nature Reviews Neuroscience, 10(3), 211-223, doi:10.1038/nrn2573.
68. Sara, S. J., & Bouret, S. (2012). Orienting and reorienting: The locus coeruleus mediates cognition through arousal. Neuron, 76(1), 130-141, doi:10. 1016/j.neuron.2012.09.011.
69. Sara, S. J., & Segal, M. (1991). Plasticity of sensory responses of locus coeruleus neurons in the behaving rat: Implications for cognition. Progress in Brain Research, 88, 571-585.
70. Sarter, M., Gehring, W. J., & Kozak, R. (2006). More attention must be paid: The neurobiology of attentional effort. Brain Research Reviews, 51(2), 145-160, doi:10.1016/j.brainresrev.2005.11.002.
71. Schneider, K. A., & Kastner, S. (2009). Effects of sustained spatial attention in the human lateral geniculate nucleus and superior colliculus. Journal of Neuroscience, 29(6), 1784-1795, doi:10.1523/ JNEUROSCI.4452-08.2009.
72. Scholl, B. J. (2009). What have we learned about attention from multiple-object tracking (and vice versa)? In D. Dedrick & L. Trick (Eds.), Computation, cognition, and Pylyshyn (pp. 49-77). Cambridge, MA: MIT Press.
73. Serences, J. T., & Yantis, S. (2006). Selective visual attention and perceptual coherence. Trends in Cognitive Sciences, 10(1), 38-45, doi:10.1016/j.tics. 2005.11.008.
74. Siegle, G. J., Steinhauer, S. R., Stenger, V. A., Konecky, R., & Carter, C. S. (2003). Use of concurrent pupil dilation assessment to inform interpretation and analysis of fMRI data. Neuro-Image, 20(1), 114-124, doi:10.1016/ S1053-8119(03)00298-2.
75. Silver, M. A., Ress, D., & Heeger, D. J. (2007). Neural correlates of sustained spatial attention in human early visual cortex. Journal of Neurophysiology, 97(1), 229-237, doi:10.1152/jn.00677.2006.
76. Somers, D. C., Dale, A. M., Seiffert, A. E., & Tootell, R. B. (1999). Functional MRI reveals spatially specific attentional modulation in human primary visual cortex. Proceedings of the National Academy of Sciences, USA, 96(4), 1663-1668.
77. Stanners, R. F., Coulter, M., Sweet, A. W., & Murphy, P. (1979). The pupillary response as an indicator of arousal and cognition. Motivation & Emotion, 3(4), 319-340, doi:10.1007/BF00994048.
78. Störmer, V. S., Winther, G. N., Li, S.-C., & Andersen, S. K. (2013). Sustained multifocal attentional enhancement of stimulus processing in early visual areas predicts tracking performance. Journal of Neuroscience, 33(12), 5346-5351, doi:10.1523/ JNEUROSCI.4015-12.2013.
79. Talairach, J., & Tournoux, P. (1988). Co-planar stereotactic atlas of the human brain. Stuttgart: Thieme.
80. Vankov, A., Hervé-Minvielle, A., & Sara, S. J. (1995). Response to novelty and its rapid habituation in locus coeruleus neurons of the freely exploring rat. European Journal of Neuroscience, 7, 1180-1187.
81. Wang, C.-A., Boehnke, S. E., White, B. J., & Munoz, D. P. (2012). Microstimulation of the monkey superior colliculus induces pupil dilation without evoking saccades. Journal of Neuroscience, 32(11), 3629-3636, doi:10.1523/JNEUROSCI.5512-11. 2012.
82. Ward, B. D. (2000). Simultaneous inference for fMRI data. In AFNI 3dDeconvolve Documentation. Medical College of Wisconsin. Retrieved from http:// afni.nimh.nih.gov/pub/dist/doc/manual/AlphaSim. pdf .
83. Wen, X., Yao, L., Liu, Y., & Ding, M. (2012). Causal interactions in attention networks predict behavioral performance. Journal of Neuroscience, 32(4), 1284-1292, doi:10.1523/JNEUROSCI.2817-11. 2012.
84. Wierda, S. M., van Rijn, H., Taatgen, N. A., & Martens, S. (2012). Pupil dilation deconvolution reveals the dynamics of attention at high temporal resolution. Proceedings of the National Academy of Sciences, USA, 109(22), 8456-8460, doi:10.1073/ pnas.1201858109.
85. Wilhelm, B., Wilhelm, H., & Lüdtke, H. (1999). Pupillography: Principles and applications in basic and clinical research. In J. Kuhlmann & M. Böttcher (Eds.), Pupillography: Principles, methods and applications (pp. 1-10). München, Germany: Zuckscjwerdt Verlag.