Integrating audiovisual informatiom for the control of overt attention

Journal of Vision

Volumn 7, Issue 10, 2007, Pages

  Onat, Selim ^a,b   Libertus, Klaus ^a   König, Peter ^a  

^a UNIVERSITY OF OSNABRÜCK   (Germany)

^b DUKE UNIVERSITY   (United States)

Author keywords

Crossmodal integration; Eye movements; Linearity; Natural stimuli; Overt attention; Saliency map

Indexed keywords

ADULT; ARTICLE; ATTENTION; AUDITORY STIMULATION; EYE FIXATION; EYE MOVEMENT; HEARING; HEMISPHERIC DOMINANCE; HUMAN; INFORMATION SCIENCE; MALE; METHODOLOGY; NATURAL SCIENCE; PHOTOSTIMULATION; PHYSIOLOGY; PROBABILITY; SOUND DETECTION; STATISTICAL MODEL; VISION; VISUAL FIELD;

ACOUSTIC STIMULATION; ADULT; ATTENTION; AUDITORY PERCEPTION; EYE MOVEMENTS; FIXATION, OCULAR; FUNCTIONAL LATERALITY; HUMANS; INFORMATION THEORY; LINEAR MODELS; MALE; NATURE; PHOTIC STIMULATION; PROBABILITY; SOUND LOCALIZATION; VISUAL FIELDS; VISUAL PERCEPTION;

EID: 34547521060     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/7.10.11     Document Type: Article

References (35)

1. Arndt, P. A., & Colonius, H. (2003). Two stages in crossmodal saccadic integration: Evidence from a visual-auditory focused attention task. Experimental Brain Research, 150, 417-426. [PubMed]
2. Baddeley, R. J., & Tatler, B. W. (2006). High frequency edges (but not contrast) predict where we fixate: A Bayesian system identification analysis. Vision Research, 46, 2824-2833. [PubMed]
3. Beauchamp, M. S., Argall, B. D., Bodurka, J., Duyn, J. H., & Martin, A. (2004). Unraveling multisensory integration: Patchy organization within human STS multisensory cortex. Nature Neuroscience, 7, 1190-1192. [PubMed]
4. Bisley, J. W., & Goldberg, M. E. (2006). Neural correlates of attention and distractibility in the lateral intraparietal area. Journal of Neurophysiology, 95, 1696-1717. [PubMed] [Article]
5. Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C., McGuire, P. K., et al. (1997). Activation of auditory cortex during silent lipreading. Science, 276, 593-596. [PubMed]
6. Calvert, G., Campbell, R., & Brammer, M. J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology, 10, 649-657. [PubMed] [Article]
7. Carandini, M., Heeger, D. J., & Movshon, J. A. (1997). Linearity and normalization in simple cells of the macaque primary visual cortex. Journal of Neuroscience, 17, 8621-8644. [PubMed] [Article]
8. Corneil, B. D., & Munoz, D. P. (1996). The influence of auditory and visual distractors on human orienting gaze shifts. Journal of Neuroscience, 16, 8193-8207. [PubMed] [Article]
9. Corneil, B. D., Van Wanrooij, M., Munoz, D. P., & Van Opstal, A. J. (2002). Auditory-visual interactions subserving goal-directed saccades in a complex scene. Journal of Neurophysiology, 88, 438-454. [PubMed] [Article]
10. Driver, J., & Spence, C. (2000). Multisensory perception: Beyond modularity and convergence. Current Biology, 10, R731-R735. [PubMed] [Article]
11. Einhäuser, W., & König, P. (2003). Does luminance-contrast contribute to a saliency map for overt visual attention? European Journal of Neuroscience, 17, 1089-1097. [PubMed]
12. Ethier, C., Brizzi, L., Darling, W. G., & Capaday, C. (2006). Linear summation of cat motor cortex outputs. Journal of Neuroscience, 26, 5574-5581. [PubMed] [Article]
13. Foxe, J. J., & Schroeder, C. E. (2005). The case for feedforward multisensory convergence during early cortical processing. Neuroreport, 16, 419-423. [PubMed]
14. Fu, K. M., Johnston, T. A., Shah, A. S., Arnold, L., Smiley, J., Hackett, T. A., et al. (2003). Auditory cortical neurons respond to somatosensory stimulation. Journal of Neuroscience, 23, 7510-7515. [PubMed] [Article]
15. Ghazanfar, A. A., Maier, J. X., Hoffman, K. L., & Logothetis, N. K. (2005). Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. Journal of Neuroscience, 25, 5004-5012. [PubMed] [Article]
16. Itti, L., & Koch, C. (2001). Computational modelling of visual attention. Nature Reviews, Neuroscience, 2, 194-203. [PubMedl
17. Kayser, C., Petkov, C. I., Augath, M., & Logothetis, N. K. (2005). Integration of touch and sound in auditory cortex. Neuron, 48, 373-384. [PubMed] [Article]
18. Koch, C., & Ullman, S. (1985) Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology, 4, 219-227. [PubMed]
19. Li, Z. (2002). A saliency map in primary visual cortex. Trends in Cognitive Sciences, 6, 9-16. [PubMed]
20. Macaluso, E., & Driver, J. (2005). Multisenspry spatial interactions: A window onto functional integratign in the human brain. Trends in Neuroscience, 28, 264-271. [PubMedl
21. Macaluso, E., Frith, C. D., & Driver, J. (2000). Modulation of human visual cortex by crossmodal spatial attention. Science, 289, 1206-1208. [PubMed]
22. Mazer, J. A., & Gallant, J, L. (2003). Goal-related activity in V4 during free viewing visual search. Evidence for a ventral stream visual salience map. Neuron, 40, 1241-1250. [PubMed] [Article]
23. Meredith, M. A., & Stein, B. E. (1986). Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. Journal of Neurophysiology, 56, 640-662. [PubMed]
24. Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Cognitive Brain Research, 14, 115-128. [PubMed]
25. Parkhurst, D., Law, K., & Niebur, E. (2002). Modeling the role of salience in the allocation of overt visual attention. Vision Research, 42, 107-123. [PubMed]
26. Peters, R. J., Iyer, A., Itti, L., & Koch, C. (2005). Components of bottom-up gaze allocation in natural images. Vision Research, 45, 2397-2416. [PubMed]
27. Reinagel, P., & Zador, A. M. (1999). Natural scene statistics at the centre of gaze. Network, 10, 341-350. [PubMed]
28. Renninger, L. W., Coughlan, J., Verghese, P., & Malik, J. (2005). An information maximization model of eye movements. Advances in Neural Information Processing System, 17, 1121-1128. [PubMed]
29. Schnupp, J. W., Mrsic-Flogel, T. D., & King, A. J. (2001). Linear processing of spatial cues in primary auditory cortex. Nature, 414, 200-204. [PubMed]
30. Stanford, T. R., Quessy, S., & Stein, B. E. (2005). Evaluating the operations underlying multisensory integration in the cat superior colliculus. Journal of Neuroscience, 25, 6499-6508. [PubMed] [Article]
31. Stein, B. E., Jiang, W., & Stanford, T. R. (2004). Multisensory integration in single neurons of the midbrain. In G. Calvert, C. Spence, & B. E. Stein (Eds.), Handbook of multisensory processes (pp. 243-64). Cambridge, MA: MIT.
32. Tatler, B. W., Baddeley, R. J., & Gilchrist, I. D. (2005). Visual correlates of fixation selection: Effects of scale and time. Vision Research, 45, 643-659. [PubMed]
33. Tatler, B. W., Baddeley, R. J., & Vincent, B. T. (2006). The long and the short of it: Spatial statistics at fixation vary with saccade amplitude and task. Vision Research, 46, 1857-1862. [PubMed]
34. Thompson, K. G., & Bichot, N. P. (2005). A visual salience map in the primate frontal eye field. Progress in Brain Research, 147, 251-262. [PubMed]
35. Thompson, K. G.; Bichot, N. P., & Sato, T. R. (2005). Frontal eye field activity before visual search errors reveals the integration of bottom-up and top-down salience. Journal of Neurophysiology, 93, 337-351. [PubMed] [Article]