Visual attention modulates audiovisual speech perception

European Journal of Cognitive Psychology

Volumn 16, Issue 3, 2004, Pages 457-472

  Tiippana, K ^a   Andersen, T S ^a   Sams, M ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ATTENTION; AUDIOVISUAL EQUIPMENT; CONTROLLED STUDY; EYE MOVEMENT; HUMAN; HUMAN EXPERIMENT; NORMAL HUMAN; PRIORITY JOURNAL; SPEECH; SPEECH PERCEPTION; VISUAL ADAPTATION;

EID: 2342655716     PISSN: 09541446     EISSN: None     Source Type: Journal    
DOI: 10.1080/09541440340000268     Document Type: Article

References (29)

1. Anastasio, T. J., Patton, P. E., & Belkacem-Boussaid, K. (2000). Using Bayes' rule to model multisensory enhancement in the superior colliculus. Neural Computation, 12, 1165-1187.
2. Bertelson, P., Vroomen, J., de Gelder, B., & Driver, J. (2000). The ventriloquist effect does not depend on the direction of deliberate visual attention. Perception and Psychophysics, 62(2), 321-332.
3. Calvert, G. A., Campbell, R., & Brammer, M. J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology, 10, 649-657.
4. Colin, C., Radeau, M., Soquet, A., Demolin, D., Colin, F., & Deltenre, P. (2002). Mismatch negativity evoked by the McGurk-MacDonald effect: A phonetic representation within short-term memory. Clinical Neurophysiology, 113, 495-506.
5. Dekle, D. J., Fowler, C. A., & Funnell, M. G. (1992). Audiovisual integration in perception of real words. Perception and Psychophysics, 51, 355-362.
6. Driver, J. (1996). Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature, 381, 66-68.
7. Easton, R. D., & Basala, M. (1982). Perceptual dominance during lipreading. Perception and Psychophysics, 32, 562-570.
8. Erber, N. P. (1969). Interaction of audition and vision in the recognition of oral speech stimuli. Journal of Speech and Hearing Research, 12, 423-425.
9. Grant, K. W., & Seitz, P. F. (1998). Measures of auditory-visual integration in nonsense syllables and sentences. Journal of the Acoustical Society of America, 104, 2438-2450.
10. Green, K. P. (1996). The use of auditory and visual information in phonetic perception. In D. G. Stork & M. E. Hennecke (Eds.), Speechreading by humans and machines: Models, systems, and applications (Vol. 150, pp. 55-77). Berlin, Germany: Springer.
11. Green, K. P., Kuhl, P. K., Meltzoff, A. N., & Stevens, E. B. (1991). Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect. Perception and Psychophysics, 50, 524-536.
12. Greenhouse, S. W., & Geisser, S. (1959). On methods in the analysis of profile data. Psychometrika, 24, 95-112.
13. Massaro, D. W. (1984). Children's perception of visual and auditory speech. Child Development, 55, 1777-1788.
14. Massaro, D. W. (1998). Perceiving talking faces. Cambridge, MA: MIT Press.
15. Massaro, D. W., & Cohen, M. M. (2000). Tests of auditory-visual integration efficiency within the framework of the fuzzy logical model of perception. Journal of the Acoustical Society of America, 108, 784-789.
16. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
17. Palermo, R., & Rhodes, G. (2002). The influence of divided attention on holistic face perception. Cognition, 82, 225-257.
18. Paré, M., Richler, R. C., ten Hove, M., & Munhall, K. G. (in press). Gaze behavior in audiovisual speech perception: The influence of ocular fixations on the McGurk effect. Perception and Psychophysics.
19. Pesonen, J. (1968). Phoneme communication of the deaf. Helsinki, Finland: Suomalaisen Kirjallisuuden Kirjapaino Oy.
20. Smeele, P. M., Massaro, D. W., Cohen, M. M., & Sittig, A. C. (1998). Laterality in visual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 24, 1232-1242.
21. Sovijärvi, A. (1963). Suomen kielen äännekuvasto [Phoneme descriptions of the Finnish language]. Jyväskylä, Finland: K. J. Gummerus Oy.
22. Stein, B. E., Wallace, M. T., & Meredith, M. A. (1995). Neural mechanisms mediating attention and orientation to multisensory cues. In M. S. Gazzaniga (Ed.), The cognitive neurosciences (pp. 683-702). Cambridge, MA: MIT Press.
23. Sumby, W. H., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-215.
24. Summerfield, Q., & McGrath, M. (1984). Detection and resolution of audio-visual incompatibility in the perception of vowels. Quarterly Journal of Experimental Psychology, 36A, 51-74.
25. Tiippana, K., Andersen, T. S., & Sams, M. (2001). Visual attention influences audiovisual speech perception. In D. W. Massaro, J. Light, & K. Geraci (Eds.), Proceedings of the International conference on AudioVisual Speech Processing, Aalborg, Denmark.
26. Treisman, A. (1986). Properties, parts and objects. In K. R. Boff, L. Kaufman. & J. P. Thomas (Eds.), Handbook of perception and human performance: Cognitive processes and performance (Vol. 2, pp. 35.31-35.62). New York: John Wiley & Sons.
27. Treisman, A. M., & Gelade, G. (1980). A feature-integration theory of attention. Cognitive Psychology, 12, 97-136.
28. Vroomen, J., Bertelson, P., & de Gelder, B. (2001a). The ventriloquist effect does not depend on the direction of automatic visual attention. Perception and Psychophysics, 63(4), 651-659.
29. Vroomen, J., Driver, J., & de Gelder, B. (2001b). Is cross-modal integration of emotional expressions independent of attentional resources? Cognitive, Affective, and Behavioral Neuroscience, 1, 382-387.