Audio-visual speech perception is special

Cognition

Volumn 96, Issue 1, 2005, Pages

  Tuomainen, Jyrki ^a,b   Andersen, Tobias S ^a   Tiippana, Kaisa ^a   Sams, Mikko ^a  

^a AALTO UNIVERSITY   (Finland)

^b UNIVERSITY OF TURKU   (Finland)

Author keywords

Audio visual speech perception; Multisensory integration; Selective attention; Sine wave speech

Indexed keywords

ADULT; ARTICLE; AUDIOMETRY; CONTROLLED STUDY; EAR; EYE; HUMAN; HUMAN EXPERIMENT; NORMAL HUMAN; PRIORITY JOURNAL; SIGNAL TRANSDUCTION; SPEECH; TASK PERFORMANCE; VISION;

EID: 17044377552     PISSN: 00100277     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cognition.2004.10.004     Document Type: Article

References (27)

1. Boersma, P., & Weenink, D., (1992-2002). Praat a system doing phonetics by computer, v. 4.0.13. http://www.fon.hum.uva.nl/praat/
2. G. Calvert Cross-modal processing in the human brain: insights from functional neuroimaging studies Cerebral Cortex 11 2001 1110 1123
3. J. Duncan Cooperating brain systems in selective perception and action T. Inui J.L. McClelland Attention and performance XVI 1996 The MIT Press Cambridge, MA 549 578
4. C.A. Fowler Listeners do hear sounds, not tongues Journal of the Acoustical Society of America 99 3 1996 1730 1741
5. S.D. Goldinger Echoes of echoes? An episodic theory of lexical access Psychological Review 105 2 1998 251 279
6. K.W. Grant, and P-F. Seitz The use of visible speech cues for improving auditory detection of spoken sentences Journal of the Acoustical Society of America 108 3 2000 1197 1208
7. K. Green, P. Kuhl, A. Meltzoff, and E. Stevens Integrating speech information across talkers, gender, and sensory modality: female faces and male voices in the McGurk effect Perception and Psychophysics 50 6 1991 524 536
8. J.K. Hietanen, P. Manninen, M. Sams, and V. Surakka Does audiovisual speech perception use information about facial configuration? European Journal of Cognitive Psychology 13 2001 395 407
9. J.A. Jones, and K.G. Munhall The effects of separating auditory and visual sources on audiovisual integration of speech Canadian Acoustics 25 4 1997 13 19
10. M. Kamachi, H. Hill, K. Lander, and E. Vatikiotis-Bateson 'Putting the face to the voice': matching identity across modality Current Biology 13 2003 1709 1714
11. P.K. Kuhl, K.A. Williams, and A.N. Meltzoff Cross-modal speech perception in adults and infants using nonspeech auditory stimuli Journal of Experimental Psychology: Human Perception and Performance 17 3 1991 829 840
12. A.M. Liberman, and I.G. Mattingly The motor theory of speech perception revised Cognition 21 1 1985 1 36
13. J. MacDonald, and H. McGurk Visual influences on speech perception processes Perception and Psychophysics 24 3 1978 253 257
14. D.W. Massaro Perceiving talking faces 1998 MIT Press Cambridge, MA
15. H. McGurk, and J. MacDonald Hearing lips and seeing voices Nature 264 1976 746 748
16. R.E. Remez Establishing and maintaining perceptual coherence: unimodal and multimodal evidence Journal of Phonetics 31 2003 293 304
17. R.E. Remez, J.M. Fellowes, D.B. Pisoni, W.D. Goh, and P.E. Rubin Multimodal perceptual organization of speech: evidence from tone analogs of spoken utterances Speech Communication 26 1998 65 73
18. R.E. Remez, P.E. Rubin, S.M. Berns, J.S. Pardo, and J.M. Lang On the perceptual organization of speech Psychological Review 101 1 1994 129 156
19. R.E. Remez, P.E. Rubin, D.B. Pisoni, and T.D. Carrell Speech perception without traditional speech cues Science 212 4497 1981 947 949
20. B.H. Repp Phonetic trading relations and context effects: new experimental evidence for a speech mode of perception Psychological Bulletin 92 1 1982 81 110
21. L.D. Rosenblum, and C.A. Fowler Audio-visual investigation of the loudness-effort effect for speech and nonspeech stimuli Journal of Experimental Psychology: Human Perception and Performance 17 4 1991 976 985
22. H.M. Saldaña, and L.D. Rosenblum Visual influences on auditory pluck and bow judgments Perception and Psychophysics 54 3 1993 406 416
23. B.E. Stein, and M.A. Meredith The merging of the senses 1993 A Bradford Book Cambridge, MA
24. W.H. Sumby, and I. Pollack Visual contribution to speech intelligibility in noise The Journal of the Acoustical Society of America 26 2 1954 212 215
25. K. Tiippana, T.S. Andersen, and M. Sams Visual attention modulates audiovisual speech perception European Journal of Cognitive Psychology 16 3 2004 457 472
26. A.M. Treisman, and G. Gelade A feature-integration theory of attention Cognitive Psychology 12 1 1980 97 136
27. R.B. Welch, and D.H. Warren Immediate perceptual response to intersensory discrepancy Psychological Bulletin 88 3 1980 638 667