Use of visual information in speech perception: Evidence for a visual rate effect both with and without a McGurk effect

Perception and Psychophysics

Volumn 67, Issue 5, 2005, Pages 759-769

  Brancazio, Lawrence ^a,b   Miller, Joanne L ^c  

^a SOUTHERN CONNECTICUT STATE UNIVERSITY   (United States)

^b HASKINS LABORATORIES   (United States)

^c NORTHEASTERN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 27844503499     PISSN: 00315117     EISSN: None     Source Type: Journal    
DOI: 10.3758/BF03193531     Document Type: Review

References (42)

1. BRANCAZIO, L. (2004). Lexical influences in audiovisual speech perception. Journal of Experimental Psychology: Human Perception & Performance, 30, 445-463.
2. BRANCAZIO, L., MILLER, J. L., & PARÉ, M. A. (1999). Perceptual effects of place of articulation on voicing for audio-visually discrepant stimuli. Journal of the Acoustical Society of America, 106, 2270.
3. BRANCAZIO, L., MILLER, J. L., & PARÉ, M. A. (2003). Visual influences on the internal structure of phonetic categories. Perception & Psychophysics, 65, 591-601.
4. BURNHAM, D. (1998). Language specificity in the development of auditory-visual speech perception. In R. Campbell, B. Dodd, and D. Burnham (Eds.), Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech (pp. 27-60). Hove, U.K.: Psychology Press.
5. CARNEY, A. E., CLEMENT, B. R., & CIENKOWSKI, K. M. (1999). Talker variability effects in auditory-visual speech perception. Journal of the Acoustical Society of America, 106, 2270.
6. CHEN, T. H., & MASSARO, D. W. (2004). Mandarin speech perception by ear and eye follows a universal principle. Perception & Psychophysics, 66, 820-836.
7. COHEN, J., MACWHINNEY, B., FLATT, M., & PROVOST, J. (1993). PsyScope: An interactive graphic system for designing and controlling experiments in the psychology laboratory using Macintosh computers. Behavior Research Methods, Instruments, & Computers, 25, 257-271.
8. ERBER, N. P. (1969). Interaction of audition and vision in the recognition of oral speech stimuli. Journal of Speech & Hearing Research, 12, 423-425.
9. FOWLER, C. A. (1986). An event approach to the study of speech perception from a direct-realist perspective. Journal of Phonetics, 14, 3-28.
10. GREEN, K. P. (1998). The use of auditory and visual information during phonetic processing: Implications for theories of speech perception. In R. Campbell, B. Dodd, & D. Burnham (Eds.), Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech (pp. 3-25). Hove, U.K.: Psychology Press.
11. GREEN, K. P., & GERDEMAN, A. (1995). Cross-modal discrepancies in coarticulation and the integration of speech information: The McGurk effect with mismatched vowels. Journal of Experimental Psychology: Human Perception & Performance, 21, 1409-1426.
12. GREEN, K. P., & KÜHL, P. K. (1989). The role of visual information in the processing of place and manner features in speech perception. Perception & Psychophysics, 45, 34-42.
13. GREEN, K. P., KÜHL, P. K., MELTZOFF, A. N., & STEVENS, E. B. (1991). Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect. Perception & Psychophysics, 50, 524-536.
14. GREEN, K. P., & MILLER, J. L. (1985). On the role of visual rate information in phonetic perception. Perception & Psychophysics, 38, 269-276.
15. GREEN, K. P., & NORRIX, L. W. (1997). Acoustic cues to place of articulation and the McGurk effect: The role of release bursts, aspiration, and formant transitions. Journal of Speech & Hearing Research, 40, 646-665.
16. JORDAN, T. R., & BEVAN, K. (1997). Seeing and hearing rotated faces: Influences of facial orientation on visual and audiovisual speech recognition. Journal of Experimental Psychology: Human Perception & Performance, 23, 388-403.
17. LISKER, L., & ABRAMSON, A. S. (1964). A cross-language study of voicing in initial stops: Acoustical measurements. Word, 20, 384-422.
18. LISKER, L., & ABRAMSON, A. S. (1970). The voicing dimension: Some experiments in comparative phonetics. In Proceedings of the Sixth International Congress of Phonetic Sciences (pp. 563-567). Prague: Academia.
19. MACDONALD, J., ANDERSEN, S., & BACHMANN, T. (2000). Hearing by eye: How much spatial degradation can be tolerated? Perception, 29, 1155-1168.
20. MACDONALD, J., & MCGURK, H. (1978). Visual influences on speech perception processes. Perception & Psychophysics, 24, 253-257.
21. MANUEL, S. Y., REPP, B. H., LIBERMAN, A. M., & STUDDERT-KENNEDY, M. (1983, November). Exploring the "McGurk effect." Paper presented at the 24th meeting of the Psychonomic Society, San Diego.
22. MASSARO, D. W. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Hillsdale, NJ: Erlbaum.
23. MASSARO. D. W. (1998). Perceiving talking faces: From speech perception to a behavioral principle. Cambridge, MA: MIT Press.
24. MASSARO. D. W., & COHEN, M. M. (1983). Evaluation and integration of visual and auditory information in speech perception. Journal of Experimental Psychology: Human Perception & Performance, 9, 753-771.
25. MASSARO. D. W., & COHEN, M. M. (1996). Perceiving speech from inverted faces. Perception & Psychophysics, 58, 1047-1065.
26. MASSARO, D. W., COHEN, M. M., GESI, A., HEREDIA, R., & TSUZAKI, M. (1993 ). Bimodal speech perception: An examination across languages. Journal of Phonetics, 21, 445-478.
27. MASSARO, D. W., COHEN, M. M., & SMEELE. P. M. T. (1995). Cross-linguistic comparisons in the integration of visual and auditory speech. Memory & Cognition, 23, 113-131.
28. McGURK, H., & MACDONALD, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
29. MILLER, J. L. (1977). Nonindependence of feature processing in initial consonants. Journal of Speech & Hearing Research, 20, 519-528.
30. MILLER, J. L. (1981). Effects of speaking rate on segmental distinctions. In P. D. Eimas & J. L. Miller (Eds.), Perspectives on the study of speech (pp. 39-74). Hillsdale, NJ: Erlbaum.
31. PITT, M. A. (1995). The locus of the lexical shift in phoneme identification. Journal of Experimental Psychology: Learning, Memory, & Cognition, 21, 1037-1052.
32. PITT, M. A., & SAMUEL, A. G. (1993). An empirical and meta-analytic evaluation of the phoneme identification task. Journal of Experimental Psychology: Human Perception & Performance, 19, 699-725.
33. ROSENBLUM, L. D., & SALDAÑA, H. M. (1996). An audiovisual test of kinematic primitives for visual speech perception. Journal of Experimental Psychology: Human Perception & Performance, 22, 318-331.
34. SCHWARTZ, J.-L., ROBERT-RIBES, J., & ESCUDIER. P. (1998). Ten years after Summerfield: A taxonomy of models for audio-visual fusion in speech perception. In R. Campbell, B. Dodd, and D. Burnham (Eds.), Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech (pp. 85-108). Hove, U.K.: Psychology Press.
35. SEKIYAMA, K. (1997). Cultural and linguistic factors in audiovisual speech processing: The McGurk effect in Chinese subjects. Perception & Psychophysics, 59, 73-80.
36. SEKIYAMA, K., & TOHKURA, Y. (1991). McGurk effect in non-English listeners: Few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility. Journal of the Acoustical Society of America, 90, 1797-1805.
37. SEKIYAMA, K., & TOHKURA, Y. (1993). Inter-language differences in the influence of visual cues in speech perception. Journal of Phonetics, 21, 427-444.
38. SUMBY, W. H., & POLLACK, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-215.
39. SUMMERFIELD, Q. (1981). Articulatory rate and perceptual constancy in phonetic perception. Journal of Experimental Psychology: Human Perception & Performance, 7, 1074-1095.
40. SUMMERFIELD, Q. (1987). Some preliminaries to a comprehensive ac count of audio-visual speech perception. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lip reading (pp. 3-51). Hillsdale, NJ: Erlbaum.
41. VOLAITIS, L. E., & MILLER, J. L. (1992). Phonetic prototypes: Influence of place of articulation and speaking rate on the internal structure of voicing categories. Journal of the Acoustical Society of America, 92, 723-735.
42. WERKER, J. F., FROST. P. E., & McGuRK. H. (1992). La langue et les lèvres: Cross-language influences on bimodal speech perception. Canadian Journal of Psychology, 46, 551-568.