ASKING A NAIVE QUESTION TO THE McGURK EFFECT: WHY DOES AUDIO [b] GIVE MORE [d] PERCEPTS WITH VISUAL [g] THAN WITH VISUAL [d]?

Auditory-Visual Speech Processing 2001, AVSP 2001

Volumn , Issue , 2001, Pages 138-142

  Cathiard, M A ^a   Schwartz, J L ^a   Abry, C ^a  

^a CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

'CURRENT; BRAIN MECHANISMS; LABORATORY CONDITIONS; LIPREADING; VISUAL INFORMATION;

SPEECH PROCESSING;

EID: 33749558539     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. MacDonald, J., and McGurk, H. "Visual influences on speech perception process", Perception & Psychophysics, 24(3): 253-257, 1978.
2. McGurk, H., and Buchanan, L. "Bimodal speech perception: Vision and hearing", Unplished manuscript, department of psychology, University of Surrey, Guildford, Surrey GU2 5XH, U.K, 1981.
3. Summerfield, Q. "Some preliminaries to a comprehensive account of audio-visual speech perception", In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lip-reading, LEA: London, New Jersey, 3-51, 1987.
4. Sekiyama, K., and Tokhura, Y. "McGurk effect in non-english listeners: Few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility", Journal of the Acoustical Society of America, 90(4): 1797-1805, 1991.
5. Miller, G.A., and Nicely, P.E. "An analysis of perceptual confusions among some english consonants", Journal of the Acoustical Society of America, 27:338-352, 1955.
6. Wang, M.D., and Bilger, R.C. "Consonant confusions in noise: A study of perceptual features", Journal of the Acoustical Society of America, 54:1248-1266, 1973.
7. Walden, B.E., Prozek, R.A., Montgomery, A.A., Scherre, C.K., and Jones, C.J. "Effects of training on the visual recognition of consonants", Journal of Speech and Hearing Research, 20: 130-145, 1977.
8. Binnie C.A., Montgomery A.A., and Jackson P.L. "Auditory and visual contributions to the perception of consonants", Journal of Speech and Hearing Research, 17: 619-630, 1974.
9. Fisher, C.G. "Confusions among visually perceived consonants", Journal of Speech and Hearing Research, 11: 796-804, 1968.
10. Erber, N.P. "Auditory, visual, and auditory-visual recognition of consonants with normal and impaired hearing", Journal of Speech and Hearing Research, 15:414-422, 1972.
11. Owens, E., and Blazek, B. "Visemes observed by hearing-impaired and normal-hearing adult viewers", Journal of Speech and Hearing Research, 28: 381-393, 1985.
12. Heider, F.K., and Heider, G.M. "An experimental investigation of lip-reading", Psychological Monography, 52:124-153, 1940.
13. Massaro, D.W., "Illusions and issues in bimodal speech perception", In D. Burnham, J. Robert-Ribès and E. Vatikiotis-Bateson (Eds.), International Conference on Auditory-Visual Speech Processing-AVSP'98, Terrigal, Australia, 21-26, 1998.
14. Summerfield, Q. "Use of visual information for phonetic perception", Phonetica, 36, 314-331, 1979.
15. Colin, C. "Etude comportementale et electrophysiologique des processus impliqués dans l'effet McGurk et dans l'effet de ventriloquie", unpublished Dissertation in Psychological Sciences, Université Libre de Bruxelles, 2001.
16. Massaro, D.W. Speech perception by ear and eye: A paradigm for psychological inquiry, Hillsdale, NJ: LEA, London, 1987.
17. Schwartz, J.-L., Robert-Ribès, J., and Escudier, P. "Ten years after Summerfield: A taxonomy of models for audio-visual fusion in speech perception", In R. Campbell, B. Dodd & D. Burnham (Eds.), Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech, Psychology Press, 85-108, 1998.
18. Lindblom, B. "The status of phonetic gestures", In I.G. Mattingly & M. Studdert-Kennedy (Eds.), Modularity and the motor theory of speech perception, Hillsdale, NJ: LEA, London, 7-24, 1991.
19. Öhman, S. "Coarticulation in VCV utterances: Spectrographic measurements", Journal of the Acoustical Society of America, 39, 151-168, 1966.
20. Miller, J.L., and Liberman, A.M. "Some effects of later occuring information on the perception of stop consonant and semivowel", Perception & Psychophysics, 25, 457-465, 1979.
21. Grenn, K.P. and Miller, J.L. “On the role of visual rate information in phonetic perception”, Perception & Psychophysics, 38, 269-276, 1985.
22. Werker, J.F., Frost, P.E. and McGurk, H. "La langue et les lèvres: Cross-language influences on bimodal speech perception", Canadian Journal of Psychology, 46(4), 551-568, 1992.
23. Munhall, K.G., Gribble P., Sacco, L., and Ward, M. "Temporal constraints on the McGurk effect", Perception & Psychophysics, 58(3), 351-362, 1996.
24. Munhall, K.G., and Tohkura, Y. "Audiovisual gating and the time course of speech perception", Journal of the Acoustical Society of America, 104(1):530-539, 1998.
25. Campbell, R., Calvert, G., Brammer, M., MacSweeney, M., Surguladze, S., McGuire, P., Woll, B., Williams, S., Amaro, E. and David, A.S. "Activation in auditory cortex by speechreading in hearing people: fRMI studies", In International Conference on Auditory-Visual Speech Processing-AVSP'99, Santa Cruz, California, 1999.
26. Lewis, J.W., Beauchamp, M.S., and DeYoe E.A. "A comparison of visual and auditory motion processing in human cerebral cortex", Cerebral Cortex, 10: 873-888, 2000.