Temporal constraints on the McGurk effect

Perception and Psychophysics

Volumn 58, Issue 3, 1996, Pages 351-362

  Munhall, K G ^a   Gribble, P ^b   Sacco, L ^a   Ward, M ^a  

^a QUEEN S UNIVERSITY   (Canada)

^b MCGILL UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ATTENTION; HUMAN; LIP READING; PAIRED ASSOCIATE LEARNING; PHONETICS; PSYCHOPHYSICS; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION; TIME PERCEPTION;

ATTENTION; HUMANS; LIPREADING; PAIRED-ASSOCIATE LEARNING; PHONETICS; PSYCHOACOUSTICS; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION; TIME PERCEPTION;

EID: 0030114670     PISSN: 00315117     EISSN: None     Source Type: Journal    
DOI: 10.3758/BF03206811     Document Type: Article

References (54)

1. ABRY, C., & BOË, L. J. (1986). Laws for lips. Speech Communication, 5, 97-193.
2. BERNSTEIN, L. E., COULTER, D., O'CONNELL, M. P., EBERHARDT, S., & DEMOREST, M. (1992, June). Vibrotactile and haptic speech codes. Paper presented at the Second International Conference on Tactile Aids, Hearing Aids, & Cochlear Implants, Stockholm.
3. BERNSTEIN, L. E., & EBERHARDT, S. (1986). Audio-visual stimuli. Johns Hopkins University, Department of Electrical and Computer Engineering.
4. BRAIDA, D. L. (1991). Crossmodal integration in the identification of consonant segments. Quarterly Journal of Experimental Psychology, 43, 647-677.
5. COHEN, M. M. (1984). Processing of visual and auditory information in speech perception. Unpublished doctoral dissertation, University of California, Santa Cruz.
6. DIXON, N., & SPITZ, L. (1980). The detection of audiovisual desynchrony. Perception, 9, 719-721.
7. DUNNETT, C. W. (1955). A multiple comparison procedure for comparing several treatment means with a control. Journal of the American Statistical Association, 50, 1096-1121.
8. FOWLER, C. A., & DEKLE, D. J. (1991). Listening with eye and hand: Cross-modal contributions to speech perception. Journal of Experimental Psychology: Human Perception & Performance, 17, 816-828.
9. GAGNE, J.-P., MASTERSON, V., MUNHALL, K. G., BILIDA, N., & QUERENGESSER, C. (1994). Across talker variability in speech intelligibility for conversational and clear speech: A crossmodal investigation. Journal of the Academy of Rehabilitative Audiology, 27, 133-158.
10. GAY, T. (1978). Effect of speaking rate on vowel formant transitions. Journal of the Acoustical Society of America, 63, 223-230.
11. GAY, T. (1981). Mechanisms of the control of speech rate. Phonetica, 38, 148-158.
12. GERDEMAN, A. (1994). Temporal incongruity and the McGurk effect. Unpublished master's thesis, University of Arizona, Tucson.
13. GRACCO, V., & ABBS, J. (1986). Variant and invariant characteristics of speech movements. Experimental Brain Research, 65, 156-166,
14. GREEN, K. P. (1987). The perception of speaking rate using visual information from a talker's face. Perception & Psychophysics, 42, 587-593.
15. GREEN, K. P., & GERDEMAN, A. (1995). Cross-modal discrepancies in coarticulation and the integration of speech information: The McGurk effect with mismatched vowels. Journal of Experimental Psychology: Human Perception & Performance, 21, 1409-1426.
16. GREEN, K. P., & KUHL, P. K. (1989). The role of visual information in the processing of place and manner features in speech perception. Perception & Psychophysics, 45, 34-42.
17. GREEN, K. P., & KUHL, P. K. (1991). Integral processing of visual place and auditory voicing information during phonetic perception. Journal of Experimental Psychology: Human Perception & Performance, 17, 278-288.
18. GREEN, K. P., KUHL, P. K., & MELTZOFF, N. A. (1988, November). Factors affecting the integration of auditory and visual information in speech: The effect of vowel environment. Paper presented at the annual meeting of the Acoustical Society of America, Honolulu.
19. GREEN, K. P., KUHL, P. K., MELTZOFF, A. N., & STEVENS, E. B. (1991). Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect. Perception & Psychophysics, 50, 524-536.
20. GREEN, K. [P.], & MILLER, J. L. (1985). On the role of visual rate information in phonetic perception. Perception & Psychophysics, 38, 269-276.
21. GREEN, K. P., STEVENS, E. B., & KUHL, P. K. (1994). Talker continuity and the use of rate information during phonetic perception. Perception & Psychophysics, 55, 249-260.
22. HIRSH, I. J., & SHERRICK, C. E. (1961). Perceived order in different sense modalities. Journal of Experimental Psychology, 62, 423-432.
23. KASHINO, M., & CRAIG, C. (1994). The influence of knowledge and experience during the processing of spoken words: Non-native listeners. In Proceedings of the International Conference on Spoken Language Processing (pp. 2047-2050).
24. LIBERMAN, A., COOPER, F., SHANKWEILER, D., & STUDDERT-KENNEDY, M. (1967). Perception of the speech code. Psychological Review, 74, 431-461.
25. LINDBLOM, B. (1990). Explaining phonetic variation: A sketch of the H and H theory. In W. Hardcastle & A. Marchal (Eds.), Speech production and speech modeling (pp. 403-439). Dordrecht: Kluwer.
26. MACDONALD, J., & MCGURK, H. (1978). Visual influences on speech perception processes. Perception & Psychophysics, 24, 253-257.
27. MANUEL, S. Y., REPP, B., STUDDERT-KENNEDY, M., & LIBERMAN, A. (1983). Exploring the "McGurk effect." Journal of the Acoustical Society of America, 74, S66.
28. MASSARO, D. W. (1987). Speech perception by ear and eye. Hillsdale, NJ: Erlbaum.
29. MASSARO, D. W., & COHEN, M. M. (1993). Perceiving asynchronous bimodal speech in consonant-vowel and vowel syllables. Speech Communication, 13, 127-134.
30. MASSARO, D. W., SMEELE, P. M. T., COHEN, M. M., & SITTIG, A. C. (1995). Perception of asynchronous and conflicting visual and auditory speech. Manuscript submitted for publication.
31. MCGRATH, M., & SUMMERFIELD, Q. (1985). Intermodal timing relations and audio-visual speech recognition by normal-hearing adults. Journal of the Acoustical Society of America, 77, 678-685.
32. MCGURK, H., & MACDONALD, J. (1976). Hearing lips and seeing speech. Nature, 264, 746-748.
33. MILLER, J. (1986). Rate-dependent processing in speech perception. In A. Ellis (Ed.), Progress in the psychology of language (Vol. 3, pp. 119-157). Hillsdale, NJ: Erlbaum.
34. MILLER, J., & BAER, T. (1983). Some effects of speaking rate on the production of/b/ and /w/. Journal of the Acoustical Society of America, 73, 1751-1755.
35. ÖHMAN, S. (1967). Numerical model of coarticulation. Journal of the Acoustical Society of America, 41, 310-320.
36. PANDEY, C. P., KUNOV, H., & ABEL, M. S. (1986). Disruptive effects of auditory signal delay on speech perception with lip-reading. Journal of Auditory Research, 26, 27-41.
37. PICHENY, M. A., DURLACH, N., & BRAIDA, L. (1985). Speaking clearly for the hard of hearing I: Intelligibility differences between clear and conversational speech. Journal of Speech & Hearing Research, 28, 96-103.
38. PICK, H., WARREN, D., & HAY, J. (1969). Sensory conflict in judgments of spatial direction. Perception & Psychophysics, 6, 203-205.
39. REMEZ, R. E., & RUBIN, P. E. (in press). Acoustic shards, perceptual glue. In J. Charles-Luce, P. A. Luce, & J. R. Sawusch (Eds.), Theories in spoken language: Perception, production, and development. Norwood, NJ: Ablex.
40. REMEZ, R. E., RUBIN, P. E., BERNS, S. M., PARDO, J. S., & LANG, J. M. (1994). On the perceptual organization of speech. Psychological Review, 101, 129-156.
41. SCHEIRMAN, G. L., & CHEETHAM, P. J. (1990). Motion measurement using the Peak Performance Technologies system. Society of Photooptical Instrumentation Engineers Proceedings, 1356, 67-70.
42. SEKIYAMA, K., & TOHKURA, Y. (1991). McGurk effect in non-English listeners: Few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility. Journal of the Acoustical Society of America, 90, 1797-1805.
43. SMEELE, P. M. T., SITTIG, A. C., & VAN HEUVEN, V. J. (1992). Intelligibility of audio-visually desynchronized speech: Asymmetrical effect of phoneme position. In Proceedings of the International Conference on Spoken Language Processing (pp. 65-68).
44. SMEELE, P. M. T., SITTIG, A. C., & VAN HEUVEN, V. J. (1994). Temporal organization of bimodal speech information. In Proceedings of the International Conference on Spoken Language Processing (pp. 1431-1434).
45. SUMBY, W. H.,& POLLACK, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-215.
46. SUMMERFIELD, Q. (1987). Some preliminaries to a comprehensive account of audio-visual speech perception. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lip-reading (pp. 3-51). London: Erlbaum.
47. SUMMERFIELD, Q. (1992). Lipreading and audio-visual speech perception. Philosophical Transactions of the Royal Society of London: Series B, 335, 71-78.
48. SUMMERFIELD, Q., & MCGRATH, M. (1984). Detection and resolution of audiovisual incompatibility in the perception of vowels. Quarterly Journal of Experimental Psychology, 36A, 51-74.
49. TILLMANN, H. G., POMPINO-MARSCHALL, B., & PORZIG, H. (1984). Zum Einfluß visuell dargeborener Sprachbewegungen auf die Wahrnehmung der akustisch kodierten Artikulation. Forschungsberichte des Instituts für Phonetik und Sprachliche Kommunikation der Universität München, 19, 318-338.
50. VATIKIOTIS-BATESON, E., EIGSTI, I., & YANO, S. (1994). Listener eye movement behavior during audiovisual speech perception. In Proceedings of the International Conference on Spoken Language Processing (pp. 527-530).
51. VITKOVICH, M., & BARBER, P. (1994). Effects of video frame rate on subjects' ability to shadow one of two competing verbal passages. Journal of Speech & Hearing Research, 37, 1204-1210.
52. WARD, M. (1992). The effect of auditory-visual dysynchrony on the integration of auditory and visual information in speech perception. Unpublished bachelor's thesis, Queen's University, Kingston, Ontario.
53. WELCH, R. B., DUTTONHURT, L. D., & WARREN, D. H. (1986). Contributions of audition and vision to temporal rate perception. Perception & Psychophysics, 39, 294-300.
54. WELCH, R. B., & WARREN, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychological Bulletin, 88, 638-667.