Audio-visual interactions with intact clearly audible speech

Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology

Volumn 57, Issue 6, 2004, Pages 1103-1121

  Davis, Chris ^a   Kim, Jeesun ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; FACE; FEMALE; HUMAN; MALE; MOVEMENT (PHYSIOLOGY); SPEECH PERCEPTION; VISION;

ADULT; FACE; FEMALE; HUMANS; MALE; MOVEMENT; SPEECH PERCEPTION; VISUAL PERCEPTION;

EID: 4344606556     PISSN: 02724987     EISSN: None     Source Type: Journal    
DOI: 10.1080/02724980343000701     Document Type: Article

References (48)

1. Buccino, G., Binkofski, F., Fink, G. R., Fadiga, L., Fogassi, L. Gallese, V., et al. (2001). Action observation activates premotor and parietal areas in a somatotopic manner: An fMRI study. European Journal of Neuroscience, 13, 400-404.
2. Burnham, D., Francis, E., Webster, D., Luksaneeyanawin, S., Attapaiboon, C., Lacerda, F., & Keller, P. (1996). Perception of lexical tone across languages: Evidence for a linguistic mode of processing. In T. Bunnell & W. Idsardi (Eds.), Proceedings of the Fourth International Conference on Spoken Language Processing (Vol. 1, pp. 2514-2517), Philadelphia, PA, USA.
3. Byrne, R. W. (1999). Imitation without intentionality: Using string parsing to copy the organization of behaviour. Animal Cognition, 2, 63-72.
4. Callan, D. E., Callan, A. M., Kroos, C., & Vatikiotis-Bateson, E. (2001). Multimodal contribution to speech perception revealed by independent component analysis: A single-sweep EEG case study. Cognitive Brain Research, 10, 349-353.
5. Calvert, G. A., Campbell, R., & Brammer, M. J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology, 10, 649-657.
6. Cox, E.A., Norrix, L.W., & Green, K.P. (1999). The contribution of visual information to on-line sentence processing: Evidence from phoneme monitoring. In D. Massaro (Ed.), Proceedings of AVSP'99 (Vol. 1, Paper No. 5), Santa Cruz, CA, USA. Adelaide, Australia: Causal Productions.
7. Davis, C., Castles, A., & Iakovidis, E. (1998). Masked homophone and pseudohomophone priming in children and adults. Language and Cognitive Processes, 13, 625-651.
8. Davis, C., & Kim, J. (2001). Repeating and remembering foreign language words: Implications for language teaching systems. Artificial Intelligence Review, 16, 37-47.
9. Dixon, W. J., & Tukey, J. W. (1968). Approximate behavior of the distribution of winsorized t (trimming/winsorization 2). Technometrics, 10, 83-98.
10. Driver, J., & Spence, C. (1998). Attention and the crossmodal construction of space. Trends in Cognitive Sciences, 2, 251-262.
11. Forster, K. I., & Forster, J. C. (2003). DMDX: A windows display program with millisecond accuracy. Behavioral Research: Methods, Instruments & Computers, 35, 116-124.
12. Frauenfelder, U. H., & Kearns, R. K. (1996). Sequence monitoring. Language and Cognitive Processes, 11, 665-673.
13. Goodale, M. A., & Murison, R. C. C. (1975). The effects of lesions of the superior colliculus on locomotor orientation and the orienting reflex in the rat. Brain Research, 88, 243-261.
14. Grant, K. W., & Seitz, P. (2000). The use of visible speech cues for improving auditory detection of spoken sentences. Journal of the Acoustical Society of America, 108, 1197-1208.
15. Kerzel, D., & Bekkering, H. (2000). Motor activation from visible speech: Evidence form stimulus response compatibility. Journal of Experimental Psychology: Human Perception and Performance, 26, 634-647.
16. Kim, J., & Davis, C. (2003). Hearing foreign voices: Does knowing what is said affect masked visual speech detection? Perception, 32, 111-120.
17. Kohler, E., Keysers, C., Umiltà, M. A., Fogassi, L., Gallese, V., & Rizzolatti, G. (2002). Hearing sounds, understanding actions: Action representation in mirror neurons. Science, 297, 846-848.
18. Kuhl, P. K., & Meltzoff, A. N. (1982). The bimodal perception of speech in infancy. Science, 218, 1138-1141.
19. Kuhl, P. K. (2000). A new view of language acquisition. Proceedings of the National Academy of Sciences, 97, 11850-11857.
20. Lee, A. (2000). Virtual Dub©. Retrieved October 10, 2000 from http://www.virtualdub.org
21. Liberman, A. M., & Mattingly, I. G. (1985). The motor theory of speech perception revised. Cognition, 21, 1-36.
22. MacLeod, A., & Summerfield, Q. (1987). Quantifying the contribution of vision to speech perception in noise. British Journal of Audiology, 21, 131-141.
23. MacNeilage, P. F. (1998). The frame/content theory of evolution of speech production. Behavioral and Brain Sciences, 21, 499-511.
24. Markham, D. (1999). Naïve imitation of second-language stimuli: Duration and F0. In J. Ohala (Ed.), Proceedings of the Fourteenth International Congress of Phonetic Sciences (Vol. 2, pp. 1145-1148), San Francisco, CA, USA.
25. Massaro, D. W. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
26. Massaro, D. W. (1998). Perceiving talking faces. Cambridge, MA: MIT Press.
27. Massaro, D. W. (1999). Speechreading: Illusion or window into pattern recognition. Trends in Cognitive Sciences, 3, 310-317.
28. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
29. Meredith, M. A., & Stein, B. E. (1983). Interactions among converging sensory inputs in the superior colliculus. Science, 221, 389-339.
30. Norrix, L. W., & Green, K. P. (1996). Auditory-visual context effects on the perception of /r/ and /l/ in a stop cluster. Journal of the Acoustical Society of America, 99, 2591.
31. Oden, G. C., & Massaro, D. W. (1978). Integration of featural information in speech perception, Psychological feview, 55, 172-191.
32. Olson, I. R., Gatenby, J. C., & Gore, J. C. (2002). A comparison of bound and unbound audio-visual information processing in the human cerebral cortex. Cognitive Brain Research, 14, 129-138.
33. O'Shaugnessy, D. (1987). Speech communication (pp. 165-185). Reading, MA: Addison-Wesley.
34. Perea, M., Rosa, E., & Gómez, C. (2002). Is the go/no-go lexical decision task an alternative to the yes/no lexical decision task? Memory and Cognition, 30, 34-45.
35. Reisberg, D., McLean, J., & Goldfield, A. (1987). Easy to hear to understand: A lip-reading advantage with intact auditory stimuli. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lip-reading (pp. 97-113). Hove, UK: Lawrence Erlbaum Associates Ltd.
36. Sohn, H. (1994). Korean. London: Routledge.
37. Stein, B. E. (1984). Development of the superior colliculus. Annual Review Neuroscience, 7, 95-125.
38. Stein, B. E. (1998). Neural mechanisms for synthesizing sensory information and producing adaptive behaviors. Experimental Brain Research, 123, 124-135.
39. Stein, B. E., & Meredith, M. A. (1993). The merging of the senses. Cambridge, MA: MIT Press.
40. Stetson, R. H. (1905). A motor theory of rhythm and discrete association (II). Psychological Review, 12, 293-350.
41. Sumby, W. H., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustic Society of America, 26, 212-215.
42. Summerfield, A. Q. (1979). Use of visual information for phonetic perception. Phonetica, 36, 314-331.
43. Vatikiotis-Bateson, E. (1999). Audiovisual speech production: Some issues for recognition. In 1999 Spring Meeting of the Acoustical Society of Japan (Vol. 11-3, pp. 81-84). Tokyo: ASJ.
44. Vatikiotis-Bateson, E., Munhall, K. G., Hirayama, M., Lee, Y. C., & Terzopoulos, D. (1996). The dynamics of audiovisual behavior in speech. In D. Stork & M. Hennecke (Eds.), Speechreading by humans and machines (NATO-ASI Series F, Vol. 150 (pp. 221-232). Berlin: Springer-Verlag.
45. Wallace, M. T., Meredith, M. A., & Stein B. E. (1993). Converging influences from visual, auditory and somatosensory cortices onto output neurons of the superior colliculus. Journal of Neurophysiology, 69, 1797-1809.
46. Walton, G. E., & Bower, T. G. R. (1993). Amodal representation of speech in infants. Infant Behavior and Development, 16, 233-243.
47. Yehia, H., Rubin, P., & Vatikiotis-Bateson, E. (1998). Quantitative association of vocal-tract and facial behavior. Speech Communication, 26, 23-43.
48. Yoneyama, K. (1996). Segmentation strategies for spoken language recognition: Evidence from semi-bilingual Japanese speakers of English. In H. T. Bunnell & W. Idsardi (Eds.), Proceedings of ICSLP 96, Fourth International Conference on Spoken Language Processing (Vol. 1, pp. 454-457), Philadelphia, PA, USA.