Audiovisual Asynchrony Detection for Speech and Nonspeech Signals

AVSP 2003 - International Conference on Audio-Visual Speech Processing

Volumn , Issue , 2003, Pages 25-30

  Conrey, Brianna L ^a   Pisoni, David B ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH RECOGNITION;

ASYNCHRONY; CONDITION; DETECTION TASKS; DISPLAY CONDITIONS; FULL FACES; LIGHT DISPLAY; MULTISENSORY; NON SPEECH;

SPEECH PROCESSING;

EID: 33845384666     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (34)

1. Lewkowicz, D.J., Perception of auditory-visual temporal synchrony in human infants. Journal of Experimental Psychology: Human Perception and Performance, 1996. 22: p. 1094-1106.
2. Stein, B. and M.A. Meredith, The merging of the senses. 1993, Cambridge, MA: MIT Press. 211.
3. Bushara, K.O., J. Grafman, and M. Hallett, Neural correlates of auditory-visual stimulus onset asynchrony detection. Journal of Neuroscience, 2001. 21(1): p. 300-304.
4. Dixon, N. and L. Spitz, The detection of audiovisual desynchrony. Perception, 1980. 9: p. 719-721.
5. McGrath, M. and Q. Summerfield, Intermodal timing relations and audio-visual speech recognition by normal-hearing adults. Journal of the Acoustical Society of America, 1985. 77(2): p. 678-684.
6. Grant, K.W., V. van Wassenhove, and D. Poeppel. Discrimination of auditory-visual synchrony. in AVSP 2003 International Conference on Auditory-Visual Speech Processing. 2003.
7. Munhall, K.G., et al., Temporal constraints on the McGurk effect. Perception & Psychophysics, 1996. 58(3): p. 351-362.
8. Grant, K.W. and S. Greenberg. Speech intelligibility derived from asynchronous processing of auditory-visual information. in AVSP International Conference on Auditory-Visual Speech Processing. 2001.
9. Pandey, C.P., H. Kunov, and M.S. Abel, Disruptive effects of auditory signal delay on speech perception with lip-reading. The Journal of Auditory Research, 1986. 26: p. 27-41.
10. Massaro, D. and M. Cohen, Perceiving asynchronous bimodal speech in consonant-vowel and vowel syllables. Speech Communication, 1993. 13: p. 127-134.
11. Massaro, D., Perceiving talking faces: From speech perception to a behavioral principle. 1998, Cambridge, MA: MIT Press.
12. Lachs, L. and L.R. Hérnandez, Update: The Hoosier Audiovisual Multitalker Database, in Research on Spoken Language Processing Progress Report 22. 1998, Speech Research Laboratory, Indiana University: Bloomington, IN. p. 377-388.
13. Sheffert, S.M., L. Lachs, and L.R. Hérnandez, The Hoosier audiovisual multitalker database, in Research on Spoken Language Processing no. 21. 1996, Speech Research Laboratory, Indiana University: Bloomington, IN. p. 578-583.
14. Lachs, L. and D.B. Pisoni, Visual recognition of spoken words without audition. under review.
15. Lachs, L., Vocal tract kinematics and crossmodal speech information, in Research on Spoken Language Processing Technical Report. 2002, Indiana University: Bloomington. p. 1-90.
16. Rosenblum, L.D. and H.M. Saldaña, An audiovisual test of kinematic primitives for visual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 1996. 22(2): p. 318-331.
17. Bergeson, T.R., J.T. Reynolds, and D.B. Pisoni. Perception of point light displays of speech by normal-hearing adults and deaf adults with cochlear implants. in AVSP 2003 International Conference on Auditory-Visual Speech Processing. 2003.
18. Spence, C., et al., Multisensory temporal order judgments: When two locations are better than one. Perception & Psychophysics, 2003. 65(2): p. 318-328.
19. King, A.J. and A.R. Palmer, Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus. Experimental Brain Research, 1985. 60: p. 492-500.
20. Meredith, M.A., J.W. Nemitz, and B.E. Stein, Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. The Journal of Neuroscience, 1987. 7(10): p. 3215-3229.
21. Meredith, M.A., On the neuronal basis for multisensory convergence: A brief overview. Cognitive Brain Research, 2002. 14: p. 31-40.
22. Lewald, J. and R. Guski, Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli. Cognitive Brain Research, 2003. 16: p. 468-478.
23. Grant, K.W. and P.F. Seitz, Measures of auditory-visual integration in nonsense syllables and sentences. Journal of the Acoustical Society of America, 1998. 104: p. 2438-2450.
24. Schroeder, C.E. and J.J. Foxe, The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Cognitive Brain Research, 2002. 14: p. 187-198.
25. Calvert, G., et al., Activation of auditory cortex during silent lipreading. Science, 1997. 276: p. 593-6.
26. Calvert, G., et al., Response amplification in sensory-specific cortices during crossmodal binding. NeuroReport, 1999. 10: p. 2629-2623.
27. Calvert, G., R. Campbell, and M.J. Brammer, Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology, 2000. 10: p. 649-657.
28. Calvert, G. and R. Campbell, Reading speech from still and moving faces: The neural substrates of visible speech. Journal of Cognitive Neuroscience, 2003. 15(1): p. 57-70.
29. Callan, D.E., et al., Multimodal contribution to speech perception revealed by independent component analysis: A single-sweep EEG case study. Cognitive Brain Research, 2001. 10: p. 349-353.
30. Molholm, S., et al., Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cognitive Brain Research, 2002. 14: p. 115-128.
31. Teder-Sälejärvi, W.A., et al., An analysis of audiovisual crossmodal integration by means of event-related potential (ERP) recordings. Cognitive Brain Research, 2002. 14: p. 106-114.
32. Giard, M.H. and F. Peronnet, Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience, 1999. 11(5): p. 473-490.
33. Shams, L., Y. Kamitani, and S. Shimojo, Visual illusion induced by sound. Cognitive Brain Research, 2002. 14: p. 147-152.
34. Vatikiotis-Bateson, E., et al., Eye movement of perceivers during audiovisual speech perception. Perception & Psychophysics, 1998. 60(6): p. 926-940.