Perception of ‘Speech-and-Gesture’ Integration

International Conference on Auditory-Visual Speech Processing 2008, AVSP 2008

Volumn , Issue , 2008, Pages 31-36

  Giorgolo, Gianluca ^a   Verstraten, Frans A J ^b  

^a UTRECHT UNIVERSITY   (Netherlands)

^b UTRECHT UNIVERSITY   (Netherlands)

Author keywords

Audiovisual perception; Speech and gesture integration

Indexed keywords

AUDIO SIGNAL; AUDIO-VISUAL PERCEPTIONS; GESTURE INPUT; MULTI-MODAL; PROSODICS; SPEECH AND GESTURE INTEGRATION; SPEECH INPUT; TEMPORAL ALIGNMENT; VISUAL SIGNALS;

SPEECH COMMUNICATION;

EID: 77955191814     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Harry McGurk and John MacDonald. Hearing lips and seeing voices. Nature, 264, 1976.
2. Kevin G. Munhall, P. Gribble, L. Sacco, and M. Ward. Temporal constraints on the mcgurk effect. Perception & Psychophysics, 58(3):351–362, 1996.
3. L. D. Rosenblum, M. A. Schmuckler, and J. A. Johnson. The mcgurk effect in infants. Perception & Psychophysics, 59(3):347–357, 1997.
4. George Hollich, Rochelle S. Newman, and Peter W. Jusczyk. Infants’ use of synchronized visual information to separate streams of speech. Child Development, 76(3):598–613, 2005.
5. David McNeill. Hand and Mind. University of Chicago Press, 1992.
6. David McNeill. Gesture and Thought. University of Chicago Press, November 2005.
7. Asli Özyürek, Roel M. Willems, Sotaro Kita, and Peter Hagoort. On-line integration of semantic information from speech and gesture: Insights from event-related brain potentials. Journal of Cognitive Neuroscience, 19(4):605–616, 2007.
8. Roel M. Willems, Asli Özyürek, and Peter Hagoort. When language meets action: The neural integration of gesture and speech. Cerebral Cortex, December 2006.
9. S. D. Kelly, C. Kravitz, and M. Hopkins. Neural correlates of bimodal speech and gesture comprehension. Brain and Language, 89(1):253–260, 2004.
10. Adam Kendon. Do gestures communicate? a review. Research on Language and Social Interaction, 27(3):175–200, 1994.
11. Geoffrey Beattie and Heather Shovelton. Do iconic gestures really contribute anything to the semantic information conveyed by speech? an experimental investigation. Semiotica, 123:201–212, 1999.
12. E. Krahmer and M. Swerts. The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57(3):396–414, 2007.
13. Daniel P. Loehr. Gesture and Intonation. PhD thesis, Faculty of the Graduate School of Arts and Sciences of Georgetown University, March 2004.
14. Paul Boersma and David Weenink. Praat: doing phonetics by computer (Version 5.0.24) [Computer program]. Retrieved September, 2007, from http://www.praat.org/
15. Adam Kendon. Some relationships between body motion and speech: An analysis of an example. In A. Siegman and B. Pope, editors, Studies in Dyadic Communication. Pergamon Press, New York, 1972.