Combined gesture-speech analysis and speech driven gesture synthesis

2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Proceedings

Volumn 2006, Issue , 2006, Pages 893-896

  Sargin, M E ^a   Aran, O ^c   Karpov, A ^d   Ofli, F ^a   Yasinnik, Y ^b   Wilson, S ^e   Erzin, E ^a   Yemez, Y ^a   Tekalp, A M ^a  

^a KOÇ UNIVERSITY   (Turkey)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c BOGAZICI UNIVERSITY   (Turkey)

^d ST PETERSBURG INSTITUTE FOR INFORMATICS AND AUTOMATION   (Russian Federation)

^e UNIVERSITY COLLEGE DUBLIN   (Ireland)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; CORRELATION METHODS; FEATURE EXTRACTION; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION; LINGUISTICS;

GESTURE SYNTHESIS; GESTURE-SPEECH CORRELATION; HUMAN-MACHINE INTERACTION SYSTEMS;

SPEECH ANALYSIS;

EID: 34247646607     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICME.2006.262663     Document Type: Conference Paper

References (11)

1. H. McGurk and J. McDonald, "Hearing lips and seeing voices," Nature, pp. 746-748, 1976.
2. S. Kettebekov, M. Yeasin, and R. Sharma, "Prosody based co-analysis for continuous recognition of coverbal gestures," Proc. ICMI'02, 2002.
3. F. Quek, D. McNeill, R. Ansari, X-F. Ma, R. Bryll, S. Duncan, and K.E. McCullough, "Gesture cues for conversational interaction in monocular video," Proc. Int. Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in RealTime Systems'99, 1999.
4. L. Valbonesi, R. Ansari, D. McNeill, F. Quek, S. Duncan, K. E. McCullough, and R. Bryll, "Multimodal signal analysis of prosody and hand motion: Temporal correlation of speech and gestures," Proc. of the European Signal Processing Conference 2002 (EUSIPCO'02), vol. 1, pp. 75-78, 2002.
5. M. E. Sargin, E. Erzin, Y. Yemez, and A. M. Tekalp, "Lip feature extraction based on audio-visual correlation," Proc. of the European Signal Processing Conference (EUSIPCO'05), 2005.
6. M. E. Sargin, F. Ofli, Y. Yasinnik, O. Aran, A. Karpov, S. Wilson, E. Erzin, Y. Yemez, and A. M. Tekalp, "Combined gesture-speech analysis and synthesis," Proc. of the eNTER-FACE'05 The SIMILAR Workshop on Multimodal Interfaces, August 2005.
7. P. Boersma, "Accurate short-term analysis of the fundamental frequency and the harmonics-to-noise ratio of a sampled sound," Proc. of the Inst. of Phonetic Sciences, vol. 17, pp. 97-110, 1993.
8. Jie Yang and Yangsheng Xu, "Hidden markov model for gesture recognition," Tech. Rep. CMU-RI-TR-94-10, Robotics Institute, Carnegie Mellon University, May 1994.
9. S. Duncan, F. Parrill, and D. Loehr, "Discourse factors in gesture and speech prosody," Conf. of the International Society for Gesture Studies (ISGS), 2005.
10. M.A. Epstein, "Voice quality and prosody in english," Proceedings of the XVth International Congress of Phonetic Sciences, 2003.
11. M.E. Sargin, "Output of the animation engine," 2005, Available in http://home.ku.edu.tr/~msargin/icme06/.