Inferring body pose using speech content

Proceedings of the Seventh International Conference on Multimodal Interfaces, ICMI'05

Volumn , Issue , 2005, Pages 53-60

  Wang, Sy Bor ^a   Demirdjian, David ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Arm Gesture Recogntion; Audio Visual Tracking; Untethered Body Pose Tracking

Indexed keywords

COMPUTER AIDED ANALYSIS; COMPUTER VISION; ERROR ANALYSIS; HUMAN COMPUTER INTERACTION; SPEECH RECOGNITION; USER INTERFACES;

ARM GESTURE RECOGNTION; AUDIO-VISUAL TRACKING; LINEAR DISCRIMINANT ANALYSIS (LDA); UNTETHERED BODY POSE TRACKING;

GESTURE RECOGNITION;

EID: 32344443929     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1088463.1088476     Document Type: Conference Paper

References (18)

1. R. A. Bolt. Put that there: Voice and gesture at the graphics interface. In 7th annual conf. on Computer Graphics and Interactive Techniques, pages 262-270. ACM Press, 1980.
2. A. Corradini, R. Wesson, and P. R. Cohen. A map-based system using speech and 3d gestures for pervasive computing. In Int'l Conf. on Multimodal Interfaces, 2002.
3. Q. Delamarre and O. D. Faugeras. 3D articulated models and multi-view tracking with silhouettes. In Proceedings of ICCV'99, pages 716-721, 1999.
4. D. Demirdjian and T. Darrell. 3-d articulated pose tracking for untethered deictic reference. In Int'l Conf. on Multimodal Interfaces, 2002.
5. H. Holzapfel, K. Nickel, and R. Stiefelhagen. Implementation and evaluation of a constraint-based multimodal fusion system for speech and 3d pointing gestures. In Int'l Conf. on Multimodal Interfaces, pages 175-182, 2004.
6. X. Huang, A. Acero, and H. Hon. Spoken Language Processing. Prentice Hall, Upper Sadle River, New Jersey, 2001.
7. C. Hundtofte, G. Hager, and A. Okamura. Building a task language for segmentation and recognition of user input to cooperative manipulation systems. In IEEE Virtual Reality Conference (HAPTICS 2002), Orlando, Florida, 2002.
8. N. Jojic, M. Turk, and T. Huang. Tracking articulated objects in dense disparity maps. In International Conference on Computer Vision, pages 123-130, 1999.
9. E. Kaiser, A. Olwal, D. McGee, H. Benko, A. Corradini, and X. Li. Mutual disambiguation of 3d multimodal interaction in augmented and virtual reality. In Int'l Conf. on Multimodal Interfaces, Vancouver, B. C., Canada, 2003.
10. D. B. Koons, C. J. Sparrell, and K. R. Thorisson. Integrating simultaneous input from speech, gaze, and hand gestures. In Intelligent Multimedia Interfaces, M. T. Maybury, 1993. AAAI Press/MIT Press Cambridge, MA.
11. D. McNeill. Hand and Mind. The University Chicago Press, Chicago IL, 1992.
12. S. L. Oviatt. Mutual disambiguation of recognition errors in a multimodal architecture. In Int'l conf. of Computer Human Interfaces(CHI 99), Pittsburgh, Pennsylvania, 1999.
13. S. L. Oviatt. Ten myths of multimodal interaction. In CACM, volume 42(11), pages 74-81, 1999.
14. S. L. Oviatt, A. DeAngeli, and K. Kuhn. Integration and synchronization of input modes during multimodal human-computer interaction. In CHI, pages 415-422, 1997.
15. L. R. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. In Proc. of the IEEE, volume 77, pages 257-286, 2002.
16. S. Seneff, E. Hurley, R. Lau, C. Pao, P. Schmid, and V. Zue. Galaxy-2: A reference architecture for conversational system development. In Int'l conf. of Speech and Language Processing, Sydney, Australia, 1998.
17. R. Sharma, J. Cai, S. Chakravathy, I. Poddar, and Y. Sethi. Exploiting speech/gesture co-occurrence for improving continuous gesture recognition in weather narration. In Int'l Conf. on Face and Gesture Recognition, Grenoble France, 2000.
18. R. Stiefelhagen, C. Fugen, H. H. P. Gieselmann, K. Nickel, and A. Waibel. Natural human-robot interaction using speech, gaze and gestures. In Int'l Conf. on Intelligent Robots and Systems, Sendai, Japan, 2004.