Improving continuous gesture recognition with spoken prosody

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 1, Issue , 2003, Pages

  Kettebekov, Sanshzar ^a   Yeasin, Mohammed ^a   Sharma, Rajeev ^a  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTATIONAL COMPLEXITY; COMPUTER SIMULATION; MARKOV PROCESSES; MAXIMUM LIKELIHOOD ESTIMATION; NATURAL LANGUAGE PROCESSING SYSTEMS; NEURAL NETWORKS; SPEECH ANALYSIS; SPEECH PROCESSING;

BAYESIAN NETWORKS; CO-ARTICULATION ANALYSIS; HIDDEN MARKOV MODELS; SPEECH CO-ANALYSIS; SPOKEN PROSODY;

GESTURE RECOGNITION;

EID: 4944234707     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. R. A. Bolt, "Put-that-there: Voice and gesture at the graphic interface", In SIGGRAPH-Computer Graphics, 1980.
2. G. Rigoll, A. Kosmala, and S. Eickeler, "High Performance Real-Time Gesture Recognition Using Hidden Markov Models," in Gesture and Sign Language in Human-Computer Interaction, vol. LNAI 1371, M. Fröhlich, Ed., 1997, pp. 69-80.
3. M. Assan and K. Grobel, "Video-Based Sign Language Recognition Using Hidden Markov Models," in Gesture and Sign Language in Human-Computer Interaction, vol. LNAI 1371, I. Wachsmuth and M. Fröhlich, Eds., 1997, pp. 97-111.
4. R. Sharma, J. Cai, S. Chakravarthy, I. Poddar, and Y. Sethi, "Exploiting Speech/Gesture Co-occurrence for Improving Continuous Gesture Recognition in Weather Narration," In Proc. International Conference on Face and Gesture Recognition (FG'2000), Grenoble, France, pp., 2000.
5. A. D. Wilson and A. F. Bobick, "Hidden Markov Models for Modeling and Recognizing Gesture Under Variation," in Hidden Markov Models: Applications in Computer Vision., T. Caelli, Ed.: World Scientific, 2001, pp. 123-160.
6. H. Lee and J. H. Kim, "An HMM-based Threshold Model Approach for Gesture Recognition", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, pp. 961-673, 1999.
7. A. F. Bobick and A. D. Wilson, "A State-Based Approach to the Representation and Recognition of Gesture", IEEE Trans on Pattern Analysis and Machine Intelligence, vol. 19, pp. 1325-1327, 1997.
8. F. G. Hofmann, P. Heyer, and G. Hommel, "Velocity Profile Based Recognition of Dynamic Gestures with Discrete Hidden Markov Models," in Gesture and Sign Language in Human-Computer Interaction, vol. LNAI 1371, M. Fröhlich, Ed., 1997, pp. 81-96.
9. D. McNeill, Hand and Mind: The University of Chicago Press, Chicago, IL, 1992.
10. S. Kettebekov and R. Sharma, "Understanding gestures in multimodal human computer interaction", International Journal on Artificial Intelligence Tools, vol. 9, pp. 205-224, 2000.
11. A. Kendon, Conducting Interaction: Cambridge: Cambridge University Press, 1990.
12. S. Kettebekov and R. Sharma, "Toward Natural Gesture/Speech Control of a Large Display," in Engineering for Human Computer Interaction, vol. 2254, Lecture Notes in Computer Science, M. R. Little and L. Nigay, Eds. Berlin Heidelberg New York: Springer Verlag, 2001, pp. 133-146.
13. S. Kita, I. V. Gijn, and H. V. Hulst, "Movement phases in signs and co-speech gestures, and their transcription by human coders," In Proc. Intl. Gesture Workshop, pp. 23-35, 1997.
14. A. Kendon, "Gesticulation and speech: Two aspects of the process of the utterance," in The Relation Between Verbal and Non-verbal Communication, M. R. Key, Ed. Hague: Mouton, 1980, pp. 207-227.
15. Y. Azoz, L. Devi, and R. Sharma, "Reliable tracking of human arm dynamics by multiple cue integration and constraint fusion," In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp., 1998.
16. L. R. Rabiner, "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition", Proceedings of the IEEE, vol. 77, pp. 257-286, 1989.
17. S. Kettebekov, M. Yeasin, and R. Sharma, "Prosody Based Co-analysis for Continuous Recognition of Coverbal Gestures," In Proc. International Conference on Multimodal Interfaces (ICMI'02), Pittsburgh, USA, pp. 161-166, 2002.
18. P. Taylor, "The rise/fall/connection model of intonation." Speech Communication, vol. 15, pp. 169-186, 1994.
19. D. M. Chickering, D. Heckerman, and C. Meek, "A Bayesian approach to learning Bayesian networks with local structure.," In Proc. Thirteenth Conference on Uncertainty in Artificial Intelligence, Providence, RI, pp. 80-89, 1997.
20. D. M. Chickering, "The WinMine Toolkit," Microsoft, Redmond, WA MSR-TR-2002-103, 2002.