Sign language recognition based on HMM/ANN/DP

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 14, Issue 5, 2000, Pages 587-602

  Gao, Wen ^a,b   Ma, Jiyong ^a   Wu, Jiangqin ^b   Wang, Chunli ^c  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^b HARBIN INSTITUTE OF TECHNOLOGY   (China)

^c DALIAN UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; DYNAMIC PROGRAMMING; FEATURE EXTRACTION; GRAPHICAL USER INTERFACES; MARKOV PROCESSES; MATHEMATICAL MODELS; NEURAL NETWORKS; OBJECT RECOGNITION; PATTERN MATCHING; SIGNAL PROCESSING; VIRTUAL REALITY;

HAND GESTURE RECOGNITION; HIDDEN MARKOV MODEL (HMM); MULTIMODAL USER INTERFACES; SIGN LANGUAGE RECOGNITION;

SPEECH COMMUNICATION;

EID: 0034239262     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218001400000386     Document Type: Article

References (21)

1. R. Bellman and S. Dreyfus, Applied Dynamic Programming, Princeton University, Princeton, NJ, 1962.
2. H. Bourlard, "State-of-the-art and recent progress in hybrid HMM/ANN speech recognition," Proc. Int. Conf. Artificial Neural Networks, 1997, pp. 201-208.
3. C. Charayaphan and A. Marble, "Image processing system for interpreting motion in American sign language," J. Biomed. Engin. 14 (1992) 419-425.
4. S. S. Fels, "Glove-TalkII: mapping hand gestures to speech using neural networks - An approach to building adaptive interfaces," Ph.D. thesis, Computer Science Department, University of Torono, 1994.
5. S. S. Fels and G. Hinton, "GloveTalk: a neural network interface between a DataDlove and a speech synthesizer," IEEE Trans. Neural Networks, 4 (1993) 2-8.
6. K. Grobel and M. Assan, "Isolated sign language recognition using hidden Markov models," Proc. Int. Conf. System, Man and Cybernetics, 1996, pp. 162-167.
7. M. W. Kadous, "Machine recognition of Auslan signed using PowerGlove: towards large-lexicon recognition of sign language," Proc. WIGLS. The Workshop on the Integration of Gesture in Language and Speech, 1996, pp. 165-174.
8. S. B. Rang and K. Ikeuchi, "Robust task programing by human demonstration," Proc. Image Understanding Workshop, 1994, pp. 303-308.
9. S. M. Katz, "Estimation of probabilities from sparse data for the language model component of a speech recognizer," IEEE Trans. Acous. Speech Sign. Proc. 35, 3 (1987) 400-401.
10. J. Kramer and L. J. Leifer, "A "talking glove" for nonverbal deaf individual," Technical Report CDR TR 1990 0312, Center For Design Research, Standford University, 1990.
11. R.-H. Liang and M. Ouhyoung, "A real-time continuous gesture recognition system for sign language," Proc. Third Int. Conf. Automatic Face and Gesture Recognition, Nara, Japan, 1998, pp. 558-565.
12. K. Murakami and H. Taguchi, "Gesture recognition using recurrent neural networks," In CHI'91 Conference Proc., 1991, pp. 237-242.
13. L. Rabiner and B. Juang, "An introduction to hidden Markov models," IEEE ASSP Mag., Jan. (1996) 4-16.
14. T. Starner, "Visual recognition of American sign language using hidden Markov models," Master's thesis, MIT Media Laboratory, July, 1995.
15. T. Takahashi and F. Kishino, "Gesture coding based in experiments with a hand gesture interface device," SIGCHI Bull. 23, 2 (1991) 67-73.
16. C. P. Tung and A. C. Kak, "Automatic learning of assembly tasks using a dataglove system," Proc. IEEE/RSJ Conf. Intelligent Robots and Systems, 1995, pp. 1-8.
17. C. Vogler and D. Metaxas, "Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods," Proc. IEEE Int. Conf. Systems, Man and Cybernetics, Orlando, FL, 1997, pp. 156-161.
18. C. Vogler and D. Metaxas, "ASL recognition based on a coupling between HMMs and 3D motion analysis," Proc. IEEE Int. Conf. Computer Vision, Mumbai, India, 1998, pp. 363-369.
19. C. Vogler and D. Metaxas, "Toward scalability in ASL recognition: breaking down signs into phonemes," Proc. Gesture Workshop, Gif-sur-Yvette, France, 1999, pp. 400-404.
20. C. Vogler and D. Metaxa, "Parallel hidden Markov models for American sign language recognition," Proc. Int. Conf. Computer Vision, Kerkyra, Greece, September 1999, pp. 224-228.
21. A. D. Wexelblat, "A feature-based approach to continuous gesture analysis," Master thesis, MIT, 1993.