Large-vocabulary continuous sign language recognition based on transition-movement models

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans

Volumn 37, Issue 1, 2007, Pages 1-9

  Fang, Gaolin ^a,b   Gao, Wen ^c   Zhao, Debin ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b FUJITSU LABORATORIES LTD   (Japan)

^c INSTITUTE OF COMPUTING TECHNOLOGY   (China)

Author keywords

Chinese sign language (CSL); Dynamic time warping (DTW); Hidden Markov model (HMM); Sign language recognition (SLR); Temporal clustering algorithm

Indexed keywords

ALGORITHMS; ITERATIVE METHODS; MARKOV PROCESSES; VOCABULARY CONTROL;

CHINESE SIGN LANGUAGE; DYNAMIC TIME WARPING; TEMPORAL CLUSTERING ALGORITHM; TRANSITION-MOVEMENT MODELS;

CONTINUOUS SPEECH RECOGNITION;

EID: 33845725620     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2006.886347     Document Type: Article

References (29)

1. C. L. Wang, W. Gao, and S. G. Shan, "An approach based on phonemes to large vocabulary Chinese sign language recognition," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., 2002, pp. 411-416.
2. C. Vogler and D. Metaxas, "Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods," in Proc. IEEE Int. Conf. Syst., Man Cybern., 1997, pp. 156-161.
3. M.W. Kadous, "Machine recognition of Auslan signs using Powergloves: Towards large-lexicon recognition of sign language," in Proc. Workshop Integration Gesture Language Speech, 1996, pp. 165-174.
4. H. Matsuo, S. Igi, S. Lu, Y. Nagashima, Y. Takata, and T. Teshima, "The recognition algorithm with non-contact for Japanese sign language using morphological analysis," in Proc. Int. Gesture Workshop, 1997, pp. 273-284.
5. G. L. Fang, W. Gao, and D. B. Zhao, "Large vocabulary sign language recognition based on fuzzy decision trees," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 34, no. 3, pp. 305-314, May 2004.
6. S. S. Fels and G. E. Hinton, "Glove-talk: A neural network interface between a data-glove and a speech synthesizer," IEEE Trans. Neural Netw., vol. 4, no. 1, pp. 2-8, Jan. 1993.
7. J. S. Kim, W. Jang, and Z. Bien, "A dynamic gesture recognition system for the Korean sign language (KSL)," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 26, no. 2, pp. 354-359, Apr. 1996.
8. P. Vamplew and A. Adams, "Recognition of sign language gestures using neural networks," Aust. J. Intell. Inf. Process. Syst., vol. 5, no. 2, pp. 94-102, 1998.
9. M. B. Waldron and S. Kim, "Isolated ASL sign recognition system for deaf persons," IEEE Trans. Rehabil. Eng., vol. 3, no. 3, pp. 261-271, Sep. 1995.
10. K. Grobel and M. Assan, "Isolated sign language recognition using hidden Markov models," in Proc. Int. Conf. Syst., Man and Cybern., 1997, pp. 162-167.
11. M. Assan and K. Grobel, "Video-based sign language recognition using hidden Markov models," in Proc. Int. Gesture Workshop, 1997, pp. 97-109.
12. T. Starner, J. Weaver, and A. Pentland, "Real-time American sign language recognition using desk and wearable computer based video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 12, pp. 1371-1375, Dec. 1998.
13. B. Bauer and H. Hienz, "Relevant features for video-based continuous sign language recognition," in Proc. 4th Int. Conf. Autom. Face Gesture Recognit., 2000, pp. 440-445.
14. B. Bauer and K. F. Kraiss, "Towards an automatic sign language recognition system using subunits," in Proc. Int. Gesture Workshop, 2001, pp. 64-75.
15. R. H. Liang and M. Ouhyoung, "A real-time continuous gesture recognition system for sign language," in Proc. 3rd Int. Conf. Autom. Face Gesture Recognit., 1998, pp. 558-565.
16. H. Sagawa and M. Takeuchi, "A method for recognizing a sequence of sign language words represented in a Japanese sign language sentence," in Proc. 4th Int. Conf. Autom. Face Gesture Recognit., 2000, pp. 434-439.
17. G. L. Fang and W. Gao, "A SRN/HMM system for signer-independent continuous sign language recognition," in Proc. 5th IEEE Int. Conf. Autom. Face Gesture Recognit., 2002, pp. 312-317.
18. C. Vogler and D. Metaxas, "Toward scalability in ASL recognition: Breaking down signs into phonemes," in Proc. Int. Gesture Workshop, 1999, pp. 400-404.
19. C. Vogler and D. Metaxas, "A framework for recognizing the simultaneous aspects of American sign language," Comput. Vis. Image Underst., vol. 81, no. 3, pp. 358-384, Mar. 2001.
20. W. Gao, J. Y. Ma, J. Q. Wu, and C. L. Wang, "Sign language recognition based on HMM/ANN/DP," Int. J. Pattern Recognit. Artif. Intell., vol. 14, no. 5, pp. 587-602, 2000.
21. W. Gao, J. Y. Ma, X. L. Chen et al., "HandTalker: A multimodal dialog system using sign language and 3-D virtual human," in Proc. 3rd Int. Conf. Multimodal Interface, 2000, pp. 564-571.
22. G. L. Fang, W. Gao, and D. B. Zhao, "Large vocabulary sign language recognition based on hierarchical decision trees," in Proc. 5th Int. Conf. Multimodal Interface, 2003, pp. 125-131.
23. Y. Q. Chen, W. Gao, G. L. Fang, and Z. Q. Wang, "CSLDS: Chinese sign language dialog system," in Proc. IEEE ICCV Int. Workshop Anal. Modeling Faces Gestures, 2003, pp. 236-237.
24. W. Gao, G. L. Fang, D. B. Zhao, and Y. Q. Chen, "A Chinese sign language recognition system based on SOFM/HMM/SRN," Pattern Recognit., vol. 37, no. 12, pp. 2389-2402, Dec. 2004.
25. W. Gao, G. L. Fang, D. B. Zhao, and Y. Q. Chen, "Transition movement models for large vocabulary continuous sign language recognition," in Proc. IEEE 6th Int. Conf. Autom. Face Gesture Recognit., 2004, pp. 553-558.
26. W. C. Stokoe, Sign Language Structure: An Outline of the Visual Communication System of the American Deaf. Studies in Linguistics: Occasional Papers 8 (Revised 1978). Buffalo, NY: Linstok, 1960.
27. J. G. Wilpon and L. R. Rabiner, "A modified K-means clustering algorithm for use in isolated word recognition," IEEE Trans. Acoust., Speech, Signal Process., vol. 33, no. 3, pp. 587-594, Jun. 1985.
28. C. S. Myers and L. R. Rabiner, "A comparative study of several dynamic time-warping algorithms for connected word recognition," Bell Syst. Tech. J., vol. 60, no. 7, pp. 1389-1409, 1981.
29. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-285, Feb. 1989.