Large vocabulary sign language recognition based on fuzzy decision trees

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans.

Volumn 34, Issue 3, 2004, Pages 305-314

  Fang, Gaolin ^a   Gao, Wen ^b   Zhao, Debin ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b INSTITUTE OF COMPUTING TECHNOLOGY   (China)

Author keywords

Finite state machine; Fuzzy decision trees; Hidden Markov models (HMM); Self organizing feature maps (SOFM); Sign language recognition

Indexed keywords

DECISION THEORY; FEATURE EXTRACTION; FUZZY SETS; HUMAN COMPUTER INTERACTION; MARKOV PROCESSES;

FINITE STATE MACHINE; FUZZY DECISION TREES; HIDDEN MARKOV MODELS; SELF ORGANIZING FEATURE MAPS; SIGN LANGUAGE; SIGN LANGUAGE RECOGNITION;

PATTERN RECOGNITION;

EID: 2442495127     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2004.824852     Document Type: Article

References (31)

1. M. W. Kadous, "Machine recognition of auslan signs using powergloves: Toward large-lexicon recognition of sign language," in Proc. Workshop Integration Gesture Language Speech, 1996, pp. 165-174.
2. H. Matsuo, S. Igi, S. Lu, Y. Nagashima, Y. Takata, and T. Teshima, "The recognition algorithm with noncontact for Japanese sign language using morphological analysis," in Proc. Int. Gesture Workshop, 1997, pp. 273-284.
3. S. S. Fels and G. E. Hinton, "Glove-talk: A neural network interface between a data-glove and a speech synthesizer," IEEE Trans. Neural Networks, vol. 4, pp. 2-8, Jan. 1993.
4. J. S. Kim, W. Jang, and Z. Bien, "A dynamic gesture recognition system for the Korean sign language (KSL)," IEEE Trans. Syst., Man, Cybern. B, vol. 26, pp. 354-359, Apr. 1996.
5. M. B. Waldron and S. Kim, "Isolated ASL sign recognition system for deaf persons," IEEE Trans. Rehab. Eng., vol. 3, pp. 261-271, June 1995.
6. K. Grobel and M. Assan, "Isolated sign language recognition using hidden Markov models," in Proc. Int. Conf. Systems, Man Cybernetics, 1997, pp. 162-167.
7. B. Bauer and H. Hienz, "Relevant features for video-based continuous sign language recognition," in Proc. 4th Int. Conf. Automatic Face Gesture Recognition, 2000, pp. 440-445.
8. R. H. Liang and M. Ouhyoung, "A real-time continuous gesture recognition system for sign language," in Proc. 3rd Int. Conf. Automatic Face Gesture Recognition, 1998, pp. 558-565.
9. T. Starner, J. Weaver, and A. Pentland, "Real-time American sign language recognition using desk and wearable computer based video," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 1371-1375, Dec. 1998.
10. C. Vogler and D. Metaxas, "Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods," in Proc. IEEE Int. Conf. Systems, Man Cybernetics, 1997, pp. 156-161.
11. C. Vogler and D. Metaxas, "Toward scalability in ASL recognition: Breaking down signs into phonemes," in Proc. Int. Gesture Workshop, 1999, pp. 400-404.
12. C. Vogler and D. Metaxas, "A framework for recognizing the simultaneous aspects of American sign language," Comput. Vis. Image Understanding, vol. 81, no. 3, pp. 358-384, 2001.
13. P. Vamplew and A. Adams, "Recognition of sign language gestures using neural networks," Aust. J. Intell. Informat. Process. Syst., vol. 5, no. 2, pp. 94-102, 1998.
14. W. Gao, J. Y. Ma, J. Q. Wu, and C. L. Wang, "Sign language recognition based on HMM/ANN/DP," Int. J. Pattern Recognit. Artif. Intell., vol. 14, no. 5, pp. 587-602, 2000.
15. W. Gao et al., "HandTalker: A multimodal dialog system using sign language and 3-D virtual human," in Proc. 3rd Int. Conf. Multimodal Interface, 2000, pp. 564-571.
16. W. C. Stokoe, Sign Language Structure: An Outline of the Visual Communication System of the American Deaf. Studies in Linguistics: Occasional Papers 8 (Revised 1978). Buffalo, NY: Linstok, 1960.
17. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Royal Statistical Soc., vol. 39, no. 1, pp. 1-38, 1977.
18. G. J. McLachlan and T. Krishnan, The EM Algorithm and Extensions. New York: Wiley, 1997.
19. C. S. Lee, G. Park, J. S. Kim, Z. Bien, W. Jang, and S. K. Kim, "Real-time recognition system of Korean sign language based on elementary components," in Proc. 6th Int. Conf. Fuzzy Systems, 1997, pp. 1463-1468.
20. P. Hong, M. Turk, and T. S. Huang, "Gesture modeling and recognition using finite state machines," in Proc. 4th Int. Conf. Automatic Face Gesture Recognition, 2000, pp. 410-415.
21. E. Trentin and M. Gori, "A survey of hybrid ANN/HMM models for automatic speech recognition," Neurocomput., vol. 37, no. 1/4, pp. 91-126, 2001.
22. A. Corradini, H. J. Böhme, and H. M. Gross, "A hybrid stochastic-connectionist approach to gesture recognition," Int. J. Artif. Intell. Tools, vol. 9, no. 2, pp. 177-204, 2000.
23. X. Li, M. Parizeau, and R. Plamondon, "Hidden Markov model multiple observation training," Tech. Rep. EPM/RT-99-16, 1999.
24. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, pp. 257-285, 1989.
25. J. R. Quinlan, "Induction of decision trees," Mach. Learn., vol. 2, no. 1, pp. 81-106, 1996.
26. ____, C4.5: Program for Machine Learning. San Mateo, CA: Morgan Kaufmann, 1993.
27. L. Breiman, J. H. Friedman, R.A. Olshen, and C. J. Stone, Classification and Regression Trees. New York: Chapman & Hall, 1984.
28. A. Suárez and J. F. Lutsko, "Globally optimal fuzzy decision trees for classification and regression," IEEE Trans. Pattern Anal. Machine Intell., vol. 21, pp. 1297-1311, Dec. 1999.
29. C. Z. Janikow, "Fuzzy decision trees: Issues and methods," IEEE Trans. Syst., Man, Cybern. B, vol. 28, pp. 1-14, Feb. 1998.
30. M. I. Jordan and R. A. Jacobs, "Hierarchical mixtures of experts and the EM algorithm," Neural Computation, vol. 6, no. 2, pp. 181-214, 1994.
31. M. Gales, "Maximum likelihood linear transformations for HMM-based speech recognition," Comput. Speech Lang., vol. 12, no. 1, pp. 75-98, 1998.