A Chinese sign language recognition system based on SOFM/SRN/HMM

Pattern Recognition

Volumn 37, Issue 12, 2004, Pages 2389-2402

  Gao, Wen ^a,b   Fang, Gaolin ^a   Zhao, Debin ^a   Chen, Yiqiang ^b  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b INSTITUTE OF COMPUTING TECHNOLOGY   (China)

Author keywords

Chinese sign language; Hidden Markov model; Self organizing feature map; Sign language recognition; Simple recurrent network

Indexed keywords

FEATURE EXTRACTION; MARKOV PROCESSES; MATHEMATICAL MODELS; PROBABILITY; PROBLEM SOLVING; SELF ORGANIZING MAPS;

CHINESE SIGN LANGUAGE; HIDDEN MARKOV MODEL (HMM); SIGN LANGUAGE RECOGNITION; SIMPLE RECURRENT NETWORK (SRN);

SPEECH RECOGNITION;

EID: 12344292712     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0031-3203(04)00165-7     Document Type: Article

References (44)

1. C.L. Wang, W. Gao, and S.G. Shan An approach based on phonemes to large vocabulary Chinese sign language recognition Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition 2002 411 416
2. C. Vogler, and D. Metaxas Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods Proceedings of the IEEE International Conference on Systems, Man and Cybernetics 1997 156 161
3. V.I. Pavlovic, R. Sharma, and T.S. Huang Visual interpretation of hand gestures for human-computer interaction a review IEEE Trans. Pattern Anal. Mach. Intell. 19 7 1997 677 695
4. Y. Wu, and T.S. Huang Vision-based gesture recognition a review Proceedings of the International Gesture Workshop 1999 103 115
5. H.K. Lee, and J.H. Kim An HMM-based threshold model approach for gesture recognition IEEE Trans. Pattern Anal. Mach. Intell. 21 10 1999 961 973
6. A. Corradini, H.J. Böhme, and H.M. Gross A hybrid stochastic-connectionist approach to gesture recognition Int. J. Artif. Intell. Tools 9 2 2000 177 204
7. H.S. Yoon, J. Soh, Y.J. Bae, and H.S. Yang Hand gesture recognition using combined features of location angle and velocity, Pattern Recognition 34 7 2001 1491 1501
8. J. Triesch, and C. Malsburg A system for person-independent hand posture recognition against complex backgrounds IEEE Trans. Pattern Anal. Mach. Intell. 23 12 2001 1449 1453
9. M.W. Kadous Machine recognition of Auslan signs using PowerGloves towards large-lexicon recognition of sign language Proceedings of the Workshop on the Integration of Gesture in Language and Speech 1996 165 174
10. H. Matsuo, S. Igi, S. Lu, Y. Nagashima, Y. Takata, and T. Teshima The recognition algorithm with non-contact for Japanese sign language using morphological analysis Proceedings of the International Gesture Workshop 1997 273 284
11. S.S. Fels, and G.E. Hinton Glove-talk a neural network interface between a data-glove and a speech synthesizer IEEE Trans. Neural Networks 4 1 1993 2 8
12. J.S. Kim, W. Jang, and Z. Bien A dynamic gesture recognition system for the Korean sign language (KSL) IEEE Trans. Syst. Man Cybernet. 26 2 1996 354 359
13. M.B. Waldron, and S. Kim Isolated ASL sign recognition system for deaf persons IEEE Trans. Rehabilitation Eng. 3 3 1995 261 271
14. K. Grobel, and M. Assan Isolated sign language recognition using hidden Markov models Proceedings of the International Conference on System, Man and Cybernetics 1997 162 167
15. M. Assan, and K. Grobel Video-based sign language recognition using hidden Markov models Proceedings of the International Gesture Workshop 1997 97 109
16. T. Starner, J. Weaver, and A. Pentland Real-time American sign language recognition using desk and wearable computer based video IEEE Trans. Pattern Anal. Mach. Intell. 20 12 1998 1371 1375
17. B. Bauer, and H. Hienz Relevant features for video-based continuous sign language recognition Proceedings of the Fourth International Conference on Automatic Face and Gesture Recognition 2000 440 445
18. B. Bauer, and K.F. Kraiss Towards an automatic sign language recognition system using subunits Proceedings of the International Gesture Workshop 2001 64 75
19. R.H. Liang, and M. Ouhyoung A real-time continuous gesture recognition system for sign language Proceedings of the Third International Conference on Automatic Face and Gesture Recognition 1998 558 565
20. H. Sagawa, and M. Takeuchi A method for recognizing a sequence of sign language words represented in a Japanese sign language sentence Proceedings of the Fourth International Conference on Automatic Face and Gesture Recognition 2000 434 439
21. C. Vogler, and D. Metaxas Toward scalability in ASL recognition breaking down signs into phonemes Proceedings of the International Gesture Workshop 1999 400 404
22. C. Vogler, and D. Metaxas A framework for recognizing the simultaneous aspects of American sign language Comput. Vis. Image Und. 81 3 2001 358 384
23. W. Gao, J.Y. Ma, J.Q. Wu, and C.L. Wang Sign language recognition based on HMM/ANN/DP Int. J. Pattern Recognition Artif. Intell. 14 5 2000 587 602
24. W. Gao, J.Y. Ma, and X.L. Chen HandTalker A multimodal dialog system using sign language and 3-D virtual human Proceedings of the Third International Conference on Multimodal Interface 2000 564 571
25. P. Vamplew, and A. Adams Recognition of sign language gestures using neural networks Austral. J. Intell. Inform. Process. Syst. 5 2 1998 94 102
26. G.L. Fang, W. Gao, and J.Y. Ma Signer-independent sign language recognition based on SOFM/HMM Proceedings of the IEEE ICCV Workshop Recognition, Analysis and Tracking of Faces and Gestures in Real-time Systems 2001 90 95
27. G.L. Fang, and W. Gao A SRN/HMM system for signer-independent continuous sign language recognition Proceedings of the Fifth International Conference on Automatic Face and Gesture Recognition 2002 312 317
28. W.C. Stokoe, Sign language structure: an outline of the visual communication system of the American deaf. Studies in Linguistics: Occasional Papers 8 (revised 1978), Linstok Press, University of Buffalo, 1960.
29. T. Kohonen The self-organizing maps Proc. IEEE 78 9 1990 1464 1480
30. R. Rabiner A tutorial on hidden Markov models and selected applications in speech recognition, Proc. IEEE 77 2 1989 257 285
31. Y. Bengio, R.D. Mori, G. Flammia, and R. Kompe Global optimization of a neural network-hidden Markov model hybrid IEEE Trans. Neural Networks 3 2 1992 252 259
32. H. Bourlard, and N. Morgan Continuous speech recognition by connectionist statistical methods IEEE Trans. Neural Networks 4 6 1993 893 909
33. D. Albesano, R. Gemello, and F. Mana Hybrid HMM-NN modeling of stationary-transitional units for continuous speech recognition Inf. Sci. 123 1 2000 3 11
34. E. Trentin, and M. Gori A survey of hybrid ANN/HMM models for automatic speech recognition Neurocomputing 37 1 2000 91 126
35. X.L. Li, M. Parizeau, and R. Plamondon Training hidden Markov models with multiple observations - a combinatorial method IEEE Trans. Pattern Anal. Mach. Intell. 22 4 2000 371 377
36. C. Leggetter, and P. Woodland Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models Comput. Speech Lang. 9 2 1995 171 186
37. M.I. Jordan, Serial order: a parallel distributed processing approach, ICS Report 8604, Institute for Cognitive Science, University of California, San Diego, 1986.
38. J.L. Elman Finding structure in time Cognitive Sci. 14 2 1990 179 211
39. T. Robinson An application of recurrent nets to phone probability estimation IEEE Trans. Neural Networks 5 2 1994 298 305
40. A. Senior, and A.J. Robinson Forward-backward retraining of recurrent neural networks Adv. Neural Inf. Process. Syst. 8 1996 743 749
41. K. Murakami, and H. Taguchi Gesture recognition using recurrent neural networks Proceedings of the CHI'91 Human Factors in Computing Systems 1991 237 242
42. A. Corradini Real-time gesture recognition by means of hybrid recognizers Proceedings of the International Gesture Workshop 2001 34 46
43. P.J. Werbos Backpropagation through time what it does and how to do it Proc. IEEE 78 10 1990 1550 1560
44. S.X. Kate Estimation of probabilities from sparse data for the language model component of a speech recognizer IEEE Trans. Acoust. Speech Signal Process. 35 3 1987 400 401