Signing Exact English (SEE): Modeling and recognition

Pattern Recognition

Volumn 41, Issue 5, 2008, Pages 1638-1652

  Kong, W W ^a   Ranganath, Surendra ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Clustering; Gesture recognition; Handshape recognition; Linear discriminant analysis; Motion trajectory recognition; Sign language recognition; Vector quantization principal component analysis

Indexed keywords

CLUSTERING ALGORITHMS; DECISION TREES; DISCRIMINANT ANALYSIS; LINEAR CONTROL SYSTEMS; MAGNETIC RECORDING; PRINCIPAL COMPONENT ANALYSIS; VECTOR QUANTIZATION;

FISHER'S LINEAR DISCRIMINANT (FLD); HANDSHAPE RECOGNITION; LINEAR DISCRIMINANT ANALYSIS; MAGNETIC TRACKERS; MOTION TRAJECTORY RECOGNITION; SIGN LANGUAGE RECOGNITION; SIGNING EXACT ENGLISH (SEE);

GESTURE RECOGNITION;

EID: 38349182504     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2007.10.016     Document Type: Article

References (46)

1. Gustason G., and Zawolkow E. Signing Exact English (1995), Modern Sign Press Inc.
2. S.K. Liddell, R.E. Johnson, America Sign Language: the phonological base, in: Sign Language Studies, 1989, pp. 195-277 (Chapter 64).
3. Ong S.C.W., and Ranganath S. Automatic sign language analysis: a survey and the future beyond lexical meaning. IEEE Trans. Pattern Anal. Mach. Intell. 27 6 (2005) 873-891
4. Beale R., and Edwards A.D.N. Recognising postures and gestures using neural networks. In: Beale R., and Finlay J. (Eds). Neural Networks and Pattern Recognition in Human-Computer Interaction (1992), Ellis Horwood, New York 163-169
5. H. Hienz, K. Grobel, G. Beckers, Video-based handshape recognition using artificial neural networks, in: Fourth European Congress on Intelligent Techniques and Soft Computing, 1996, pp. 1659-1663.
6. J. Wu, W. Gao, The recognition of finger-spelling for Chinese sign language, in: Gesture and Sign Language in Human-Computer Interaction Gesture Workshop, vol. 2298, London, UK, 2001, pp. 96-100.
7. C. Oz, M. Leu, Recognition of finger spelling of American sign language with artificial neural network using position/orientation sensors and data glove, in: Proceedings of the Second International Symposium on Neural Networks, Chongqing, China, 2005, pp. 157-164.
8. Cui Y., and Weng J. Appearance-based hand sign recognition from intensity image sequences. Comput. Vision Image Understanding 78 2 (2000) 157-176
9. J.-W. Deng, H.T. Tsui, A novel two-layer PCA/MDA scheme for hand posture recognition, in: Proceedings of the 16th International Conference on Pattern Recognition, vol. 1, 2002, pp. 283-286.
10. E.-J. Ong, R. Bowden, A boosted classifier tree for hand shape detection, in: Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition, Seoul, Korea, 2004, pp. 889-894.
11. Iikura Y., and Yasuoka Y. Utilization of a best linear discriminant function for designing the binary decision tree. Int. J. Remote Sensing 12 1 (1991) 55-67
12. Li X.-B., et al. Multivariate decision trees using linear discriminants and tabu search. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 33 2 (2003) 194-205
13. Loh W.-Y., and Vanichsetakul N. Tree-structured classification via generalized discriminant analysis. J. Am. Stat. Assoc. 83 403 (1988) 715-728
14. Swets D.L., and Weng J. Hierarchical discriminant analysis for image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 21 5 (1999) 386-401
15. Waldron M.B., and Kim S. Isolated ASL sign recognition system for deaf persons. IEEE Trans. Rehabil. Eng. 3 3 (1995) 261-271
16. Vamplew P., and Adams A. Recognition of sign language gestures using neural networks. Aust. J. Intelligent Inf. Process. Syst. 5 2 (1998) 94-102
17. Yang M.-H., Ahuja N., and Tabb M. Extraction of 2D motion trajectories and its application to hand gesture recognition. IEEE Trans. Pattern Anal. Mach. Intell. 24 8 (2002) 1061-1074
18. Sagawa H., Takeuchi M., and Ohki M. Methods to describe and recognize sign language based on gesture components represented by symbols and numerical values. Knowl. Based Syst. 10 (1998) 287-294
19. M.W. Kadous, Machine recognition of Auslan signs using powergloves: towards large-lexicon recognition of sign languages, in: Proceedings of Workshop on the Integration of Gestures in Language and Speech, Wilmington Delaware, 1996, pp. 165-174.
20. T. Starner, A. Pentland, Visual recognition of American sign language using hidden Markov models, in: Proceedings of the First IEEE International Conference on Automatic Face and Gesture Recognition, Zurich, Switzerland, 1995, pp. 189-194.
21. T. Starner, J. Weaver, A. Pentland, Real-time American sign language recognition using desk and wearable computer based video, in: Proceedings of the IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, 1998, pp. 1371-1375.
22. B. Bauer, H. Hienz, Relevant features for video-based continuous sign language recognition, in: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, Grenoble, France, 2000, pp. 440-445.
23. B. Bauer, H. Hienz, K.-F. Kraiss, Video-based continuous sign language recognition using statistical methods, in: Proceedings of the International Conference on Pattern Recognition, vol. 2, Barcelona, Spain, 2000, pp. 463-466.
24. C. Vogler, D. Metaxas, Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods, in: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Orlando, FL, 1997, pp. 156-161.
25. C. Vogler, D. Metaxas, ASL recognition based on a coupling between HMMs and 3D motion analysis, in: Proceedings of the International Conference on Computer Vision, Mumbai, India, 1998, pp. 363-369.
26. C. Vogler, D. Metaxas, Parallel hidden Markov models for American sign language recognition, in: Proceedings of the International Conference on Computer Vision, Kerkyra, Greece, 1999, pp. 22-25.
27. C. Vogler, D. Metaxas, Towards scalability in ASL recognition: breaking down sign into phonemes, in: Gesture Workshop, Gif-sur-Yvette, France, 1999, pp. 211-224.
28. C. Vogler, D. Metaxas, Handshapes and movements: multiple-channel ASL recognition, in: Gesture Workshop, Genova, Italy, 2003, pp. 247-258.
29. C. Vogler, H. Sun, D. Metaxas, A framework for motion recognition with applications to American sign language and gait recognition, in: Proceedings of the Workshop on Human Motion, Austin, TX, 2000, pp. 33-38.
30. Bilmes J. What HMMs can do. IEICE Trans. Inf. Syst. E89-D 3 (2006) 869-891
31. S. Akyol, U. Canzler, An information terminal using vision based sign language recognition, in: Proceedings of the International ITEA Workshop on Virtual Home Environments, Paderborn, Germany, 2002, pp. 61-68.
32. L. Zhang, et al., Vision-based sign language recognition using sign-wise tied mixture HMM, in: Proceedings of the Sixth International Conference on Multimodal Interfaces, State College, PA, USA, 2004, pp. 198-204.
33. R. Cutler, L. Davis, View-based detection and analysis of periodic motion, in: Proceedings of the 14th IEEE International Conference on Pattern Recognition, Brisbane, Australia, 1998, pp. 495-500.
34. Cutler R., and Davis L. Robust real-time periodic motion detection, analysis, and applications. IEEE Trans. Pattern Anal. Mach. Intell. 22 8 (2000) 781-796
35. R. Polana, R. Nelson, Detecting activities, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, New York, USA, 1993, pp. 2-7.
36. P.S. Tsai, et al., Cyclic motion detection, Technical Report CS-TR-93-08, University of Central Florida, Orlando, FL, 1993.
37. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. second ed. (2001), Wiley, New York
38. W.W. Kong, S. Ranganath, 3-D hand trajectory recognition for signing exact English, in: Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition, Seoul, Korea, 2004, pp. 535-540.
39. Kambhatla N., and Leen T.K. Dimension reduction by local principal component analysis. Neural Comput. 9 (1997) 1493-1516
40. A. Pentland, B. Moghaddam, T. Starner, View-based and modular eigenspaces for face recognition, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 1994, pp. 84-91.
41. S. Srinivasan, K.L. Boyer, Head pose estimation using view based eigenspaces, in: Proceedings of the 16th International Conference on Pattern Recognition, Quebec, Canada, 2002, pp. 302-305.
42. ® Reference Manual, August 1998.
43. ® USER'S MANUAL, rev. c Edition, November 2002.
44. Broomhead D.S., and Lowe D. Multivariate functional interpolation and adaptive networks. Complex Syst. 2 (1988) 321-355
45. Moody J., and Darken C. Fast learning in networks of locally-tuned processing units. Neural Comput. 1 2 (1989) 281-294
46. Ong S.C.W., and Ranganath S. Understanding gestures with systematic variations in movement dynamics. Pattern Recognition 39 (2006) 1633-1648