Spatio-temporal feature-extraction techniques for isolated gesture recognition in Arabic Sign Language

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 37, Issue 3, 2007, Pages 641-650

  Shanableh, Tamer ^a   Assaleh, Khaleh ^a   Al Rousan, M ^b  

^a AMERICAN UNIVERSITY OF SHARJAH   (United Arab Emirates)

^b JORDAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Jordan)

Author keywords

Feature extraction; Motion analysis; Pattern classification; Visual languages

Indexed keywords

BAYESIAN NETWORKS; FORMAL LANGUAGES; GESTURE RECOGNITION; HIDDEN MARKOV MODELS; IMAGE CLASSIFICATION; MOTION ESTIMATION;

BIDIRECTIONAL PREDICTIONS; K NEAREST NEIGHBOR; SIGN LANGUAGES; VIDEO SEQUENCE;

FEATURE EXTRACTION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; CULTURAL ANTHROPOLOGY; GESTURE; HUMAN; METHODOLOGY; SIGN LANGUAGE;

ALGORITHMS; ARAB WORLD; ARTIFICIAL INTELLIGENCE; GESTURES; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; SIGN LANGUAGE;

EID: 34249014321     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2006.889630     Document Type: Article

References (30)

1. J. S. Kim, W. Jang, and Z. Bien, "A dynamic gesture recognition system for the Korean sign language (KSL)," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 26, no. 2, pp. 354-359, Apr. 1996.
2. C. Wang, W. Gao, and Z. Xuan, "A real-time large vocabulary continuous recognition system for chinese sign language," in Proc. IEEE Pacific Rim Conf. Multimedia, 2001, pp. 150-157.
3. O. Al-Jarrah and A. Halawani, "Recognition of gestures in arabic sign language using neuro-fuzzy systems," Artif. Intell., vol. 133, no. 1/2, pp. 117-138, Dec. 2001.
4. M. Al-Rousan and M. Hussain, "Automatic recognition of arabic sign language finger spelling," Int. J. Comput. Appl., vol. 8, no. 2, pp. 80-88, Jun. 2001.
5. K. Assaleh and M. Al-Rousan, "Recognition of arabic sign language alphabet using polynomial classifiers," EURASIP J. Appl. Signal Process., vol. 2005, no. 13, pp. 2136-2145, 2005.
6. T. Starner, J. Weaver, and A. Pentland, "Real-time American sign language recognition using desk and wearable computer based video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 12, pp. 1371-1375, Dec. 1998.
7. H. Matsuo, S. Igi, S. Lu, Y. Nagashima, Y. Takata, and T. Teshima, "The recognition algorithm with noncontact for Japanese sign language using morphological analysis," in Proc. Int. Gesture Workshop, 1997, pp. 273-284.
8. S. S. Fels and G. E. Hinton, "Glove-talk: A neural network interface between a data-glove and a speech synthesizer," IEEE Trans. Neural Netw., vol. 4, no. 1, pp. 2-8, Jan. 1993.
9. M. W. Kadous, "Machine recognition of auslan signs using powergloves: Toward large-lexicon recognition of sign language," in Proc. Workshop Integr: Gesture Lang. Speech, 1996, pp. 165-174.
10. K. Grobel and M. Assan, "Isolated sign language recognition using hidden Markov models," in Proc. Int. Conf. Syst., Man Cybern., 1997, pp. 162-167.
11. B. Bauer and H. Hienz, "Relevant features for video-based continuous sign language recognition," in Proc. 4th Int. Conf. Autom. Face Gesture Recog., 2000, pp. 440-445.
12. R. H. Liang and M. Ouhyoung, "A real-time continuous gesture recognition system for sign language," in Proc. 3rd Int. Conf. Autom. Face Gesture Recog., 1998, pp. 558-565.
13. C. Ong and S. Ranganath, "Automatic sign language analysis: A survey and the future beyond lexical meaning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 6, pp. 873-891, Jun. 2005.
14. N. Tanibata, N. Shimada, and Y. Shirai, "Extraction of hand features for recognition of sign language words," in Proc. Int. Conf. Vis. Interface, 2002, pp. 391-398.
15. C. Vogler and D. Metaxas, "Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods," in Proc. IEEE Int. Conf. Syst., Man Cybern., 1997, pp. 156-161.
16. Y. Cui and J. Weng, "Appearance-based hand sign recognition from intensity image sequences," Comput. Vis. Image Underst., vol. 78, no. 2, pp. 157-176, 2000.
17. T. Kobayashi and S. Haruyama, "Partly-hidden Markov model and its application to gesture recognition," in Proc. Int. Conf. Acoust., Speech, and Signal Process., 1997, vol. 4, pp. 3081-3084.
18. B. Bauer and K. F. Kraiss, "Video-based sign recognition using self-organizing subunits," in Proc. Int. Conf. Pattern Recog., 2002, vol. 2, pp. 434-437.
19. C.-L. Huang and W.-Y. Huang, "Sign language recognition using model-based tracking and a 3D hopfield neural network," Mach. Vis. Appl., vol. 10, no. 5/6, pp. 292-307, Apr. 1998.
20. M.-H. Yang, N. Ahuja, and M. Tabb, "Extraction of 2-D motion trajectories and its application to hand gesture recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 8, pp. 1061-1074, Aug. 2002.
21. MPEG-4, Information Technology, Coding of Audio-Visual Objects, Part 10: Advanced Video Coding, ISO/IEC 14496-10, 2005.
22. P. Chen, "Fully scalable subband/wavelet coding," Ph.D. dissertation, Rensselaer Polytechnic Inst., Troy, NY, May 2003.
23. J.-R. Ohm, M. Schaar, and J. Woods, "Interframe wavelet coding - Motion picture representation for universal scalability," Signal Process. Image Commun., vol. 19, no. 9, pp. 877-908, Oct. 2004.
24. S. Jeannin and A. Divakaran, "MPEG-7 visual motion descriptors," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 6, pp. 720-724, Jun. 2001.
25. MPEG-2, Generic Coding of Moving Pictures and Associated Audio Information: Video, ISO/IEC 13818-2, Nov. 1994.
26. R. Gonzalez and R. Woods, Digital Image Processing, 2nd ed. Englewood Cliffs, NJ: Prentice-Hall, 2002.
27. C.-S. Lee, G. T. Park, J.-S. Kim, Z. Bien, W. Jang, and S.-K. Kim, "Real-time recognition system of Korean sign language based on elementary components," in Proc. 6th IEEE Int. Conf. Fuzzy Syst., Barcelona, Spain, Jul. 1997, pp. 1463-1468.
28. F.-S. Chen, C.-M. Fu, and C.-L. Huang, "Hand gesture recognition using a real-time tracking method and hidden Markov models," Image Vis. Comput., vol. 21, no. 8, pp. 745-758, 2003.
29. K. R. Rao and P. Yip, Discrete Cosine Transform: Algorithms, Advantages, Applications. New York: Academic, Aug. 1990.
30. Sharjah City for Humanitarian Services (SCHS), Local charity Sharjah, UAE. [Online]. Available: http://www.sharjah-welcome.com/schs/about/