SignTutor: An interactive system for sign language tutoring

IEEE Multimedia

Volumn 16, Issue 1, 2009, Pages 81-92

  Aran, Oya ^a   Ari, Ismail ^a   Akarun, Lale ^a   Sankur, Bülent ^a   Benoit, Alexandre ^b   Caplier, Alice ^b   Campr, Pavel ^c   Carrillo, Ana Huerta ^d   Fanard, François Xavier ^e  

^a BOGAZICI UNIVERSITY   (Turkey)

^b GIPSA LAB   (France)

^c UNIVERSITY OF WEST BOHEMIA   (Czech Republic)

^d UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^e UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

Author keywords

Cameras; Data mining; Feature extraction; Handicapped aids; Head; Pixel; Shape

Indexed keywords

HANDICAPPED AIDS; HEAD; INTERACTIVE SYSTEMS; LANGUAGE LEARNING; MULTI MODAL FEEDBACKS; SHAPE; SIGN LANGUAGES;

CAMERAS; INFORMATION MANAGEMENT; LINGUISTICS; PIXELS;

FEATURE EXTRACTION;

EID: 60349085542     PISSN: 1070986X     EISSN: None     Source Type: Journal    
DOI: 10.1109/MMUL.2009.17     Document Type: Article

References (20)

1. S.K. Liddell, Grammar, Gesture, and Meaning in American Sign Language Cambridge Univ. Press, 2003.
2. W.C. Stokoe, "Sign Language Structure: An Outline of the Visual Communication Systems of the American Deaf," J. Deaf Studies and Deaf Education, vol. 10, no. 1, 2005, pp. 3-37.
3. S.C.W. Ong and S. Ranganath, "Automatic Sign Language Analysis: A Survey and the Future Beyond Lexical Meaning," IEEE Trans. Pattern Analysis and Machine Learning, vol. 27, no. 6, 2005, pp. 873-891.
4. F.K.H. Quek, "Toward a Vision-Based Hand Gesture Interface," Proc. Virtual Reality Software and Technology Conf., G. Singh, S.K. Feiner, and D. Thalmann, eds., World Scientific, 1994, pp. 17-31.
5. Y. Wu and T.S. Huang, "Hand Modeling, Analysis, and Recognition for Vision Based Human Computer Interaction," IEEE Signal Processing Mag., vol. 18, no. 3, 2001, pp. 51-60.
6. T. Starner and A. Pentland, Realtime American Sign Language Recognition from Video Using Hidden Markov Models, tech. report, MIT Media Laboratory, 1996.
7. C. Vogler and D. Metaxas, "ASL Recognition Based on a Coupling between HMMs and 3D Motion Analysis," Proc. Int'l Conf. Computer Vision (ICCV), IEEE CS Press, 1998, p. 363.
8. G. Fang, W. Gao, and D. Zhao, "Large-Vocabulary Continuous Sign Language Recognition Based on Transition-Movement Models," IEEE Trans. Systems, Man and Cybernetics, pt. A, vol. 37, no. 1, 2007, pp. 1-9.
9. K.W. Ming and S. Ranganath, "Representations for facial expressions," Proc. Int'l Conf. Control Automation, Robotics, and Vision, vol. 2, IEEE Press, 2002, pp. 716-721.
10. U.M. Erdem and S. Sclaroff, "Automatic Detection of Relevant Head Gestures in American Sign Language Communication," Proc. Int'l Conf. Pattern Recognition, vol. 1, IEEE CS Press, 2002, pp. 460-463.
11. S. Jayaram et al., "Effect of Color Space Transformation, the Illuminance Component, and Color Modeling on Skin Detection," IEEE Conf. Computer Vision and Pattern Recognition (CVPR), IEEE CS Press, 2004, pp. 813-818.
12. O. Aran and L. Akarun, "Recognizing Two Handed Gestures with Generative, Discriminative and Ensemble Methods via Fisher Kernels," Proc. Int'l Workshop Multimedia Content Representation, Classification, and Security, LNCS 4105, Springer-Verlag, 2006, pp. 159-166.
13. I. Fasel et al., Machine Perception Toolbox, API Specification for MPT-1.0, UCSD Machine Perception Lab.; http://mplab.ucsd.edu/grants/ project1/free-software/MPTWebSite/API/.
14. W. Beaudot, The Neural Information Processing in the Vertebrate Retina: A Melting Pot of Ideas for Artificial Vision, doctoral dissertation, Dept. Computer Science, INPG (France), 1994.
15. A. Benoit and A. Caplier, "Head Nods Analysis: Interpretation of Non Verbal Communication Gestures," Proc. IEEE Int'l Conf. Image Processing (ICIP), vol. 3, IEEE Press, 2005, pp. 425-428.
16. A.B. Torralba and J. Herault, "An Efficient Neuromorphic Analog Network for Motion Estimation," IEEE Trans. Circuits and Systems-I, special issue on bio-inspired processors and CNNs for vision, vol. 46, no. 2, 1999, pp. 269-280.
17. L.R. Rabiner, "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Proc. IEEE, vol. 77, no. 2, 1989, pp. 257-285.
18. I.S. Pandzic and R. Forchheimer, MPEG-4 Facial Animation: The Standard, Implementation and Applications, Wiley, 2002.
19. K. Balci, "Xface: Open Source Toolkit for Creating 3D Faces of an Embodied Conversational Agent," Proc. 5th Int'l Symp. SmartGraphics LNCS 3638, Springer-Verlag, 2005, pp. 263-266.
20. S.C. Ong, S. Ranganath, and Y. Venkatesha, "Understanding Gestures with Systematic Variations in Movement Dynamics," Pattern Recognition, vol. 39, no. 9, 2006, pp. 1633-1648.