Recognitionwith raw canonical phonetic movement and handshape subunits on videos of continuous Sign Language

Proceedings - International Conference on Image Processing, ICIP

Volumn , Issue , 2012, Pages 1413-1416

  Theodorakis, Stavros ^a   Pitsikalis, Vassilis ^a   Rodomagoulakis, Isidoros ^a   Maragos, Petros ^a  

^a NATIONAL TECHNICAL UNIVERSITY OF ATHENS   (Greece)

Author keywords

Automatic Data Driven Phonetic Lexicon; Automatic Sign Language (SL) Recognition; Greek SL; Movement Handshape Integration; Phonetic Models

Indexed keywords

AUTOMATIC ANALYSIS; AUTOMATIC DATA-DRIVEN PHONETIC LEXICON; AUTOMATIC RECOGNITION; GREEK SL; MULTI-STREAM; SIGN LANGUAGE; VISUAL FEATURE EXTRACTION; VISUAL-PROCESSING;

HIDDEN MARKOV MODELS; IMAGE PROCESSING;

LINGUISTICS;

EID: 84875837663     PISSN: 15224880     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICIP.2012.6467134     Document Type: Conference Paper

References (26)

1. http://www.dictasign.eu.
2. P. Buehler, M. Everingham, and A. Zisserman, "Learning sign language by watching TV (using weakly aligned subtitles)," in CVPR,2009, pp. 2961-2968.
3. R. Bowden, D. Windridge, T. Kadir, A. Zisserman, and M. Brady, "A linguistic feature vector for the visual interpretation of sign language," in ECCV, 2004.
4. B. Bauer and K. F. Kraiss, "Towards an automatic sign language recognition system using subunits," in Proc. of Int'l Gesture Workshop, 2001, pp. 64-75.
5. G. Fang, X. Gao, W. Gao, and Y. Chen, "A novel approach to automatically extracting basic units from chinese sign language," in ICPR, 2004.
6. J. Han, G. Awad, and A. Sutherland, "Modelling and segmenting subunits for sign language recognition based on hand motion analysis," Pat. Rec. Lett., vol. 30, no. 6, pp. 623-633, 2009.
7. P. Yin, T. Starner, H. Hamilton, I. Essa, and J. Rehg, "Learning the basic units in american sign language using discriminative segmental feature selection," in Proc. ICASSP, 2009, pp. 4757-4760.
8. V. Pitsikalis, S. Theodorakis, and P. Maragos, "Data-driven sub-units and modeling structure for continuous sign language recognition with multiple cues," in LREC Wrk Representation and Proc. of SL: Corpora and SL Technologies, 2010.
9. C. Vogler and D. Metaxas, "A framework for recognizing the simultaneous aspects of american sign language," CVIU, vol. 81, no. 3, pp. 358-384, 2001.
10. L. Ding and A. Martinez, "Modelling and recognition of the linguistic components in american sign language," Im. and Vis. Comp., 27, pp. 1826-1844, 2009.
11. V. Pitsikalis, S. Theodorakis, C. Vogler, and P.Maragos, "Advances in phoneticsbased sub-unit modeling for transcription alignment and sign language recognition," in CVPR Workshop Gesture Recognition, 2011.
12. U. Agris, J. Zieren, U. Canzler, B. Bauer, and K. F. Kraiss, "Recent developments in visual sign language recognition," Univ. Acc. Inf. Soc., 6, pp. 323-362, 2008.
13. WC Stokoe, "Sign language structure," Annual Review of Anthropology, vol. 9, no. 1, pp. 365-390, 1980.
14. S. K. Liddell and R. E. Johnson, "American sign language: The phonological base," Sign Language Studies, vol. 64, pp. 195 - 277, 1989.
15. C. Vogler and D. Metaxas, "Handshapes and movements: Multiple-channel american sign language recognition," in Gesture Workshop, 2003, pp. 247-258.
16. P. Dreuw, J. Forster, T. Deselaers, and H. Ney, "Efficient approximations to model-based joint tracking and recognition of continuous sign language," in Proc. IEEE Int'l Conf. on Autom. Face & Gesture Rec., 2008, pp. 1-6.
17. P. Dreuw, D. Rybach, T. Deselaers, M. Zahedi, and H. Ney, "Speech recognition techniques for a sign language recognition system," in Interspeech, 2007.
18. R. Yang, S. Sarkar, and B. Loeding, "Handling movement epenthesis and hand segmentation ambiguities in continuous sign language recognition using nested dynamic programming," IEEE Trans. PAMI, vol. 32, no. 3, pp. 462-477, 2010.
19. G. Fang, W. Gao, and D. Zhao, "Large-vocabulary continuous sign language recognition based on transition-movement models," IEEE Trans. SMC, 37, 2007.
20. H. D. Yang, S. Sclaroff, and S.W. Lee, "Sign language spotting with a threshold model based on conditional random fields," IEEE Trans. PAMI, 31, 2009.
21. A. Roussos, S. Theodorakis, V. Pitsikalis, and P. Maragos, "Hand tracking and Affine Shape-Appearance Handshape Sub-Units in Continuous Sign Language recognition," in Workshop on Sign, Gesture and Activity (SGA), ECCV, 2010.
22. A. Roussos, S. Theodorakis, V. Pitsikalis, and P. Maragos, "Affine-invariant modeling of shape-appearance images applied on sign language handshape classification," in Proc. Int'l Conf. on Image Processing, 2010.
23. S. Theodorakis, V. Pitsikalis, and P. Maragos, "Advances in dynamic-static integration of movement and handshape cues for sign language recognition," in Gesture Workshop (GW-2011), Greece, Athens, May 2011, 2011.
24. S. Prillwitz, R. Leven, H. Zienert, R. Zienert, T. Hanke, and J. Henning, "Ham- NoSys. Version 2.0," Int'l Studies on SL and Communication of the Deaf, 1989.
25. S. Theodorakis, V. Pitsikalis, and P. Maragos, "Dynamic vs. Static Sub-Unit Modeling for Continuous Sign Language Recognition with Movement-Position Cues," IEEE Trans. Sys. Man Cyb. Part B, under review, 2012.
26. L. R. Rabiner, "A tutorial on Hidden Markov Models and selected applications in speech recognition," Proc. of the IEEE, vol. 77, pp. 257-286, 1989.