Polish sign language words recognition with Kinect

2013 6th International Conference on Human System Interactions, HSI 2013

Volumn , Issue , 2013, Pages 219-226

  Oszust, Mariusz ^a   Wysocki, Marian ^a  

^a RZESZOW UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

[No Author keywords available]

Indexed keywords

CROSS-VALIDATION TESTS; DATA DIVISION; DYNAMIC TIME WARPING; FEATURE VECTORS; NEAREST-NEIGHBOUR CLASSIFIER; RECOGNITION ACCURACY; SETS OF FEATURES; SIGN LANGUAGE;

HUMAN COMPUTER INTERACTION;

EID: 84883672885     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HSI.2013.6577826     Document Type: Conference Paper

References (46)

1. D. J. Lin, V. Le, and T.S. Huang, "Human-computer interaction", Visual Analysis of Humans, pp. 493-510, 2011.
2. J. Marnik, S. Samolej, T. Kapuscinski, M. Oszust, and M. Wysocki, "Using computer graphics, vision and gesture recognition tools for building interactive systems supporting therapy of children", Z. Hippe, J. Kulikowski, T. Mroczek (eds.) Human Computer Systems Interaction: Backgrounds and Applications. Advances in Intelligent and Soft Computing, Springer Berlin / Heidelberg vol. 98, 2012, pp. 539-553.
3. V. Kosmidou, P. Petrantonakis, and L. J. Hadjileontiadis, "Enhanced sign language recognition using weighted intrinsic-mode entropy and signer's level of deafness", IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 41, 2011, no. 6, pp. 1531-1543.
4. W. Gao, G. Fang, D. Zhao, and Y. Chen, "A Chinese sign language recognition system based on SOFM/SRN/HMM", Pattern Recognition, vol. 37, 2004, no. 12, pp. 2389-2402.
5. C. Vogler and D. N. Metaxas, "Toward scalability in ASL recognition: Breaking down signs into phonemes", (Eds.) A. Braffort, R. Gherbi, S. Gibet, J. Richardson, D. Teil, Gesture Workshop. Lecture Notes in Computer Science, Springer, vol. 1739, 1999, pp. 211-224.
6. M. Flasinski and S. Myslinski, "On the use of graph parsing for recognition of isolated hand postures of Polish sign language", Pattern Recognition, vol. 43, 2010, no. 6, pp. 2249-2264.
7. S. C. W. Ong and S. Ranganath: "Automatic sign language analysis: a survey and the future beyond lexical meaning", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, 2005, no. 6, pp. 873-891.
8. G. Awad, J. Han, and A. Sutherland, "Novel boosting framework for subunit-based sign language recognition", Proceedings of the 16th IEEE international conference on Image processing, ICIP'09, IEEE Press, Piscataway, NJ, 2009, pp. 2693-2696.
9. Primesense, http://www.primesense.com/casestudies/kinect/, accessed on 10.01.2013.
10. Z. Ren, J. Meng, J. Yuan, and Z. Zhang, "Robust Hand Gesture Recognition with Kinect Sensor", in proceeding of the 19th International Conference on Multimedia, Scottsdale, AZ, USA, 2011.
11. Z. Ren, J. Meng, and J. Yuan, "Depth camera based hand gesture recognition and its applications in Human-Computer-Interaction", 8th International Conference on Information, Communications and Signal Processing (ICICS), 2011, pp. 1-5.
12. T. Wan, Y. Wang, and J. Li, "Hand gesture recognition system using depth data", 2nd International Conference on Consumer Electronics, Communications and Networks (CECNet), 2012, pp. 1063-1066.
13. L. Kam, J. Konrad, and P. Ishwar, "A gesture-driven computer interface using Kinect", 2012 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI), 2012, pp.185-188.
14. Y. Li, "Hand gesture recognition using Kinect", 2012 IEEE 3rd International Conference on Software Engineering and Service Science (ICSESS), 2012, pp. 196-199.
15. C. Keskin, F. Kirac, Y.E. Kara, and L. Akarun, "Real time hand pose estimation using depth sensors," in 2011 IEEE International Conference Computer Vision Workshops (ICCV Workshops), 2011, pp. 1228-1234.
16. K.K. Biswas and S.K. Basu, "Gesture recognition using Microsoft Kinect", in 5th International Conference on Automation, Robotics and Applications (ICARA), 2011, pp. 100-103.
17. O. Patsadu, C. Nukoolkit, and B. Watanapa, "Human gesture recognition using Kinect camera", 2012 International Joint Conference on Computer Science and Software Engineering (JCSSE), 2012, pp. 28-32.
18. Y. Wang, C. Yang, X. Wu, S. Xu, and H. Li, "Kinect Based Dynamic Hand Gesture Recognition Algorithm Research", 4th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC), vol. 1, 2012, pp. 274-279.
19. Y-J. Chang, S-F. Chen, and J-D. Huang, "A Kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities", Research in Developmental Disabilities, vol. 32, 2011, no. 6, pp. 2566-2570.
20. D. Capilla, "Sign Language Translator using Microsoft Kinect XBOX 360", MSc Thesis Department of Electrical Engineering and Computer Science Computer Vision Lab University of Tennessee, Knoxville, USA , 2012.
21. S. Lang, M. Block, and R. Rojas, "Sign Language Recognition Using Kinect", In Artificial Intelligence and Soft Computing, (Eds) L. Rutkowski, M. Korytkowski, R. Scherer, R. Tadeusiewicz, L. Zadeh, J. Zurada. Lecture Notes in Computer Science, Springer Berlin Heidelberg vol. 7267, 2012, pp. 394-402.
22. Z. Zafrulla, H. Brashear, T. Starner, H. Hamilton, and P. Presti, "American sign language recognition with the Kinect", in Proc. ICMI, 2011, pp. 279-286.
23. J. Suarez and R.R. Murphy, "Hand gesture recognition with depth images: a review", IEEE Press, 2012, pp. 411-417.
24. D. Uebersax,J. Gall, M.V. den Bergh, and L. J. V. Gool, "Real-time sign language letter and word recognition from depth data" In ICCV Workshops, IEEE press, 2011, pp. 383-390.
25. M. Zahedi and A. R. Manashty, "Robust sign language recognition system using ToF depth cameras", Computing Research Repository-CORR, abs/1105.0, 2011.
26. S. Theodoridis and K. Koutroumbas, "Pattern Recognition, Fourth Edition", Academic Press, 2008.
27. H. Cooper, "Sign Language Recognition: Generalising to More Complex Corpora", Centre For Vision Speech and Signal Processing, PhD thesis, University Of Surrey, 2010.
28. J. Han, G. Awad, and A. Sutherland, "Modelling and segmenting subunits for sign language recognition based on hand motion analysis", Pattern Recognition Letters, vol. 30, 2009, no. 6, pp. 623-633.
29. V. Athitsos, C. Neidle, S. Sclaroff, J. Nash, R. Stefan, A. Thangali, H. Wang, and Q. Yuan, "Large lexicon project: American sign language video corpus and sign language indexing/retrieval algorithms", 2010.
30. M. Oszust and M. Wysocki, "Modelling and recognition of signed expressions using subunits obtained by data-driven approach", Ramsay A., Agre G. (eds.) AIMSA, Lecture Notes in Computer Science, Springer, vol. 7557, 2012, pp. 315-324.
31. Q. Wang, X. Chen, L.-G. Zhang, C. Wang, and W. Gao, "Viewpoint invariant sign language recognition", Computer Vision and Image Understanding, vol. 108, 2007, no. 1-2, pp. 87-97.
32. J. Hendzel, "Polish Sign Language Dictionary" (in Polish). Publishing House Pojezierze, 1986.
33. Microsoft Kinect, http://www.microsoft.com/en-us/kinectforwindows/, accessed 2.02.2013.
34. N. Burrus, http://nicolas.burrus.name/index.php/Research/Kinect Calibration, accessed 02.02.2013.
35. http://www.openni.org/, acessed 02.02.2013.
36. V. Vezhnevets, V. Sazonov, and A. Andreeva, "A survey on Pixel-Based skin color detection techniques", in Proceedings of the GraphiCon, 2003, pp. 85-92.
37. M. Wysocki, T. Kapuscinski, J. Marnik, and M. Oszust, "Vision-based Hand Gesture Recognition" (in Polish), Rzeszow University of Technology Publishing House, 2011.
38. KinectTCP, Temple University, https://sites.google.com/a/temple.edu/ kinecttcp/, accessed 02.02.2013
39. J. Wang, C. Zhang, W. Zhu, Z. Zhang, Z. Xiong, and P.A. Chou, "3D scene reconstruction by multiple structured-light based commodity depth cameras", in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, 2012, pp. 5429-5432.
40. R. Xu and D. Wunsch, "Clustering", Wiley-IEEE Press, 2009.
41. C.A. Ratanamahatana and E. Keogh, "Three Myths about Dynamic Time Warping Data Mining". In SIAM International Conference on Data Mining, 2005, pp. 506-510.
42. E. Keogh and J. Lin, "Hot sax: Efficiently finding the most unusual time series subsequence", Fifth IEEE International Conference on Data Mining, 2005, pp. 226-233.
43. T.-C. Fu, "A review on time series data mining", Engineering Applications of Artificial Intelligence, vol. 24, 2011, no. 1, pp. 164-181.
44. Y. Chen, E. Garcia, M. Gupta, R. Maya, A. Rahimi, and L. Cazzanti, "Similarity-based Classification: Concepts and Algorithms", Journal of Machine Learning Research, 2009, pp. 747-776.
45. U. Maulik and S. Bandyopadhyay, "Performance evaluation of some clustering algorithms and validity indices", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, 2002, no. 12, pp. 1650-1654.
46. MATLAB, Natick, Massachusetts: The MathWorks Inc., 2012.