Sign language recognition with the kinect sensor based on conditional random fields

Sensors (Switzerland)

Volumn 15, Issue 1, 2015, Pages 135-147

  Yang, Hee Deok ^a  

^a Chosun University   (South Korea)

Author keywords

BoostMap embedding; Conditional random field; Sign language recognition

Indexed keywords

IMAGE SEGMENTATION; VISUAL LANGUAGES;

BOOSTMAP EMBEDDING; CONDITIONAL RANDOM FIELD; DEPTH INFORMATION; EMBEDDING METHOD; KINECT SENSORS; SIGN LANGUAGE; SIGN LANGUAGE RECOGNITION; THREE-DIMENSIONAL (3D) SPACE;

RANDOM PROCESSES;

EID: 84919782569     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s150100135     Document Type: Article

References (18)

1. Yang, H.-D.; Sclaroff, S.; Lee, S.-W. Sign language spotting with a threshold model based on conditional random fields. IEEE Trans. Pattern Anal. Mach. Intell. 2009, 31, 1264-1277.
2. Yang, H.-D.; Lee, S.-W. Simultaneous spotting of signs and fingerspellings based on hierarchical conditional random fields and boostmap embeddings. Pattern Recognit. 2010, 43, 2858-2870.
3. Yang, H.-D.; Lee, S.-W. Robust sign language recognition by combining manual and non-manual features based on conditional random field and support vector machine. Pattern Recognit. Lett. 2013, 34, 2051-2056.
4. Lahamy, H.; Lichti, D.D. Towards real-time and rotation-invariant American Sign Language alphabet recognition using a range camera. Sensors 2012, 12, 14416-14441.
5. Ren, Z.; Yuan, J.; Meng, J.; Zhang, Z. Robust part-based hand gesture recognition using kinect sensor. IEEE Trans. Multimed. 2013, 15, 1110-1120.
6. Palacios, J.; Sagüés, C.; Montijano, E.; Llorente, S. Human-computer interaction based on hand gestures using RGB-D sensors. Sensors 2013, 13, 11842-11860.
7. Zhang, S.; He, W.; Yu, Q.; Zheng, X. Low-Cost Interactive Whiteboard Using the Kinect. In Proceedings of the International Conference on Image Analysis and Signal Processing, Huangzhou, China, 9-11 November 2012; pp. 1-5.
8. Chang, Y.J.; Chen, S.F.; Huang, J.D. A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities. Res. Dev. Disabil. 2011, 32, 2566-2570.
9. Ramey, A.; Gonzalez-Pacheco, V.; Salichs, M.A. Integration of a Low-Cost RGB-D Sensor in a Social Robot for Gesture Recognition. In Proceedings of the 6th ACM/IEEE International Conference on Human-Robot Interaction, Lausanne, Switzerland, 6-9 March 2011; pp. 229-230.
10. Van den Bergh, M.; Carton, D.; De Nijs, R.; Mitsou, N.; Landsiedel, C.; Kuehnlenz, K.; Wollherr, D.; van Gool, L.; Buss, M. Real-time 3D hand gesture interaction with a robot for understanding directions from humans. In Proceedings of the IEEE RO-MAN, Atlanta, GA, USA, 31 July-3 August 2011; pp. 357-362.
11. Xu, D.; Chen, Y.L.; Lin, C.; Kong, X.; Wu, X. Real-Time Dynamic Gesture Recognition System Based on Depth Perception for Robot Navigation. In Proceedings of the IEEE International Conference on Robotics and Biomimetics, Guangzhou, China, 11-14 December 2012; pp. 689-694.
12. Zafrulla, Z.; Brashear, H.; Starner, T.; Hamilton, H.; Presti, P. American sign language recognition with the kinect. In Proceedings of the International Conference on Multimodal Interfaces, Alicante, Spain, 14-18 November 2011; pp. 279-286.
13. Chai, X.; Li, G.; Lin, Y.; Xu, Z.; Tang, Y.; Chen, X.; Zhou, M. Sign Language Recognition and Translation with Kinect. In Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition, Shanghai, China, 22-26 April 2013.
14. Cheng, H.; Dai, Z.; Liu, Z. Image-to-class dynamic time warping for 3D hand gesture recognition. In Proceedings of IEEE Conference on Multimedia and Expo, San Jose, CA, USA, July 15-19 2013; pp. 1-16.
15. Moreira Almeida, S.; Guimarães, F.; Arturo Ramírez, J. Extraction in Brazilian Sign Language Recognition based on phonological structure and using RGB-D sensors. Expert Syst. Appl. 2014, 41, 7259-7271.
16. Shotton, J.; Fitzgibbon, A.; Cook, M.; Sharp, T.; Finocchio, M.; Moore, R.; Kipman, A.; Blake, A. Real-time Human Pose Recognition in Parts from Single Depth Images. In Proceedings of IEEE Conference on CVPR, Colorado Springs, CO, USA, 20-25 June 2011; pp. 1297-1304.
17. Fischler, M.A.; Bolles, R.C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Comm. ACM 1981, 24, 381-395.
18. Athitsos, V.; Alon, J.; Sclaroff, S.; Kollios, G. Boostmap: An embedding method for efficient nearest neighbor retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30, 89-104.