Towards real-time and rotation-invariant American sign language alphabet recognition using a range camera

Sensors (Switzerland)

Volumn 12, Issue 11, 2012, Pages 14416-14441

  Lahamy, Hervé ^a   Lichti, Derek D ^a  

^a UNIVERSITY OF CALGARY   (Canada)

Author keywords

3D signature; Accuracy assessment; Posture recognition; Range camera; Rotation invariance; Segmentation; Tracking

Indexed keywords

3D SIGNATURE; ACCURACY ASSESSMENT; POSTURE RECOGNITION; RANGE CAMERAS; ROTATION INVARIANCE;

CAMERAS; IMAGE SEGMENTATION; SURFACE DISCHARGES; THREE DIMENSIONAL COMPUTER GRAPHICS;

ROTATION;

ALGORITHM; ARTICLE; HAND; HUMAN; PHOTOGRAPHY; PHYSIOLOGY; SIGN LANGUAGE; UNITED STATES;

ALGORITHMS; HAND; HUMANS; PHOTOGRAPHY; SIGN LANGUAGE; UNITED STATES;

EID: 84870545474     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s121114416     Document Type: Article

References (40)

1. Fu, Y.F.; Ho, C.S. A user-dependent easily-adjusted static finger language recognition system for handicapped aphasiacs. Appl. Artif. Intell. 2009, 23, 932-944.
2. Rashid, O.; Al-Hamadi, A.; Michaelis, B. A Framework for the Integration of Gesture and Posture Recognition Using HMM and SVM. In Proceedings of the International Conference on Intelligent Computing and Intelligent Systems, Shanghai, China, 20-22 November 2009; pp. 572-577.
3. Zhi, L.; Ray, J. Real Time Hand Gesture Recognition Using a Range Camera. In Proceedings of the Conference on Robotics and Automation (ACRA), Sydney, Australia, 2-4 December 2009.
4. Lee, Y.; Jung, K. 3D Posture Representation Using Meshless Parameterization with Cylindrical Virtual Boundary. In Proceedings of the 2nd Pacific Rim Conference on Advances in Image and Video Technology, Santiago, Chile, 17-19 December 2007; pp. 449-461.
5. He, G.-F.; Kang, S.-K.; Song, W.-C.; Jung, S.-T. Real-Time Gesture Recognition Using 3D Depth Camera. In Proceedings of the IEEE 2nd International Conference on Software Engineering and Service Science, Beijing, China, 15-17 July 2011; pp. 187-190.
6. Uebersax, D.; Gall, J.; van den Bergh, M.; van Gool, L. Real-Time Sign Language Letter and Word Recognition from Depth Data. In Proceedings of the IEEE Workshop on Human Computer Interaction, Barcelona, Spain, 7 November 2011; pp. 383-390.
7. Tang, X.; Liu, Y.; Lv, C.; Sun, D. Hand motion classification using a multi-channel surface electromyography sensor. Sensors 2012, 12, 1130-1147.
8. Raheja, J.L.; Shyam, R.; Kumar, U. Hand Gesture Capture and Recognition Technique for Real-Time Video Stream. In Proceedings of the International Conference on Artificial Intelligence and Soft Computing, Palma de Mallorca, Spain, 7-9 September 2009; pp. 40-44.
9. Grzeszcuk, R.; Bradski, G.; Chu, M.H.; Bouguet, J. Stereo Based Gesture Recognition Invariant to 3D Pose and Lighting. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Hilton Head, SC, USA, 13-15 June 2000; pp. 826-833.
10. Malassiotis, S.; Strintzis, M.G. Real-time hand posture recognition using range data. Image Vis. Comput. 2008, 26, 1027-1037.
11. Breuer, P.; Eckes, C.; Muller, S. Hand Gesture Recognition with a Novel IR Time-of-Flight Range Camera-A Pilot Study. In Proceedings of the Mirage 2007 Computer Vision/Computer Graphics Collaboration Techniques and Applications, Rocquencourt, France, 28-30 March 2007; pp. 247-260.
12. Sung, K.K.; Mi, Y.N.; Phill, K.R. Color Based Hand and Finger Detection Technology for User Interaction. In Proceedings of the International Conference on Convergence and Hybrid Information Technology (ICHIT), Daejeon, Korea, 28-29 August 2008; pp. 229-236.
13. Elmezain, M.; Al-Hamadi, A.; Michaelis, B. Hand Trajectory-Based Gesture Spotting and Recognition Using HMM. In Proceedings of the 16th IEEE International Conference on Image Processing, Cairo, Egypt, 7-12 November 2009; pp. 3577-3580.
14. Correa, M.; Ruiz-del-solar, J.; Verschae, R.; Jong, L.; Castillo, N. Real-Time Hand Gesture Recognition for Human Robot Interaction. Lect. Notes Comput. Sci. 2009, 5949, 46-57.
15. Hand Gesture Recognition Using the Kinect Sensor. Available online: http://www.kinecthacks.com/kinect-hand-gesture-recognition-hands-up/(accessed on 12 June 2012).
16. The Leap Sensor. Available online: http://live.leapmotion.com/about.html (accessed on 12 June 2012).
17. Yin, X.; Ming, X. Hand Gesture Segmentation, Recognition and Application. In Proceedings of the IEEE International Symposium on Robotics and Automation, Seoul, Korea, 21-26 May 2001; pp. 438-443.
18. Zhang, Q.; Chen, F; Liu, X. Hand Gesture Detection and Segmentation Based on Difference Background Image with Complex Background. In Proceedings of the International Conference on Embedded Software and Systems, Sichuan, China, 29-31 July 2008; pp. 338-343.
19. Holte, M.B.; Moeslund, T.B. Gesture Recognition Using a Range Camera; Technical Report for Laboratory of Computer Vision and Media Technology, Aalborg University: Aalborg, Denmark, February 2007.
20. Xia, L.; Fujimura, K. Hand Gesture Recognition Using Depth Data. In Proceedings of 6th IEEE International Conference on Automatic Face and Gesture Recognition, Seoul, Korea, 17-19 May 2004; pp. 529-534.
21. Ghobadi, S.; Loepprich, O.; Hartmann, K.; Loffeld, O. Hand Segmentation Using 2D/3D Images. In Proceedings of Conference Ivcnz 2007, Hamilton, New Zealand, 5-7 December 2007.
22. Heisele, B.; Ritter, W. Segmentation of Range and Intensity Image Sequences by Clustering. In Proceedings of International Conference on Information Intelligence and Systems, Bethesda, MD, USA, 31 October-3 November 1999; pp. 223-225.
23. Nguyen, D.B.; Enokia, S.; Toshiaki, E. Real-Time Hand Tracking and Gesture Recognition System. In Proceedings of the International Conference on Graphics, Vision and Image Processing, Cairo, Egypt, 19-21 December 2005; pp. 362-368.
24. Isard, M.; Blake, A. Contour Tracking by Stochastic Propagation of Conditional Density. In Proceedings of the 4th European Conference on Computer Vision, Cambridge, UK, 15-18 April 1996; pp. 343-356.
25. Yu, Y.; Guan, Y.; Xiong, H. Real-time extraction of fingertip for pointing gesture recognition. Comput. Eng. Appl. 2011, 47, 219-222.
26. Roth, M.; Tanaka, K.; Weissman, C.; Yerazunis, W. Computer vision for interactive computer graphics. IEEE Comput. Graphic. Appl. 1998, 18, 42-53.
27. Hanning, Z.; Dennis, J.L.; Thomas, S.H. Static Hand Gesture Recognition Based on Local Orientation Histogram Feature Distribution Model. In Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop, Washington, DC, USA, 27 June-2 July 2004.
28. Liu, H.; Ju, Z.; Zhu, X.; Xiong, Y. Dynamic Grasp Recognition Using Time Clustering, Gaussian Mixture Models and Hidden Markov Models. In Proceeding of the 1st International Conference, Wuhan, China, 15-17 October 2008; pp. 669-678.
29. Triesch, J.; Von, D.M. Robust Classification of Hand Postures against Complex Backgrounds. In Proceedings of the 2nd International Conference on Automatic Face And Gesture Recognition, Killington, VT, USA, 14-16 October 1996; pp. 170-175.
30. Black, M.J.; Jepson, A.D. Recognizing Temporal Trajectories Using the Condensation Algorithm. In Proceedings of 3rd IEEE International Conference on Automatic Face and Gesture Recognition, Nara, Japan, 14-16 April 1998; pp. 16-21.
31. Jeon, M.-J.; Yang, S.-E.; Bien, Z. User Adaptive Hand Gesture Recognition Using Multivariate Fuzzy Decision Tree and Fuzzy Garbage Model Source. In Proceedings of the 2009 IEEE International Conference on Fuzzy Systems, Jeju Island, Korea, 20-24 August 2009; pp. 474-479.
32. Todd, C.A.; Hassan, S.A.; Georgios, C.A. An Open Source Framework for Real-Time, Incremental, Static and Dynamic Hand Gesture Learning and Recognition. In Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques, San Diego, CA, USA, 19-24 July 2011; pp. 123-130.
33. Heung, S.; Bong, K.S.; Seong, W.L. Hand gesture recognition based on dynamic Bayesian network framework. Pattern Recogn. 2010, 43, 3059-3072.
34. Pragati, G.; Naveen, A.; Sanjeev, S. Vision based hand gesture recognition. Proc. World Acad. Sci. Eng. Technol. 2009, 49, 972-977.
35. Lindner, M.; Kolb, A. Compensation of motion artifacts for time-of-flight cameras, dynamic 3D imaging. Lect. Notes Comput. Sci. 2009, 5742, 16-27.
36. Read, P.; Meyer, M. Restoration of Motion Picture Film, Conservation and Museology; Butterworth-Heinemann: Oxford, UK, 2011; pp. 24-26.
37. Lahamy, H.; Lichti, D. Performance Analysis of Different Methods for Hand Gesture Recognition Using Range Cameras. In Proceedings of the Videometrics, Range Imaging, and Applications Conference, Munich, Germany, 23-26 May 2011; Volume 8085, pp. 80850B:1-80850B:14.
38. Lahamy, H.; Lichti, D. Robust Real-Time and Rotation-Invariant American Sign Language Alphabet Recognition Using Range Camera. In Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Melbourne, Australia, 25 August-1 September 2012; pp. 217-222.
39. Bourennane, S.; Fossati, C. Comparison of shape descriptors for hand posture recognition. Signal Image Video Process. 2012, 6, 147-157.
40. Bastos, R.; Dias, M.S. Skin Color Profile Capture for Scale and Rotation Invariant, Hand Gesture Recognition. In Proceedings of the 7th International Gesture Workshop, Lisbon, Portugal, 23-25 May 2007; pp. 81-92.