Hand gesture recognition using color and depth images enhanced with hand angular pose data

IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems

Volumn , Issue , 2012, Pages 71-76

  Trindade, Pedro ^a   Lobo, Jorge ^a   Barreto, Joao P ^a  

^a UNIVERSITY OF COIMBRA   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

COLOR AND DEPTH IMAGES; DEPTH IMAGE; FULL-BODY MOTIONS; GROUND PLANES; HAND GESTURE; HAND-GESTURE RECOGNITION; HUMAN PALM; HUMAN POSE; MICROSOFT; POINT CLOUD; PROJECTED LIGHT; RECOGNITION METHODS; SEARCH SPACES; SIGN LANGUAGE; SKIN COLOR; STEREO VISION SYSTEM; TEMPLATE DATABASE;

COMPUTER VISION; IMAGE MATCHING; IMAGE SEGMENTATION; INTELLIGENT SYSTEMS; SENSORS; STEREO VISION; THREE DIMENSIONAL COMPUTER GRAPHICS;

GESTURE RECOGNITION;

EID: 84870599626     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MFI.2012.6343032     Document Type: Conference Paper

References (23)

1. Robert Y. Wang. Real-time hand-tracking as a user input device. 2008.
2. Robert Y. Wang and Jovan Popović. Real-time hand-tracking with a color glove. ACM Trans. Graph., 28:63:1-63:8, July 2009.
3. Gary R Bradski. Computer vision face tracking for use in a perceptual user interface. Interface, 2(2):1221, 1998.
4. F. Ullah. American sign language recognition system for hearing impaired people using cartesian genetic programming. In Proc. 5th Int Automation, Robotics and Applications (ICARA) Conf, pages 96-99, 2011.
5. P. Trindade and J. Lobo. Distributed accelerometers for gesture recognition and visualization. In DoCEIS'11-Doctoral Conference on Computing, Electrical and Industrial Systems, pages 215-223, Lisbon, Portugal, February 2011.
6. A. S. Ghotkar, R. Khatal, S. Khupase, S. Asati, and M. Hadap. Hand gesture recognition for indian sign language. In Proc. Int Computer Communication and Informatics (ICCCI) Conf, pages 1-4, 2012.
7. Microsoft Kinect. http://www.xbox.com/kinect, 2012.
8. Virgile Hgman. Building a 3d map from rgb-d sensors. Master's thesis, KTH Royal Institute of Technology, 2011.
9. Iason Oikonomidis, Nikolaos Kyriazis, and Antonis A. Argyros. Markerless and Efficient 26-DOF Hand Pose Recovery. In Asian Conference on Computer Vision, Queenstown, New Zealand, 2010.
10. Nikolaos Kyriazis Iason Oikonomidis and Antonis Argyros. Efficient model-based 3d tracking of hand articulations using kinect. In Proc. BMVC, pages 101.1-101.11, 2011. http://dx.doi.org/10.5244/C.25.101.
11. Iason Oikonomidis, Nikolaos Kyriazis, and Antonis A. Argyros. Tracking the Articulated Motion of Two Strongly Interacting Hands. In Computer Vision and Pattern Recognition, Providence, Rhode Island, USA, 2012.
12. Jamie Shotton, Andrew Fitzgibbon, Mat Cook, Toby Sharp, Mark Finocchio, Richard Moore, Alex Kipman, and Andrew Blake. Real-Time Human Pose Recognition in Parts from Single Depth Images. June 2011.
13. P. Henry, M. Krainin, E. Herbst, X. Ren, and D. Fox. RGB-D Mapping: Using depth cameras for dense 3D modeling of indoor environments. In Proceedings of the 12th International Symposium on Experimental Robotics, 2010.
14. Vladimir Vezhnevets, Vassili Sazonov, and Alla Andreeva. A survey on pixel-based skin color detection techniques. In IN PROC. GRAPHICON-2003, pages 85-92, 2003.
15. L. Dipietro, A.M. Sabatini, and P. Dario. A survey of glove-based systems and their applications. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, 38(4):461-482, july 2008.
16. J. Lobo, P. Trindade, and J. Dias. Observing hand grasp type and contact points using hand distributed accelerometers and instrumented objects. In IEEE/ICRA 2011: Workshop on Autonomous Grasping, 2011.
17. T. Hoshi, S. Ozaki, and H. Shinoda. Three-dimensional shape capture sheet using distributed triaxial accelerometers. In Networked Sensing Systems, 2007. INSS '07. Fourth International Conference on, pages 207-212, june 2007.
18. J. Lobo and J. Dias. Relative pose calibration between visual and inertial sensors. The International Journal of Robotics Research (IJRR) Special Issue from the 2nd Workshop on Integration of Vision and Inertial Sensors., 26:561-577, 2007.
19. J. Lobo and J. Dias. Vision and inertial sensor cooperation using gravity as a vertical reference. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(12):1597-1608, December 2003.
20. B.K.P. Horn. Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society of America, 4(4):629-462, April 1987.
21. Zhengyou Zhang. Iterative point matching for registration of free-form curves and surfaces. Int. J. Comput. Vision, 13(2):119-152, October 1994.
22. Polhemus Liberty Electromagnetic Motion Tracking System. http://www.polhemus.com, 2012.
23. Szymon Rusinkiewicz and Marc Levoy. Efficient variants of the ICP algorithm. In Third International Conference on 3D Digital Imaging and Modeling (3DIM), June 2001.