A multi-modal gesture recognition system in a human-robot interaction scenario

2009 IEEE International Workshop on Robotic and Sensors Environments, ROSE 2009 - Proceedings

Volumn , Issue , 2009, Pages 41-46

  Li, Zhi ^a   Jarvis, Ray ^a  

^a MONASH UNIVERSITY   (Australia)

Author keywords

Attention direction; Depth data; Gesture recognition; Hand shap; ; Hand trajectory; Pose estimation; Range camera

Indexed keywords

3-D SPACE; ATTENTION DIRECTION; BODY POSE; EYE-GAZE; GESTURE RECOGNITION SYSTEM; GRADIENT BASED; HAND GESTURE; HAND SHAPE; HIGH FRAME RATE; HUMAN ROBOT INTERACTIONS; MODEL-BASED ALGORITHMS; MULTI-MODAL; MULTIMODAL SYSTEM; OBJECTS DETECTION; PARTICLE FILTER; POSE ESTIMATION; RANGE CAMERAS; SEARCHING METHODS; STEREO CAMERAS;

CAMERAS; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION; IMAGE SEGMENTATION; MAN MACHINE SYSTEMS; ROBOTICS; SENSORS; THREE DIMENSIONAL;

HUMAN ROBOT INTERACTION;

EID: 76249127121     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ROSE.2009.5355984     Document Type: Conference Paper

References (18)

1. T. Starner, and A. Pentland, "Real-time American sign language recognition from video using hidden markov models", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol 20, pp. 1371-1375, 1995.
2. M.J. Black and A.D. Jepson, "Recognizing temporal trajectories using the condensation algorithm", Proceedings of Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 16-21, April, 1998.
3. X. Liu and K. Fujimura, "Hand Gesture Recognition using Depth Data", proceedings of the sixth IEEE international Conference on Automatic face and gesture recognition, pp. 529-534, May, 2004
4. J. Carranza, C. Theobalt, M. Magnor and H.P. Seidel, "Free-viewpoint video of human actors", Proceedings of ACM SIGGRAPH, pp. 565-577, July, 2003.
5. J. Starck and A. Hilton, "Model-Based Multiple View Reconstruction of People", Proceedings of Ninth IEEE International Conference on Computer Vision, vol 2, pp 915-922, 2003.
6. C. Sminchisescu and B. Triggs, "Estimating articulated human motion with covariance scaled sampling", International Journal of Robotics Research, vol 22, 371-391, 2003.
7. Z. Xu, R. Schwarte, H. Heinol, B. Buxbaum, and T. Ringbeck, "Smart pixel - photonic mixer device (PMD), in Proc. Int. Conf. on Mechatron. & Machine Vision, pp. 259 264, 1998.
8. M. Lindner and A. Kolb, "Calibration of the Intensity-Related Distance Error of the PMD TOF-Camera", Proceedings of Intelligent Robots and Computer Vision XXV: Algorithms, Techniques, and Active Vision, September, 2007.
9. T. Kahlmann and H. Ingensand, "Calibration and improvements of the high-resolution range-imaging camera SwissRanger", Proceedings of the SPIE, Vol.5665, pp. 144-155, February, 2005.
10. R. Lienhart and J. Maydt, "An extended set of Haar-like features for rapid object detection", Proceedings of 2002 International Conference on Image Processing, vol 1, pp. I- 900-I-903, 2002.
11. Rainer Lienhart, Er Kuranov, Vadim Pisarevsky, "Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection", In DAGM 25th Pattern Recognition Symposium, 2003.
12. C. Beder, B. Bartczak and R. Koch, "A comparison of PMD- camera and stereo-vision for the task of surface reconstruction using Patchlets", IEEE Conference on Computer Vision and Pattern Recognition, pp 1-8, 2007.
13. M. Isard, A. Blake, "CONDENSATION - Conditional Density Propagation for Visual Tracking", International Journal of Computer Vision, pp 5-28, 1998.
14. L.R. Rabiner, "A tutorial on Hidden Markov Models and selected applications in speech recognition", Readings in speech recognition, pp 267-296, 1990.
15. C. E. Jacobs, A. Finkelstein, and D. H. Salesin, "Fast Multiresolution Image Querying", International conference on computer graphics and interactive techniques, pp 277-286, 1995.
16. A.H. Barr, "Superquadrics and angle-preserving transformations" , Computer Graphics and Applications, vol 1(1), pp 11-23, 1981
17. K. Nickle and R. Stiefelhagen, "Pointing gesture recognition based on 3dtracking of face, hands and head orientation", Proceedings of the 5th international conference on Multimodal interfaces, pp 140-146, 2003.
18. http://www.seeingmachines.com/product/facelab