View-invariant gesture recognition using 3D optical flow and harmonic motion context

Computer Vision and Image Understanding

Volumn 114, Issue 12, 2010, Pages 1353-1361

  Holte, M B ^a   Moeslund, T B ^a   Fihl, P ^a  

^a AALBORG UNIVERSITY   (Denmark)

Author keywords

Action recognition; Motion primitives; Optical flow; Spherical harmonics; Time of Flight camera; View invariant

Indexed keywords

ACTION RECOGNITION; MOTION PRIMITIVES; SPHERICAL HARMONICS; TIME-OF-FLIGHT CAMERAS; VIEW-INVARIANT;

CAMERAS; HARMONIC ANALYSIS; HARMONIC FUNCTIONS; OPTICAL FLOWS; SPHERES; THREE DIMENSIONAL;

GESTURE RECOGNITION;

EID: 77958004871     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2010.07.012     Document Type: Article

References (37)

1. M. Ahmad, S.-W. Lee, HMM-based human action recognition using multiview image sequences, in: International Conference on Pattern Recognition, Hong Kong, August 2006.
2. H.H. Avils-Arriaga, and L.E. Sucar Dynamic bayesian networks for visual recognition of dynamic gestures Journal of Intelligent and Fuzzy Systems 12 3-4 2002 243 250
3. S. Belongie, J. Malik, and J. Puzicha Shape matching and object recognition using shape contexts Pattern Analysis and Machine Intelligence 24 4 2002 509 522
4. I. Cohen, H. Li, Inference of human postures by classification of 3D human body shape, in: Workshop on Analysis and Modeling of Faces and Gestures, Nice, France, October 2003.
5. J. Gonzalez, J. Varona, F. Roca, J. Villanueva, aSpaces: action spaces for recognition and synthesis of human actions, in: International Workshop on Articulated Motion and Deformable Objects, Palma de Mallorca, Spain, November 2002.
6. M. Haker, M. Bohme, T. Martinetz, E. Barth. Geometric invariants for facial feature tracking with 3D TOF cameras, in: International Symposium on Signals, Circuits and Systems, Iasi, Romania, July 2007.
7. D. Hansen, R. Larsen, F. Lauze. Improving face detection with TOF cameras, in: International Symposium on Signals, Circuits and Systems, Iasi, Romania, July 2007.
8. M. Holte, T. Moeslund, P. Fihl, Fusion of range and intensity information for view invariant gesture recognition, in: Workshop on Time-of-Flight based Computer Vision, Anchorage, Alaska, June 2008.
9. B. Horn, and B. Schunck Determining optical flow Artificial Intelligence 17 1981 185 203
10. O. Jenkins, M. Mataric, Deriving action and behavior primitives from human motion data, in: International Conference on Intelligent Robots and Systems, Lausanne, Switzerland, September 2002.
11. Y. Kameda, M. Minoh, K. Ikeda, Three Dimensional motion estimation of a human body using a difference image sequence, in: Asian Conference on Computer Vision, Singapore, December 1995.
12. S. Khan, LUMS School of Science and Engineering Lahore, Pakistan. .
13. O. Kahler, E. Rodner, J. Denzler, On fusion of range and intensity information using graph-cut for planar patch segmentation, in: Dynamic 3D Imaging Workshop, Heidelberg, Germany, September 2007.
14. A. Kolb, E. Barth, R. Koch, R. Larsen, Time-of-flight sensors in computer graphics, in: Eurographics 2009 - State of the Art Reports, Munich, Germany, March 2009, pp. 119-134.
15. R. Larsen, B. Lading, Multiple Geodesic distance based registration of surfaces applied to facial expression data, in: International Symposium on Signals, Circuits and Systems, Iasi, Romania, July 2007.
16. V. Levenshtein Binary codes capable of correcting deletions, insertions and reversals Soviet Physics Doklady 10 8 1966 707 710
17. D. Lowe Distinctive image features from scale-invariant keypoints International Journal of Computer Vision 60 2 2004 91 110
18. B. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, in: Proceedings of Imaging Understanding Workshop, Washington DC, USA, April 1981.
19. R. Messing, C. Pal, H. Kautz, Activity recognition using the velocity histories of tracked keypoints, in: International Conference on Computer Vision, Kyoto, Japan, September 2009.
20. S. Mitra, and T. Acharya Gesture recognition: a survey IEEE Transactions on Systems, Man and Cybernetics, Part C: Applications and Reviews 37 3 2007 311 324
21. T. Moeslund, A. Hilton, and V. Kruger A survey of advances in vision-based human motion capture and analysis Computer Vision and Image Understanding 104 2 2006 90 126
22. T. Oggier, M. Stamm, M. Schweizer, J. Pedersen, User Manual SwissRanger 2 Rev. b. Version 1.02, March 2005.
23. A. Prusak, I. Schiller, O. Melnychuk, R. Koch, H. Roth, Pose estimation and map building with a PMD-camera for robot navigation, in: Dynamic 3D Imaging Workshop, Heidelberg, Germany, September 2007.
24. P.K. Reddy, D. Grest, V. Kruger. Human action recognition in table-top scenarios: an HMM-based analysis to optimize the performance, in: Computer Analysis of Images and Patterns, Vienna, Austria, August 2007.
25. Q. Shi, L. Wang, L. Cheng, A. Smola, Discriminative human action segmentation and recognition using semi-markov model, in: Computer Vision and Pattern Recognition, Anchorage, Alaska, June 2008.
26. S. Soutschek, J. Penne, J. Hornegger, J. Kornhuber, 3-D gesture-based scene navigation in medical imaging applications using time-of-flight cameras, in: Workshop on Time-of-Flight based Computer Vision, Anchorage, Alaska, June 2008.
27. R. Souvenir, J. Babbs, Learning the viewpoint manifold for action recognition, in: Computer Vision and Pattern Recognition, Anchorage Alaska, 2008.
28. A. Swadsba, B. Liu, J. Penne, O. Jesorsky, R. Kompe, A comprehensive system for 3D modeling from range images acquired from a 3D ToF sensor, in: International Conference on Computer Vision Systems, Bielefeld Germany, 2007.
29. A. Swadzba, N. Beuter, J. Schmidt, G. Sagerer, Tracking objects in 6D for reconstructing static scenes, Workshop on Time-of-flight based computer vision, Anchorage Alaska, 2008.
30. C. Thurau, V. Hlavac, Pose primitive based human action recognition in videos or still images, in: Computer Vision and Pattern Recognition, Anchorage Alaska, June, 2008.
31. S.N. Vitaladevuni, V. Kellokumpu, L.S. Davis, Action recognition using ballistic dynamics, in: Computer Vision and Pattern Recognition, Anchorage Alaska, June, 2008.
32. W.-H.A. Wang, C.-L. Tung, Dynamic hand gesture recognition using hierarchical dynamic bayesian networks through low-level image processing, in: International Conference on Machine Learning and Cybernetics, Kunming, China, July 2008.
33. D. Weinland, R. Ronfard, and E. Boyer Free viewpoint action recognition using motion history volumes Computer Vision and Image Understanding 104 2 2006 249 257
34. A. Yilmaz, M. Shah, Actions Sketch: a novel action representation, in: Computer vision and pattern recognition, San Diego, CA, USA, June 2005.
35. 3DV Systems, 2nd Carmel St. Industrial Park Building 1, 20692 Yokneam, Israel. .
36. MESA Imaging, Technoparkstrasse 1, 8005 Zuerich, Switzerland. .
37. PMD Technologies, Am Eichenhang 50, D-57076 Siegen, Germany. .