Human action recognition using global point feature histograms and action shapes

Advanced Robotics

Volumn 23, Issue 14, 2009, Pages 1873-1908

  Rusu, Radu Bogdan ^a   Bandouch, Jan ^a   Meier, Franziska ^a,b   Essa, Irfan ^b   Beetz, Michael ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b Georgia Institute of Technology   (United States)

Author keywords

Action recognition; Action segmentation; Global features; Point cloud

Indexed keywords

ACTION RECOGNITION; ACTION SEGMENTATION; DATA SETS; DATA STREAM; GLOBAL FEATURES; HUMAN ACTIONS; HUMAN-ACTION RECOGNITION; INDOOR ENVIRONMENT; INTERVAL SCHEDULING; PATTERN-MATCHING TECHNIQUE; POINT CLOUD; POINT FEATURES; STATISTICAL ANALYSIS; SUFFIX-TREES; THIRD SPATIAL DIMENSIONS; TIME AXIS; TIME INTERVAL; TIME SEQUENCES;

CLOUDS; GESTURE RECOGNITION; PATTERN MATCHING;

THREE DIMENSIONAL;

EID: 71049135620     PISSN: 01691864     EISSN: 15685535     Source Type: Journal    
DOI: 10.1163/016918609X12518783330243     Document Type: Article

References (57)

1. R. B. Rusu, J. Bandouch, Z. C. Marton, N. Blodow and M. Beetz, Action recognition in intelligent environments using point cloud features extracted from silhouette sequences, in: Proc. IEEE 17th Int. Symp. on Robot and Human Interactive Communication, München, pp. 267-272 (2008).
2. M. Blank, L. Gorelick, E. Shechtman, M. Irani and R. Basri, Actions as space-time shapes, in: Proc. IEEE Int. Conf. on Computer Vision, Beijng, pp. 1395-1402 (2005).
3. L. Gorelick, M. Blank, E. Shechtman, M. Irani and R. Basri, Actions as space-time shapes, IEEE Trans. Pattern Anal. Mach. Intell. 29, 2247-2253 (2007).
4. A. Yilmaz and M. Shah, Actions sketch: a novel action representation, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, San Diego, CA, Vol.1, pp. 984-989 (2005).
5. R. B. Rusu, N. Blodow, Z. Marton, A. Soos and M. Beetz, Towards 3D object maps for autonomous household robots, in: Proc. 20th IEEE Int. Conf. on Intelligent Robots and Systems, San Diego, CA, ThB1.1 (2007).
6. E. Wahl, U. Hillenbrand and G. Hirzinger, Surflet-pair-relation histograms: a statistical 3D-shape representation for rapid classification, in: Proc. 3DIM03, Banff, AB, pp. 474-481. (2003).
7. Y. Sheikh, M. Sheikh and M. Shah, Exploring the space of a human action, in: Proc. IEEE Int. Conf. on Computer Vision, Beijng, pp. 144-149 (2005).
8. D. Kulíc, W. Takano and Y. Nakamura, Incremental learning, clustering and hierarchy formation of whole body motion patterns using adaptive hidden markov chains, Int. J. Robotics Res. 27, 761-784 (2008).
9. J. Deutscher and I. Reid, Articulated body motion capture by stochastic search, Int. J. Comp. Vision 61, 185-205 (2005).
10. B. Rosenhahn, T. Brox, U. Kersting, A. Smith, J. Gurney and R. Klette, A system for marker-less motion capture, Künst. Intell. 20, 45-51 (2006).
11. R. Kehl and L. V. Gool, Markerless tracking of complex human motions from multiple views, Comp. Vision Image Understand. 104, 190-209 (2006).
12. R. P. Horaud, M. Niskanen, G. Dewaele and E. Boyer, Human motion tracking by registering an articulated surface to 3-D points and normals, IEEE Trans. Pattern Anal.Mach. Intell. 31, 158-163 (2009).
13. A. F. Bobick and J. W. Davis, The recognition of human movement using temporal templates, IEEE Trans. Pattern Anal. Mach. Intell. 23, 257-267 (2001) .
14. L. Wang and D. Suter, Informative shape representations for human action recognition, in: Proc. IEEE 18th Int. Conf. on Pattern Recognition, Hong Kong, pp. 1266-1269 (2006).
15. A. A. Efros, A. C. Berg, G. Mori and J. Malik, Recognizing action at a distance, in: Proc. IEEE Int. Conf. on Computer Vision, Nice, pp. 726-733 (2003).
16. D. Weinland, R. Ronfard and E. Boyer, Free viewpoint action recognition using motion history volumes, Comp. Vision Image Understand. 104, 249-257 (2006).
17. A. Agarwal and B. Triggs, 3D human pose from silhouettes by relevance vector regression, in: Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, Wasington, DC, Vol.2, pp. 882-888 (2004).
18. J. Bandouch, F. Engstler and M. Beetz, Evaluation of hierarchical sampling strategies in 3D human pose estimation, in: Proc. 19th British Machine Vision Conf., Leeds, paper 261 (2008).
19. K. M. Cheung, S. Baker and T. Kanade, Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Madison, WI, pp. 77-84 (2003).
20. I. Cohen and H. Li, Inference of human postures by classification of 3D human body shape, in: Proc. IEEE Int. Workshop on Analysis and Modeling of Faces and Gestures, Nice, pp. 74-81 (2003).
21. K. Ogawara, X. Li and K. Ikeuchi, Marker-less human motion estimation using articulated deformable model, in: Proc. IEEE Int. Conf. on Robotics and Automation, Rome, pp. 46-51 (2007).
22. A. Oikonomopoulos, P. Ioannis and M. Pantic, Spatio-temporal salient points for visual recognition of human actions, IEEE Trans. Syst. Man Cybernet. B 36, 710-719 (2006). (Pubitemid 43811326)
23. A. Veeraraghavan, A. K. Roy-Chowdhury and R. Chellappa, Matching shape sequences in video with applications in human movement analysis, IEEE Trans. Pattern Anal. Mach. Intell. 27, 1896- 1909 (2005).
24. C. Schuldt, I. Laptev and B. Caputo, Recognizing human actions: a local svm approach, in: Proc. 17th Int. Conf. on Pattern Recognition, Liambridge, pp. 32-36 (2004).
25. V. Krüger and D. Grest, Using hiddenMarkovmodels for recognizing action primitives in complex actions, Lecture Notes Comp. Sci. 4522, 203-212 (2007).
26. F. Lv and R. Nevatia, Single view human action recognition using key pose matching and viterbi path searching, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Minneapolis, MN, Vol.2, pp. 194-201 (2007).
27. P. Peursum, S. Venkatesh and G. A. W. West, Tracking-as-recognition for articulated full-body human motion analysis, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Minneapolis, MN, pp. 1-8 (2007).
28. F. Caillette, A. Galata and T. Howard, Real-time 3-D human body tracking using learnt models of behaviour, Comp. Vision Image Understand. 109, 112-125 (2008).
29. D. Minnen, I. Essa and T. Starner, Expectation grammars: leveraging high-level expectations for activity recognition, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Madison, WI, pp. 626-632 (2003).
30. A. Ogale, A. Karapurkar and Y. Aloimonos, View-invariant modeling and recognition of human actions using grammars, in: Proc. IEEE Workshop on Dynamical Vision, Beijng, pp. 115-126 (2005).
31. C. Sminchisescu, A. Kanaujia, Z. Li and D. Metaxas, Conditional random fields for contextual human motion recognition, in: Proc. IEEE Int. Conf. on Computer Vision, Beijng, pp. 1808-1815 (2005).
32. R. Poppe and M. Poel, Comparison of silhouette shape descriptors for example-based human pose recovery, in: Proc. IEEE Conf. on Automatic Face and Gesture Recognition, Southampton, pp. 541-546 (2006).
33. S. Belongie, J. Malik and J. Puzicha, Shape matching and object recognition using shape contexts, IEEE Trans. Pattern Anal. Mach. Intell. 24, 509-522 (2002).
34. G. Mori, Recovering 3D human body configurations using shape contexts, IEEE Trans. Pattern Anal. Mach. Intell. 28, 1052-1062 (2006).
35. M. Grundmann, F. Meier and I. Essa, 3D shape context and distance transform for action recognition, in: Proc. Int. Conf. on Pattern Recognition, Tampa, FL, pp. 1-4 (2008).
36. G. Hetzel, B. Leibe, P. Levi and B. Schiele, 3D object recognition from range images using local feature histograms, in: Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, Kauai Island, HI, pp. 394-399 (2001).
37. A. Johnson, Spin-images: a representation for 3-D surface matching, PhD Thesis, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA (1997).
38. X. Li and I. Guskov, 3D object recognition from range images using pyramid matching, in: Proc. IEEE Conf. on Computer Vision, Rio de Janeiro (2007).
39. F. D. la Torre Frade, J. Campoy, Z. Ambadar and J. F. Cohn, Temporal segmentation of facial behavior, in: Proc. IEEE Int. Conf. on Computer Vision, Rio de Janeiro (2007).
40. L. Zelnik-Manor and M. Irani, Event-based analysis of video, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Kauai Island, HI, pp. 123-130 (2001).
41. J. Barbic, A. Safonova, J.-Y. Pan, C. Faloutsos, J. K. Hodgins and N. S. Pollard, Segmenting motion capture data into distinct behaviors, in: Proc. Graphics Interface, London, ON, pp. 185- 194 (2004).
42. F. Zhou, F. D. la Torre Frade and J. K. Hodgins, Aligned cluster analysis for temporal segmentation of human motion, in: Proc. IEEE Conf. on Automatic Face and Gestures Recognition, Amsterdam, pp. 1-7 (2009).
43. D. Weinland, R. Ronfard and E. Boyer, Automatic discovery of action taxonomies from multiple views, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, New York, NY, Vol.2, pp. 1639-1645 (2006).
44. V. Krüger, D. Kragic, A. Ude and C. Geib, The meaning of action: a review on action recognition and mapping, Adv. Robotics 21, 1473-1501 (2007).
45. C. Stauffer andW. Grimson, Adaptive background mixture models for real-time tracking, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Fort Collins, CO, Vol.2, pp. 246-252 (1999).
46. A. M. Elgammal, D. Harwood and L. S. Davis, Non-parametric model for background subtraction, in: Proc. 6th Eur. Conf. on Computer Vision - Part II, Dublin, pp. 751-767 (2000).
47. K. Kim, T. H. Chalidabhongse, D. Harwood and L. S. Davis, Real-time foreground-background segmentation using codebook model, Real-Time Imaging 11, 172-185 (2005).
48. A. Prati, I. Mikic, M. M. Trivedi and R. Cucchiara, Detecting moving shadows: algorithms and evaluation, IEEE Trans. Pattern Anal. Mach. Intell. 25, 918-923 (2003).
49. A. M. Elgammal and L. S. Davis, Probabilistic framework for segmenting people under occlusion, in: Proc. IEEE Int. Conf. on Computer Vision, Vancouver, BC, pp. 145-152 (2001).
50. G. Zhang, J. Jia, W. Xiong, T. Wong, P. Heng and H. Bao, Moving object extraction with a handheld camera, in: Proc. IEEE Int. Conf. on Computer Vision, Rio de Janeiro (2007).
51. M. K. Hu, Visual pattern recognition by moment invariants, IRE Trans. Inform. Theory 8, 179-187 (1962).
52. E. M. McCreight, A space-economical suffix tree construction algorithm, J. ACM 23, 262-272 (1976).
53. M. Muja and D. G. Lowe, Approximate nearest neighbors with automatic algorithm configuration, in: Proc. Int. Conf. on Computer Vision Theory and Applications, Lisbon (2009).
54. R. B. Rusu, N. Blodow, Z. C. Marton and M. Beetz, Aligning point cloud views using persistent feature histograms, in: Proc. 21st IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Nice, pp. 3384-3391 (2008).
55. H. Hoppe, T. DeRose, T. Duchamp, J. McDonald and W. Stuetzle, Surface reconstruction from unorganized points, in: Proc. 19th Annu. Conf. on Computer Graphics and Interactive Techniques, Chicago, IL, pp. 71-78 (1992).
56. A survey of content based 3D shape retrieval methods, in: Proc. Shape Modeling International (2004).
57. M. Beetz, F. Stulp, B. Radig, J. Bandouch, N. Blodow, M. Dolha, A. Fedrizzi, D. Jain, U. Klank, I. Kresse, A. Maldonado, Z. Marton, L. Mösenlechner, F. Ruiz, R. B. Rusu and M. Tenorth, The assistive kitchen-a demonstration scenario for cognitive technical systems, in: Proc. IEEE 17th Int. Symp. on Robot and Human Interactive Communication, München, pp. 1-8 (2008).