A local 3-D motion descriptor for multi-view human action recognition from 4-D sSpatio-temporal interest Points

IEEE Journal on Selected Topics in Signal Processing

Volumn 6, Issue 5, 2012, Pages 553-565

  Holte, Michael B ^a   Chakraborty, Bhaskar ^b   Gonzàlez, Jordi ^b   Moeslund, Thomas B ^a  

^a AALBORG UNIVERSITY   (Denmark)

^b Department of Computer Science ^*  (Spain)

Author keywords

3 D; 4 D spatio temporal interest points (STIPs); human action recognition; i3DPost; IXMAS; local motion description; multi view; view invariance

Indexed keywords

3-D; HUMAN-ACTION RECOGNITION; I3DPOST; IXMAS; LOCAL MOTIONS; MULTI-VIEWS; SPATIO-TEMPORAL; VIEW-INVARIANCE;

GESTURE RECOGNITION; IMAGE RECOGNITION; MOTION ESTIMATION; SUPPORT VECTOR MACHINES;

THREE DIMENSIONAL;

EID: 84865366707     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2012.2193556     Document Type: Article

References (70)

1. T. Moeslund, A. Hilton, and V. Krüger, "A survey of advances in vision-based human motion capture and analysis," Conf. Vis. Media Prod., vol. 104, no. 2-3, pp. 90-126, 2006. (Pubitemid 44573873)
2. R. Poppe, "A survey on vision-based human action recognition," Image Vis. Comput., vol. 28, no. 6, pp. 976-990, 2010.
3. D. Weinland, R. Ronfard, and E. Boyer, "A survey of vision-based methods for action representation, segmentation and recognition," INRIA Rep., vol. RR-7212, pp. 54-111, 2010.
4. X. Ji and H. Liu, "Advances in view-invariant human motion analysis: A review," IEEE Trans. Syst., Man, Cyber n. C, vol. 40, no. 1, pp. 13-24, Jan. 2010.
5. I. Cohen and H. Li, "Inference of human postures by classification of 3D human body shape," in Proc. IEEE Int.Workshop AMFG, 2003, pp. 74-81.
6. N. Gkalelis, H. Kim, A. Hilton, N. Nikolaidis, and I. Pitas, "The i3Dpost multi-view and 3D human action/interaction database," in Proc. Conf. Vis. Media Prod., 2009, pp. 159-168.
7. L. Sigal and M. Black, "Humaneva: Synchronized video and motion capture dataset for evaluation of articulated human motion," Tech. Rep., 2006.
8. D. Weinland, R. Ronfard, and E. Boyer, "Free viewpoint action recognition using motion history volumes," Comput. Vis. Image Understand., vol. 104, no. 2, pp. 249-257, 2006. (Pubitemid 44573869)
9. J. Starck and A. Hilton, "Surface capture for performance based animation," IEEE Comput. Graph. Applicat., vol. 27, no. 3, pp. 21-31, 2007. (Pubitemid 46767722)
10. M. Holte, T. Moeslund, N. Nikolaidis, and I. Pitas, "3D human action recognition for multi-view camera systems," in Proc. 3DIMPVT, 2011.
11. S. Pehlivan and P. Duygulu, "A new pose-based representation for recognizing actions from multiple cameras," Comput. Vis. Image Understand., vol. 115, pp. 140-151, 2011.
12. R. Souvenir and J. Babbs, "Learning the viewpoint manifold for action recognition," in Proc. Comput. Vis. Pattern Recognit., 2008.
13. N. Gkalelis, N. Nikolaidis, and I. Pitas, "View independent human movement recognition from multi-view video exploiting a circular invariant posture representation," in Proc. Int. Conf. Multimedia Expo, 2009.
14. A. Iosifidis, N. Nikolaidis, and I. Pitas, "Movement recognition exploiting multi-view information," in Proc. Int. Workshop Multimedia Signal Process., 2010.
15. M. Ahmad and S.-W. Lee, "Hmm-based human action recognition using multiview image sequences," in Proc. Int. Conf. Pattern Recognit., 2006.
16. S. Cherla, K. Kulkarni, A. Kale, and V. Ramasubramanian, "Towards fast, view-invariant human action recognition," in Proc. Comput. Vis. Pattern Recognit. Workshops, 2008.
17. D. Tran and A. Sorokin, "Human activity recognition with metric learning," in Proc. Eur. Conf. Comput. Vis., 2008.
18. K. Reddy, J. Liu, and M. Shah, "Incremental action recognition using feature-tree," in Proc. Int. Conf. Comput. Vis., 2009.
19. S. Vitaladevuni, V. Kellokumpu, and L. Davis, "Action recognition using ballistic dynamics," in Proc. Comput. Vis. Pattern Recognit., 2008.
20. D. Weinland, M. Özuysal, and P. Fua, "Making action recognition robust to occlusions and viewpoint changes," in Proc. Eur. Conf. Comput. Vis., 2010.
21. F. Lv and R. Nevatia, "Single view human action recognition using key pose matching and viterbi path searching," in Proc. Comput. Vis. Pattern Recognit., 2007.
22. P. Fihl and T. B. Moeslund, "Invariant gait continuum based on the duty-factor," SIViP, vol. 3, no. 4, pp. 391-402, 2008.
23. J. Liu, S. Ali, and M. Shah, "Recognizing human actions using multiple features," in Proc. Conf. Comput. Vis. Pattern Recognit., 2008.
24. J. Liu and M. Shah, "Learning human actions via information maximization," in Proc. Conf. Comput. Vis. Pattern Recognit., 2008.
25. A. Haq, I. Gondal, and M. Murshed, "On dynamic scene geometry for view-invariant action matching," in Proc. Conf. Comput. Vis. Pattern Recognit., 2011.
26. I. Junejo, E. Dexter, I. Laptev, and P. Pérez, "Cross-view action recognition from temporal self-similarities," in Proc. Eur. Conf. Comput. Vis., 2008.
27. I. Junejo, E. Dexter, I. Laptev, and P. Pérez, "View-independent action recognition from temporal self-similarities," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 172-185, Jan. 2011.
28. A. Farhadi and M. Tabrizi, "Learning to recognize activities from the wrong view point," in Proc. Eur. Conf. Comput. Vis., 2008.
29. J. Liu, M. Shah, B. Kuipers, and S. Savarese, "Cross-view action recognition via view knowledge transfer," in Proc. Conf. Comput. Vis. Pattern Recognit., 2011.
30. M. Ankerst, G. Kastenmüller, H.-P. Kriegel, and T. Seidl, "3D shape histograms for similarity search and classification in spatial databases," in Proc. Symp. Spatial Databases, 1999.
31. A. Johnson and M. Hebert, "Using spin images for efficient object recognition in cluttered 3D scenes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 5, pp. 433-449, May 1999.
32. M. Kazhdan, T. Funkhouser, and S. Rusinkiewicz, "Rotation invariant spherical harmonic representation of 3D shape descriptors," in Proc. SIGGRAPH, 2003.
33. M. Körtgen, M. Novotni, and R. Klein, "3D shape matching with 3D shape contexts," in Proc. Central Eur. Seminar Comput. Graph., 2003.
34. R. Osada, T. Funkhouser, B. Chazelle, and D. Dobkin, "Shape distributions," ACM Trans. Graph., vol. 21, pp. 807-832, 2002.
35. S. Belongie, J. Malik, and J. Puzicha, "Shape matching and object recognition using shape contexts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 4, pp. 509-522, Apr. 2002. (Pubitemid 34448769)
36. P. Huang and A. Hilton, "Shape-colour histograms for matching 3D video sequences," in Proc. 3-D Digital Imag. Modeling, 2009.
37. P. Huang, A. Hilton, and J. Starck, "Shape similarity for 3D video sequences of people," Int. J. Comput. Vis., vol. 89, pp. 362-381, 2010.
38. P. Huang, J. Starck, and A. Hilton, "A study of shape similarity for temporal surface sequences of people," in Proc. 3-D Digital Imag. Modeling, 2007.
39. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld, "Learning realistic human actions from movies," in Proc. Conf. Comput. Vis. Pattern Recognit., 2008.
40. J. Liu, J. Luo, and M. Shah, "Recognizing realistic actions from videos "in the wild"," in Proc. Conf. Comput. Vis. Pattern Recognit., 2009.
41. M. Pierobon, M. Marcon, A. Sarti, and S. Tubaro, "3-D body posture tracking for human action template matching," in Proc. Int Conf. Acoust. Speech Signal Process., 2006, pp. 501-504.
42. D. Weinland, R. Ronfard, and E. Boyer, "Action recognition from arbitrary views using 3D exemplars," in Proc. Int. Conf. Comput. Vis., 2007.
43. A. Bobick and J. Davis, "The recognition of human movement using temporal templates," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 3, pp. 257-267, Mar. 2001. (Pubitemid 32286632)
44. P. Turaga, A. Veeraraghavan, and R. Chellappa, "Statistical analysis on stiefel and grassmann manifolds with applications in computer vision," in Proc. Conf. Comput. Vis. Pattern Recognit., 2008.
45. P. Yan, S. Khan, and M. Shah, "Learning 4d action feature models for arbitrary view action recognition," in Proc. Conf. Comput. Vis. Pattern Recognit., 2008.
46. A. Yilmaz and M. Shah, "Actions sketch: A novel action representation," in Proc. Conf. Comput. Vis. Pattern Recognit., 2005.
47. I. Laptev, "On space-time interest points," Int. J. Comput. Vis., vol. 64, no. 2/3, pp. 107-123, 2005. (Pubitemid 41314645)
48. C. Harris and M. Stephens, "A combined corner and edge detector," in Proc. Alvey Vis. Conf., 1988.
49. P. Dollár, V. Rabaud, G. Cottrell, and S. Belongie, "Behavior recognition via sparse spatio-temporal features," in Proc. IEEE Int. Workshop Vis. Surveill. and Perform. Eval. Tracking Surveill., 2005.
50. H. Jhuang, T. Serre, L. Wolf, and T. Poggio, "A biologically inspired system for action recognition," in Proc. Int. Conf. Comput. Vis., 2007.
51. A. Oikonomopoulos, I. Patras, and M. Pantic, "Spatiotemporal salient points for visual recognition of human actions," IEEE Trans, Syst., Man, Cybern. B, vol. 36, no. 3, pp. 710-719, Jun. 2006. (Pubitemid 43811326)
52. G. Willems, T. Tuytelaars, and L. V. Gool, "An efficient dense and scale-invariant spatio-temporal interest point detector," in Proc. Eur. Conf. Comput. Vis., 2008.
53. S. Wong and R. Cipolla, "Extracting spatiotemporal interest points using global information," in Proc. Int. Conf. Comput. Vis., 2007.
54. B. Chakraborty, M. Holte, T. Moeslund, and J. Gonzàlez, "A selective spatio-temporal interest point detector for human action recognition in complex scenes," in Proc. Int. Conf. Comput. Vis., 2011.
55. A. Kläser,M.Marszalek, and C. Schmid, "A spatio-temporal descriptor based on 3D-gradients," in Proc. British Mach. Vis. Conf., 2008.
56. J. Koenderink and A. V. Doorn, "Representation of local geometry in the visual system," Biolog. Cybern., vol. 55, pp. 367-375, 1987. (Pubitemid 17030735)
57. I. Laptev and T. Lindeberg, "Local descriptors for spatio-temporal recognition," in Proc. 1st Int. Workshop Spatial Conf. Vis. Motion Anal., 2004.
58. P. Scovanner, S. Ali, and M. Shah, "A 3-dimensional sift descriptor and its application to action recognition," in Proc. ACMInt. Conf. Multimedia, 2007.
59. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
60. I. Laptev, B. Caputo, C. Schüldt, and T. Lindeberg, "Local velocityadapted motion events for spatio-temporal recognition," Int. J. Comput. Vis., vol. 108, no. 3, pp. 207-229, 2007. (Pubitemid 350016963)
61. W. Li, Z. Zhang, and Z. Liu, "Action recognition based on a bag of 3D points," in Proc. Conf. Comput. Vis. Pattern Recognit. Workshops, 2010.
62. T. Lindeberg, "Feature detection with automatic scale selection," Int. J. Comput. Vis., vol. 30, no. 2, pp. 79-116, 1998. (Pubitemid 128517917)
63. I.-K. Jung and S. Lacroix, "A robust interest points matching algorithm," in Proc. Int. Conf. Comput. Vis., 2001.
64. A. Swadzba, N. Beuter, J. Schmidt, and G. Sagerer, "Tracking objects in 6d for reconstructing static scenes," in Proc. Comput. Vis. Pattern Recognit. Workshops, 2008.
65. S. Vedula, S. Baker, P. Rander, R. Collins, and T. Kanade, "Threedimensional scene flow," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 475-480, Mar. 2005.
66. B. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. Imaging Understanding Workshop, 1981.
67. R. Chaudhry, A. Ravichandran, G. Hager, and R. Vidal, "Histograms of oriented optical flowand Binet-Cauchy kernels on nonlinear dynamical systems for the recognition of human actions," in Proc. Conf. Comput. Vis. Pattern Recognit., 2009.
68. N. Slonim and N. Tishby, "Agglomerative information bottleneck," in Proc. Neural Info. Process. Syst., 1999.
69. C.-C. Chang and C.-J. Lin, LIBSVM: A Library for Support Vector Machines 2001 [Online].Available: http://www.csie.ntu.edu.tw/~cjlin/libsvm
70. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake, "Real-time human pose recognition in parts from single depth images," in Proc. Conf. Comput. Vis. Pattern Recognit., 2011.