Sequence of the most informative joints (SMIJ): A new representation for human skeletal action recognition

Journal of Visual Communication and Image Representation

Volumn 25, Issue 1, 2014, Pages 24-38

  Ofli, Ferda ^a   Chaudhry, Rizwan ^b   Kurillo, Gregorij ^a   Vidal, René ^b   Bajcsy, Ruzena ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Johns Hopkins University   (United States)

Author keywords

Bag of words; Berkeley MHAD; Cross database generalization; HDM05; Human action recognition; Human action representation; Informative joints; Linear dynamical systems; MSR Action3D; Normalized edit distance

Indexed keywords

BAG OF WORDS; BERKELEY MHAD; CROSS-DATABASE GENERALIZATION; HDM05; HUMAN ACTIONS; HUMAN-ACTION RECOGNITION; LINEAR DYNAMICAL SYSTEMS; MSR ACTION3D; NORMALIZED EDIT DISTANCE;

GESTURE RECOGNITION; IMAGE RECOGNITION; LINEAR CONTROL SYSTEMS; MODELS;

MOTION ESTIMATION;

EID: 84891625198     PISSN: 10473203     EISSN: 10959076     Source Type: Journal    
DOI: 10.1016/j.jvcir.2013.04.007     Document Type: Article

References (43)

1. T.B. Moeslund, and E. Granum A survey of computer vision-based human motion capture Computer Vision and Image Understanding (CVIU) 81 2001 231 268 (Pubitemid 32415976)
2. T.B. Moeslund, A. Hilton, and V. Krüger A survey of advances in vision-based human motion capture and analysis Computer Vision and Image Understanding (CVIU) 104 2006 90 126 (Pubitemid 44573873)
3. P. Turaga, R. Chellappa, V.S. Subrahmanian, and O. Udrea Machine recognition of human activities: a survey IEEE Transactions on Circuits and Systems for Video Technology 18 2008 1473 1488
4. J. Aggarwal, and M. Ryoo Human activity analysis: a review ACM Computing Surveys 43 2011 16:1 16:43
5. P. Dollár, V. Rabaud, G. Cottrell, S. Belongie, Behavior recognition via sparse spatio-temporal features, in: Proceedings of IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS), 2005.
6. I. Laptev On space-time interest points International Journal of Computer Vision (IJCV) 64 2-3 2005 107 123 (Pubitemid 41314645)
7. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008.
8. A. Bissacco, A. Chiuso, Y. Ma, S. Soatto, Recognition of human gaits, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2001, vol. 2, pp. 52-58.
9. A. Bissacco, A. Chiuso, and S. Soatto Classification and recognition of dynamical models: the role of phase, independent components, kernels and optimal transport IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 29 2007 1958 1972 (Pubitemid 47423789)
10. S. Ali, A. Basharat, M. Shah, Chaotic invariants for human action recognition, in: Proceedings of IEEE International Conference on Computer Vision (ICCV), 2007.
11. J. Yamato, J. Ohya, K. Ishii, Recognizing human action in time-sequential images using hidden Markov model, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1992.
12. J.K. Aggarwal, and Q. Cai Human motion analysis: a review Computer Vision and Image Understanding (CVIU) 73 1999 90 102
13. G.W. Taylor, G.E. Hinton, S. Roweis, Modeling human motion using binary latent variables, in: Proceedings of Neural Information Processing Systems (NIPS), 2007.
14. G.W. Taylor, G.E. Hinton, Factored conditional restricted Boltzmann machines for modeling motion style, in: Proceedings of International Conference on Machine Learning (ICML), 2009.
15. T. Cover, and j. Thomas Elements of Information Theory 2006 Wiley
16. F. Ofli, R. Chaudhry, G. Kurillo, R. Vidal, R. Bajcsy, Sequence of the most informative joints (SMIJ): a new representation for human skeletal action recognition, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2012, pp. 8-13.
17. A. Marzal, and E. Vidal Computation of normalized edit distance and applications IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 15 1993 926 932 (Pubitemid 23703604)
18. P. Beaudoin, S. Coros, M. van de Panne, P. Poulin, Motion-motif graphs, in: Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA), 2008, pp. 117-126.
19. M. Müller, A. Baak, H.-P. Seidel, Efficient and robust annotation of motion capture data, in: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA), 2009, pp. 17-26.
20. J. Barbič, A. Safonova, J.-Y. Pan, C. Faloutsos, J.K. Hodgins, N.S. Pollard, Segmenting motion capture data into distinct behaviors, in: Proceedings of Graphics Interface (GI), 2004, pp. 185-194.
21. A. López-Méndez, J. Gall, J. Casas, L.V. Gool, Metric learning from poses for temporal clustering of human motion, in: Proceedings of British Machine Vision Conference (BMVC), 2012, pp. 49.1-49.12.
22. F. Zhou, F.D. la Torre, and J.K. Hodgins Hierarchical aligned cluster analysis for temporal clustering of human motion IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 99 2012 1 15
23. C. Shannon, and W. Weaver The Mathematical Theory of Communication 1949 University of Illinois Press vol. 1
24. F.J. Damerau A technique for computer detection and correction of spelling errors Communications of the ACM 7 1964 171 176
25. V.I. Levenshtein Binary codes capable of correcting deletions, insertions and reversals Soviet Physics Doklady 10 1966 707 710
26. R.A. Wagner, and M.J. Fischer The string-to-string correction problem Journal of the ACM 21 1974 168 173
27. R.A. Wagner, and R. Lowrance An extension of the string-to-string correction problem Journal of the ACM 22 1975 177 183
28. C. Dance, J. Willamowski, L. Fan, C. Bray, G. Csurka, Visual categorization with bags of keypoints, in: Proceedings of European Conference on Computer Vision (ECCV), 2004.
29. H.E. Cetingul, R. Chaudhry, R. Vidal, A system theoretic approach to synthesis and classification of lip articulation, in: Proceeding of International Workshop on Dynamic Vision, 2007.
30. R. Chaudhry, A. Ravichandran, G. Hager, R. Vidal, Histograms of oriented optical flow and binet-cauchy kernels on nonlinear dynamical systems for the recognition of human actions, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009, pp. 1932-1939.
31. R. Vidal, A. Chiuso, S. Soatto, Application of hybrid system identification in computer vision, in: Proceedings of the European Control Conference, 2007, pp. 27-34.
32. P.V. Overschee, and B.D. Moor N4SID: Subspace algorithms for the identification of combined deterministic-stochastic systems Automatica, Special Issue in Statistical Signal Processing and Control 30 1994 75 93
33. R. Shumway, and D. Stoffer An approach to time series smoothing and forecasting using the EM algorithm Journal of Time Series Analysis 3 1982 253 264
34. G. Doretto, A. Chiuso, Y. Wu, and S. Soatto Dynamic textures International Journal of Computer Vision (IJCV) 51 2003 91 109
35. K.D. Cock, and B.D. Moor Subspace angles and distances between ARMA models System and Control Letters 46 2002 265 270
36. B. Afsari, R. Chaudhry, A. Ravichandran, R. Vidal, Group action induced distances for averaging and clustering linear dynamical systems with applications to the analysis of dynamic visual scenes, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
37. S. Vishwanathan, A. Smola, and R. Vidal Binet-Cauchy kernels on dynamical systems and its application to the analysis of dynamic scenes International Journal of Computer Vision (IJCV) 73 2007 95 119 (Pubitemid 46181619)
38. A. Chan, N. Vasconcelos, Probabilistic kernels for the classification of auto-regressive visual processes, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2005, vol. 1, pp. 846-851. (Pubitemid 43897281)
39. F. Ofli, R. Chaudhry, G. Kurillo, R. Vidal, R. Bajcsy, Berkeley MHAD: A comprehensive multimodal human action database, in: Proceedings of IEEE Workshop on Applications of Computer Vision (WACV), 2013.
40. M. Müller, T. Röder, M. Clausen, B. Eberhardt, B. Krüger, A. Weber, Documentation Mocap Database HDM05, Technical Report CG-2007-2, Universität Bonn, 2007.
41. W. Li, Z. Zhang, Z. Liu, Action recognition based on a bag of 3D points, in: Proceedings of Computer Vision and Pattern Recognition Workshops (CVPRW), 2010, pp. 9-14.
42. J. Zhang, M. Marszalek, S. Lazebnik, and C. Schmid Local features and kernels for classification of texture and object categories: a comprehensive study International Journal of Computer Vision (IJCV) 73 2007 213 238 (Pubitemid 46181625)
43. A. Torralba, A. Efros, Unbiased look at dataset bias, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp. 1521-1528.