Part-based motion descriptor image for human action recognition

Pattern Recognition

Volumn 45, Issue 7, 2012, Pages 2562-2572

  Tran, K N ^a   Kakadiaris, I A ^a   Shah, S K ^a  

^a University of Houston   (United States)

Author keywords

Discriminant analysis; Human action recognition; Motion descriptor image; Principal component analysis; Sparse representation; Subspace learning

Indexed keywords

HUMAN-ACTION RECOGNITION; MOTION DESCRIPTOR IMAGE; PRINCIPAL COMPONENT ANALYSIS (PCA); SPARSE REPRESENTATION; SUBSPACE LEARNING;

DISCRIMINANT ANALYSIS; PRINCIPAL COMPONENT ANALYSIS;

GESTURE RECOGNITION;

EID: 84857999484     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2011.12.028     Document Type: Article

References (52)

1. V. Kellokumpu, M. Pietikainen, J. Heikkilä, Human activity recognition using sequences of postures, in: Proceedings of the Machine Vision Applications, Tsukuba Science City, Japan, 2005, pp. 570573.
2. K. Tran, I. Kakadiaris, S. Shah, Fusion of human posture feature for continuous action recognition, in: Proceedings of the European Conference on Computer Vision Workshop on Sign, Gesture, and Activity, Crete, Greece, 2010.
3. R. Poppe A survey on vision-based human action recognition Image and Vision Computing 28 6 2010 976 990
4. M. Andriluka, S. Roth, B. Schiele, Pictorial structures revisited: people detection and articulated pose estimation, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Miami, FL, 2009, pp. 10141021.
5. P. Felzenszwalb, and D. Huttenlocher Pictorial structures for object recognition International Journal of Computer Vision 61 1 2005 55 79
6. B. Sapp, C. Jordan, B. Taskar, Adaptive pose priors for pictorial structures, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, 2010, pp. 422429.
7. J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma Robust face recognition via sparse representation IEEE Transactions on Pattern Analysis and Machine Intelligence 2009 210 227
8. G. Shakhnarovich, and B. Moghaddam Face recognition in subspaces Handbook of Face Recognition 2005 Springer 141 168
9. M. Turk, and A. Pentland Eigenfaces for recognition Journal of Cognitive Neuroscience 3 1 1991 71 86
10. P. Belhumeur, J. Hespanha, and D. Kriegman Eigenfaces vs. fisherfaces: recognition using class specific linear projection IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 1997 711 720 (Pubitemid 127762263)
11. D.M. Gavrila The visual analysis of human movement: a survey Computer Vision and Image Understanding 73 1 1999 82 98
12. T. Moeslund, A. Hilton, and V. Krger A survey of advances in vision-based human motion capture and analysis Computer Vision and Image Understanding 104 2006 90 126 (Pubitemid 44573873)
13. D. Weinland, R. Ronfard, and E. Boyer A survey of vision-based methods for action representation, segmentation and recognition Computer Vision and Image Understanding 115 2 2011 224 241
14. A. Bobick, and J. Davis The recognition of human movement using temporal templates IEEE Transactions on Pattern Analysis and Machine Intelligence 23 3 2001 257 267 (Pubitemid 32286632)
15. M. Blank, L. Gorelick, E. Shechtman, M. Irani, R. Basri, Actions as space-time shapes, in: Proceedings of the IEEE International Conference on Computer Vision, Beijing, China, 2005, pp. 13951402.
16. M. Ziaeefard, H. Ebrahimnezhad, Hierarchical human action recognition by normalized-polar histogram, in: Proceedings of the International Conference Pattern Recognition, Istanbul, Turkey, 2010, pp. 37203723.
17. A. Efros, A. Berg, G. Mori, J. Malik, Recognizing action at a distance, in: Proceedings of the International Conference on Computer Vision, Nice, France, 2003, pp. 726733.
18. S. Ali, and M. Shah Human action recognition in videos using kinematic features and multiple instance learning IEEE Transactions on Pattern Analysis and Machine Intelligence 32 2 2010 288 303
19. A. Ali, J. Aggarwal, Segmentation and recognition of continuous human activity, in: Proceedings of the IEEE Workshop on Detection and Recognition of Events in Video, Vancouver, BC, Canada, 2001, pp. 2835.
20. S. Eickeler, A. Kosmala, G. Rigoll, Hidden Markov model based continuous online gesture recognition, in: Proceedings of the International Conference on Pattern Recognition, Washington, DC, USA, 1998, pp. 12061208.
21. Y. Iwai, H. Shimizu, M. Yachida, Real-time context-based gesture recognition using HMM and automaton, in: Proceedings of the IEEE International Conference on Computer Vision Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, Corfu, Greece, 1999, pp. 127134.
22. I. Laptev On space-time interest points International Journal of Computer Vision 64 23 2005 107 123 (Pubitemid 41314645)
23. P. Dollar, V. Rabaud, G. Cottrell, S. Belongie, Behavior recognition via sparse spatio-temporal features, in: Proceedings of the IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, Beijing, China, 2005, pp. 6572.
24. J. Niebles, L. Fei-Fei, A hierarchical model of shape and appearance for human action classification, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Los Alamitos, CA, USA, 2007, pp. 18.
25. E. Shechtman, M. Irani, Space-time behavior based correlation, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, 2005, pp. 405412.
26. T. Kobayashi, N. Otsu, Action and simultaneous multiple-person identification using cubic higher-order local auto-correlation, in: Proceedings of the International Conference on Pattern Recognition, vol. 4, Washington, DC, USA, 2004, pp. 741744.
27. S. Belongie, J. Malik, and J. Puzicha Shape matching and object recognition using shape contexts IEEE Transactions on Pattern Analysis and Machine Intelligence 24 4 2002 509 522 (Pubitemid 34448769)
28. G. Johansson Visual perception of biological motion and a model for its analysis Perception & Psychophysics 1 1973 201 211
29. C. Thurau, V. Hlavac, Pose primitive based human action recognition in videos or still images, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA, 2008, pp. 18.
30. N. Ikizler, and P. Duygulu Histogram of oriented rectangles: a new pose descriptor for human action recognition Image and Vision Computing 27 2009 1515 1526
31. Y. Wang, and G. Mori Learning a discriminative hidden part model for human action recognition Proceedings of the Neural Information Processing Systems 2008 1721 1728
32. W. Yang, Y. Wang, G. Mori, Recognizing human actions from still images with latent poses, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, 2010, pp. 20302037.
33. B. Yao, and L. Fei-Fei Modeling mutual context of object and human pose in humanobject interaction activities Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2010 17 24
34. S. Maji, L. Bourdev, J. Malik, Action recognition from a distributed representation of pose and appearance, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Springs, CO, 2011, pp. 31773184.
35. E. Amaldi, and V. Kann On the approximability of minimizing nonzero variables or unsatisfied relations in linear systems Theoretical Computer Science 209 12 1998 237 260 (Pubitemid 128450440)
36. 1-norm near-solution approximates the sparsest near-solution Communications on Pure and Applied Mathematics 59 7 2006 907 934
37. S. Wright, R. Nowak, M. Figueiredo, Sparse reconstruction by separable approximation, in: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Las Vegas, NV, USA, 2008, pp. 33733376.
38. W. Zhao, R. Chellappa, A. Krishnaswamy, Discriminant analysis of principal components for face recognition, in: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, Washington, DC, USA, 1998, pp. 336341.
39. C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local SVM approach, in: Proceedings of the 17th International Conference on Pattern Recognition, vol. 3, Cambridge, UK, 2004, pp. 3236.
40. M. Rodriguez, J. Ahmed, M. Shah, Action MACH: a spatio-temporal maximum average correlation height filter for action recognition, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, AK, 2008, pp. 18.
41. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, A. Blake, Real-time human pose recognition in parts from single depth images, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Springs, CO, 2011, pp. 12971304.
42. A. Gilbert, J. Illingworth, R. Bowden, Fast realistic multi-action recognition using mined dense spatio-temporal features, in: Proceedings of the IEEE International Conference on Computer Vision, Kyoto, 2009, pp. 925931.
43. M. Bregonzio, S. Gong, T. Xiang, Recognizing action as clouds of space-time interest points, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Miami, FL, 2009, pp. 19481955.
44. T. Kim, S. Wong, R. Cipolla, Tensor canonical correlation analysis for action classification, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, 2007, pp. 18.
45. I. Laptev, M. MarszaŁek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, AK, 2008, pp. 18.
46. J. Liu, J. Luo, M. Shah, Recognizing realistic actions from videos in the wild, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Miami, FL, 2009, pp. 19962003.
47. A. Yao, J. Gall, L. Van Gool, A hough transform-based voting framework for action recognition, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, 2010, pp. 20612068.
48. A. Kovashka, K. Grauman, Learning a hierarchy of discriminative space-time neighborhood features for human action recognition, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, 2010, pp. 20462053.
49. M. Kaaniche, F. Bremond, Gesture recognition by learning local motion signatures, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Los Alamitos, CA, USA, 2010, pp. 27452752.
50. L. Cao, Z. Liu, T. Huang, Cross-dataset action detection, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, 2010, pp. 19982005.
51. L. Yeffet, L. Wolf, Local trinary patterns for human action recognition, in: Proceedings of the IEEE International Conference on Computer Vision, Kyoto, Japan, 2009, pp. 492497.
52. H. Wang, M. Ullah, A. Kläser, I. Laptev, C. Schmid, Evaluation of local spatio-temporal features for action recognition, in: Proceedings of the British Machine Vision Conference, London, UK, 2009, pp. 127138.