Boosted key-frame selection and correlated pyramidal motion-feature representation for human action recognition

Pattern Recognition

Volumn 46, Issue 7, 2013, Pages 1810-1818

  Liu, Li ^a   Shao, Ling ^a   Rockett, Peter ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Action recognition; Boosted key frame selection; Correlograms; Pyramidal motion features

Indexed keywords

ACTION RECOGNITION; ADABOOST LEARNING ALGORITHMS; CORRELOGRAMS; HUMAN-ACTION RECOGNITION; KEY FRAME SELECTION; MOTION FEATURES; PROBABILISTIC DISTRIBUTION; TEMPORAL RELATIONSHIPS;

GESTURE RECOGNITION; LEARNING ALGORITHMS; MOTION ESTIMATION; OBJECT RECOGNITION; PROBABILITY DISTRIBUTIONS; VIDEO RECORDING;

FEATURE EXTRACTION;

EID: 84875258702     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.10.004     Document Type: Article

References (40)

1. P. Dollár, V. Rabaud, G. Cottrell, S. Belongie, Behavior recognition via sparse spatio-temporal features, in: IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, Beijing, China, 2005, pp. 65-72.
2. Y. Freund, R. Schapire, A decision-theoretic generalization of on-line learning and an application to boosting, in: 2nd European Conference on Computational Learning Theory (EuroCOLT'95), 1995, pp. 23-37.
3. E. Osuna, R. Freund, F. Girosi, Training support vector machines: an application to face detection, in: IEEE Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, 1997, pp. 130-136.
4. L. Shao, D. Wu, X. Chen, Action recognition using correlogram of body poses and spectral regression, in: 18th IEEE International Conference on Image Processing, Brussels, Belgium, 2011, pp. 209-212.
5. Y. Wang, and G. Mori Human action recognition by semilatent topic models IEEE Transactions on Pattern Analysis and Machine Intelligence 31 10 2009 1762 1774
6. D. Weinland, R. Ronfard, and E. Boyer A survey of vision-based methods for action representation, segmentation and recognition Computer Vision and Image Understanding 115 2 2011 224 241
7. A.A. Efros, A.C. Berg, G. Mori, J. Malik, Recognizing action at a distance, in: 9th IEEE International Conference on Computer Vision, vol. 2, Berkeley, CA, 2003, pp. 726-733.
8. S. Carlsson, J. Sullivan, Action recognition by shape matching to key frames, in: IEEE Computer Society Workshop on Models versus Exemplars in Computer Vision, vol. 1, Kauai, Hawaii, 2001, pp. 255-262.
9. Z. Zhao, A. Elgammal, Information theoretic key frame selection for action recognition, in: British Machine Vision Conference (BMVC 2008), Leeds, UK, 2008, pp. 95-104.
10. M. Cooper, J. Foote, Discriminative techniques for keyframe selection, in: IEEE International Conference on Multimedia and Expo, Amsterdam, The Netherlands, 2005, p. 4.
11. Y. Zhuang, Y. Rui, T. Huang, S. Mehrotra, Adaptive key frame extraction using unsupervised clustering, in: International Conference on Image Processing, vol. 1, Chicago, IL, 1998, pp. 866-870.
12. X. Cao, B. Ning, P. Yan, and X. Li Selecting key poses on manifold for pairwise action recognition IEEE Transactions on Industrial Informatics 8 1 2011 168 177
13. W. Gong, A. Bagdanov, F. Roca, J. González, Automatic key pose selection for 3D human action recognition, in: 6th International Conference on Articulated Motion and Deformable Objects (AMDO'10), 2010, pp. 290-299.
14. M. Zhou, H. Wei, Face verification using Gabor wavelets and AdaBoost, in: International Conference on Pattern Recognition, vol. 1, Hong Kong, 2006, pp. 404-407.
15. C. Shan, S. Gong, and P.W. McOwan Facial expression recognition based on local binary patterns a comprehensive study Image and Vision Computing 27 6 2009 803 816
16. S. Piyanuch, K. Deepak, H. Allen, Feature selection using AdaBoost for face expression recognition, in: 4th IASTED International Conference on Visualization, Imaging, and Image Processing, Marbella, Spain, 2004, pp. 261-286.
17. A. Fathi, G. Mori, Action recognition by learning mid-level motion features, in: IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, 2008, pp. 1-8.
18. V. Kellokumpu, G. Zhao, M. Pietikǎinen, Dynamic textures for human movement recognition, in: ACM International Conference on Image and Video Retrieval, Xi'an, China, 2010, pp. 470-476.
19. A. Treptow, A. Zell, Combining AdaBoost learning and evolutionary search to select features for real-time object detection, in: Congress on Evolutionary Computation, vol. 2, Portland, OR, 2004, pp. 2107-2113.
20. S. Paisitkriangkrai, C. Shen, and J. Zhang Fast pedestrian detection using a cascade of boosted covariance features IEEE Transactions on Circuits and Systems for Video Technology 18 8 2008 1140 1151
21. I. Laptev, P. Pérez, Retrieving actions in movies, in: International Conference on Computer Vision, Rio de Janeiro, Brazil, 2007, pp. 1-8.
22. B.D. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, in: DARPA Image Understanding Workshop, 1981, pp. 121-130.
23. A. Oliva, and A. Torralba Modeling the shape of the scene a holistic representation of the spatial envelope International Journal of Computer Vision 42 3 2001 145 175
24. D. Hubel, and T. Wiesel Receptive fields and functional architecture of monkey striate cortex Journal of Physiology 195 1 1968 215 243
25. M. Riesenhuber, and T. Poggio Hierarchical models of object recognition in cortex Nature Neuroscience 2 11 1999 1019 1025
26. D. Song, and D. Tao Biologically inspired feature manifold for scene classification IEEE Transactions on Image Processing 19 1 2010 174 184
27. G. De'ath, and K.E. Fabricius Classification and regression trees a powerful yet simple technique for ecological data analysis Ecology 81 11 2000 3178 3192
28. J. Huang, S.R. Kumar, W.J. Mitra, M. Zhu, R. Zabih, Image indexing using color correlograms, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, 1997, pp. 762-768.
29. D. Wu, L. Shao, Silhouette analysis based action recognition via exploiting human poses, IEEE Transactions on Circuits and Systems for Video Technology (2012). http://dx.doi.org/10.1109/TCSVT.2012.2203731.
30. C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local SVM approach, in: International Conference on Pattern Recognition, vol. 3, Cambridge, UK, 2004, pp. 32-36.
31. D. Weinland, E. Boyer, R. Ronfard, Action recognition from arbitrary views using 3D exemplars, in: 11th International Conference on Computer Vision, Rio de Janeiro, Brazil, 2007, pp. 1-7.
32. H. Kuehne, H.J.E.G.T. Poggio, T. Serre, HMDB: a large video database for human motion recognition, in: 13th IEEE International Conference on Computer Vision, Barcelona, Spain, 2011, pp. 2556-2563.
33. A. Yao, J. Gall, L.V. Gool, A Hough transform-based voting framework for action recognition, in: International Conference on Computer Vision and Pattern Recognition, 2010, pp. 2061-2068.
34. J.C. Niebles, H. Wang, and F. Li Unsupervised learning of human action categories using spatial-temporal words International Journal of Computer Vision 79 3 2008 299 318
35. S. Ji, W. Xu, M. Yang, K. Yu, 3D convolutional neural networks for human action recognition, in: International Conference on Machine Learning, Haifa, Israel, 2010.
36. H. Jhuang, T. Serre, L. Wolf, T. Poggio, A biologically inspired system for action recognition, in: International Conference on Computer Vision, Rio de Janeiro, Brazil, 2007, pp. 1-8.
37. J. Liu, M. Shah, Learning human actions via information maximization, in: IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, 2008, pp. 1-8.
38. D. Weinland, R. Ronfard, and E. Boyer Free viewpoint action recognition using motion history volumes Computer Vision and Image Understanding 104 2-3 2006 249 257
39. M. Varma, B.R. Babu, More generality in efficient multiple kernel learning, in: 26th Annual International Conference on Machine Learning, New York, NY, 2009, pp. 1065-1072.
40. X. Wu, D. Xu, L. Duan, J. Luo, Action recognition using context and appearance distribution features, in: IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, 2011, pp. 489-496.