Discriminative two-level feature selection for realistic human action recognition

Journal of Visual Communication and Image Representation

Volumn 24, Issue 7, 2013, Pages 1064-1074

  Wu, Qiuxia ^a,b   Wang, Zhiyong ^b   Deng, Feiqi ^a   Xia, Yong ^b   Kang, Wenxiong ^a   Feng, David Dagan ^b  

^a SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

^b UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Bag of features model; Maximal information compression index; Realistic human action recognition; Saliency map; Space time interest points; Support vector machine; Unsupervised codeword selection; Visual saliency

Indexed keywords

BAG-OF-FEATURES; CODEWORD SELECTION; HUMAN-ACTION RECOGNITION; MAXIMAL INFORMATION; SALIENCY MAP; SPACE-TIME INTEREST POINTS; VISUAL SALIENCY;

ALGORITHMS; GESTURE RECOGNITION; SUPPORT VECTOR MACHINES; VISUALIZATION;

FEATURE EXTRACTION;

EID: 84881193309     PISSN: 10473203     EISSN: 10959076     Source Type: Journal    
DOI: 10.1016/j.jvcir.2013.07.001     Document Type: Article

References (46)

1. P. Turaga, R. Chellappa, V.S. Subrahmanian, and O. Udrea Machine recognition of human activities: a survey IEEE Transactions on Circuits and Systems for Video Technology 18 11 2008 1473 1488
2. R. Poppe A survey on vision-based human action recognition Image and Vision Computing 28 6 2010 976 990
3. D. Weinland, R. Ronfard, and E. Boyer A survey of vision-based methods for action representation, segmentation and recognition Computer Vision and Image Understanding 115 2 2011 224 241
4. C. Schüldt, I. Laptev, B. Caputo, Recognizing human actions: a local svm approach, in: IEEE International Conference on Pattern Recognition (ICPR'04), vol. 3, 2004, pp. 32-36.
5. M. Blank, L. Gorelick, E. Shechtman, M. Irani, R. Basri, Actions as space-time shapes, in: IEEE International Conference on Computer Vision (ICCV'05), vol. 2, 2005, pp. 1395-1402. (Pubitemid 44042342)
6. D.N. Vizireanu, C. Pirnog, V. Lazarescu, and A. Vizireanu The skeleton structure-an improved compression algorithm with perfect reconstruction Journal of Digital Imaging 14 2 Suppl 1 2001 241 242 (Pubitemid 32794300)
7. R.M. Udrea, and N. Vizireanu Iterative generalization of morphological skeleton Journal of Electronic Imaging 16 1 2007 10501
8. S.A. Rahman, M.K.H. Leung, and S.-Y. Cho Human action recognition employing negative space features Journal of Visual Communication and Image Representation 24 3 2013 217 231
9. I.N. Junejo, and Z.A. Aghbari Using sax representation for human action recognition Journal of Visual Communication and Image Representation 23 6 2012 853 861
10. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, in: IEEE International Conference on Computer Vision and, Pattern Recognition (CVPR'08), 2008, pp. 1-8.
11. J. Liu, J. Luo, M. Shah, Recognizing realistic actions from videos in the wild, in: IEEE International Conference on Computer Vision and, Pattern Recognition (CVPR'09), 2009, pp. 1996-2003.
12. I. Laptev On space-time interest points International Journal of Computer Vision 64 2 2005 107 123 (Pubitemid 41314645)
13. M. Marszalek, I. Laptev, C. Schmid, Actions in context, in: IEEE International Conference on Computer Vision and, Pattern Recognition (CVPR'09), 2009, pp. 2929-2936.
14. K. Rapantzikos, Y. Avrithis, S. Kollias, Dense saliency-based spatiotemporal feature points for action recognition, in: IEEE International Conference on Computer Vision and, Pattern Recognition (CVPR'09), 2009, pp. 1454-1461.
15. C. Liu, Q. Huang, S. Jiang, L. Xing, Q. Ye, and W. Gao A framework for flexible summarization of racquet sports video using multiple modalities Computer Vision and Image Understanding 113 3 2009 415 424
16. D. Han, L. Bo, C. Sminchisescu, Selection and context for action recognition, in: IEEE International Conference on Computer Vision (ICCV '09), 2009, pp. 1933-1940.
17. L. Itti, C. Koch, and E. Niebur A model of saliency-based visual attention for rapid scene analysis IEEE Transactions on Pattern Analysis and Machine Intelligence 20 11 1998 1254 1259 (Pubitemid 128742001)
18. D. Walther, and C. Koch Modeling attention to salient proto-objects Neural Networks 19 9 2006 1395 1407 (Pubitemid 44708603)
19. F. Moosmann, D. Larlus, F. Jurie, Learning saliency maps for object categorization, in: ECCV International Workshop on the Representation and Use of Prior Knowledge in Vision, 2006.
20. T. Liu, J. Sun, N.-N. Zheng, X. Tang, H.-Y. Shum, Learning to detect a salient object, in: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR '07), 2007, pp. 1-8.
21. S. Lu, J. Zhang, Z. Wang, and D.D. Feng Fast human action classification and voi localization with enhanced sparse coding Journal of Visual Communication and Image Representation 24 2 2013 127 136
22. P. Mitra, C. Murthy, and S.K. Pal Unsupervised feature selection using feature similarity IEEE Transactions on Pattern Analysis and Machine Intelligence 24 3 2002 301 312 (Pubitemid 35289348)
23. J. Harel, C. Koch, and P. Perona Graph-based visual saliency Advances in Neural Information Processing Systems vol. 19 2007 MIT Press 545 552
24. K. Mikolajczyk, and C. Schmid A performance evaluation of local descriptors IEEE Transactions on Pattern Analysis and Machine Intelligence 27 10 2005 1615 1630 (Pubitemid 41555406)
25. I. Laptev, T. Lindeberg, Space-time interest points, in: IEEE International Conference on Computer Vision (ICCV'03), vol. 1, 2003, pp. 432-439.
26. P. Dollár, V. Rabaud, G. Cottrell, S. Belongie, Behavior recognition via sparse spatio-temporal features, in: IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, 2005, pp. 65-72. (Pubitemid 46178025)
27. M. Bregonzio, S. Gong, T. Xiang, Recognising action as clouds of space-time interest points, in: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR'09), 2009, pp. 1948-1955.
28. G. Zhu, M. Yang, K. Yu, W. Xu, Y. Gong, Detecting video events based on action recognition in complex scenes using spatio-temporal descriptor, in: ACM International Conference on Multimedia, 2009, pp. 165-174.
29. J. Sun, X. Wu, S. Yan, L.-F. Cheong, T.-S. Chua, J. Li, Hierarchical spatio-temporal context modeling for action recognition, in: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR'09), 2009, pp. 2004-2011.
30. J.K. Tsotsos, L. Itti, and G. Rees A brief and selective history of attention L. Itti, G. Rees, J.K. Tsotsos, Neurobiology of Attention 2005 Academic Press Burlington xxiii xxxii
31. H.-C. Shih, J.-N. Hwang, and C.-L. Huang Content-based attention ranking using visual and contextual attention model for baseball videos IEEE Transactions on Multimedia 11 2 2009 244 255
32. M.-C. Chi, C.-H. Yeh, and M.-J. Chen Robust region-of-interest determination based on user attention model through visual rhythm analysis IEEE Transactions on Circuits and Systems for Video Technology 19 7 2009 1025 1038
33. C. Koch, and S. Ullman Shifts in selective visual attention: towards the underlying neural circuitry Human Neurobiology 4 4 1985 219 227 (Pubitemid 16176695)
34. O.L. Meur, P.L. Callet, D. Barba, and D. Thoreau A coherent computational approach to model bottom-up visual attention IEEE Transactions on Pattern Analysis and Machine Intelligence 28 5 2006 802 817
35. P.L. Rosin A simple method for detecting salient regions Pattern Recognition 42 11 2009 2363 2371
36. F. Jurie, B. Triggs, Creating efficient codebooks for visual recognition, in: IEEE International Conference on Computer Vision (ICCV 2005), vol. 1, 2005, pp. 604-610. (Pubitemid 44055011)
37. G. Schindler, M. Brown, R. Szeliski, City-scale location recognition, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR '07), 2007, pp. 1-7.
38. S. Kim, I.S. Kweon, Simultaneous classification and visualword selection using entropy-based minimum description length, in: International Conference on Pattern Recognition (ICPR '06), vol. 1, 2006, pp. 650-653. (Pubitemid 46531986)
39. L. Wang, Toward a discriminative codebook: codeword selection across multi-resolution, in: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR '07), 2007, pp. 1-8.
40. L. Zhang, C. Chen, J. Bu, Z. Chen, S. Tan, and X. He Discriminative codeword selection for image representation A.C.M. International Conference on Multimedia, MM '10 2010 ACM New York, NY, USA 173 182
41. D. Gokalp, S. Aksoy, Scene classification using bag-of-regions representations, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR '07), 2007, pp. 1-8.
42. P.K. Mallapragada, R. Jin, A.K. Jain, Online visual vocabulary pruning using pairwise constraints, in: CVPR, 2010, pp. 3073-3080.
43. S. Zhang, Q. Tian, G. Hua, Q. Huang, and S. Li Descriptive visual words and visual phrases for image applications ACM International Conference on Multimedia (MM '09) 2009 ACM 75 84
44. J. Malik, and P. Perona Preattentive texture discrimination with early vision mechanisms Journal of the Optical Society of America A 7 5 1990 923 932
45. J. Yang, Y.-G. Jiang, A.G. Hauptmann, C.-W. Ngo, Evaluating bag-of-visual-words representations in scene classification, in: ACM International Workshop on Multimedia Information Retrieval, 2007, pp. 197-206.
46. C.-C. Chang, C.-J. Lin, LIBSVM: a library for support vector machines, 2001.