Content-based retrieval of human actions from realistic video databases

Information Sciences

Volumn 236, Issue , 2013, Pages 56-65

  Jones, Simon ^a   Shao, Ling ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Content based video retrieval; Human action recognition; Relevance feedback

Indexed keywords

ACTION REPRESENTATIONS; CONTENT-BASED VIDEO RETRIEVAL; CONTENT-BASED VIDEO RETRIEVAL SYSTEMS; HUMAN-ACTION RECOGNITION; LOCAL FEATURE EXTRACTION; PRACTICAL SYSTEMS; RELEVANCE FEEDBACK; SPATIO-TEMPORAL;

CONTENT BASED RETRIEVAL; DATA PROCESSING; FEATURE EXTRACTION; GESTURE RECOGNITION; INFORMATION RETRIEVAL; SUPPORT VECTOR MACHINES; VIDEO RECORDING;

MOTION ESTIMATION;

EID: 84875720554     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2013.02.018     Document Type: Article

References (44)

1. F. Arman, R. Depommier, A. Hsu, M.Y. Chiu, Content-based browsing of video sequences, in: Proc. ACM Multimedia, 1994, pp. 97-103.
2. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri Actions as space-time shapes IEEE Trans. Pattern Anal. Mach. Intell. 29 2007 2247 2253 (Pubitemid 350124072)
3. O. Boiman, E. Shechtman, M. Irani, In defense of nearest-neighbor based image classification, in: Proc. IEEE Conf. Comput. Vision and Pattern Recognition, 2008, pp. 1-8.
4. C.C. Chen, M.S. Ryoo, J.K. Aggarwal, Ut-Tower Dataset: Aerial View Activity Classification Challenge, 2010, < http://cvrc.ece.utexas.edu/ SDHA2010/Aerial-View-Activity.html >.
5. J. Choi, W.J. Jeon, S.C. Lee, Spatio-temporal pyramid matching for sports videos, in: ACM SIGMM Int. Conf. Multimedia Information Retrieval, 2008, pp. 291-297.
6. C. Ding, A. Kamal, G. Denina, H. Nguyen, A. Ivers, B. Varda, C. Ravishankar, B. Bhanu, A. Roy-Chowdhury, Videoweb Activities Dataset, ICPR contest on Semantic Description of Human Activities (SDHA), 2010, < http://cvrc.ece.utexas.edu/SDHA2010/Wide-Area-Activity.html >.
7. P. Dollar, V. Rabaud, G. Cottrell, S. Belongie, Behavior recognition via sparse spatio-temporal features, in: Proc. IEEE Workshop Visual Surveillance and Performance Evaluation Tracking and Surveillance, 2005, pp. 65-72. (Pubitemid 46178025)
8. Y. Gao, M. Wang, R. Ji, Z. Zha, and J. Shen k-partite graph reinforcement and its application in multimedia information retrieval Inform. Sci. 194 2012 224 239
9. K. Grauman, T. Darrell, The pyramid match kernel: Discriminative classification with sets of image features, in: IEEE Int. Conf. Comput. Vision, 2005, pp. 1458-1465. (Pubitemid 44042350)
10. K. Grauman, T. Darrell, Approximate correspondences in high dimensions, in: Advances Neural Inform. Process. Syst., 2006.
11. P. Hong, Q. Tian, T.S. Huang, Incorporate support vector machines to content-based image retrieval with relevance feedback, in: Proc. IEEE Int. Conf. Image Process., vol. 3, 2000, pp. 750-753.
12. R. Jin, and L. Shao Retrieving human actions using spatio-temporal features and relevance feedback L. Shao, C. Shan, J. Luo, M. Etoh, Multimedia Interaction and Intelligent User Interfaces 2010 Springer-Verlag
13. S. Jones, L. Shao, Action retrieval with relevance feedback on youtube videos, in: International Conference on Internet Multimedia Computing and Service, 2011.
14. S. Jones, L. Shao, J. Zhang, and Y. Liu Relevance feedback for real-world human action retrieval Pattern Recog. Lett. 33 2011 4:446 4:452
15. A. Kläser, M. Marszałek, C. Schmid, A spatio-temporal descriptor based on 3D-Gradients, in: Proc. British Mach. Vision Conf., 2008, pp. 995-1004.
16. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, Learning Realistic Human Actions From Movies, in: Proc. IEEE Conf. Comput. Vision and Pattern Recognition, 2008, pp. 1-8.
17. S. Lazebnik, C. Schmid, J. Ponce, Beyond bags of features: spatial pyramid matching for recognizing natural scene categories, in: Proc. IEEE Conf. Comput. Vision and Pattern Recognition, 2006, pp. 2169-2178. (Pubitemid 44931582)
18. J. Liu, J. Luo, M. Shah, Recognizing realistic actions from videos "in the Wild", in: Proc. IEEE Conf. Comput. Vision and Pattern Recognition, 2009, pp. 1996-2003.
19. D.G. Lowe Distinctive image features from scale-invariant keypoints Int. J. Comput. Vision 60 2004 91 110
20. H. Luan, Y.T. Zheng, M. Wang, and T.S. Chua Visiongo: towards video retrieval with joint exploration of human and computer Inform. Sci. 181 2011 4197 4213
21. M. Marszalek, I. Laptev, C. Schmid, Actions in context, in: Proc. IEEE Conf. Comput. Vision and Pattern Recognition, 2009, pp. 2929-2936.
22. D.C.G. Pedronette, and R.Da S. Torres Exploiting pairwise recommendation and clustering strategies for image re-ranking Inform. Sci. 207 2012 19 34
23. M.D. Rodriguez, J. Ahmed, M. Shah, Action MACH: a spatio-temporal maximum average correlation height filter for action recognition, in: Proc. IEEE Conf. Comput. Vision and Pattern Recognition, 2008.
24. S.T. Roweis, and L.K. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 2000 2323 2326 (Pubitemid 32041578)
25. M.S. Ryoo, J.K. Aggarwal, Ut-Interaction Dataset, ICPR Contest on Semantic Description of Human Activities (SDHA), 2010, < http://cvrc.ece. utexas.edu/SDHA2010/Human-Interaction.html >.
26. G. Salton The SMART Retrieval System - Experiments in Automatic Document Processing 1971 Prentice-Hall, Inc. Upper Saddle River, NJ, USA
27. C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local SVM approach, in: Proc. Int. Conf. Pattern Recognition, vol. 3, 2004, pp. 32-36.
28. L. Shao, X. Chen, Histogram of body poses and spectral regression discriminant analysis for human action categorization, in: Proc. British Mach. Vision Conf., 2010, pp. 88.1-88.11.
29. L. Shao, Y. Du, Spatio-temporal shape contexts for human action retrieval, in: Proc. Int. Workshop Interactive Multimedia Consumer Electronics, 2009, pp. 43-50.
30. L. Shao, R. Mattivi, Feature detector and descriptor evaluation in human action recognition, in: Proc. ACM Int. Conf. Image and Video Retrieval, 2010, pp. 477-484.
31. D. Tao, X. Li, and S.J. Maybank Negative samples analysis in relevance feedback IEEE Trans. Knowl. Data Eng. 2007 568 580
32. D. Tao, X. Tang, X. Li, and Y. Rui Direct kernel biased discriminant analysis: a new content-based image retrieval relevance feedback algorithm IEEE Trans. Multimedia 8 2006 716 727 (Pubitemid 44144157)
33. D. Tao, X. Tang, X. Li, and X. Wu Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval IEEE Trans. Pattern Anal. Mach. Intell. 28 2006 1088 1099
34. X. Tian, D. Tao, X.S. Hua, and X. Wu Active reranking for web image search IEEE Trans. Image Process. 19 2010 805 820
35. X. Tian, D. Tao, Y. Rui, Sparse transfer learning for interactive video search, in: ACM Trans. Multimedia Computing, Commun. and Applicat., 2012.
36. S. Tong, E. Chang, Support vector machine active learning for image retrieval, in: Proc. ACM Multimedia, 2001, pp. 107-118. (Pubitemid 32962460)
37. J. Yamato, J. Ohya, K. Ishii, Recognizing human action in time-sequential images using hidden Markov model, in: Proc. IEEE Conf. Comput. Vision and Pattern Recognition, 1992, pp. 379-385.
38. R. Yan, A. Hauptmann, R. Jin, Negative pseudo-relevance feedback in content-based video retrieval, in: Proc. ACM Multimedia, ACM, 2003, pp. 343-346.
39. Y. Yang, F. Nie, D. Xu, J. Luo, Y. Zhuang, and Y. Pan A multimedia retrieval framework based on semi-supervised ranking and relevance feedback IEEE Trans. Pattern Anal. Mach. Intell. 34 2012 723 742
40. Y. Yang, Y. Zhuang, D. Tao, D. Xu, J. Yu, and J. Luo Recognizing cartoon image gestures for retrieval and interactive cartoon clip synthesis IEEE Trans. Circuits Syst. Video Technol. 20 2010 1745 1756
41. C. Yuan, X. Li, W. Hu, H. Wang, Human action recognition using pyramid vocabulary tree, in: Proc. Asian Conf. Comput. Vision, 2009, pp. 527-537.
42. C. Zhang, S. Member, and T. Chen An active learning framework for content-based information retrieval Proc. ACM Multimedia 4 2002 260 268
43. H.J. Zhang, J. Wu, D. Zhong, and S. Smoliar An integrated system for content-based video retrieval and browsing Pattern Recog. 30 1997 643 658 (Pubitemid 127419710)
44. Z. Zhang, R. Ji, H. Yao, P. Xu, J. Wang, Random sampling SVM based soft query expansion for image retrieval, in: Int. Conf. Image and Graphics, 2007, pp. 805-809.