Fast action retrieval from videos via feature disaggregation

Computer Vision and Image Understanding

Volumn 156, Issue , 2017, Pages 104-116

  Qin, Jie ^a   Liu, Li ^b   Yu, Mengyang ^b   Wang, Yunhong ^a   Shao, Ling ^b  

^a BEIHANG UNIVERSITY   (China)

^b NORTHUMBRIA UNIVERSITY   (United Kingdom)

Author keywords

Feature disaggregation; Learning based hashing; Similarity search; Video retrieval

Indexed keywords

BINARY CODES; BINS; IMAGE RETRIEVAL; VIDEO RECORDING;

DISAGGREGATION; FEATURE DIMENSIONS; HASHING ALGORITHMS; LEARNING BASED HASHING; LEARNING SIMILARITY; SIMILARITY SEARCH; TEMPORAL INFORMATION; VIDEO RETRIEVAL;

NEAREST NEIGHBOR SEARCH;

EID: 84994741654     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2016.09.009     Document Type: Article

References (49)

1. Chen, C., Jafari, R., Kehtarnavaz, N., Improving human action recognition using fusion of depth camera and inertial sensors. IEEE Trans. Human Mach. Syst. 45:1 (2015), 51–61.
2. Chen, C., Liu, M., Zhang, B., Han, J., Jiang, J., Liu, H., 3d action recognition using multi-temporal depth motion maps and fisher vector. International Joint Conference on Artificial Intelligence (IJCAI), 2016.
3. Datar, M., Immorlica, N., Indyk, P., Mirrokni, V.S., Locality-sensitive hashing scheme based on p-stable distributions. Annual Symposium on Computational Geometry (SCG), 2004.
4. Ding, C., He, X., K-means clustering via principal component analysis. International Conference on Machine Learning (ICML), 2004.
5. Gong, Y., Kumar, S., Rowley, H.A., Lazebnik, S., Learning binary codes for high-dimensional data using bilinear projections. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013.
6. Gong, Y., Lazebnik, S., Iterative quantization: a procrustean approach to learning binary codes. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011.
7. He, K., Wen, F., Sun, J., K-means hashing: an affinity-preserving quantization method for learning binary compact codes. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013.
8. Heo, J.-P., Lee, Y., He, J., Chang, S.-F., Yoon, S.-E., Spherical hashing. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
9. Indyk, P., Motwani, R., Approximate nearest neighbors: towards removing the curse of dimensionality. ACM Symposium on Theory of Computing (STOC), 1998.
10. Jain, M., v. Gemert, J., Jgou, H., Bouthemy, P., Snoek, C.G.M., Action localization with tubelets from motion. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.
11. Jegou, H., Douze, M., Schmid, C., Perez, P., Aggregating local descriptors into a compact image representation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010.
12. Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., Fei-Fei, L., Large-scale video classification with convolutional neural networks. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.
13. Kuehne, H., Jhuang, H., Garrote, E., Poggio, T., Serre, T., HMDB: a large video database for human motion recognition. IEEE International Conference on Computer Vision (ICCV), 2011.
14. Kulis, B., Grauman, K., Kernelized locality-sensitive hashing. IEEE Trans. Pattern Anal. Mach. Intell. 34:6 (2012), 1092–1104.
15. Laptev, I., On space-time interest points. Int. J. Comput. Vis. 64:2 (2005), 107–123.
16. Lazebnik, S., Schmid, C., Ponce, J., Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2006.
17. Lee, Y., Heo, J.-P., Yoon, S.-E., Quadra-embedding: binary code embedding with low quantization error. Comput. Vis. Image Understand. 125 (2014), 214–222.
18. Lin, G., Shen, C., Suter, D., van den Hengel, A., A general two-step approach to learning-based hashing. IEEE International Conference on Computer Vision (ICCV), 2013.
19. Liu, L., Shao, L., Li, X., Lu, K., Learning spatio-temporal representations for action recognition: a genetic programming approach. IEEE Trans. Cybern. 46:1 (2016), 158–170.
20. Liu, L., Wang, L., A scalable unsupervised feature merging approach to efficient dimensionality reduction of high-dimensional visual data. IEEE International Conference on Computer Vision (ICCV), 2013.
21. Liu, L., Yu, M., Shao, L., Local feature binary coding for approximate nearest neighbor search. British Machine Vision Conference (BMVC), 2015.
22. Liu, L., Yu, M., Shao, L., Multiview alignment hashing for efficient image search. IEEE Trans. Image Process. 24:3 (2015), 956–966.
23. Liu, L., Yu, M., Shao, L., Projection bank: from high-dimensional data to medium-length binary codes. IEEE International Conference on Computer Vision (ICCV), 2015.
24. Liu, W., He, J., Chang, S.-F., Large graph construction for scalable semi-supervised learning. International Conference on Machine Learning (ICML), 2010, 679–686.
25. Liu, W., Mu, C., Kumar, S., Chang, S.-F., Discrete graph hashing. Annual Conference on Neural Information Processing Systems (NIPS), 2014.
26. Liu, W., Wang, J., Chang, S.-F., Hashing with graphs. International Conference on Machine Learning (ICML), 2011.
27. Liu, W., Wang, J., Ji, R., Jiang, Y.-G., Chang, S.-F., Supervised hashing with kernels. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
28. Marszałek, M., Laptev, I., Schmid, C., Actions in context. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009.
29. Oliva, A., Torralba, A., Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comput. Vis. 42:3 (2001), 145–175.
30. Perronnin, F., Liu, Y., SÃ!‘nchez, J., Poirier, H., Large-scale image retrieval with compressed fisher vectors. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010, 3384–3391.
31. Perronnin, F., Sánchez, J., Mensink, T., Improving the fisher kernel for large-scale image classification. European Conference on Computer Vision (ECCV), 2010.
32. Qin, J., Liu, L., Yu, M., Wang, Y., Shao, L., Fast action retrieval from videos via feature disaggregation. British Machine Vision Conference (BMVC), 2015.
33. Qin, J., Liu, L., Zhang, Z., Wang, Y., Shao, L., Compressive sequential learning for action similarity labeling. IEEE Trans. Image Process. 25:2 (2016), 756–769.
34. Raginsky, M., Lazebnik, S., Locality-sensitive binary codes from shift-invariant kernels. Annual Conference on Neural Information Processing Systems (NIPS), 2009.
35. Ramanathan, V., Li, C., Deng, J., Han, W., Li, Z., Gu, K., Song, Y., Bengio, S., Rosenberg, C., Fei-Fei, L., Learning semantic relationships for better action retrieval in images. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
36. Sanchez, J., Perronnin, F., High-dimensional signature compression for large-scale image classification. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, 1665–1672.
37. Shen, F., Shen, C., Liu, W., Shen, H.T., Supervised discrete hashing. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
38. Soomro, K., Idrees, H., Shah, M., Action localization in videos through context walk. IEEE International Conference on Computer Vision (ICCV), 2015.
39. Soomro, K., Zamir, A.R., Shah, M., UCF101: a dataset of 101 human actions classes from videos in the wild. CRCV-TR-12-01, 2012.
40. Wang, H., Kläser, A., Schmid, C., Liu, C.-L., Action recognition by dense trajectories. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, 3169–3176.
41. Wang, H., Schmid, C., Action recognition with improved trajectories. IEEE International Conference on Computer Vision (ICCV), 2013, 3551–3558.
42. Wang, J., Kumar, S., Chang, S.-F., Sequential projection learning for hashing with compact codes. International Conference on Machine Learning (ICML), 2010.
43. Wang, J., Kumar, S., Chang, S.-F., Semi-supervised hashing for large-scale search. IEEE Trans. Pattern Anal. Mach. Intell. 34:12 (2012), 2393–2406.
44. Wang, Q., Zhu, G., Yuan, Y., Statistical quantization for similarity search. Comput. Vis. Image Understand. 124:0 (2014), 22–30.
45. Wang, T., Wang, S., Ding, X., Detecting human action as the spatio-temporal tube of maximum mutual information. IEEE Trans. Circ. Syst. Video Technol. 24:2 (2014), 277–290.
46. Weiss, Y., Torralba, A., Fergus, R., Spectral hashing. Annual Conference on Neural Information Processing Systems (NIPS), 2009.
47. Xia, Y., He, K., Kohli, P., Sun, J., Sparse projections for high-dimensional binary codes. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, 3332–3339.
48. Yu, F.X., Kumar, S., Gong, Y., Chang, S.-F., Circulant binary embedding. International Conference on Machine Learning (ICML), 2014.
49. Zha, H., He, X., Ding, C., Gu, M., Simon, H.D., Spectral relaxation for k-means clustering. Annual Conference on Neural Information Processing Systems (NIPS), 2001.