Compressive sequential learning for action similarity labeling

IEEE Transactions on Image Processing

Volumn 25, Issue 2, 2016, Pages 756-769

  Qin, Jie ^a   Liu, Li ^b   Zhang, Zhaoxiang ^c   Wang, Yunhong ^a   Shao, Ling ^b  

^a BEIHANG UNIVERSITY   (China)

^b NORTHUMBRIA UNIVERSITY   (United Kingdom)

^c Chinese Academy of Sciences   (China)

Author keywords

Action recognition; Action similarity labeling; Boosting; Pair matching; Sparse random projection

Indexed keywords

ADAPTIVE BOOSTING; CLASSIFICATION (OF INFORMATION); COMPRESSED SENSING; ENCODING (SYMBOLS); ITERATIVE METHODS; MATRIX ALGEBRA; MOTION ESTIMATION; SIGNAL RECONSTRUCTION;

ACTION RECOGNITION; BOOSTING; HUMAN-ACTION RECOGNITION; LOW-DIMENSIONAL SPACES; MEASURING SIMILARITIES; PAIR MATCHING; RESTRICTED ISOMETRY PROPERTIES; SPARSE RANDOM PROJECTIONS;

GESTURE RECOGNITION;

EID: 85009494321     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2508600     Document Type: Article

References (46)

1. I. Everts, J. C. van Gemert, and T. Gevers, "Evaluation of color spatiotemporal interest points for human action recognition, " IEEE Trans. Image Process., vol. 23, no. 4, pp. 1569-1580, Apr. 2014.
2. M. Yu, L. Liu, and L. Shao, "Structure-preserving binary representations for RGB-D action recognition, " IEEE Trans. Pattern Anal. Mach. Intell., doi: 10.1109/TPAMI.2015.2491925.
3. K. Guo, P. Ishwar, and J. Konrad, "Action recognition from video using feature covariance matrices, " IEEE Trans. Image Process., vol. 22, no. 6, pp. 2479-2494, Jun. 2013.
4. F. Zhu and L. Shao, "Weakly-supervised cross-domain dictionary learning for visual recognition, " Int. J. Comput. Vis., vol. 109, nos. 1-2, pp. 42-59, Aug. 2014.
5. A. Oikonomopoulos, I. Patras, and M. Pantic, "Spatiotemporal localization and categorization of human actions in unsegmented image sequences, " IEEE Trans. Image Process., vol. 20, no. 4, pp. 1126-1140, Apr. 2011.
6. L. Shao, L. Liu, and M. Yu, "Kernelized multiview projection for robust action recognition, " Int. J. Comput. Vis., 2015, doi: 10.1007/s11263-015-0861-6.
7. L. Liu, L. Shao, X. Li, and K. Lu, "Learning spatio-temporal representations for action recognition: A genetic programming approach, " IEEE Trans. Cybern., doi: 10.1109/TCYB.2015.2399172.
8. L. Shao, X. Zhen, D. Tao, and X. Li, "Spatio-temporal Laplacian pyramid coding for action recognition, " IEEE Trans. Cybern., vol. 44, no. 6, pp. 817-827, Jun. 2014.
9. O. Kliper-Gross, T. Hassner, and L. Wolf, "The action similarity labeling challenge, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 3, pp. 615-621, Mar. 2012.
10. L. Cheng, "Riemannian similarity learning, " in Proc. 30th Int. Conf. Mach. Learn., vol. 28. 2013, pp. 540-548.
11. O. Kliper-Gross, T. Hassner, and L. Wolf, "One shot similarity metric learning for action recognition, " in Proc. 1st Int. Conf. Similarity-Based Pattern Recognit., 2011, pp. 31-45.
12. I. Kotsia and I. Patras, "Exploring the similarities of neighboring spatiotemporal points for action pair matching, " in Proc. 11th Asian Conf. Comput. Vis., 2013, pp. 624-635.
13. X. Peng, Y. Qiao, Q. Peng, and Q. Wang, "Large margin dimensionality reduction for action similarity labeling, " IEEE Signal Process. Lett., vol. 21, no. 8, pp. 1022-1025, Aug. 2014.
14. O. Kliper-Gross, Y. Gurovich, T. Hassner, and L. Wolf, "Motion interchange patterns for action recognition in unconstrained videos, " in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 256-269.
15. Y Hanani, N. Levy, and L. Wolf, "Evaluating new variants of motion interchange patterns, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), Jun. 2013, pp. 263-268.
16. L. Wolf, Y. Hanani, and T. Hassner, "A piggyback representation for action recognition, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), Jun. 2014, pp. 520-525.
17. E. J. Candès and T. Tao, "Decoding by linear programming, " IEEE Trans. Inf. Theory, vol. 51, no. 12, pp. 4203-4215, Dec. 2005.
18. H. Jégou, M. Douze, C. Schmid, and P. Perez, "Aggregating local descriptors into a compact image representation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 3304-3311.
19. T. Trzcinski, M. Christoudias, P. Fua, and V. Lepetit, "Boosting binary keypoint descriptors, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 2874-2881.
20. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting, " J. Comput. Syst. Sci., vol. 55, no. 1, pp. 119-139, Aug. 1997.
21. L. Liu, M. Yu, and L. Shao, "Projection bank: From high-dimensional data to medium-length binary codes, " in Proc. IEEE Int. Conf. Comput. Vis., pp. 2821-2829, Dec. 2015.
22. L. Liu and L. Shao, "Sequential compact code learning for unsupervised image hashing, " IEEE Trans. Neural Netw. Learn. Syst., doi: 10.1109/TNNLS.2015.2495345.
23. L. Liu, M. Yu, and L. Shao, "Unsupervised local feature hashing for image similarity search, " IEEE Trans. Cybern., doi: 10.1109/TCYB.2015.2480966.
24. F. Perronnin, J. Sánchez, and T. Mensink, "Improving the Fisher kernel for large-scale image classification, " in Proc. 11th Eur. Conf. Comput. Vis. (ECCV), 2010, pp. 143-156.
25. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld, "Learning realistic human actions from movies, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2008, pp. 1-8.
26. I. Laptev, "On space-time interest points, " Int. J. Comput. Vis., vol. 64, nos. 2-3, pp. 107-123, 2005.
27. H. Wang, A. Klaser, C. Schmid, and C.-L. Liu, "Action recognition by dense trajectories, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 3169-3176.
28. H. Wang, A. Klaser, C. Schmid, and C.-L. Liu, "Dense trajectories and motion boundary descriptors for action recognition, " Int. J. Comput. Vis., vol. 103, no. 1, pp. 60-79, May 2013.
29. N. Dalal, B. Triggs, and C. Schmid, "Human detection using oriented histograms of flow and appearance, " in Proc. 9th Eur. Conf. Comput. Vis., 2006, pp. 428-441.
30. T. Mikolov, K. Chen, G. Corrado, and J. Dean, "Efficient estimation of word representations in vector space, " in Proc. ICLR Workshop, 2013.
31. R. E. Schapire, "The strength of weak learnability, " Mach. Learn., vol. 5, no. 2, pp. 197-227, 1990.
32. Y. Freund, "Boosting a weak learning algorithm by majority, " Inf. Comput., vol. 121, no. 2, pp. 256-285, Sep. 1995.
33. R. E. Schapire and Y. Singer, "Improved boosting algorithms using confidence-rated predictions, " Mach. Learn., vol. 37, no. 3, pp. 297-336, 1999.
34. J. Friedman, T. Hastie, and R. Tibshirani, "Additive logistic regression: A statistical view of boosting, " Ann. Statist., vol. 28, no. 2, pp. 337-407, 2000.
35. S.-F. Chang, W. Liu, J. Wang, R. Ji, and Y.-G. Jiang, "Supervised hashing with kernels, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 2074-2081.
36. J. Wang, S. Kumar, and S.-F. Chang, "Sequential projection learning for hashing with compact codes, " in Proc. 27th Int. Conf. Mach. Learn. (ICML), 2010, pp. 1127-1134.
37. D. Achlioptas, "Database-friendly random projections: Johnson-Lindenstrauss with binary coins, " J. Comput. Syst. Sci., vol. 66, no. 4, pp. 671-687, Jun. 2003.
38. R. Baraniuk, M. Davenport, R. DeVore, and M. Wakin, "A simple proof of the restricted isometry property for random matrices, " Constructive Approx., vol. 28, no. 3, pp. 253-263, Dec. 2008.
39. P. Li, T. J. Hastie, and K. W. Church, "Very sparse random projections, " in Proc. 12th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2006, pp. 287-296.
40. H. V. Nguyen and L. Bai, "Cosine similarity metric learning for face verification, " in Proc. 10th Asian Conf. Comput. Vis., 2011, pp. 709-720.
41. C. Schuldt, I. Laptev, and B. Caputo, "Recognizing human actions: A local SVM approach, " in Proc. IEEE/IAPR Int. Conf. Pattern Recognit., Aug. 2004, pp. 32-36.
42. H. Kuehne, H. Jhuang, E. Garrote, T. Poggio, and T. Serre, "HMDB: A large video database for human motion recognition, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Nov. 2011, pp. 2556-2563.
43. M. Marszalek, I. Laptev, and C. Schmid, "Actions in context, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 2929-2936.
44. D. H. Wolpert, "Stacked generalization, " Neural Netw., vol. 5, no. 2, pp. 241-259, 1992.
45. H. Wang and C. Schmid, "Action recognition with improved trajec-tories, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2013, pp. 3551-3558.
46. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines, " ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, pp. 27:1-27:27, 2011. [Online]. Available: http://www.csie.ntu.edu. tw/~cjlin/libsvm