Learning spatial and temporal extents of human actions for action detection

IEEE Transactions on Multimedia

Volumn 17, Issue 4, 2015, Pages 512-525

  Zhou, Zhong ^a   Shi, Feng ^a   Wu, Wei ^a  

^a BEIHANG UNIVERSITY   (China)

Author keywords

Action localization; action recognition; discriminative latent variable model; split and merge

Indexed keywords

EQUIVALENCE CLASSES; IMAGE RECOGNITION; MOTION ESTIMATION;

ACTION LOCALIZATION; ACTION RECOGNITION; DETECTION PERFORMANCE; LATENT VARIABLE MODELING; MANUAL ANNOTATION; SEGMENTATION RESULTS; SPLIT-AND-MERGE; STATE-OF-THE-ART METHODS;

CHEMICAL DETECTION;

EID: 84925135568     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2015.2404779     Document Type: Article

References (36)

1. Y. Tian, R. Sukthankar, and M. Shah, "Spatiotemporal deformable part models for action detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2013, pp. 2642-2649.
2. Y. Hu, L. Cao, F. Lv, S. Yan, Y. Gong, and T. S. Huang, "Action detection in complex scenes with spatial and temporal ambiguities," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Sep.-Oct. 2009, pp. 128-135.
3. S. Ma, J. Zhang, N. Ikizler-Cinbis, and S. Sclaroff, "Action recognition and localization by hierarchical space-time segments," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 2744-2751.
4. T. Lan, Y. Wang, and G. Mori, "Discriminative figure-centric models for joint action localization and recognition," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 2003-210.
5. M. Raptis, I. Kokkinos, and S. Soatto, "Discovering discriminative action parts from mid-level video representations," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2012, pp. 1242-1249.
6. F. Shi, Z. Zhou, J. Xiao, and W. Wu, "Robust trajectory clustering for motion segmentation," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 3088-3095.
7. A. Gaidon, Z. Harchaoui, and C. Schmid, "Recognizing activities with cluster-trees of tracklets," in Proc. Brit. Mach. Vis. Conf., Sep. 2012, pp. 30.1-30.13.
8. Y.-G. Jiang, Q. Dai, X. Xue, W. Liu, and C.-W. Ngo, "Trajectory-based modeling of human actions with motion reference points," in Proc. Eur. Conf. Comput. Vis., Oct. 2012, vol. 7576, pp. 425-438.
9. M. D. Rodriguez, J. Ahmed, and M. Shah, "Action MACH: A spatiotemporal maximum average correlation height filter for action recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2008, pp. 1-8.
10. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld, "Learning realistic human actions from movies," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2008, pp. 1242-1249.
11. H. Wang, A. Klaser, C. Schmid, and C.-L. Liu, "Action recognition by dense trajectories," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2011, pp. 3169-3176.
12. H. Wang and C. Schmid, "Action recognition with improved trajectories," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 3551-3558.
13. M. Jain, H. Jegou, and P. Bouthemy, "Better exploiting motion for better action recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2013, pp. 2555-2562.
14. S. Wu, O. Oreifej, and M. Shah, "Action recognition in videos acquired by a moving camera using motion decomposition of Lagrangian particle trajectories," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 1419-1426.
15. E. Vig, M. Dorr, and D. Cox, "Space-variant descriptor sampling for action recognition based on saliency and eye movements," in Proc. Eur. Conf. Comput. Vis., Oct. 2012, vol. 7578, pp. 84-97.
16. Y. Xie, H. Chang, Z. Li, L. Liang, X. Chen, and D. Zhao, "A unified framework for locating and recognizing human actions," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2011, pp. 25-32.
17. A. A. Efros, A. C. Berg, G. Mori, and J. Malik, "Recognizing action at a distance," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Oct. 2003, vol. 2, pp. 726-733.
18. W. Brendel and S. Todorovic, "Learning spatiotemporal graphs of human activities," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 778-785.
19. T. Brox and J. Malik, "Large displacement optical flow: Descriptor matching in variational motion estimation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 3, pp. 500-513, Mar. 2011.
20. T. Brox and J. Malik, "Object segmentation by long term analysis of point trajectories," in Proc. Eur. Conf. Comput. Vis., Sep. 2010, vol. 6315, pp. 282-295.
21. H. Jhuang, J. Gall, S. Zuffi, C. Schmid, and M. J. Black, "Towards understanding action recognition," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 3192-3199.
22. R. Arandjelovic and A. Zisserman, "Three things everyone should know to improve object retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2012, pp. 2911-2918.
23. S. Satkin and M. Hebert, "Modeling the temporal extent of actions," in Proc. Eur. Conf. Comput. Vis., Sep. 2010, vol. 6311, pp. 536-548.
24. N. Shapovalova, A. Vahdat, K. Cannons, T. Lan, and G. Mori, "Similarity constrained latent support vector machine: An application to weakly supervised action classification," in Proc. Eur. Conf. Comput. Vis., Oct. 2012, vol. 7578, pp. 55-68.
25. S. C. Hoi and M. R. Lyu, "A multimodal and multilevel ranking scheme for large-scale video retrieval," IEEE Trans. Multimedia, vol. 10, no. 4, pp. 607-619, Jun. 2008.
26. G. Yu, N. A. Goussies, J. Yuan, and Z. Liu, "Fast action detection via discriminative random forest voting and top-K subvolume search," IEEE Trans. Multimedia, vol. 13, no. 3, pp. 507-517, Jun. 2011.
27. Y. Ke, R. Sukthankar, and M. Hebert, "Event detection in crowded videos," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2007, pp. 1-8.
28. C.-N. Yu and T. Joachims, "Learning structural SVMs with latent variables," in Proc. Int. Conf. Mach. Learn., Jun. 2009, pp. 1169-1176.
29. T. Zhang, C. Xu, G. Zhu, S. Liu, and H. Lu, "A generic framework for video annotation via semi-supervised learning," IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1206-1219, Aug. 2012.
30. J. R. Magnus and H. Neudecker, Matrix Differential Calculus with Applications in Statistics and Econometrics, 2nd ed. New York, NY, USA: Wiley, 1999.
31. D. Tran and J. Yuan, "Max-margin structured output regression for spatio-temporal action localization," in Proc. Neural Inf. Process. Syst., Dec. 2012, pp. 350-358.
32. M. Jain, J. van Gemert, H. Jegou, P. Bouthemy, and C. Snoek, "Action localization with tubelets from motion," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2014, pp. 740-747.
33. D. Tran and J. Yuan, "Optimal spatio-temporal path discovery for video event detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2011, pp. 3321-3328.
34. J. R. R. Uijlings, K. E. A. van de Sande, T. Gevers, and A. W. M. Smeulders, "Selective search for object recognition," Int. J. Comput. Vis., vol. 104, no. 2, pp. 154-171, 2013.
35. E. Elhamifar and R. Vidal, "Sparse subspace clustering: Algorithm, theory, and applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 11, pp. 2765-2781, Nov. 2013.
36. A. M. Cheriyadat and R. J. Radke, "Non-negative matrix factorization of partial track data for motion segmentation," in Proc. IEEE Int. Conf. Comput. Vis., Sep.-Oct. 2009, pp. 865-872.