Learning latent spatio-temporal compositional model for human action recognition

MM 2013 - Proceedings of the 2013 ACM Multimedia Conference

Volumn , Issue , 2013, Pages 263-272

  Liang, Xiaodan ^a   Lin, Liang ^a   Cao, Liangliang ^b  

^a SUN YAT SEN UNIVERSITY   (China)

^b IBM RESEARCH   (United States)

Author keywords

Action recognition; And or graph; Structural learning; Video understanding

Indexed keywords

ACTION RECOGNITION; AND- OR GRAPH; COMPOSITIONAL MODELING; HUMAN-ACTION RECOGNITION; SPATIO-TEMPORAL STRUCTURES; STRUCTURAL CONFIGURATIONS; STRUCTURAL LEARNING; VIDEO UNDERSTANDING;

GESTURE RECOGNITION; ITERATIVE METHODS;

MOTION ESTIMATION;

EID: 84887476984     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2502081.2502089     Document Type: Conference Paper

References (47)

1. M. Albanese, R. Chellappa, N. P. Cuntoor, V. Moscato, A. Picariello, V. S. Subrahmanian, and O. Udrea. A constrained probabilistic petri net framework for human activity detection in video. IEEE Transactions on Multimedia, 10(6):982-996, 2008.
2. J. F. Allen and G. Ferguson. Actions and events in interval temporal logic. J. Log. Comput., 4(5):531-579, 1994.
3. M. R. Amer, D. Xie, M. Zhao, S. Todorovic, and S. C. Zhu. Cost-sensitive top-down/bottom-up inference for multiscale activity recognition. In ECCV (4), pages 187-200, 2012.
4. W. Brendel and S. Todorovic. Learning spatiotemporal graphs of human activities. In ICCV, pages 778-785, 2011.
5. L. Cao, Z. Liu, and T. S. Huang. Cross-dataset action detection. In CVPR, pages 1998-2005, 2010.
6. W. Choi, K. Shahid, and S. Savarese. Learning context for collective activity recognition. In CVPR, 2011.
7. P. Dollár, V. Rabaud, G. Cottrell, and S. Belongie. Behavior recognition via sparse spatio-temporal features. In VS-PETS, October 2005.
8. X. Duan, L. Lin, and H. Chao. Discovering video shot categories by unsupervised stochastic graph partition. IEEE Transactions on Multimedia, 15(1):167-180, 2013.
9. T. V. Duong, H. H. Bui, D. Q. Phung, and S. Venkatesh. Activity recognition and abnormality detection with the switching hidden semi-markov model. In CVPR (1), pages 838-845, 2005.
10. P. F. Felzenszwalb, R. B. Girshick, D. A. McAllester, and D. Ramanan. Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell., 32(9):1627-1645, 2010.
11. A. Gupta, P. Srinivasan, J. Shi, and L. S. Davis. Understanding videos, constructing plots learning a visually grounded storyline model from annotated videos. In CVPR, pages 2012-2019, 2009.
12. N. Ikizler-Cinbis and S. Sclaroff. Object, scene and actions: Combining multiple features for human action recognition. In ECCV (1), pages 494-507, 2010.
13. L. Jiang, A. G. Hauptmann, and G. Xiang. Leveraging high-level and low-level features for multimedia event detection. In ACM Multimedia, pages 449-458, 2012.
14. Y.-G. Jiang, Q. Dai, X. Xue, W. Liu, and C.-W. Ngo. Trajectory-based modeling of human actions with motion reference points. In ECCV (5), 2012.
15. A. Kläser, M. Marszalek, and C. Schmid. A spatio-temporal descriptor based on 3d-gradients. In BMVC, 2008.
16. I. Laptev. On space-time interest points. International Journal of Computer Vision, 64(2-3):107-123, 2005.
17. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld. Learning realistic human actions from movies. In CVPR, 2008.
18. Z. Li, Y. Fu, T. S. Huang, and S. Yan. Real-time human action recognition by luminance field trajectory analysis. In ACM Multimedia, pages 671-676, 2008.
19. L. Lin, H. Gong, L. Li, and L. Wang. Semantic event representation and recognition using syntactic attribute graph grammar. Pattern Recognition Letters, 30(2):180-186, 2009.
20. L. Lin, X. Wang, W. Yang, and J. Lai. Learning contour-fragment-based shape model with and-or tree representation. In CVPR, pages 135-142, 2012.
21. L. Lin, T. Wu, J. Porway, and Z. Xu. A stochastic graph grammar for compositional object representation and recognition. Pattern Recognition, 42(7):1297-1307, 2009.
22. J. Liu, J. Luo, and M. Shah. Recognizing realistic actions from videos. In CVPR, pages 1996-2003, 2009.
23. Z. Ma, Y. Yang, Y. Cai, N. Sebe, and A. G. Hauptmann. Knowledge adaptation for ad hoc multimedia event detection with few exemplars. In ACM Multimedia, pages 469-478, 2012.
24. M. Marszalek, I. Laptev, and C. Schmid. Actions in context. In CVPR, 2009.
25. J. C. Niebles, C.-W. Chen, and F.-F. Li. Modeling temporal structure of decomposable motion segments for activity classification. In ECCV (2), pages 392-405, 2010.
26. M. Raptis, I. Kokkinos, and S. Soatto. Discovering discriminative action parts from mid-level video representations. In CVPR, pages 1242-1249, 2012.
27. M. S. Ryoo and J. K. Aggarwal. Spatio-temporal relationship match: Video structure comparison for recognition of complex human activities. In ICCV, pages 1593-1600, 2009.
28. S. Sadanand and J. J. Corso. Action bank: A high-level representation of activity in video. In CVPR, pages 1234-1241, 2012.
29. S. Satkin and M. Hebert. Modeling the temporal extent of actions. In ECCV (1), pages 536-548, 2010.
30. P. Scovanner, S. Ali, and M. Shah. A 3-dimensional sift descriptor and its application to action recognition. In ACM Multimedia, pages 357-360, 2007.
31. Z. Si, M. Pei, B. Yao, and S.-C. Zhu. Unsupervised learning of event and-or grammar and semantics from video. In ICCV, pages 41-48, 2011.
32. Y. Song, L.-P. Morency, and R. Davis. Multi-view latent variable discriminative models for action recognition. In CVPR, pages 2120-2127, 2012.
33. Y. Song, S. Tang, Y.-T. Zheng, T.-S. Chua, Y. Zhang, and S. Lin. Exploring probabilistic localized video representation for human action recognition. Multimedia Tools Appl., 58(3):663-685, 2012.
34. J. Sun, X. Wu, S. Yan, L. F. Cheong, T.-S. Chua, and J. Li. Hierarchical spatio-temporal context modeling for action recognition. In CVPR, pages 2004-2011, 2009.
35. K. Tang, F.-F. Li, and D. Koller. Learning latent temporal structure for complex event detection. In CVPR, pages 1250-1257, 2012.
36. H. Wang, A. Kläser, C. Schmid, and C.-L. Liu. Action recognition by dense trajectories. In CVPR, pages 3169-3176, 2011.
37. S. Wang, Y. Yang, Z. Ma, X. Li, C. Pang, and A. G. Hauptmann. Action recognition by exploring data distribution and feature correlation. In CVPR, pages 1370-1377, 2012.
38. X. Wang and L. Lin. Dynamical and-or graph learning for object shape modeling and detection. In NIPS, pages 242-250, 2012.
39. Y. Wang and G. Mori. Hidden part models for human action recognition: Probabilistic versus max margin. IEEE Trans. Pattern Anal. Mach. Intell., 33(7):1310-1323, 2011.
40. B. Yao and S. C. Zhu. Learning deformable action templates from cluttered videos. In ICCV, pages 1507-1514, 2009.
41. G. Yu, J. Yuan, and Z. Liu. Real-time human action search using random forest based hough voting. In ACM Multimedia, pages 1149-1152, 2011.
42. J. Yuan, Z. Liu, and Y. Wu. Discriminative video pattern search for efficient action detection. IEEE Trans. Pattern Anal. Mach. Intell., 33(9):1728-1743, 2011.
43. A. L. Yuille and A. Rangarajan. The concave-convex procedure. Neural Computation, 15(4):915-936, 2003.
44. Y. Zhang, X. Liu, M.-C. Chang, W. Ge, and T. Chen. Spatio-temporal phrases for activity recognition. In ECCV (3), pages 707-721, 2012.
45. X. Zhou, X. Zhuang, S. Yan, S.-F. Chang, M. Hasegawa-Johnson, and T. S. Huang. Sift-bag kernel for video event analysis. In ACM Multimedia, pages 229-238, 2008.
46. G. Zhu, M. Yang, K. Yu, W. Xu, and Y. Gong. Detecting video events based on action recognition in complex scenes using spatio-temporal descriptor. In ACM Multimedia, pages 165-174, 2009.
47. S. C. Zhu and D. Mumford. A stochastic grammar of images. Foundations and Trends in Computer Graphics and Vision, 2(4):259-362, 2006.