Learning and parsing video events with goal and intent prediction

Computer Vision and Image Understanding

Volumn 117, Issue 10, 2013, Pages 1369-1383

  Pei, Mingtao ^a,b   Si, Zhangzhang ^a   Yao, Benjamin Z ^a   Zhu, Song Chun ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b BEIJING INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Event parsing; Goal prediction; Information projection; Temporal And Or Graph (T AOG); Unsupervised learning

Indexed keywords

ATOMS; CONTEXT FREE GRAMMARS; CONTEXT FREE LANGUAGES; FORECASTING; LEARNING ALGORITHMS; MULTI AGENT SYSTEMS; STOCHASTIC SYSTEMS; UNSUPERVISED LEARNING;

BAYESIAN FRAMEWORKS; EVENT PARSING; HIERARCHICAL COMPOSITION; INFORMATION PROJECTIONS; PROBABILISTIC FRAMEWORK; SEQUENCE OF ACTIONS; STOCHASTIC CONTEXT FREE GRAMMAR; TEMPORAL AND-OR GRAPH (T-AOG);

SOFTWARE AGENTS;

EID: 84885389309     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2012.12.003     Document Type: Article

References (35)

1. G. Csibra, G. Gergely, Obsessed with goals: functions and mechanisms of teleological interpretation of actions in humans, Acta Psychol. (2007) 60-78. (Pubitemid 44932838)
2. C. L. Baker, R. Saxe, J. B. Tenenbaum, Action understanding as inverse planning, Cognition (2009) 329-349.
3. H. Chen, Z. J. Xu, Z. Q. Liu, S.-C. Zhu, Composite templates for cloth modeling and sketching, in: IEEE Conference on Computer Vision and Pattern Recognition, 2006.
4. S.-C. Zhu, D. Mumford, A stochastic grammar of images, Found. Trends Comput. Graph. Vision 2 (2006) 259-362.
5. A. Gupta, P. Srinivasan, J. Shi, L. S. Davis, Understanding videos, constructing plots: learning a visually grounded storyline model from annotated videos, in: IEEE Conference on Computer Vision and Pattern Recognition, 2009.
6. J. C. Earley, An Efficient Context-Free Parsing Algorithm, Ph. D. thesis, Carnegie Mellon Univ., 1968.
7. F. Han, S.-C. Zhu, Bottom-up/top-down image parsing with attribute grammar, IEEE Trans. Pattern Anal. Mach. Intel. 31 (1) (2009) 59-73.
8. M. Brand, N. Oliver, A. Pentland, Coupled hidden markov models for complex action recognition, in: IEEE Conference on Computer Vision and Pattern Recognition, 1997.
9. P. Natarajan, R. Nevatia, Coupled hidden semi markov models for activity recognition, in: IEEE Workshop on Motion and Video Computing, 2007.
10. K. Otsuka, J. Yamato, Y. Takemae, H. Murase, Conversation scene analysis with dynamic bayesian network based on visual head tracking, in: IEEE International Conference on Multimedia and Expo, 2006.
11. M. Al-Hames, G. Rigoll, A multi-modal mixed-state dynamic bayesian network for robust meeting event recognition from disturbed data, in: IEEE International Conference on Multimedia and Expo, 2005.
12. M. S. Ryoo, J. K. Aggarwal, Recognition of composite human activities through context-free grammar based representation, in: IEEE Conference on Computer Vision and Pattern Recognition, 2006.
13. Y. A. Ivanov, A. F. Bobick, Recognition of visual activities and interactions by stochastic parsing, IEEE Trans. Pattern Anal. Mach. Intel. 8 (2000) 852-872.
14. S. W. Joo, R. Chellappa, Recognition of multi-object events using attribute grammars, in: International Conference on Image Processing, 2006.
15. Z. Zhang, T. Tan, K. Huang, An extended grammar system for learning and recognizing complex visual events, IEEE Trans. Pattern Anal. Mach. Intel. (2011) 240-255.
16. A. Hakeem, Y. Sheikh, M. Shah, Casee: A hierarchical event representation for the analysis of videos, in: The Nineteenth National Conference on Artificial Intelligence, 2004.
17. B. Georis, M. Maziere, F. Bremond, M. Thonnat, A video interpretation platform applied to bank agency monitoring, in: 2nd Workshop of Intelligent Distributed Surveillance System, 2004.
18. M. Albanese, R. Chellappa, V. Moscato, V. Subrahmanian, Pads: a probabilistic activity detection framework for video data, IEEE Trans. Pattern Anal. Mach. Intel. (2010) 2246-2261.
19. J. Yuan, Y. Wu, M. Yang, From frequent itemsets to semantically meaningful visual patterns, in: SIGKDD, 2007.
20. F. Nater, H. Grabner, L. V. Gool, Exploiting simple hierarchies for unsupervised human behavior analysis, in: IEEE Conference on Computer Vision and Pattern Recognition, 2010.
21. D. Moore, I. Essa, Recognizing multitasked activities using stochastic contextfree grammar, in: AAAI, 2001.
22. M. Pei, Y. Jia, S.-C. Zhu, Parsing video events with goal inference and intent prediction, in: International Conference on Computer Vision, 2011.
23. Z. Si, M. Pei, B. Yao, S.-C. Zhu, Unsupervised learning of event and-or grammar and semantics from video, in: International Conference on Computer Vision, 2011.
24. A. Torralba, K. P. Murphy, W. T. Freeman, Sharing visual features for multiclass and multiview object detection, IEEE Trans. Pattern Anal. Mach. Intel. (2007) 854-869. (Pubitemid 46534781)
25. Y. Zhao, S.-C. Zhu, Image parsing with stochastic scene grammar, in: Neural Information Processing Systems (NIPS), 2011.
26. M. Rodriguez, S. Ali, T. Kanade, Tracking in unstructured crowded scenes, in: International Conference on Computer Vision, 2009.
27. B. Yao, S.-C. Zhu, Learning deformable action templates from cluttered videos, in: International Conference on Computer Vision, 2009.
28. J. F. Allen, G. Ferguson, Actions and events in interval temporal logic, J. Logic Comput. 4 (1994) 531-579.
29. W. Brendel, A. Fern, S. Todorovic, Probabilistic event logic for interval-based event recognition, in: IEEE Conference on Computer Vision and Pattern Recognition, 2011.
30. Y. N. Wu, Z. Si, H. Gong, S.-C. Zhu, Learning active basis model for object detection and recognition, Int. J. Comput. Vision 90 (2) (2010) 198-230.
31. S. D. Pietra, V. D. Pietra, J. Lafferty, Inducing features of random fields, IEEE Trans. Pattern Anal. Mach. Intel. 19 (4) (1997) 380-393. (Pubitemid 127762893)
32. S.-C. Zhu, Y. N. Wu, D. B. Mumford, Minimax entropy principle and its applications to texture modeling, Neural Comput. 9 (8) (1997) 1627-1660. (Pubitemid 127462299)
33. Z. Si, S.-C. Zhu, Learning and-or templates for object recognition and detection, IEEE Trans. Pattern Anal. Mach. Intel., in press.
34. K. Tu, V. Honavar, Unsupervised learning of probabilistic context-free grammar using iterative biclustering, in: Proceedings of 9th International Colloquium on Grammatical Inference (ICGI), 2008.
35. Y. Zhao, S.-C. Zhu, S. Luo, Co3 for ultra-fast and accurate interactive segmentation, in: ACM Multimedia, 2010.