Seeing what you're told: Sentence-guided activity recognition in video

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2014, Pages 732-739

  Siddharth, N ^a   Barbu, Andrei ^b   Siskind, Jeffrey Mark ^c  

^a STANFORD UNIVERSITY   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c PURDUE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SCIENCE; COMPUTERS; ELECTRICAL ENGINEERING; SOFTWARE ENGINEERING;

ACTION RECOGNITION; ACTIVITY RECOGNITION; BOTTOM UP; COMPOSITIONAL STRUCTURE; FOCUS OF ATTENTION; FOCUSING MECHANISMS; MULTI-MODAL; SPATIAL RELATIONS;

PATTERN RECOGNITION;

EID: 84911429020     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2014.99     Document Type: Conference Paper

References (19)

1. A. Barbu, A. Bridge, Z. Burchill, D. Coroian, S. Dickinson, S. Fidler, A. Michaux, S. Mussman, N. Siddharth, D. Salvi, L. Schmidt, J. Shangguan, J. M. Siskind, J. Waggoner, S. Wang, J. Wei, Y. Yin, and Z. Zhang. Video in sentences out. In Twenty-Eighth Conference on Uncertainty in Artificial Intelligence, pages 102-112, Aug. 2012.
2. A. Barbu, N. Siddharth, A. Michaux, and J. M. Siskind. Simultaneous object detection, tracking, and event recognition. Advances in Cognitive Systems, 2:203-220, Dec. 2012.
3. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The PASCAL Visual Object Classes (VOC) challenge. International Journal of Computer Vision, 88(2):303-338, June 2010.
4. A. Farhadi, M. Hejrati, M. Sadeghi, P. Young, C. Rashtchian, J. Hockenmaier, and D. Forsyth. Every picture tells a story: Generating sentences from images. In European Conference on Computer Vision, pages 15-29, Sept. 2010.
5. P. F. Felzenszwalb, R. B. Girshick, and D. McAllester. Cascade object detection with deformable part models. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 2241-2248, June 2010.
6. C. Fernández Tena, P. Baiget, X. Roca, and J. Gonzàlez. Natural language descriptions of human behavior from video sequences. In J. Hertzberg, M. Beetz, and R. Englert, editors, KI 2007: Advances in Artificial Intelligence, volume 4667 of Lecture Notes in Computer Science, pages 279-292. Springer Berlin Heidelberg, 2007.
7. A. Gupta, Y. Verma, and C. Jawahar. Choosing linguistics over vision to describe images. In Twenty-Sixth National Conference on Artificial Intelligence, pages 606-612, July 2012.
8. L. Jie, B. Caputo, and V. Ferrari. Who's doing what: Joint modeling of names and verbs for simultaneous face and pose annotation. In Neural Information Processing Systems Conference, pages 1168-1176, Dec. 2009.
9. M. U. G. Khan and Y. Gotoh. Describing video contents in natural language. In Workshop on Innovative Hybrid Approaches to the Processing of Textual Data, pages 27-35, Apr. 2012.
10. A. Kojima, T. Tamura, and K. Fukunaga. Natural language description of human activities from video images based on concept hierarchy of actions. International Journal of Computer Vision, 50(2):171-184, Nov. 2002.
11. I. Laptev, M. Marszałek, C. Schmid, and B. Rozenfeld. Learning realistic human actions from movies. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 1-8, June 2008.
12. P. Li and J. Ma. What is happening in a still picture? In First Asian Conference on Pattern Recognition, pages 32-36, Nov. 2011.
13. M. Mitchell, J. Dodge, A. Goyal, K. Yamaguchi, K. Stratos, X. Han, A. Mensch, A. C. Berg, T. L. Berg, and H. Daumé III. Midge: Generating image descriptions from computer vision detections. In 13th Conference of the European Chapter of the Association for Computational Linguistics, pages 747-756, Apr. 2012.
14. J. Sivic and A. Zisserman. Video Google: a text retrieval approach to object matching in videos. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 1470-1477, Oct. 2003.
15. A. J. Viterbi. Convolutional codes and their performance in communication systems. IEEE Transactions on Communication, 19(5):751-772, Oct. 1971.
16. Z. Wang, G. Guan, Y. Qiu, L. Zhuo, and D. Feng. Semantic context based refinement for news video annotation. Multimedia Tools and Applications, 67(3):607-627, Dec. 2013.
17. J. K. Wolf, A. M. Viterbi, and G. S. Dixon. Finding the best set of K paths through a trellis with application to multitarget tracking. IEEE Transactions on Aerospace and Electronic Systems, 25(2):287-296, Mar. 1989.
18. Y Yang, C. L. Teo, H. Daumé III, and Y Aloimonos. Corpus-guided sentence generation of natural images. In Conference on Empirical Methods in Natural Language Processing, pages 444-454, July 2011.
19. H. Yu and J. M. Siskind. Grounded language learning from video described with sentences. In 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 53-63, Aug. 2013.