Generating natural-language video descriptions using text-mined knowledge

Proceedings of the 27th AAAI Conference on Artificial Intelligence, AAAI 2013

Volumn , Issue , 2013, Pages 541-547

  Krishnamoorthy, Niveda ^a   Malkarnenkar, Girish ^a   Mooney, Raymond ^a   Saenko, Kate ^b   Guadarrama, Sergio ^c  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^b UNIVERSITY OF MASSACHUSETTS LOWELL   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONTEXTUAL INFORMATION; REAL-WORLD; SELECTION ALGORITHM; TEXT CORPORA;

ARTIFICIAL INTELLIGENCE;

EID: 84893398951     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. Barbu, A.; Bridge, A.; Burchill, Z.; Coroian, D.; Dickinson, S.; Fidler, S.; Michaux, A.; Mussman, S.; Narayanaswamy, S.; Salvi, D.; et al. 2012. Video in sentences out. In UAI, 102-12.
2. Chang, C., and Lin, C. 2011. Libsvm: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology (TIST) 2(3):27.
3. Chen, S., and Goodman, J. 1999. An empirical study of smoothing techniques for language modeling. Computer Speech & Language 13(4):359-393.
4. Chen, D.; Dolan, W.; Raghavan, S.; Huynh, T.; Mooney, R.; Blythe, J.; Hobbs, J.; Domingos, P.; Kate, R.; Garrette, D.; et al. 2010. Collecting highly parallel data for paraphrase evaluation. JAIR 37:397-435.
5. De Marneffe, M.; MacCartney, B.; and Manning, C. 2006. Generating typed dependency parses from phrase structure parses. In Proceedings of LREC, volume 6, 449-454.
6. Ding, D.; Metze, F.; Rawat, S.; Schulam, P.; Burger, S.; Younessian, E.; Bao, L.; Christel, M.; and Hauptmann, A. 2012. Beyond audio and video retrieval: towards multimedia summarization. In Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, 2. ACM.
7. Farhadi, A.; Hejrati, M.; Sadeghi, M.; Young, P.; Rashtchian, C.; Hockenmaier, J.; and Forsyth, D. 2010. Every picture tells a story: Generating sentences from images. Computer Vision-ECCV 2010 15-29.
8. Felzenszwalb, P.; McAllester, D.; and Ramanan, D. 2008. A discriminatively trained, multiscale, deformable part model. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, 1-8. IEEE.
9. Khan, M., and Gotoh, Y. 2012. Describing video contents in natural language. EACL 2012 27.
10. Kojima, A.; Tamura, T.; and Fukunaga, K. 2002. Natural language description of human activities from video images based on concept hierarchy of actions. International Journal of Computer Vision 50(2):171-184.
11. Kulkarni, G.; Premraj, V.; Dhar, S.; Li, S.; Choi, Y.; Berg, A.; and Berg, T. 2011. Baby talk: Understanding and generating simple image descriptions. In CVPR, 1601-1608. IEEE.
12. Laptev, I., and Perez, P. 2007. Retrieving actions in movies. In Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on, 1-8. IEEE.
13. Laptev, I.; Marszalek, M.; Schmid, C.; and Rozenfeld, B. 2008. Learning realistic human actions from movies. In CVPR, 1-8. IEEE.
14. Lee, M.; Hakeem, A.; Haering, N.; and Zhu, S. 2008. Save: A framework for semantic annotation of visual events. In CVPRW, 1-8. IEEE.
15. Li, L.; Su, H.; Xing, E.; and Fei-Fei, L. 2010. Object bank: A high-level image representation for scene classification and semantic feature sparsification. Advances in Neural Information Processing Systems 24.
16. Li, S.; Kulkarni, G.; Berg, T.; Berg, A.; and Choi, Y. 2011. Composing simple image descriptions using web-scale ngrams. In Proceedings of the Fifteenth Conference on Computational Natural Language Learning, 220-228. Association for Computational Linguistics.
17. Lin, Y.; Michel, J.; Aiden, E.; Orwant, J.; Brockman, W.; and Petrov, S. 2012. Syntactic annotations for the google books ngram corpus. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics.
18. Motwani, T., and Mooney, R. 2012. Improving video activity recognition using object recognition and text mining. ECAI.
19. Ordonez, V.; Kulkarni, G.; and Berg, T. 2011. Im2text: Describing images using 1 million captioned photographs. In Proceedings of NIPS.
20. Packer, B.; Saenko, K.; and Koller, D. 2012. A combined pose, object, and feature model for action understanding. In CVPR, 1378-1385. IEEE.
21. Pauls, A., and Klein, D. 2011. Faster and smaller n-gram language models. In Proceedings of the 49th annual meeting of the Association for Computational Linguistics: Human Language Technologies, volume 1, 258-267.
22. Pedersen, T.; Patwardhan, S.; and Michelizzi, J. 2004. Wordnet:: Similarity: measuring the relatedness of concepts. In Demonstration Papers at HLT-NAACL 2004, 38-41. Association for Computational Linguistics.
23. Reddy, K., and Shah, M. 2012. Recognizing 50 human action categories of web videos. Machine Vision and Applications 1-11.
24. Schuldt, C.; Laptev, I.; and Caputo, B. 2004. Recognizing human actions: A local SVM approach. In Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on, volume 3, 32-36. IEEE.
25. Wang, H.; Klaser, A.; Schmid, C.; and Liu, C.-L. 2011. Action recognition by dense trajectories. In CVPR, 3169-3176. IEEE.
26. Yang, Y.; Teo, C. L.; Daumé, III, H.; and Aloimonos, Y. 2011. Corpus-guided sentence generation of natural images. In EMNLP, EMNLP '11, 444-454. Association for Computational Linguistics.
27. Yao, B., and Fei-Fei, L. 2010. Modeling mutual context of object and human pose in human-object interaction activities. In CVPR.
28. Yao, B.; Yang, X.; Lin, L.; Lee, M.; and Zhu, S. 2010. I2t: Image parsing to text description. Proceedings of the IEEE 98(8):1485-1508.
29. Zhang, J.; Marszałek, M.; Lazebnik, S.; and Schmid, C. 2007. Local features and kernels for classification of texture and object categories: A comprehensive study. International Journal of Computer Vision 73(2):213-238.