Weakly-supervised alignment of video with text

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2015 International Conference on Computer Vision, ICCV 2015, Issue , 2015, Pages 4462-4470

  Bojanowski, P ^a   Lajugie, R ^a   Grave, E ^b   Bach, F ^a   Laptev, I ^a   Ponce, J ^c   Schmid, C ^a  

^a INRIA   (France)

^b Och Spine at New York Presbyterian Hospitals   (United States)

^c ECOLE NORMALE SUPÉRIEURE   (France)

Author keywords

[No Author keywords available]

Indexed keywords

COMBINATORIAL OPTIMIZATION; INTEGER PROGRAMMING; QUADRATIC PROGRAMMING; RELAXATION PROCESSES; VISUAL LANGUAGES;

ASSIGNMENT PROBLEMS; CONDITIONAL GRADIENT; INTEGER SOLUTIONS; MANUAL ANNOTATION; NATURAL LANGUAGES; QUADRATIC PROGRAMS; ROUNDING PROCEDURES; TEXTUAL DESCRIPTION;

COMPUTER VISION;

EID: 84973883674     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2015.507     Document Type: Conference Paper

References (47)

1. M. R. Amer, S. Todorovic, A. Fern, and S.-C. Zhu. Monte carlo tree search for scheduling activity recognition. In ICCV, 2013.
2. F. Bach and Z. Harchaoui. Diffrac: A discriminative and flexible framework for clustering. In NIPS, 2007.
3. K. Barnard, P. Duygulu, D. A. Forsyth, N. de Freitas, D. M. Blei, and M. I. Jordan. Matching words and pictures. JMLR, 2003.
4. M. Baroni, S. Bernardini, A. Ferraresi, and E. Zanchetta. The wacky wide web: A collection of very large linguistically processed web-crawled corpora. Language Ressources and Evaluation, 2009.
5. D. Bertsekas. Nonlinear Programming. Athena Scientific, 1999.
6. P. Bojanowski, F. Bach, I. Laptev, J. Ponce, C. Schmid, and J. Sivic. Finding actors and actions in movies. In ICCV, 2013.
7. P. Bojanowski, R. Lajugie, F. Bach, I. Laptev, J. Ponce, C. Schmid, and J. Sivic. Weakly supervised action labeling in videos under ordering constraints. In ECCV, 2014.
8. J. Donahue, L. A. Hendricks, S. Guadarrama, M. Rohrbach, S. Venugopalan, K. Saenko, and T. Darrell. Long-term recur-rent convolutional networks for visual recognition and description. ArXiv preprint arXiv:1411. 4389, 2014.
9. P. Duygulu, K. Barnard, J. F. G. d. Freitas, and D. A. Forsyth. Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In ECCV, 2002.
10. A. Farhadi, S. M. M. Hejrati, M. A. Sadeghi, P. Young, C. Rashtchian, J. Hockenmaier, and D. A. Forsyth. Every picture tells a story: Generating sentences from images. In ECCV, 2010.
11. M. Frank and P. Wolfe. An algorithm for quadratic programming. Naval Research Logistics Quarterly, 1956.
12. A. FRome, G. S. Corrado, J. Shlens, S. Bengio, J. Dean, M. Ranzato, and T. Mikolov. Devise: A deep visual-semantic embedding model. In NIPS, 2013.
13. A. Gaidon, Z. Harchaoui, and C. Schmid. Actom sequence models for efficient action detection. In CVPR, 2011.
14. Y. Gong, Q. Ke, M. Isard, and S. Lazebnik. A multi-view embedding space for modeling internet images, tags, and their semantics. IJCV, 2014.
15. E. Grave, G. Obozinski, and F. Bach. A markovian approach to distributional semantics with application to semantic compositionality. In COLING, 2014.
16. Y. Guo and D. Schuurmans. Convex relaxations of latent variable training. In NIPS, 2007.
17. D. Hardoon, S. Szedmak, and J. Shawe-Taylor. Canonical correlation analysis: An overview with application to learning methods. Neural computation, 16(12):2639-2664, 2004.
18. M. Hodosh, P. Young, and J. Hockenmaier. Framing image description as a ranking task: Data, models and evaluation metrics. JAIR, pages 853-899, 2013.
19. H. Hotelling. Relations between two sets of variates. Biometrika, 3:321-377, 1936.
20. A. Joulin, F. Bach, and J. Ponce. Discriminative clustering for image co-segmentation. In CVPR, 2010.
21. A. Joulin, F. Bach, and J. Ponce. Multi-class cosegmentation. In CVPR, 2012.
22. A. Joulin, K. Tang, and L. Fei-Fei. Efficient image and video co-localization with frank-wolfe algorithm. In ECCV, 2014.
23. A. Karpathy, A. Joulin, and F. F. F. Li. Deep fragment embeddings for bidirectional image sentence mapping. In NIPS, 2014.
24. S. Khamis, V. I. Morariu, and L. S. Davis. Combining perframe and per-track cues for multi-person action recognition. In ECCV, 2012.
25. S. Kwak, B. Han, and J. H. Han. Scenario-based video event recognition by constraint flow. In CVPR, 2011.
26. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld. Learning realistic human actions from movies. In CVPR, 2008.
27. B. Laxton, J. Lim, and D. J. Kriegman. Leveraging temporal, contextual and ordering constraints for recognizing complex activities in video. In CVPR, 2007.
28. R. Lebret, P. O. Pinheiro, and R. Collobert. Phrase-based image captioning. ArXiv preprint arXiv:1502. 03671, 2015.
29. J. Malmaud, J. Huang, V. Rathod, N. Johnston, A. Rabinovich, and K. Murphy. What's cookin'? interpreting cooking videos using text, speech and vision. NAACL, 2015.
30. C. D. Manning, M. Surdeanu, J. Bauer, J. Finkel, S. J. Bethard, and D. McClosky. The Stanford CoreNLP natural language processing toolkit. In ACL (Demo.), 2014.
31. M. Marszalek, I. Laptev, and C. Schmid. Actions in context. In CVPR, 2009.
32. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. Distributed representations of words and phrases and their compositionality. In NIPS, 2013.
33. V. Ordonez, G. Kulkarni, and T. L. Berg. Im2text: Describing images using 1 million captioned photographs. In NIPS, 2011.
34. L. R. Rabiner and B.-H. Juang. Fundamentals of Speech Recognition. Prentice Hall, 1993.
35. T. Rakthanmanon, B. Campana, A. Mueen, G. Batista, B. Westover, Q. Zhu, J. Zakaria, and E. Keogh. Addressing big data time series: Mining trillions of time series subsequences under dynamic time warping. ACM Trans. on Knowledge Discovery from Data (TKDD), 7(3):10, 2013.
36. V. Ramanathan, A. Joulin, P. Liang, and L. Fei-Fei. Linking people with "their" names using coreference resolution. In ECCV, 2014.
37. M. Regneri, M. Rohrbach, D. Wetzel, S. Thater, B. Schiele, and M. Pinkal. Grounding action descriptions in videos. TACL, 1:25-36, 2013.
38. M. Rohrbach, W. Qiu, I. Titov, S. Thater, M. Pinkal, and B. Schiele. Translating video content to natural language descriptions. In ICCV, 2013.
39. M. S. Ryoo and J. K. Aggarwal. Recognition of composite human activities through context-free grammar based representation. In CVPR, 2006.
40. H. Sakoe and S. Chiba. Dynamic programming algorithm optimization for spoken word recognition. Acoustics, Speech and Signal Processing, 1978.
41. S. Satkin and M. Hebert. Modeling the temporal extent of actions. In ECCV, 2010.
42. R. Socher and L. Fei-Fei. Connecting modalities: Semisupervised segmentation and annotation of images using unaligned text corpora. In CVPR, 2010.
43. R. Socher, A. Karpathy, Q. V. Le, C. D. Manning, and A. Y. Ng. Grounded compositional semantics for finding and describing images with sentences. TACL, 2014.
44. M. Tapaswi, M. Bäuml, and R. Stiefelhagen. "knock! knock! who is it?" probabilistic person identification in tv-series. In CVPR, 2012.
45. M. Tapaswi, M. Bäuml, and R. Stiefelhagen. Book2movie: Aligning video scenes with book chapters. In CVPR, 2015.
46. H. Wang and C. Schmid. Action recognition with improved trajectories. In ICCV, 2013.
47. F. Zhou and F. De La Torre. Canonical time warping for alignment of human behavior. NIPS, 2009.