Early embedding and late reranking for video captioning

MM 2016 - Proceedings of the 2016 ACM Multimedia Conference

Volumn , Issue , 2016, Pages 1082-1086

  Dong, Jianfeng ^a   Li, Xirong ^b   Lan, Weiyu ^b   Huo, Yujia ^b   Snoek, Cees G M ^c  

^a ZHEJIANG UNIVERSITY   (China)

^b RENMIN UNIVERSITY OF CHINA   (China)

^c UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

MSR video to language challenge; Sentence reranking; Tag embedding; Video captioning

Indexed keywords

HUMAN LIKENESS; IMAGE CAPTIONING; MSR VIDEO TO LANGUAGE CHALLENGE; NOCV1; NON-TRIVIAL; PERFORMANCE METRICS; RE-RANKING; TAG EMBEDDING; VIDEO CAPTIONING;

EID: 84994631269     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2964284.2984064     Document Type: Conference Paper

References (16)

1. J. Dong, X. Li, and C. Snoek. Word2VisualVec: Cross-media retrieval by visual feature prediction. CoRR, abs/1604.06838, 2016.
2. H. Fang, S. Gupta, F. Iandola, R. K. Srivastava, L. Deng, P. Dollár, J. Gao, X. He, M. Mitchell, J. C. Platt, et al. From captions to visual concepts and back. In CVPR, 2015.
3. Y.-G. Jiang, Z. Wu, J. Wang, X. Xue, and S.-F. Chang. Exploiting feature and class relationships in video categorization with regularized deep neural networks. CoRR, abs/1502.07209, 2015.
4. X. Li and Q. Jin. Improving image captioning by concept-based sentence reranking. In PCM, 2016.
5. X. Li, C. Snoek, and M. Worring. Learning social tag relevance by neighbor voting. IEEE Trans. Multimedia, 11(7):1310-1322, 2009.
6. X. Li, T. Uricchio, L. Ballan, M. Bertini, C. Snoek, and A. D. Bimbo. Socializing the semantic gap: A comparative survey on image tag assignment, refinement, and retrieval. ACM Computing Surveys, 49(1):14:1-14:39, 2016.
7. P. Mettes, D. Koelma, and C. Snoek. The ImageNet shuffle: Reorganized pre-training for video event detection. In ICMR, 2016.
8. T. Mikolov, K. Chen, G. Corrado, and J. Dean. Efficient estimation of word representations in vector space. In ICLR, 2013.
9. Y. Pan, T. Mei, T. Yao, H. Li, and Y. Rui. Jointly modeling embedding and translation to bridge video and language. In CVPR, 2016.
10. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In CVPR, 2015.
11. D. Tran, L. Bourdev, R. Fergus, L. Torresani, and M. Paluri. Learning spatiotemporal features with 3d convolutional networks. In ICCV, 2015.
12. R. Vedantam, C. L. Zitnick, and D. Parikh. Cider: Consensus-based image description evaluation. In CVPR, 2015.
13. S. Venugopalan, M. Rohrbach, J. Donahue, R. Mooney, T. Darrell, and K. Saenko. Sequence to sequence-video to text. In ICCV, 2015.
14. O. Vinyals, A. Toshev, S. Bengio, and D. Erhan. Show and tell: A neural image caption generator. In CVPR, 2015.
15. J. Xu, T. Mei, T. Yao, and Y. Rui. MSR-VTT: A large video description dataset for bridging video and language. In CVPR, 2016.
16. H. Yu, J. Wang, Z. Huang, Y. Yang, and W. Xu. Video paragraph captioning using hierarchical recurrent neural networks. In CVPR, 2016.