Phrase-based image captioning

32nd International Conference on Machine Learning, ICML 2015

Volumn 3, Issue , 2015, Pages 2085-2094

  Lebret, Rémi ^a   Pinheiro, Pedro O ^b   Collobert, Ronan ^c  

^a IDIAP RESEARCH INSTITUTE   (Switzerland)

^b EPFL   (Switzerland)

^c FACEBOOK AI RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTATIONAL LINGUISTICS; LEARNING ALGORITHMS; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; NEURAL NETWORKS; SYNTACTICS;

BILINEAR MODELS; CONVOLUTIONAL NEURAL NETWORK; IMAGE CAPTIONING; IMAGE REPRESENTATIONS; NATURAL LANGUAGE PROCESSING; SIMPLE MODELING; STATE OF THE ART; TEXTUAL DESCRIPTION;

COMPUTER VISION;

EID: 84970028761     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Chen, X. and Zitnick, C. L. Minds Eye: A Recurrent Visual Representation for Image Caption Generation. In IEEE International Concference on Computer Vision and Patter Recognition (CVPR), 2015.
2. Donahue, I., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Saenko, K., and Darrell, T. Long-term Recurrent Convolutional Networks for Visual Recognition and Description. arXiv preprint arXiv: 1411.4389, 2014.
3. Fang, H., Gupta, S., Iandola, F., Srivastava, R., Deng, L., Dollár, P., Gao, J., He, X., Mitchell, M., Piatt, J., Zitnick, C. L., and Zweig, G. From captions to visual concepts and back. In IEEE International Concference on Computer Vision and Patter Recognition (CVPR), 2015.
4. Hodosh, M., Young, P., and Hockenmaier, J. Framing image description as a ranking task: data, models and evaluation metrics. Journal of Artificial Intelligence Research, 2013.
5. Karpathy, A. and Fei-Fei, L. Deep Visual-Semantic Alignments for Generating Image Descriptions. In IEEE International Concference on Computer Vision and Patter Recognition (CVPR), 2015.
6. Kiros, R., Salakhutdinov, R., and Zemel, R. S. Unifying Visual-Semantic Embeddings with Multimodal Neural Language Models. arXiv preprint arXiv:1411.2539, 2014.
7. Kulkarni, G., Premraj, V., Dhar, S., Li, Siming, Choi, Yejin, Berg, A. C., and Berg, T. L. Baby Talk: Understanding and Generating Simple Image Descriptions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35 (12):2891-2903, 2013.
8. Kuznetsova, P., Ordonez, V., Berg, A. C., Berg, T. L., and Choi, Y. Collective Generation of Natural Image Descriptions. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 359-368. Association for Computational Linguistics, luly 2012.
9. Lebret, R. and Collobert, R. Rehabilitation of count-based models for word vector representations. In Gelbukh, Alexander (ed.), Computational Linguistics and Intelligent Text Processing, volume 9041 of Lecture Notes in Computer Science, pp. 417-429. Springer International Publishing, 2015.
10. Le Cun, Y., Bottou, L., Bengio, Y., and Haffner, P. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 1998.
11. Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C. L. Microsoft COCO: Common Objects in Context. In Computer Vision-ECCV2014, pp. 740-755. Springer, 2014.
12. Mao, I., Xu, W., Yang, Y., Wang, J., Huang, Z., and Yuille, A. L. Deep Captioning with Multimodal Recurrent Neural Networks (m-RNN). In International Conference on Learning Representations (ICLR), 2015.
13. Mikolov, T., Chen, K., Corrado, G., and Dean, I. Efficient Estimation of Word Representations in Vector Space. arXiv preprint arXiv:1301.3781, 2013a.
14. Mikolov, T., Sutskever, I., Chen, K., Corrado, G., and Dean, J. Distributed Representations of Words and Phrases and their Compositionality. In Advances in Neural Information Processing Systems, pp. 3111-3119. 2013b.
15. Mitchell, M., Han, X., Dodge, J., Mensch, A., Goyal, A., Berg, A., Yamaguchi, K., Berg, T., Stratos, K., and Daume, III, H. Midge: Generating Image Descriptions from Computer Vision Detections. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics, pp. 747-756. Association for Computational Linguistics, 2012.
16. Mnih, A. and Kavukcuoglu, Koray. Learning word em-beddings efficiently with noise-contrastive estimation. In Advances in Neural Information Processing Systems, pp. 2265-2273. 2013.
17. Papineni, K., Roukos, S., Ward, T., and Zhu, W.-J. BLEU: A Method for Automatic Evaluation of Machine Translation. In Proceedings of the 40th annual meeting on association for computational linguistics, pp. 311-318. Association for Computational Linguistics, 2002.
18. Pennington, J., Socher, R., and Manning, C. D. GloVe: Global Vectors for Word Representation. In Proceedings of the Empiricial Methods in Natural Language Processing (EMNLP 2014), volume 12, 2014.
19. Simonyan, K. and Zisserman, A. Very deep convolutional networks for large-scale image recognition. CoRR, 2014.
20. Socher, R., Karpathy, A., Le, Q. V., Manning, C. D., and Ng, A. Y. Grounded Compositional Semantics for Finding and Describing Images with Sentences. Transactions of the Association for Computational Linguistics, 2:207-218, 2014.
21. Srivastava, N. and Salakhutdinov, R. Multimodal Learning with Deep Boltzmann Machines. Journal of Machine Learning Research, 2014.
22. Venugopalan, S., Xu, H., Donahue, J., Rohrbach, M., Mooney, R. J., and Saenko, K. Translating Videos to Natural Language Using Deep Recurrent Neural Networks. arXiv preprint arXiv:1412.4729, 2014.
23. Vinyals, O., Toshev, A., Bengio, S., and Erhan, D. Show and tell: A neural image caption generator. arXiv preprint arXiv: 1411.4555, 2014.
24. Yao, B. Z., Yang, X., Lin, L., Lee, M. W., and Zhu, S. C. I2T: Image Parsing to Text Description. Proceedings of the IEEE, 98(8): 1485-1508, 2010.