Variational autoencoder for deep learning of images, labels and captions

Advances in Neural Information Processing Systems

Volumn , Issue , 2016, Pages 2360-2368

  Pu, Yunchen ^a   Gan, Zhe ^a   Henao, Ricardo ^a   Yuan, Xin ^b   Li, Chunyuan ^a   Stevens, Andrew ^a   Carin, Lawrence ^a  

^a USA   (United States)

^b LUCENT TECHNOLOGIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DEEP LEARNING; IMAGE RETRIEVAL; LEARNING SYSTEMS; NEURAL NETWORKS; RECURRENT NEURAL NETWORKS; SIGNAL ENCODING;

AUTO ENCODERS; COMPUTATIONALLY EFFICIENT; CONVOLUTIONAL NEURAL NETWORK; GENERATIVE MODEL; IMAGE ENCODERS; LATENT IMAGES; PRESENCE/ABSENCE; SEMI-SUPERVISED;

DEEP NEURAL NETWORKS;

EID: 85018916536     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (34)

1. Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. D. Jackel. Backpropa-gation applied to handwritten zip code recognition. Neural Computation, 1989.
2. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, 2012.
3. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. In ICLR, 2015.
4. C. Szegedy, W. Liui, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In CVPR, 2015.
5. O. Vinyals, A. Toshev, S. Bengio, and D. Erhan. Show and tell: A neural image caption generator. In CVPR, 2015.
6. K. Xu, J. L. Ba, R. Kiros, K. Cho, A. Courville, R. Salakhutdinov, R. S. Zemel, and Y. Bengio. Show, attend and tell: Neural image caption generation with visual attention. In ICML, 2015.
7. Q. Wu, C. Shen, A. Hengel, L. Liu, and A. Dick. What value do explicit high level concepts have in vision to language problems? In CVPR, 2016.
8. Y. Pu, X. Yuan, A. Stevens, C. Li, and L. Carin. A deep generative deconvolutional image model. In AISTATS, 2016.
9. Y. Pu, X. Yuan, and L. Carin. Generative deep deconvolutional learning. In ICLR workshop, 2015.
10. D. P. Kingma and M. Welling. Auto-encoding variational Bayes. In ICLR, 2014.
11. A. Mnih and K. Gregor. Neural variational inference and learning in belief networks. In ICML, 2014.
12. N. G. Polson and S. L. Scott. Data augmentation for support vector machines. Bayes. Anal., 2011.
13. T. D. Kulkarni, W.I. Whitney, P. Kohli, and J. B. Tenenbaum. Deep convolutional inverse graphics network. In NIPS, 2015.
14. A. Dosovitskiy, J. T. Springenberg, M. Tatarchenko, and T. Brox. Learning to generate chairs, tables and cars with convolutional networks. In CVPR, 2015.
15. C. Li, J. Zhu, T. Shi, and B. Zhang. Max-margin deep generative models. In NIPS, 2015.
16. V. Vapnik. The nature of statistical learning theory. Springer-Verlag New York, Inc., 1995.
17. R. Henao, X. Yuan, and L. Carin. Bayesian nonlinear SVMs and factor modeling. NIPS, 2014.
18. S Hochreiter and J. Schmidhuber. Long short-term memory. Neural Computation, 1997.
19. K. Cho, B. V. Merrienboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, and Y. Bengio. Learning phrase representations using rnn encoder-decoder for statistical machine translation. In EMNLP, 2014.
20. D. Kingma and J. Ba. Adam: A method for stochastic optimization. In ICLR, 2015.
21. I. Sutskever, O. Vinyals, and Q. V. Le. Sequence to sequence learning with neural networks. In NIPS, 2014.
22. F. Bastien, P. Lamblin, R. Pascanu, J. Bergstra, I. Goodfellow, A. Bergeron, N. Bouchard, D. Warde-Farley, and Y. Bengio. Theano: new features and speed improvements. In NIPS Workshop, 2012.
23. A. Krizhevsky and G. Hinton. Learning multiple layers of features from tiny images. Computer Science Department, University of Toronto, Tech. Rep, 2009.
24. F. Li, F. Rob, and P. Perona. Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories. Computer Vision and Image Understanding, 2007.
25. G. Griffin, A. Holub, and P. Perona. Caltech-256 object category dataset. 2007.
26. D.P. Kingma, S. Mohamed, D.J. Rezende, and M. Welling. Semi-supervised learning with deep generative models. In NIPS, 2014.
27. A. Rasmus, M. Berglund, M. Honkala, H. Valpola, and T. Raiko. Semi-supervised learning with ladder networks. In NIPS, 2015.
28. H. Fang, S. Gupta, F. Iandola, R. Srivastava, L. Deng, P. Dollár, J. Gao, X. He, M. Mitchell, J. C. Platt, C. L. Zitnick, and G. Zweig. From captions to visual concepts and back. In CVPR, 2015.
29. M. Hodosh, P. Young, and J. Hockenmaier. Framing image description as a ranking task: Data, models and evaluation metrics. Journal of Artificial Intelligence Research, 2013.
30. P. Young, A. Lai, M. Hodosh, and J. Hockenmaier. From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions. Transactions of the Association for Computational Linguistics, 2014.
31. T. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C. L. Zitnick. Microsoft COCO: Common objects in context. In ECCV, 2014.
32. K. Papineni, S. Roukos, T. Ward, and W. Zhu. Bleu: a method for automatic evaluation of machine translation. Transactions of the Association for Computational Linguistics, 2002.
33. S. Banerjee and A. Lavie. Meteor: An automatic metric for MT evaluation with improved correlation with human judgments. In ACL workshop, 2005.
34. R. Vedantam, Z. C. Lawrence, and D. Parikh. Cider: Consensus-based image description evaluation. In CVPR, 2015.