Nonparametric Variational Auto-Encoders for Hierarchical Representation Learning

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2017-October, Issue , 2017, Pages 5104-5112

  Goyal, Prasoon ^a   Hu, Zhiting ^a,b   Liang, Xiaodan ^a   Wang, Chenyu ^b   Xing, Eric P ^a,b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b Petuum Inc Inc   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; LEARNING SYSTEMS; NORMAL DISTRIBUTION; SEMANTICS; SIGNAL ENCODING;

CLUSTERING ACCURACY; GENERALIZATION CAPACITY; HIERARCHICAL REPRESENTATION; HIERARCHICAL STRUCTURES; REPRESENTATION SPACE; STANDARD NORMAL DISTRIBUTIONS; VARIATIONAL INFERENCE; VIDEO REPRESENTATIONS;

BAYESIAN NETWORKS;

EID: 85041927783     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2017.545     Document Type: Conference Paper

References (21)

1. D. M. Blei. Probabilistic topic models. Communications of the ACM, 55(4):77-84, 2012.
2. D. M. Blei, T. L. Griffiths, and M. I. Jordan. The nested Chinese restaurant process and Bayesian nonparametric inference of topic hierarchies. Journal of the ACM (JACM), 57(2):7, 2010.
3. S. R. Bowman, L. Vilnis, O. Vinyals, A. M. Dai, R. Jozefowicz, and S. Bengio. Generating sentences from a continuous space. arXiv preprint arXiv:1511.06349, 2015.
4. A. Dosovitskiy and T. Brox. Generating images with perceptual similarity metrics based on deep networks. In Advances in Neural Information Processing Systems, pages 658-666, 2016.
5. K. Gregor, I. Danihelka, A. Graves, D. J. Rezende, and D. Wierstra. Draw: A recurrent neural network for image generation. arXiv preprint arXiv:1502.04623, 2015.
6. G. E. Hinton and R. R. Salakhutdinov. Using deep belief nets to learn covariance kernels for Gaussian processes. In Advances in neural information processing systems, pages 1249-1256, 2008.
7. Z. Hu, Q. Ho, A. Dubey, and E. P. Xing. Large-scale distributed dependent nonparametric trees. In ICML, pages 1651-1659, 2015.
8. Z. Hu, Z. Yang, X. Liang, R. Salakhutdinov, and E. P. Xing. Controlled generation of text. In ICML, 2017.
9. Z. Hu, Z. Yang, R. Salakhutdinov, and E. P. Xing. On unifying deep generative models. arXiv preprint arXiv:1706.00550, 2017.
10. M. Johnson, D. K. Duvenaud, A. Wiltschko, R. P. Adams, and S. R. Datta. Composing graphical models with neural networks for structured representations and fast inference. In Advances in Neural Information Processing Systems, pages 2946-2954, 2016.
11. D. P. Kingma and M. Welling. Auto-encoding variational Bayes. arXiv preprint arXiv:1312.6114, 2013.
12. A. B. L. Larsen, S. K. Sønderby, H. Larochelle, and O. Winther. Autoencoding beyond pixels using a learned similarity metric. arXiv preprint arXiv:1512.09300, 2015.
13. A. Makhzani, J. Shlens, N. Jaitly, I. Goodfellow, and B. Frey. Adversarial autoencoders. arXiv preprint arXiv:1511.05644, 2015.
14. P. Over, J. Fiscus, G. Sanders, D. Joy, M. Michel, G. Awad, A. Smeaton, W. Kraaij, and G. Quenot. Trecvid 2014-an overview of the goals, tasks, data, evaluation mechanisms and metrics. In Proceedings of TRECVID, page 52, 2014.
15. C. E. Rasmussen. Gaussian processes for machine learning. 2006.
16. N. Siddharth, B. Paige, A. Desmaison, J.-W. v. d. Meent, F. Wood, N. D. Goodman, P. Kohli, and P. H. Torr. Learning disentangled representations in deep generative models. 2017.
17. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
18. T. Tieleman and G. Hinton. Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude. COURSERA: Neural networks for machine learning, 4(2), 2012.
19. J. Walker, C. Doersch, A. Gupta, and M. Hebert. An uncertain future: Forecasting from static images using variational autoencoders. In European Conference on Computer Vision, pages 835-851. Springer, 2016.
20. C.Wang and D. M. Blei. Variational inference for the nested Chinese restaurant process. In Advances in Neural Information Processing Systems, pages 1990-1998, 2009.
21. A. G.Wilson, Z. Hu, R. Salakhutdinov, and E. P. Xing. Deep kernel learning. In Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, pages 370-378, 2016.