A note on the evaluation of generative models

4th International Conference on Learning Representations, ICLR 2016 - Conference Track Proceedings

Volumn , Issue , 2016, Pages

  Theis, Lucas ^a   Van Den Oord, Aäron ^b   Bethge, Matthias ^a  

^a UNIVERSITY OF TÜBINGEN   (Germany)

^b GHENT UNIVERSITY   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

MACHINE LEARNING; TEXTURES;

GENERATIVE MODEL; HIGH-DIMENSIONAL; LOG LIKELIHOOD; PARZEN WINDOW ESTIMATE; SEMI- SUPERVISED LEARNING; TEXTURE SYNTHESIS; UNSUPERVISED FEATURE LEARNING; VISUAL FIDELITY;

SUPERVISED LEARNING;

EID: 85083950260     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. Bachman, P. and Precup, D. Variational Generative Stochastic Networks with Collaborative Shaping. Proceedings of the 32nd International Conference on Machine Learning, pp. 1964–1972, 2015.
2. Bengio, Y., Mesnil, G., Dauphin, Y., and Rifai, S. Better mixing via deep representations. In Proceedings of the 30th International Conference on Machine Learning, 2013a.
3. Bengio, Y., Thibodeau-Laufer, E., Alain, G., and Yosinski, J. Deep generative stochastic networks trainable by backprop, 2013b. arXiv:1306.1091.
4. Bishop, C. M. Pattern Recognition and Machine Learning. Springer, 2006.
5. Breuleux, O., Bengio, Y., and Vincent, P. Unlearning for better mixing. Technical report, Universite de Montreal, 2009.
6. Denton, E., Chintala, S., Szlam, A., and Fergus, R. Deep Generative Image Models using a Lapla-cian Pyramid of Adversarial Networks. arXiv.org, 2015.
7. Dosovitskiy, A., Springenberg, J. T., and Brox, T. Learning to Generate Chairs with Convolutional Neural Networks. In IEEE International Conference on Computer Vision and Pattern Recognition, 2015.
8. Dziugaite, G. K., Roy, D. M., and Ghahramani, Z. Training generative neural networks via maximum mean discrepancy optimization, 2015. arXiv:1505.0390.
9. Gatys, L. A., Ecker, A. S., and Bethge, M. Texture synthesis and the controlled generation of natural stimuli using convolutional neural networks, 2015. arXiv:1505.07376.
10. Gerhard, H. E., Wichmann, F. A., and Bethge, M. How sensitive is the human visual system to the local statistics of natural images? PLoS Computational Biology, 9(1), 2013.
11. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. Generative adversarial nets. In Advances in Neural Information Processing Systems 27, 2014.
12. Gregor, K., Danihelka, I., Graves, A., and Wierstra, D. DRAW: A recurrent neural network for image generation. In Proceedings of the 32nd International Conference on Machine Learning, 2015.
13. Gretton, A., Borgwardt, K. M., Rasch, M., Schölkopf, B., and Smola, A. J. A kernel method for the two-sample-problem. In Advances in Neural Information Processing Systems 20, 2007.
14. Gutmann, M. and Hyvärinen, A. Noise-contrastive estimation: A new estimation principle for unnormalized statistical models. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, 2010.
15. Hays, J. and Efros, A. A. Scene completion using millions of photographs. ACM Transactions on Graphics (SIGGRAPH), 26, 2007.
16. Hinton, G. E. Training Products of Experts by Minimizing Contrastive Divergence. Neural Computation, 14(8):1771–1800, 2002.
17. Hyvärinen, A., Hurri, J., and Hoyer, P. O. Natural Image Statistics: A Probabilistic Approach to Early Computational Vision. Springer, 2009.
18. Hyvärinen, A. Estimation of non-normalized statistical models using score matching. Journal of Machine Learning Research, pp. 695–709, 2005.
19. Kingma, D. P., Rezende, D. J., Mohamed, S., and Welling, M. Semi-supervised learning with deep generative models. In Advances in Neural Information Processing Systems 27, 2014.
20. Lacoste-Julien, S., Huszar, F., and Ghahramani, Z. Approximate inference for the loss-calibrated Bayesian. In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, 2011.
21. Lasserre, J. A., Bishop, C. M., and Minka, T. P. Principled hybrids of generative and discriminative models. In Proceedings of the Computer Vision and Pattern Recognition Conference, 2006.
22. Li, Y., Swersky, K., and Zemel, R. Generative moment matching networks. In Proceedings of the 32nd International Conference on Machine Learning, 2015.
23. Portilla, J. and Simoncelli, E. P. A parametric texture model based on joint statistics of complex wavelet coefficients. International Journal of Computer Vision, 40:49–70, 2000.
24. Shannon, C. E. A mathematical theory of communication. ACM SIGMOBILE Mobile Computing and Communications Review, 5(1):3–55, 2001.
25. Sohl-Dickstein, J., Battaglino, P., and DeWeese, M. R. Minimum Probability Flow Learning. In Proceedings of the 28th International Conference on Machine Learning, 2011.
26. Sohl-Dickstein, J., Weiss, E. A., Maheswaranathan, N., and Ganguli, S. Deep unsupervised learning using nonequilibrium thermodynamics. In Proceedings of the 32nd International Conference on Machine Learning, 2015.
27. Theis, L. and Bethge, M. Generative Image Modeling Using Spatial LSTMs. In Advances in Neural Information Processing Systems 28, 2015.
28. Uria, B., Murray, I., and Larochelle, H. RNADE: The real-valued neural autoregressive density-estimator. In Advances in Neural Information Processing Systems 26, 2013.
29. van den Oord, A. and Dambre, J. Locally-connected transformations for deep GMMs, 2015. Deep Learning Workshop, ICML.
30. van den Oord, A. and Schrauwen, B. Factoring Variations in Natural Images with Deep Gaussian Mixture Models. In Advances in Neural Information Processing Systems 27, 2014.
31. Wang, Z. and Bovik, A. C. Mean squared error: Love it or leave it? IEEE Signal Processing Magazine, 2009.
32. Welling, M. and Teh, Y. W. Bayesian Learning via Stochastic Gradient Langevin Dynamics. In Proceedings of the 28th International Conference on Machine Learning, 2011.