Generating more realistic images using gated MRF's

Advances in Neural Information Processing Systems 23: 24th Annual Conference on Neural Information Processing Systems 2010, NIPS 2010

Volumn , Issue , 2010, Pages

  Ranzato, Marc Aurelio ^a   Mnih, Volodymyr ^a   Hinton, Geoffrey E ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

DE-NOISING; HIGH-RESOLUTION IMAGES; INDIRECT TASKS; INPAINTING; LATENT VARIABLE; MEASURING PERFORMANCE; NATURAL IMAGES; PROBABILISTIC MODELS; REALISTIC IMAGES; SET MODELS;

PIXELS;

EID: 85162052854     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. E.P. Simoncelli. Statistical modeling of photographic images. Handbook of Image and Video Processing, pages 431-441, 2005.
2. A. Hyvarinen, J. Karhunen, and E. Oja. Independent Component Analysis. John Wiley & Sons, 2001.
3. G.E. Hinton and R. R Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313(5786):504-507, 2006.
4. M. Ranzato and G.E. Hinton. Modeling pixel means and covariances using factorized third-order boltzmann machines. In CVPR, 2010.
5. M.J. Wainwright and E.P. Simoncelli. Scale mixtures of gaussians and the statistics of natural images. In NIPS, 2000.
6. S. Roth and M.J. Black. Fields of experts: A framework for learning image priors. In CVPR, 2005.
7. U. Schmidt, Q. Gao, and S. Roth. A generative perspective on mrfs in low-level vision. In CVPR, 2010.
8. S. Geman and D. Geman. Stochastic relaxation, gibbs distributions, and the bayesian restoration of images. PAMI, 6:721-741, 1984.
9. M. Welling, G.E. Hinton, and S. Osindero. Learning sparse topographic representations with products of student-t distributions. In NIPS, 2003.
10. S.C. Zhu and D. Mumford. Prior learning and gibbs reaction diffusion. PAMI, pages 1236-1250, 1997.
11. S. Osindero, M.Welling, and G. E. Hinton. Topographic product models applied to natural scene statistics. Neural Comp., 18:344-381, 2006.
12. S. Osindero and G. E. Hinton. Modeling image patches with a directed hierarchy of markov random fields. In NIPS, 2008.
13. Y. Karklin and M.S. Lewicki. Emergence of complex cell properties by learning to generalize in natural scenes. Nature, 457:83-86, 2009.
14. B. A. Olshausen and D. J. Field. Sparse coding with an overcomplete basis set: a strategy employed by v1? Vision Research, 37:3311-3325, 1997.
15. Y. W. Teh, M. Welling, S. Osindero, and G. E. Hinton. Energy-based models for sparse overcomplete representations. JMLR, 4:1235-1260, 2003.
16. Y. Weiss and W.T. Freeman. What makes a good model of natural images? In CVPR, 2007.
17. S. Roth and M. J. Black. Fields of experts. Int. Journal of Computer Vision, 82:205-229, 2009.
18. K. Gregor and Y. LeCun. Emergence of complex-like cells in a temporal product network with local receptive fields. arXiv:1006.0448, 2010.
19. C. Tang and C. Eliasmith. Deep networks for robust visual recognition. In ICML, 2010.
20. M. Ranzato, A. Krizhevsky, and G.E. Hinton. Factored 3-way restricted boltzmann machines for modeling natural images. In AISTATS, 2010.
21. N. Heess, C.K.I. Williams, and G.E. Hinton. Learning generative texture models with extended fields-ofexperts. In BMCV, 2009.
22. A. Krizhevsky. Learning multiple layers of features from tiny images, 2009. MSc Thesis, Dept. of Comp. Science, Univ. of Toronto.
23. A. Waibel, T. Hanazawa, G. Hinton, K. Shikano, and K. Lang. Phoneme recognition using time-delay neural networks. IEEE Acoustics Speech and Signal Proc., 37:328-339, 1989.
24. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
25. T. Tieleman and G.E. Hinton. Using fast weights to improve persistent contrastive divergence. In ICML, 2009.
26. R.M. Neal. Bayesian learning for neural networks. Springer-Verlag, 1996.
27. T. Tieleman. Training restricted boltzmann machines using approximations to the likelihood gradient. In ICML, 2008.
28. http://www.cs.berkeley.edu/projects/vision/grouping/segbench/.
29. M. Welling, M. Rosen-Zvi, and G.E. Hinton. Exponential family harmoniums with an application to information retrieval. In NIPS, 2005.
30. http://yann.lecun.com/exdb/mnist/.
31. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In Proc. ICML, 2009.
32. G.E. Hinton. Training products of experts by minimizing contrastive divergence. Neural Computation, 14:1771-1800, 2002.
33. A. Torralba, R. Fergus, and W.T. Freeman. 80 million tiny images: a large dataset for non-parametric object and scene recognition. PAMI, 30:1958-1970, 2008.