Modeling pixel means and covariances using factorized third-order Boltzmann machines

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2010, Pages 2551-2558

  Ranzato, Marc'Aurelio ^a   Hinton, Geoffrey E ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

BOLTZMANN MACHINES; CELL ARCHITECTURES; CELL COMPLEXES; DATA SETS; EXTRACTING FEATURES; GENERATIVE MODEL; HIDDEN UNITS; NATURAL IMAGES; PROBABILISTIC FRAMEWORK; PROBABILISTIC MODELS; RECOGNITION ACCURACY; THIRD-ORDER; YIELD STATE;

COMPUTER VISION; COVARIANCE MATRIX; EXTRACTION; PIXELS;

FEATURE EXTRACTION;

EID: 77955989954     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2010.5539962     Document Type: Conference Paper

References (33)

1. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle. Greedy layer-wise training of deep networks. In NIPS, 2007. 1
2. C. Bishop. Probabilistic principal component analysis. Journal of the Royal Statistical Society, Series B, 61:611-622, 1999. 1
3. N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In CVPR, 2005. 1
4. Y. Freund and D. Haussler. Unsupervised learning of distributions on binary vectors using two layer networks. Technical report, University of Calif. Santa Cruz, 1994. 1, 3
5. X. He, R. Zemel, and D. Ray. Learning and incorporating top-down cues in image segmentation. In ECCV, 2006. 1
6. N. Heess, C. Williams, and G. Hinton. Learning generative texture models with extended fields-of-experts. In BMCV, 2009. 7
7. G. Hinton. Training products of experts by minimizing contrastive divergence. Neural Computation, 14:1771-1800, 2002. 4
8. G. Hinton, P. Dayan, and M. Revow. Modeling the manifolds of images of handwritten digits. IEEE Transactions on Neural Networks, 8:65-74, 1997. 1
9. G. Hinton, S. Osindero, and Y.-W. Teh. A fast learning algorithm for deep belief nets. Neural Comp., 18:1527-1554, 2006. 7
10. G. Hinton and R. R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313(5786):504- 507, 2006. 1, 5
11. G. E. Hinton, S. Osindero, M. Welling, and Y. Teh. Unsupervised discovery of non-linear structure using contrastive backpropagation. Cognitive Science, 30:725-731, 2006. 4
12. K. Jarrett, K. Kavukcuoglu, M. Ranzato, and Y. LeCun. What is the best multi-stage architecture for object recognition? In ICCV, 2009. 1
13. Y. Karklin and M. Lewicki. Emergence of complex cell properties by learning to generalize in natural scenes. Nature, 457:83-86, 2009. 1, 2
14. K. Kavukcuoglu, M. Ranzato, R. Fergus, and Y. LeCun. Learning invariant features through topographic filter maps. In CVPR, 2009. 1
15. U. Koster and A. Hyvarinen. A two-layer ica-like model estimated by score matching. In ICANN, 2007. 1
16. A. Krizhevsky. Learning multiple layers of features from tiny images, 2009. MSc Thesis, Dept. of Comp. Science, Univ. of Toronto. 1, 2, 6, 7
17. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In Proc. ICML, 2009. 1
18. D. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 2004. 1, 7
19. R. Memisevic and G. Hinton. Learning to represent spatial transformations with factored higher-order boltzmann machines. Neural Comp., 2010. 7
20. R. Neal. Bayesian learning for neural networks. Springer- Verlag, 1996. 4
21. A. Oliva and A. Torralba. Modeling the shape of the scene: a holistic representation of the spatial envelope. IJCV, 42:145- 175, 2001. 1, 7
22. B. A. Olshausen and D. J. Field. Sparse coding with an overcomplete basis set: a strategy employed by v1? Vision Research, 37:3311-3325, 1997. 1
23. S. Osindero and G. E. Hinton. Modeling image patches with a directed hierarchy of markov random fields. In NIPS, 2008. 7
24. S. Osindero, M. Welling, and G. E. Hinton. Topographic product models applied to natural scene statistics. Neural Comp., 18:344-381, 2006. 2, 5, 7
25. R. Raina, A. Battle, H. Lee, B. Packer, and A. Ng. Selftaught learning: Transfer learning from unlabeled data. In ICML, 2007. 7
26. M. Ranzato, F. Huang, Y. Boureau, and Y. LeCun. Unsupervised learning of invariant feature hierarchies with applications to object recognition. In CVPR'07, 2007. 7
27. M. Ranzato, A. Krizhevsky, and G. Hinton. Factored 3-way restricted boltzmann machines for modeling natural images. In AISTATS, 2010. 2, 7
28. S. Roth and M. Black. Fields of experts: A framework for learning image priors. In CVPR, 2005. 1
29. T. Sejnowski. Higher-order boltzmann machines. In AIP Conf. proc., Neural networks for computing, 1986. 3
30. A. Torralba, R. Fergus, and W. Freeman. 80 million tiny images: a large dataset for non-parametric object and scene recognition. PAMI, 30:1958-1970, 2008. 6
31. A. Torralba, R. Fergus, and Y. Weiss. Small codes and large databases for recognition. In CVPR, 2008. 7
32. P. Vincent, H. Larochelle, Y. Bengio, and P. Manzagol. Extracting and composing robust features with denoising autoencoders. In ICML, 2008. 1
33. M. Wainwright and E. Simoncelli. Scale mixtures of gaussians and the statistics of natural images. In NIPS, 2000. 4