The hierarchical beta process for convolutional factor analysis and deep learning

Proceedings of the 28th International Conference on Machine Learning, ICML 2011

Volumn , Issue , 2011, Pages 361-368

  Chen, Bo ^a   Polatkan, Gungor ^b   Sapiro, Guillermo ^c   Dunson, David B ^d   Carin, Lawrence ^a  

^a Duke University   (United States)

^b Princeton University   (United States)

^c UNIVERSITY OF MINNESOTA   (United States)

^d Duke University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA SETS; DEEP LEARNING; FACTOR ANALYSIS; GIBBS SAMPLING; MODEL PARAMETERS; MULTI-LEVEL; MULTITASK LEARNING;

CLASSIFICATION (OF INFORMATION); DATA HANDLING; LEARNING SYSTEMS;

CONVOLUTION;

EID: 80053437590     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Adams, R.P., Wallach, H.M., and Ghahramani, Z. Learning the structure of deep sparse graphical models. In AISTATS, 2010.
2. Boureau, Y.L., Bach, F., LeCun, Y., and Ponce, J. Learning mid-level features for recognition. In CVPR, 2010.
3. Erhan, D., Bengio, Y., Courville, A., Manzagol, P.-A., Vincent, P., and Bengio, S. Why does unsupervised pretraining help deep learning? JMLR, 2010.
4. Griffiths, T. L. and Ghahramani, Z. Infinite latent feature models and the Indian buffet process. In NIPS, 2005.
5. Hinton, G.E., Osindero, S., and Teh, Y.W. A fast learning algorithm for deep belief nets. Neural Computation, 2006.
6. Jarrett, K., Kavukcuoglu, K., Ranzato, M., and LeCun, Y. What is the best multi-stage architecture for object recognition? In ICCV, 2009.
7. Jenatton, R., Mairal, J., Obozinski, G., and Bach, F. Proximal methods for sparse hierarchical dictionary learning. In ICML, 2010.
8. Lazebnik, S., Schmid, C., and Ponce, J. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In CVPR, 2006.
9. LeCun, Y., Bottou, L., Bengio, Y., and Haffher, P. Gradient-based learning applied to document recognition. Proc. IEEE, 1998.
10. Lee, H., Ekanadham, C., and Ng, A. Y. Sparse deep belief network model for visual area v2. In NIPS, 2008.
11. Lee, H., Grosse, R., Ranganath, R., and Ng, A. Y. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In ICML, 2009.
12. Mairal, J., Bach, F., Ponce, J., and Sapiro, G. Online dictionary learning for sparse coding. In ICML, 2009.
13. Norouzi, M., Ranjbar, M., and Mori, G. Stacks of convolutional restricted boltzmann machines for shift-invariant feature learning. In CVPR, 2009.
14. Paisley, J. and Carin, L. Nonparametric factor analysis with beta process priors. In ICML, 2009.
15. Puertas, G., Bornschein, J., and Lucke, J. The maximal causes of natural scenes are edge filters. In NIPS, 2010.
16. Ranzato, M., Poultney, C.S., Chopra, S., and LeCun, Y. Efficient learning of sparse representations with an energy-based model. In NIPS, 2006.
17. Thibaux, R. and Jordan, M.I. Hierarchical beta processes and the Indian buffet process. In AISTATS, 2007.
18. Vincent, P., Larochelle, H., Bengio, Y., and Manzagol, P.A. Extracting and composing robust features with denoising autoencoders. In ICML, 2008.
19. Zeiler, M.D., Krishnan, D., Taylor, G.W., and Fergus, R. Deconvolution networks. In CVPR, 2010.
20. Zhang, H., Berg, A. C., Maire, M., and Malik, J. SVM-KNN: Discriminative nearest neighbor classification for visual category recognition. In CVPR, 2006.
21. Zhou, M., Chen, H., Paisley, J., Ren, L., Sapiro, G., and Carin, L. Non-parametric Bayesian dictionary learning for sparse image representations. In NIPS, 2009.
22. Zoran, D. and Weiss, Y. The tree-dependent components of natural images are edge filters. In NIPS, 2009.