Learning and selecting features jointly with point-wise gated Boltzmann machines

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 2, 2013, Pages 876-884

  Sohn, Kihyuk ^a   Zhou, Guanyu ^a   Lee, Chansoo ^a   Lee, Honglak ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING;

DYNAMIC FEATURE SELECTIONS; FEATURE LEARNING; GATED BOLTZMANN MACHINES; GATING MECHANISMS; GENERATIVE MODEL; HIGH-LEVEL FEATURES; UNSUPERVISED FEATURE LEARNING; VISUAL RECOGNITION;

LEARNING SYSTEMS;

EID: 84897565124     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. Bengio, Y., Lamblin, P., Popovici, D., and Larochelle, H. Greedy layer-wise training of deep networks. In NIPS, 2007.
2. Bengio, Y. Learning deep architectures for AI. Foundations and Trends in Machine Learning, 2(1):1-127, 2009.
3. Boureau, Y. L., Bach, F., LeCun, Y., and Ponce, J. Learning mid-level features for recognition. In CVPR, 2010.
4. Everingham, M., Van Gool, L., Williams, C. K., Winn, J., and Zisserman, A. The pascal visual object classes (voc) challenge. International journal of computer vision, 88 (2):303-338, 2010.
5. Fan, R. E., Chang, K. W., Hsieh, C. J., Wang, X. R., and Lin, C. J. LIBLINEAR: A library for large linear classification. Journal of Machine Learning Research, 9: 1871-1874, 2008.
6. Fei-Fei, L., Fergus, R., and Perona, P. Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories. In CVPR Workshop on Generative Model Based Vision, 2004.
7. Goh, H., Thome, N., Cord, M., and Lim, J. H. Unsupervised and supervised visual codes with restricted Boltzmann machines. In ECCV, 2012.
8. Griffin, G., Holub, A., and Perona, P. Caltech-256 object category dataset. Technical report, California Institute of Technology, 2007.
9. Guyon, I. and Elisseeff, A. An introduction to variable and feature selection. Journal of Machine Learning Research, 3:1157-1182, 2003.
10. Heess, N., Le Roux, N., and Winn, J. Weakly supervised learning of foreground-background segmentation using masked RBMs. In ICANN, 2011.
11. Hinton, G. E. Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8):1771-1800, 2002.
12. Hinton, G. E., Osindero, S., and Teh, Y. A fast learning algorithm for deep belief nets. Neural Computation, 18(7):1527-1554, 2006. (Pubitemid 44024729)
13. Jain, A. and Zongker, D. Feature selection: Evaluation, application, and small sample performance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(2):153-158, 1997. (Pubitemid 127828334)
14. Larochelle, H. and Bengio, Y. Classification using discriminative restricted Boltzmann machines. In ICML, 2008.
15. Larochelle, H., Erhan, D., Courville, A., Bergstra, J., and Bengio, Y. An empirical evaluation of deep architectures on problems with many factors of variation. In ICML, 2007.
16. Lazebnik, S., Schmid, C., and Ponce, J. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In CVPR, 2006.
17. Le Roux, N., Heess, N., Shotton, J., and Winn, J. Learning a generative model of images by factoring appearance and shape. Neural Computation, 23(3):593-650, 2011.
18. Lee, H., Ekanadham, C., and Ng, A. Y. Sparse deep belief network model for visual area V2. In NIPS, 2008.
19. Lee, H., Grosse, R., Ranganath, R., and Ng, A. Y. Unsupervised learning of hierarchical representations with convolutional deep belief networks. Communications of the ACM, 54(10):95-103, 2011.
20. Memisevic, R. and Hinton, G. E. Learning to represent spatial transformations with factored higher-order Boltzmann machines. Neural Computation, 22 (6): 1473-1492, 2010.
21. Nair, V. and Hinton, G. E. Implicit mixtures of restricted Boltzmann machines. In NIPS, 2008.
22. Ranzato, M., Poultney, C., Chopra, S., and LeCun, Y. Efficient learning of sparse representations with an energy-based model. In NIPS, 2007.
23. Rifai, S., Vincent, P., Muller, X., Glorot, X., and Bengio, Y. Contractive auto-encoders: Explicit invariance during feature extraction. In ICML, 2011.
24. Rifai, S., Bengio, Y., Courville, A., Vincent, P., and Mirza, M. Disentangling factors of variation for facial expression recognition. In ECCV, 2012.
25. Sejnowski, T. J. Higher-order Boltzmann machines. In AIP Conference Proceedings on Neural Networks for Computing, 1987.
26. Sohn, K. and Lee, H. Learning invariant representations with local transformations. In ICML, 2012.
27. Sohn, K., Jung, D. Y., Lee, H., and Hero, A. O. Efficient learning of sparse, distributed, convolutional feature representations for object recognition. In ICCV, 2011.
28. Tang, Y., Salakhutdinov, R., and Hinton, G. E. Robust Boltzmann machines for recognition and denoising. In CVPR, 2012.
29. Vincent, P., Larochelle, H., Bengio, Y., and Manzagol, P. A. Extracting and composing robust features with denoising autoencoders. In ICML, 2008.
30. Weston, J., Mukherjee, S., Chapelle, O., Pontil, M., Poggio, T., and Vapnik, V. Feature selection for svms. In NIPS, 2001.
31. Yang, J., Yu, K., Gong, Y., and Huang, T. S. Linear spatial pyramid matching using sparse coding for image classification. In CVPR, 2009.
32. Yang, Y. and Pedersen, J. O. A comparative study on feature selection in text categorization. In ICML, 1997.