ICA with reconstruction cost for efficient overcomplete feature learning

Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011

Volumn , Issue , 2011, Pages

  Le, Quoc V ^a   Karpenko, Alexandre ^a   Ngiam, Jiquan ^a   Ng, Andrew Y ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTERING ALGORITHMS; CONVOLUTION; COSTS; NEURAL NETWORKS; OBJECT RECOGNITION; OPTIMIZATION;

AUTO ENCODERS; CONVOLUTIONAL NEURAL NETWORK; FEATURE LEARNING; HIGH DIMENSIONAL DATA; INDEPENDENT COMPONENTS ANALYSIS; LEARN+; OVER-COMPLETE; PROPERTY; SPARSE FEATURES; UNSUPERVISED FEATURE LEARNING;

INDEPENDENT COMPONENT ANALYSIS;

EID: 85162310599     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. M.A. Ranzato, C. Poultney, S. Chopra, and Y. LeCun. Efficient learning of sparse representations with an energy-based model. In NIPS, 2006.
2. R. Raina, A. Battle, H. Lee, B. Packer, and A.Y. Ng. Self-taught learning: Transfer learning from unlabelled data. In ICML, 2007.
3. M. Ranzato, F. J. Huang, Y. Boureau, and Y. LeCun. Unsupervised learning of invariant feature hierarchies with applications to object recognition. In CVPR, 2007.
4. J. Yang, K. Yu, Y. Gong, and T. Huang. Linear spatial pyramid matching using sparse coding for image classification. In CVPR, 2009.
5. J. Yang, K. Yu, and T. Huang. Efficient highly over-complete sparse coding using a mixture model. In ECCV, 2010.
6. A. Coates, H. Lee, and A. Y. Ng. An analysis of single-layer networks in unsupervised feature learning. In AISTATS 14, 2011.
7. K. Yu, Y. Lin, and J. Lafferty. Learning image representations from pixel level via hierarchical sparse coding. In CVPR, 2011.
8. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle. Greedy layerwise training of deep networks. In NIPS, 2007.
9. G. E. Hinton, S. Osindero, and Y. W. Teh. A fast learning algorithm for deep belief nets. Neural Computation, 2006.
10. B. Olshausen and D. Field. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 1996.
11. A. Hyvärinen, J. Karhunen, and E. Oja. Independent Component Analysis. Wiley Interscience, 2001.
12. Q. V. Le, J. Ngiam, Z. Chen, D. Chia, P. W. Koh, and A. Y. Ng. Tiled convolutional neural networks. In NIPS, 2010.
13. Q. V. Le, W. Zou, S. Y. Yeung, and A. Y. Ng. Learning hierarchical spatio-temporal features for action recognition with independent subspace analysis. In CVPR, 2011.
14. Q. V. Le, J. Ngiam, A. Coates, A. Lahiri, B. Prochnow, and A. Y. Ng. On optimization methods for deep learning. In ICML, 2011.
15. M. Marzalek, I. Laptev, and C. Schmid. Actions in context. In CVPR, 2009.
16. A. Hyvärinen, J. Hurri, and P. O. Hoyer. Natural Image Statistics. Springer, 2009.
17. B. Olshausen and D. Field. Sparse coding with an overcomplete basis set: A strategy employed by v1. Vision Research, 1997.
18. M. S. Lewicki and T. J. Sejnowski. Learning overcomplete representations. Neural Computation, 2000.
19. L. Ma and L. Zhang. Overcomplete topographic independent component analysis. Elsevier, 2008.
20. M. Schmidt. minFunc, 2005.
21. P. Vincent, H. Larochelle, Y. Bengio, and P. A. Manzagol. Extracting and composing robust features with denoising autoencoders. In ICML, 2008.
22. H. Lee, C. Ekanadham, and A. Y. Ng. Sparse deep belief net model for visual area V2. In NIPS, 2008.
23. H. Larochelle, Y. Bengio, J. Louradour, and P. Lamblin. Exploring strategies for training deep neural networks. JMLR, 2009.
24. G. Hinton. A practical guide to training restricted boltzmann machines. Technical report, U. of Toronto, 2010.
25. P. Vincent. A connection between score matching and denoising autoencoders. Neural Computation, 2010.
26. A. Hyvärinen. Estimation of non-normalized statistical models using score matching. JMLR, 2005.
27. Y. Karklin and M.S. Lewicki. Is early vision optimized for extracting higher-order dependencies? In NIPS, 2006.
28. C. Schuldt, I. Laptev, and B. Caputo. Recognizing human actions: A local SVM approach. In ICPR, 2004.
29. J. Liu, J. Luo, and M. Shah. Recognizing realistic actions from videos "in the Wild". In CVPR, 2009.
30. HengWang,MuhammadMuneeb Ullah, Alexander Klaser, Ivan Laptev, and Cordelia Schmid. Evaluation of local spatio-temporal features for action recognition. In BMVC, 2010.