Unsupervised feature learning by Deep Sparse Coding

SIAM International Conference on Data Mining 2014, SDM 2014

Volumn 2, Issue , 2014, Pages 902-910

  He, Yunlong ^a   Kavukcuoglu, Koray ^b   Wang, Yun ^c   Szlam, Arthur ^d   Qi, Yanjun ^e  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b DEEPMIND   (United Kingdom)

^c PRINCETON UNIVERSITY   (United States)

^d CITY COLLEGE OF NEW YORK   (United States)

^e UNIVERSITY OF VIRGINIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DEEP LEARNING; OBJECT RECOGNITION;

FEATURE REPRESENTATION; LOW DIMENSIONAL EMBEDDING; MULTI-LAYER ARCHITECTURES; SPARSE REPRESENTATION; SPATIAL SMOOTHNESS; STATE-OF-THE-ART PERFORMANCE; UNSUPERVISED FEATURE LEARNING; VISUAL OBJECT RECOGNITION;

DATA MINING;

EID: 84959902160     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1137/1.9781611973440.103     Document Type: Conference Paper

References (28)

1. K. Balasubramanian, K. Yu, and G. Lebanon. Smooth sparse coding via marginal regression for learning sparse representations. In ICML, 2013.
2. Y. Bengio, A. Courville, and P. Vincent. Representation learning: A review and new perspectives. arXiv preprint arXiv: 1206.5538, 2012.
3. L. Bo, X. Ren, and D. Fox. Multipath sparse coding using hierarchical matching pursuit. CVPR, 2013.
4. Y.-L. Boureau, F. Bach, Y. LeCun, and J. Ponce. Learning mid-level features for recognition. In CVPR, pages 2559-2566. IEEE, 2010.
5. C.-C. Chang and C.-J. Lin. Libsvm: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology (TIST), 2(3):27, 2011.
6. K. Chatfield, V. Lempitsky, A. Vedaldi, and A. Zisserman. The devil is in the details: an evaluation of recent feature encoding methods. 2011.
7. D. Ciresan, U. Meier, and J. Schmidhuber. Multicolumn deep neural networks for image classification. CVPR, 2012.
8. A. Coates and A. Y. Ng. The importance of encoding versus training with sparse coding and vector quantization. In ICML, volume 8, page 10, 2011.
9. N. Dalai and B. Triggs. Histograms of oriented gradients for human detection. In CVPR 2005, volume 1, pages 886-893. IEEE, 2005.
10. L. Fei-Fei, R. Fergus, and P. Perona. Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. In CVPR, Workshop on Generative-Model Based Vision., 2004.
11. L. Fei-Fei and P. Perona. A bayesian hierarchical model for learning natural scene categories. In CVPR, 2005.
12. J. Feng, B. Ni, Q. Tian, and S. Yan. Geometric p-norm feature pooling for image classification. In CVPR, pages 2609-2704. IEEE, 2011.
13. S. Gao, I. W. Tsang, L.-T. Chia, and P. Zhao. Local features are not lonely-laplacian sparse coding for image classification. In CVPR, pages 3555-3561. IEEE, 2010.
14. G. Griffin, A. Holub, and P. Perona. Caltech-256 object category dataset. 2007.
15. R. Hadsell, S. Chopra, and Y. LeCun. Dimensionality reduction by learning an invariant mapping. In CVPR, volume 2, pages 1735-1742. IEEE, 2006.
16. G. E. Hinton, S. Osindero, and Y.-W. Teh. A fast learning algorithm for deep belief nets. Neural computation, 18(7):1527-1554, 2006.
17. Y. Jia, C. Huang, and T. Darrell. Beyond spatial pyramids: Receptive field learning for pooled image features. In CVPR, 2012, pages 3370-3377. IEEE, 2012.
18. K. Kavukcuoglu, M. Ranzato, R. Fergus, and Y. Le-Cun. Learning invariant features through topographic filter maps. In CVPR, 2009.
19. A. Krizhevsky, I. Sutskever, and G. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25, pages 1106-1114, 2012.
20. S. Lazebnik, C. Schmid, and J. Ponce. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In CVPR, volume 2, pages 2169-2178. IEEE, 2006.
21. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
22. D. G. Lowe. Distinctive image features from scaleinvariant keypoints. IJCV, 60(2):91-110, 2004.
23. J. Mairal, F. Bach, J. Ponce, and G. Sapiro. Online dictionary learning for sparse coding. In Proceedings of the 26th Annual International Conference on Machine Learning, pages 689-696. ACM, 2009.
24. A. Oliva and A. Torraba. Modeling the shape of the scene: A holistic representation of the spatial envelop. In IJCV, 2001.
25. B. A. Olshausen et al. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381(6583):607-609, 1996.
26. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong. Locality-constrained linear coding for image classification. In CVPR, pages 3360-3367. IEEE, 2010.
27. J. Yang, K. Yu, Y. Gong, and T. Huang. Linear spatial pyramid matching using sparse coding for image classification. In CVPR, pages 1794-1801. IEEE, 2009.
28. K. Yu, Y. Lin, R. Fergus, and Y. LeCun. Learning image representations from the pixel level via hierachical sparse coding. In CVPR, 2011.