Discriminative unsupervised feature learning with convolutional neural networks

Advances in Neural Information Processing Systems

Volumn 1, Issue January, 2014, Pages 766-774

  Dosovitskiy, Alexey ^a   Springenberg, Jost Tobias ^a   Riedmiller, Martin ^a   Brox, Thomas ^a  

^a UNIVERSITY OF FREIBURG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); CONVOLUTION; IMAGE MATCHING; INFORMATION SCIENCE; NEURAL NETWORKS; OBJECT RECOGNITION;

CLASSIFICATION RESULTS; CONVOLUTIONAL NEURAL NETWORK; FEATURE REPRESENTATION; STATE OF THE ART; SUPERVISED TRAININGS; UNLABELED DATA; UNSUPERVISED FEATURE LEARNING; VISUAL OBJECT RECOGNITION;

LEARNING ALGORITHMS;

EID: 84937964776     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. A. Krizhevsky, I. Sutskever, and G. E. Hinton. ImageNet classification with deep convolutional neural networks. In NIPS, pages 1106-1114, 2012.
2. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. In ECCV, 2014.
3. J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, and T. Darrell. DeCAF: A deep convo-lutional activation feature for generic visual recognition. In ICML, 2014.
4. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, 2014.
5. K. Cho. Simple sparsification improves sparse denoising autoencoders in denoising highly corrupted images. In ICML. JMLR Workshop and Conference Proceedings, 2013.
6. P. Fischer, A. Dosovitskiy, and T. Brox. Descriptor matching with convolutional neural networks: a comparison to SIFT. 2014. pre-print, arXiv:1405.5769v1 [cs.CV].
7. Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. D. Jackel. Backpropagation applied to handwritten zip code recognition. Neural Computation, 1(4):541-551, 1989.
8. K. Kavukcuoglu, P. Sermanet, Y. Boureau, K. Gregor, M. Mathieu, and Y. LeCun. Learning convolutional feature hierachies for visual recognition. In NIPS, 2010.
9. P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol. Extracting and composing robust features with denoising autoencoders. In ICML, pages 1096-1103, 2008.
10. W. Y. Zou, A. Y. Ng, S. Zhu, and K. Yu. Deep learning of invariant features via simulated fixations in video. In NIPS, pages 3212-3220, 2012.
11. K. Sohn and H. Lee. Learning invariant representations with local transformations. In ICML, 2012.
12. K. Y. Hui. Direct modeling of complex invariances for visual object features. In ICML, 2013.
13. P. Simard, B. Victorri, Y. LeCun, and J. S. Denker. Tangent Prop - A formalism for specifying selected invariances in an adaptive network. In NIPS, 1992.
14. H. Drucker and Y. LeCun. Improving generalization performance using double backpropagation. IEEE Transactions on Neural Networks, 3(6):991-997, 1992.
15. M.-R. Amini and P. Gallinari. Semi supervised logistic regression. In ECAI, pages 390-394, 2002.
16. Y. Grandvalet and Y. Bengio. Entropy regularization. In Semi-Supervised Learning, pages 151-168. MIT Press, 2006.
17. A. Ahmed, K. Yu, W. Xu, Y. Gong, and E. Xing. Training hierarchical feed-forward visual recognition models using transfer learning from pseudo-tasks. In ECCV (3), pages 69-82, 2008.
18. R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu, and P. Kuksa. Natural language processing (almost) from scratch. Journal of Machine Learning Research, 12:2493-2537, 2011.
19. S. Wager, S. Wang, and P. Liang. Dropout training as adaptive regularization. In NIPS. 2013.
20. S. Rifai, Y. N. Dauphin, P. Vincent, Y. Bengio, and X. Muller. The manifold tangent classifier. In NIPS. 2011.
21. A. Coates, H. Lee, and A. Y. Ng. An analysis of single-layer networks in unsupervised feature learning. AISTATS, 2011.
22. A. Krizhevsky and G. Hinton. Learning multiple layers of features from tiny images. Master's thesis, Department of Computer Science, University of Toronto, 2009.
23. L. Fei-Fei, R. Fergus, and P. Perona. Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories. In CVPR WGMBV, 2004.
24. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. R. Salakhutdinov. Improving neural networks by preventing co-adaptation of feature detectors. 2012. pre-print, arxiv:cs/1207.0580v3.
25. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093, 2014.
26. A. Coates and A. Y. Ng. Selecting receptive fields in deep networks. In NIPS, pages 2528-2536, 2011.
27. L. Bo, X. Ren, and D. Fox. Unsupervised feature learning for RGB-D based object recognition. In ISER, June 2012.
28. Y. Boureau, N. Le Roux, F. Bach, J. Ponce, and Y. LeCun. Ask the locals: multi-way local pooling for image recognition. In ICCV'11. IEEE, 2011.
29. L. Bo, X. Ren, and D. Fox. Multipath sparse coding using hierarchical matching pursuit. In CVPR, pages 660-667, 2013.
30. K. Swersky, J. Snoek, and R. P. Adams. Multi-task bayesian optimization. In NIPS, 2013.
31. M. Lin, Q. Chen, and S. Yan. Network in network. In ICLR, 2014.
32. K. He, X. Zhang, S. Ren, and J. Sun. Spatial pyramid pooling in deep convolutional networks for visual recognition. In ECCV, 2014.