Regularization of neural networks using DropConnect

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 3, 2013, Pages 2095-2103

  Wan, Li ^a   Zeiler, Matthew ^a   Zhang, Sixin ^a   LeCun, Yann ^a   Fergus, Rob ^a  

^a POLYTECHNIC UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA PROCESSING; IMAGE RECOGNITION; LEARNING SYSTEMS;

GENERALIZATION PERFORMANCE; RANDOM SUBSETS;

NEURAL NETWORKS;

EID: 84897550107     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. D. Ciresan, U. Meier, and J. Schmidhuber. Multicolumn deep neural networks for image classification. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), CVPR '12, pages 3642-3649, Washington, DC, USA, 2012. IEEE Computer Society. ISBN 978-1-4673-1226-4.
2. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Improving neural networks by preventing co-adaptation of feature detectors. CoRR, abs/1207.0580, 2012.
3. A. Krizhevsky. Learning Multiple Layers of Features from Tiny Images. Master's thesis, University of Toront, 2009.
4. A. Krizhevsky. cuda-convnet. http://code.google.com/p/cuda-convnet/, 2012.
5. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, nov 1998. ISSN 0018-9219. doi: 10.1109/5.726791.
6. Y. LeCun, F. J. Huang, and L. Bottou. Learning methods for generic object recognition with invariance to pose and lighting. In Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition, CVPR'04, pages 97-104, Washington, DC, USA, 2004. IEEE Computer Society.
7. M. Ledoux and M. Talagrand. Probability in Banach Spaces. Springer, New York, 1991.
8. D. J. C. Mackay. Probable networks and plausible predictions - a review of practical bayesian methods for supervised neural networks. In Bayesian methods for backpropagation networks. Springer, 1995.
9. V. Nair and G. E. Hinton. Rectified Linear Units Improve Restricted Boltzmann Machines. In ICML, 2010.
10. Y. Netzer, T. Wang, Coates A., A. Bissacco, B. Wu, and A. Y. Ng. Reading digits in natural images with unsupervised feature learning. In NIPS Workshop on Deep Learning and Unsupervised Feature Learning 2011, 2011.
11. J. Snoek, H. Larochelle, and R. A. Adams. Practical bayesian optimization of machine learning algorithms. In Neural Information Processing Systems, 2012.
12. A. S. Weigend, D. E. Rumelhart, and B. A. Huberman. Generalization by weight-elimination with application to forecasting. In NIPS, 1991.
13. M. D. Zeiler and R. Fergus. Stochastic pooling for regualization of deep convolutional neural networks. In ICLR, 2013.