Stochastic pooling for regularization of deep convolutional neural networks

1st International Conference on Learning Representations, ICLR 2013 - Conference Track Proceedings

Volumn , Issue , 2013, Pages

  Zeiler, Matthew D ^a   Fergus, Rob ^a  

^a POLYTECHNIC UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONVOLUTION; NEURAL NETWORKS; STOCHASTIC SYSTEMS;

CONVOLUTIONAL NEURAL NETWORK; DATA AUGMENTATION; HYPER-PARAMETER; IMAGE DATASETS; MULTINOMIAL DISTRIBUTIONS; REGULARIZATION APPROACH; STATE-OF-THE-ART PERFORMANCE; STOCHASTIC PROCEDURE;

DEEP NEURAL NETWORKS;

EID: 85083954484     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. D. C. Ciresan, U. Meier, J. Masci, L. M. Gambardella, and J. Schmidhuber. Flexible, high performance convolutional neural networks for image classification. In IJCAI, 2011.
2. G.E. Hinton, N. Srivastave, A. Krizhevsky, I. Sutskever, and R. R. Salakhutdinov. Improving neural networks by preventing co-adaptation of feature detectors. arXiv:1207.0580, 2012.
3. K. Jarrett, K. Kavukcuoglu, M. Ranzato, and Y. LeCun. What is the best multi-stage architecture for object recognition? In ICCV, 2009.
4. Y. Jia and C. Huang. Beyond spatial pyramids: Receptive field learning for pooled image features. In NIPS Workshops, 2011.
5. A. Krizhevsky. Learning multiple layers of featurs from tiny images. Technical Report TR-2009, University of Toronto, 2009.
6. A. Krizhevsky. cuda-convnet. http://code.google.com/p/cuda-convnet/, 2012.
7. Y. LeCun. The MNIST database. http://yann.lecun.com/exdb/mnist/, 2012.
8. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278–2324, 1998.
9. G. Montavon, G. Orr, and K.-R. Muller, editors. Neural Networks: Tricks of the Trade. Springer, San Francisco, 2012.
10. V. Nair and G.E. Hinton. Rectified linear units improve restricted boltzmann machines. In ICML, 2010.
11. Y. Netzer, T. Wang, A. Coates, A. Bissacco, B. Wu, and A. Y. Ng. Reading digits in natural images with unsupervised feature learning. In NIPS Workshop, 2011.
12. P. Sermanet, S. Chintala, and Y. LeCun. Convolutional neural networks applied to house numbers digit classification. In ICPR, 2012.
13. P. Simard, D. Steinkraus, and J. Platt. Best practices for convolutional neural networks applied to visual document analysis. In ICDAR, 2003.
14. http://gp-you.org/. GPUmat. http://sourceforge.net/projects/gpumat/, 2012.
15. M. Zeiler, G. Taylor, and R. Fergus. Adaptive deconvolutional networks for mid and high level feature learning. In ICCV, 2011.