Spectral representations for convolutional neural networks

Advances in Neural Information Processing Systems

Volumn 2015-January, Issue , 2015, Pages 2449-2457

  Rippel, Oren ^a   Snoek, Jasper ^b   Adams, Ryan P ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX NETWORKS; CONVOLUTION; FREQUENCY DOMAIN ANALYSIS; INFORMATION SCIENCE; NEURAL NETWORKS; STOCHASTIC SYSTEMS;

CLASSIFICATION AND APPROXIMATION TASKS; COMPLEX COEFFICIENTS; CONVOLUTIONAL NEURAL NETWORK; DIMENSIONALITY REDUCTION; EFFICIENT COMPUTATION; FASTER CONVERGENCE; FREQUENCY DOMAINS; SPECTRAL REPRESENTATIONS;

DISCRETE FOURIER TRANSFORMS;

EID: 84965137166     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Bengio, Yoshua and LeCun, Yann. Scaling learning algorithms towards AI. In Bottou, Léon, Chapelle, Olivier, DeCoste, D., and Weston, J. (eds.), Large Scale Kernel Machines. MIT Press, 2007.
2. Goodfellow, Ian J., Warde-Farley, David, Mirza, Mehdi, Courville, Aaron C., and Bengio, Yoshua. Maxout networks. CoRR, abs/1302.4389, 2013. URL http://dblp.uni-trier.de/db/journals/corr/corr1302.htmlbs-1302-4389.
3. Hinton, Geoffrey. What's wrong with convolutional nets? MIT Brain and Cognitive Sciences - Fall Colloquium Series, Dec. 2014a. URL http://techtv. mit.edu/collections/bcs/videos/30698-what-s-wrong-with-convolutional-nets.
4. Hinton, Geoffrey. Ask me anything: Geoffrey hinton. Reddit Machine Learning, 2014b. URL https://www.reddit.com/r/MachineLearning/comments/2lmo0l/ama-geoffrey-hinton/.
5. Ioffe, Sergey and Szegedy, Christian. Batch normalization: Accelerating deep network training by reducing internal covariate shift. CoRR, abs/1502.03167, 2015. URL http://arxiv.org/abs/1502.03167.
6. Karpathy, Andrej, Toderici, George, Shetty, Sanketh, Leung, Thomas, Sukthankar, Rahul, and Fei-Fei, Li. Large-scale video classification with convolutional neural networks. In Computer Vision and Pattern Recognition, 2014.
7. Kingma, Diederik and Ba, Jimmy. Adam: A method for stochastic optimization. CoRR, abs/1412.6980, 2015. URL http://arxiv.org/abs/1412.6980.
8. Krizhevsky, Alex. Learning multiple layers of features from tiny images. Technical report, 2009.
9. Krizhevsky, Alex., Sutskever, Ilya, and Hinton, Geoffrey E. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, 2012.
10. LeCun, Yann, Boser, Bernhard, Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., and Jackel, L. D. Handwritten digit recognition with a back-propagation network. In Advances in Neural Information Processing Systems, 1989.
11. Lee, Chen-Yu, Xie, Saining, Gallagher, Patrick, Zhang, Zhengyou, and Tu, Zhuowen. Deeply-supervised nets. CoRR, abs/1409.5185, 2014. URL http://arxiv.org/abs/1409.5185.
12. Lin, Min, Chen, Qiang, and Yan, Shuicheng. Network in network. CoRR, abs/1312.4400, 2013. URL http://dblp. uni-trier.de/db/journals/corr/corr1312.html#LinCY13.
13. Mathieu, Michaël, Henaff, Mikael, and LeCun, Yann. Fast training of convolutional networks through FFTs. CoRR, abs/1312.5851, 2013. URL http://arxiv.org/abs/1312.5851.
14. Rippel, Oren, Gelbart, Michael A., and Adams, Ryan P. Learning ordered representations with nested dropout. In International Conference on Machine Learning, 2014.
15. Russakovsky, Olga, Deng, Jia, Su, Hao, Krause, Jonathan, Satheesh, Sanjeev, Ma, Sean, Huang, Zhiheng, Karpathy, Andrej, Khosla, Aditya, Bernstein, Michael, Berg, Alexander C., and Li, Fei-Fei. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision, 2015. doi: 10.1007/s11263-015-0816-y.
16. Snoek, Jasper, Larochelle, Hugo, and Adams, Ryan Prescott. Practical Bayesian optimization of machine learning algorithms. In Neural Information Processing Systems, 2012.
17. Snoek, Jasper, Rippel, Oren, Swersky, Kevin, Kiros, Ryan, Satish, Nadathur, Sundaram, Narayanan, Patwary, Md. Mostofa Ali, Prabhat, and Adams, Ryan P. Scalable Bayesian optimization using deep neural networks. In International Conference on Machine Learning, 2015.
18. Torralba, Antonio and Oliva, Aude. Statistics of natural image categories. Network, 14(3):391-412, August 2003. ISSN 0954-898X.
19. Vasilache, Nicolas, Johnson, Jeff, Mathieu, Michaël, Chintala, Soumith, Piantino, Serkan, and LeCun, Yann. Fast convolutional nets with fbfft: A GPU performance evaluation. CoRR, abs/1412.7580, 2014. URL http://arxiv.org/abs/1412.7580.
20. Zeiler, Matthew D. and Fergus, Rob. Stochastic pooling for regularization of deep convolutional neural networks. CoRR, abs/1301.3557, 2013. URL http://dblp. uni-trier.de/db/journals/corr/corr1301.html #abs-1301-3557.