Tiled convolutional neural networks

Advances in Neural Information Processing Systems 23: 24th Annual Conference on Neural Information Processing Systems 2010, NIPS 2010

Volumn , Issue , 2010, Pages

  Le, Quoc V ^a   Ngiam, Jiquan ^a   Chen, Zhenghao ^a   Chia, Daniel ^a   Koh, Pang Wei ^a   Ng, Andrew Y ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX NETWORKS; CONVOLUTION; LEARNING ALGORITHMS; NETWORK ARCHITECTURE; NEURAL NETWORKS; OBJECT RECOGNITION;

CONVOLUTION NEURAL NETWORK; CONVOLUTIONAL NEURAL NETWORK; DIGIT RECOGNITION; HARDCODING; HIDDEN UNITS; LEARN+; OBJECTS RECOGNITION; ROTATIONAL INVARIANCES; SCALE INVARIANCE; TRANSLATIONAL INVARIANCE;

INVARIANCE;

EID: 85161972005     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient based learning applied to document recognition. Proceeding of the IEEE, 1998.
2. P. Simard, D. Steinkraus, and J. Platt. Best practices for convolutional neural networks applied to visual document analysis. In ICDAR, 2003.
3. Y. LeCun, F.J. Huang, and L. Bottou. Learning methods for generic object recognition with invariance to pose and lighting. In CVPR, 2004.
4. R. Collobert and J.Weston. A unified architecture for natural language processing: Deep neural networks with multitask learning. In ICML, 2008.
5. Rajat Raina, Alexis Battle, Honglak Lee, Benjamin Packer, and Andrew Y. Ng. Self-taught learning: Transfer learning from unlabeled data. In ICML, 2007.
6. G.E. Hinton, S. Osindero, and Y.W. Teh. A fast learning algorithm for deep belief nets. Neural Computation, 2006.
7. D. Erhan, A. Courville, Y. Bengio, and P. Vincent. Why does unsupervised pre-training help deep learning? Journal of Machine Learning Research, 2010.
8. A. Hyvarinen and P. Hoyer. Topographic independent component analysis as a model of V1 organization and receptive fields. Neural Computation, 2001.
9. A. Hyvarinen, J. Hurri, and P. Hoyer. Natural Image Statistics. Springer, 2009.
10. A. Krizhevsky. Learning multiple layers of features from tiny images. Technical report, U. Toronto, 2009.
11. H. Lee, R. Grosse, R. Ranganath, and A.Y. Ng. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In ICML, 2009.
12. M.A. Ranzato K. Jarrett, K. Kavukcuoglu and Y. LeCun. What is the best multi-stage architecture for object recognition? In ICCV, 2009.
13. I. Goodfellow, Q.V. Le, A. Saxe, H. Lee, and A.Y. Ng. Measuring invariances in deep networks. In NIPS, 2010.
14. B. Olshausen and D. Field. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 1996.
15. A. Hyvarinen, J. Karhunen, and E. Oja. Independent Component Analysis. Wiley Interscience, 2001.
16. A. Hyvarinen. Estimation of non-normalized statistical models using score matching. JMLR, 2005.
17. K. Kavukcuoglu, M.A. Ranzato, R. Fergus, and Y. LeCun. Learning invariant features through topographic filter maps. In CVPR, 2009.
18. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle. Greedy layerwise training of deep networks. In NIPS, 2007.
19. V. Nair and G. Hinton. 3D object recognition with deep belief nets. In NIPS, 2009.
20. Y. Bengio and Y. LeCun. Scaling learning algorithms towards AI. In Large-Scale Kernel Machines, 2007.
21. R. Salakhutdinov and H. Larochelle. Efficient learning of Deep Boltzmann Machines. In AISTATS, 2010.
22. R.E. Fan, K.W. Chang, C.J. Hsieh, X.R. Wang, and C.J. Lin. LIBLINEAR: A library for large linear classification. JMLR, 9:1871-1874, 2008.
23. G. Hinton and R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 2006.
24. M. Ranzato and G. Hinton. Modeling pixel means and covariances using factorized third-order boltzmann machines. In CVPR, 2010.
25. K. Yu and T. Zhang. Improved local coordinate coding using local tangents. In ICML, 2010.
26. Y. Bengio. Learning deep architectures for AI. Foundations and Trends in Machine Learning, 2009.
27. A. Saxe, M. Bhand, Z. Chen, P. W. Koh, B. Suresh, and A. Y. Ng. On random weights and unsupervised feature learning. In Workshop: Deep Learning and Unsupervised Feature Learning (NIPS), 2010.
28. D. Erhan, Y. Bengio, A. Courville, and P. Vincent. Visualizing higher-layer features of a deep network. Technical report, University of Montreal, 2009.
29. P. Berkes and L.Wiskott. Slow feature analysis yields a rich repertoire of complex cell properties. Journal of Vision, 2005.
30. R. Fergus A. Torralba and W. T. Freeman. 80 million tiny images: a large dataset for non-parametric object and scene recognition. In IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.