Refining Architectures of Deep Convolutional Neural Networks

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 2212-2220

  Shankar, Sukrit ^a   Robertson, Duncan ^b   Ioannou, Yani ^a   Criminisi, Antonio ^b   Cipolla, Roberto ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b MICROSOFT RESEARCH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; CONVOLUTION; IMAGE RECOGNITION; NEURAL NETWORKS; PATTERN RECOGNITION;

CONVOLUTIONAL NEURAL NETWORK; DEEP LEARNING; HIDDEN UNITS; INPUT AND OUTPUTS; INPUT-OUTPUT; NATURAL SCENES; NOVEL STRATEGIES; REFINEMENT ALGORITHMS;

NETWORK ARCHITECTURE;

EID: 84986275851     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.243     Document Type: Conference Paper

References (28)

1. C. Cortes, M. Mohri, and U. Syed. Deep boosting. In Proceedings of the 31st International Conference on Machine Learning (ICML-14), pages 1179-1187, 2014.
2. A. Criminisi, J. Shotton, and E. Konukoglu. Decision forests: A unified framework for classification, regression, density estimation, manifold learning and semi-supervised learning. Now, 2012.
3. N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, volume 1, pages 886-893. IEEE, 2005.
4. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In CVPR, pages 248-255. IEEE, 2009.
5. M. Denil, B. Shakibi, L. Dinh, N. de Freitas, et al. Predicting parameters in deep learning. In Advances in Neural Information Processing Systems, pages 2148-2156, 2013.
6. B. Graham. Spatially-sparse convolutional neural networks. arXiv preprint arXiv:1409.6070, 2014.
7. K. He, X. Zhang, S. Ren, and J. Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In Proceedings of the IEEE International Conference on Computer Vision, pages 1026-1034, 2015.
8. M. Jaderberg, A. Vedaldi, and A. Zisserman. Speeding up convolutional neural networks with low rank expansions. arXiv preprint arXiv:1405.3866, 2014.
9. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093, 2014.
10. A. Krizhevsky and G. Hinton. Learning multiple layers of features from tiny images, 2009.
11. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, volume 1, page 4, 2012.
12. B. Liu, M. Wang, H. Foroosh, M. Tappen, and M. Pensky. Sparse convolutional neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 806-814, 2015.
13. Z. Liu, P. Luo, X. Wang, and X. Tang. Deep learning face attributes in the wild. arXiv preprint arXiv:1411.7766 (To apeear in ICCV), 2015.
14. A. Oliva, A. Torralba, et al. Building the gist of a scene: The role of global image features in recognition. Progress in brain research, 155, 2006.
15. M. Oquab, L. Bottou, I. Laptev, and J. Sivic. Learning and transferring mid-level image representations using convolutional neural networks. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1717-1724. IEEE, 2014.
16. G. Patterson and J. Hays. Sun attribute database: Discovering, annotating, and recognizing scene attributes. In CVPR, pages 2751-2758. IEEE, 2012.
17. Z. Peng, L. Lin, R. Zhang, and J. Xu. Deep boosting: Layered feature mining for general image classification. In Multimedia and Expo (ICME), 2014 IEEE International Conference on, pages 1-6. IEEE, 2014.
18. T. N. Sainath, B. Kingsbury, V. Sindhwani, E. Arisoy, and B. Ramabhadran. Low-rank matrix factorization for deep neural network training with high-dimensional output targets. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, pages 6655-6659. IEEE, 2013.
19. S. Shalev-Shwartz. Selfieboost: A boosting algorithm for deep learning. arXiv preprint arXiv:1411.3436, 2014.
20. S. Shankar, V. K. Garg, and R. Cipolla. Deep-carving: Discovering visual attributes by carving deep neural nets. In CVPR, June 2015.
21. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
22. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. arXiv preprint arXiv:1409.4842, 2014.
23. L. Torrey and J. Shavlik. Transfer learning. Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, 1:242, 2009.
24. J. Xue, J. Li, and Y. Gong. Restructuring of deep neural network acoustic models with singular value decomposition. In INTERSPEECH, pages 2365-2369, 2013.
25. J. Yosinski, J. Clune, Y. Bengio, and H. Lipson. How transferable are features in deep neural networks? In Advances in Neural Information Processing Systems, pages 3320-3328, 2014.
26. B. Zhou, A. Khosla, A. Lapedriza, A. Oliva, and A. Torralba. Object detectors emerge in deep scene cnns. arXiv preprint arXiv:1412.6856, 2014.
27. B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva. Learning deep features for scene recognition using places database. In Advances in Neural Information Processing Systems, pages 487-495, 2014.
28. J. T. Zhou, S. J. Pan, I.W. Tsang, and Y. Yan. Hybrid heterogeneous transfer learning through deep learning. In Twenty-Eighth AAAI Conference on Artificial Intelligence, 2014.