Compact convolutional neural network transfer learning for small-scale image classification

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2016-May, Issue , 2016, Pages 2737-2741

  Li, Zengxi ^a   Song, Yan ^a   McLoughlin, Ian ^b   Dai, Lirong ^a  

^a National Engineering Laboratory for Speech and Language Information Processing   (United Kingdom)

^b UNIVERSITY OF KENT   (United Kingdom)

Author keywords

CNN; Image Classification; Transfer Learning

Indexed keywords

EID: 84973351658     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2016.7472175     Document Type: Conference Paper

References (24)

1. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton, "Imagenet classification with deep convolutional neural networks, " in Proc. of NIPs, 2012, pp. 1106-1114.
2. Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Fei-Fei Li, "Imagenet: A large-scale hierarchical image database, " in Proc. of CVPR, 2009, pp. 248-255.
3. Ariadna Quattoni and Antonio Torralba, "Recognizing indoor scenes, " in Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on. IEEE, 2009, pp. 413-420.
4. Ali Sharif Razavian, Hossein Azizpour, Josephine Sullivan, and Stefan Carlsson, "CNN features off-the-shelf: An astounding baseline for recognition, " CoRR, vol. Abs/1403. 6382, 2014.
5. Ken Chatfield, Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman, "Return of the devil in the details: Delving deep into convolutional nets, " Proc. of ECCV, 2014.
6. Ross B. Girshick and Jeff Donahue, "Rich feature hierarchies for accurate object detection and semantic segmentation, " in Proc. of CVPR, 2014, pp. 580-587.
7. Jason Yosinski, Jeff Clune, Yoshua Bengio, and Hod Lipson, "How transferable are features in deep neural networks, " in Proc. of NIPs, Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, Eds., pp. 3320-3328. 2014.
8. E. Denton, W. Zaremba, J. Bruna, Y. LeCun, and R. Fergus, "Exploiting linear structure within convolutional networks for efficient evaluation, " in Proc. of NIPs. IEEE, 2014.
9. M. Jaderberg, A. Vedaldi, and A. Zisserman, "Speeding up convolutional neural networks with low rank expansions, " in Proc. of BMVC, 2014.
10. Xiangyu Zhang, Jianhua Zou, Xiang Ming, Kaiming He, and Jian Sun, "Efficient and accurate approximations of nonlinear convolutional networks, " in Proc. of CVPR, 2015.
11. Ariadna Quattoni and Antonio Torralba, "Recognizing indoor scenes, " in Proc. of CVPR, 2009, pp. 413-420.
12. A. Vedaldi and K. Lenc, "Matconvnet-convolutional neural networks for matlab, " CoRR, vol. Abs/1412. 4564, 2014.
13. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman, "Return of the devil in the details: Delving deep into convolutional nets, " in British Machine Vision Conference, 2014.
14. Geoffrey Hinton, Oriol Vinyals, and Jeff Dean, "Distilling the knowledge in a neural network, " arXiv preprint arXiv: 1503. 02531, 2015.
15. Alex Krizhevsky and Geoffrey Hinton, "Learning multiple layers of features from tiny images, " 2009.
16. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. LeCun, "Overfeat: Integrated recognition, localization and detection using convolutional networks, " in Proc. ICLR, 2014.
17. Chen-Yu Lee, Saining Xie, Patrick Gallagher, Zhengyou Zhang, and Zhuowen Tu, "Deeply-supervised nets, " arXiv preprint arXiv: 1409. 5185, 2014.
18. M. Lin, Q. Chen, and S. Yan, "Network in network, " arXiv preprint arXiv: 1312. 4400v3, 2014.
19. Li Wan, Matthew Zeiler, Sixin Zhang, Yann Le Cun, and Rob Fergus, "Regularization of neural networks using dropconnect, " in Proceedings of The 30th International Conference on Machine Learning, 2013, pp. 1058-1066.
20. Ian J Goodfellow, David Warde-Farley, Mehdi Mirza, Aaron Courville, and Yoshua Bengio, "Maxout networks, " arXiv preprint arXiv: 1302. 4389, 2013.
21. Mandar Dixit, Si Chen, Dashan Gao, Nikhil Rasiwasia, and Nuno Vasconcelos, "Scene classification with semantic fisher vector, " in Proc. of CVPR, 2015.
22. Yunchao Gong, Liwei Wang, and Ruiqi Guo, "Multiscale orderless pooling of deep convolutional activation features, " in Proc. of ECCV, 2014, pp. 392-407.
23. Lingqiao Liu, Chunhua Shen, Lei Wang, Anton van den Hengel, and Chao Wang, "Encoding high dimensional local features by sparse coding based fisher vectors, " in Advances in Neural Information Processing Systems 27, 2014, December 8-13 2014, Montreal, Quebec, Canada, 2014, pp. 1143-1151.
24. Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, and Trevor Darrell, "Decaf: A deep convolutional activation feature for generic visual recognition, " arXiv preprint arXiv: 1310. 1531, 2014.