Error-driven incremental learning in deep convolutional neural network for large-scale image classification

MM 2014 - Proceedings of the 2014 ACM Conference on Multimedia

Volumn , Issue , 2014, Pages 177-186

  Xiao, Tianjun ^a   Zhang, Jiaxing ^b   Yang, Kuiyuan ^b   Peng, Yuxin ^a   Zhang, Zheng ^b  

^a PEKING UNIVERSITY   (China)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Deep convolutional neural network; Incremental learning; Large scale image classification

Indexed keywords

CLONING; CONVOLUTION; CONVOLUTIONAL NEURAL NETWORKS; DEEP LEARNING; DEEP NEURAL NETWORKS; FORECASTING; IMAGE CLASSIFICATION;

BUILDING BLOCKES; COARSE-GRAINED; COMPONENT MODEL; CONTINUOUS LEARNING; EXPOSED TO; INCREMENTAL LEARNING; MULTIMEDIA TASKS; TRAINING ALGORITHMS;

LEARNING SYSTEMS;

EID: 84913546601     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2647868.2654926     Document Type: Conference Paper

References (24)

1. Y. Aytar and A. Zisserman. Tabula rasa: Model transfer for object category detection. In Computer Vision (ICCV), 2011 IEEE International Conference on, pages 2252-2259. IEEE, 2011.
2. Y. Bengio, J. Louradour, R. Collobert, and J. Weston. Curriculum learning. In Proceedings of the 26th annual international conference on machine learning, pages 41-48. ACM, 2009.
3. J. Deng, A. C. Berg, K. Li, and L. Fei-Fei. What does classifying more than 10, 000 image categories tell us? In Computer Vision-ECCV 2010, pages 71-84. Springer, 2010.
4. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 248-255. IEEE, 2009.
5. R. Elwell and R. Polikar. Incremental learning of concept drift in nonstationary environments. Neural Networks, IEEE Transactions on, 22(10):1517-1531, 2011.
6. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The pascal visual object classes (voc) challenge. International Journal of Computer Vision, 88(2):303-338, June 2010.
7. L. Fe-Fei, R. Fergus, and P. Perona. A bayesian approach to unsupervised one-shot learning of object categories. In Computer Vision, 2003. Proceedings. Ninth IEEE International Conference on, pages 1134-1141. IEEE, 2003.
8. L. Fei-Fei, R. Fergus, and P. Perona. One-shot learning of object categories. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 28(4):594-611, 2006.
9. L. Fei-Fei, R. Fergus, and P. Perona. Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories. Computer Vision and Image Understanding, 106(1):59-70, 2007.
10. I. J. Goodfellow, M. Mirza, X. Da, A. Courville, and Y. Bengio. An empirical investigation of catastrophic forgeting in gradient-based neural networks. arXiv preprint arXiv:1312.6211, 2013.
11. G. Griffin, A. Holub, and P. Perona. Caltech-256 object category dataset. 2007.
12. G. Griffin and P. Perona. Learning and using taxonomies for fast visual categorization. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pages 1-8. IEEE, 2008.
13. J. Hoffman, E. Tzeng, J. Donahue, Y. Jia, K. Saenko, and T. Darrell. One-shot adaptation of supervised deep convolutional models. arXiv preprint arXiv:1312.6204, 2013.
14. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, volume 1, page 4, 2012.
15. I. Kuzborskij, F. Orabona, and B. Caputo. From n to n+ 1: Multiclass transfer incremental learning. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 3358-3365. IEEE, 2013.
16. C. H. Lampert, H. Nickisch, and S. Harmeling. Learning to detect unseen object classes by between-class attribute transfer. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 951-958. IEEE, 2009.
17. S. Lazebnik, C. Schmid, and J. Ponce. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on, volume 2, pages 2169-2178. IEEE, 2006.
18. Z. Lu and Y. Peng. Image annotation by semantic sparse recoding of visual content. In Proceedings of the 20th ACM international conference on Multimedia, pages 499-508. ACM, 2012.
19. F. Perronnin, J. Sánchez, and T. Mensink. Improving the fisher kernel for large-scale image classification. In ECCV, pages 143-156. Springer, 2010.
20. C. Snoek, K. van de Sande, D. Fontijne, A. Habibian, M. Jain, S. Kordumova, Z. Li, M. Mazloom, S. Pintea, R. Tao, et al. Mediamill at trecvid 2013: Searching concepts, objects, instances and events in video. In NIST TRECVID Workshop, 2013.
21. S. Thrun. Is learning the n-th thing any easier than learning the first? Advances in neural information processing systems, pages 640-646, 1996.
22. T. Tommasi, F. Orabona, and B. Caputo. Safety in numbers: Learning categories from few examples with multi model knowledge transfer. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 3081-3088. IEEE, 2010.
23. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong. Locality-constrained linear coding for image classification. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 3360-3367. IEEE, 2010.
24. G. Widmer and M. Kubat. Learning in the presence of concept drift and hidden contexts. Machine learning, 23(1):69-101, 1996.