Cost-Effective Active Learning for Deep Image Classification

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 27, Issue 12, 2017, Pages 2591-2600

  Wang, Keze ^a,b   Zhang, Dongyu ^a,b   Li, Ya ^c   Zhang, Ruimao ^a,b   Lin, Liang ^a,b  

^a SUN YAT SEN UNIVERSITY   (China)

^b NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^c GUANGZHOU UNIVERSITY   (China)

Author keywords

Active learning (AL); deep neural nets; image classification; incremental learning

Indexed keywords

ALUMINUM; ARTIFICIAL INTELLIGENCE; COST EFFECTIVENESS; COSTS; DEEP LEARNING; DEEP NEURAL NETWORKS; FACE RECOGNITION; IMAGE CLASSIFICATION; ITERATIVE METHODS; NEURAL NETWORKS;

ACTIVE LEARNING; CLASSIFICATION PERFORMANCE; CONVOLUTIONAL NEURAL NETWORK; DEEP NEURAL NETS; FEATURE REPRESENTATION; INCREMENTAL LEARNING; OBJECT CATEGORIZATION; PREDICTION CONFIDENCE;

CLASSIFICATION (OF INFORMATION);

EID: 85031935078     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2016.2589879     Document Type: Article

References (42)

1. B.-C. Chen, C.-S. Chen, and W. H. Hsu, "Cross-age reference coding for age-invariant face recognition and retrieval, " in Proc. ECCV, 2014, pp. 768-783.
2. G. Griffin, A. Holub, and P. Perona, "Caltech-256 object category dataset, " California Inst. Technol., Pasadena, CA, USA, Tech. Rep. 7694, 2007.
3. B. Demir and L. Bruzzone, "A novel active learning method in relevance feedback for content-based remote sensing image retrieval, " IEEE Trans. Geosci. Remote Sens., vol. 53, no. 5, pp. 2323-2334, May 2015.
4. K. Brinker, "Incorporating diversity in active learning with support vector machines, " in Proc. ICML, 2003, pp. 1-8.
5. B. Long, J. Bian, O. Chapelle, Y. Zhang, Y. Inagaki, and Y. Chang, "Active learning for ranking through expected loss optimization, " IEEE Trans. Knowl. Data Eng., vol. 27, no. 5, pp. 1180-1191, May 2015.
6. A. J. Joshi, F. Porikli, and N. Papanikolopoulos, "Multi-class active learning for image classification, " in Proc. CVPR, Jun. 2009, pp. 2372-2379.
7. A. Kapoor, K. Grauman, R. Urtasun, and T. Darrell, "Active learning with Gaussian processes for object categorization, " in Proc. ICCV, Oct. 2007, pp. 1-8.
8. A. Kapoor, G. Hua, A. Akbarzadeh, and S. Baker, "Which faces to tag: Adding prior constraints into active learning, " in Proc. ICCV, Sep./Oct. 2009, pp. 1058-1065.
9. R. M. Castro and R. D. Nowak, "Minimax bounds for active learning, " IEEE Trans. Inf. Theory, vol. 54, no. 5, pp. 2339-2353, May 2008.
10. X. Li and Y. Guo, "Adaptive active learning for image classification, " in Proc. CVPR, Jun. 2013, pp. 859-866.
11. E. Elhamifar, G. Sapiro, A. Yang, and S. S. Sasrty, "A convex optimization framework for active learning, " in Proc. Int. Conf. Comput. Vis. (ICCV), Dec. 2013, pp. 209-216.
12. D. D. Lewis, "A sequential algorithm for training text classifiers: Corrigendum and additional data, " ACM SIGIR Forum, vol. 29, no. 2, pp. 13-19, 1995.
13. X. Li and Y Guo, "Multi-level adaptive active learning for scene classification, " in Proc. ECCV, 2014, pp. 234-249.
14. B. Zhang, Y Wang, and F. Chen, "Multilabel image classification via high-order label correlation driven active learning, " IEEE Trans. Image Process., vol. 23, no. 3, pp. 1430-1441, Mar. 2014.
15. F. Sun, M. Xu, and X. Jiang, "Robust multi-label image classification with semi-supervised learning and active learning, " in Proc. 21st Int. Conf. MultiMedia Modeling, 2015, pp. 512-523.
16. S. C. H. Hoi, R. Jin, J. Zhu, and M. R. Lyu, "Batch mode active learning and its application to medical image classification, " in Proc. ICML, 2006, pp. 417-424.
17. D. Tuia, F. Ratle, F. Pacifici, M. F. Kanevski, and W J. Emery, "Correction to 'active learning methods for remote sensing image classification, "' IEEE Trans. Geosci. Remote Sens., vol. 48, no. 6, p. 2767, Jun. 2010.
18. S. Tong and D. Koller, "Support vector machine active learning with applications to text classification, " J. Mach. Learn. Res., vol. 2, pp. 45-66, Mar. 2001.
19. A. McCallum and K. Nigam, "Employing EM and pool-based active learning for text classification, " in Proc. ICML, 1998, pp. 350-358.
20. G. Schohn and D. Cohn, "Less is more: Active learning with support vector machines, " in Proc. ICML, 2000, pp. 1-8.
21. S. Vijayanarasimhan and K. Grauman, "Large-scale live active learning: Training object detectors with crawled data and crowds, " in Proc. CVPR, Jun. 2011, pp. 1449-1456.
22. A. G. Hauptmann, W.-H. Lin, R. Yan, J. Yang, and M.-Y Chen, "Extreme video retrieval: Joint maximization of human and computer performance, " in Proc. 14th ACM Int. Conf. Multimedia, 2006, pp. 385-394.
23. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks, " in Proc. NIPS, 2012, pp. 1097-1105.
24. D. Cireşan, U. Meier, and J. Schmidhuber, "Multi-column deep neural networks for image classification, " in Proc. CVPR, Jun. 2012, pp. 3642-3649.
25. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, "ImageNet: A large-scale hierarchical image database, " in Proc. CVPR, Jun. 2009, pp. 248-255.
26. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition, " in Proc. ICLR, 2015, pp. 1-14.
27. L. Jiang, D. Meng, Q. Zhao, S. Shan, and A. G. Hauptmann, "Self-paced curriculum learning, " in Proc. AAAI, 2015, pp. 1-7.
28. Q. Zhao, D. Meng, L. Jiang, Q. Xie, Z. Xu, and A. G. Hauptmann, "Self-paced learning for matrix factorization, " in Proc. AAAI, 2015, pp. 3196-3202.
29. L. Jiang, D. Meng, T. Mitamura, and A. G Hauptmann, "Easy samples first: Self-paced reranking for zero-example multimedia search, " in Proc. 22nd ACM Int. Conf. Multimedia, 2014, pp. 547-556.
30. L. Jiang, D. Meng, S.-I. Yu, Z. Lan, S. Shan, and A. G. Hauptmann, "Self-paced learning with diversity, " in Proc. NIPS, 2014, pp. 2078-2086.
31. B. Settles, "Active learning literature survey, " Comput. Sci. Dept., Univ. Wisconsin-Madison, Madison, WI, USA, Tech. Rep. 1648, 2009.
32. T. Scheffer, C. Decomain, and S. Wrobel, "Active hidden Markov models for information extraction, " in Proc. IDA, 2001, pp. 309-318.
33. C. E. Shannon, "A mathematical theory of communication, " ACM SIGMOBILE Mobile Comput. Commun. Rev., vol. 5, no. 1, pp. 3-55, 2001.
34. M. P. Kumar, B. Packer, and D. Koller, "Self-paced learning for latent variable models, " in Proc. NIPS, 2010, pp. 1189-1197.
35. Y. Bengio, J. Louradour, R. Collobert, and J. Weston, "Curriculum learning, " in Proc. ICML, 2009, pp. 41-48.
36. Y Freund, H. S. Seung, E. Shamir, and N. Tishby, "Selective sampling using the query by committee algorithm, " Mach. Learn., vol. 28, no. 2, pp. 133-168, 1997.
37. A. J. Joshi, F. Porikli, and N. R Papanikolopoulos, "Scalable active learning for multiclass image classification, " IEEE Trans. Pattern Anal. Mach. Intell, vol. 34, no. 11, pp. 2259-2273, Nov. 2012.
38. X. Xiong and F De la Torre, "Supervised descent method and its applications to face alignment, " in Proc. CVPR, Jun. 2013, pp. 532-539.
39. V. Nair and G. E. Hinton, "Rectified linear units improve restricted Boltzmann machines, " in Proc. ICML, 2010, pp. 1-8.
40. O. Russakovsky et al, "ImageNet large scale visual recognition chal-lenge, " Int. J. Comput. Vis., vol. 115, no. 3, pp. 211-252, Dec. 2015.
41. J. Donahue et al, "DeCAF: A deep convolutional activation feature for generic visual recognition, " in Proc. 31st Int. Conf. Mach. Learn. (ICML), Beijing, China, Jun. 2014, pp. 21-26.
42. Y Jia et al, "Caffe: Convolutional architecture for fast feature embed-ding, " in Proc. 22nd ACM Int. Conf. Multimedia, 2014, pp. 675-678.