Image Classification by Cross-Media Active Learning with Privileged Information

IEEE Transactions on Multimedia

Volumn 18, Issue 12, 2016, Pages 2494-2502

  Yan, Yan ^a   Nie, Feiping ^b   Li, Wen ^c   Gao, Chenqiang ^d   Yang, Yi ^a   Xu, Dong ^e  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^b NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^c ETH ZURICH   (Switzerland)

^d CHONGQING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^e UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Active learning; cross media analysis; image classification; Image Text joint modeling

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); LEARNING ALGORITHMS; TEXT PROCESSING;

ACTIVE LEARNING; ACTIVE-LEARNING ALGORITHM; CROSS-MEDIA; JOINT MODELING; OPTIMAL TRADEOFFS; TEXTUAL DESCRIPTION; TEXTUAL INFORMATION; UNLABELED SAMPLES;

IMAGE CLASSIFICATION;

EID: 84999792442     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2016.2602938     Document Type: Article

References (33)

1. J.Krapac, M. Allan, J.Verbeek, and F. Jurie, "Improving web image search results using query-relative classifiers," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2010, pp. 1094-1101.
2. N. Rasiwasia et al., "A new approach to cross-modal multimedia retrieval," in Proc. ACM Int. Conf. Multimedia, 2010, pp. 251-260.
3. L. Duan,W. Li, I.W.-H. Tsang, and D. Xu, "Improving web image search by bag-based reranking," IEEE Trans. Image Process, vol. 20, no. 11, pp. 3280-3290, Nov. 2011.
4. W. Li, L. Niu, and D. Xu, "Exploiting privileged information from web data for image categorization," in Proc. Comput. Vis., 2014, pp. 437-452.
5. B. Settles, "Active learning literature survey," Univ. Wisconsin-Madison, Madison, WI, USA, Comput. Sci. Tech. Rep. 1648, Jan. 2010.
6. Y. Freund, H. S. Seung, E. Shamir, and N. Tishby, "Selective sampling using the query by committee algorithm," Mach. Learn., vol. 28, nos. 2/3, pp. 133-168, 1997.
7. S. Tong and D. Koller, "Support vector machine active learning with applications to text classification," J. Mach. Learn Res, vol. 2, pp. 45-66, 2002.
8. S. Dasgupta and D. Hsu, "Hierarchical sampling for active learning," in Proc. 25th Int. Conf. Mach. Learn., 2008, pp. 208-215.
9. Y. Yang, Y.-T. Zhuang, F.Wu, and Y.-H. Pan, "Harmonizing hierarchical manifolds for multimedia document semantics understanding and crossmedia retrieval," IEEE Trans. Multimedia, vol. 10, no. 3, pp. 437-446, Apr. 2008.
10. F. Wu et al., "Sparse multi-modal hashing," IEEE Trans. Multimedia, vol. 16, no. 2, pp. 427-439, Feb. 2014.
11. S. Wang et al., "Semi-supervised multiple feature analysis for action recognition," IEEE Trans. Multimedia, vol. 16, no. 2, pp. 289-298, Feb. 2014.
12. Y. Yang, Z. Ma, A. Hauptmann, and N. Sebe, "Feature selection for multimedia analysis by sharing information among multiple tasks," IEEE Trans. Multimedia, vol. 15, no. 3, pp. 661-669, Apr. 2013.
13. X. Chang, Z. Ma, Y. Yang, Z. Zeng, and A. G. Hauptmann, "Bi-level semantic representation analysis for multimedia event detection," IEEE Trans. Cybern., vol. PP, no. 99, pp. 1-18, 2016.
14. X. He,W.Min, D. Cai, and K. Zhou, "Laplacian optimal design for image retrieval," in Proc. 30th Annu. Int. ACM SIGIR Conf. Res. Dev. Inf. Retr., 2007, pp. 119-126.
15. P. Jain and A. Kapoor, "Active learning for large multi-class problems," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2009, pp. 762-769.
16. S. Huang, R. Jin, andZ.-H. Zhou, "Active learning by querying informative and representative examples," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 10, pp. 1936-1949, Oct. 2014.
17. Y. Yang, Z. Ma, F. Nie, X. Chang, and A. G. Hauptmann, "Multi-class active learning by uncertainty sampling with diversity maximization," Int. J. Comput. Vis., vol. 113, no. 2, pp. 113-127, 2015.
18. I. Muslea, S. Minton, and C. A. Knoblock, "Active learning with multiple views," J. Artif. Intell. Res., vol. 27, pp. 203-233, 2006.
19. V. Vapnik and A. Vashist, "A new learning paradigm: Learning using privileged information," Neural Netw., vol. 22, no. 5, pp. 544-557, 2009.
20. M.-F. Balcan, A. Broder, and T. Zhang, "Margin based active learning," in Proc. Learn. Theory, 2007, pp. 35-50.
21. H. T. Nguyen and A. Smeulders, "Active learning using pre-clustering," in Proc. 21th Int. Conf. Mach. Learn., 2004.
22. C. C. Aggarwal, Data Classification: Algorithms and Applications. Boca Raton, FL, USA: CRC Press, 2014.
23. W. Wang and Z.-H. Zhou, "On multi-view active learning and the combination with semi-supervised learning," in Proc. 25th Int. Conf. Mach. Learn., 2008, pp. 1152-1159.
24. Y. Han et al., "Image attribute adaptation," IEEE Trans. Multimedia, vol. 16, no. 4, pp. 1115-1126, Jun. 2014.
25. L. Chen, D. Xu, I. W. Tsang, and J. Luo, "Tag-based image retrieval improved by augmented features and group-based refinement," IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1057-1067, Aug. 2012.
26. A. Lindner and S. Susstrunk, "Semantic-improved color imaging applications: It is all about context," IEEE Trans. Multimedia, vol. 17, no. 5, pp. 700-710, May 2015.
27. Y. Wu, I. Kozintsev, J.-Y. Bouguet, and C. Dulong, "Sampling strategies for active learning in personal photo retrieval," in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 2006, pp. 529-532.
28. D. P. Bertsekas, Nonlinear Programming. Belmont, MA, USA: Athena Scientific, 1999.
29. F. Delbos and J.C.Gilbert, "Global linear convergence of an augmented lagrangian algorithm for solving convex quadratic optimization problems," J. Convex Anal., vol. 12, pp. 45-69, 2005.
30. C. Rashtchian, P. Young, M. Hodosh, and J. Hockenmaier, "Collecting image annotations using amazon's mechanical turk," in Proc. NAACL HLT Workshop Creating Speech Lang. Data Amazon's Mech. Turk, 2010, pp. 139-147.
31. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," CoRR, 2014. [online]. Available: http://arxiv.org/abs/1409.1556
32. Y. Jia et al., "Caffe: Convolutional architecture for fast feature embedding," Proc. 22nd ACM Int. Conf. Multimedia, pp. 675-678, 2014.
33. O. MacAodha,N.D. Campbell, J. Kautz, andG. J. Brostow, "Hierarchical subquery evaluation for active learning on a graph," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2014, pp. 564-571.