Multi-Modal Curriculum Learning for Semi-Supervised Image Classification

IEEE Transactions on Image Processing

Volumn 25, Issue 7, 2016, Pages 3249-3260

  Gong, Chen ^a,b   Tao, Dacheng ^b   Maybank, Stephen J ^c   Liu, Wei ^d   Kang, Guoliang ^b   Yang, Jie ^a  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^c UNIVERSITY OF LONDON   (United Kingdom)

^d IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Curriculum learning; Image classification; Multi modal; Semi supervised learning

Indexed keywords

CRACK PROPAGATION; CURRICULA; EDUCATION; ITERATIVE METHODS; SUPERVISED LEARNING; TEACHING;

CLASSIFICATION ACCURACY; DISCRIMINABILITY; IMAGE SEQUENCE; MULTI-MODAL; PROPAGATION PROCESS; SEMI- SUPERVISED LEARNING; SEMI-SUPERVISED; SEMI-SUPERVISED METHOD;

IMAGE CLASSIFICATION;

EID: 84973146898     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2016.2563981     Document Type: Article

References (56)

1. X. Cai, F. Nie, W. Cai, and H. Huang, "Heterogeneous image features integration via multi-modal semi-supervised learning model," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2013, pp. 1737-1744.
2. D. Dai and L. Van Gool, "Ensemble projection for semi-supervised image classification," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2013, pp. 2072-2079.
3. R. Fergus, Y. Weiss, and A. Torralba, "Semi-supervised learning in gigantic image collections," in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2009, pp. 522-530.
4. M. Guillaumin, J. Verbeek, and C. Schmid, "Multimodal semisupervised learning for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 902-909.
5. Y. Luo, D. Tao, B. Geng, C. Xu, and S. J. Maybank, "Manifold regularized multitask learning for semi-supervised multilabel image classification," IEEE Trans. Image Process., vol. 22, no. 2, pp. 523-536, Feb. 2013.
6. L. Jing and M. K. Ng, "Sparse label-indicator optimization methods for image classification," IEEE Trans. Image Process., vol. 23, no. 3, pp. 1002-1014, Mar. 2014.
7. X. Liu, T. Guo, L. He, and X. Yang, "A low-rank approximation-based transductive support tensor machine for semisupervised classification," IEEE Trans. Image Process., vol. 24, no. 6, pp. 1825-1838, Jun. 2015.
8. B. Wang, Z. Tu, and J. K. Tsotsos, "Dynamic label propagation for semi-supervised multi-class multi-label classification," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2013, pp. 425-432.
9. W. Xie, Z. Lu, Y. Peng, and J. Xiao, "Graph-based multimodal semi-supervised image classification," Neurocomputing, vol. 138, pp. 167-179, Aug. 2014.
10. Y. Bengio, J. Louradour, R. Collobert, and J. Weston, "Curriculum learning," in Proc. Int. Conf. Mach. Learn. (ICML), 2009, pp. 41-48.
11. X. Zhu and Z. Ghahramani, "Learning from labeled and unlabeled data with label propagation," School Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, USA, Tech. Rep. CMU-CALD-02-107, 2002.
12. X. Zhu and A. B. Goldberg, Introduction to Semi-Supervised Learning. San Mateo, CA, USA: Morgan Kaufmann, 2009.
13. C. Rosenberg, M. Hebert, and H. Schneiderman, "Semi-supervised selftraining of object detection models," in Proc. IEEE Workshops Appl. Comput. Vis. (WACV), Jan. 2005, pp. 29-36.
14. T. Joachims, "Transductive inference for text classification using support vector machines," in Proc. Int. Conf. Mach. Learn. (ICML), 1999, pp. 200-209.
15. Y.-F. Li and Z.-H. Zhou, "Towards making unlabeled data never hurt," in Proc. Int. Conf. Mach. Learn. (ICML), 2011, pp. 1081-1088.
16. Y. Wang and S. Chen, "Safety-aware semi-supervised classification," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 11, pp. 1763-1772, Nov. 2013.
17. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol. 7, pp. 2399-2434, Nov. 2006.
18. X. Zhu, Z. Ghahramani, and J. Lafferty, "Semi-supervised learning using Gaussian fields and harmonic functions," in Proc. Int. Conf. Mach. Learn. (ICML), 2003, pp. 912-919.
19. C. Gong, D. Tao, K. Fu, and J. Yang, "Fick's law assisted propagation for semisupervised learning," IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 9, pp. 2148-2162, Sep. 2015.
20. A. Shrivastava, S. Singh, and A. Gupta, "Constrained semi-supervised learning using attributes and comparative attributes," in Proc. Eur. Conf. Comput. Vis. (ECCV), 2012, pp. 369-383.
21. A. Mahmood, A. Mian, and R. Owens, "Semi-supervised spectral clustering for image set classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014, pp. 121-128.
22. G. Camps-Valls, T. V. BandosMarsheva, and D. Zhou, "Semi-supervised graph-based hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 10, pp. 3044-3054, Oct. 2007.
23. C. Xu, T. Liu, D. Tao, and C. Xu, "Local rademacher complexity for multi-label learning," IEEE Trans. Image Process., vol. 25, no. 3, pp. 1495-1507, Mar. 2016.
24. C. Xu, D. Tao, and C. Xu. (2013). "A survey on multi-view learning." [Online]. Available: http://arxiv.org/abs/1304.5634
25. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training," in Proc. Conf. Comput. Learn. Theory, 1998, pp. 92-100.
26. C. Ding and D. Tao, "Robust face recognition via multimodal deep face representation," IEEE Trans. Multimedia, vol. 17, no. 11, pp. 2049-2058, Nov. 2015.
27. G. R. G. Lanckriet, N. Cristianini, P. Bartlett, L. El Ghaoui, and M. I. Jordan, "Learning the kernel matrix with semidefinite programming," J. Mach. Learn. Res., vol. 5, pp. 27-72, Jan. 2004.
28. M. White, X. Zhang, D. Schuurmans, and Y.-L. Yu, "Convex multi-view subspace learning," in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2012, pp. 1673-1681.
29. Y. Luo, T. Liu, D. Tao, and C. Xu, "Multiview matrix completion for multilabel image classification," IEEE Trans. Image Process., vol. 24, no. 8, pp. 2355-2368, Aug. 2015.
30. M. P. Kumar, B. Packer, and D. Koller, "Self-paced learning for latent variable models," in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2010, pp. 1189-1197.
31. L. Jiang, D. Meng, S.-I. Yu, Z. Lan, S. Shan, and A. Hauptmann, "Self-paced learning with diversity," in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2014, pp. 2078-2086.
32. L. Jiang, D. Meng, Q. Zhao, S. Shan, and A. Hauptmann, "Self-paced curriculum learning," in Proc. AAAI Conf. Artif. Intell. (AAAI), 2015, p. 6.
33. C. Gong, D. Tao, W. Liu, L. Liu, and J. Yang, "Label propagation via teaching-to-learn and learning-to-teach," IEEE Trans. Neural Netw. Learn. Syst., Apr. 2016. [Online]. Available: http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7447818
34. C. Gong, D. Tao, J. Yang, and W. Liu, "Teaching-to-learn and learning-to-teach for multi-label propagation," in Proc. AAAI Conf. Artif. Intell. (AAAI), 2016, pp. 1-7.
35. Y. J. Lee and K. Grauman, "Learning the easy things first: Self-paced visual category discovery," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 1721-1728.
36. J. S. Supancic, III, and D. Ramanan, "Self-paced learning for long-term tracking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 2379-2386.
37. L. Jiang, D. Meng, T. Mitamura, and A. G. Hauptmann, "Easy samples first: Self-paced reranking for zero-example multimedia search," in Proc. ACM Multimedia Conf. (ACM MM), 2014, pp. 547-556.
38. M. Karasuyama and H. Mamitsuka, "Manifold-based similarity adaptation for label propagation," in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2013, pp. 1547-1555.
39. X. Zhu, J. D. Lafferty, and Z. Ghahramani, "Semi-supervised learning: From Gaussian fields to Gaussian processes," Tech. Rep. CMU-CS-03-175, Carnegie Mellon Univ., Pittsburgh, PA, USA, 2003.
40. C. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer, 2006.
41. H. Qiu and E. R. Hancock, "Clustering and embedding using commute times," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 11, pp. 1873-1890, Nov. 2007.
42. D. P. Bertsekas, Constrained Optimization and Lagrange Multiplier Methods. San Diego, CA, USA: Academic, 2014.
43. P.-A. Absil and J. Malick, "Projection-like retractions on matrix manifolds," SIAM J. Optim., vol. 22, no. 1, pp. 135-158, Jan. 2012.
44. F. Pompili, N. Gillis, P.-A. Absil, and F. Glineur. (2014). "Two algorithms for orthogonal nonnegative matrix factorization with application to clustering." [Online]. Available: http://arxiv.org/abs/1201.0901
45. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Learning with local and global consistency," in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2003, pp. 321-328.
46. A. Bosch, A. Zisserman, and X. Munoz, "Representing shape with a spatial pyramid kernel," in Proc. 6th ACM Int. Conf. Image video Retr., 2007, pp. 401-408.
47. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001.
48. T. Ahonen, A. Hadid, and M. Pietikäinen, "Face recognition with local binary patterns," in Proc. Eur. Conf. Comput. Vis. (ECCV), 2004, pp. 469-481.
49. G. Griffin, A. Holub, and P. Perona, "Caltech-256 object category dataset," California Inst. Technol., Pasadena, CA, USA, Tech. Rep. CNSTR- 2007-001, 2007.
50. Z. Xu, Z. Hong, Y. Zhang, J. Wu, A. ChungTsoi, and D. Tao, "Multinomial latent logistic regression for image understanding," IEEE Trans. Image Process., vol. 25, no. 2, pp. 973-987, Feb. 2016.
51. L.-J. Li and L. Fei-Fei, "What, where and who? Classifying events by scene and object recognition," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Oct. 2007, pp. 1-8.
52. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2006, pp. 2169-2178.
53. A. Krizhevsky, "Learning multiple layers of features from tiny images," Univ. Toronto, Toronto, ON, Canada, Tech. Rep., 2009.
54. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng, "NUSWIDE: A real-world Web image database from national University of Singapore," in Proc. ACM Int. Conf. Image Video Retr., 2009, pp. 48-56.
55. M. Karasuyama and H. Mamitsuka, "Multiple graph label propagation by sparse integration," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 12, pp. 1999-2012, Dec. 2013.
56. T. Liu and D. Tao, "Classification with noisy labels by importance reweighting," IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 3, pp. 447-461, Mar. 2016.