Large margin multi-modal multi-task feature extraction for image classification

IEEE Transactions on Image Processing

Volumn 25, Issue 1, 2016, Pages 414-427

  Luo, Yong ^a,b,c   Wen, Yonggang ^b   Tao, Dacheng ^c   Gui, Jie ^d   Xu, Chao ^a  

^a China   (China)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^d INSTITUTE OF INTELLIGENT MACHINES   (China)

Author keywords

Feature extraction; Image classification; Large margin; Multi modal; Multi task

Indexed keywords

EXTRACTION; FEATURE EXTRACTION; IMAGE CLASSIFICATION; IMAGE PROCESSING;

FEATURE REDUNDANCY; HIGH DIMENSIONS; HIGH-DIMENSIONAL; LARGE MARGIN PRINCIPLE; LARGE MARGINS; MULTI-MODAL; MULTIPLE MODALITIES; REAL-WORLD IMAGE DATA;

CLASSIFICATION (OF INFORMATION);

EID: 85009436124     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2495116     Document Type: Article

References (50)

1. Y. Luo, D. Tao, B. Geng, C. Xu, and S. J. Maybank, "Manifold regularized multitask learning for semi-supervised multilabel image classification, " IEEE Trans. Image Process., vol. 22, no. 2, pp. 523-536, Feb. 2013.
2. Y Luo, T. Liu, D. Tao, and C. Xu, "Decomposition-based transfer distance metric learning for image classification, " IEEE Trans. Image Process., vol. 23, no. 9, pp. 3789-3801, Sep. 2014.
3. U. Srinivas, Y. Suo, M. Dao, V. Monga, and T. D. Tran, "Structured sparse priors for image classification, " IEEE Trans. Image Process., vol. 24, no. 6, pp. 1763-1776, Jun. 2015.
4. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope, " Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001.
5. D. G. Lowe, "Distinctive image features from scale-invariant keypoints, " Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
6. M. Guillaumin, J. Verbeek, and C. Schmid, "Multimodal semi-supervised learning for image classification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 902-909.
7. I. Guyon, S. Gunn, M. Nikravesh, and L. A. Zadeh, Eds., Feature Extraction: Foundations and Applications. Berlin, Germany: Springer-Verlag, 2006.
8. F. Nie, H. Huang, X. Cai, and C. H. Ding, "Efficient and robust feature selection via joint I2 1-norms minimization, " in Proc. Adv. Neural Inf. Process. Syst., 2010, pp. 1813-1821.
9. Z. Li, Y. Yang, J. Liu, X. Zhou, and H. Lu, "Unsupervised feature selection using nonnegative spectral analysis, " in Proc. 26th AAAI Conf. Artif. Intell., 2012, pp. 1026-1032.
10. M. Masaeli, J. G. Dy, and G. M. Fung, "From transformation-based dimensionality reduction to feature selection, " in Proc. 27th Int. Conf. Mach. Learn., 2010, pp. 751-758.
11. P. S. Bradley and O. L. Mangasarian, "Feature selection via concave minimization and support vector machines, " in Proc. 15th Int. Conf. Mach. Learn., 1998, pp. 82-90.
12. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. New York, NY, USA: Wiley, 2001.
13. X. He, D. Cai, and P. Niyogi, "Laplacian score for feature selection, " in Proc. Adv. Neural Inf. Process. Syst., 2005, pp. 507-514.
14. G. Obozinski, B. Taskar, and M. Jordan, "Multi-task feature selection, " in Proc. ICML Workshop Struct. Knowl. Transf. Mach. Learn., 2006, pp. 1-15.
15. Y. Yang, H. T. Shen, Z. Ma, Z. Huang, and X. Zhou, "l2, 1-norm regularized discriminative feature selection for unsupervised learning, " in Proc. Int. Joint Conf. Artif. Intell., 2011, pp. 1589-1594.
16. J. Tang, X. Hu, H. Gao, and H. Liu, "Unsupervised feature selection for multi-view data in social media, " in Proc. SIAM Int. Conf. Data Mining, 2013, pp. 270-278.
17. U. von Luxburg, "A tutorial on spectral clustering, " Statist. Comput., vol. 17, no. 4, pp. 395-416, 2007.
18. H. Wang, F. Nie, and H. Huang, "Multi-view clustering and feature learning via structured sparsity, " in Proc. 30th Int. Conf. Mach. Learn., 2013, pp. 352-360.
19. B. Cao, L. He, X. Kong, P. S. Yu, Z. Hao, and A. B. Ragin, "Tensor-based multi-view feature selection with applications to brain diseases, " in Proc. IEEE Int. Conf. Data Mining, Dec. 2014, pp. 40-49.
20. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng, "NUS-WIDE: A real-world Web image database from National University of Singapore, " in Proc. ACM Int. Conf. Image Video Retr., 2009, p. 48.
21. M. J. Huiskes and M. S. Lew, "The MIR flickr retrieval evaluation, " in Proc. 1st ACM Int. Conf. Multimedia Inf. Retr., 2008, pp. 39-43.
22. F. Nie, S. Xiang, Y. Jia, C. Zhang, and S. Yan, "Trace ratio criterion for feature selection, " in Proc. 23rd AAAI Conf. Artif. Intell., 2008, pp. 671-676.
23. X. Cai, F. Nie, H. Huang, and C. Ding, "Multi-class l2, 1-norm support vector machine, " in Proc. IEEE 11th Int. Conf. Data Mining, Dec. 2011, pp. 91-100.
24. S. Xiang, F. Nie, G. Meng, C. Pan, and C. Zhang, "Discriminative least squares regression for multiclass classification and feature selection, " IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 11, pp. 1738-1754, Nov. 2012.
25. C. Hou, F. Nie, X. Li, D. Yi, and Y. Wu, "Joint embedding learning and sparse regression: A framework for unsupervised feature selection, " IEEE Trans. Cybern., vol. 44, no. 6, pp. 793-804, Jun. 2014.
26. S. Eleftheriadis, O. Rudovic, and M. Pantic, "Discriminative shared Gaussian processes for multiview and view-invariant facial expression recognition, " IEEE Trans. Image Process., vol. 24, no. 1, pp. 189-204, Jan. 2015.
27. J. Woo, M. Stone, and J. L. Prince, "Multimodal registration via mutual information incorporating geometric and spatial context, " IEEE Trans. Image Process., vol. 24, no. 2, pp. 757-769, Feb. 2015.
28. Y. Luo, D. Tao, C. Xu, C. Xu, H. Liu, and Y. Wen, "Multiview vectorvalued manifold regularization for multilabel image classification, " IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 5, pp. 709-722, May 2013.
29. Y. Luo, J. Tang, J. Yan, C. Xu, and Z. Chen, "Pre-trained multi-view word embedding using two-side neural network, " in Proc. 28th AAAI Conf. Artif. Intell., 2014, pp. 1982-1988.
30. J. Gui, D. Tao, Z. Sun, Y. Luo, X. You, and Y. Y. Tang, "Group sparse multiview patch alignment framework with view consistency for image classification, " IEEE Trans. Image Process., vol. 23, no. 7, pp. 3126-3137, Jul. 2014.
31. Y. Luo, T. Liu, D. Tao, and C. Xu, "Multiview matrix completion for multilabel image classification, " IEEE Trans. Image Process., vol. 24, no. 8, pp. 2355-2368, Aug. 2015.
32. C. Xu, D. Tao, and C. Xu, "Multi-view intact space learning, " IEEE Trans. Pattern Anal. Mach. Intell., doi: 10.1109/TPAMI.2015.2417578.
33. G. R. G. Lanckriet, N. Cristianini, P. Bartlett, L. El Ghaoui, and M. I. Jordan, "Learning the kernel matrix with semidefinite program-ming, " J. Mach. Learn. Res., vol. 5, pp. 27-72, Jan. 2004.
34. B. McFee and G. Lanckriet, "Learning multi-modal similarity, " J. Mach. Learn. Res., vol. 12, pp. 491-523, Feb. 2011.
35. T. Xia, D. Tao, T. Mei, and Y. Zhang, "Multiview spectral embed-ding, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 6, pp. 1438-1446, Dec. 2010.
36. D. R. Hardoon, S. Szedmak, and J. Shawe-Taylor, "Canonical correlation analysis: An overview with application to learning methods, " Neural Comput., vol. 16, no. 12, pp. 2639-2664, Dec. 2004.
37. M. White, X. Zhang, D. Schuurmans, and Y.-L. Yu, "Convex multiview subspace learning, " in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 1682-1690.
38. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training, " in Proc. Annu. Conf. Comput. Learn. Theory, 1998, pp. 92-100.
39. U. Brefeld and T. Scheffer, "Co-EM support vector learning, " in Proc. Int. Conf. Mach. Learn., 2004, pp. 121-128.
40. A. Kumar, P. Rai, and H. Daume, "Co-regularized multi-view spectral clustering, " in Proc. Adv. Neural Inf. Process. Syst., 2011, pp. 1413-1421.
41. T. Liu and D. Tao, "Classification with noisy labels by importance reweighting, " IEEE Trans. Pattern Anal. Mach. Intell., doi: 10.1109/TPAMI.2015.2456899.
42. Y. Nesterov, "Smooth minimization of non-smooth functions, " Math. Program., vol. 103, no. 1, pp. 127-152, 2005.
43. N. Guan, D. Tao, Z. Luo, and B. Yuan, "NeNMF: An optimal gradient method for nonnegative matrix factorization, " IEEE Trans. Signal Process., vol. 60, no. 6, pp. 2882-2898, Jun. 2012.
44. M. Sokolova and G. Lapalme, "A systematic analysis of performance measures for classification tasks, " Inf. Process. Manage., vol. 45, no. 4, pp. 427-437, 2009.
45. M. Zhu, "Recall, precision and average precision, " Dept. Statist. Actuarial Sci., Univ. Waterloo, Waterloo, ON, Canada, Working Paper 2004-09, 2004.
46. C. Sammut and G. I. Webb, Encyclopedia of Machine Learning. Berlin, Germany: Springer-Verlag, 2011.
47. G. James, D. Witten, T. Hastie, and R. Tibshirani, An Introduction to Statistical Learning. Berlin, Germany: Springer-Verlag, 2013.
48. H. Hu, Y. Wen, T.-S. Chua, and X. Li, "Toward scalable systems for big data analytics: A technology tutorial, " IEEE Access, vol. 2, pp. 652-687, Jul. 2014.
49. Y. Wen, X. Zhu, J. J. P. C. Rodrigues, and C. W. Chen, "Cloud mobile media: Reflections and outlook, " IEEE Trans. Multimedia, vol. 16, no. 4, pp. 885-902, Jun. 2014.
50. G. Gao, W. Zhang, Y. Wen, Z. Wang, and W. Zhu, "Towards cost-efficient video transcoding in media cloud: Insights learned from user viewing patterns, " IEEE Trans. Multimedia, vol. 17, no. 8, pp. 1286-1296, Aug. 2015.