Multiview vector-valued manifold regularization for multilabel image classification

IEEE Transactions on Neural Networks and Learning Systems

Volumn 24, Issue 5, 2013, Pages 709-722

  Luo, Yong ^a   Tao, Dacheng ^b   Xu, Chang ^a   Xu, Chao ^a   Liu, Hong ^d   Wen, Yonggang ^c  

^a Peking University   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^d PEKING UNIVERSITY   (China)

Author keywords

Image classification; Manifold; Multilabel; Multiview; Semisupervised

Indexed keywords

CLASSIFICATION (OF INFORMATION); VECTOR SPACES; COMPUTER VISION;

COMPLEMENTARY PROPERTY; MANIFOLD; MANIFOLD REGULARIZATIONS; MULTI-LABEL; MULTI-VIEWS; MULTIPLE FEATURES; SEMI-SUPERVISED; VECTOR-VALUED FUNCTION;

IMAGE CLASSIFICATION;

ALGORITHM; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; DATA BASE; PROCEDURES; REPRODUCIBILITY; STATISTICAL MODEL;

ALGORITHMS; DATABASE MANAGEMENT SYSTEMS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MODELS, STATISTICAL; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS;

EID: 84884922012     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2238682     Document Type: Article

References (61)

1. M. Boutell, J. Luo, X. Shen, and C. Brown, "Learning multi-label scene classification," Pattern Recognit., vol. 37, no. 9, pp. 1757-1771, 2004.
2. M. Guillaumin, J. Verbeek, and C. Schmid, "Multimodal semi-supervised learning for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 902-909.
3. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
4. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001. (Pubitemid 32680801)
5. E. Çesmeli and D. Wang, "Texture segmentation using gaussian-markov random fields and neural oscillator networks," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 394-404, Mar. 2001. (Pubitemid 32371493)
6. D. Masip and J. Vitrià, "Shared feature extraction for nearest neighbor face recognition," IEEE Trans. Neural Netw., vol. 19, no. 4, pp. 586-595, Apr. 2008. (Pubitemid 351583576)
7. C. Micchelli and M. Pontil, "On learning vector-valued functions," Neural Comput., vol. 17, no. 1, pp. 177-204, 2005.
8. H. Minh and V. Sindhwani, "Vector-valued manifold regularization," in Proc. 28th Int. Conf. Mach. Learn., 2011, pp. 57-64.
9. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol. 7, no. 1, pp. 2399-2434, Jan. 2006. (Pubitemid 44708005)
10. G. Chen, Y. Song, F. Wang, and C. Zhang, "Semi-supervised multi-label learning by solving a sylvester equation," in Proc. SIAM Int. Conf. Data Mining, 2008, pp. 410-419.
11. B. Hariharan, L. Zelnik-Manor, S. Vishwanathan, and M. Varma, "Large scale max-margin multi-label classification with priors," in Proc. 27th Int. Conf. Mach. Learn., 2010, pp. 423-430.
12. L. Sun, S. Ji, and J. Ye, "Canonical correlation analysis for multilabel classification: A least-squares formulation, extensions, and analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 194-200, Jan. 2011.
13. L. Rosasco, E. Vito, A. Caponnetto, M. Piana, and A. Verri, "Are loss functions all the same?" Neural Comput., vol. 16, no. 5, pp. 1063-1076, 2004. (Pubitemid 38483051)
14. D. Tao, X. Tang, X. Li, and X. Wu, "Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 7, pp. 1088-1099, Jul. 2006.
15. D. Tao, X. Li, and S. Maybank, "Negative samples analysis in relevance feedback," IEEE Trans. Knowl. Data Eng., vol. 19, no. 4, pp. 568-580, Apr. 2007.
16. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, "The PASCAL visual object classes challenge (VOC) results," Int. J. Comput. Vis., vol. 88, no. 2, pp. 303-338, 2010.
17. M. J. Huiskes and M. S. Lew, "The MIR flickr retrieval evaluation," in Proc. 1st ACM Int. Conf. Multimedia Inf. Retr., 2008, pp. 39-43.
18. A. Rakotomamonjy, F. Bach, S. Canu, and Y. Grandvalet, "SimpleMKL," J. Mach. Learn. Res., vol. 9, pp. 2491-2521, Nov. 2008.
19. M. Kloft, U. Brefeld, S. Sonnenburg, and A. Zien, "Lp-norm multiple kernel learning," J. Mach. Learn. Res., vol. 12, no. 3, pp. 953-997, Mar. 2011.
20. D. Hsu, S. Kakade, J. Langford, and T. Zhang, "Multi-label prediction via compressed sensing," in Advances in Neural Information Processing Systems. New York, USA: Springer-Verlag, 2009, pp. 772-780.
21. T. Zhou and D. Tao, "Multi-label subspace ensemble," J. Mach. Learn. Res., vol. 22, pp. 1444-1452, Apr. 2012.
22. T. Zhou, D. Tao, and X. Wu, "Compressed labeling on distilled labelsets for multi-label learning," Mach. Learn., vol. 88, no. 1, pp. 69-126, 2012.
23. Y. Luo, D. Tao, B. Geng, C. Xu, and S. J. Maybank, "Manifold regularized multi-task learning for semi-supervised multi-label image classification," IEEE Trans. Image Process., vol. 22, no. 2, pp. 523-536, Feb. 2013.
24. R. Schapire and Y. Singer, "Boostexter: A boosting-based system for text categorization," Mach. Learn., vol. 39, no. 2, pp. 135-168, 2000. (Pubitemid 30594821)
25. A. Elisseeff and J. Weston, "A kernel method for multi-labelled classification," in Advances in Neural Information Processing Systems. New York, USA: Springer-Verlag, 2001, pp. 681-687.
26. M. Zhang and Z. Zhou, "ML-KNN: A lazy learning approach to multilabel learning," Pattern Recognit., vol. 40, no. 7, pp. 2038-2048, 2007. (Pubitemid 46497248)
27. A. McCallum, "Multi-label text classification with a mixture model trained by EM," in Proc. Assoc. Adv. Artif. Intell. Workshop Text Learn., 1999, pp. 1-7.
28. L. Sun, S. Ji, and J. Ye, "Hypergraph spectral learning for multi-label classification," in Proc. 14th ACM Int. Conf. Knowl. Discovery Data Mining, 2008, pp. 668-676.
29. S. Ji, L. Tang, S. Yu, and J. Ye, "A shared-subspace learning framework for multi-label classification," ACM Trans. Knowl. Discovery Data, vol. 4, no. 2, pp. 1-29, 2010.
30. S. Zafeiriou, G. Tzimiropoulos, M. Petrou, and T. Stathaki, "Regularized kernel discriminant analysis with a robust kernel for face recognition and verification," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 3, pp. 526-534, Mar. 2012.
31. D. Tao, X. Tang, X. Li, and Y. Rui, "Direct kernel biased discriminant analysis: A new content-based image retrieval relevance feedback algorithm," IEEE Trans. Multimedia, vol. 8, no. 4, pp. 716-727, Aug. 2006. (Pubitemid 44144157)
32. G. Lanckriet, N. Cristianini, P. Bartlett, L. Ghaoui, and M. Jordan, "Learning the kernel matrix with semidefinite programming," in Proc. 19th Int. Conf. Mach. Learn., Jan. 2002, pp. 323-330.
33. S. Sonnenburg, G. Rätsch, C. Schäfer, and B. Schölkopf, "Large scale multiple kernel learning," J. Mach. Learn. Res., vol. 7, pp. 1531-1565, Jul. 2006. (Pubitemid 44373694)
34. K. Kreutz-Delgado, J. Murray, B. Rao, K. Engan, T. Lee, and T. Sejnowski, "Dictionary learning algorithms for sparse representation," Neural Comput., vol. 15, no. 2, pp. 349-396, 2003. (Pubitemid 37049825)
35. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Oct. 2006, pp. 2169-2178.
36. K. Labusch, E. Barth, and T. Martinetz, "Simple method for high-performance digit recognition based on sparse coding," IEEE Trans. Neural Netw., vol. 19, no. 11, pp. 1985-1989, Nov. 2008.
37. X. Zhou, K. Yu, T. Zhang, and T. Huang, "Image classification using super-vector coding of local image descriptors," in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 141-154.
38. Y. Yang and S. Newsam, "Spatial pyramid co-occurrence for image classification," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 1465-1472.
39. T. Xia, D. Tao, T. Mei, and Y. Zhang, "Multiview spectral embedding," IEEE Trans. Syst., Man, Cybern., B, Cybern., vol. 40, no. 6, pp. 1438-1446, Dec. 2010.
40. B. Xie, Y. Mu, D. Tao, and K. Huang, "m-SNE: Multiview stochastic neighbor embedding," IEEE Trans. Systems, Man, Cybern., B, Cybern., vol. 41, no. 4, pp. 1088-1096, Aug. 2011.
41. J. Yu, M. Wang, and D. Tao, "Semi-supervised multiview distance metric learning for cartoon synthesis," IEEE Trans. Image Process., vol. 21, no. 11, pp. 4636-4648, Nov. 2012.
42. H. Su, M. Sun, L. Fei-Fei, and S. Savarese, "Learning a dense multiview representation for detection, viewpoint classification and synthesis of object categories," in Proc. IEEE Int. Conf. Comput. Vis., Sep.-Oct. 2009, pp. 213-220.
43. Y. Fu, Y. Guo, Y. Zhu, F. Liu, C. Song, and Z. Zhou, "Multi-view video summarization," IEEE Trans. Multimedia, vol. 12, no. 7, pp. 717-729, Aug. 2010.
44. A. Iosifidis, A. Tefas, and I. Pitas, "View-invariant action recognition based on artificial Neural Networks," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 3, pp. 412-424, Jul. 2012.
45. A. Saffari, C. Leistner, M. Godec, and H. Bischof, "Robust multi-view boosting with priors," in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 776-789.
46. D. Zhang, F. Wang, L. Si, and T. Li, "Maximum margin multiple instance clustering with its applications to image and text clustering," IEEE Trans. Neural Netw., vol. 22, no. 5, pp. 739-751, May 2011.
47. H. Zhang, G. Liu, T. Chow, and W. Liu, "Textual and visual content-based anti-phishing: A Bayesian approach," IEEE Trans. Neural Netw., vol. 22, no. 10, pp. 1532-1546, Oct. 2011.
48. S. Bucak, R. Jin, and A. Jain, "Multi-label learning with incomplete class assignments," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 2801-2808.
49. X. Chen, X. Yuan, Q. Chen, S. Yan, and T. Chua, "Multi-label visual classification with label exclusive context," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 834-841.
50. Z. Fan, Y. Xu, and D. Zhang, "Local linear discriminant analysis framework using sample neighbors," IEEE Trans. Nural Netw., vol. 22, no. 7, pp. 1119-1132, Jul. 2011.
51. D. Bouchaffra, "Mapping dynamic bayesian networks to α-shapes: Application to human faces identification across ages," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 8, pp. 1229-1241, Aug. 2012.
52. L. Chen, I. Tsang, and D. Xu, "Laplacian embedded regression for scalable manifold regularization," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 6, pp. 902-915, Jun. 2012.
53. V. Strassen, "Gaussian elimination is not optimal," Numer. Math., vol. 13, no. 4, pp. 354-356, 1969.
54. J. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances in Kernel Methods. Cambridge, MA, USA: MIT Press, pp. 185-208, 1999.
55. J. Van De Weijer and C. Schmid, "Coloring local feature extraction," in Proc. Eur. Conf. Comput. Vis., 2006, pp. 334-348.
56. M. Zhu, "Recall, precision and average precision," Dept. Electr. Eng., Univ. Waterloo, Waterloo, ON, Canada, Tech. Rep. 2004-09, 2004.
57. T. Fawcett, "Roc graphs: Notes and practical considerations for researchers," Mach. Learn., vol. 31, pp. 1-38, Mar. 2004.
58. X. Zhu, "Semi-supervised learning literature survey," Dept. Electr. Eng., Univ. Wisconsin Madison, Madison, WI, USA, Tech. Rep. 1530, 2006.
59. M. Gori, "On the time complexity of regularized least square," in Proc. WIRN, 2011, pp. 85-96.
60. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani, "Least angle regression," Annals Stat., vol. 32, no. 2, pp. 407-499, 2004.
61. J. Demšar, "Statistical comparisons of classifiers over multiple data sets," J. Mach. Learn. Res., vol. 7, no. 1, pp. 1-30, Jan. 2006. (Pubitemid 43022939)