Local Rademacher Complexity for Multi-Label Learning

IEEE Transactions on Image Processing

Volumn 25, Issue 3, 2016, Pages 1495-1507

  Xu, Chang ^a   Liu, Tongliang ^b   Tao, Dacheng ^b   Xu, Chao ^a  

^a Peking University   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

local Rademacher complexity; Multi label learning

Indexed keywords

ALGORITHMS; COMPUTATIONAL COMPLEXITY; LEARNING SYSTEMS; OPTIMIZATION; VIRTUAL REALITY;

EMPIRICAL RISK MINIMIZATION; EMPIRICAL STUDIES; GENERALIZATION ERROR BOUNDS; LABEL CORRELATIONS; MULTI-LABEL LEARNING; OBJECTIVE FUNCTIONS; RADEMACHER COMPLEXITY; THRESHOLDING ALGORITHMS;

LEARNING ALGORITHMS;

EID: 84962777544     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2016.2524207     Document Type: Article

References (66)

1. M.-L. Zhang and Z.-H. Zhou, "A review on multi-label learning algorithms, " IEEE Trans. Knowl. Data Eng., vol. 26, no. 8, pp. 1819-1837, Aug. 2014.
2. S. Gao, W. Wu, C.-H. Lee, and T.-S. Chua, "A MFoM learning approach to robust multiclass multi-label text categorization, " in Proc. 21st Int. Conf. Mach. Learn., 2004, p. 42.
3. J. Tang, Z.-J. Zha, D. Tao, and T.-S. Chua, "Semantic-gap-oriented active learning for multilabel image annotation, " IEEE Trans. Image Process., vol. 21, no. 4, pp. 2354-2360, Apr. 2012.
4. F. Sun, J. Tang, H. Li, G.-J. Qi, and T. S. Huang, "Multi-label image categorization with sparse factor representation, " IEEE Trans. Image Process., vol. 23, no. 3, pp. 1028-1037, Mar. 2014.
5. J. Fan, Y. Shen, C. Yang, and N. Zhou, "Structured max-margin learning for inter-related classifier training and multilabel image annotation, " IEEE Trans. Image Process., vol. 20, no. 3, pp. 837-854, Mar. 2011.
6. Z. Li, J. Liu, J. Tang, and H. Lu, "Robust structured subspace learning for data representation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 10, pp. 2085-2098, Oct. 2015.
7. J. Tang, Z. Li, M. Wang, and R. Zhao, "Neighborhood discriminant hashing for large-scale image retrieval, " IEEE Trans. Image Process., vol. 24, no. 9, pp. 2827-2840, Sep. 2015.
8. L. Jing and M. K. Ng, "Sparse label-indicator optimization methods for image classification, " IEEE Trans. Image Process., vol. 23, no. 3, pp. 1002-1014, Mar. 2014.
9. Z. Barutcuoglu, R. E. Schapire, and O. G. Troyanskaya, "Hierarchical multi-label prediction of gene function, " Bioinformatics, vol. 22, no. 7, pp. 830-836, Jan. 2006.
10. G. Tsoumakas, I. Katakis, and I. Vlahavas, "Mining multi-label data, " in Data Mining and Knowledge Discovery Handbook. New York, NY, USA: Springer, 2010, pp. 667-685.
11. J. Read, B. Pfahringer, G. Holmes, and E. Frank, "Classifier chains for multi-label classification, " J. Mach. Learn., vol. 85, no. 3, pp. 333-359, Dec. 2011.
12. B. Hariharan, L. Zelnik-Manor, M. Varma, and S. Vishwanathan, "Large scale max-margin multi-label classification with priors, " in Proc. 27th Int. Conf. Mach. Learn. (ICML), 2010, pp. 423-430.
13. M.-L. Zhang and K. Zhang, "Multi-label learning by exploiting label dependency, " in Proc. 16th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2010, pp. 999-1008.
14. Y. Guo and W. Xue, "Probabilistic multi-label classification with sparse feature learning, " in Proc. 23rd Int. Joint Conf. Artif. Intell., 2013, pp. 1373-1379.
15. S.-J. Huang, Z.-H. Zhou, and Z. Zhou, "Multi-label learning by exploiting label correlations locally, " in Proc. AAAI, 2012, pp. 1-7.
16. W. Bi and J. T. Kwok, "Multilabel classification with label correlations and missing labels, " in Proc. AAAI Conf. Artif. Intell. (AAAI), 2014, pp. 1680-1686.
17. Y.-N. Chen and H.-T. Lin, "Feature-aware label space dimension reduction for multi-label classification, " in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 1529-1537.
18. F. Tai and H.-T. Lin, "Multilabel classification with principal label space transformation, " Neural Comput., vol. 24, no. 9, pp. 2508-2542, 2012.
19. V. N. Vapnik, Statistical Learning Theory, vol. 2. New York, NY, USA: Wiley, 1998.
20. M. Xu, Y.-F. Li, and Z.-H. Zhou, "Multi-label learning with pro loss, " in Proc. AAAI Conf. Artif. Intell. (AAAI), 2013, pp. 1-7.
21. B. Zhang, Y. Wang, and F. Chen, "Multilabel image classification via high-order label correlation driven active learning, " IEEE Trans. Image Process., vol. 23, no. 3, pp. 1430-1441, Mar. 2014.
22. P. L. Bartlett and S. Mendelson, "Rademacher and Gaussian complexities: Risk bounds and structural results, " J. Mach. Learn. Res., vol. 3, pp. 463-482, Mar. 2003.
23. H.-F. Yu, P. Jain, and I. S. Dhillon, "Large-scale multi-label learning with missing labels, " in Proc. 21st Int. Conf. Mach. Learn., 2014, pp. 1-9.
24. C. Cortes, M. Kloft, and M. Mohri, "Learning kernels using local rademacher complexity, " in Proc. Adv. Neural Inf. Process. Syst., 2013, pp. 2760-2768.
25. P. L. Bartlett, O. Bousquet, and S. Mendelson, "Local rademacher complexities, " Ann. Statist., vol. 3, no. 4, pp. 1497-1537, Aug. 2005.
26. R. E. Schapire and Y. Singer, "BoosTexter: A boosting-based system for text categorization, " Mach. Learn., vol. 39, nos. 2-3, pp. 135-168, May 2000.
27. R. Yan, J. Tesic, and J. R. Smith, "Model-shared subspace boosting for multi-label classification, " in Proc. 13th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2007, pp. 834-843.
28. M.-L. Zhang and Z.-H. Zhou, "ML-KNN: A lazy learning approach to multi-label learning, " Pattern Recognit., vol. 40, no. 7, pp. 2038-2048, Jul. 2007.
29. E. Spyromitros, G. Tsoumakas, and I. Vlahavas, "An empirical study of lazy multilabel classification algorithms, " in Artificial Intelligence: Theories, Models and Applications. Berlin, Germany: Springer, 2008, pp. 401-406.
30. J. Tang, R. Hong, S. Yan, T.-S. Chua, G.-J. Qi, and R. Jain, "Image annotation by kNN-sparse graph-based label propagation over noisily tagged Web images, " ACM Trans. Intell. Syst. Technol., vol. 2, no. 2, p. 14, Feb. 2011.
31. A. Clare and R. D. King, "Knowledge discovery in multi-label phenotype data, " in Principles of Data Mining and Knowledge Discovery. Berlin, Germany: Springer, 2001, pp. 42-53.
32. C. Vens, J. Struyf, L. Schietgat, S. Džeroski, and H. Blockeel, "Decision trees for hierarchical multi-label classification, " Mach. Learn., vol. 73, no. 2, pp. 185-214, Nov. 2008.
33. W. Bi and J. T. Kwok, "Multi-label classification on tree-and DAGstructured hierarchies, " in Proc. 28th Int. Conf. Mach. Learn. (ICML), 2011, pp. 17-24.
34. K. Crammer and Y. Singer, "A family of additive online algorithms for category ranking, " J. Mach. Learn. Res., vol. 3, pp. 1025-1058, Mar. 2003.
35. M.-L. Zhang and Z.-H. Zhou, "Multilabel neural networks with applications to functional genomics and text categorization, " IEEE Trans. Knowl. Data Eng., vol. 18, no. 10, pp. 1338-1351, Oct. 2006.
36. A. Elisseeff and J. Weston, "A kernel method for multi-labelled classification, " in Proc. Adv. Neural Inf. Process. Syst., 2001, pp. 681-687.
37. R. Cabral, F. De la Torre, J. P. Costeira, and A. Bernardino, "Matrix completion for weakly-supervised multi-label image classification, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 1, pp. 121-135, Jan. 2015.
38. M. R. Boutell, J. Luo, X. Shen, and C. M. Brown, "Learning multi-label scene classification, " Pattern Recognit., vol. 37, no. 9, pp. 1757-1771, Sep. 2004.
39. G. Tsoumakas and I. Vlahavas, "Random k-labelsets: An ensemble method for multilabel classification, " in Machine Learning: ECML. Springer, 2007, pp. 406-417.
40. J. Read, B. Pfahringer, and G. Holmes, "Multi-label classification using ensembles of pruned sets, " in Proc. 8th IEEE Int. Conf. Data Mining (ICDM), Dec. 2008, pp. 995-1000.
41. J. Fürnkranz, "Round robin classification, " J. Mach. Learn. Res., vol. 2, pp. 721-747, Mar. 2002.
42. T.-F. Wu, C.-J. Lin, and R. C. Weng, "Probability estimates for multiclass classification by pairwise coupling, " J. Mach. Learn. Res., vol. 5, pp. 975-1005, Dec. 2004.
43. Y. Zhang and J. Schneider, "A composite likelihood view for multilabel classification, " in Proc. Int. Conf. Artif. Intell. Statist., 2012, pp. 1407-1415.
44. L. Jing, L. Yang, Y. Jian, and M. K. Ng, "Semi-supervised low-rank mapping learning for multi-label classification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2015, pp. 1483-1491.
45. D. Hsu, S. Kakade, J. Langford, and T. Zhang, "Multi-label prediction via compressed sensing, " in Proc. NIPS, vol. 22. 2009, pp. 772-780.
46. Y. Zhang and J. G. Schneider, "Multi-label output codes using canonical correlation analysis, " in Proc. Int. Conf. Artif. Intell. Statist., 2011, pp. 873-882.
47. Y. Zhang and J. Schneider, "Maximum margin output coding, " in Proc. Int. Conf. Mach. Learn., 2012, pp. 1575-1582.
48. W. Gao and Z.-H. Zhou, "On the consistency of multi-label learning, " Artif. Intell., vols. 199-200, pp. 22-44, Jun. /Jul. 2013.
49. K. Dembczýnski, W. Waegeman, W. Cheng, and E. Hüllermeier, "On label dependence and loss minimization in multi-label classification, " Mach. Learn., vol. 88, no. 1, pp. 5-45, Jul. 2012.
50. Y. Cong, J. Liu, J. Yuan, and J. Luo, "Self-supervised online metric learning with low rank constraint for scene categorization, " IEEE Trans. Image Process., vol. 22, no. 8, pp. 3179-3191, Aug. 2013.
51. L. Vandenberghe and S. Boyd, "Semidefinite programming, " SIAM Rev., vol. 38, no. 1, pp. 49-95, 1996.
52. Z. Harchaoui, M. Douze, M. Paulin, M. Dudik, and J. Malick, "Largescale image classification with trace-norm regularization, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 3386-3393.
53. G. Zhu, S. Yan, and Y. Ma, "Image tag refinement towards low-rank, content-tag prior and error sparsity, " in Proc. Int. Conf. Multimedia, 2010, pp. 461-470.
54. S. Ma, D. Goldfarb, and L. Chen, "Fixed point and Bregman iterative methods for matrix rank minimization, " Math. Program., vol. 128, no. 1, pp. 321-353, Jun. 2011.
55. J.-F. Cai, E. J. Candès, and Z. Shen, "A singular value thresholding algorithm for matrix completion, " SIAM J. Optim., vol. 20, no. 4, pp. 1956-1982, 2010.
56. K. C. Toh and S. Yun, "An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems, " Pacific J. Optim., vol. 6, nos. 615-640, p. 15, 2010.
57. A. Beck and M. Teboulle, "A fast iterative shrinkage-thresholding algorithm for linear inverse problems, " SIAM J. Imag. Sci., vol. 2, no. 1, pp. 183-202, 2009.
58. S. Ji and J. Ye, "An accelerated gradient method for trace norm minimization, " in Proc. 26th Annu. Int. Conf. Mach. Learn., 2009, pp. 457-464.
59. K. Chen, H. Dong, and K.-S. Chan, "Reduced rank regression via adaptive nuclear norm penalization, " Biometrika, vol. 100, no. 4, pp. 901-920, Sep. 2013.
60. L. Xiao and T. Zhang, "A proximal stochastic gradient method with progressive variance reduction, " SIAM J. Optim., vol. 24, no. 4, pp. 2057-2075, 2014.
61. L. Rosasco, S. Villa, and B. C. Vu. (2014). "Convergence of stochastic proximal gradient algorithm. " [Online]. Available: http: //arxiv. org/abs/1403. 5074
62. K. Simonyan and A. Zisserman. (2014). "Very deep convolutional networks for large-scale image recognition. " [Online]. Available: http: //arxiv. org/abs/1409. 1556
63. W. Cheng, E. Hüllermeier, and K. J. Dembczynski, "Bayes optimal multilabel classification via probabilistic classifier chains, " in Proc. 27th Int. Conf. Mach. Learn. (ICML), 2010, pp. 279-286.
64. K. J. Dembczynski, W. Waegeman, W. Cheng, and E. Hüllermeier, "An exact algorithm for f-measure maximization, " in Proc. Adv. Neural Inf. Process. Syst., 2011, pp. 1404-1412.
65. C.-L. Li and H.-T. Lin, "Condensed filter tree for cost-sensitive multilabel classification, " in Proc. 31st Int. Conf. Mach. Learn. (ICML), 2014, pp. 423-431.
66. J. Demšar, "Statistical comparisons of classifiers over multiple data sets, " J. Mach. Learn. Res., vol. 7, pp. 1-30, Jan. 2006.