Learning Instance Correlation Functions for Multilabel Classification

IEEE Transactions on Cybernetics

Volumn 47, Issue 2, 2017, Pages 499-510

  Liu, Huawen ^a   Li, Xuelong ^b   Zhang, Shichao ^c  

^a ZHEJIANG NORMAL UNIVERSITY   (China)

^b XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

^c ZHEJIANG GONGSHANG UNIVERSITY   (China)

Author keywords

instance based learning; k nearest neighbors (kNNs); multilabel classification; partial least square (PLS) regression; 1 norm

Indexed keywords

MAPPING; TEXT PROCESSING;

CORRELATION FUNCTION; EFFECTIVE ALGORITHMS; EMPIRICAL STUDIES; HIGH-DIMENSIONAL PROBLEMS; MAPPING RELATIONSHIPS; MULTI-LABEL CLASSIFICATIONS; MULTI-LABEL LEARNING; TEXT CATEGORIZATION;

CLASSIFICATION (OF INFORMATION);

EID: 84958593324     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2016.2519683     Document Type: Article

References (52)

1. M.-L. Zhang and Z.-H. Zhou, "A review on multi-label learning algorithms," IEEE Trans. Knowl. Data Eng., vol. 26, no. 8, pp. 1819-1837, Aug. 2014.
2. E. Gibaja and S. Ventura, "Multi-label learning: A review of the state of the art and ongoing research," Wiley Interdiscipl. Rev. Data Min. Knowl. Disc., vol. 6, no. 4, pp. 411-444, 2014.
3. G. Tsoumakas et al., "Correlation-based pruning of stacked binary relevance models for multi-label learning," in Proc. MLD, Bled, Slovenia, 2009, pp. 101-116.
4. D. Benbouzid, R. Busa-Fekete, N. Casagrande, F.-D. Collin, and B. Kégl, "MULTIBOOST: A multi-purpose boosting package," J. Mach. Learn. Res., vol. 13, pp. 549-553, Mar. 2012.
5. M.-L. Zhang and Z.-H. Zhou, "ML-KNN: A lazy learning approach to multi-label learning," Pattern Recognit., vol. 40, no. 7, pp. 2038-2048, 2007.
6. G. Tsoumakas, I. Katakis, and I. Vlahavas, "Random k-labelsets for multi-label classification," IEEE Trans. Knowl. Data Eng., vol. 23, no. 7, pp. 1079-1089, Jul. 2011.
7. H. Liu, S. Zhang, and X. Wu, "MLSLR: Multilabel learning via sparse logistic regression," Inf. Sci., vol. 281, pp. 310-320, Oct. 2014.
8. W. Cheng and E. Hullermeier, "Combining instance-based learning and logistic regression for multilabel classification," Mach. Learn., vol. 76, nos. 2-3, pp. 211-225, 2009.
9. S. Ji, L. Tang, S. Yu, and J. Ye, "A shared-subspace learning framework for multi-label classification," ACM Trans. Knowl. Disc. Data, vol. 4, no. 2, 2010, Art. ID 8.
10. H. Liu, Z. Ma, S. Zhang, and X. Wu, "Penalized partial least square discriminant analysis with-1-norm for multi-label data," Pattern Recognit., vol. 48, no. 5, pp. 1724-1733, 2015.
11. Q. Gu, Z. Li, and J. Han, "Correlated multi-label feature selection," in Proc. 20th ACM Int. Conf. Inf. Knowl. Manag., Glasgow, U.K., 2011, pp. 1087-1096.
12. J. Lee and D.-W. Kim, "Feature selection for multi-label classification using multivariate mutual information," Pattern Recognit. Lett., vol. 34, no. 3, pp. 349-357, 2013.
13. L. Shao, R. Yan, X. Li, and Y. Liu, "From heuristic optimization to dictionary learning: A review and comprehensive comparison of image denoising algorithms," IEEE Trans. Cybern., vol. 44, no. 7, pp. 1001-1013, Jul. 2014.
14. Y. Su, X. Gao, X. Li, and D. Tao, "Multivariate multilinear regression," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 6, pp. 1560-1573, Dec. 2012.
15. D. Chu, L.-Z. Liao, M. K. Ng, and X. Zhang, "Sparse canonical correlation analysis: New formulation and algorithm," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 12, pp. 3050-3065, Dec. 2013.
16. D. Lee, W. Lee, Y. Lee, and Y. Pawitan, "Sparse partial leastsquares regression and its applications to high-throughput data analysis," Chemometr. Intell. Lab. Syst., vol. 109, no. 1, pp. 1-8, 2011.
17. G. Tsoumakas, I. Katakis, and I. Vlahavas, "Mining multi-label data," in Data Mining and Knowledge Discovery Handbook, 1st ed. New York, NY, USA: Springer, 2010, pp. 667-685.
18. M.-L. Zhang and Z.-H. Zhou, "Multilabel neural networks with applications to functional genomics and text categorization," IEEE Trans. Knowl. Data Eng., vol. 18, no. 10, pp. 1338-1351, Oct. 2006.
19. J. Shen, Y. Zhao, S. Yan, and X. Li, "Exposure fusion using boosting Laplacian pyramid," IEEE Trans. Cybern., vol. 44, no. 9, pp. 1579-1590, Sep. 2014.
20. J. Zhang, X. Wu, and V. S. Sheng, "Active learning with imbalanced multiple noisy labeling," IEEE Trans. Cybern., vol. 45, no. 5, pp. 1095-1107, May 2015.
21. J. Furnkranz, E. Hullermeier, E. L. Mencía, and K. Brinker, "Multilabel classification via calibrated label ranking," Mach. Learn., vol. 73, no. 2, pp. 133-153, 2008.
22. E. L. Mencía, S.-H. Park, and J. Fürnkranz, "Efficient voting prediction for pairwise multilabel classification," Neurocomputing, vol. 73, nos. 7-9, pp. 1164-1176, 2010.
23. Y. Guo and W. Xue, "Probabilistic multi-label classification with sparse feature learning," in Proc. 23rd Int. Joint Conf. Artif. Intell., Beijing, China, 2013, pp. 1373-1379.
24. W. Bi and J. T. Kwok, "Multi-label classification on tree-and DAG-structured hierarchies," in Proc. ICML, Bellevue, WA, USA, 2011, pp. 17-24.
25. H. Su and J. Rousu, "Multilabel classification through random graph ensembles," Mach. Learn., vol. 99, no. 2, pp. 231-256, 2015.
26. F. Tai and H.-T. Lin, "Multilabel classification with principal label space transformation," Neural Comput., vol. 24, no. 9, pp. 2508-2542, 2012.
27. D. J. Hsu, S. M. Kakade, J. Langford, and T. Zhang, "Multi-label prediction via compressed sensing," in Proc. NIPS, Vancouver, BC, Canada, 2009, pp. 772-780.
28. L. E. Sucar et al., "Multi-label classification with Bayesian networkbased chain classifiers," Pattern Recognit. Lett., vol. 41, pp. 14-22, May 2014.
29. S. Zhu, X. Ji, W. Xu, and Y. Gong, "Multi-labelled classification using maximum entropy method," in Proc. ACM SIGIR, Salvador, Brazil, 2005, pp. 274-281.
30. Q. Wu, Y. Ye, H. Zhang, T. W. S. Chow, and S.-S. Ho, "ML-TREE: A tree-structure-based approach to multilabel learning," IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 3, pp. 430-443, Mar. 2015.
31. L. Sun, S. Ji, and J. Ye, "Canonical correlation analysis for multilabel classification: A least-squares formulation, extensions, and analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 194-200, Jan. 2011.
32. H. Liu, X. Wu, and S. Zhang, "A new supervised feature selection method for pattern classification," Comput. Intell., vol. 30, no. 2, pp. 342-361, 2014.
33. R. Hong et al., "Image annotation by multiple-instance learning with discriminative feature mapping and selection," IEEE Trans. Cybern., vol. 44, no. 5, pp. 669-680, May 2014.
34. H. Huang, C. Ding, D. Kong, and H. Zhao, "Multi-label ReliefF and F-statistic feature selections for image annotation," in Proc. CVPR, Providence, RI, USA, 2012, pp. 2352-2359.
35. S. Jungjit, A. A. Freitas, M. Michaelis, and J. Cinatl, "Two extensions to multi-label correlation-based feature selection: A case study in bioinformatics," in Proc. IEEE SMC, Manchester, U.K., 2013, pp. 1519-1524.
36. G. Madjarov, D. Kocev, D. Gjorgjevikj, and S. Džeroski, "An extensive experimental comparison of methods for multi-label learning," Pattern Recognit., vol. 45, no. 9, pp. 3084-3104, 2012.
37. Y. Liu, F. Tang, and Z. Zeng, "Feature selection based on dependency margin," IEEE Trans. Cybern., vol. 45, no. 6, pp. 1209-1221, Jun. 2015.
38. Y. Fu, X. Zhu, and A. K. Elmagarmid, "Active learning with optimal instance subset selection," IEEE Trans. Cybern., vol. 43, no. 2, pp. 464-475, Apr. 2013.
39. H. Liu and S. Zhang, "Noisy data elimination using mutual k-nearest neighbor for classification mining," J. Syst. Softw., vol. 85, no. 5, pp. 1067-1074, 2012.
40. Q. Wang, Y. Yuan, P. Yan, and X. Li, "Saliency detection by multipleinstance learning," IEEE Trans. Cybern., vol. 43, no. 2, pp. 660-672, Apr. 2013.
41. Y. Xiao, B. Liu, Z. Hao, and L. Cao, "A similarity-based classification framework for multiple-instance learning," IEEE Trans. Cybern., vol. 44, no. 4, pp. 500-515, Apr. 2014.
42. Y. Xu et al., "Data uncertainty in face recognition," IEEE Trans. Cybern., vol. 44, no. 10, pp. 1950-1961, Oct. 2014.
43. Y. Dong, D. Tao, X. Li, J. Ma, and J. Pu, "Texture classification and retrieval using shearlets and linear regression," IEEE Trans. Cybern, vol. 45, no. 3, pp. 358-369, Mar. 2015.
44. A.-L. Boulesteix and K. Strimmer, "Partial least squares: A versatile tool for the analysis of high-dimensional genomic data," Briefings Bioinformat., vol. 8, no. 1, pp. 32-44, 2007.
45. F. Bach, R. Jenatton, J. Mairal, and G. Obozinski, "Optimization with sparsity-inducing penalties," Found. Trends Mach. Learn., vol. 4, no. 1, pp. 1-106, Jan. 2012.
46. C. Hou, F. Nie, X. Li, D. Yi, and Y. Wu, "Joint embedding learning and sparse regression: A framework for unsupervised feature selection," IEEE Trans. Cybern, vol. 44, no. 6, pp. 793-804, Jun. 2014.
47. J. Friedman, T. Hastie, and R. Tibshirani, "Regularization paths for generalized linear models via coordinate descent," J. Stat. Softw., vol. 33, no. 1, pp. 1-22, 2010.
48. E. Süli and D. F. Mayers, An Introduction to Numerical Analysis. Cambridge, U.K.: Cambridge Univ., 2003.
49. G. Tsoumakas, I. Katakis, and I. Vlahavas, "Effective and efficient multilabel classification in domains with large number of labels," in Proc. MMD, Antwerp, Belgium, 2008, pp. 1-15.
50. J. Read, "A pruned problem transformation method for multi-label classification," in Proc. New Zealand Comput. Sci. Res. Student Conf., Christchurch, New Zealand, 2008, pp. 143-150.
51. J. Read, B. Pfahringer, G. Holmes, and E. Frank, "Classifier chains for multi-label classification," Mach. Learn., vol. 85, no. 3, pp. 335-359, 2011.
52. G. Tsoumakas, E. Spyromitros-Xioufis, J. Vilcek, and I. Vlahavas, "Mulan: A Java library for multi-label learning," J. Mach. Learn. Res., vol. 12, pp. 2411-2414, Jul. 2011.