ML-TREE: A tree-structure-based approach to multilabel learning

IEEE Transactions on Neural Networks and Learning Systems

Volumn 26, Issue 3, 2015, Pages 430-443

  Wu, Qingyao ^a   Ye, Yunming ^a   Zhang, Haijun ^a   Chow, Tommy W S ^b   Ho, Shen Shyang ^c  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b CITY UNIVERSITY OF HONG KONG   (Hong Kong)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Hierarchical tree model; multilabel classification; multilabel learning; tree based classification.

Indexed keywords

LEARNING ALGORITHMS;

AUTOMATIC DISCOVERY; DIFFERENT DOMAINS; HIERARCHICAL TREE; MULTI-LABEL CLASSIFICATIONS; MULTI-LABEL LEARNING; STATISTICAL SIGNIFICANCE; TREE ALGORITHMS; TREE-BASED;

TREES (MATHEMATICS);

EID: 85027921685     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2014.2315296     Document Type: Article

References (39)

1. R. Schapire and Y. Singer, "BoosTexter: A boosting-based system for text categorization," Mach. Learn., vol. 39, no. 2, pp. 135-168, 2000.
2. F. De Comité, R. Gilleron, and M. Tommasi, "Learning multi-label alternating decision trees from texts and data," in Proc. 3rd Int. Conf. MLDM Pattern Recognit., 2003, pp. 251-274.
3. H. Kazawa, T. Izumitani, H. Taira, and E. Maeda, "Maximal margin labeling for multi-topic text categorization," in Proc. Adv. NIPS, vol. 17. 2005, pp. 649-656.
4. N. Ueda and K. Saito, "Parametric mixture models for multi-labeled text," in Proc. Adv. NIPS, vol. 15. 2003, pp. 721-728.
5. A. Elisseeff and J. Weston, "A kernel method for multi-labelled classification," in Proc. Adv. NIPS, vol. 14. 2002, pp. 681-687.
6. M. Zhang and Z. Zhou, "Multilabel neural networks with applications to functional genomics and text categorization," IEEE Trans. Knowl. Data Eng., vol. 18, no. 10, pp. 1338-1351, Oct. 2006.
7. A. Clare and R. King, "Knowledge discovery in multi-label phenotype data," in Proc. Principles Data Mining Knowl. Discovery, 2001, pp. 42-53.
8. M. Boutell, J. Luo, X. Shen, and C. Brown, "Learning multi-label scene classification," Pattern Recognit., vol. 37, no. 9, pp. 1757-1771, 2004.
9. M. Zhang and Z. Zhou, "ML-KNN: A lazy learning approach to multi-label learning," Pattern Recognit., vol. 40, no. 7, pp. 2038-2048, 2007.
10. G. Qi, X. Hua, Y. Rui, J. Tang, T. Mei, and H. Zhang, "Correlative multi-label video annotation," in Proc. 15th Int. Conf. Multimedia, 2007, pp. 17-26.
11. K. Trohidis, G. Tsoumakas, G. Kalliris, and I. Vlahavas, "Multilabel classification of music into emotions," in Proc. 9th Int. Conf. Music Inf. Retrieval, 2008, pp. 325-330.
12. G. Tsoumakas and I. Katakis, "Multi-label classification: An overview," Int. J. Data Warehousing, Mining, vol. 3, no. 3, pp. 1-13, 2007.
13. G. Tsoumakas, I. Katakis, and I. Vlahavas, "Mining multi-label data," in Data Mining and Knowledge Discovery Handbook. New York, NY, USA: Springer-Verlag, 2010, pp. 667-685.
14. M.-L. Zhang and Z.-H. Zhou, "A review on multi-label learning algorithms," IEEE Trans. Knowl. Data Eng., May 2013, to be published.
15. S. Zhu, X. Ji, W. Xu, and Y. Gong, "Multi-labelled classification using maximum entropy method," in Proc. 28th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2005, pp. 274-281.
16. N. Ghamrawi and A. McCallum, "Collective multi-label classification," in Proc. 14th ACM Int. Conf. Inf. Knowl. Manag., 2005, pp. 195-200.
17. K. Gold and A. Petrosino, "Using information gain to build meaningful decision forests for multilabel classification," in Proc. IEEE 9th Int. Conf. Develop. Learn., Jan. 2010, pp. 58-63.
18. W. Cheng and E. Hüllermeier, "Combining instance-based learning and logistic regression for multilabel classification," Mach. Learn., vol. 76, no. 2, pp. 211-225, 2009.
19. H. Blockeel, L. D. Raedt, and J. Ramon, "Top-down induction of clustering trees," in Proc. 15th Int. Conf. Mach. Learn., 2000, pp. 55-63.
20. C. Vens, J. Struyf, L. Schietgat, S. Džeroski, and H. Blockeel, "Decision trees for hierarchical multi-label classification," Mach. Learn., vol. 73, no. 2, pp. 185-214, 2008.
21. D. Kocev, C. Vens, J. Struyf, and S. Džeroski, "Ensembles of multi-objective decision trees," in Proc. ECML, 2007, pp. 624-631.
22. I. W. Tsang, J. T. Kwok, and P. M. Cheung, "Core vector machines: Fast SVM training on very large datasets," J. Mach. Learn. Res., vol. 6, no. 1, pp. 363-392, 2006.
23. G. Tsoumakas, I. Katakis, and I. Vlahavas, "Effective and efficient multilabel classification in domains with large number of labels," in Proc. ECML/PKDD Workshop Mining Multidimensional Data, 2008, pp. 30-44.
24. S. Bengio, J. Weston, and D. Grangier, "Label embedding trees for large multi-class tasks," Adv. Neural Inf. Process. Syst., vol. 23, no. 1, pp. 163-171, 2010.
25. K. Punera, S. Rajan, and J. Ghosh, "Automatically learning document taxonomies for hierarchical classification," in Proc. Special Interest Tracks Posters 14th Int. Conf. World Wide Web, 2005, pp. 1010-1011.
26. J. Deng, S. Satheesh, A. Berg, and L. Fei-Fei, "Fast and balanced: Efficient label tree learning for large scale object recognition," Adv. Neural Inf. Process. Syst., vol. 2, pp. 567-575, Dec. 2011.
27. G. Madjarov and D. Gjorgjevikj, "Hybrid decision tree architecture utilizing local SVMs for multi-label classification," in Proc. 7th Int. Conf. Hybrid Artif. Intell. Syst., 2012, pp. 1-12.
28. B. Fu, Z. Wang, R. Pan, G. Xu, and P. Dolog, "Learning tree structure of label dependency for multi-label learning," in Proc. Adv. Knowl. Discovery Data Mining, 2012, pp. 159-170.
29. N. Cesa-Bianchi, C. Gentile, and L. Zaniboni, "Hierarchical classification: Combining Bayes with SVM," in Proc. 23rd Int. Conf. Mach. Learn., 2006, pp. 177-184.
30. N. Cesa-Bianchi, C. Gentile, A. Tironi, and L. Zaniboni, "Incremental algorithms for hierarchical classification," Adv. Neural Inf. Process. Syst., vol. 7, no. 1, pp. 233-240, 2005.
31. W. Bi and J. T. Kwok, "Multi-label classification on tree- and DAG-structured hierarchies," in Proc. 28th ICML, 2011, pp. 17-24.
32. M. Zhang and K. Zhang, "Multi-label learning by exploiting label dependency," in Proc. 16th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2010, pp. 999-1007.
33. G. Madjarov, D. Kocev, D. Gjorgjevikj, and S. Džeroski, "An extensive experimental comparison of methods for multi-label learning," Pattern Recognit., vol. 45, no. 9, pp. 3084-3104, 2012.
34. J. Read, B. Pfahringer, G. Holmes, and E. Frank, "Classifier chains for multi-label classification," Mach. Learn., vol. 85, no. 3, pp. 333-359, 2011.
35. G. Tsoumakas, J. Vilcek, L. Spyromitros, and I. Vlahavas, "Mulan: A Java library for multi-label learning," J. Mach. Learn. Res., vol. 1, pp. 1-48, Jan. 2010.
36. C. Chang and C. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, p. 27, 2011.
37. J. Demšar, "Statistical comparisons of classifiers over multiple data sets," J. Mach. Learn. Res., vol. 7, pp. 1-30, Jan. 2006.
38. K. Dembczyński, W. Waegeman, W. Cheng, and E. Hüllermeier, "Regret analysis for performance metrics in multi-label classification: The case of Hamming and subset zero-one loss," in Proc. Mach. Learn. Knowl. Discovery Databases, 2010, pp. 280-295.
39. S. Huang, Y. Yu, and Z. Zhou, "Multi-label hypothesis reuse," in Proc. 18th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2012, pp. 525-533.