Multi-label ensemble based on variable pairwise constraint projection

Information Sciences

Volumn 222, Issue , 2013, Pages 269-281

  Li, Ping ^a   Li, Hong ^b   Wu, Min ^b  

^a ZHEJIANG UNIVERSITY   (China)

^b CENTRAL SOUTH UNIVERSITY   (China)

Author keywords

Boosting; Constraint projection; Ensemble learning; Multi label classification; Variable pairwise constraints

Indexed keywords

BOOSTING; CONSTRAINT PROJECTION; ENSEMBLE LEARNING; MULTI-LABEL; PAIRWISE CONSTRAINTS;

ARTIFICIAL INTELLIGENCE;

SOFTWARE ENGINEERING;

EID: 84870054699     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2012.07.066     Document Type: Article

References (53)

1. J. Abellán, and A.R. Masegosa An ensemble method using credal decision trees European Journal of Operational Research 205 2010 218 226
2. E. Bauer, and R. Kohavi An empirical comparison of voting classification algorithms: bagging, boosting, and variants Machine Learning 36 1-2 1999 105 139
3. B. Biggio, G. Fumera, and F. Roli Multiple classifier systems for robust classifier design in adversarial environments International Journal of Machine Learning and Cybernetics 1 1-4 2010 27 41
4. M.R. Boutell, J. Luo, X. Shen, and C.M. Brown Learning multi-label scene classification Pattern Recognition 37 9 2004 1757 1771
5. L. Breiman Bagging predictors Machine Learning 24 2 1996 123 140
6. L. Breiman Random forests Machine Learning 45 1 2001 5 32
7. H. Cevikalp, J. Verbeek, F. Jurie, A. Klaser, Semi-supervised dimensionality reduction using pairwise equivalence constraints, in: Proceedings of the International Conference on Computer Vision Theory and Applications, Grenoble, France, 2008, pp. 489-496.
8. Y.-L. Chen, S.-Y. Wu, and Y.-C. Wang Discovering multi-label temporal patterns in sequence databases Information Sciences 181 3 2011 398 418
9. W. Cheng, and E. Hüllermeier Combining instance-based learning and logistic regression for multilabel classification Machine Learning 76 2-3 2009 211 225
10. A. Elisseeff, and J. Weston A kernel method for multi-labelled classification T.G. Dietterich, S. Becker, Z. Ghahramani, Advances in Neural Information Processing Systems (NIPS) vol. 14 2002 MIT Press Cambridge, MA 681 687
11. J. Fürnkranz, E. Hüllermeier, E.-L. Mencía, and K. Brinker Multilabel classification via calibrated label ranking Machine Learning 73 2 2008 133 153
12. S. Godbole, and S. Sarawagi Discriminative methods for multi-labeled classification H. Dai, R. Srikant, C. Zhang, Lecture Notes in Artificial Intelligence vol. 3056 2004 Springer Berlin 22 30
13. Y. Han, F. Wu, Y. Zhuang, and X. He Multi-label transfer learning with sparse representation IEEE Transactions on Circuits and Systems for Video Technology 20 8 2010 1110 1121
14. T.K. Ho The random subspace method for constructing decision forest IEEE Transactions on Pattern Analysis and Machine Intelligence 20 8 1998 832 844
15. S. Ji, J. Ye, Linear dimensionality reduction for multi-label classification, in: Proceedings of the 21st International Joint Conference on Artificial Intelligence (IJCAI), Pasadena, California, USA, 2009, pp. 1077-1082.
16. H. Kazawa, T. Izumitani, H. Taira, and E. Maeda Maximal margin labeling for multi-topic text categorization L.K. Saul, Y. Weiss, L. Bottou, Advances in Neural Information Processing Systems vol. 17 2005 MIT Press Cambridge, MA 649 656
17. A. Krogh, and J. Vedelsby Neural network ensembles, cross validation and active learning G. Tesauro, D.S. Touretzky, T.K. Leen, Advances in Neural Information Processing Systems 1995 MIT Press Cambridge, MA 231 238
18. L.I. Kuncheva Full-class set classification using the Hungarian algorithm International Journal of Machine Learning and Cybernetics 1 1-4 2010 53 61
19. H.-Yi Lo, J.-C. Wang, H.-M. Wang, and S.-D. Lin Cost-sensitive multi-label learning for audio tag annotation and retrieval IEEE Transactions on Multimedia 13 3 2011 518 529
20. N. Loris, and L. Alessandra An experimental comparison of ensemble of classifiers for bankruptcy prediction and credit scoring Experts Systems with Applications 36 2009 3028 3033
21. A. McCallum, Multi-label text classification with a mixture model trained by EM, in: Working Notes of the AAAI'99 Workshop on Text Learning, Orlando, FL, 1999.
22. S. Oh, M. Lee, and B. Zhang Ensemble learning with active example selection for imbalanced biomedical data classification IEEE/ACM Transactions on Computational Biology and Bioinformatics 8 2 2011 316 325
23. D. Opitz, and R. Maclin Popular ensemble methods: an empirical study Journal of Artificial Intelligence Research 11 1999 169 198
24. N.C. Oza, and K. Tumer Classifier ensembles: select real-world applications Information Fusion 9 2008 4 20
25. G.-J. Qi, X.-S. Hua, Y. Rui, J.-H. Tang, T. Mei, H.-J. Zhang, Correlative multi-label video annotation, in: Proceedings of the 15th ACM International Conference on Multimedia, Augsburg, Germany, 2007, pp.17-26.
26. P. Rai, H. Daumé III, Multi-label prediction via sparse infinite CCA, in: Proceedings of the Conference on Neural Information Processing Systems (NIPS), Vancouver, Canada, 2009.
27. J. Read, B. Pfahringer, G. Holmes, Multi-label classification using ensembles of pruned sets, in: Proceedings of the 8th IEEE International Conference on Data Mining, Pisa, Italy, 2008, pp. 995-1000.
28. J. Read, B. Pfahringer, G. Holmes., E. Frank, Classifier Chains for Multi-label Classification, in: Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases: Part II (ECML/PKDD), Bled, Slovenia, 2009, pp. 254-269.
29. J.J. Rodriguez, L.I. Kuncheva, and C.J. Alonso Rotation forest: a new classifier ensemble method IEEE Transactions on Pattern Analysis and Machine Intelligence 28 10 2006 1619 1630
30. R.E. Schapire, and Y. Singer Boostexter: a boosting-based system for text categorization Machine Learning 39 2000 135 168
31. R.E. Schapire The Boosting Approach to Machine Learning: An Overview Nonlinear Estimation and Classification 2003 Springer Berlin
32. S.-L. Sun, and C.-S. Zhang Subspace ensembles for classification Physica A 385 2007 199 207
33. G.D. Thomas Ensemble Learning, The Handbook of Brain Theory and Neural Networks second ed. 2002 MIT Press Cambridge, MA
34. G. Tsoumakas, and I. Katakis Multi-label classification: an overview International Journal of Data Warehousing and Mining 3 3 2007 1 13
35. G. Tsoumakas, I. Katakis, and I. Vlahavas Mining multi-label data O. Maimon, L. Rokach, Data Mining and Knowledge Discovery Handbook second ed. 2010 Springer
36. G. Tsoumakas, I. Vlahavas, Random k-Labelsets: an ensemble method for multilabel classification, in: Proceedings of the 18th European Conference on Machine Learning, Warsaw, Poland, 2007, pp. 406-417.
37. G.V. Vanessa, A.G. Jeronimo, and F.V. Aniibal Committees of Adaboost ensembles with modified emphasis functions Neurocomputing 73 2010 1289 1292
38. H. Wang, C. Ding, H. Huang, Multi-label linear discriminant analysis, in: Proceedings of the 11th European conference on Computer vision: Part VI (ECCV), LNCS 6316, Crete, Greece, 2010, pp. 126-139.
39. L.-J. Wang An improved multiple fuzzy NNC system based on mutual information and fuzzy integral International Journal of Machine Learning and Cybernetics 1 2 2011 25 36
40. X.-Z. Wang, and C.-R. Dong Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy IEEE Transactions on Fuzzy Systems 17 3 2009 556 567
41. X.-Z. Wang, J.-H. Zhai, and S.-X. Lu Induction of multiple fuzzy decision trees based on rough set technique Information Sciences 178 16 2008 3188 3202
42. I.H. Witten, and E. Frank Data Mining: Practical Machine Learning Tools and Techniques second ed. 2005 Morgan Kaufman San Francisco
43. R. Xia, C. Zong, and S. Li Ensemble of feature sets and classification algorithms for sentiment classification Information Sciences 181 6 2011 1138 1152
44. J. Xiao, C. He, X. Jiang, and D. Liu A dynamic classifier ensemble selection approach for noise data Information Sciences 180 18 2010 3402 3421
45. Wei-Guo Yi, Ming-Yu Lu, and Zhi Liu Multi-valued attribute and multi-labeled data decision tree algorithm International Journal of Machine Learning and Cybernetics 2 2 2011 67 74
46. M.-L. Zhang, and Z.-H. Zhou Multi-label neural networks with applications to functional genomics and text categorization IEEE Transactions on Knowledge and Data Engineering 18 10 2006 1338 1351
47. M.-L. Zhang, and Z.-H. Zhou ML-knn: a lazy learning approach to multi-label learning Pattern Recognition 40 7 2007 2038 2048
48. M.-L. Zhang, J.M. Pena, and V. Robles Feature selection for multi-label naive Bayes classification Information Sciences 179 19 2009 3218 3229
49. Z.-H. Zhou, Y. Jiang, and S.-F. Chen Extracting symbolic rules from trained neural network ensembles Artificial Intelligence Communications 16 1 2003 3 15
50. B.-F. Zhang, X. Xu, J.-S. Su, An ensemble method for multi-class and multi-label text categorization, in: Proceedings of the International Conference on Intelligent System and Knowledge Engineering (ISKE), Chengdu, China, 2007, pp. 1345-1350.
51. D.-Q. Zhang, S.-C. Chen, Z.-H Zhou, Q. Yang, Constraint projections for ensemble learning, in: Proceedings of the 23rd AAAI Conference on Artificial Intelligence, Chicago, 2008, pp. 758-763.
52. D.-Q. Zhang, Z.-H. Zhou, S.-C. Chen, Semi-supervised dimensionality reduction, in: Proceedings of the 2007 SIAM International Conference on Data Mining, Minneapolis, USA, 2007, pp. 629-634.
53. Y. Zhang, Z.-H. Zhou, Multi-label dimensionality reduction via dependency maximization, in: Proceedings of the 23rd AAAI Conference on Artificial Intelligence, Chicago, 2008, pp. 1503-1505.