LI-MLC: A label inference methodology for addressing high dimensionality in the label space for multilabel classification

IEEE Transactions on Neural Networks and Learning Systems

Volumn 25, Issue 10, 2014, Pages 1842-1854

  Charte, Francisco ^a   Rivera, Antonio J ^b   Del Jesus, María J ^b   Herrera, Francisco ^a,c  

^a UNIVERSITY OF GRANADA   (Spain)

^b UNIVERSITY OF JAÉN   (Spain)

^c KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

Author keywords

Association rules (ARs); data transformation; dimensionality reduction; multilabel classification (MLC).

Indexed keywords

DATA TRANSFORMATION; DIMENSIONALITY REDUCTION; HIGH DIMENSIONALITY; LABEL SPACE; MULTI-LABEL CLASSIFICATIONS;

EID: 84907817318     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2296501     Document Type: Article

References (57)

1. G. Tsoumakas, E. S. Xioufis, J. Vilcek, and I. Vlahavas. (2014, Jan. 1). MULAN Multi-Label Dataset Repository [Online]. Available: http://mulan.sourceforge.net/datasets.html
2. Y. H. Li and A. K. Jain, "Classification of text documents," Comput. J., vol. 41, no. 8, pp. 537-546, 1998.
3. J. R. Bellegarda, "Large vocabulary speech recognition with multispan statistical language models," IEEE Trans. Speech Audio Process., vol. 8, no. 1, pp. 76-84, Jan. 2000.
4. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection," J. Mach. Learn. Res., vol. 3, pp. 1157-1182, Mar. 2003.
5. P. Mitra, C. A. Murthy, and S. K. Pal, "Unsupervised feature selection using feature similarity," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 3, pp. 301-312, Mar. 2002.
6. N. Spolaôr, E. A. Cherman, M. C. Monard, and H. D. Lee, "A comparison of multi-label feature selection methods using the problem transformation approach," Electron. Notes Theoretical Comput. Sci., vol. 292, pp. 135-151, Mar. 2013.
7. M.-L. Zhang and Z.-H. Zhou, "A review on multi-label learning algorithms," IEEE Trans. Knowl. Data Eng. [Online]. Available: http://dx.doi.org/10.1109/TKDE.2013.39
8. G. Tsoumakas, I. Katakis, and I. Vlahavas, "Mining multi-label data," in Data Mining and Knowledge Discovery Handbook, O. Maimon and L. Rokach, Eds. Boston, MA, USA: Springer-Verlag, 2010, ch. 34, pp. 667-685.
9. A. de Carvalho and A. Freitas, "A tutorial on multi-label classification techniques," in Foundations of Computational Intelligence, vol. 5, A. Abraham, A.-E. Hassanien, and V. Snášel, Eds. Berlin Heidelberg, Germany: Springer-Verlag, 2009, ch. 8, pp. 177-195.
10. S. Godbole and S. Sarawagi, "Discriminative methods for multi-labeled classification," in Proc. 8th Pacific-Asia Conf. Knowl. Discovery Data Mining, LNCS 3056. 2004, pp. 22-30.
11. J. Fürnkranz, E. Hüllermeier, E. Loza Mencía, and K. Brinker, "Multilabel classification via calibrated label ranking," Mach. Learn., vol. 73, no. 2, pp. 133-153, 2008.
12. M. Boutell, J. Luo, X. Shen, and C. Brown, "Learning multi-label scene classification," Pattern Recognit., vol. 37, no. 9, pp. 1757-1771, 2004.
13. G. Madjarov, D. Kocev, D. Gjorgjevikj, and S. Džeroski, "An extensive experimental comparison of methods for multi-label learning," Pattern Recognit., vol. 45, no. 9, pp. 3084-3104, 2012.
14. A. Clare and R. D. King, "Knowledge discovery in multi-label phenotype data," in Proc. 5th Eur. Conf. Principles Data Mining Knowl. Discovery, LNCS 2168. Freiburg, Germany, 2001, pp. 42-53.
15. F. De Comité, R. Gilleron, and M. Tommasi, "Learning multi-label alternating decision trees from texts and data," in Proc. 3rd Int. Conf. Mach. Learn. Data Mining Pattern Recognit., LNCS 2734. Leipzig, Germany, 2003, pp. 35-49.
16. M. Zhang and Z. Zhou, "ML-KNN: A lazy learning approach to multilabel learning," Pattern Recognit., vol. 40, no. 7, pp. 2038-2048, 2007.
17. W. Cheng and E. Hüllermeier, "Combining instance-based learning and logistic regression for multilabel classification," Mach. Learn., vol. 76, nos. 2-3, pp. 211-225, 2009.
18. M.-L. Zhang, "Multilabel neural networks with applications to functional genomics and text categorization," IEEE Trans. Knowl. Data Eng., vol. 18, no. 10, pp. 1338-1351, Oct. 2006.
19. M.-L. Zhang, "ML-RBF: RBF neural networks for multi-label learning," Neural Process. Lett., vol. 29, no. 2, pp. 61-74, 2009.
20. A. Elisseeff and J. Weston, "A kernel method for multi-labelled classification," in Advances in Neural Information Processing Systems, vol. 14. Cambridge, MA, USA: MIT Press, 2001, pp. 681-687.
21. J. Read, B. Pfahringer, G. Holmes, and E. Frank, "Classifier chains for multi-label classification," Mach. Learn., vol. 85, no. 3, pp. 333-359, 2011.
22. G. Tsoumakas and I. Vlahavas, "Random k-labelsets: An ensemble method for multilabel classification," in Proc. 18th ECML, LNCS 4701. Warsaw, Poland, 2007, pp. 406-417.
23. G. Tsoumakas, I. Katakis, and I. Vlahavas, "Effective and efficient multilabel classification in domains with large number of labels," in Proc. ECML/PKDD Workshop MMD, Antwerp, Belgium, 2008, pp. 30-44.
24. A. Chan and A. A. Freitas, "A new ant colony algorithm for multi-label classification with applications in bioinfomatics," in Proc. 8th Annu. Conf. Genetic Evol. Comput., 2006, pp. 27-34.
25. J. Weston, O. Chapelle, A. Elisseeff, B. Schölkopf, and V. Vapnik, "Kernel dependency estimation," in Advances in Neural Information Processing Systems, vol. 15. New York, NY, USA: Springer-Verlag, 2002, pp. 873-880.
26. D. Hsu, S. Kakade, J. Langford, and T. Zhang, "Multi-label prediction via compressed sensing," in Advances in Neural Information Processing Systems, vol. 22. New York, NY, USA: Springer-Verlag, 2009, pp. 772-780.
27. T. Zhou, D. Tao, and X. Wu, "Compressed labeling on distilled labelsets for multi-label learning," Mach. Learn., vol. 88, nos. 1-2, pp. 69-126, 2012.
28. G. Tsoumakas, A. Dimou, E. Spyromitros, V. Mezaris, I. Kompatsiaris, and I. Vlahavas, "Correlation based pruning of stacked binary relevance models for multi-label learning," in Proc. 1st Int. Workshop Learn. Multi- Label Data, Bled, Slovenia, 2009, pp. 101-116.
29. E. A. Cherman, J. Metz, and M. Monard, "A simple approach to incorporate label dependency in multi-label classification," in Proc. 9th MICAI, LNCS 6438. Pachuca, Mexico, 2010, pp. 33-43.
30. M.-L. Zhang and K. Zhang, "Multi-label learning by exploiting label dependency," in Proc. 16th Int. Conf. Knowl. Discovery Data Mining, Washington, DC, USA, 2010, pp. 999-1008.
31. Y. Guo and S. Gu, "Multi-label classification using conditional dependency networks," in Proc. 22th Int. Joint Conf. Artif. Intell., vol. 2. 2011, pp. 1300-1305.
32. L. Tenenboim-Chekina, L. Rokach, and B. Shapira, "Identification of label dependences for multi-label classification," in Proc. 2nd Int. Workshop Learn. Multi-Label Data, Haifa, Israel, 2010, pp. 53-60.
33. F. Tai and H. Lin, "Multi-label classification with principle label space transformation," in Proc. 2nd Int. Workshop Learn. Multi-Label Data, Haifa, Israel, 2010, pp. 45-52.
34. S.-H. Park and J. Fürnkranz, "Multi-label classification with label constraints," in Proc. ECML PKDD Workshop Preference Learn., Antwerp, Belgium, 2008, pp. 157-171.
35. J. Hipp, U. Güntzer, and G. Nakhaeizadeh, "Algorithms for association rule mining-A general survey and comparison," ACM SIGKDD Explorat. Newslett., vol. 2, no. 1, pp. 58-64, 2000.
36. C. Silverstein, S. Brin, and R. Motwani, "Beyond market baskets: Generalizing association rules to dependence rules," Data Mining Knowl. Discovery, vol. 2, no. 1, pp. 39-68, 1998.
37. S. Brin, R. Motwani, J. D. Ullman, and S. Tsur, "Dynamic itemset counting and implication rules for market basket data," in Proc. Int. Conf. Manag. Data, Tucson, AZ, USA, 1997, pp. 255-264.
38. J. Han, J. Pei, Y. Yin, and R. Mao, "Mining frequent patterns without candidate generation: A frequent-pattern tree approach," Data Mining Knowl. Discovery, vol. 8, no. 1, pp. 53-87, 2004.
39. J. Read, B. Pfahringer, and G. Holmes, "Multi-label classification using ensembles of pruned sets," in Proc. 8th IEEE ICDM, Pisa, Italy, Dec. 2008, pp. 995-1000.
40. D. A. Cieslak and N. V. Chawla, "Start globally, optimize locally, predict globally: Improving performance on imbalanced data," in Proc. 8th IEEE ICDM, Pisa, Italy, Dec. 2008, pp. 143-152.
41. R. A. Groeneveld and G. Meeden, "Measuring skewness and kurtosis," Statistician, vol. 33, no. 4, pp. 391-399, 1984.
42. E. Cohen, M. Datar, S. Fujiwara, A. Gionis, P. Indyk, R. Motwani, et al., "Finding interesting associations without support pruning," IEEE Trans. Knowl. Data Eng., vol. 13, no. 1, pp. 64-78, Jan./Feb. 2001.
43. I. Katakis, G. Tsoumakas, and I. Vlahavas, "Multilabel text classification for automated tag suggestion," in Proc. ECML PKDD Discovery Challenge, Antwerp, Belgium, 2008, pp. 75-83.
44. B. Klimt and Y. Yang, "The enron corpus: A new dataset for email classification research," in Proc. ECML, Pisa, Italy, 2004, pp. 217-226.
45. K. Crammer, M. Dredze, K. Ganchev, P. P. Talukdar, and S. Carroll, "Automatic code assignment to medical text," in Proc. Workshop Biol., Translational, Clinical Lang. Process., Prague, Czech Republic, 2007, pp. 129-136.
46. P. Duygulu, K. Barnard, J. de Freitas, and D. Forsyth, "Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary," in Proc. 7th Eur. Conf. Comput. Vis., Copenhagen, Denmark, 2002, pp. 97-112.
47. K. Barnard, P. Duygulu, D. Forsyth, N. de Freitas, D. M. Blei, and M. I. Jordan, "Matching words and pictures," J. Mach. Learn. Res., vol. 3, pp. 1107-1135, Feb. 2003.
48. D. Turnbull, L. Barrington, D. Torres, and G. Lanckriet, "Semantic annotation and retrieval of music and sound effects," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 2, pp. 467-476, Feb. 2008.
49. A. Wieczorkowska, P. Synak, and Z. Ras̈, "Multi-label classification of emotions in music," in Intelligent Information Processing and Web Mining, vol. 35. New York, NY, USA: Springer-Verlag, 2006, ch. 30, pp. 307-315.
50. S. Diplaris, G. Tsoumakas, P. Mitkas, and I. Vlahavas, "Protein classification with multiple algorithms," in Proc. 10th PCI, Volos, Greece, 2005, pp. 448-456.
51. C. G. M. Snoek, M. Worring, J. C. van Gemert, J. M. Geusebroek, and A. W. M. Smeulders, "The challenge problem for automated detection of 101 semantic concepts in multimedia," in Proc. 14th Annu. ACM Int. Conf. Multimedia, Santa Barbara, CA, USA, 2006, pp. 421-430.
52. J. Read and P. Reutemann. (2014, Jan. 1). MEKA Multi-Label Dataset Repository [Online]. Available: http://meka.sourceforge.net/#datasets
53. J. Demšar, "Statistical comparisons of classifiers over multiple data sets," J. Mach. Learn. Res., vol. 7, pp. 1-30, Jan. 2006.
54. J. Luengo, S. García, and F. Herrera, "A study on the use of statistical tests for experimentation with neural networks: Analysis of parametric test conditions and non-parametric tests," Expert Syst. Appl., vol. 36, no. 4, pp. 7798-7808, 2009.
55. D. J. Sheskin, Handbook of Parametric and Nonparametric Statistical Procedures. London, U.K.: Chapman & Hall, 2003.
56. J. Alcala-Fdez, A. Fernández, J. Luengo, J. Derrac, S. García, L. Sánchez, et al., "Keel data-mining software tool: Data set repository and integration of algorithms and experimental analysis framework," J. Multiple-Valued Logic Soft Comput., vol. 17, nos. 2-3, pp. 255-287, 2011.
57. E. Alvares-Cherman, J. Metz, and M. C. Monard, "Incorporating label dependency into the binary relevance framework for multi-label classification," Expert Syst. Appl., vol. 39, no. 2, pp. 1647-1655, 2012.