Adapting non-hierarchical multilabel classification methods for hierarchical multilabel classification

Intelligent Data Analysis

Volumn 15, Issue 6, 2011, Pages 861-887

  Cerri, Ricardo ^a   De Carvalho, André Carlos P L F ^a   Freitas, Alex A ^b  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

^b UNIVERSITY OF KENT   (United Kingdom)

Author keywords

bioinformatics; Hierarchical classification; multilabel classification

Indexed keywords

BINARY CLASSIFICATION METHODS; CLASSIFICATION METHODS; DATA SETS; GLOBAL METHODS; HIERARCHICAL CLASSIFICATION; HIERARCHICAL LEVEL; LOCAL APPROACHES; MULTI-LABEL;

CLASSIFICATION (OF INFORMATION);

BIOINFORMATICS;

EID: 84856444732     PISSN: 1088467X     EISSN: 15714128     Source Type: Journal    
DOI: 10.3233/IDA-2011-0500     Document Type: Article

References (49)

1. D.W. Aha, D. Kibler and M.K. Albert, Instance-based learning algorithms, Machine Learning 6(1) (1991), 37-66.
2. R. Alves, M. Delgado and A. Freitas, Multi-label hierarchical classification of protein functions with artificial immune systems, In III Brazilian Symposium on Bioinformatics, volume 5167 of Lecture Notes in Bioinformatics, pages 1-12, Berlin, Heidelberg, 2008. Springer-Verlag.
3. M. Ashburner, C.A. Ball, J.A. Blake, D. Botstein, H. Butler, J.M. Cherry, A.P. Davis, K. Dolinski, S.S. Dwight, J.T. Eppig, M.A. Harris, D.P. Hill, L. Issel-Tarver, A. Kasarskis, S. Lewis, J.C. Matese, J.E. Richardson, M. Ringwald, G.M. Rubin and G. Sherlock, Gene ontology: tool for the unification of biology. The Gene Ontology Consortium, Nat Genet 25(1) (May 2000), 25-29.
4. Z.Barutcuoglu, R.E. Schapire andO.G. Troyanskaya, Hierarchical multi-label prediction of gene function, Bioinformatics 22(7) (2006), 830-836.
5. P.N. Bennett and N. Nguyen, Refined experts: improving classification in large taxonomies, In SIGIR '09: Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval, pages 11-18, New York, NY, USA, 2009. ACM.
6. H. Blockeel, L. De Raedt and J. Ramon, Top-down induction of clustering trees, In Proceedings of the 15th International Conference on Machine Learning, pages 55-63. Morgan Kaufmann, 1998.
7. M.R. Boutell, J. Luo, X. Shen and C.M. Brown, Learning multi-label scene classification, Pattern Recognition 37(9) (2004), 1757-1771.
8. L. Cai and T. Hofmann, Exploiting known taxonomies in learning overlapping concepts, In IJCAI'07: Proceedings of the 20th international joint conference on Artifical intelligence, pages 714-719, San Francisco, CA, USA, 2007. Morgan Kaufmann Publishers Inc.
9. A. Carvalho and A. Freitas, A tutorial on multi-label classification techniques, volume 5 of Studies in Computational Intelligence 205, pages 177-195. Springer, September 2009.
10. N. Cesa-Bianchi, C. Gentile and L. Zaniboni, Incremental algorithms for hierarchical classification, Machine Learning 7 (2006), 31-54.
11. A. Clare and R.D. King, Predicting gene function in saccharomyces cerevisiae, Bioinformatics 19 (2003), 42-49.
12. W.W. Cohen, Fast effective rule induction, In In Proceedings of the Twelfth International Conference on Machine Learning, pages 115-123, 1995.
13. E.P. Costa, A.C. Lorena, A.C. Carvalho and A.A. Freitas, Top-down hierarchical ensembles of classifiers for predicting g-protein-coupled-receptor functions, In III Brazilian Symposium on Bioinformatics, volume 5167 of Lecture Notes in Bioinformatics, pages 35-46, Berlin, Heidelberg, 2008. Springer-Verlag.
14. E.P. Costa, A.C. Lorena, A.C. Carvalho, A.A. Freitas and N. Holden, Comparing several approaches for hierarchical classification of proteins with decision trees, In II Brazilian Symposium on Bioinformatics, volume 4643 of Lecture Notes in Bioinformatics, pages 126-137, Berlin, Heidelberg, 2007. Springer-Verlag.
15. K. Crammer and Y. Singer, On the algorithmic implementation of multiclass kernel-based vector machines, Machine Learning 2 (2002), 265-292.
16. J. Demšar, Statistical comparisons of classifiers over multiple data sets, Journal of Machine Learning Research 7 (2006), 1-30.
17. E. Dimitriadou, K. Hornik, F. Leisch, D. Meyer and A. Weingessel, r-cran-e1071, 2008.
18. I. Dimitrovski, D. Kocev, S. Loskovska and S.Dzeroski, Hierarchical annotation of medical images, In 11th International Multiconference Information Society, volume A, pages 174-177, 2008.
19. A. Elisseeff and J. Weston, Kernel methods for multi-labelled classification and categorical regression problems, In In Advances in Neural Information Processing Systems 14, pages 681-687. MIT Press, 2001.
20. A. Esuli, T. Fagni and F. Sebastiani, TreeBoost.mh: A boosting algorithm for multi-label hierarchical text categorization, In In Proceedings of the 13th International Symposium on String Processing and Information Retrieval (SPIRE06), pages 13-24, 2006.
21. A. Esuli, T. Fagni and F. Sebastiani, Boosting multi-label hierarchical text categorization, Inf Retr 11(4) (2008), 287-313.
22. A.A. Freitas and A.C. Carvalho, A Tutorial on Hierarchical Classification with Applications in Bioinformatics, volume 1, chapter VII, pages 175-208. Idea Group, January 2007. Research and Trends in Data Mining Technologies and Applications.
23. M. Friedman, The use of ranks to avoid the assumption of normality implicit in the analysis of variance, Journal of the American Statistical Association 32(200) (1937), 675-701.
24. N. Friedman, D. Geiger and M. Goldszmidt, Bayesian network classifiers, Mach Learn 29(2-3) (1997), 131-163.
25. W. Hersh, C. Buckley, T.J. Leone and D. Hickam, Ohsumed: an interactive retrieval evaluation and new large test collection for research, In SIGIR '94: Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, pages 192-201, New York, NY, USA, 1994. Springer-Verlag New York, Inc.
26. K. Hornik, C. Buchta and A. Zeileis, Open-source machine learning: R meets Weka, Computational Statistics 24(2) (2009), 225-232.
27. S. Kiritchenko, S. Matwin and A.F. Famili, Hierarchical text categorization as a tool of associating genes with gene ontology codes, In Proceedings of the Second European Workshop on Data Mining and Text Mining in Bioinformatics, pages 30-34, Pisa, Italy, 2004.
28. W. Krauth and M. Mezard, Learning algorithms with optimal stability in neural networks, Journal of Physics A: Mathematical and General 20(11) (1987), L745.
29. D.D. Lewis, Y. Yang, T.G. Rose and F. Li, Rcv1: A new benchmark collection for text categorization research, Journal Machine Learning Research 5 (2004), 361-397.
30. H.W. Mewes, D. Frishman, U. Güldener, G. Mannhaupt, K. Mayer, M. Mokrejs, B. Morgenstern, M. Münsterkötter, S. Rudd and B. Weil, Mips: a database for genomes and protein sequences, Nucleic Acids Res 30(1) (2002), 31-34.
31. P.B. Nemenyi, Distribution-free multiple comparisons, PhD thesis, Princeton University, 1963.
32. I.U. of Biochemistry, M. Biology and E.C. Webb, Enzyme nomenclature 1992: recommendations of the Nomenclature Committee of the International Union of Biochemistry and Molecular Biology on the nomenclature and classification of enzymes / prepared for NC-IUBMB by Edwin C. Webb, Published for the International Union of Biochemistry and Molecular Biology by Academic Press, San Diego, 1992.
33. F. Otero, A. Freitas and C. Johnson, A hierarchical classification ant colony algorithm for predicting gene ontology terms, in: Proc. 7th European Conference on Evolutionary Computation, Machine Learning and Data Mining in Bioinformatics (EvoBio-2009), C. Pizzuti, M. Ritchie and M. Giacobini, eds, volume Lecture Notes in Computer Science 5483, pages 68-79. Springer, March 2009,
34. J.R. Quinlan, C4.5: programs for machine learning, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1993.
35. R Development Core Team, R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2008.
36. J. Rousu, C. Saunders, S. Szedmak and J. Shawe-Taylor, Kernel-based learning of hierarchical multilabel classification models, Journal of Machine Learning Research 7 (2006), 1601-1626.
37. R.E. Schapire and Y. Singer, Improved boosting algorithms using confidence-rated predictions, In Machine Learning, volume 37, pages 297-336, Hingham, MA, USA, 1999. Kluwer Academic Publishers.
38. X. Shen, M. Boutell, J. Luo and C. Brown, Multi-label machine learning and its application to semantic scene classification, volume 5307, pages 188-199, 2004.
39. C. Silla Jr and A. Freitas, A survey of hierarchical classification across different application domains, Data Mining and Knowledge Discovery 22(1-2) (2011), 31-72.
40. A. Sun and E.-P. Lim, Hierarchical text classification and evaluation. In Fourth IEEE International Conference on Data Mining, pages 521-528, 2001.
41. B. Taskar, C. Guestrin and D. Koller, Max-margin markov networks, in: Advances in Neural Information Processing Systems 16, S. Thrun, L.K. Saul and B. Schölkopf, eds, pages 25-32. MIT Press, 2003.
42. K. Toutanova, F. Chen, K. Popat and T. Hofmann, Text classification in a hierarchical mixture model for small training sets, In CIKM '01: Proceedings of the tenth international conference on Information and knowledge management, pages 105-113, New York, NY, USA, 2001. ACM.
43. I. Tsochantaridis, T. Joachims, T. Hofmann and Y. Altun, Large margin methods for structured and interdependent output variables, Journal of Machine Learning Research 6 (2005), 1453-1484.
44. G. Tsoumakas and I. Vlahavas, Random k-labelsets: An ensemble method for multilabel classification. In Proceedings of the 18th European Conference on Machine Learning (ECML 2007), pages 406-417, Warsaw, Poland, 2007.
45. G. Valentini, True path rule hierarchical ensembles. In MCS '09: Proceedings of the 8th International Workshop on Multiple Classifier Systems, volume 5519 of Lecture Notes in Bioinformatics, pages 232-241, Berlin, Heidelberg, 2009. Springer-Verlag.
46. V.N. Vapnik, The Nature of Statistical Learning Theory (Information Science and Statistics). Springer-Verlag New York, Inc., 1999.
47. C. Vens, J. Struyf, L. Schietgat, S. Džeroski and H. Blockeel, Decision trees for hierarchical multi-label classification, Machine Learning 73(2) (2008), 185-214.
48. WIPO, World Intellectual Property Organization, 2001. http://www.wipo.int/portal/index.html.en.
49. G. Tsoumakas, I. Katakis and I.P.Vlahavas,MiningMulti-label Data, DataMining and Knowledge Discovery Handbook, Springer, 2010, Oded Maimon and Lior Rokach, 667-685.