Hierarchical multi-label classification using local neural networks

Journal of Computer and System Sciences

Volumn 80, Issue 1, 2014, Pages 39-56

  Cerri, Ricardo ^a   Barros, Rodrigo C ^a   De Carvalho, André C P L F ^a  

^a Instituto de Ciências Matemáticas e de Computaçã o ICMC   (Brazil)

Author keywords

Hierarchical multi label classification; Local classification method; Neural networks

Indexed keywords

DECISION TREES; MULTILAYER NEURAL NETWORKS; NEURAL NETWORKS;

CLASSIFICATION HIERARCHIES; CLASSIFICATION METHODS; CLASSIFICATION TASKS; DECISION TREE INDUCTION; EXPERIMENTAL ANALYSIS; HIERARCHICAL MULTI-LABEL CLASSIFICATIONS; MULTI LAYER PERCEPTRON; PRECISION AND RECALL;

CLASSIFICATION (OF INFORMATION);

CLASSIFICATION; FORESTRY; NEURAL NETWORKS;

EID: 84884973606     PISSN: 00220000     EISSN: 10902724     Source Type: Journal    
DOI: 10.1016/j.jcss.2013.03.007     Document Type: Conference Paper

References (49)

1. A. Freitas, and A.C. Carvalho A tutorial on hierarchical classification with applications in bioinformatics Research and Trends in Data Mining Technologies and Applications 2007 Idea Group 175 208 (Ch. VII)
2. A. Clare, and R.D. King Predicting gene function in Saccharomyces cerevisiae Bioinformatics 19 2003 42 49
3. J. Struyf, H. Blockeel, and A. Clare Hierarchical multi-classification with predictive clustering trees in functional genomics Workshop on Computational Methods in Bioinformatics Lect. Notes Artif. Intell. vol. 3808 2005 Springer 272 283
4. H. Blockeel, L. Schietgat, J. Struyf, S. Dzeroski, A. Clare, Decision trees for hierarchical multilabel classification: A case study in functional genomics, in: Knowledge Discovery in Databases, 2006, pp. 18-29.
5. C. Vens, J. Struyf, L. Schietgat, S. Džeroski, and H. Blockeel Decision trees for hierarchical multi-label classification Mach. Learn. 73 2008 185 214
6. R. Alves, M. Delgado, A. Freitas, Knowledge discovery with artificial immune systems for hierarchical multi-label classification of protein functions, in: International Conference on Fuzzy Systems, 2010, pp. 2097-2104.
7. F. Otero, A. Freitas, and C. Johnson A hierarchical multi-label classification ant colony algorithm for protein function prediction Memetic Comput. 2 2010 165 181
8. R. Cerri, A.C.P.L.F. Carvalho, Hierarchical multilabel classification using top-down label combination and artificial neural networks, in: Brazilian Symposium on Artificial Neural Networks, 2010, pp. 253-258.
9. G. Obozinski, G. Lanckriet, C. Grant, W. Jordan, M.I. Noble, Consistent probabilistic outputs for protein function prediction, Genome Biology 9 (Suppl. 1).
10. G. Valentini True path rule hierarchical ensembles for genome-wide gene function prediction IEEE/ACM Trans. Comput. Biol. Bioinform. 8 3 2011 832 847
11. R. Cerri, R. Barros, A. de Carvalho, Hierarchical multi-label classification for protein function prediction: A local approach based on neural networks, in: Intelligent Systems Design and Applications (ISDA), 2011, pp. 337-343.
12. J.R. Quinlan C4.5: Programs for Machine Learning 1993 Morgan Kaufmann Publishers Inc. San Francisco, CA, USA
13. V.N. Vapnik The Nature of Statistical Learning Theory 1999 Springer-Verlag New York
14. E. Costa, A. Lorena, A. Carvalho, A. Freitas, and N. Holden Comparing several approaches for hierarchical classification of proteins with decision trees II Brazilian Symposium on Bioinformatics Lect. Notes in Bioinform. vol. 4643 2007 Springer-Verlag Berlin, Heidelberg 126 137
15. C. Silla, and A. Freitas A survey of hierarchical classification across different application domains Data Min. Knowl. Discov. 22 2010 31 72
16. G. Valentini, True path rule hierarchical ensembles, in: International Workshop on Multiple Classifier Systems, 2009, pp. 232-241.
17. S. Kiritchenko, S. Matwin, A.F. Famili, Hierarchical text categorization as a tool of associating genes with gene ontology codes, in: European Workshop on Data Mining and Text Mining in Bioinformatics, 2004, pp. 30-34.
18. R. Cerri, A.C.P.L.F. Carvalho, Hierarchical multilabel protein function prediction using local neural networks, in: Brazilian Symposium on Bioinformatics, 2011, pp. 10-17.
19. D.E. Rumelhart, and J.L. McClelland Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1 1986 MIT Press Cambridge, MA
20. M. Riedmiller, H. Braun, A Direct adaptive method for faster backpropagation learning: The RPROP algorithm, in: International Conference on Neural Networks, 1993, pp. 586-591.
21. N. Cesa-Bianchi, C. Gentile, and L. Zaniboni Incremental algorithms for hierarchical classification Mach. Learn. 7 2006 31 54
22. N. Cesa-Bianchi, and G. Valentini Hierarchical cost-sensitive algorithms for genome-wide gene function prediction J. Mach. Learn. Res. 8 2010 14 29
23. G. Valentini, M. Re, Weighted true path rule: a multilabel hierarchical algorithm for gene function prediction, in: 1st Workshop on Learning from Multi-Label Data (MLD) held in conjunction with ECML/PKDD, 2009, pp. 132-145.
24. N. Cesa-Bianchi, M. Re, and G. Valentini Synergy of multi-label hierarchical ensembles, data fusion, and cost-sensitive methods for gene functional inference Mach. Learn. 88 1-2 2012 209 241
25. M. Re, and G. Valentini Simple ensemble methods are competitive with state-of-the-art data integration methods for gene function prediction J. Mach. Learn. Res. - Proc. Track 8 2010 98 111
26. A. Mayne, R. Perry, Hierarchically classifying documents with multiple labels, in: 2009 IEEE Symposium on Computational Intelligence and Data Mining, CIDM 2009 - Proceedings, 2009, pp. 133-139.
27. R. Cerri, and A.C.P.L.F. Carvalho New top-down methods using SVMs for hierarchical multilabel classification problems Proceedings of the International Joint Conference on Neural Networks (IJCNN) 2010 IEEE Barcelona 3064 3071
28. G. Tsoumakas, I. Katakis, and I.P. Vlahavas Mining multi-label data Data Mining and Knowledge Discovery Handbook 2nd edition 2010 Springer 667 685
29. X. Shen, M. Boutell, J. Luo, and C. Brown Multi-label machine learning and its application to semantic scene classification Proc. SPIE 5307 2004 188 199
30. R. Cerri, A.C.P.L.F. Carvalho, and A.A. Freitas Adapting non-hierarchical multilabel classification methods for hierarchical multilabel classification Intelligent Data Analysis 15 6 2011 861 887 10.3233/IDA-2011-0500
31. H. Blockeel, M. Bruynooghe, S. Dzeroski, J. Ramon, J. Struyf, Hierarchical multi-classification, in: Workshop on Multi-Relational Data Mining, 2002, pp. 21-35.
32. L. Schietgat, C. Vens, J. Struyf, H. Blockeel, D. Kocev, and S. Dzeroski Predicting gene function using hierarchical multi-label decision tree ensembles BMC Bioinformatics 11 2010 2
33. L. Breiman Bagging predictors Mach. Learn. 24 2 1996 123 140
34. R. Alves, M. Delgado, and A. Freitas Multi-label hierarchical classification of protein functions with artificial immune systems III Brazilian Symposium on Bioinformatics Lect. Notes in Bioinform. vol. 5167 2008 Springer-Verlag Berlin, Heidelberg 1 12
35. L.N. de Castro, and J.I. Timmis Artificial Immune Systems: A New Computational Intelligence Approach 2002 Springer-Verlag London
36. S. Sangsuriyun, S. Marukatat, and K. Waiyamai Hierarchical Multi-label Associative Classification (HMAC) using negative rules International Conference on Cognitive Informatics 2010 IEEE 919 924
37. M. Dorigo, V. Maniezzo, and A. Colorni Positive feedback as a search strategy Tech. rep. 1991 Dipartimento di Elettronica, Politecnico di Milano, IT
38. M. Dorigo Optimization, learning and natural algorithms PhD thesis 1992 Dipartimento di Elettronica, Politecnico di Milano, IT
39. F. Otero, A. Freitas, and C. Johnson A hierarchical classification ant colony algorithm for predicting gene ontology terms European Conference on Evolutionary Computation, Machine Learning and Data Mining in Bioinformatics Lect. Notes Comput. Sci. 2009 Springer 68 79
40. A. Ruepp, A. Zollner, D. Maier, K. Albermann, J. Hani, M. Mokrejs, I. Tetko, U. Güldener, G. Mannhaupt, M. Münsterkötter, and H.W. Mewes The FunCat, a functional annotation scheme for systematic classification of proteins from whole genomes Nucl. Acids Res. 32 18 2004 5539 5545
41. I.H. Witten, and E. Frank Data Mining: Practical Machine Learning Tools and Techniques 2nd edition 2005 Morgan Kaufmann
42. J. Davis, M. Goadrich, The relationship between precision-recall and ROC curves, in: International Conference on Machine Learning, 2006, pp. 233-240.
43. J. Demšar Statistical comparisons of classifiers over multiple data sets J. Mach. Learn. Res. 7 2006 1 30
44. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I.H. Witten The WEKA data mining software: an update SIGKDD Explor. Newsl. 11 1 2009 10 18
45. A. Sun, E. Peng Lim, W.K. Ng, and J. Srivastava Blocking reduction strategies in hierarchical text classification IEEE Trans. Knowl. Data Eng. 16 2004 1305 1308
46. K. Trohidis, G. Tsoumakas, G. Kalliris, I. Vlahavas, Multilabel classification of music into emotions, in: International Conference on Music Information Retrieval, 2008.
47. G. Doquire, and M. Verleysen Feature selection for multi-label classification problems Proceedings of the 11th International Conference on Artificial Neural Networks Conference on Advances in Computational Intelligence 2011 Springer-Verlag Berlin, Heidelberg 9 16
48. C. Igel, M. Husken, Improving the Rprop learning algorithm, in: International Symposium on Neural Computation, 2000.
49. M.J.D. Powell Radial basis functions for multivariable interpolation: a review Algorithms for Approximation 1987 Clarendon Press New York, NY, USA 143 167