A survey of hierarchical classification across different application domains

Data Mining and Knowledge Discovery

Volumn 22, Issue 1-2, 2011, Pages 31-72

  Silla Jr , Carlos N ^a   Freitas, Alex A ^a  

^a UNIVERSITY OF KENT   (United Kingdom)

Author keywords

DAG structured class hierarchies; Hierarchical classification; Tree structured class hierarchies

Indexed keywords

APPLICATION DOMAINS; CLASS HIERARCHIES; EMPIRICAL COMPARISON; EXISTING METHOD; HIERARCHICAL CLASSIFICATION; HIGH LEVEL OF ABSTRACTION;

SURVEYS;

EID: 78651375098     PISSN: 13845810     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10618-010-0175-9     Document Type: Review

References (107)

1. Aleksovski D, Kocev D, Dzeroski S (2009) Evaluation of distance measures for hierarchical multilabel classification in functional genomics. In: Proceedings of the 1st workshop on learning from multi-label data (MLD) held in conjunction with ECML/PKDD, pp 5-16
2. Altun Y, Hofmann T (2003) Large margin methods for label sequence learning. In: Proceedings of the 8th European conference on speech communication and technology (EuroSpeech)
3. Alves RT, Delgado MR, Freitas AA (2008) Multi-label hierarchical classification of protein functions with artificial immune systems. In: Advances in bioinformatics and computational biology, Lecture notes in bioinformatics, vol 5167. Springer, Berlin, pp 1-12
4. M Ashburner CA Ball JA Blake D Botstein H Butler JM Cherry AP Davis K Dolinski SS Dwight JT Eppig MA Harris DP Hill L Issel-Tarver A Kasarskis S Lewis JC Matese JE Richardson M Ringwald GM Rubin G Sherlock 2000 Gene ontology consortium. Gene ontology: tool for the unification of biology Nat Genet 25 25 29 10.1038/75556
5. Astikainen K, Holmand L, Pitkanen E, Szedmak S, Rousu J (2008) Towards structured output prediction of enzyme function. BMC Proc 2(Suppl 4)
6. JGA Barbedo A Lopes 2007 Automatic genre classification of musical signals EURASIP J Adv Signal Process 2007 12 2299369
7. AJ Barret 1997 Nomenclature committee of the international union of biochemistry and molecular biology (NC-IUBMB). Enzyme Nomenclature. Recommendations 1992. Supplement 4: corrections and additions Eur J Biochem 250 1 1 6 10.1111/j.1432-1033.1997.001-1.x
8. Barutcuoglu Z, DeCoro C (2006) Hierarchical shape classification using bayesian aggregation. In: Proceedings of the IEEE conference on shape modeling and applications
9. Z Barutcuoglu RE Schapire OG Troyanskaya 2006 Hierarchical multi-label prediction of gene function Syst Biol 22 830 836
10. Bennett PN, Nguyen N (2009) Refined experts: improving classification in large taxonomies. In: Proceedings of the 32nd international ACM SIGIR conference on research and development in information retrieval, pp 11-18
11. Binder A, Kawanabe M, Brefeld U (2009) Efficient classification of images with taxonomies. In: Proceedings of the 9th Asian conference on computer vision
12. Blockeel H, Bruynooghe M, Dzeroski S, Ramon J, Struyf J (2002) Hierarchical multi-classification. In: Proceedings of the first SIGKDD workshop on multirelational data mining (MRDM-2002), pp 21-35
13. Blockeel H, Schietgat L, Struyf J, Džeroski S, Clare A (2006) Decision trees for hierarchical multilabel classification: a case study in functional genomics. In: Knowledge discovery in databases: PKDD 2006. Lecture notes in computer science, vol 4213. Springer, Berlin, pp 18-29
14. Brecheisen S, Kriegel HP, Kunath P, Pryakhin A (2006a) Hierarchical genre classification for large music collections. In: Proceedings of the IEEE 7th international conference on Multimedia & Expo, pp 1385-1388
15. Brecheisen S, Kriegel HP, Kunath P, Pryakhin A, Vorberger F (2006b) MUSCLE: music classification engine with user feedback. In: Springer (ed) Proceedings of the 10th international conference on extending database technology, vol 3896 in Lecture notes in computer science, pp 1164-1167
16. Burkhardt F, Paeschke A, Rolfes M, Sendlmeier WF, Weiss B (2005) A database of German emotional speech. In: Proceedings of the 9th European conference on speech communication and technology, pp 1517-1520
17. Burred JJ, Lerch A (2003) A hierarchical approach to automatic musical genre classification. In: Proceedings of the 6th international conference on digital audio effects, pp 8-11
18. Cai L, Hofmann T (2004) Hierarchical document categorization with support vector machines. In: Proceedings of the 13th ACM international conference on information and knowledge management, pp 78-87
19. Cai L, Hofmann T (2007) Exploiting known taxonomies in learning overlapping concepts. In: Proceedings of the 20th international joint conference on artificial intelligence, pp 714-719
20. Ceci M (2008) Hierarchical text categorization in a transductive setting. In: Proceedings of the IEEE international conference of data mining workshops, pp 184-191
21. M Ceci D Malerba 2007 Classifying web documents in a hierarchy of categories: a comprehensive study J Intell Inform Syst 28 1 1 41 10.1007/s10844-006-0003-2
22. Cesa-Bianchi N, Valentini G (2009) Hierarchical cost-sensitive algorithms for genome-wide gene function prediction. In: Third international workshop on machine learning in systems biology
23. Cesa-Bianchi N, Gentile C, Zaniboni L (2006a) Hierarchical classification: combining Bayes with SVM. In: Proceedings of the 23rd international conference on machine learning, pp 177-184
24. N Cesa-Bianchi C Gentile L Zaniboni 2006 Incremental algorithms for hierarchical classification J Mach Learn Res 7 31 54 2274361
25. S Chakrabarti B Dom R Agrawal P Raghavan 1998 Scalable feature selection, classification and signature generation for organizing large text databases into hierarchical topic taxonomies VLDB J 7 163 178 10.1007/s007780050061
26. Chen Y, Crawford MM, Ghosh J (2004) Integrating support vector machines in a hierarchical output space decomposition framework. In: Proceedings of the IEEE international symposium on geoscience and remote sensing, vol 2, pp 949-952
27. Clare A (2004) Machine learning and data mining for yeast functional genomics. PhD thesis, University of Wales Aberystwyth
28. A Clare RD King 2003 Predicting gene function in Saccharomyces cerevisiae Bioinformatics 19 suppl 2 ii42 ii49
29. Costa E, Lorena A, Carvalho A, Freitas A (2007a) A review of performance evaluation measures for hierarchical classifiers. In: Evaluation methods for machine learning II: papers from the 2007 AAAI Workshop, AAAI Press, pp 1-6
30. Costa E, Lorena A, Carvalho A, Freitas AA, Holden N (2007b) Comparing several approaches for hierarchical classification of proteins with decision trees. In: Advances in bioinformatics and computational biology, Lecture notes in bioinformatics, vol 4643. Springer, Berlin, pp 126-137
31. Costa EP, Lorena AC, de Carvalho A, Freitas AA (2008) Top-down hierarchical ensembles of classifiers for predicting g-protein-coupled-receptor functions. In: Advances in Bioinformatics and computational biology. Lecture notes in bioinformatics, vol 5167. Springer, Berlin, pp 35-46
32. D'Alessio S, Murray K, Schiaffino R, Kershenbaum A (2000) The effect of using hierarchical classifiers in text categorization. In: Proceedings of the 6th international conference Recherche d́ Information Assistee par Ordinateur, pp 302-313
33. DeCoro C, Barutcuoglu Z, Fiebrink R (2007) Bayesian aggregation for hierarchical genre classification. In: Proceedings of the 8th international conference on music information retrieval, Vienna, Austria, pp 77-80
34. Dekel O, Keshet J, Singer Y (2004a) Large margin hierarchical classification. In: Proceedings of the 21th international conference on Machine learning
35. Dekel O, Keshet J, Singer Y (2004b) An online algorithm for hierarchical phoneme classification. In: Proceedings of the 1st machine learning for multimodal interaction workshop. Lecture notes in computer science, vol 3361. Springer, Berlin, pp 146-158
36. Dimitrovski I, Kocev D, Loskovska S, Dzeroski S (2008) Hierarchical annotation of medical images. In: Proceedings of the 11th international multiconference information society, vol A, pp 174-177
37. Downie JS, Cunningham SJ (2002) Toward a theory of music information retrieval queries: System design implications. In: Proceedings of the 3rd international conference on music information retrieval, pp 299-300
38. Dumais ST, Chen H (2000) Hierarchical classification of Web content. In: Belkin NJ, Ingwersen P, Leong MK (eds) Proceedings of the 23rd ACM international conference on research and development in information retrieval, pp 256-263
39. Eisner R, Poulin B, Szafron D, Lu P, Greiner R (2005) Improving protein function prediction using the hierarchical structure of the gene ontology. In: Proceedings of the IEEE symposium on computational intelligence in bioinformatics and computational biology, pp 1-10
40. A Esuli T Fagni F Sebastiani 2008 Boosting multi-label hierarchical text categorization Inform Retr 11 4 287 313 10.1007/s10791-008-9047-y
41. Fagni T, Sebastiani F (2007) On the selection of negative examples for hierarchical text categorization. In: Proceedings of the 3rd language technology conference, pp 24-28
42. Freitas AA, de Carvalho ACPLF (2007) Research and trends in data mining technologies and applications, Idea Group, chap A: tutorial on hierarchical classification with applications in bioinformatics, pp 175-208
43. COA Freitas LS Oliveira SBK Aires F Bortolozzi 2008 Metaclasses and zoning mechanism applied to handwriting recognition J Univers Comput Sci 14 2 211 223
44. S García F Herrera 2008 An extension on "statistical comparisons of classifiers over multiple data sets" for all pairwise comparisons J Mach Learn Res 9 2677 2694
45. S Gauch A Chandramouli S Ranganathan 2009 Training a hierarchical classifier using inter document relationships J Am Soc Inform Sci Technol 60 1 47 58 10.1002/asi.20951
46. JA Gerlt PC Babbitt 2000 Can sequence determine function Genome Biol 1 5 1 10 10.1186/gb-2000-1-5-reviews0005
47. Guan Y, Myers CL, Hess DC, Barutcuoglu Z, Caudy AA, Troyanskaya OG (2008) Predicting gene function in a hierarchical context with an ensemble of classifiers. Genome Biol 9(Suppl 1):S3
48. PY Hao JH Chiang YK Tu 2007 Hierarchically SVM classification based on support vector clustering method and its application to document categorization Expert Syst Appl 33 627 635 10.1016/j.eswa.2006.06.009
49. Hayete B, Bienkowska J (2005) Gotrees: predicting go associations from protein domain composition using decision trees. In: Proceedings of the Pacific symposium on biocomputing, pp 127-138
50. Holden N, Freitas AA (2005) A hybrid particle swarm/ant colony algorithm for the classification of hierarchical biological data. In: Proceedings of the 2nd IEEE swarm intelligence symposium, pp 100-107
51. Holden N, Freitas AA (2006) Hierarchical classification of g-protein-coupled receptors with a pso/aco algorithm. In: Proceedings of the 3rd IEEE swarm intelligence symposium, pp 77-84
52. Holden N, Freitas AA (2008) Improving the performance of hierarchical classification with swarm intelligence. In: Proc. 6th European conference on evolutionary computation, machine learning and data mining in bioinformatics (EvoBio). Lecture notes in computer science, vol 4973. Springer, Berlin, pp 48-60
53. N Holden AA Freitas 2009 Hierarchical classification of protein function with ensembles of rules and particle swarm optimisation Soft Comput J 13 259 272 10.1007/s00500-008-0321-0
54. Jin B, Muller B, Zhai C, Lu X (2008) Multi-label literature classification based on the gene ontology graph. BMC Bioinform 9:525
55. Kiritchenko S, Matwin S, Famili AF (2005) Functional annotation of genes using hierarchical text categorization. In: Proceedings of the ACL workshop on linking biological literature, ontologies and databases: mining biological semantics
56. Kiritchenko S, Matwin S, Nock R, Famili AF (2006) Learning and evaluation in the presence of class hierarchies: application to text categorization. In: Proceedings of the 19th Canadian conference on artificial intelligence. Lecture notes in artificial intelligence, vol 4013, pp 395-406
57. Koerich AL, Kalva PR (2005) Unconstrained handwritten character recognition using metaclasses of characters. In: Proceedings of the IEEE international conference on image processing, vol 2, pp 542-545
58. Koller D, Sahami M (1997) Hierarchically classifying documents using very few words. In: Proceedings of the 14th international conference on machine learning, pp 170-178
59. Kriegel HP, Kroger P, Pryakhin A, Schubert M (2004) Using support vector machines for classifying large sets of multi-represented objects. In: Proceedings of the SIAM international conference on data mining, pp 102-114
60. S Kumar J Ghosh MM Crawford 2002 Hierarchical fusion of multiple classifiers for hyperspectral data analysis Pattern Anal Appl 5 210 220 1024.68094 10.1007/s100440200019 1922452
61. Labrou Y, Finin T (1999) Yahoo! as an ontology-using yahoo! categories to describe documents. In: Proceedings of the ACM conference on information and knowledge management, pp 180-187
62. Lee JH, Downie JS (2004) Survey of music information needs, uses, and seeking behaviours: preliminary findings. In: Proceedings of the fifth international conference on music information retrieval, Barcelona, Spain, pp 441-446
63. Li T, Ogihara M (2005) Music genre classification with taxonomy. In: Proceedings of the IEEE international conference on acoustics, speech, and signal processing, pp 197-200
64. T Li S Zhu M Ogihara 2007 Hierarchical document classification using automatically generated hierarchy J Intell Inform Syst 29 2 211 230 10.1007/s10844-006-0019-7
65. TY Liu Y Yang H Wan HJ Zeng Z Chen WY Ma 2005 Support vector machines classification with a very large-scale taxonomy ACM SIGKDD Explor Newsl 7 1 36 43 10.1145/1089815.1089821
66. Lorena AC, Carvalho ACPLF (2004) Comparing techniques for multiclass classification using binary svm predictors. In: Proceedings of the IV Mexican international conference on artificial intelligence. Lecture notes in artificial intelligence, vol 2972, pp 272-281
67. McCallum A, Rosenfeld R, Mitchell TM, Ng AY (1998) Improving text classification by shrinkage in a hierarchy of classes. In: Proceedings of the international conference on machine learning, pp 359-367
68. McKay C, Fujinaga I (2004) Automatic genre classification using large high-level musical feature sets. In: Proceedings of the international conference on music information retrieval, pp 525-530
69. D Mladenic M Grobelnik 2003 Feature selection on hierarchy of web documents Decis Support Syst 35 45 87 10.1016/S0167-9236(02)00097-0
70. Otero FEB, Freitas AA, Johnson CG (2009) A hierarchical classification ant colony algorithm for predicting gene ontology terms. In: Pizzuti C, Ritchie M, Giacobini M (eds) Proceedings of the 7th European conference on evolutionary computation, machine learning and data mining in bioinformatics (EvoBio). Lecture Notes in Computer Science, vol 5483. Springer, Berlin, pp 68-79
71. Peng X, Choi B (2005) Document classifications based on word semantic hierarchies. In: Proceedings of the international conference on artificial intelligence and applications, pp 362-367
72. Punera K, Ghosh J (2008) Enhanced hierarchical classification via isotonic smoothing. In: Proceedings of the 17th international conference on World Wide Web, pp 151-160
73. Punera K, Rajan S, Ghosh J (2005) Automatically learning document taxonomies for hierarchical classification. In: Proceedings of the international World Wide Web conference, pp 1010-1011
74. Qiu X, Gao W, Huang X (2009) Hierarchical multi-class text categorization with global margin maximization. In: Proceedings of the Joint conference of the 47th Annual Meeting of the ACL and the 4th international joint conference on natural language processing of the AFNLP, Association for computational linguistics, pp 165-168
75. Rocchio JJ (1971) The SMART retrieval system: experiments in automatic document processing, chap: relevance feedback in information retrieval, Prentice Hall, pp 313-323
76. Rousu J, Saunders C, Szedmak S, Shawe-Taylor J (2005) Learning hierarchical multi-category text classification models. In: Proceedings of the 22nd international conference on machine learning, pp 744-751
77. J Rousu C Saunders S Szedmak J Shawe-Taylor 2006 Kernel-based learning of hierarchical multilabel classification models J Mach Learn Res 7 1601 1626 2274418
78. A Ruepp A Zollner D Maier K Albermann J Hani M Mokrejs I Tetko U Guldener G Mannhaupt M Munsterkotter HW Mewes 2004 The FunCat, a functional annotation scheme for systematic classification of proteins from whole genomes Nucleic Acids Res 32 18 5539 5545 10.1093/nar/gkh894
79. ME Ruiz P Srinivasan 2002 Hierarchical text categorization using neural networks Inform Retr 5 87 118 0999.68185 10.1023/A:1012782908347
80. Sasaki M, Kita K (1998) Rule-based text categorization using hierarchical categories. In: Proceedings of IEEE international conference on systems, man, and cybernetics, pp 2827-2830
81. A Secker M Davies A Freitas J Timmis M Mendao D Flower 2007 An experimental comparison of classification algorithms for the hierarchical prediction of protein function Expert Updat (the BCS-SGAI Mag) 9 3 17 22
82. A Secker M Davies AA Freitas E Clark J Timmis DR Flower 2010 Hierarchical classification of g-protein-coupled-receptors with data-driven selection of attributes and classifiers Int J Data Mining Bioinform 4 2 191 210 10.1504/IJDMB.2010.032150
83. MW Seeger 2008 Cross-validation optimization for large scale structured classification kernel methods J Mach Learn Res 9 1147 1178 2417267
84. Shilane P, Kazhdan M, Min P, Funkhouser T (2004) The Princeton shape benchmark. In: Proceedings of the shape modeling international
85. Silla Jr CN, Freitas AA (2009a) A global-model naive bayes approach to the hierarchical prediction of protein functions. In: Proceedings of the 9th IEEE international conference on data mining, pp 992-997
86. Silla Jr CN, Freitas AA (2009b) Novel top-down approaches for hierarchical classification and their application to automatic music genre classification. In: Proceedings of the IEEE international conference on systems, man, and cybernetics, pp 3599-3604
87. M Sokolova G Lapalme 2009 A systematic analysis of performance measures for classification tasks Inform Process Manag 45 427 437 10.1016/j.ipm.2009.03. 002
88. Sun A, Lim EP (2001) Hierarchical text classification and evaluation. In: Proceedings of the IEEE international conference on data mining, pp 521-528
89. A Sun EP Lim WK Ng 2003 Performance measurement framework for hierarchical text classification J Am Soc Inform Sci Technol 54 11 1014 1028 10.1002/asi.10298
90. A Sun EP Lim WK Ng J Srivastava 2004 Blocking reduction strategies in hierarchical text classification IEEE Trans Knowl Data Eng 16 10 1305 1308 10.1109/TKDE.2004.50
91. Tikk D, Biró G (2003) Experiment with a hierarchical text categorization method on the wipo-alpha patent collection. In: Proceedings of the 4th international symposium on uncertainty modeling and analysis, pp 104-109
92. D Tikk JD Yang SL Bang 2003 Hierarchical text categorization using fuzzy relational thesaurus Kybernetika 39 5 583 600
93. D Tikk G Biró JD Yang 2004 A hierarchical text categorization approach and its application to frt expansion Aust J Intell Inform Process Syst 8 3 123 131
94. Tikk D, Biró G, Torcsvári A (2007) Emerging technologies of text mining: techniques and applications, Idea Group, chap: a hierarchical online classifier for patent categorization, pp 244-267
95. G Tsoumakas I Katakis 2007 Multi label classification: an overview Int J Data Wareh Mining 3 3 1 13
96. I Tsochantaridis T Joachims T Hofmann Y Altun 2005 Large margin methods for structured and interdependent output variables J Mach Learn Res 6 1453 1484 2249862
97. Valentini G (2009) True path rule hierarchical ensembles. In: Kittler J, Benediktsson J, Roli F (eds) Proceedings of the eighth international workshop on multiple classifier systems. Lecture notes in computer science, vol 5519. Springer, Berlin, pp 232-241
98. Valentini G, Re M (2009) Weighted true path rule: a multilabel hierarchical algorithm for gene function prediction. In: Proceedings of the 1st workshop on learning from multi-label data (MLD) held in conjunction with ECML/PKDD, pp 132-145
99. C Vens J Struyf L Schietgat S Džeroski H Blockeel 2008 Decision trees for hierarchical multi-label classification Mach Learn 73 2 185 214 10.1007/s10994-008-5077-3
100. Wang K, Zhou S, Liew SC (1999) Building hierarchical classifiers using class proximity. In: In Proceedings of the 25th conference on very large data base. Morgan Kaufmann Publishers, San Francisco, pp 363-374
101. Wang K, Zhou S, He Y (2001) Hierarchical classification of real life documents. In: Proceedings of the 1st SIAM international conference on data mining, Chicago, USA
102. J Wang X Shen W Pan 2009 Large margin hierarchical classification with multiple paths J Am Stat Assoc 104 487 1213 1223 10.1198/jasa.2009.tm08084 2562009
103. AS Weigend ED Wiener JO Pedersen 1999 Exploiting hierarchy in text categorization Inform Retr 1 193 216 10.1023/A:1009983522080
104. Wu F, Zhang J, Honavar V (2005) Learning classifiers using hierarchically structured class taxonomies. In: Proceedings of the symposium on abstraction, reformulation, and approximation, vol 3607. Springer, Berlin, pp 313-320
105. Xiao Z, Dellandréa E, Dou W, Chen L (2007) Hierarchical Classification of Emotional Speech. Technical report RR-LIRIS-2007-006, LIRIS UMR 5205 CNRS/INSA de Lyon/Université Claude Bernard Lyon 1/Université Lumière Lyon 2/Ecole Centrale de Lyon, http://liris.cnrs.fr/publis/?id=2742
106. Xue GR, Xing D, Yang Q, Yu Y (2008) Deep classification in large-scale text hierarchies. In: Proceedings of the 31st annual international ACM SIGIR conference on research and development in information retrieval, pp 619-626
107. Zhang T (2003) Semi-automatic approach for music classification. In: Proceedings of the SPIE conference on internet multimedia management systems, pp 81-91