An empirical comparison of flat and hierarchical performance measures for multi-label classification with hierarchy extraction

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6881 LNAI, Issue PART 1, 2011, Pages 579-589

  Brucker, Florian ^a   Benites, Fernando ^a   Sapozhnikova, Elena ^a  

^a UNIVERSITY OF KONSTANZ   (Germany)

Author keywords

Hierarchical Classification; Multi label Classification; Performance Measures; Text Classification

Indexed keywords

CLASS HIERARCHIES; CLASS LABELS; DATA SETS; EMPIRICAL COMPARISON; HIER-ARCHICAL CLUSTERING; HIERARCHICAL CLASSIFICATION; MULTI-LABEL; PERFORMANCE MEASURE; PERFORMANCE MEASUREMENTS; PERFORMANCE MEASURES; PRECISION AND RECALL; PREDICTIVE PERFORMANCE; QUALITY ASSESSMENT; TEXT CLASSIFICATION; TEXT MINING; EMPIRICAL - COMPARISONS; HIERARCHICAL MULTI-LABEL CLASSIFICATIONS; MULTI LABEL CLASSIFICATION; STATISTICAL CONSISTENCIES;

KNOWLEDGE BASED SYSTEMS; TAXONOMIES; TEXT PROCESSING; SUPPORT VECTOR MACHINES; TEXT MINING;

HIERARCHICAL SYSTEMS; HIERARCHICAL CLUSTERING;

EID: 80053137125     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-23851-2_59     Document Type: Conference Paper

References (21)

1. Benites, F., Brucker, F., Sapozhnikova, E.: Multi-Label Classification by ART-based Neural Networks and Hierarchy Extraction. In: Proc. of the IEEE IJCNN 2010, pp. 2788-2796. IEEE Computer Society, Barcelona (2010)
2. Brucker, F., Benites, F., Sapozhnikova, E.: Multi-label classification and extracting predicted class hierarchies. Pattern Recognition 44(3), 724-738 (2011)
3. Cai, L., Hofmann, T.: Exploiting known taxonomies in learning overlapping concepts. In: Proc. of Int. Joint Conf. on Artificial Intelligence (2007)
4. Cesa-Bianchi, N., Gentile, C., Zaniboni, L.: Hierarchical classification: combining Bayes with SVM. In: Proc. of the 23rd Int. Conf. on Machine learning (2006)
5. Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines (2001), http://www.csie.ntu.edu.tw/~cjlin/libsvm (acc. 03.2010)
6. Costa, E., Lorena, A., Carvalho, A., Freitas, A.: A review of performance evaluation measures for hierarchical classifiers. In: Proc. of the AAAI 2007 Workshop: Evaluation Methods for Machine Learning II, pp. 1-6 (2007)
7. Davis, J., Goadrich, M.: The relationship between precision-recall and ROC curves. In: Proc. of the 23rd Int. Conf. on Machine Learning, p. 240. ACM, New York (2006)
8. Granitzer, M.: Hierarchical text classification using methods from machine learning. Master's thesis, Graz University of Technology (2003)
9. Huang, J., Ling, C.: Using AUC and accuracy in evaluating learning algorithms. IEEE Transactions on Knowledge and Data Engineering, 299-310 (2005)
10. Ipeirotis, P., Gravano, L., Sahami, M.: Probe, Count, and Classify: Categorizing Hidden-Web Databases. In: Proc. of the 2001 ACM SIGMOD Int. Conf. on Management of Data, pp. 67-78 (2001)
11. Kiritchenko, S.: Hierarchical text categorization and its application to bioinformatics. Ph.D. thesis, University of Ottawa Ottawa, Ont., Canada (2006)
12. Nowak, S., Lukashevich, H.: Multilabel classification evaluation using ontology information. In: Proc. of the First ESWC Workshop on Inductive Reasoning and Machine Learning on the Semantic Web, Heraklion, Greece (2009)
13. Silla, C., Freitas, A.: A survey of hierarchical classification across different application domains. Data Mining and Knowledge Discovery, 1-42 (2010)
14. Struyf, J., Dzeroski, S., Blockeel, H., Clare, A.: Hierarchical multi-classification with predictive clustering trees in functional genomics. In: Bento, C., Cardoso, A., Dias, G. (eds.) EPIA 2005. LNCS (LNAI), vol. 3808, pp. 272-283. Springer, Heidelberg (2005) (Pubitemid 43829732)
15. Sun, A., Lim, E.: Hierarchical text classification and evaluation. In: Proc. of the 2001 IEEE Int. Conf. on Data Mining, California, USA, vol. 528 (2001)
16. Tan, P., Steinbach, M., Kumar, V.: Introduction to data mining. Pearson Addison Wesley, Boston (2006)
17. Verspoor, K., Cohn, J., Mniszewski, S., Joslyn, C.: A categorization approach to automated ontological function annotation. Protein Science 15(6), 1544-1549 (2006)
18. Wang, K., Zhou, S., He, Y.: Hierarchical classification of real life documents. In: Proc. of the 1st (SIAM) Int. Conf. on Data Mining, pp. 1-16 (2001)
19. Woolam, C., Khan, L.: Multi-concept document classification using a perceptronlike algorithm. In: WI-IAT 2008: Proc. of the 2008 IEEE/WIC/ACM Int. Conf. on Web Intelligence and Intelligent Agent Technology, pp. 570-574. IEEE Computer Society, Washington, DC, USA (2008)
20. Wu, F., Zhang, J., Honavar, V.: Learning Classifiers Using Hierarchically Structured Class Taxonomies. In: Zucker, J.-D., Saitta, L. (eds.) SARA 2005. LNCS (LNAI), vol. 3607, pp. 313-320. Springer, Heidelberg (2005)
21. Yang, Y.: An evaluation of statistical approaches to text categorization. Information Retrieval 1(1), 69-90 (1999)