Comparison of evaluation metrics in classification applications with imbalanced datasets

Proceedings - 7th International Conference on Machine Learning and Applications, ICMLA 2008

Volumn , Issue , 2008, Pages 777-782

  Fatourechi, Mehrdad ^a   Ward, Rabab K ^a,c   Mason, Steven G ^b   Huggins, Jane ^d   Schlögl, Alois ^e   Birch, Gary E ^a,b,c  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b Neil Squire Society   (Canada)

^c UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^d UNIVERSITY OF MICHIGAN MEDICAL SCHOOL   (United States)

^e GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

MEASUREMENT THEORY; ROBOT LEARNING;

DATA-SETS; EVALUATION METRIC; EVALUATION METRICS; KAPPA COEFFICIENTS; MODEL SELECTIONS; SIMULATION RESULTS;

APPLICATIONS;

EID: 60649102026     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICMLA.2008.34     Document Type: Conference Paper

References (6)

1. J. Cohen, "A coefficient of agreement for nominal scales," Educational and Psychological Measurement, vol. 20, pp. 37-46, 1960.
2. M. H. Zweig and G. Campbell, "Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine," Clin. Chem., vol. 39, pp. 561-577, Apr. 1993.
3. F. Provost and T. Fawcett, "Robust Classification for Imprecise Environments," Mach. Learning, vol. 42, pp. 203-231, 2001.
4. J. Huang and C. X. Ling, "Using AUC and accuracy in evaluating learning algorithms," IEEE Trans. Knowled. Data Eng., vol. 17, pp. 299-310, 2005.
5. J. F. Borisoff, S. G. Mason, A. Bashashati and G. E. Birch, "Brain-computer interface design for asynchronous control applications: improvements to the LF-ASD asynchronous brain switch," IEEE Trans. Biomed. Eng., vol. 51, pp. 985-992, Jun. 2004.
6. A. Schlögl, J. Kronegg, J. Huggins and S. G. Mason, "Evaluation criteria in BCI research," in Towards Brain-Computer Interfacing G. Dornhege, J. R. Millan, T. Hinterberger, D. McFarland and K. R. Muller, Eds. MIT Press, 2007.