Comparison of four performance metrics for evaluating sampling techniques for low quality class-imbalanced data

Proceedings - 7th International Conference on Machine Learning and Applications, ICMLA 2008

Volumn , Issue , 2008, Pages 153-158

  Folleco, Andres ^a   Khoshgoftaar, Taghi M ^a   Napolitano, Amri ^a  

^a FLORIDA ATLANTIC UNIVERSITY   (United States)

Author keywords

Class imbalance; Data quality; Data sampling; Performance metrics; Simulated noise

Indexed keywords

CLASS IMBALANCE; DATA QUALITY; DATA SAMPLING; PERFORMANCE METRICS; SIMULATED NOISE;

BENCHMARKING; EDUCATION; ROBOT LEARNING; SOFTWARE ENGINEERING;

TREES (MATHEMATICS);

EID: 60649086930     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICMLA.2008.11     Document Type: Conference Paper

References (19)

1. R. Barandela, R. M. Valdovinos, J. S. Sanchez, and F. J. Ferri. The imbalanced training sample problem: Under or over sampling? In Joint IAPR International Workshops on Structural, Syntactic, and Statistical Pattern Recognition (SSPR/SPR'04), Lecture Notes in Computer Science 3138, (806-814), 2004.
2. W. J. Conover. Practical Nonparametric Statistics. John Wiley and Sons, New York, NY, USA, 1971.
3. J. Davis and K. Goadrich. The relationship between Precision-Recall and ROC curves. In Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, 2006.
4. H. Han, W. Y. Wang, and B. H. Mao. Borderline-SMOTE: A new over-sampling method in imbalanced data sets learning. In In International Conference on Intelligent Computing (ICIC'05). Lecture Notes in Computer Science 3644, pages 878-887. Springer-Verlag, 2005.
5. D. J. Hand. Good practice in retail credit scorecard assessment. Journal of the Operational Research Society, 56:1109-1117, 2005.
6. T. Jo and N. Japkowicz. Class imbalances versus small disjuncts. SIGKDD Explorations, 6 (1):40-49, 2004.
7. T. M. Khoshgoftaar, N. Seliya, and K. Gao. Detecting noisy instances with the rule-based classification model. Intelligent Data Analysis: An International Journal, 9 (4):347-364, 2005.
8. M. Kubat and S. Matwin. Addressing the curse of imbalanced training sets: One sided selection. In Proceedings of the Fourteenth International Conference on Machine Learning, pages 179-186. Morgan Kaufmann, 1997.
9. C. Manning and H. Schutze. Foundations of statistical natural language processing. MIT Press, Cambirdge, MA, 1999.
10. F Provost and T. Fawcett. Robust classification for imprecise environments. Machine Learning, 42:203-231, 2001.
11. J. R. Quinlan. C4.5: Programs For Machine Learning. Morgan Kaufmann, San Mateo, California, 1993.
12. T. M. Khoshgoftaar, V. Joshi, and N. Seliya. Detecting noisy instances with the ensemble filter: a study in software quality estimation. Intl. Journal of Software Engineering, 16 (1): 124, 2006.
13. J. Van Hulse. Data quality in data mining and machine learning. Ph.D. Dissertation, Department of Computer Science and Engineering, Florida Atlantic University, Boca Raton, Florida, USA, May 2007. Advised by T. M. Khoshgoftaar.
14. J. Van Hulse and T. M. Khoshgoftaar. Class noise detection using frequent itemsets. Intelligent Data Analysis: An International Journal, 10 (6):487-507, 2006.
15. J. Van Hulse, T. M. Khoshgoftaar, and A. Napolitano. Skewed class distributions and mislabeled examples. In Seventh IEEE International Conference on Data Mining - Workshops (ICDMW'07), pages 477-482, October 2007.
16. G. Weiss. Learning with rare cases and small disjuncts. In 12th International Conference on Machine Learning, pages 558-565. Morgan Kaufmann, 1995.
17. D.Wilson. Asymptotic properties of nearest neighbor rules using edited data sets. IEEE Trans. on Systems, Man and Cybernetics, (2):408-421, 1972.
18. I. H. Witten and E. Frank. Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann, San Francisco, California, 2nd edition, 2005.
19. X. Zhu and X. Wu. Class noise vs attribute noise: A quantitative study of their impacts. Artificial Intelligence Review, 22 (3-4): 177-210, November 2004.