A multiple resampling method for learning from imbalanced data sets

Computational Intelligence

Volumn 20, Issue 1, 2004, Pages 18-36

  Estabrooks, Andrew ^a   Jo, Taeho ^b   Japkowicz, Nathalie ^b  

^a IBM TORONTO LAB   (Canada)

^b UNIVERSITY OF OTTAWA   (Canada)

Author keywords

Class imbalance problem; Decision trees; Inductive learning; Multiple resampling; Text classification

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); PROBLEM SOLVING; SAMPLING;

CLASS IMBALANCE PROBLEM; DECISION TREES; INDUCTIVE LEARNING; MULTIPLE RESAMPLING; TEST CLASSIFICATION;

LEARNING SYSTEMS;

EID: 1442356040     PISSN: 08247935     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.0824-7935.2004.t01-1-00228.x     Document Type: Article

References (18)

1. BREIMAN, L. 1998. Combining Predictors. Technical Report, Statistics Department, 1998.
2. CHAWLA, N., L. HALL, and W. KEGELMEYER. 2002. SMOTE: synthetic minority oversampling technique. Journal of Artificial Intelligence Research, 16:321-357.
3. ESTABROOKS, A. 2000. A Combination Scheme for Inductive Learning from Imbalanced Data Sets. MCS Thesis, Faculty of Computer Science, Dalhousie University.
4. HANSEN, L. K., and P. SALAMON. 1990. Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(10), 993-1001.
5. JACOBS, R. A., M. I. JORDAN, S. J. NOWLAN, and G. E. HINTON. 1991. Adaptive mixtures of local experts. Neural Computation, 3:79-87.
6. JAPKOWICZ, N., and S. STEPHEN. 2002. The class imbalance problem: a systematic study. Intelligent Data Analysis, 6(5):429-450.
7. JAPKOWICZ, N., C. MYERS, and M. GLUCK. 1995, A novelty detection approach to classification. In Proceedings of the Fourteenth Joint Conference on Artificial Intelligence, Montreal, Que, pp. 518-523.
8. KUBAT, M., and S. MATWIN. 1997, Addressing the curse of imbalanced data sets: one-sided sampling. In Proceedings of the Fourteenth International Conference on Machine Learning, Nashville, TN, pp. 179-186.
9. KUBAT, M., R. HOLTE, and S. MATWIN. 1998, Machine learning for the detection of oil spills in satellite radar images. Machine Learning, 30:195-215.
10. LEWIS, D., and W. GALE. 1994, Training text classifiers by uncertainty sampling. In Proceedings of the Seventh Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Dublin, Ireland.
11. LING, C., and C. LI. 1998, Data mining for direct marketing: problems and solutions. In Proceedings of KDD-98.
12. PAZZANI, M., C. MERZ, P. MURPHY, K. ALI, T. HUME, and C. BRUNK. 1994, Reducing misclassification costs. In Proceedings of the Eleventh International Conference on Machine Learning, New Bronswick, NJ, pp. 217-225.
13. PROVOST, F., and T. FAWCETT. 2001, Robust classification for imprecise environments. Machine Learning Journal, 42(3).
14. RIDDLE, P., R. SECAL, and O. ETZIONI. 1991: Representation design and brute-force induction in a Boeing manufacturing domain. Applied Artificial Intelligence, 8:125-147.
15. SCOTT, S., and S. MATWIN. 1999, Feature engineering for text classification. In Proceedings of the Sixteenth International Conference on Machine Learning, Bled, Slovenia, pp. 379-388.
16. SHIMSHONI, Y., and N. INTRATOR. 1998, Classifying seismic signals by integrating ensembles of neural networks. IEEE Transactions On Signal Processing, Special issue on Neural Networks 46(5):1194-1201.
17. WEISS, S., and I. KAPOULEAS. 1990, An empirical comparison of pattern recognition, neural nets and machine learning methods. In Readings in Machine Learning. Edited by J. W Shavlik and T. G. Dietterich. Morgan-Kauffman, San Maeto, CA.
18. WEISS, G., and F. PROVOST. 2003, Learning when training data are costly: the effect of class distribution on tree induction. Journal of Artificial Intelligence Research, 19: 315-354.