Roughly balanced bagging for imbalanced data

Society for Industrial and Applied Mathematics - 8th SIAM International Conference on Data Mining 2008, Proceedings in Applied Mathematics 130

Volumn 1, Issue , 2008, Pages 143-152

  Hido, Shohei ^a   Kashima, Hisashi ^a  

^a IBM RESEARCH   (United States)

Author keywords

Bagging; Imbalanced data; Negative binomial distribution; Sampling

Indexed keywords

SAMPLING;

BAGGING; CLASSIFICATION LEARNING; IMBALANCED CLASS; IMBALANCED DATA; NEGATIVE BINOMIAL DISTRIBUTION; NUMBER OF SAMPLES; REAL APPLICATIONS; SKEWED CLASS DISTRIBUTIONS;

DATA MINING;

EID: 52649160312     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1137/1.9781611972788.13     Document Type: Conference Paper

References (22)

1. G. Batista, R. C. Prati, and M. C. Monard. A study of the behavior of several methods for balancing machine learning training data. SIGKDD Explorations Newsletter, 6(1):20-29, 2004.
2. L. Breiman. Bagging predictors. Machine Learning, 24(2):123-140, 1996.
3. L. Breiman. Random forests. Machine Learning, 45(1):5-32, 2001.
4. N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer. SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence and Research, 16:321-357, 2002.
5. N. V. Chawla, N. Japkowicz, and A. Kotcz. Editorial: special issue on learning from imbalanced data sets. SIGKDD Explorations Newsletter, 6(1):1-6, 2004.
6. N. V. Chawla, A. Lazarevic, L. O. Hall, and K. W. Bowyer. SMOTEBoost: Improving prediction of the minority class in boosting. In Proceedings of the Seventh European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD), pages 107-119, 2003.
7. C. Chen, A. Liaw, and L. Breiman, Using random forest to learn imbalanced data. Technical report, Department of Statistics, University of California, Berkeley, 2004.
8. W. W. Cohen. Fast effective rule induction. In Proceedings of the Twelfth International Conference on Machine Learning (ICML), pages 115-123, 1995.
9. P. Domingos. Metacost: A general method for making classifiers cost-sensitive, In Knowledge Discovery and Data Mining, pages 155-164, 1999.
10. W. Fan, E. Greengrass, J. McCloskey, P. S. Yu, and K. Drummey. Effective estimation of posterior probabilities: Explaining the accuracy of randomized decision tree approaches. In Proceedings of the Fifth IEEE International Conference on Data Mining (ICDM), pages 154-161, 2005.
11. W. Fan, S. J. Stolfo, J. Zhang, and P. K. Chan. AdaCost: misclassification cost-sensitive boosting. In Proceedings of the Sixth International Conference on Machine Learning (ICML), pages 97-105, 1999.
12. Y. Freund and R. E, Schapire. Experiments with a new boosting algorithm. In Proceedings of the Thirteenth International Conference on Machine Learning (ICML), pages 148-156, 1996.
13. J. Friedman and P. Hall. On bagging and nonlinear estimation, available at http://www-stat.stanford.edu/~jhf/, 2000.
14. J. Gao, W. Fan, J. Han, and P. S. Yu. A general framework for mining concept-drifting data streams with skewed distributions. In Proceedings of the Seventh SIAM International Conference on Data Mining (SDM), 2007.
15. H. Guo and H. L. Viktor. Learning from imbalanced data sets with boosting and data generation: the DataBoost-IM approach. SIGKDD Explorations Newsletter, 6(1):30-39, 2004.
16. M. Kubat and S. Matwin. Addressing the curse of imbalanced training sets: one-sided selection. In Proceedings of the Fourteenth International Conference on Machine Learning (ICML), pages 179-186, 1997.
17. D. Newman, S. Hettich, C. Blake, and C. Merz. UCI repository of machine learning databases, 1998.
18. J. R. Quinlan. C4.5: programs for machine learning. Morgan Kaufmann, 1993.
19. R Development Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, 2005.
20. D. Tao, X. Tang, X. Li, and X. Wu. Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(7): 1088-1099, 2006.
21. I. H. Witten and E. Frank. Data Mining: Practical Machine Learning Tools. Elsevier, 2005.
22. B. Zadrozny, J. Langford, and N. Abe. Cost-sensitive learning by cost-proportionate example weighting. In Proceedings of the Third IEEE International Conference on Data Mining (ICDM), page 435, 2003.