A data complexity analysis on imbalanced datasets and an alternative imbalance recovering strategy

Proceedings - 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings), WI'06

Volumn , Issue , 2006, Pages 270-276

  Weng, Cheng G ^a   Poon, Josiah ^a  

^a UNIVERSITY OF SYDNEY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

DATA STRUCTURES; SEARCH ENGINES;

DATASET PROBLEM; IMBALANCE DATASETS;

WEBSITES;

EID: 42549139271     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WI.2006.9     Document Type: Conference Paper

References (18)

1. R. Akbani, S. Kwek, and N. Japkowicz. Applying support vector machines to unbalanced datasets. In Lecture Notes in Computer Science, volume 3201, pages 39-50, 2004.
2. Gustavo E. A. P. A. Batista, Ronaldo C. Prati, and Maria Carolina Monard. A study of the behavior of several methods for balancing machine learning training data. SIGKDD Explor. Newsl., 6(1):20-29, 2004.
3. Nitesh V. Chawla. C4.5 and unbalanced Data sets: Investigating the effect of sampling method, probabilistic estimate, and decision tree structure. In Workshop on Learning from Imbalanced Datasets (ICML'03), 2003.
4. N.V. Chawla, K.W. Bowyer, L.O. Hall, and W.P. Kegelmeyer. SMOTE: Synthetic Minority Over-sampling TEchnique. In Journal of Artificial Intelligence Research, volume 16, pages 321-357, 2002.
5. C. Chen, A. Liaw, and L. Breiman. Using random forest to learn unbalanced data. Technical Report Technical report 666, Statistics Department, University of California at Berkeley, 2004.
6. J. Chen, H. He, J. Li, H. Jin, D. McAullay, G. Williams, R. Sparks, and C. Kelman. Representing association classification rules mined from health data. In International Conference on Knowledge-Based & Intelligent Information & Engineering Systems, 2005.
7. Hugo Sax Gilles Cohen, Melanie Hilario and Stephane Hugonnet. Data Imbalance in Surveillance of Nosocomial Infections. In Lecture Notes in Computer Science, volume 2868, pages 109-117, 2003.
8. Hongyu Guo and Herna L. Viktor. Learning from imbalanced data sets with boosting and data generation: the DataBoost-IM approach. SIGKDD Explor. Newsl., 6(1):30-39, 2004.
9. T.K. Ho. A Data Complexity Analysis of Comparative Advantages of Decision Forest Constructors. In Pattern Analysis and Applications, pages 102-112, 2002.
10. A. Hoekstra and R. Duin. The nonlinearity of pattern classifiers. In Proc. of the 13th ICPR, pages 271-275, 1996.
11. Taeho Jo and Nathalie Japkowicz. Class imbalances versus small disjuncts. SIGKDD Explor. Newsl., 6(1):40-49, 2004.
12. M. Kubat and S. Matwin. Addressing the curse of unbalanced training sets: one-sided selection. In XIV International Conference on Machine Learning, pages 179-186, 1997.
13. F. Lebourgeois and H. Emptoz. Pretopological approach for supervised learning. In Proceedings 13th International Conference on Pattern Recognition, pages 256-260, 1996.
14. Foster Provost. Machine Learning from unbalanced Data Sets 101. In AAAI Workshop on Learning from Imbalanced Data Sets. AAAI Press, 2000.
15. Fabrizio Sebastiani. Machine learning in automated text categorization. ACM Computing Surveys, 34(1): 1-47, 2002.
16. I. Tomek. Two modifications of cnn. In IEEE Transactions on Systems Man and Communications, volume SMC-6, pages 769-772, 1976.
17. Sarah Zelikovitz and Haym Hirsh. Improving Short Text Classification Using Unlabeled Background Knowledge. In In Proceedings of the Seventeenth International Conference on Machine Learning, 2000.
18. Jianping Zhang and Inderjeet Mani. kNN Approach to Unbalanced Data Distributions: A Case Study involving Information Extraction. In Workshop on Learning from Imbalanced Datasets (ICML'03), 2003.