Learning imbalanced data sets with a min-max modular support vector machine

IEEE International Conference on Neural Networks - Conference Proceedings

Volumn , Issue , 2007, Pages 1673-1678

  Ye, Zhi Fei ^b   Lu, Bao Liang ^a,b  

^a IEEE

^b SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); COMPUTER NETWORKS; EDUCATION; IMAGE RETRIEVAL; SAMPLING; SUPPORT VECTOR MACHINES; VECTORS;

CLASS IMBALANCE PROBLEMS; RE-SAMPLING; TASK DECOMPOSITION;

LEARNING SYSTEMS;

EID: 51749094851     PISSN: 10987576     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2007.4371209     Document Type: Conference Paper

References (28)

1. P. K. Chan and S. J. Stolfo, "Toward scalable learning withnon-uniform class and cost distributions: a case study in credit card fraud detection," Proc. 4th International Conference on Knowledge Discovery and Data Mining, 1998, pp. 164-168.
2. M. Kubat, R. C. Holte, and S. Matwin, "Machine learning for the detection of oil spills in satellite radar images," Machine Learning, vol. 30, pp. 195-215, Feb./Mar. 1998.
3. M. A. Maloof, "Learning when data sets are imbalanced and when costs are unequal and unknown," Proc. Workshop on Learning from Imbalanced Data Sets II, International Conference on Machine Learning, 2003.
4. K. J. Park and M. Kanehisa, "Prediction of protein subcellular locations by support vector machines using compositions of amino acids and amino acid pairs" Bioinformatics, vol. 19, pp. 1656-1663, 2003.
5. C. Drummond, and R. C. Holte, "C4.5, class imbalance, and cost sensitivity: why under-sampling beats over-sampling," Proc. Workshop on Learning from Imbalanced Data Sets II, International Conference on Machine Learning, 2003.
6. N. V. Chawla, A. Lazarevic, L. O. Hall, and W. P. Kegelmeyer, "SMOTE: Synthetic Minority Over-sampling Technique," Journal of Artificial Intelligence Research, vol. 16, pp. 321-357, 2002.
7. M. Kubat and S. Matwin, "Addressing the curse of imbalanced training sets: one-sided selection," Proc. 14th International Conference on Machine Learning, 1997, pp. 179-186.
8. B. Raskutti and A. Kowalczyk, "Extreme re-balancing for SVM's: a case study," Proc. Workshop on Learning from Imbalanced Data Sets II, International Conference on Machine Learning, 2003.
9. R. Yan, Y. Liu, R. Jin, and A. Hauptmann, "On predicting rare classes with SVM ensembles in scene classification," Proc. IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 3, pp. 21-24, 2003.
10. C. Cardie and N. Howe, "Improving minority class prediction using case-specific feature weights," Proc. 14th International Conference on Machine Learning, 1997, pp. 57-65.
11. K. Veropoulos, C. Campbell, and N. Cristianini, "Controlling the sensitivity of Support Vector Machines," Proc. International Joint Conference on Artificial Intelligence, 1999, pp. 55-60.
12. M. Pazzani, C. Merz, P.Murphy, K. Ali, T. Hume, and C. Brunk, "Reducing misclassification costs," Proc. 11th International Conference on Machine Learning, 1994, pp. 217-225.
13. C. Elkan, "The foundations of cost-sensitive learning," Proc. 7th International Conference on Machine Learning, 2001, pp. 239-246.
14. Z. H. Zhou, and X. Y. Liu, "Training cost-sensitive neural networks with methods addressing the class imbalance problem," IEEE Transaction on Knowledge and Data Engineering, vol. 18(1), pp. 63-77, Jan. 2006.
15. Y. Liu, A. An, and X. Huang, "Boosting prediction accuracy on imbalanced datasets with SVM Ensembles," Proc. Advances in Knowledge Discovery and Data Mining, 10th Pacific-Asia Conference, 2006, pp. 107-118.
16. R. E. Schapire, "A brief introduction to boosting," Proc. 6th International Joint Conference on Artificial Intelligence, 1999, pp. 1401-1406.
17. W.Fan, S. J. Stolfo, J. Zhang, and P. K. Chan, "AdaCost: misclassification cost-sensitive boosting," Proc. 6th International Conference on Machine Learning, 1999, pp. 99-105.
18. B. L. Lu, and M. Ito, "Task decomposition and module combination based on class relations: A modular neural network for pattern classification," IEEE Transactions on Neural Networks, vol. 10(5), pp. 1244-1256 Sep. 1999.
19. B. L. Lu, K. A. Wang, M. Utiyama, and H. Isahara, "A part-versus-part method for massively parallel training of support vector machines," Proc. IEEE International Joint Conference on Neural Networks, 2004, pp. 735-740.
20. K. Chen, B. L. Lu and J. T. Kwok, "Efficient classification of multi-label and imbalanced data using Min-max Modular classifiers," Proc. IEEE International Joint Conference on Neural Networks, 2006, pp. 1770-1775.
21. I. T. Jolliffe, Principle Component Analysis, New York: Springer, 1986.
22. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, Second Edition, John Wiley & Sons. Inc. 2001.
23. Z. G. Fan, and B. L. Lu, "Fast recognition of multi-view faces with feature selection," Proc. IEEE International Conference on Computer Vision, 2005, pp. 76-81.
24. J. Kittler, M. Hatef, R. P. W. Duin, and J. Mata, "On Combining Classifiers," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20(3), pp. 226-239, Mar. 1998.
25. See5 and C5.0, http://www.rulequest.com/see5-info.html.
26. C. C. Chang, and C. J. Lin, "LIBSVM - A Library for Support Vector Machines," http://www.csie.ntu.edu.tw/~cjlin/libsvm/
27. A. Bradley, "The use of the area under the ROC curve in the evaluation of machine learning algorithms," Pattern Recognition, vol. 30(7), pp. 1145-1159, 1997.
28. N. V. Chawla, N. Japkowicz, and A. Kolcz, "Editorial: Special Issue on Learning from Imbalanced Data Sets," SIGKDD Explorations, vol. 6(1), pp. 1-6, 2004.