Margin calibration in SVM class-imbalanced learning

Neurocomputing

Volumn 73, Issue 1-3, 2009, Pages 397-411

  Yang, Chan Yun ^a   Yang, Jr Syu ^b   Wang, Jian Jun ^c  

^a TECHNOLOGY AND SCIENCE INSTITUTE OF NORTHERN TAIWAN   (Taiwan)

^b TAMKANG UNIVERSITY   (Taiwan)

^c SOUTHWEST UNIVERSITY   (China)

Author keywords

Class imbalanced learning; Classification; Cost sensitive learning; Margin; Support vector machines

Indexed keywords

CLASS-IMBALANCED LEARNING; CLASSIFICATION; COST-SENSITIVE; COST-SENSITIVE LEARNING; DECISION BOUNDARY; EXPERIMENTAL VALIDATIONS; FUTURE APPLICATIONS; IMBALANCED CLASS; IMBALANCED DATASET; LOSS FUNCTIONS; MACHINE-LEARNING; MARGIN; OPTIMAL PERFORMANCE; PRACTICAL ISSUES; RECEIVER OPERATING CHARACTERISTIC CURVES; REFERENCE MODELS;

MODELS; SUPPORT VECTOR MACHINES;

EDUCATION;

ACCURACY; AREA UNDER THE CURVE; ARTICLE; CALIBRATION; CLASSIFICATION; CONTROLLED STUDY; DECISION MAKING; LEARNING; MACHINE LEARNING; MATHEMATICAL COMPUTING; PRIORITY JOURNAL; PROBLEM SOLVING; RECEIVER OPERATING CHARACTERISTIC; SUPPORT VECTOR MACHINE;

EID: 70350728414     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2009.08.006     Document Type: Article

References (45)

1. Provost F. Machine learning from imbalanced data sets. In: Japkowicz N., and Holte R. (Eds). Invited Paper for the AAAI'2000 Workshop on Imbalanced Data Sets (2000), AAAI Press, Austin, TX
2. In: Chawla N.V., Japkowicz N., and Kotcz A. (Eds). Editorial: special issue on learning from imbalanced data sets. SIKDD Explorations Newsletters 6 1 (2004) 1-6
3. Weiss G.M. Mining with rarity: a unifying framework. Newsletter of the ACM Special Interest Group on Knowledge Discovery and Data Mining 6 1 (2004) 7-19
4. S. Visa, A. Ralescu, Issues in mining imbalanced data sets-a review paper, in: MAICS-2005: Proceedings of the 16th Midwest Artificial Intelligence and Cognitive Science Conference, Dayton, OH, 2005, pp. 67-73.
5. Domingos P. MetaCost: a general method for making classifiers cost sensitive. ACM SIGKDD: Proceedings of the Fifth International Conference on Knowledge Discovery and Data Mining (1999), ACM Press, New York 155-164
6. Elkan C. The foundations of cost-sensitive learning. In: Nebel B. (Ed). Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence (2001), Morgan Kaufmann, San Fransisco 973-978
7. Ting K.M. An instance-weighting method to induce cost-sensitive trees. IEEE Transactions on Knowledge and Data Engineering 14 3 (2002) 659-665
8. Vapnik V.N. The Nature of Statistical Learning Theory (1995), Springer, New York
9. Vapnik V.N. Statistical Learning Theory (1998), Wiley, New York
10. Cristianini N., and Shawe-Taylor J. An Introduction to Support Vector Machines (2000), Cambridge University Press, UK
11. Schülkopf B., and Smola A.J. Learning with Kernels (2002), MIT Press, Cambridge, MA
12. C.-C. Chang, C.-J. Lin, LIBSVM: a library for support vector machines, Department of Computer Science, National Taiwan University, 2000 〈http://www.csie.ntu.edu.tw/∼cjlin/libsvm〉.
13. Burges C.J.C. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 2 2 (1998) 121-167
14. Dehmeshki J., Chen J., Casique M.V., and Karakoy M. Classification of lung data by sampling and support vector machine. IEMBS'04: Proceedings of 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol. 2 (2004), IEEE Press, San Francisco, USA 3194-3197
15. Fu Y., Sun R., Yang Q., He S., Wang C., Wang H., Shan S., Liu J., and Gao W. A block-based support vector machine approach to the protein homology prediction task in KDD cup. ACM SIGKDD Explorations Newsletter 6 2 (2004) 120-124
16. S. Lessmann, Solving imbalanced classification problems with support vector machines, in: IC-AI'04: Proceedings of the International Conference on Artificial Intelligence, vol. 1, Las Vegas, USA, 2004, pp. 214-220.
17. Akbani R., Kwek S., and Japkowicz N. Applying support vector machines to imbalanced datasets. In: Boulicaut J.-F., Esposito F., Giannotti F., and Pedreschi D. (Eds). Lecture Notes in Computer Science, ECML: Proceedings of 15th European Conference on Machine Learning vol. 3201 (2004), Springer, Pisa, Italy 39-50
18. Chawla N., Bowyer K., Hall L., and Kegelmeyer P. SMOTE: synthetic minority over-sampling technique. Journal of Artificial Intelligence Research 16 (2002) 321-357
19. Veropoulos K., Campbell C., and Cristianini N. Controlling the sensitivity of support vector machines. In: Dean T. (Ed). IJCAI: Proceedings of International Joint Conference on Artificial Intelligence (1999), Morgan Kaufmann, Stockholm, Sweden 55-60
20. Ertekin S., Huang J., and Giles C.L. Active learning for class imbalance problem. Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (2007), Amsterdam, Holland 823-824
21. Chen X.W., Gerlach B., and Casasent D. Pruning support vectors for imbalanced data classification. IJCNN05: Proceedings of International Joint Conference on Neural Networks (2005), IEEE Press, Montreal, Canada 1883-1888
22. Wu S., and Amari S. Conformal transformation of kernel functions: a data-dependent way to improve support vector machine classifiers. Neural Processing Letters 15 (2002) 59-67
23. Wu G., and Chang E.Y. KBA: kernel boundary alignment considering imbalanced data distribution. IEEE Transactions on Knowledge and Data Engineering 17 6 (2005) 786-795
24. Cohen G., Hilario M., and Pellegrini C. One-class support vector machines with a conformal kernel-a case study in handling class imbalance. In: Fred A., Caelli T., Duin R.P.W., Campilho A., and Ridder D.D. (Eds). Lecture Notes in Computer Science, SSPR/SPR'04: Proceedings of Joint IAPR International Workshops on Structural, Syntactic, and Statistical Pattern Recognition vol. 3138 (2004), Springer, Lisbon, Portugal 850-858
25. Campadelli P., Casiraghi E., and Valentini G. Support vector machines for candidate nodules classification. Neurocomputing 68 (2005) 281-289
26. Lee K.K., Gunn S.R., Harris C.J., and Reed P.A.S. Classification of imbalanced data with transparent kernels. Proceedings of INNS-IEEE International Joint Conference on Neural Networks (2001), IEEE Press, Washington, DC 2410-2415
27. β support vector machines, in: Proceedings of International Joint Conference on Neural Networks, Montreal, Quebec, Canada, 2005, pp. 1443-1448.
28. Shin H., and Cho S.B. Response modeling with support vector machines. Expert Systems with Applications 30 4 (2006) 746-760
29. Karakoulas G.J., and Shawe-Taylor J. Optimizing classifiers for imbalanced training sets. In: Kearns M.S., Solla S.A., and Cohn D.A. (Eds). Advances in Neural Information Processing Systems II, NIPS'98: Proceedings of Neural Information Processing Workshop (1999), MIT Press, Cambridge, MA 253-259
30. Cortes C., and Vapnik V.N. Support vector networks. Machine Learning 20 (1995) 273-297
31. Yang C.-Y. Highlighting heterogeneous samples to support vector machines' training. Neurocomputing 72 (2008) 218-230
32. Lin Y. A note on margin-based loss functions in classification. Statistics and Probability Letters 68 1 (2004) 73-82
33. Zhang T. Statistical behavior and consistency of classification methods based on convex risk minimization. The Annals of Statistics 32 (2004) 56-85
34. P.L. Bartlett, M.I. Jordan, J.D. McAuliffe, Convexity, classification, and risk bounds, Technical Report 638, Department of Statistics, UC Berkeley, CA, 2003.
35. Steinwart I. Consistency of support vector machines and other regularized kernel classifiers. IEEE Transactions on Information Theory 51 1 (2005) 128-142
36. Steinwart I. How to compare different loss functions and their risks. Constructive Approximation 26 2 (2007) 225-287
37. Lin C.-F., and Wang S.-D. Fuzzy support vector machines. IEEE Transactions on Neural Network 13 2 (2002) 464-471
38. C.E. Rasmussen, R.M. Neal, G.E. Hinton, D. van Camp, M, Revow, Z. Ghahramani, R. Kustra, R. Tibshirani, Delve: data for evaluating learning in valid experiments, The University of Toronto, Canada, 1996 〈http://www.cs.utoronto.ca/∼delve/〉.
39. A. Asuncion, D.J. Newman, UCI Machine Learning Repository. University of California, Irvine, CA, School of Information and Computer Science, 2007 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉.
40. Yang C.-Y., and Chou J.-J. Modeling the rotifer classifier with non-parametric hybrid KNN rules-a comparative evaluation approach. Image and Vision Computing 23 4 (2005) 427-439
41. Hanley J.A., and McNeil B.J. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143 (1982) 29-36
42. Fawcett T. An introduction to ROC analysis. Pattern Recognition Letters 27 8 (2006) 861-874
43. Tao Q., Wu G.-W., Wang F.-Y., and Wang J. Posterior probability support vector machines for unbalanced data. IEEE Transactions on Neural Networks 16 6 (2005) 1561-1573
44. Gonen M., Tanugur A.G., and Alpaydin E. Multiclass posterior probability support vector machines. IEEE Transactions on Neural Networks 19 1 (2008) 130-139
45. Michalewicz Z. Genetic Algorithms+Data Structures=Evolution Programs, 1994. Third revised and extended edition (1999), Springer, New York