A measure optimized cost-sensitive learning framework for imbalanced data classification

Biologically-Inspired Techniques for Knowledge Discovery and Data Mining

Volumn , Issue , 2014, Pages 48-75

  Cao, Peng ^a,b   Zaiane, Osmar ^b   Zhao, Dazhe ^c  

^a NORTHEASTERN UNIVERSITY   (China)

^b UNIVERSITY OF ALBERTA   (Canada)

^c NORTHEASTERN UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COSTS; EDUCATION; PARTICLE SWARM OPTIMIZATION (PSO);

BENCHMARK DATASETS; COST-SENSITIVE LEARNING; EVALUATION MEASURES; INTRINSIC PARAMETERS; MISCLASSIFICATION COSTS; OBJECTIVE FUNCTIONS; REAL-WORLD PROBLEM; SAMPLING TECHNIQUE;

PROBLEM SOLVING;

EID: 84946124449     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-4666-6078-6.ch003     Document Type: Chapter

References (46)

1. Akbani, R., Kwek, S., & Japkowicz, N. (2004). Applying support vector machines to imbalanced datasets. In Proceedings of the 2004 European conference on machine learning (pp. 39-50). Pisa, Italy: Academic Press.
2. Barua, S., Monirul Islam, M., Yao, X., & Murase, K. (2013). MWMOTE: Majority weighted minority oversampling technique for imbalanced data set learning. IEEE Transactions on Knowledge and Data Engineering.
3. Blagus, R. (2013). Improved shrunken centroid classifiers for high-dimensional class-imbalanced data. BMC Bioinformatics, 14(1), 64-76. doi:10.1186/1471-2105-14-64 PMID:23433084
4. Carlisle, A., & Dozier, G. (2001). an off-the-shelf PSO. In Proceedings of Particle Swarm Optimization Workshop (pp. 1-6). Academic Press.
5. Carvalho, M., & Ludermir, T. B. (2007). Particle swarm optimization of neural network architectures and weights. In Proceedings of the 7th international conference on hybrid intelligent systems (pp. 336-339). Kaiserlautern, Australia:Academic Press.
6. Cervantes, A., Galván, O. M., & Isasi, P. (2009). AMPSO: A new particle swarm method for nearest neighborhood classification. IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics, 39(5), 1082-1091. doi:10.1109/ TSMCB.2008.2011816 PMID:19336325
7. Chávez, M. C., Casas, G., Falcón, R., Moreira, J. E., & Grau, R. (2007). Building fine bayesian networks aided by PSO-based feature selection. In Proceedings of Advances in Artificial Intelligence (pp. 441-451). Academic Press. doi:10.1007/978-3-540-76631-5_42
8. Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002). SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 16, 321-357.
9. Chawla, N. V., Cieslak, D. A., Hall, L. O., & Joshi, A. (2008). Automatically countering imbalance and its empirical relationship to cost. Data Mining and Knowledge Discovery, 17(2), 225-252. doi:10.1007/s10618-008-0087-0
10. Chawla, N. V., Japkowicz, N., & Kolcz, A. (2004). Editorial: special issue on learning from imbalanced data sets. SIGKDD Explorations, 6(1), 1-6. doi:10.1145/1007730.1007733
11. Chawla, N. V., Lazarevic, A., Hall, L. O., & Bowyer, K. W. (2003). SMOTEBoost: Improving prediction of the minority class in boosting. In Proceedings of the Seventh European conference Principles and Practice of Knowledge Discovery in Databases (pp. 107-119). Cavtat-Dubrovnik, Croatia: Academic Press.
12. Chawla, N. V., & Sylvester, J. (2007). Exploiting diversity in ensembles: Improving the performance on unbalanced datasets. In Proceedings of the 7th International Workshop on Multiple Classifier Systems (pp. 397-406). Prague, Czech Republic:Academic Press.
13. Chris, S., Taghi, M. K., Jason, V. H., & Amri, N. (2008). A comparative study of data sampling and cost sensitive learning. In Proceedings of IEEE International Conference on Data Mining Workshops. Pisa, Italy: IEEE.
14. Galar, M., Fernández, A., Barrenechea, E., & Herrera, F. (2013). Eusboost: Enhancing Ensembles for Highly Imbalanced Data-sets by Evolutionary Undersampling. Pattern Recognition. doi:10.1016/j.patcog.2013.05.006
15. Gao, M., Hong, X., Chen, S., & Harris, C. J. (2011). A combined SMOTE and PSO based RBF classifier for two-class imbalanced problems. Neurocomputing, 74, 3456-3466. doi:10.1016/j. neucom.2011.06.010
16. Hassan, R., Cohanim, R., & De Weck, O. (2005). A comparison of particle swarm optimization and the genetic algorithm. In Proceedings of the 46th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference. Austin, TX: AIAA.
17. He, H., & Garcia, E. A. (2009). Learning from imbalanced data. IEEE Transactions on Knowledge and Data Engineering, 21(9), 1263-1284. doi:10.1109/TKDE.2008.239
18. He, H., & Ma, Y. (2013). Imbalanced Learning:Foundations, Algorithms, and Applications. Wiley-IEEE.
19. Hsu, C.W., Chang, C.C., & Lin, C.J. (2003). A Practical Guide to Support vector Classification. National Taiwan University Technical Report.
20. Kennedy, J., & Eberhart, R. C. (1995). Particle swarm optimization. In Proceedings of IEEE International Conference on Neural Networks (pp.1942-1948). Nedlands, Australia: IEEE.
21. Khanesar, M. A., Teshnehlab, M., & Shoorehdeli, M. A. (2007). A novel binary particle swarm optimization. In Proceedings of Mediterranean Conference on Control & Automation (pp. 1-6). Athens, Greece: Academic Press.
22. Klement, W., Wilk, S., Michaowski, W., & Matwin, S. (2009). Dealing with Severely Imbalanced Data. In Proceedings of Workshop on Data Mining When Classes are Imbalanced and Errors Have Costs, PAKDD. Bangkok, Thailand: PAKDD.
23. Kotsiantis, S., Kanellopoulos, D., & Pintelas, P. (2006). Handling imbalanced datasets: A review. GESTS International Transactions on Computer Science and Engineering, 30(1), 25-36.
24. Kubat, M., & Matwin, S. (1997). Addressing the Curse of Imbalanced Training Sets: One-Sided Selection. In Proceedings of the 14th International Conference on Machine Learning (vol. 97, pp. 179-186). Academic Press.
25. Kukar, M., & Kononenko, I. (1998). Cost-sensitive learning with neural networks. In Proceedings of European Conference on Artificial Intelligence (pp.445-449). Brighton, UK: Academic Press.
26. Li, N., Tsang, I., & Zhou, Z. (2013). Efficient Optimization of Performance Measures by Classifier Adaptation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(6), 1370-1382. doi:10.1109/TPAMI.2012.172 PMID:22868653
27. Li, Q. (2007). Recent progress in computer-aided diagnosis of lung nodules on thin-section CT. Computerized Medical Imaging and Graphics, 31, 248-257. doi:10.1016/j.compmedimag.2007.02.005 PMID:17369020
28. Ling, C. X., Huang, J., & Zhang, H. (2003). AUC:A Statistical Consistent and More Discriminating Measure than Accuracy. In Proceedings of the 18th International Conference on Artificial Intelligence (pp. 329-341). Acapulco, Mexico:Academic Press.
29. Ling, C. X., & Sheng, V. S. (2008). Cost-sensitive learning and the class imbalance problem. In Encyclopedia of Machine Learning (pp. 231-235). Academic Press.
30. Maloof, M. A. (2003). Learning when data sets are imbalanced and when costs are unequal and unknown. In Proceedings of International Conference on Machine Learning Workshop on Learning from Imbalanced Data Sets. Melbourne, FL:Academic Press.
31. Martens, D., Baesens, B., & Fawcett, T. (2011). Editorial Survey: Swarm Intelligence for Data Mining. Machine Learning, 82(1), 1-42. doi:10.1007/s10994-010-5216-5
32. Mazurowski, M. A., Habas, P. A., Zurada, J. M., Lo, J. Y., Baker, J. A., & Tourassi, G. D. (2008). Training neural network classifiers for medical decision making: The effects of imbalanced datasets on classification performance. Neural Networks, 21, 427-436. doi:10.1016/j.neunet.2007.12.031 PMID:18272329
33. Nabavi-Kerizi, S. H., Abadi, M., & Kabir, E. (2010). A PSO-based weighting method for linear combination of neural networks. Computers & Electrical Engineering, 36(5), 886-894. doi:10.1016/j.compeleceng.2008.04.006
34. Rao, R. B., Fung, G., Krishnapuram, B., Bi, J., Dundar, M., & Raykar, V.... Stoeckel, J. (2009). Mining medical images. In Proceedings of the Third Workshop on Data Mining Case Studies and Practice Prize, Fifteenth Annual SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2009). Paris, France: ACM.
35. Sousa, T., Silva, A., & Neves, A. (2004). Particle swarm based data mining algorithms for classification tasks. Parallel Computing, 30(5-6), 767-783. doi:10.1016/j.parco.2003.12.015
36. Tang, K., Wang, R., & Chen, T. (2011). Towards maximizing the area under the ROC Curve for multi-class classification problems. In Proceedings of the 25th AAAI Conference on Artificial Intelligence (pp. 483-488). San Francisco, CA:AAAI.
37. Van Hulse, J., Khoshgoftaar, T. M., Napolitano, A., & Wald, R. (2009). Feature selection with high dimensional imbalanced data. In Proceedings of the 9th IEEE International Conference on Data Mining Workshops (pp. 507-514). Miami, FL: IEEE.
38. Veropoulos, K., Campbell, C., & Cristianini, N. (1999). Controlling the sensitivity of support vector machines. In Proceedings of the international joint conference on artificial intelligence (pp. 55-60). Stockholm, Sweden: Academic Press.
39. Weiss, G., McCarthy, K., & Zabar, B. (2007). Cost-sensitive learning vs. sampling: Which is best for handling unbalanced classes with unequal error costs? In Proceedings of the 2007 International Conference on Data Mining (pp. 35-41). CSREA Press.
40. Yang, Q., & Wu, X. (2006). 10 challenging problems in data mining research. International Journal of Information Technology & Decision Making, 5(4), 597-604. doi:10.1142/S0219622006002258
41. Yang, X., Zheng, Y., Siddique, M., & Beddoe, G. (2008). Learning from imbalanced data: a comparative study for colon CAD. In Proceedings of the Medical Imaging (Vol. 6915). Academic Press.
42. Yu, H., Ni, J., & Zhao, J. (2013). ACOSampling:An ant colony optimization-based undersampling method for classifying imbalanced DNA microarray data. Neurocomputing, 101, 309-318. doi:10.1016/j.neucom.2012.08.018
43. Yuan, B., & Liu, W. H. (2011). A Measure Oriented Training Scheme for Imbalanced Classification Problems. In Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining Workshop on Biologically Inspired Techniques for Data Mining (pp. 293-303). Shenzhen, China: Academic Press.
44. Yuan, B., & Ma, X. (2012). Sampling + Reweighting:Boosting the Performance of AdaBoost on Imbalanced Datasets. In Proceedings of the 2012 International Joint Conference on Neural Networks (pp. 2680-2685). Brisbane, Australia:Academic Press.
45. Zheng, Z., Wu, X., & Srihari, R. (2004). Feature selection for text categorization on imbalanced data. ACM SIGKDD Explorations, 6(1), 80-89. doi:10.1145/1007730.1007741
46. Zhou, Z. H., & Liu, X. Y. (2006). Training Cost-Sensitive Neural Networks with Methods Addressing the Class Imbalance Problem. IEEE Transactions on Knowledge and Data Engineering, 18(1), 63-77. doi:10.1109/TKDE.2006.17