Self-Organizing Map Oversampling (SOMO) for imbalanced data set learning

Expert Systems with Applications

Volumn 82, Issue , 2017, Pages 40-52

  Douzas, Georgios ^a   Bacao, Fernando ^a  

^a NOVA INFORMATION MANAGEMENT SCHOOL NOVA IMS   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

CONFORMAL MAPPING;

ARTIFICIAL DATA; BETWEEN CLUSTERS; CLASS DISTRIBUTIONS; HIGH-DIMENSIONAL; IMBALANCED DATA-SETS; PERFORMANCE OF ALGORITHM; STANDARD ALGORITHMS; WITHIN CLUSTERS;

SELF ORGANIZING MAPS;

EID: 85017142343     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2017.03.073     Document Type: Article

References (54)

1. Aggarwal, C.C., Hinneburg, A., Keim, D.A., On the surprising behavior of distance metrics in high dimensional space. Database Theory – ICDT 2001 (2001), 420–434.
2. Akbani, R., Kwek, S., Japkowicz, N., Applying support vector machine to imbalanced datasets. Machine Learning: ECML 2004 (2004), 39–50.
3. Barua, S., Islam, Md.M., Yao, X., Murase, K., MWMOTE – Majority weighted minority oversampling technique for imbalanced data set learning. IEEE Transactions on Knowledge and Data Engineering 26:2 (2014), 405–425.
4. Batista, G.E., Prati, R.C., Monard, M.C., A study of the behavior of several methods for balancing machine learning training data. ACM SIGKDD Explorations Newsletter – Special Issue on Learning from Imbalanced Datasets 6:1 (2004), 20–29.
5. Bellman, R.E., Adaptive control processes: A guided tour, 28, 1961, Princeton University Press, 1–19 http://arxiv.org/abs/1302.6677.
6. Beyer, K.S., Goldstein, J., Ramakrishnan, R., Shaft, U., When is ‘nearest Neighbor’ meaningful?. Database theory—ICDT’99, 1999, 217–235.
7. Bunkhumpornpat, C., Sinapiromsaran, K., Lursinsap, C., Safe-Level-SMOTE: Safe-level-synthetic minority over-sampling technique for handling the class imbalanced problem. Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), 2009, 475–482.
8. Bunkhumpornpat, C., Sinapiromsaran, K., Lursinsap, C., DBSMOTE: Density-based synthetic minority over-sampling technique. Applied Intelligence 36:3 (2012), 664–684.
9. Chawla, N.V., Data mining for imbalanced datasets: An overview. Data Mining and Knowledge Discovery Handbook, 2010, 875–886.
10. Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P., SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research 16 (2002), 321–357.
11. Chawla, N.V., Japkowicz, N., Drive, P., Editorial : Special issue on learning from imbalanced data sets. ACM SIGKDD Explorations Newsletter 6:1 (2004), 1–6.
12. Chawla, N.V., Japkowicz, N., Kolcz, A., Workshop learning from imbalanced data sets II. Proceedings of the international conference machine learning, 2003.
13. Chawla, N.V., Lazarevic, A., Hall, L.O., Bowyer, K.W., SMOTEBoost: Improving prediction of the minority class in boosting. Proceedings of the seventh European conference on principles and practice of knowledge discovery in databases, 2003, 107–119.
14. Cieslak, D.A., Chawla, N.V., Start globally, optimize locally, predict globally: Improving performance on imbalanced data. Proceedings – IEEE international conference on data mining, ICDM, 2008, 143–152.
15. Cieslak, D.A., Chawla, N.V., Striegel, A., Combating imbalance in network intrusion datasets. IEEE International conference on granular computing, 2006, 732–737.
16. Clearwater, S.H., Stern, E.G., A rule-learning program in high energy physics event classification. Computer Physics Communications 67:2 (1991), 159–182.
17. Cottrell, M., Fort, J.C., Pagès, G., Theoretical aspects of the SOM algorithm. Neurocomputing 21:1–3 (1998), 119–138.
18. Domingos, P., MetaCost : A general method for making classifiers. Proceedings of the 5th international conference on knowledge discovery and data mining, 1999, 155–164.
19. Fernández, A., López, V., Galar, M., Jesus, M.J., Herrera, F., Analysing the classification of imbalanced data-sets with multiple classes: Binarization techniques and ad-hoc approaches. Knowledge-Based Systems 42 (2013), 97–110.
20. Friedman, J.H., Greedy function approximation: A gradient boosting machine. Annals of Statistics 29:5 (2001), 1189–1232.
21. Galar, M., Fernández, A., Barrenechea, E., Bustince, H., Herrera, F., A review on ensembles for the class imbalance problem: Bagging-, Boosting-, and Hybrid-based approaches. IEEE Transactions on Systems, Man and Cybernetics Part C 42:4 (2012), 463–484.
22. Gorban, A., Kegl, B., Wunsch, D., Zinovyen, A., Principal manifolds for data visualization and dimension reduction. 2008, Springer.
23. Graves, S.J., Asner, G.P., Martin, R.E., Anderson, C.B., Colgan, M.S., Kalantari, L., et al. Tree species abundance predictions in a tropical agricultural landscape with a supervised classification model and imbalanced data. Remote Sensing, 8(2), 2016.
24. Guo, H., Viktor, H., Learning from imbalanced data sets with boosting and data generation: The DataBoost IM Ap- proach. ACM SIGKDD Explorations Newsletter 6:1 (2004), 30–39.
25. Han, H., Wang, W., Mao, B., Borderline-SMOTE: A new over-sampling method in imbalanced data sets learning. Advances in intelligent computing 17:12 (2005), 878–887.
26. Hart, P., The condensed nearest neighbor rule. IEEE Trans. Inform. Theory 14 (1968), 515–516.
27. He, H., Bai, Y., Garcia, E., Li, S., ADASYN: Adaptive synthetic sampling approach for imbalanced learning. IEEE international joint conference on neural networks, 2008. IJCNN 2008. (IEEE world congress on computational intelligence), 2008, 1322–1328 (pp. 1322–1328).
28. He, H., Garcia, E.A., Learning from imbalanced data. IEEE Transactions on Knowledge and Data Engineering 21:9 (2009), 1263–1284.
29. Japkowicz, N., Learning from imbalanced data sets. Proceedings of the american association for artificial intelligence (AAAI) workshop, 2000.
30. Jo, T., Japkowicz, N., Class imbalances versus small disjuncts. ACM Sigkdd Explorations Newsletter 6 (2004), 40–49.
31. Kaski, S., Kohonen, T., Methods for interpreting a self-organized map in data analysis. ESANN ‘98, 6th European symposium on artificial neural neural networks, 22–24 April 1998, Brussels, Belgium (Brussels: D-Facto), 1998, 185–190.
32. Kaski, S., Lagus, K., Comparing self-organizing maps. Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), 1996, 809–814.
33. Kohonen, T., Self-organized formation of topologically correct feature maps. Biological Cybernetics 43:1 (1982), 59–69.
34. Kohonen, T., Self-organizing maps. Springer series in information sciences, 2001, 501.
35. Kotsiantis, S., Kanellopoulos, D., Panayiotis, P., Handling imbalanced datasets : A review. Science 30:1 (2006), 25–36.
36. Kubat, M., Matwin, S., Addressing the curse of imbalanced training sets: One sided selection. ICML 97 (1997), 179–186.
37. Laurikkala, J., Improving identification of difficult small classes by balancing class distribution. Artificial Intelligence in Medicine, 2001, 63–66.
38. Lemaitre, G., Nogueira, F., & Adidas, C. (2016). “Imbalanced-learn: A python toolbox to tackle the curse of imbalanced datasets in machine learning”. CoRR abs/1609.06570.
39. McCullagh, P., Generalized linear models. European Journal of Operational Reasearch 16 (1984), 285–292.
40. Meŕenyi, E., Jain, A., Villmann, T., Explicit magnification control of self-organizing maps for ‘forbidden’ data. IEEE Transactions on Neural Networks 18:3 (2007), 786–797.
41. Merenyi, E., Tasdemir, K., Zhang, L., Learning highly structured manifolds: Harnessing the power of SOMs. Springer. Similarity-Based Clustering, LNAI 5400 (2009), 138–168.
42. Nekooeimehr, I., Lai-Yuen, S.K., Adaptive semi-unsupervised weighted oversampling (A-SUWO) for imbalanced datasets. Expert Systems with Applications 46 (2016), 405–416.
43. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., et al. Scikit-learn: Machine learning in python. Journal of Machine Learning Research 12 (2011), 2825–2830.
44. Prati, R.C., Batista, G.E., Silva, D.F., Class imbalance revisited: A new experimental setup to assess the performance of treatment methods. Knowledge and Information Systems, 2014, 1–24.
45. Ritter, H., Schulten, K., Extending Kohonen's self-organizing mapping algorithm to learn ballistic movements. Neural Computers, 1988, 393–406.
46. Sarajedini, A., Chau, P.M., Cumulative distribution estimation with neural networks. WCNN’96, 1996, 876–880.
47. Sun, Z., Song, Q., Zhu, X., Sun, H., Xu, B., Zhou, Y., A novel ensemble method for classifying imbalanced data. Pattern Recognition 48 (2015), 1623–1637.
48. Tang, B., He, H., KernelADASYN: Kernel based adaptive synthetic data generation for imbalanced learning. IEEE Congress on Evolutionary Computation (CEC), 2015.
49. Ting, K.M., An instance-weighting method to induce cost-sensitive trees. IEEE Transactions on Knowledge and Data Engineering 14:3 (2002), 659–665.
50. Tomek, I., Two modifications of CNN. IEEE Transactions on Systems, Man and Cybernetics 6 (1976), 769–772.
51. Verbeke, W., Dejaeger, K., Martens, D., Hur, J., Baesens, B., New insights into churn prediction in the telecommunication sector: A profit driven data mining approach. European Journal of Operational Research 218:1 (2012), 211–229.
52. Wang, S., Minku, L.L., Yao, X., Resampling-based ensemble methods for online class imbalance learning. IEEE Trans. Knowledge Data Eng. 27:5 (2015), 1356–1368.
53. Wilson, D.L., Asymptotic properties of nearest neighbor rules using edited data. IEEE Transactions on Systems, Man and Cybernetics 2:3 (1972), 408–421.
54. Zhao, X.M., Li, X., Chen, L., Aihara, K., Protein classification with imbalanced data. Proteins: Structure, Function and Genetics 70:4 (2008), 1125–1132.