Training deep neural networks on imbalanced data sets

Proceedings of the International Joint Conference on Neural Networks

Volumn 2016-October, Issue , 2016, Pages 4368-4374

  Wang, Shoujin ^a   Liu, Wei ^a   Wu, Jia ^a   Cao, Longbing ^a   Meng, Qinxue ^a   Kennedy, Paul J ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Data imbalance; Deep neural network; Loss function

Indexed keywords

COMPUTER VISION; ERRORS; NATURAL LANGUAGE PROCESSING SYSTEMS; PATTERN RECOGNITION;

CLASSIFICATION ERRORS; CLASSIFICATION TASKS; CONVENTIONAL METHODS; DATA IMBALANCE; DEEP NEURAL NETWORKS; IMBALANCED DATA-SETS; LOSS FUNCTIONS; NATURAL LANGUAGE PROCESSING;

CLASSIFICATION (OF INFORMATION);

EID: 85007256381     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2016.7727770     Document Type: Conference Paper

References (24)

1. N. V. Chawla, N. Japkowicz and A. Kotcz, Editorial: special issue on learning from imbalanced data sets, ACM SIGKDD Explorations Newsletter vol. 6(1), pp. 1-6, 2004.
2. J. Wu, S. Pan, X. Zhu, Z. Cai, "Boosting For Multi-Graph Classification", IEEE Trans. Cybernetics, vol. 45(3), pp. 430-443, 2015.
3. J. Wu, X. Zhu, C. Zhang, P. S. Yu, "Bag Constrained Structure Pattern Mining for Multi-Graph Classification", IEEE Trans. Knowl. Data Eng, vol. 26(10), pp. 2382-2396, 2014.
4. H. He and X. Shen, "A Ranked Subspace Learning Method for Gene Expression Data Classification", IJCAI2007, pp. 358-364.
5. J. C. Candy and G. C. Temes, "Oversampling delta-sigma data converters: theory, and simulation", University of Texas Press, 1962.
6. H. Li, J. Li, P. C. Chang, and J. Sun, "Parametric prediction on default risk of chinese listed tourism companies by using random oversampling, and locally linear embeddings on imbalanced samples", International Journal of Hospitality Management, vol. 35, pp. 141-151, 2013.
7. N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, "SMOTE: Synthetic Minority Over-Sampling Technique", J. Artificial Intelligence Research, vol. 16, pp. 321-357, 2002.
8. J. Mathew, M. Luo, C. K. Pang and H. L. Chan, "Kernel-based smote for SVM classification of imbalanced datasets", IECON2015, pp. 1127-1132.
9. B. X. Wang and N. Japkowicz, "Imbalanced Data Set Learning with Synthetic Samples", Proc. IRIS Machine Learning Workshop, 2004.
10. H. B. He and A. G. Edwardo, "Learning from imbalanced data", IEEE Transactions On Knowledge And Data Engineering, vol. 21(9), pp. 1263-1284, 2009.
11. N. Thai-Nghe, Z. Gatner, L. Schmidt-Thieme, "Cost-sensitive learning methods for imbalanced data", IJCNN2010, pp. 1-8.
12. P. Domingos, "MetaCost: A General Method for Making Classifiers Cost-Sensitive", ICDM1999, pp. 155-164.
13. C. Elkan, "The Foundations of Cost-Sensitive Learning", IJCAI2001, pp. 973-978.
14. M. A. Maloof, "Learning When Data Sets Are Imbalanced and When Costs Are Unequal and Unknown", ICML'03 Workshop on Learning from Imbalanced Data Sets, 2003.
15. M. Maloof, P. Langley, S. Sage, and T. Binford, "Learning to Detect Rooftops in Aerial Images", Proc. Image Understanding Workshop, pp. 835-845, 1997.
16. M. Z. Kukar and I. Kononenko, "Cost-Sensitive Learning with Neural Networks", ECAI 1998, pp. 445-449.
17. Z. H. Zhou and X. Y. Liu, "Training Cost-Sensitive Neural Networks with Methods Addressing the Class Imbalance Problem", IEEE Trans. Knowledge and Data Eng, vol. 18(1), pp. 63-77, 2006.
18. C. H. Tsai, L. C. Chang and H. C. Chiang", Forecasting of ozone episode days by cost-sensitive neural network methods", Science of the Total Environment, vol. 407(6), pp. 2124-2135, 2009.
19. M. Lin, K. Tang and X. Yao", Dynamic sampling approach to training neural networks for multiclass imbalance classification", IEEE TNNLS, vol. 24(4), pp. 647-660, 2013.
20. B. Krawczyk and M. Wozniak, "Cost-Sensitive Neural Network with ROC-Based Moving Threshold for Imbalanced Classification", IDEAL2015, pp. 45-52.
21. H. Larochelle, Y. Bengio, J. Louradour, and P. Lamblin, "Exploring strategies for training deep neural networks", Journal of machine learning research, vol 10, pp. 1-40, 2009.
22. T. Fawcett, "An introduction to ROC analysis", Pattern recognition letters, vol 27(8), pp. 861-874, 2006.
23. Liu, W., Chan, J., Bailey, J., Leckie, C., & Kotagiri, R. "Mining labelled tensors by discovering both their common and discriminative subspaces." In Proc. of the 2013 SIAM International Conference on Data Mining.
24. Liu, W., Kan, A., Chan, J., Bailey, J., Leckie, C., Pei, J., & Kotagiri, R. "On compressing weighted time-evolving graphs. In Proceedings of the 21st ACM International Conference on Information and Knowledge Management.