메뉴 건너뛰기




Volumn 24, Issue 6, 2013, Pages 888-899

Novel cost-sensitive approach to improve the multilayer perceptron performance on imbalanced data

Author keywords

Class imbalance problem; cost sensitive approach; Levenberg Marquadt; multilayer perceptron; objective function

Indexed keywords

CLASS IMBALANCE PROBLEMS; COST-SENSITIVE; LEVENBERG-MARQUADT; MULTI LAYER PERCEPTRON; OBJECTIVE FUNCTIONS;

EID: 84876114113     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2246188     Document Type: Article
Times cited : (213)

References (49)
  • 1
    • 0001924639 scopus 로고    scopus 로고
    • Neural network classification and prior class probabilities
    • Neural Networks: Tricks of the Trade New York, USA: Springer- Verlag
    • S. Lawrence, I. Burns, A. Back, A. Tsoi, and C. Giles, "Neural network classification and prior class probabilities," in Neural Networks: Tricks of the Trade (Lecture Notes in Computer Science), vol. 1524, New York, USA: Springer-Verlag, 1998, pp. 299-313.
    • (1998) Lecture Notes in Computer Science , vol.1524 , pp. 299-313
    • Lawrence, S.1    Burns, I.2    Back, A.3    Tsoi, A.4    Giles, C.5
  • 2
    • 0035283313 scopus 로고    scopus 로고
    • Robust classification for imprecise environments
    • DOI 10.1023/A:1007601015854
    • F. Provost and T. Fawcett, "Robust classification for imprecise environments," Mach. Learn., vol. 42, no. 3, pp. 203-231, Mar. 2001. (Pubitemid 32188799)
    • (2001) Machine Learning , vol.42 , Issue.3 , pp. 203-231
    • Provost, F.1    Fawcett, T.2
  • 3
    • 75349109450 scopus 로고    scopus 로고
    • An investigation of neural network classifiers with unequal misclassification costs and group sizes
    • Mar.
    • J. Lan, M. Y. Hu, E. Patuwo, and G. P. Zhang, "An investigation of neural network classifiers with unequal misclassification costs and group sizes," Decision Support Syst., vol. 48, no. 4, pp. 582-591, Mar. 2010.
    • (2010) Decision Support Syst , vol.48 , Issue.4 , pp. 582-591
    • Lan, J.1    Hu, M.Y.2    Patuwo, E.3    Zhang, G.P.4
  • 4
    • 9444270977 scopus 로고    scopus 로고
    • Class Imbalances versus Class Overlapping: An Analysis of a Learning System Behavior
    • MICAI 2004: Advances in Artificial Intelligence Third Mexican International Conference on Artificial Intelligence Mexico City, Mexico, April 26-30, 2004 Proceedings
    • R. C. Prati, G. E. A. P. A. Batista, and M. C. Monard, "Class imbalances versus class overlapping: An analysis of a learning system behavior," in Proc. 3rd Mexican Int. Conf. Artif. Intell., 2004, pp. 312-321. (Pubitemid 38716795)
    • (2004) Lecture Notes In Computer Science , Issue.2972 , pp. 312-321
    • Prati, R.C.1    Batista, G.E.A.P.A.2    Monard, M.C.3
  • 5
    • 27144531570 scopus 로고    scopus 로고
    • A study of the behavior of several methods for balancing machine learning training data
    • Jun
    • G. E. A. P. A. Batista, R. C. Prati, and M. C. Monard, "A study of the behavior of several methods for balancing machine learning training data," ACM SIGKDD Explorations Newslett., vol. 6, no. 1, pp. 20-29, Jun. 2004.
    • (2004) ACM SIGKDD Explorations Newslett , vol.6 , Issue.1 , pp. 20-29
    • Batista, G.E.A.P.A.1    Prati, R.C.2    Monard, M.C.3
  • 6
    • 77951926080 scopus 로고    scopus 로고
    • Supervised neural network modeling: An empirical investigation into learning from imbalanced data with labeling errors
    • May
    • T. M. Khoshgoftaar, J. V. Hulse, and A. Napolitano, "Supervised neural network modeling: An empirical investigation into learning from imbalanced data with labeling errors," IEEE Trans. Neural Netw., vol. 21, no. 5, pp. 813-830, May 2010.
    • (2010) IEEE Trans. Neural Netw , vol.21 , Issue.5 , pp. 813-830
    • Khoshgoftaar, T.M.1    Hulse, J.V.2    Napolitano, A.3
  • 7
    • 20844458491 scopus 로고    scopus 로고
    • Mining with rarity: A unifying framework
    • Jun
    • G. M. Weiss, "Mining with rarity: A unifying framework," ACM SIGKDD Explorations Newslett., vol. 6, no. 1, pp. 7-19, Jun. 2004.
    • (2004) ACM SIGKDD Explorations Newslett , vol.6 , Issue.1 , pp. 7-19
    • Weiss, G.M.1
  • 8
    • 68549133155 scopus 로고    scopus 로고
    • Learning from imbalanced data
    • Sep
    • H. He and E. A. Garcia, "Learning from imbalanced data," IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1263-1284, Sep. 2009.
    • (2009) IEEE Trans. Knowl. Data Eng , vol.21 , Issue.9 , pp. 1263-1284
    • He, H.1    Garcia, E.A.2
  • 9
    • 33646142788 scopus 로고    scopus 로고
    • Evaluation of neural networks and data mining methods on a credit assessment task for class imbalance problem
    • Sep
    • Y.-M. Huang, C.-M. Hung, and H. C. Jiau, "Evaluation of neural networks and data mining methods on a credit assessment task for class imbalance problem," Nonlinear Anal., Real World Appl., vol. 7, no. 4, pp. 720-747, Sep. 2006.
    • (2006) Nonlinear Anal., Real World Appl , vol.7 , Issue.4 , pp. 720-747
    • Huang, Y.-M.1    Hung, C.-M.2    Jiau, H.C.3
  • 10
    • 79953050208 scopus 로고    scopus 로고
    • A dynamic over-sampling procedure based on sensitivity for multiclass problems
    • Aug.
    • F. Fernandez-Navarro, C. Hervas-Martinez, and P. Antonio Gutierrez, "A dynamic over-sampling procedure based on sensitivity for multiclass problems," Pattern Recognit., vol. 44, no. 8, pp. 1821-1833, Aug. 2011.
    • (2011) Pattern Recognit , vol.44 , Issue.8 , pp. 1821-1833
    • Fernandez-Navarro, F.1    Hervas-Martinez, C.2    Antonio Gutierrez, P.3
  • 12
    • 40649126091 scopus 로고    scopus 로고
    • Training neural network classifiers for medical decision making: The effects of imbalanced datasets on classification performance
    • M. A. Mazurowski, P. A. Habas, J. M. Zurada, J. Y. Lo, J. A. Baker, and G. D. Tourassi, "Training neural network classifiers for medical decision making: The effects of imbalanced datasets on classification performance," Neural Netw., vol. 21, nos. 2-3, pp. 427-436, 2008.
    • (2008) Neural Netw , vol.21 , Issue.2-3 , pp. 427-436
    • Mazurowski, M.A.1    Habas, P.A.2    Zurada, J.M.3    Lo, J.Y.4    Baker, J.A.5    Tourassi, G.D.6
  • 14
    • 34547973397 scopus 로고    scopus 로고
    • The imbalanced training sample problem: Under or over sampling?
    • Structural, Syntactic, Statistical Pattern Recognition New York, USA: Springer- Verlag
    • R. Barandela, R. Valdovinos, J. Sanchez, and F. Ferri, "The imbalanced training sample problem: Under or over sampling?" in Structural, Syntactic, Statistical Pattern Recognition (Lecture Notes in Computer Science), vol. 3138, New York, USA: Springer-Verlag, 2004, pp. 806-814.
    • (2004) Lecture Notes in Computer Science , vol.3138 , pp. 806-814
    • Barandela, R.1    Valdovinos, R.2    Sanchez, J.3    Ferri, F.4
  • 15
    • 0034825091 scopus 로고    scopus 로고
    • Supervised versus unsupervised binary-learning by feedforward neural networks
    • DOI 10.1023/A:1007660820062
    • N. Japkowicz, "Supervised versus unsupervised binary-learning by feedforward neural networks," Mach. Learn., vol. 42, nos. 1-2, pp. 97-122, 2001. (Pubitemid 32872400)
    • (2001) Machine Learning , vol.42 , Issue.1-2 , pp. 97-122
    • Japkowicz, N.1
  • 16
    • 33847410597 scopus 로고    scopus 로고
    • One-class document classification via Neural Networks
    • DOI 10.1016/j.neucom.2006.05.013, PII S092523120600261X, Advances in Computational Intelligence and Learning 14th European Symposium on Artificial Neural Networks 2006
    • L. Manevitz and M. Yousef, "One-class document classification via neural networks," Neurocomput., vol. 70, nos. 7-9, pp. 1466-1481, Mar. 2007. (Pubitemid 46336763)
    • (2007) Neurocomputing , vol.70 , Issue.7-9 , pp. 1466-1481
    • Manevitz, L.1    Yousef, M.2
  • 17
    • 32344438970 scopus 로고    scopus 로고
    • Extreme re-balancing for SVMs: A case study
    • Jun
    • B. Raskutti and A. Kowalczyk, "Extreme re-balancing for SVMs: A case study," ACM SIGKDD Explorations Newslett., vol. 6, no. 1, pp. 60-69, Jun. 2004.
    • (2004) ACM SIGKDD Explorations Newslett , vol.6 , Issue.1 , pp. 60-69
    • Raskutti, B.1    Kowalczyk, A.2
  • 19
    • 0002804620 scopus 로고    scopus 로고
    • A comparative study of cost-sensitive boosting algorithms
    • K. M. Ting, "A comparative study of cost-sensitive boosting algorithms," in Proc. 17th Int. Conf. Mach. Learn., 2000, pp. 983-990.
    • (2000) Proc. 17th Int. Conf. Mach. Learn , pp. 983-990
    • Ting, K.M.1
  • 20
    • 34547673383 scopus 로고    scopus 로고
    • Cost-sensitive boosting for classification of imbalanced data
    • DOI 10.1016/j.patcog.2007.04.009, PII S0031320307001835
    • Y. Sun, M. S. Kamel, A. K. C. Wong, and Y. Wang, "Cost-sensitive boosting for classification of imbalanced data," Pattern Recognit., vol. 40, no. 12, pp. 3358-3378, 2007. (Pubitemid 47223287)
    • (2007) Pattern Recognition , vol.40 , Issue.12 , pp. 3358-3378
    • Sun, Y.1    Kamel, M.S.2    Wong, A.K.C.3    Wang, Y.4
  • 21
    • 77957793322 scopus 로고    scopus 로고
    • Ramoboost: Ranked minority oversampling in boosting
    • Oct.
    • S. Chen, H. He, and E. A. Garcia, "Ramoboost: Ranked minority oversampling in boosting," IEEE Trans. Neural Netw., vol. 21, no. 10, pp. 1624-1642, Oct. 2010.
    • (2010) IEEE Trans. Neural Netw , vol.21 , Issue.10 , pp. 1624-1642
    • Chen, S.1    He, H.2    Garcia, E.A.3
  • 23
    • 84862515469 scopus 로고    scopus 로고
    • A review on ensembles for the class imbalance problem: Bagging-, boosting-, and hybrid-based approaches
    • Jul.
    • M. Galar, A. Fernandez, E. Barrenechea, H. Bustince, and F. Herrera, "A review on ensembles for the class imbalance problem: Bagging-, boosting-, and hybrid-based approaches," IEEE Trans. Syst., Man, Cybern. C, vol. 42, no. 4, pp. 463-484, Jul. 2012.
    • (2012) IEEE Trans. Syst., Man, Cybern. C , vol.42 , Issue.4 , pp. 463-484
    • Galar, M.1    Fernandez, A.2    Barrenechea, E.3    Bustince, H.4    Herrera, F.5
  • 26
    • 38049120179 scopus 로고    scopus 로고
    • Improving the performance of the RBF neural networks trained with imbalanced samples
    • Computational and Ambient Intelligence New York, USA: Springer- Verlag
    • R. Alejo, V. Garcia, J. Sotoca, R. A. Mollineda, and J. Sanchez, "Improving the performance of the RBF neural networks trained with imbalanced samples," in Computational and Ambient Intelligence (Lecture Notes in Computer Science), vol. 4507. New York, USA: Springer-Verlag, 2007, pp. 162-169.
    • (2007) Lecture Notes in Computer Science , vol.4507 , pp. 162-169
    • Alejo, R.1    Garcia, V.2    Sotoca, J.3    Mollineda, R.A.4    Sanchez, J.5
  • 27
    • 77955452616 scopus 로고    scopus 로고
    • Artificial neural networks learning in ROC space
    • C. Castro and A. Braga, "Artificial neural networks learning in ROC space," in Proc. Int. Joint Conf. Comput., 2009, pp. 484-489.
    • (2009) Proc. Int. Joint Conf. Comput , pp. 484-489
    • Castro, C.1    Braga, A.2
  • 28
    • 79751530792 scopus 로고    scopus 로고
    • Error back-propagation algorithm for classification of imbalanced data
    • Feb.
    • S.-H. Oh, "Error back-propagation algorithm for classification of imbalanced data," Neurocomputing, vol. 74, no. 6, pp. 1058-1061, Feb. 2011.
    • (2011) Neurocomputing , vol.74 , Issue.6 , pp. 1058-1061
    • Oh, S.-H.1
  • 29
    • 79952441195 scopus 로고    scopus 로고
    • A new weighted approach to imbalanced data classification problem via support vector machine with quadratic cost function
    • Jul.
    • J. P. Hwang, S. Park, and E. Kim, "A new weighted approach to imbalanced data classification problem via support vector machine with quadratic cost function," Expert Syst. Appl., vol. 38, no. 7, pp. 8580-8585, Jul. 2011.
    • (2011) Expert Syst. Appl , vol.38 , Issue.7 , pp. 8580-8585
    • Hwang, J.P.1    Park, S.2    Kim, E.3
  • 30
    • 33846046907 scopus 로고    scopus 로고
    • A kernel-based two-class classifier for imbalanced data sets
    • DOI 10.1109/TNN.2006.882812
    • X. Hong, S. Chen, and C. Harris, "A kernel-based two-class classifier for imbalanced data sets," IEEE Trans. Neural Netw., vol. 18, no. 1, pp. 28-41, Jan. 2007. (Pubitemid 46062914)
    • (2007) IEEE Transactions on Neural Networks , vol.18 , Issue.1 , pp. 28-41
    • Hong, X.1    Chen, S.2    Harris, C.J.3
  • 31
    • 79957852245 scopus 로고    scopus 로고
    • A novel SVM modeling approach for highly imbalanced and overlapping classification
    • Nov.
    • Y. Qu, H. Su, L. Guo, and J. Chu, "A novel SVM modeling approach for highly imbalanced and overlapping classification," Intell. Data Anal., vol. 15, no. 3, pp. 319-341, Nov. 2011.
    • (2011) Intell. Data Anal , vol.15 , Issue.3 , pp. 319-341
    • Qu, Y.1    Su, H.2    Guo, L.3    Chu, J.4
  • 32
    • 1942451958 scopus 로고    scopus 로고
    • Adaptive feature-space conformal transformation for imbalanced-data learning
    • G. Wu and E. Y. Chang, "Adaptive feature-space conformal transformation for imbalanced-data learning," in Proc. IEEE Int. Conf. Mach. Learn., 2003, pp. 816-823.
    • (2003) Proc IEEE Int. Conf. Mach. Learn , pp. 816-823
    • Wu, G.1    Chang, E.Y.2
  • 33
    • 20844441675 scopus 로고    scopus 로고
    • KBA: Kernel boundary alignment considering imbalanced data distribution
    • DOI 10.1109/TKDE.2005.95
    • G. Wu and E. Y. Chang, "KBA: Kernel boundary alignment considering imbalanced data distribution," IEEE Trans. Knowl. Data Eng., vol. 17, no. 6, pp. 786-795, Jun. 2005. (Pubitemid 40860458)
    • (2005) IEEE Transactions on Knowledge and Data Engineering , vol.17 , Issue.6 , pp. 786-795
    • Wu, G.1    Chang, E.Y.2
  • 34
    • 0028543366 scopus 로고
    • Training feedforward networks with the Marquardt algorithm
    • Nov
    • M. T. Hagan and M. B. Menhaj, "Training feedforward networks with the Marquardt algorithm," IEEE Trans. Neural Netw., vol. 5, no. 6, pp. 989-993, Nov. 1994.
    • (1994) IEEE Trans. Neural Netw , vol.5 , Issue.6 , pp. 989-993
    • Hagan, M.T.1    Menhaj, M.B.2
  • 39
    • 84867577175 scopus 로고    scopus 로고
    • The foundations of cost-sensitive learning
    • C. Elkan, "The foundations of cost-sensitive learning," in Proc. Int. Joint Conf. Artif. Intell., 2001, pp. 973-978.
    • (2001) Proc. Int. Joint Conf. Artif. Intell , pp. 973-978
    • Elkan, C.1
  • 42
    • 84868489803 scopus 로고    scopus 로고
    • Global convergence of online BP training with dynamic learning rate
    • Feb.
    • R. Zhang, Z.-B. Xu, G.-B. Huang, and D. Wang, "Global convergence of online BP training with dynamic learning rate," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 2, pp. 330-341, Feb. 2012.
    • (2012) IEEE Trans. Neural Netw. Learn. Syst , vol.23 , Issue.2 , pp. 330-341
    • Zhang, R.1    Xu, Z.-B.2    Huang, G.-B.3    Wang, D.4
  • 44
    • 0001972236 scopus 로고    scopus 로고
    • Addressing the curse of imbalanced training sets: One-sided selection
    • M. Kubat and S. Matwin, "Addressing the curse of imbalanced training sets: One-sided selection," in Proc. Int. Conf. Mach. Learn., 1997, pp. 179-186.
    • (1997) Proc. Int. Conf. Mach. Learn , pp. 179-186
    • Kubat, M.1    Matwin, S.2
  • 45
    • 33646023117 scopus 로고    scopus 로고
    • An introduction to ROC analysis
    • Jun
    • T. Fawcett, "An introduction to ROC analysis," Pattern Recognit. Lett., vol. 27, no. 8, pp. 861-874, Jun. 2006.
    • (2006) Pattern Recognit. Lett , vol.27 , Issue.8 , pp. 861-874
    • Fawcett, T.1
  • 46
    • 29644438050 scopus 로고    scopus 로고
    • Statistical comparisons of classifiers over multiple data sets
    • J. Demsar, "Statistical comparisons of classifiers over multiple data sets," J. Mach. Learn. Res., vol. 7, pp. 1-30, Jan. 2006. (Pubitemid 43022939)
    • (2006) Journal of Machine Learning Research , vol.7 , pp. 1-30
    • Demsar, J.1
  • 47
    • 84944811700 scopus 로고
    • The use of ranks to avoid the assumption of normality implicit in the analysis of variance
    • Dec
    • M. Friedman, "The use of ranks to avoid the assumption of normality implicit in the analysis of variance," J. Amer. Stat. Assoc., vol. 32, no. 200, pp. 675-701, Dec. 1937.
    • (1937) J. Amer. Stat. Assoc , vol.32 , Issue.200 , pp. 675-701
    • Friedman, M.1
  • 48
    • 84943987463 scopus 로고
    • Multiple comparisons among means
    • O. J. Dunn, "Multiple comparisons among means," J. Amer. Stat. Assoc., vol. 56, no. 293, pp. 52-64, 1961.
    • (1961) J. Amer. Stat. Assoc , vol.56 , Issue.293 , pp. 52-64
    • Dunn, O.J.1


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.