Meta-learning for imbalanced data and classification ensemble in binary classification

Neurocomputing

Volumn 73, Issue 1-3, 2009, Pages 484-494

  Lin, Sung Chiang ^a   Chang, Yuan chin I ^b   Yang, Wei Ning ^a  

^a NATIONAL TAIWAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Taiwan)

^b INSTITUTE OF STATISTICAL SCIENCE   (Taiwan)

Author keywords

Area under ROC curve; Fisher (linear) discriminant analysis; Imbalanced data; Meta learning; ROC curve

Indexed keywords

AREA UNDER ROC CURVE; FISHER (LINEAR) DISCRIMINANT ANALYSIS; IMBALANCED DATA; META-LEARNING; ROC CURVE;

DISCRIMINANT ANALYSIS;

ARTICLE; CLASSIFICATION ALGORITHM; CLASSIFIER; DISCRIMINANT ANALYSIS; GEOMETRY; INFORMATION PROCESSING; MACHINE LEARNING; PRIORITY JOURNAL; SENSITIVITY AND SPECIFICITY;

EID: 70350719232     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2009.06.015     Document Type: Article

References (33)

1. Ali S., and Smith-Miles K.A. A meta-learning approach to automatic kernel selection for support vector machines. Neurocomputing 70 (2006) 173-186
2. Alpaydin E. Introduction to Machine Learning (2004), MIT Press, USA
3. Barandela R., Sanchez J.S., Garcia V., and Rangel E. Strategies for learning in class imbalance problems. Pattern Recognition 36 (2003) 849-851
4. Burges C.J.C. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 2 (1998) 955-974
5. Chan P.K., and Stolfo S.J. Toward scalable learning with non-uniform class and cost distributions: a case study in credit card fraud detection. Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining (1998), AAAI Press 164-168
6. C.C. Chang, C.J. Lin, LIBSVM: a library for Support Vector Machines 〈http://www.csie.ntu.edu.tw/∼cjlin/papers/libsvm.ps.gz〉, 2001.
7. Y.-c.I. Chang, S.C. Lin, Synergy of logistic regression and support vector machine in multi-class classification, in: Proceedings of the IDEAL 2004, Lecture Notes in Computer Science, vol. 3177, Springer, Berlin, Heidelberg, 2004, pp. 132-141.
8. Chawla N.V., Bowyer K.W., Hall L.O., and Kegelmeyer W.P. Smote: synthetic minority over-sampling technique. Journal of Artificial Intelligence Research 16 (2002) 321-357
9. N.V. Chawla, N. Japkowicz, A. Kotcz, Editorial: special issue on learning from imbalanced data sets, in: Proceedings of the SIGKDD Explorations Newsletter, vol. 6, ACM SIGKDD Explorations, 2004, pp. 1-6.
10. Christophe G.C., Vilalta R., and Brazdil P. Introduction to the special issue on meta-learning. Machine Learning 54 (2004) 187-193
11. Cohen G., Hilario M., Sax H., Hugonnet S., and Geissbuhler A. Learning from imbalanced data in surveillance of nosocomial infection. Artificial Intelligence in Medicine 37 (2006) 7-18
12. Dietterich T.G. Ensemble methods in machine learning. In: Kittler J., and Reli F. (Eds). Multiple Classifier Systems, Lecture Notes in Computer Science vol. 1857 (2000), Springer, Berlin, Heidelberg 1-15
13. Dzeroski S., and Zenko B. Is combining classifiers with stacking better than selecting the best one?. Machine Learning 54 (2004) 255-273
14. Estabrooks A. A multiple resampling method for learning from imbalanced data sets. Computational Intelligence 20 (2004) 18-36
15. Firth D. Bias reduction of maximum likelihood estimates. Biometrika 80 (1993) 27-38
16. Friedman J., Hastie T., and Tibshirani R. Additive logistic regression: a statistical view of boosting. Annals of Statistics 28 (2000) 337-407
17. Imam T., Ting K.M., and Kamruzzaman J. z-SVM: an SVM for Improved classification of imbalanced data. In: Sattar A., and Kang B.H. (Eds). AI 2006: Advances in Artificial Intelligence, Lecture Notes in Artificial Intelligence vol. 4304 (2006), Springer, Berlin, Heidelberg 264-273
18. N. Japkowicz, Learning from imbalanced data sets: a comparison of various strategies, in: Tech Rep. WS-00-05, AAAI Workshop on Learning from Imbalanced Data Sets, AAAI Press, Menlo Park, CA, 2000.
19. C. Li, Classifying imbalanced data using a bagging ensemble variation (bev), in: Proceedings of the ACM-SE 45, ACM, New York, 2007, pp. 203-208.
20. Liu X.Y., Wu J., and Zhou Z.H. Exploratory under-sampling for class-imbalance learning. Proceedings of the Sixth International Conference on Data Mining (2006), IEEE Computer Society, Washington 965-969
21. Liu X.Y., and Zhou Z.H. The influence of class imbalance on the cost-sensitive learning: an empirical study. Proceedings of the ICDM '06 (2006), IEEE The Computer Society
22. McCullagh P. Generalized Linear Models. second ed. (1989), Chapman & Hall, New York
23. A.L. Prodromidis, P.K. Chan, S.J. Stolfo, Meta-learning in distributed data mining systems: issues and approaches, in: Advances of Distributed Data Mining, AAAI Press, 2002.
24. Prudencio R.B.C., and Ludermir T.B. Meta-learning approaches to selecting time series models. Neurocomputing 61 (2004) 121-137
25. Punj G., and Stewart D.W. Cluster analysis in marketing research: review and suggestion for application. Journal of Marketing Research 20 (1983) 134-148
26. R Development Core Team, R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria, 2007.
27. Rencher A.C. Methods of Multivariate Analysis. second ed. (2002), Wiley, USA
28. Sharma S. Applied Multivariate Techniques (1996), Wiley, New York
29. Timm N.H. Applied Multivariate Analysis (2002), Springer, New York
30. Ting K.M., and Witten I.H. Issues in stacked generalization. Journal of Artificial Intelligence Research 10 (1999) 271-289
31. Vilalta R., and Drissi Y. A perspective view and survey of metalearning. Artificial Intelligence Review 18 (2002) 77-95
32. Zhao J.H., Li X., and Dong Z.Y. Online rare events detection. In: Zhou Z.H., Li H., and Yang Q. (Eds). Advances in Knowledge Discovery and Data Mining, Lecture Notes in Artificial Intelligence vol. 4426 (2007), Springer, Berlin, Heidelberg 1114-1121
33. J. Zhu, T. Hastie, Kernel logistic regression and the import vector machine, Journal of Computational and Graphical Statistics (2001) 1081-1088.