Bayesian decision theory for support vector machines: Imbalance measurement and feature optimization

Expert Systems with Applications

Volumn 38, Issue 5, 2011, Pages 4698-4704

  Hsu, Che Chang ^a   Wang, Kuo Shong ^a   Chang, Shih Hsing ^b  

^a NATIONAL CENTRAL UNIVERSITY   (Taiwan)

^b VANUNG UNIVERSITY   (Taiwan)

Author keywords

Bayesian approach; Class imbalance problem; Support vector machines

Indexed keywords

BAYESIAN; BAYESIAN APPROACHES; BAYESIAN DECISION THEORY; CLASS IMBALANCE; CLASS IMBALANCE PROBLEMS; CLASSIFICATION APPROACH; CLASSIFICATION DECISION; DATA SETS; DECISION COST; EXPERIMENTAL EVIDENCE; GENERALIZATION PERFORMANCE; LEARNING METHODS; LEARNING RULES; LEARNING STRATEGY; MARGIN CLASSIFIERS; MODEL ASSESSMENT; PRIMAL PROBLEM; QUADRATIC PROGRAMS; SUPPORT VECTOR;

DECISION THEORY; OPTIMIZATION; SUPPORT VECTOR MACHINES; VECTORS;

BAYESIAN NETWORKS;

EID: 79151476746     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2010.08.150     Document Type: Article

References (25)

1. C.M. Bishop Pattern recognition and machine learning 2006 Springer New York
2. Breiman, L. (1996). Bias, variance and arcing classifiers. Technical Report 460, Berkeley, CA: Statistics Department, University of California at Berkeley.
3. Chawla, N.; Japkowicz, N.; & Kolcz, A. (Eds.). (2003). In Proceedings of the ICML'2003 workshop on learning from imbalanced data sets, August 2003. Proceedings Available at .
4. R.O. Duda, P.E. Hart, and D.G. Stork Pattern classification 2nd ed. 2001 John Wiley and Sons
5. S. Ghosal, and A. Roy Posterior consistency of gaussian process prior for nonparametric binary regression Annals of Statistics 34 5 2006 2413 2429
6. T. Hastie, R. Tibshirani, and J. Friendman The elements of statistical learning: Data mining inference and prediction 2001 Springer-Verlag Berlin, Heidelberg, New York
7. A. Honkela, and H. Valpola Unsupervised variational Bayesian learning of nonlinear models Advances in neural information processing systems Vol. 17 2005 MIT Press Cambridge, MA
8. Japkowicz, N. (Ed.). (2003). AAAI workshop on learning from imbalanced data sets, Technical Report WS-00-05. Menlo Park, CA: AAAI Press.
9. Kubat, M.; & Matwin, S. (1997) Addressing the curse of imbalanced training sets: One-sided selection. In Proceedings of the 14th International Conference on Machine Learning (pp. 179-186).
10. H. Lappalainen, and A. Honkela Bayesian nonlinear independent component analysis by multi-layer perceptrons M. Girolami, Advances in independent component analysis 2000 Springer-Verlag Berlin 93 121
11. C.F. Lin, and S.D. Wang Training algorithms for fuzzy support vector machine with noisy data Pattern Recognition Letters archive 25 14 1999 1647 1656
12. Murphy, P. M. (1995). UCI-benchmark repository of artificial and real data sets. CA: University of California Irvine. .
13. R.C. Prati, G.E.A.P.A. Batista, and M.C. Monard Class imbalances versus class overlapping: An analysis of a learning system behavior MICAI 2004 312 321
14. C.E. Rasmussen, and C.K.I. Williams Gaussian processes for machine learning 2006 MIT Press Cambridge, MA
15. B. Schölkopf, P. Simard, A. Smola, and V. Vapnik Prior knowledge in support vector kernels Advances in neural information processing system Vol. 10 1998 MIT Press Cambridge, MA
16. Seeger, M. (2000). Bayesian model selection for support vector machines, Gaussian processes and other kernel classifiers. Advances in neural information processing system (Vol. 12, pp. 603-609). Cambridge, MA: MIT Press.
17. P. Sollich Bayesian methods for support vector machines: Evidence and predictive class probabilities Machine learning 46 2002 21 52
18. Y. Tang, Y.-Q. Zhang, N.V. Chawla, and S. Krasser SVMs modeling for highly imbalanced classification IEEE Transactions on Systems Man and Cybernetics Part B 39 1 2009 281 288
19. Q. Tao, G.-W. Wu, F.-Y. Wang, and J. Wang Posterior probability support vector machines for unbalanced data IEEE Transactions on Neural Networks 16 6 2005 1561 1573
20. S. Theodoridis, and K. Koutroumbas Pattern recognition Third ed. 2006 Academic Press
21. V.N. Vapnik The nature of statistical learning theory 1995 Springer-Verlag Berlin Heidelberg, New York
22. V.N. Vapnik Statistical learning theory 1998 Wiley New York
23. V.N. Vapnik An overview of statistical learning theory IEEE Transaction on Neural Networks 10 1999 988 999
24. Vlachos, P.; & Meyer, M. (1989). StatLib. Department of Statistics, Carnegie Mellon University. .
25. G. Wu, and E.Y. Chang KBA: Kernel boundary alignment considering imbalanced data distribution IEEE Transaction on Knowledge and Data Engineering 17 6 2005 786 795