AdaBoost with SVM-based component classifiers

Engineering Applications of Artificial Intelligence

Volumn 21, Issue 5, 2008, Pages 785-795

  Li, Xuchun ^a   Wang, Lei ^a   Sung, Eric ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

AdaBoost; Component classifier; Diversity; Support Vector Machine

Indexed keywords

ALUMINUM; ARCHITECTURAL DESIGN; ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); CLASSIFIERS; COMPUTER NETWORKS; DECISION MAKING; DECISION THEORY; DECISION TREES; GEARS; IMAGE RETRIEVAL; MATHEMATICAL MODELS; METROPOLITAN AREA NETWORKS; MULTILAYER NEURAL NETWORKS; MULTITASKING; NETWORK PROTOCOLS; NEURAL NETWORKS; SULFATE MINERALS; SUPPORT VECTOR MACHINES; TRANSIENTS; TREES (MATHEMATICS); VECTORS;

(001) PARAMETER; ADABOOST; BALANCE (WEIGHTING); BENCHMARK DATA; COMPONENT CLASSIFIERS; ENSEMB LE METHODS; GAUSSIAN RADIAL BASIS FUNCTION (RBF) KERNEL; GENERALIZATION PERFORMANCE; IMBALANCED CLASSIFICATION; INTERNATIONAL (CO); MACHINE LEARNING RESEARCH; MODEL PARAMETERS; MULTIPLE CLASSIFIER SYSTEM (MCS); PERFORMANCE DEGRADATION; PROOF-OF-CONCEPT (POC); VARIANCE ANALYSIS; VECTOR MACHINES;

LEARNING SYSTEMS;

EID: 44649197212     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2007.07.001     Document Type: Article

References (47)

1. Aaai'2000 Workshop on Learning from Imbalanced Data Sets. 2000.
2. Akbani R., Kwek S., and Japkowicz N. Applying support vector machines to imbalanced datasets. Proceedings of the 15th European Conference on Machine Learning (2004) 39-50
3. Baudat G., and Anouar F. Generalized discriminant analysis using a kernel approach. Neural Computation 12 (2000) 2385-2404
4. Bauer E., and Kohavi R. An empirical comparison of voting classification algorithms: bagging, boosting, and variants. Machine Learning 36 1 (1999) 105-139
5. Bradley A.P. The use of the area under the roc curve in the evaluation of machine learning algorithms. Pattern Recognition 30 (1997) 1145-1159
6. Breiman L. Bagging predictors. Machine Learning 24 (1996) 123-140
7. Chawla N.V., Bowyer K.W., Hall L.O., and Kegelmeyer W.P. Smote: synthetic minority over-sampling technique. Journal of Artificial Intelligence Research 16 (2002) 321-357
8. Cristianini N., Shawe-Taylor J., Elisseeff A., and Kandola J.S. On kernel-target alignment. Advances in Neural Information Processing Systems (2001) 367-373
9. Dasgupta S., and Long P.M. Boosting with diverse base classifiers. Proceedings of the 16th Annual Conference on Learning Theory (2003) 273-287
10. del Castillo M.D., and Serrano J.I. A multistrategy approach for digital text categorization from imbalanced documents. ACM SIGKDD Explorations: Special Issue on Learning from Imbalanced Datasets (2004) 39-70
11. Dietterich T.G. Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation 10 (1998) 1895-1923
12. Dietterich T.G. An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization. Machine Learning 40 2 (2000) 139-157
13. Domeniconi C., and Yan B. Nearest neighbor ensemble. Proceedings of the 17th International Conference on Pattern Recognition (2004) 23-26
14. Drummond C., and Holte R. Exploiting the cost (in)sensitivity of decision tree splitting criteria. Proceedings of the 17th International Conference on Machine Learning (2000) 239-246
15. Editorial: Special issue on learning from imbalanced data sets. 2004. SIGKDD Explorations 6.
16. Eveitt B. The Analysis of Contingency Tables (1977), Chapman & Hall, London
17. Fawcett T., and Provost F. Adaptive fraud detection. Data Mining and Knowledge Discovery 1 3 (1997) 291-316
18. Freund Y., and Schapire R.E. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences 55 1 (1997) 119-139
19. Guo H., and Viktor H.L. Learning from imbalanced data sets with boosting and data generation: the databoost-im approach. ACM SIGKDD Explorations: Special Issue on Learning from Imbalanced Datasets (2004) 30-39
20. Hand D. Construction and Assessment of Classification Rules (1997), Wiley, UK
21. 〈http://mlg.anu.edu.au/∼raetsch/data〉.
22. Icml'2003 Workshop on Learning from Imbalanced Data Sets (ii). 2003.
23. Joachims T. Text categorization with support vector machines: learning with many relevant features. Proceedings of the 10th European Conference on Machine Learning (1998) 137-142
24. Kubat M., and Matwin S. Addressing the curse of imbalanced training sets: one-sided selection. Proceedings of the 14th International Conference on Machine Learning (1997) 179-186
25. Kuncheva L.I., and Whitaker C.J. Using diversity with three variants of boosting: aggressive conservative and inverse. Proceedings of the 3rd International Workshop on Multiple Classifier Systems (2002)
26. Kuncheva L.I., and Whitaker C.J. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Machine Learning 51 2 (2003) 181-207
27. Ling C.X., and Li C. Data mining for direct marketing problems and solutions. Proceedings of the 4th International Conference on Knowledge Discovery and Data Mining (1998)
28. Margineantu D.D., and Dietterich T.G. Pruning adaptive boosting. Proceedings of the 14th International Conference on Machine Learning (1997) 211-218
29. Melville P., and Mooney R.J. Creating diversity in ensembles using artificial data. Information Fusion 6 1 (2005) 99-111
30. Nugroho A., Kuroyanagi S., and Iwata A. A solution for imbalanced training sets problem by combnet-ii and its application on fog forecasting. IEICE Transactions on Information and Systems (2002) 1165-1174
31. Opitz D., and Maclin R. Popular ensemble methods: an empirical study. Journal of Artificial Intelligence Research 11 (1999) 169-198
32. Pearson R., Goney G., and Shwaber J. Imbalanced clustering for microarray time-series. ICML'2003 Workshop on Learning from Imbalanced Data Sets (II) (2003)
33. Ratsch G. Soft margins for adaboost. Machine Learning 42 3 (2001) 287-320
34. Schapire R.E. The boosting approach to machine learning: an overview. MSRI Workshop on Nonlinear Estimation and Classification (2002)
35. Schapire R.E., and Singer Y. Improved boosting algorithms using confidence-rated predictions. Machine Learning 37 3 (1999) 297-336
36. Schapire R.E., Singer Y., Bartlett P., and Lee W. Boosting the margin: a new explanation for the effectiveness of voting methods. The Annals of Statistics 26 5 (1998) 1651-1686
37. Scholkopf B., Sung K.-K., Burges C., Girosi F., Niyogi P., Poggio T., and Vapnik V. Comparing support vector machines with Gaussian kernels to radial basis function classifiers. IEEE Transactions on Signal Processing 45 11 (1997) 2758-2765
38. Schwenk H., and Bengio Y. Boosting neural networks. Neural Computation 12 (2000) 1869-1887
39. Shin H.W., and Sohn S.Y. Selected tree classifier combination based on both accuracy and error diversity. Pattern Recognition 38 (2005) 191-197
40. Tong S., and Koller D. Support vector machine active learning with applications to text classification. Journal of Machine Learning Research 2 (2001) 45-66
41. Valentini G., and Dietterich T.G. Bias-variance analysis of support vector machines for the development of SVM-based ensemble methods. Journal of Machine Learning Research 5 (2004) 725-775
42. Vapnik V. Statistical Learning Theory (1998), Wiley, New York
43. Veropoulos K., Campbell C., and Cristianini N. Controlling the sensitivity of support vector machines. Proceedings of the International Joint Conference on Artificial Intelligent (1999) 55-60
44. Wickramaratna J., Holden S.B., and Buxton B.F. Performance degradation in boosting. Proceedings of the Second International Workshop on Multiple Classifier Systems (2001) 11-21
45. Windeatt T. Diversity measures for multiple classifier system analysis and design. Information Fusion 6 (2005) 21-36
46. Wu G., and Chang E.Y. Kba: kernel boundary alignment considering imbalanced data distribution. IEEE Transactions on Knowledge and Data Engineering 17 6 (2005) 786-795
47. Yan, R., Liu, Y., Jin, R., Hauptmann, A., 2003. On predicting rare class with SVM ensemble in scene classification. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal 2003, April 2003, pp. III-21-4.