Hybrid classification algorithms based on boosting and support vector machines

Kybernetes

Volumn 37, Issue 9-10, 2008, Pages 1469-1491

  Maia, Thiago Turchetti ^a   Braga, Antônio Pádua ^b   De Carvalho, André F ^c  

^a Vetta Technologies Ltda   (Brazil)

^b FEDERAL UNIVERSITY OF MINAS GERAIS   (Brazil)

^c UNIVERSITY OF SÃO PAULO   (Brazil)

Author keywords

Cybernetics; Optimization techniques; Programming and algorithm theory

Indexed keywords

COUPLINGS; CYBERNETICS; OPTIMIZATION; VECTORS;

BINARY CLASSIFICATION PROBLEMS; CLASSIFICATION ALGORITHM; DESIGN/METHODOLOGY/APPROACH; HYBRID CLASSIFICATION; OPTIMIZATION TECHNIQUES; PROGRAMMING AND ALGORITHM THEORY; SEQUENTIAL MINIMAL OPTIMIZATION ALGORITHMS; TRAINING ALGORITHMS;

SUPPORT VECTOR MACHINES;

EID: 54949142207     PISSN: 0368492X     EISSN: None     Source Type: Journal    
DOI: 10.1108/03684920810907814     Document Type: Article

References (25)

1. Almeida, M.B., Braga, A.P. and Braga, J.P. (2000), "SVM-KM: speeding SVMs learning with a priori cluster selection and k-means", Proceedings of the VIth Brazilian Symposium on Neural Networks, IEEE Computer Society Press, Washington, DC.
2. Almeida, M.B., Braga, A.P. and Braga, J.P. (2001), "Training SVMs with EDR algorithm", International Journal of Neural Systems, Vol. 11 No. 3, pp. 257-63.
3. Breiman, L. (1994), "Bagging predictors", Technical Report, University of California, Berkeley.
4. Burges, C.J.C. (1998), "A tutorial on support vector machines for pattern recognition", Data Mining and Knowledge Discovery, Vol. 2 No. 2, pp. 121-67.
5. Cristianini, N. and Shawe-Taylor, J. (2000), An Introduction to Support Vector Machines and Other Kernel-based Learning Methods, Cambridge University Press, Cambridge.
6. Dietterich, T.G. (2000), "An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization", Machine Learning, Vol. 40 No. 2, pp. 139-58.
7. Freund, Y. (1995), "Boosting a weak learning algorithm by majority", Information and Computation, Vol. 2 No. 121, pp. 256-85.
8. Freund, Y. and Schapire, R.E. (1995), "A decision-theoretic generalization of on-line learning and an application to boosting", Proceedings of the Second European Conference on Computational Learning Theory, LNCS.
9. Freund, Y. and Schapire, R.E. (1996a), "Experiments with a new boosting algorithm", Proceedings of the 13th International Conference on Machine Learning, Morgan Kaufmann, San Mateo, CA, pp. 148-56.
10. Freund, Y. and Schapire, R.E. (1996b), "Game theory, on-line prediction and boosting", Proceedings of the 9th Annual Conference on Computer Learning Theory, ACM Press, New York, NY, pp. 325-32.
11. Freund, Y. and Schapire, R.E. (1997), "A decision-theoretic generalization of on-line learning and an application to boosting", Journal of Computer and System Sciences, Vol. 55 No. 1, pp. 119-39.
12. Freund, Y. and Schapire, R.E. (1999), "A short introduction to boosting", Journal of Japanese Society for Artificial Intelligence, Vol. 14 No. 5, pp. 771-80 (appearing in Japanese, translation by Naoki Abe).
13. Haussler, D., Kearns, M., Littlestone, N. and Warmuth, M.K. (1991), "Equivalence of models for polynomial learnability", Information and Computation, Vol. 95 No. 2, pp. 129-61.
14. Kearns, M. and Valiant, L.G. (1994), "Cryptographic limitations on learning boolean formulae and finite automata", Journal of the ACM, Vol. 41 No. 1, pp. 67-95.
15. Onoda, T., Rätsch, G. and Muller, K-R. (2000), "Applying support vector machines and boosting to a non-intrusive monitoring system for household electric appliances with inverters", Proceedings of Neural Computing 2000.
16. Osuna, E., Freund, R. and Girosi, F. (1997), "An improved training algorithm for support vector machines", in Principe, J., Gile, L., Morgan, N. and Wilson, E. (Eds), Neural Networks for Signal Processing VII - Proceedings of the 1997 IEEE Workshop, IEEE, Piscataway, NJ, pp. 276-85.
17. Platt, J.C. (1998a), Fast Training of Support Vector Machines Using Sequential Minimal Optimization, MIT Press, Cambridge, MA.
18. Platt, J.C. (1998b), "Sequential minimal optimization: a fast algorithm for training support vector machines", Technical Report, Microsoft Research, Redmond, WA.
19. Rosenblatt, F. (1958), "The perceptron: a probabilistic model for information storage and organization in the brain", Psychol. Rev., Vol. 65, pp. 386-408.
20. Schapire, R.E. (1990), "The strength of weak learnability", Machine Learning, Vol. 5 No. 2, pp. 197-227.
21. Schapire, R.E. (1999), "A brief introduction to boosting", Proceedings of the 16th International Joint Conference on Artificial Intelligence.
22. Schapire, R.E. (2002), "The boosting approach to machine learning: an overview", paper presented at MSRI Workshop on Nonlinear Estimation and Classification.
23. Schapire, R.E. and Singer, Y. (1999), "Improved boosting algorithms using confidence-rated predictions", Machine Learning, Vol. 37 No. 3, pp. 297-336.
24. Valiant, L.G. (1984), "A theory of the learnable", Communications of the ACM, Vol. 27 No. 11, pp. 1134-42.
25. Vapnik, V.N. (1995), The Nature of Statistical Learning Theory, Springer, New York, NY.