Optimizing resources in model selection for support vector machine

Pattern Recognition

Volumn 40, Issue 3, 2007, Pages 953-963

  Adankon, Mathias M ^a   Cheriet, Mohamed ^a  

^a Laboratoire d'Imagerie de Vision et d'Intelligence Artificielle (LIVIA)   (Canada)

Author keywords

Hyperparameters; Kernel; Model selection; Optimizing time; SVM

Indexed keywords

APPROXIMATION THEORY; DATA STRUCTURES; MATHEMATICAL MODELS; MATRIX ALGEBRA; OPTIMIZATION; QUADRATIC PROGRAMMING;

HYPERPARAMETERS; KERNEL; MODEL SELECTION; OPTIMIZING TIME; SVM;

LEARNING SYSTEMS;

EID: 33751033588     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2006.06.012     Document Type: Article

References (28)

1. Vapnik V.N. Statistical Learning Theory (1998), Wiley, New York
2. Vapnik V.N. Estimation of Dependences based on Empirical Data (1982), Springer, Berlin
3. V.N. Vapnik, Principles of risk minimization for learning theory, Advances in Neural Information Processing Systems, vol. 4, Morgan Kaufmann, San Mateo, CA, 1992, pp. 831-838.
4. LeCun Y., Bottom L., Bengio Y., and Haffner P. Gradient-based learning applied to document recognition. Proc. IEEE 86 (1998) 2278-2324
5. G. Wahba, Y. Lin, H. Zhang, Generalized approximate cross validation for support vector machines, or, another way to look at margin-like quantities, Technical Report, Department of Statistics, University of Wisconsin, February 25, 1999.
6. T.S. Jaakkola, D. Haussler, Probabilistic kernel regression models, Workshop in Conference on Artificial Intelligence and Statistics, 1999.
7. T. Joachims, Estimating the generalization performance of a svm efficiently, International Conference on Machine Learning, 2000, pp. 431-438.
8. Opper M., and Winther O. Mean field methods for classification with gaussian processes. The 1998 Conference on Advances in Neural Information Processing Systems II (1999), MIT Press, Cambridge, MA 309-315
9. Opper M., and Winther O. Gaussian processes and svm: mean field and leave-one-out. In: Smola A.J., Bartlett P.L., Schölkopf B., and Schuurmans D. (Eds). Advances in Large Margin Classifiers (2000), MIT Press, Cambridge, MA 311-326
10. O. Chapelle, V. Vapnik, Model selection for support vector machines, Adv. Neural Inf. Process. Syst., 1999, pp. 230-236.
11. Vapnick V., and Chapelle O. Bounds on error expectation for support vector machines. Neural Comput. 12 9 (2000)
12. Chapelle O., Vapnick V., Bousquet O., and Mukherjee S. Choosing ultiple parameters for support vector machines. Mach. Learn. 46 1 (2002) 131-159
13. Chung K.-M., Kao W.-C., Wang L.-L., Sun C.-L., and Lin C.-J. Radius margin bounds for support vector machines with the rbf kernel. Neural Comput. 15 11 (2003) 2643-2681
14. Ayat N.E., Cheriet M., and Suen C.Y. Automatic model selection for the optimization of the svm kernels. Pattern Recognition Comput.Sci. 38 10 (2005) 1733-1745
15. N.E. Ayat, Sélection automatique de modèle des machines à vecteurs de support: Application à la reconnaissance d'images de chiffres manuscrits, Ph.D. Thesis, École de Technologie Supérieure, University of Quebec, 2003.
16. N.E. Ayat, M. Cheriet, C.Y. Suen, Empirical error based optimization of svm kernels: application to digit image recognition, International Workshop on Handwriting Recognition, 2002, pp. 292-297.
17. Scholkopf B., Smola A.J., and Muller K.-R. Kernel principal component analysis. In: Scholkopf B., Burges C.J.C., and Smola A.J. (Eds). Advances in Kernel Methods: Support Vector Machines (1998), MIT Press, Cambridge, MA 327-352
18. Cristianini N., and Shawe-Taylor J. An Introduction to Support Vector Machines (2000), Cambridge University Press, Cambridge
19. Shawe-Taylor J., and Cristianini N. Kernel Methods for Pattern Analysis (2004), Cambridge University Press, Cambridge
20. Platt J. Probabilistic outputs for support vector machines and comparison to regularized likelihood methods. In: Smola A.J., Bartlett P., Schoelkopf B., and Schuurmans D. (Eds). Advances in Large Margin Classifiers (2000) 61-74
21. Bishop C.M. Neural Networks for Pattern Recognition (1995), Oxford University Press, Oxford, UK
22. H.-T. Lin, C.-J. Lin, R.C. Weng, A note on platts probabilistic outputs for support vector machines, Technical Report, May 2003.
23. Bengio Y. Gradient-based optimization of hyper-parameters. Neural Comput. 12 8 (2000) 1889-1900
24. N.A. Syed, H. Liu, K.K. Sung, Incremental learning with support vector machines, in: International Joint Conference on Artificial Intelligence, 1999.
25. Dong J.-X., Krzyzak A., and Suen C.Y. Fast svm training algorithm with decomposition on very large data sets. IEEE Trans. Pattern Anal. Mach. Intell. 27 4 (2005) 603-618
26. Rätsch G., Onoda T., and Müller K.-R. Soft margins for adaboost. Mach. Learn. 42 3 (2001) 287-320
27. M. Moreira, E. Mayoraz, Improved pairwise coupling classification with correcting classifiers, in: ECML, 1998, pp. 160-171.
28. G.-H. Tzeng, Y.-J. Goo, C.-H. Wu, W.-C. Fang, A real-valued genetic algorithm to optimize the parameters of support vector machine for predicting bankruptcy, Expert Systems With Applications, in press, corrected proof, available online 11 January 2006.