In-sample model selection for Support Vector Machines

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2011, Pages 1154-1161

  Anguita, Davide ^a   Ghio, Alessandro ^a   Oneto, Luca ^a   Ridella, Sandro ^a  

^a UNIVERSITY OF GENOA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

CROSS VALIDATION; FUNCTION SPACES; HYPERPARAMETERS; MODEL SELECTION; PRECISE CONTROL; SEQUENTIAL MINIMAL OPTIMIZATION; TRAINING SETS;

CLASSIFICATION (OF INFORMATION); NEURAL NETWORKS; OPTIMIZATION;

SUPPORT VECTOR MACHINES;

EID: 80054758777     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2011.6033354     Document Type: Conference Paper

References (26)

1. V. Vapnik, "An overview of statistical learning theory", IEEE Trans. On Neural Networks, vol. 10, pp. 988-999, 1999.
2. T. Joachims, "Learning to Classify Text using Support Vector Machines: Methods, Theory, and Algorithms", Kluwer, 2002.
3. T. Jaakkola, M. Diekhans, D. Haussler, "A discriminative framework for detecting remote protein homologies", Journal of Computational Biology, vol. 7, pp. 95-114, 2000.
4. B. Schoelkopf, K.K. Sung, C. Burges, F. Girosi, P. Niyogi, T. Poggio, V. Vapnik, "Comparing Support Vector Machines with Gaussian Kernels to Radial Basis Function Classifiers", IEEE Trans. on Signal Processing, vol. 45, pp. 2758-2765, 1997.
5. I. Guyon, A. Saffari, G. Dror, G. Cawley, "Model Selection: Beyond the Bayesian/Frequentist Divide", The Journal of Machine Learning Research, vol. 11, pp. 61-87, 2010
6. D. Anguita, S. Ridella, S. Rivieccio, "K-fold generalization capability assessment for support vector classifiers", Proc. of the Int. Joint Conf. on Neural Networks, pp. 855-858, Montreal, Canada, 2005.
7. B. Efron, R. Tibshirani, "An introduction to the Bootstrap", Chapmann and Hall, 1993.
8. O. Bousquet, A. Elisseeff, "Stability and generalization", Journal of Machine Learning Research, vol. 2, pp. 499-526, 2002.
9. D. Anguita, A. Ghio, N. Greco, L. Oneto, S. Ridella, "Model selection for support vector machines: Advantages and disadvantages of the machine learning theory", International Joint Conference on Neural Networks, 2010.
10. U.M. Braga-Neto, E.R. Dougherty, "Is cross-validation valid for smallsample microarray classification?", Bioinformatics, vol. 20, pp. 374-380, 2004.
11. A. Isaksson, M. Wallman, H. Goeransson, M.G. Gustafsson, "Cross-validation and bootstrapping are unreliable in small sample classification", Pattern Recognition Letters, vol. 29, pp. 1960-1965, 2008.
12. O. Chapelle, V. Vapnik, O. Bousquet, S. Mukherjee, "Choosing multiple parameters for Support Vector Machines", Machine Learning, vol. 46, pp. 131-159, 2002.
13. S. Floyd, M. Warmuth, "Sample compression, learnability, and the Vapnik-Chervonenkis dimension", Machine Learning, vol. 21, pp. 1-36, 1995.
14. V.N. Vapnik, "The nature of statistical learning theory", Springer Verlag, 2000.
15. P.L. Bartlett, S. Boucheron, G. Lugosi, "Model selection and error estimation", Machine Learning, vol. 48, pp. 85-113, 2002.
16. K. Duan, S.S. Keerthi, A.N. Poo, "Evaluation of simple performance measures for tuning SVM hyperparameters", Neurocomputing vol. 51, pp. 41-59, 2003
17. D. Anguita, A. Ghio, S. Ridella, "Maximal Discrepancy for Support Vector Machines", Neurocomputing, (in press), 2011.
18. A.N. Tikhonov, V.Y. Arsenin, "Solution of Ill-posed Problems", Winston & Sons, 1977.
19. L. Bottou, C.J. Lin, "Support Vector Machine Solvers", in "Large Scale Learning Machines", edited by L. Bottou, O. Chapelle, D. DeCoste, J. Weston, The MIT Press, pp. 1-28, 2007.
20. V.V. Ivanov, "The Theory of Approximate Methods and Their Application to the Numerical Solution of Singular Integral Equations", Nordhoff International, 1976.
21. L. Martein, S. Schaible, "On solving a linear program with one quadratic constraint", Decisions in Economics and Finance, vol. 10, 1987.
22. J.C. Platt, "Fast training of support vector machines using sequential minimal optimization", Advances in Kernel Methods, pp. 185-208, MIT press, 1999.
23. C.J. Lin, "Asymptotic convergence of an SMO algorithm without any assumption", IEEE Trans. on Neural Networks, vol. 13, pp. 248-250, 2002.
24. T. Hastie, S. Rosset, R. Tibshirani, J. Zhu, "The entire regularization path for the support vector machine", Journal of Machine Learning Research, vol. 5, pp. 1391-1415, 2004.
25. H. Larochelle, D. Erhan, A. Courville, J. Bergstra, Y. Bengio, "An empirical evaluation of deep architectures on problems with many factors of variation", Proc. of the Int. Conf. on Machine Learning, pp. 473-480, 2007.
26. S. Munder, D.M. Gavrila, "An Experimental Study on Pedestrian Classification", IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 28, pp. 1863-1868, 2006.