Model selection for support vector machines: Advantages and disadvantages of the Machine Learning Theory

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2010, Pages

  Anguita, Davide ^a   Ghio, Alessandro ^a   Greco, Noemi ^a   Oneto, Luca ^a   Ridella, Sandro ^a  

^a UNIVERSITY OF GENOA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

STATISTICAL METHODS;

CROSS VALIDATION; HYPER-PARAMETER; LEARNING THEORY; LEAVE ONE OUT; MACHINE-LEARNING; MODEL SELECTION; NUMBER OF SAMPLES; SMALL SAMPLES; SUPPORT VECTORS MACHINE; SVM MODEL;

SUPPORT VECTOR MACHINES;

EID: 79959401322     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2010.5596450     Document Type: Conference Paper

References (30)

1. V. Vapnik, "An overview of statistical learning theory", IEEE Transactions on Neural Networks, vol. 10, pp. 988-999, 1999.
2. C.J. Lin, "Asymptotic convergence of an SMO algorithm without any assumptions", IEEE Transactions on Neural Networks, vol. 13, pp. 248-250, 2002.
3. B. L. Milenova, J. S. Yarmus, M. M. Campos, " SVM in Oracle database 10g: Removing the barriers to widespread adoption of Support Vector Machines", Proc. of the 31st Int. Conf. on Very Large Data Bases, pp. 1152-1163, 2005.
4. D. Anguita, A. Boni, S. Ridella, F. Rivieccio, D. Sterpi, "Theoretical and practical model selection methods for Support Vector classifiers", in "Support Vector Machines: Theory and Applications", edited by L. Wang, Springer, 2005.
5. B. Schoelkopf, A. Smola, Learning with Kernels, The MIT Press, 2002.
6. J. Shawe-Taylor, N. Cristianini, "Margin distribution and soft margin", in "Advances in Large Margin Classifiers", edited by A. Smola, P. Bartlett, B. Schoelkopf, D. Schuurmans, The MIT Press, 2000.
7. K. Duan, S. S. Keerthy, A. Poo, " Evaluation of simple performance measures for tuning SVM parameters", Neurocomputing, vol. 51, pp. 41-59, 2003.
8. R. Kohavi, "A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection", Proc. of the Int. Joint Conf. on Artificial Intelligence, 1995.
9. D. Anguita, S. Ridella, S. Rivieccio, " K-fold generalization capability assessment for support vector classifiers", Proc. of the Int. Joint Conf. on Neural Networks, pp. 855-858, Montreal, Canada, 2005.
10. O. Bousquet, A. Elisseeff, " Stability and generalization", Journal of Machine Learning Research, vol. 2, pp. 499-526, 2002.
11. B. Efron, R. Tibshirani, An introduction to the Bootstrap, Chapmann and Hall, 1993.
12. V. Vapnik, The Nature of Statistical Learning Theory, Springer, 2000.
13. T. Poggio, R. Rifkin, S. Mukherjee, P. Niyogi, "General conditions for predictivity in learning theory", Nature, vol. 428, pp. 419-422, 2004.
14. P.L. Bartlett, S. Boucheron, G. Lugosi, "Model selection and error estimation", Machine Learning, vol. 48, pp. 85-113, 2002.
15. U.M. Braga-Neto, E.R. Dougherty, "Is cross-validation valid for small-sample microarray classification?", Bioinformatics, vol. 20, pp. 374-380, 2004.
16. A. Isaksson, M. Wallman, H. Goeransson, M.G. Gustafsson, "Cross-validation and bootstrapping are unreliable in small sample classification", Pattern Recognition Letters, vol. 29, pp. 1960-1965, 2008.
17. D. Anguita, A. Ghio, S. Ridella, "Maximal Discrepancy for Support Vector Machines", Proc. of European Symposium on Artificial Neural Networks, Bruges, Belgium, 2010.
18. L. Bottou, C.J. Lin, " Support Vector Machine Solvers", in "Large Scale Learning Machines", edited by L. Bottou, O. Chapelle, D. DeCoste, J. Weston, The MIT Press, pp. 1-28, 2007.
19. S. Boucheron, O. Bousquet, G. Lugosi, "Theory of Classification: a Survey of Recent Advances", ESAIM: Probability and Statistics, vol. 9, pp. 323-375, 2005.
20. L. Wang, H. Jia, J. Li, "Training robust support vector machines with smooth ramp loss in the primal space", Neurocomputing, vol. 71, pp. 3020-3025, 2008.
21. L. Martein, S. Schaible, "On solving a linear program with one quadratic constraint", Decisions in Economics and Finance, vol. 10, 1987.
22. C.-W. Hsu, C.-C. Chang, C.-J. Lin, "A practical guide to support vector classification", Technical report, Dept. of Computer Science, National Taiwan University, 2003.
23. T. Hastie, S. Rosset, R. Tibshirani, J. Zhu, "The Entire Regularization Path for the Support Vector Machine", Journal of Machine Learning Research, Vol. 5, pp. 1391-1415, 2004.
24. A. Statnikov, C.F. Aliferis, I. Tsamardinos, D. Hardin, S. Levy. "A Comprehensive Evaluation of Multicategory Classification Methods for Microarray Gene Expression Cancer Diagnosis", Bioinformatics, vol. 21, pp. 631-643, 2005.
25. H. Larochelle, D. Erhan, A. Courville, J. Bergstra, Y. Bengio, "An empirical evaluation of deep architectures on problems with many factors of variation", Proc. of the International Conference on Machine Learning, pp. 473-480, 2007.
26. M. Aupetit, "Nearly homogeneous multi-partitioning with a deterministic generator", Neurocomputing, vol. 72, pp. 1379-1389, 2009.
27. A. Statnikov, I. Tsamardinos, Y. Dosbayev, C.F. Aliferis, "GEMS: A System for Automated Cancer Diagnosis and Biomarker Discovery from Microarray Gene Expression Data", International Journal of Medical Informatics, vol. 74, pp. 491-503, 2005.
28. D. Page, F. Zhan, J. Cussens, W. Waddell, J. Hardin, B. Barlogie, J. Shaughnessy, "Comparative Data Mining for Microarrays: A Case Study Based on Multiple Myeloma", Proc. of International Conference on Intelligent Systems for Molecular Biology, 2002.
29. N. Ancona, R. Maglietta, A. Piepoli, A. D'Addabbo, R. Cotugno, M. Savino, S. Liuni, M. Carella, G. Pesole, F. Perri, "On the statistical assessment of classifiers using DNA microarray data", Bioinformatics, vol. 7, 2006.
30. O. Chapelle, "Training a Support Vector Machine in the Primal", Neural Computation, vol. 19, pp. 1155-1178, 2007.