Efficient approximation of cross-validation for kernel methods using Bouligand influence function

31st International Conference on Machine Learning, ICML 2014

Volumn 1, Issue , 2014, Pages 529-537

  Liu, Yong ^a   Jiang, Shali ^a   Liao, Shizhong ^a  

^a TIANJIN UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS;

CROSS VALIDATION; INFLUENCE FUNCTIONS; KERNEL METHODS; MODEL SELECTION; MODEL SELECTION CRITERIA; NOVEL STRATEGIES; RECENT RESEARCHES; TAYLOR EXPANSIONS;

METHOD OF MOMENTS;

EID: 84919816683     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. Aronszajn, Nachman. Theory of reproducing kernels. Transactions of the American Mathematical Society, 68: 337-404, 1950.
2. Bartlett, Peter L. and Mendelson, Shahar. Rademacher and gaussian complexities: Risk bounds and structural results. The Journal of Machine Learning Research, 3: 463-482, 2002.
3. Bartlett, Peter L., Boucheron, Stéphane, and Lugosi, Gabor. Model selection and error estimation. Machine Learning, 48:85-113, 2002.
4. Cawley, Gavin C. Leave-one-out cross-validation based model selection criteria for weighted ls-svms. In Proceeding of the International Joint Conference on Neural Networks (IJCNN2006), pp. 1661-1668, 2006.
5. Cawley, Gavin C. and Talbot, Nicola L. C. Preventing overfitting during model selection via bayesian régularisation of the hyper-parameters. Journal of Machine Learning Research, 8:841-861, 2007.
6. Chapelle, Olivier, Vapnik, Vladimir, Bousquet, Olivier, and Mukherjee, Sayan. Choosing multiple parameters for support vector machines. Machine Learning, 46(1-3): 131-159, 2002.
7. Christmann, Andreas and Messem, Arnout Van. Bouligand derivatives and robustness of support vector machines for regression. Journal of Machine Learning Research, 9:915-936, 2008.
8. Christmann, Andreas and Steinwart, Ingo. On robustness properties of convex risk minimization methods for pattern recognition. Journal of Machine Learning Research, 5:1007-1034, 2004.
9. Christmann, Andreas and Steinwart, Ingo. Consistency and robustness of kernel based regression. Bernoulli, 13: 799-819, 2007.
10. Christmann, Andreas, Messem, Arnout Van, and Steinwart, Ingo. On consistency and robustness properties of support vector machines for heavy-tailed distributions. Statistics and Its Interface, 2:311-327, 2009.
11. Debruyne, Michiel, Hubert, Mia, and Suykens, Johan A.K. Model selection in kernel based regression using the influence function. Journal of Machine Learning Research, 9:2377-2400, 2008.
12. Golub, Gene H., Heath, Michael, and Wahba, Grace. Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics, 21(2):215-223, 1979.
13. Hampel, Frank R, Ronchetti, Elvezio M, Rousseeuw, Peter J, and Stahel, Werner A. Robust Statistics: The Approach Based on Influence Functions. Wiley, New York, 1986.
14. Liu, Yong, Jiang, Shali, and Liao, Shizhong. Eigenvalues perturbation of integral operator for kernel selection. In Proceedings of the 22th ACM International Conference on Information and Knowledge Management (CIKM2013), 2013.
15. Luxburg, Ulrike Von, Bousquet, Olivier, and Scholkopf, Bernhard. A compression approach to Support Vector model selection. Journal of Machine Learning Research, 5:293-323, 2004.
16. Messem, Arnout Van and Christmann, Andreas. A review on consistency and robustness properties of support vector machines for heavy-tailed distributions. Advances in Data Analysis and Classification, 4(2-3): 199-220, 2010.
17. Robinson, Stephen M. An implicit-function theorem for a class of nonsmooth functions. Mathematics of Operations Research, 16:292-309, 1991.
18. Scholkopf, Bernhard and Smola, Alexander J. Learning with kernels. MIT Press, Cambridge, MA, 2002.
19. Shawe-Taylor, John and Cristianini, Nello. An introduction to support Vector Machines and other kernel-based learning methods. Cambridge University Press, 2000. ISBN 0521780195.
20. Steinwart, Ingo and Christmann, Andreas. Support vector machines. Springer Verlag, New York, 2008.
21. Suykens, Johan A. K. and Vandewalle, Joos. Least squares Support Vector Machine classifiers. Neural Processing Letters, 9(3):293-300, 1999.
22. Vapnik, Vladimir. The nature of statistical learning theory. Springer Verlag, 2000.
23. Vito, Ernesto De, Rosasco, Lorenzo, Caponnetto, Andrea, Piana, Michele, and Verri, Alessandro. Some properties of regularized kernel methods. Journal of Machine Learning Research, 5:1363-1390, 2004.
24. Wahba, Grace. Spline Models for Observational Data. CBMS-NSF Regional Conference Series in Applied Mathematics, SIAM, 1990.
25. Wahba, Grace, Lin, Yi, and Zhang, Hao. GACV for support vector machines. In Advances in Large Margin Classifiers. MIT Press, Cambridge, , 1999.