Model selection in kernel based regression using the influence function

Journal of Machine Learning Research

Volumn 9, Issue , 2008, Pages 2377-2400

  Debruyne, Michiel ^a   Hubert, Mia ^a   Suykens, Johan A K ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Influence function; Kernel based regression; Model selection; Robustness; Stability

Indexed keywords

DISTRIBUTION FUNCTIONS; FUNCTIONS; KETONES; MAXIMUM LIKELIHOOD ESTIMATION; PROBABILITY DENSITY FUNCTION; SUBSIDENCE;

DEGREE OF ROBUSTNESSES; ESTIMATION PROCEDURES; HIGHER ORDERS; HYPER PARAMETERS; INFLUENCE FUNCTION; INFLUENCE FUNCTIONS; KERNEL BASED REGRESSION; KERNEL METHODS; LEAVE ONE OUTS; MODEL SELECTION; MODEL SELECTIONS; OUT-LIERS; RECURSIVE RELATIONS; ROBUSTNESS; SAMPLE DISTRIBUTIONS; STATISTICAL EFFICIENCIES; STATISTICAL LEARNINGS; TAYLOR EXPANSIONS;

METHOD OF MOMENTS;

EID: 56349086986     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (16)

1. D.D. Boos and R.J. Serfling. A note on differentials and the CLT and LIL for statistical functions. Annals of Statistics, 8:618-624, 1980.
2. O. Bousquet and A. Elisseeff. Stability and generalization. Journal of Machine Learning Research, 2:499-526, 2001.
3. A. Christmann and I. Steinwart. Consistency and robustness of kernel based regression. Bernoulli, 13:799-819, 2007.
4. A. Christmann and I. Steinwart. On robust properties of convex risk minimization methods for pattern recognition. Journal of Machine Learning Research, 5:1007-1034, 2004.
5. M. Debruyne, A. Christmann, M. Hubert, and J.A.K. Suykens. Robustness and stability of reweighted kernel based regression. Technical report TR 06-09, K.U. Leuven, available at http://wis.kuleuven.be/stat/robust, 2006.
6. E. DeVito, L. Rosasco, A. Caponnetto, M. Piana, and A. Verri. Some properties of regularized kernel methods. Journal of Machine Learning Research, 5:1363-1390, 2004.
7. T. Evgeniou, M. Pontil, and T. Poggio. Regularization networks and support vector machines. Advances in Computational Mathematics, 13:1-50, 2000.
8. L.T. Fernholz. Von Mises Calculus for Statistical Functionals. Lecture Notes in statistics 19, Springer, New York, 1983.
9. F.R. Hampel, E.M. Ronchetti, P.J. Rousseeuw, and W.A. Stahel. Robust Statistics: The Approach Based on Influence Functions. Wiley, New York, 1986.
10. P.J. Huber. Robust Statistics. Wiley, New York, 1981.
11. S. Kutin and P. Niyogi. Almost everywhere algorithmic stability and generalization error. In A. Daruich and N. Friedman, editors, Proceedings of Uncertainty in AI. Morgan Kaufmann, Edmonton, 2002.
12. T. Poggio, R. Rifkin, S. Mukherjee, and P. Niyogi. General conditions for predictivity in learning theory. Nature, 428:419-422, 2004.
13. J.A.K. Suykens, J. De Brabanter, L. Lukas, and J. Vandewalle. Weighted least squares support vector machines : Robustness and sparse approximation. Neurocomputing, 48:85-105, 2002a.
14. J.A.K. Suykens, T. Van Gestel, J. De Brabanter, B. De Moor, and J. Vandewalle. Least Squares Support Vector Machines. World Scientific, Singapore, 2002b.
15. A.N. Tikhonov and V.Y. Arsenin. Solutions of Ill Posed Problems. W.H. Winston, Washington D.C., 1977.
16. G. Wahba. Spline Models for Observational Data. CBMS-NSF Regional Conference Series in Applied Mathematics, SIAM, 1990.