The differogram: Non-parametric noise variance estimation and its use for model selection

Neurocomputing

Volumn 69, Issue 1-3, 2005, Pages 100-122

  Pelckmans, Kristiaan ^a   De Brabanter, Jos ^a   Suykens, Johan A K ^a   De Moor, Bart ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Complexity criteria; Kernel methods; Least squares support vector machines; Morozov's discrepancy method; Noise level

Indexed keywords

COMPUTER SIMULATION; LAGRANGE MULTIPLIERS; LEARNING SYSTEMS; LEAST SQUARES APPROXIMATIONS; MATHEMATICAL MODELS; MATRIX ALGEBRA; PARAMETER ESTIMATION; PROBABILITY DENSITY FUNCTION; VECTORS;

COMPLEXITY CRITERIA; KERNEL METHODS; LEAST SQUARES SUPPORT VECTOR MACHINES; MOROZOV DISCREPANCY METHOD;

NEURAL NETWORKS;

ARTICLE; CONTROLLED STUDY; DATA ANALYSIS; DECISION SUPPORT SYSTEM; MACHINE; MULTIVARIATE ANALYSIS; NOISE; NORMAL DISTRIBUTION; OBSERVATION; PRIORITY JOURNAL; REGRESSION ANALYSIS; SIMULATION; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICAL PARAMETERS;

EID: 27844500576     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2005.02.015     Document Type: Article

References (38)

1. H. Akaike Statistical predictor identification Ann. Inst. Statist. Math. 22 1973 203-217
2. C. Bishop Neural Networks for Pattern Recognition 1995 Oxford University Press Oxford
3. C.L. Blake, C.J. Merz, UCI repository of machine learning databases, 1998.
4. M.J. Buckley G.K. Eagleson The estimation of residual variance in nonparametric regression Biometrika 75 2 1988 189-199
5. O. Chapelle V. Vapnik O. Bousquet S. Mukherjee Choosing multiple parameters for support vector machines Machine Learning 46 1-3 2002 131-159
6. V. Cherkassky Ma. Yunqian Practical selection of SVM parameters and noise estimation for svm regression Neural Networks 17 2004 113-126
7. N.A.C. Cressie Statistics for Spatial Data 1993 Wiley New York
8. J. De Brabanter K. Pelckmans J.A.K. Suykens J. Vandewalle B. De Moor Robust cross-validation score function for non-linear function estimation, in: International Conference on Artificial Neural Networks Madrid, Spain 2002 pp. 713-719
9. L. Devroye L. Györfi D. Schäfer H. Walk The estimation problem of minimum mean squared error Statistics and Decisions 21 2003 15-28
10. P.J. Diggle Time-series: A Biostatistical Introduction 1990 Oxford University Press Oxford
11. R.L. Eubank Nonparameteric Regression and Spline Smoothing 1999 Marcel Dekker New York
12. T. Evgeniou M. Pontil T. Poggio Regularization networks and support vector machines Adv. Comput. Math. 13 1 2000 1-50
13. T. Gasser L. Sroka C. Jennen-Steinmetz Residual variance and residual pattern in nonlinear regression Biometrika 73 1986 625-633
14. G.H. Golub C.F. Van Loan Matrix Computations 1989 The John Hopkins University Press Baltimore, MD
15. W. Härdle Applied Nonparametric Regression, Econometric Society Monographs 1989 Cambridge University Press Cambridge
16. T. Hastie R. Tibshirani J. Friedman The Elements of Statistical Learning 2001 Springer Heidelberg
17. T.P. Hettmansperger, J.W. McKean, Robust Nonparametric Statistical Methods, Kendall's Library of Statistics, vol. 5, Arnold, 1994.
18. W. Hoeffding A class of statistics with asymptotically normal distribution Ann. Math. Stat. 19 1948 293-325
19. A.E. Hoerl R.W. Kennard K.F. Baldwin Ridge regression: Some simulations Commun. Stat. Part A - Theory and Methods 4 1975 105-123
20. P.J. Huber Robust estimation of a location parameter Ann. Math. Statist. 35 1964 73-101
21. A.J. Lee U-Statistics, Theory and Practice 1990 Marcel Dekker New York
22. D.J.C. MacKay The evidence framework applied to classification networks Neural Comput. 4 1992 698-714
23. C.L. Mallows Some comments on Cp Technometrics 15 1973 661-675
24. A.M. Mood F.A. Graybill D.C. Boes Introduction to the theory of statistics, Series in Probability and Statistics 1963 McGraw-Hill
25. V.A. Morozov Methods for Solving Incorrectly Posed Problems 1984 Springer Heidelberg
26. U.U. Müller A. Schick W. Wefelmeyer Estimating the error variance in nonparametric regression by a covariate-matched U-statistic Statistics 37 3 2003 179-188
27. A. Neumaier Solving ill-conditioned and singular linear systems: A tutorial on regularization SIAM Review 40 3 1998 636-666
28. T. Poggio F. Girosi Networks for approximation and learning Proc. IEEE 78 9 1990 1481-1497
29. J. Rice, Bandwidth choice for nonparametric regression, Ann. Stat. (12) (1984) 1215-1230.
30. B. Schölkopf A. Smola Learning with Kernels 2002 MIT Press Cambridge, MA
31. G. Schwartz Estimating the dimension of a model Ann. Stat. 6 1979 461-464
32. A. Sen M. Srivastava Regression Analysis, Theory, Methods and Applications 1997 Springer Heidelberg
33. J.A.K. Suykens T. Van Gestel J. De Brabanter B. De Moor J. Vandewalle Least Squares Support Vector Machines 2002 World Scientific
34. H. Tong Nonlinear Time Series Analysis: A Dynamic Approach 1990 Oxford University Press Oxford
35. T. Van Gestel J.A.K. Suykens D. Baestaens A. Lambrechts G. Lanckriet B. Vandaele B. De Moor J. Vandewalle Financial time series prediction using least squares support vector machines within the evidence framework IEEE Trans. Neural Networks (special issue on Neural Networks in Financial Engineering) 12 4 2001 809-821
36. V.N. Vapnik Statistical Learning Theory 1998 Wiley New York
37. J. von Neumann, I.N. Schoenberg, Fourier integrals and metric geometry, Trans. Am. Math. Soc. (50) (1941) 226-251.
38. G. Wahba Spline Models for Observational Data 1990 SIAM