Fast bootstrap methodology for regression model selection

Neurocomputing

Volumn 64, Issue 1-4 SPEC. ISS., 2005, Pages 161-181

  Lendasse, A ^a   Simon, G ^b   Wertz, V ^b   Verleysen, M ^b,c  

^a AALTO UNIVERSITY   (Finland)

^b UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^c University Paris I Sorbonne Panthéon   (France)

Author keywords

Bootstrap; Model selection; Nonlinear modeling; Resampling

Indexed keywords

COMPUTATIONAL COMPLEXITY; ERROR DETECTION; LEAST SQUARES APPROXIMATIONS; POLYNOMIALS; REGRESSION ANALYSIS;

FAST BOOTSTRAP (FB) METHODOLOGY; MODEL GENERALIZED ERROR ESTIMATION; RADIAL-BASIS FUNCTIONS;

NEURAL NETWORKS;

ALGORITHM; ANALYSIS OF VARIANCE; ANALYTICAL ERROR; ANALYTICAL PARAMETERS; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER MODEL; COMPUTER SIMULATION; FISHER EXACT TEST; INFORMATION PROCESSING DEVICE; MATHEMATICAL MODEL; NONLINEAR SYSTEM; NORMAL DISTRIBUTION; PREDICTION; PRIORITY JOURNAL; REGRESSION ANALYSIS; STATISTICAL ANALYSIS; STRUCTURE ANALYSIS;

EID: 15844392541     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2004.11.017     Document Type: Article

References (21)

1. H. Akaike, Information theory and an extension of the maximum likelihood principle, in: Proceedings of second International Symposium on information Theory, Budapest, 1973, pp. 267-81.
2. D. Anguita A. Boni S. Ridella Evaluating the generalization ability of support vector machines through the bootstrap Neural Process Lett 11 1 2000 51-58
3. N. Benoudjit M. Verleysen On the kernel widths in radial-basis function networks Neural Process. Lett. 18 2 2003 139-154
4. C.M. Bishop Neural Networks for Pattern Recognition 1995 Oxford University Press Oxford
5. B. Efron R.J. Tibshirani An Introduction to the Bootstrap 1993 Chapman & Hall New York
6. W.H. Greene Econometric Analysis third ed. 1997 Prentice-Hall Englewood Cliffs, NJ
7. S. Haykin Neural Networks: A Comprehensive Foundation 1998 Prentice-Hall Upper Saddle River, NJ
8. R. Kohavi, A study of cross-validation and bootstrap for accuracy estimation and model selection, in: Proceedings of the 14th International Joint Conference on A.I., Montréal, 1995 2; pp. 1137-1143.
9. A. Lendasse, G. Simon, V. Wertz, M. Verleysen, Fast bootstrap for least-square support vector machines, in: Proceedings of the European Symposium on Artificial Neural Networks ESANN'2004, Bruges, April 2004, pp. 525-530.
10. A. Lendasse V. Wertz M. Verleysen Model selection with cross-validations and bootstraps-application to time series prediction with RBFN models in: O. Kaynak E. Alpaydin E. Oja L. Xu (Eds.) Artificial Neural Networks and Neural Information Processing-ICANN/ICONIP 2003 2003 Springer-Verlag Lecture Notes in Computer Science 2714 Berlin 573-580
11. L. Ljung System Identification-Theory for the User second ed. 1999 Prentice-Hall Upper Saddle River, NJ
12. J.E. Moody The effective Number of Parameters: An analysis of generalization and regularization in nonlinear learning systems Adv. Neural Inform. Process. Systems 1992 847-854
13. T. Poggio F. Girosi Networks for approximation and learning Proc. IEEE 78 9 1990 1481-1497
14. J. Shao D. Tu The Jackknife and Bootstrap, Series in Statistics 1995 Springer-Springer New York
15. G. Simon, A. Lendasse, M. Verleysen, 2003. Bootstrap for Model Selection: Linear Approximation of the Optimism, in: J. Mira, J.R. Alvarez (eds.), Computational Methods in Neural Modeling, Springer Lecture Notes in Computer Science, vol. 2686, Berlin, pp. I182-I189.
16. M. Stone An asymptotic equivalence of choice of model by cross-validation and Akaike's criterion J. Roy. Statist. Soc. B 39 1977 44-47
17. J.A.K. Suykens J. De brabanter L. Lukas J. Vandewalle Weighted least squares support vector machines: Robustness and sparse approximation Neurocomputing, Special Issue on fundamental and information processing aspects of neurocomputing 48 1-4 2002 85-105
18. J.A.K. Suykens, L. Lukas, J. Vandewalle, Sparse least squares support vector machine classifiers, in: Proceedings of the European Symposium on Artificial Neural Networks ESANN'2000, Bruges, 2000, pp. 37-42.
19. J.A.K. Suykens, T. Van Gestel, J. De Brabanter, B. De Moor, J. Vandewalle, Least squares support vector machines, World Scientific, Singapore, 2002, ISBN 981-238-151-1.
20. J.A.K. Suykens J. Vandewalle Training multilayer perceptron classifiers based on modified support vector method IEEE Trans. Neural Networks, 10 4 1999 907-911
21. A.S. Weigend N.A. Gershenfeld Time Series Prediciton: Forecasting the Future and Understanding the Past 1994 Addison-Wesley Reading, MA