An adaptive orthogonal search algorithm for model subset selection and non-linear system identification

International Journal of Control

Volumn 81, Issue 5, 2008, Pages 714-724

  Billings, S A ^a   Wei, H L ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; ERROR ANALYSIS; IDENTIFICATION (CONTROL SYSTEMS); MATHEMATICAL MODELS; PROBLEM SOLVING;

CANDIDATE MODEL TERMS; INHERENT DYNAMICS; MODEL STRUCTURE;

NONLINEAR SYSTEMS;

EID: 41849127835     PISSN: 00207179     EISSN: 13665820     Source Type: Journal    
DOI: 10.1080/00207170701216311     Document Type: Article

References (31)

1. D.M. Allen, "The relationship between variable selection and data augmentation and a method for prediction", Technometrics, 16, pp. 125-127, 1974.
2. A. R. Barron and X.Y. Xiao, "Discussion: multivariate adaptive regression splines", Ann. Stat., 19, pp. 67-82, 1991.
3. S.A. Billings and S. Chen, The determination of multivariable nonlinear models for dynamic systems using neural networks", in Neural Network Systems Techniques and Applications, C.T. Leondes, Ed., San Diego: Academic Press, 1998, pp. 231-278.
4. S.A. Billings and G.N. Jones, "Orthogonal least-squares parameter-estimation algorithms for nonlinear stochastic-systems", Int. J. Syst. Sci., 23, pp. 1019-1032, 1992.
5. S.A. Billings and W.S.F. Voon, "Correlation based model validity tests for nonlinear models", Int. J. Com., 44, pp. 235-244, 1986.
6. S.A. Billings and H.L. Wei, "A new class of wavelet networks for nonlinear system identification", IEEE Trans. Neural Networks, 16, pp. 862-874, 2005.
7. S.A. Billings, S. Chen and M.J. Korenberg, "Identification of MIMO non-linear systems suing a forward regression orthogonal estimator", Int. J. Com., 49, pp. 2157-2189, 1989.
8. G.E.P. Box, G.M. Jenkins and G.C. Reinsel, Time Series Analysis: Forecasting and Cont., 3rd ed., New Jersey: Prentice Hall, 1994.
9. S. Chen, S.A. Billings and W. Luo, "Orthogonal least squares methods and their application to non-linear system identification", Int. J. Cont., 50, pp. 1873-1896, 1989.
10. S. Chen, C.F.N. Cowan and P.M. Grant, "Orthogonal least-squares learning algorithm for radial basis function networks", IEEE Trans. Neural Networks, 2, pp. 302-309, 1991.
11. S. Chen, X. Hong and C.J. Harris, "Sparse kernel density construction using orthogonal forward regression with leave-one-out test score and local regularization", IEEE Trans. Syst. Man, Cyber. B, 34, pp. 1708-1717, 2004b.
12. S. Chen, X. Hong, C.J. Harris and P.M. Sharkey, "Sparse modeling using orthogonal regression with PRESS statistic and regularization", IEEE Trans. Syst. Man, Cyber. B, 34, pp. 898-911, 2004a.
13. P. Craven and G. Wahba, "Smoothing noisy data with spline functions - estimating the correct degree of smoothing by the method of generalized cross-validation", Numer. Math., 31, pp. 377-403, 1979.
14. J.H. Friedman, "Multivariate adaptive regression splines", Ann. Stat., 19, pp. 1-67, 1991.
15. J.H. Friedman and B.W. Silverman, "Flexible parsimonious smoothing and additive modeling", Technometrics, 31, pp. 3-21, 1989.
16. G.H. Golub, M. Heath and G. Wahha, "Generalized cross-validation as a method for choosing a good ridge parameter", Technometrics, 21, pp. 215-223, 1979.
17. W. Gonzalez-Manteiga, A. Quintela-del-Ro and P. Vieu, "A note on variable selection in nonparametric regression with dependent data", Stat. Prob. Lett., 57, pp. 259-268, 2002.
18. X. Hong, P.M. Sharkey and K. Warwick, "A robust nonlinear identification algorithm using PRESS statistic and forward regression", IEEE Trans. Neural Networks, 14, pp. 454-458, 2003.
19. X. Hong, M. Brown, S. Chen and C.J. Harris, "Sparse model identification using orthogonal, forward regression with basis pursuit and D-optimality", IEE Proc. Contr. Theory. Appl., 151, pp. 491-498, 2004.
20. J.H.Z. Huang and L.J. Yang, "Identification of non-linear additive autoregressive models", J. Royal Statistical Soe. Ser. B, Part 2, 66, pp. 463-477, 2004.
21. L. Ljung, System Identification: Theory for the User, Englewood Cliffs: Prentice-Hall, 1987.
22. A.J. Miller, Subset Selection in Regression, London: Chapman and Hall, 1990.
23. R. Myers, Classical and Modern Regression with Applications, 2nd ed., Boston: PWS-KENT Publishing Company, 1990.
24. T. Söderström and P. Stoica, System Identification, New York: Prentice Hall, 1989.
25. P. Stoica, P. Eykhoff, P. Janssen and T. Söderström, "Model-structure selection by cross-validation", Int. J. Com., 43, pp. 1841-1878, 1986.
26. M. Stone, "Cross-validity choice and assessment of statistical predictor", J. Roy. Statist. Soc, 36, pp. 111-147, 1974.
27. D. Tjostheim and B.H. Auestad, "Nonparametric identification of nonlinear time series: selecting significant lags", J. Amer. Statis. Assoc., 89, pp. 1410-1419, 1994.
28. R. Tschernig and L.J. Yang, "Nonparametric lags selection for time series", J. Time Series Anal., 21, pp. 457-487, 2000.
29. P. Vieu, "Order choice in nonlinear autoregressive models", Statistics, 26, pp. 307-328, 1995.
30. H.L. Wei, S.A. Billings and J. Liu, "Term and variable selection for nonlinear system identification", Int. J. Cont., 77, pp. 86-110, 2004.
31. Q.M. Zhu and S.A. Billings, "Fast orthogonal identification of nonlinear stochastic models and radial basis function neural networks", Int. J. Cont., 64, pp. 871-886, 1996.