Nonlinear system identification via direct weight optimization

Automatica

Volumn 41, Issue 3, 2005, Pages 475-490

  Roll, Jacob ^a   Nazin, Alexander ^b   Ljung, Lennart ^a  

^a LINKÖPING UNIVERSITY   (Sweden)

^b TRAPEZNIKOV INSTITUTE OF CONTROL SCIENCES   (Russian Federation)

Author keywords

Function approximation; Local structures; Mean square error; Minimax techniques; Nonlinear systems; Nonparametric identification; Quadratic programming

Indexed keywords

ALGORITHMS; ERROR CORRECTION; LEAST SQUARES APPROXIMATIONS; MATHEMATICAL MODELS; NONLINEAR CONTROL SYSTEMS; OPTIMIZATION; PROBLEM SOLVING; QUADRATIC PROGRAMMING; REGRESSION ANALYSIS;

FUNCTION APPROXIMATION; LOCAL STRUCTURES; MEAN-SQUARE ERRORS; MINIMAX TECHNIQUES; NONPARAMETRIC IDENTIFICATION;

IDENTIFICATION (CONTROL SYSTEMS);

EID: 13244288637     PISSN: 00051098     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.automatica.2004.11.010     Document Type: Conference Paper

References (38)

1. C.G. Atkeson, A.W. Moore, and S. Schaal Locally weighted learning Artificial Intelligence Review 11 1-5 1997 11 73
2. S. Boyd, and L. Vandenberghe Convex optimization 2004 Cambridge University Press Cambridge
3. M.W. Braun, D. Rivera, and A. Stenman A model-on-demand identification methodology for non-linear process systems International Journal of Control 74 18 2001 1708 1717
4. S. Chen, and S.A. Billings Neural networks for nonlinear dynamic system modeling and identification International Journal of Control 56 2 1992 319 346
5. W.S. Cleveland, and S.J. Devlin Locally weighted regression An approach to regression analysis by local fitting Journal of the American Statistical Association 83 403 1988 596 610
6. N.A.C. Cressie Convex optimization 1993 Wiley New York
7. G. Cybenko Approximation by superpositions of a sigmoidal functions Mathematics of Control, Signals and Systems 2 1989 303 314
8. J.R. Deller Set membership identification in digital signal processing IEEE ASSP Magazine 6 4 1989 4 20
9. V.A. Epanechnikov Non-parametric estimation of a multivariate probability density Theory of Probability and its Applications 14 1969 153 158
10. J. Fan, and I. Gijbels Local polynomial modelling and its applications 1996 Chapman & Hall London
11. Gibbs, M. N. (1997). Bayesian Gaussian processes for regression and classification. Ph.D. thesis, University of Cambridge.
12. Härdle, W. (1990). Applied nonparametric regression. Econometric society monographs (vol. 19). Cambridge: Cambridge University Press.
13. C. Harris, X. Hong, and Q. Gan Adaptive modelling, estimation and fusion from data A neurofuzzy approach 2002 Springer Berlin
14. ILOG, Inc. (2000). CPLEX 7.0 user's manual. Gentilly, France.
15. Juditsky, A., Nazin, A., Roll, J., & Ljung, L. (2004). Adaptive DWO estimator of a regression function. In NOLCOS'04. Stuttgart, September 2004.
16. I.L. Legostaeva, and A.N. Shiryaev Minimax weights in a trend detection problem of a random process Theory of Probability and its Applications 16 2 1971 344 349
17. S.L. Leonov Remarks on extremal problems in nonparametric curve estimation Statistics & Probability Letters 43 2 1999 169 178
18. I.J. Leontaritis, and S.A. Billings Input-output parametric models for non-linear systems - part ii Stochastic non-linear systems International Journal of Control 41 2 1985 329 344
19. O.V. Lepski, and V.G. Spokoiny Optimal pointwise adaptive methods in nonparametric estimation The Annals of Statistics 25 6 1997 2512 2546
20. p. Technometrics 15 1973 661 676
21. M. Milanese, and G. Belforte Estimation theory and uncertainty intervals evaluation in presence of unknown but bounded errors Linear families of models and estimators IEEE Transactions on Automatic Control 27 2 1982 408 414
22. Milanese, M., Norton, J., Piet-Lahanier, H., & Walter, É. (Eds.) (1996). Bounding approaches to system identification. New York: Kluwer Academic/Plenum Publishers.
23. E.A. Nadaraya On estimating regression Theory of Probability and its Applications 10 1964 186 190
24. Narendra, K. S., & Li, S.-M. (1996). Neural networks in control systems. In P. Smolensky, M. C. Mozer, & D. E. Rumelhart (Eds.), Mathematical perspectives on neural networks (pp. 347-394). London: Lawrence Erlbaum Associates.
25. Nazin, A., Roll, J., & Ljung, L. (2003). A study of the DWO approach to function estimation at a given point: Approximately constant and approximately linear function classes. Technical Report LiTH-ISY-R-2578, Department of Electrical Engineering, Linköping University, SE-581 83 Linköping, Sweden.
26. Rasmussen, C. E. (1996). Evaluation of Gaussian processes and other methods for non-linear regression. Ph.D. thesis, University of Toronto.
27. Roll, J. (2003). Local and piecewise affine approaches to system identification. Ph.D. thesis, Department of Electrical Engineering, Linköping University, SE-581 83 Linköping, Sweden.
28. Roll, J., Nazin, A., & Ljung, L. (2002). A non-asymptotic approach to local modelling. In The 41st IEEE conference on decision and control (pp. 638-643), December 2002.
29. Roll, J., Nazin, A., & Ljung, L. (2003a). Local modelling of nonlinear dynamic systems using direct weight optimization. In 13th IFAC symposium on system identification (pp. 1554-1559), Rotterdam, August 2003.
30. Roll, J., Nazin, A., & Ljung, L. (2003b). Local modelling with a priori known bounds using direct weight optimization. In European control conference, Cambridge, September 2003.
31. Roll, J., Nazin, A., & Ljung, L. (2004). A general direct weight optimization framework for nonlinear system identification. To be presented at the 16th IFAC world congress on automatic control 2005, Prague, Czech Republic.
32. J. Sacks, and D. Ylvisaker Linear estimation for approximately linear models The Annals of Statistics 6 5 1978 1122 1137
33. F.C. Schweppe Recursive state estimation Unknown but bounded errors and system inputs IEEE Transactions on Automatic Control 13 1 1968 22 28
34. J. Sjöberg, Q. Zhang, L. Ljung, A. Benveniste, B. Delyon, P.Y. Glorennec, H. Hjalmarsson, and A. Juditsky Nonlinear black-box modeling in system identification A unified overview Automatica 31 12 1995 1691 1724
35. Stenman, A. (1999). Model on demand: Algorithms, analysis and applications. Ph.D. thesis, Department of Electrical Engineering, Linköping University, SE-581 83 Linköping, Sweden.
36. J.A.K. Suykens, T. van Gestel, J. De Brabanter, B. De Moor, and J. Vandewalle Least squares support vector machines 2002 World Scientific Singapore
37. M. Vidyasagar A theory of learning and generalization 1997 Springer London
38. G.S. Watson Smooth regression analysis Sankhyā, Series A 26 1964 359 372