Nonlinear identification with local model networks using GTLS techniques and equality constraints

IEEE Transactions on Neural Networks

Volumn 22, Issue 9, 2011, Pages 1406-1418

  Hametner, Christoph ^a   Jakubek, Stefan ^a  

^a VIENNA UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

Equality constraints; generalized total least squares; local model network; nonlinear system identification

Indexed keywords

EQUALITY CONSTRAINTS; EXPECTATION MAXIMIZATION; GENERALIZED TOTAL LEAST SQUARES; IDENTIFICATION PROCEDURE; ILLUSTRATIVE EXAMPLES; LOCAL MODEL; LOCAL MODEL NETWORKS; NON-LINEAR SYSTEM IDENTIFICATION; NONLINEAR IDENTIFICATIONS; NONLINEAR PROCESS; PARAMETER ESTIMATION PROCESS; PROCESS KNOWLEDGE; QUANTITATIVE KNOWLEDGE; REAL MEASUREMENTS; STRUCTURED KNOWLEDGE;

ESTIMATION; IDENTIFICATION (CONTROL SYSTEMS); INTEGRATION; NONLINEAR ANALYSIS; NONLINEAR SYSTEMS;

PARAMETER ESTIMATION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; HUMAN; NONLINEAR SYSTEM; REGRESSION ANALYSIS; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; HUMANS; LEAST-SQUARES ANALYSIS; MODELS, THEORETICAL; NONLINEAR DYNAMICS;

EID: 80052393867     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2159309     Document Type: Article

References (28)

1. J. Sjöberg, Q. Zhang, L. Ljung, A. Benveniste, B. Deylon, P.-Y. Glorennec, H. Hjalmarsson, and A. Juditsky, "Nonlinear black-box modeling in system identification: A unified overview", Automatica, vol. 31, no. 12, pp. 1691-1724, Dec. 1995.
2. A. Juditsky, H. Hjalmarsson, A. Benveniste, B. Delyon, L. Ljung, J. Sjöberg, and Q. Zhang, "Nonlinear black-box models in system identification: Mathematical foundations", Automatica, vol. 31, no. 12, pp. 1725-1750, Dec. 1995.
3. H. G. Zhang and D. Liu, Fuzzy Modeling and Fuzzy Control, 1st ed. Basle, Switzerland: Birkhauser, 2006.
4. L. Ljung, "Perspectives on system identification", in Proc. 17th IFAC World Congr., Jul. 2008, pp. 1-13.
5. A. Benavoli, L. Chisci, A. Farina, L. Ortenzi, and G. Zappa, "Hardconstrained versus soft-constrained parameter estimation", IEEE Trans. Aerosp. Electron. Syst., vol. 42, no. 4, pp. 1224-1239, Oct. 2006.
6. N. Zhou and J. W. Pierre, "Estimation of autoregressive parameters by the constrained total least square algorithm using a bootstrap method", in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. 4. Mar. 2005, pp. 417-420.
7. A. Benavoli, L. Chisci, and A. Farina, "Estimation of constrained parameters with guaranteed MSE improvement", IEEE Trans. Signal Process., vol. 55, no. 4, pp. 1264-1274, Apr. 2007.
8. Z. Wang and B. S. Peterson, "Constrained least absolute deviation neural networks", IEEE Trans. Neural Netw., vol. 19, no. 2, pp. 273-283, Feb. 2008.
9. G. Gregorcic and G. Lightbody, "Local model network identification with Gaussian processes", IEEE Trans. Neural Netw., vol. 18, no. 5, pp. 1404-1423, Sep. 2007.
10. S. V. Huffel and H. Zha, "The restricted total least squares problem: Formulation, algorithm, and properties", SIAM J. Matrix Anal. Appl., vol. 12, no. 2, pp. 292-309, Apr. 1991.
11. S. Van Huffel and J. Vandewalle, "Analysis and properties of the generalized total least squares problem AX ≈ B when some or all columns in A are subject to error", SIAM J. Matrix Anal. Appl., vol. 10, no. 3, pp. 294-315, 1989.
12. V. Cherkassky and Y. Ma, "Multiple model regression estimation", IEEE Trans. Neural Netw., vol. 16, no. 4, pp. 785-798, Jul. 2005.
13. O. Nelles, Nonlinear System Identification, 1st ed. New York: Springer-Verlag, 2002.
14. S. Jakubek and N. Keuth, "A local neuro-fuzzy network for high-dimensional models and optimization", Eng. Appl. Artif. Intell., vol. 19, no. 6, pp. 705-717, Sep. 2006.
15. J. Abonyi, R. Babuska, and F. Szeifert, "Modified Gath-Geva fuzzy clustering for identification of Takagi-Sugeno fuzzy models", IEEE Trans. Syst., Man, Cybern. Part B: Cybern., vol. 32, no. 5, pp. 612-621, Oct. 2002.
16. E. D. Lughofer, "FLEXFIS: A robust incremental learning approach for evolving Takagi-Sugeno fuzzy models", IEEE Trans. Fuzzy Syst., vol. 16, no. 6, pp. 1393-1410, Dec. 2008.
17. E. Lughofer and S. Kindermann, "SparseFIS: Data-driven learning of fuzzy systems with sparsity constraints", IEEE Trans. Fuzzy Syst., vol. 18, no. 2, pp. 396-411, Apr. 2010.
18. C. Hametner and S. Jakubek, "Neuro-fuzzy modelling using a logistic discriminant tree", in Proc. Amer. Control Conf., Jul. 2007, pp. 864-869.
19. S. Theodoridis and K. Koutroumbas, Pattern Recognition. San Diego, CA: Academic, 1999.
20. L. Breiman, J. Friedman, R. Olshen, and C. Stone, Classification and Regression Trees. Monterey, CA: Wadsworth & Brooks, 1984.
21. P. De Groen, "An introduction to total least squares", Nieuw Arch. Wiskun., vol. 14, no. 2, pp. 237-254, Jul. 1996.
22. W. Scherrer and C. Heij, "Consistency of system identification by global total least squares", Automatica, vol. 35, no. 6, pp. 993-1008, Jun. 1999.
23. I. Markovsky, J. Willems, S. Van Huffel, B. De Moor, and R. Pintelon, "Application of structured total least squares for system identification and model reduction", IEEE Trans. Autom. Control, vol. 50, no. 10, pp. 1490-1500, Oct. 2005.
24. R. Fletcher, Practical Methods of Optimization, 2nd ed. New York: Wiley, 1987.
25. P. E. Gill, W. Murray, and M. H. Wright, Practical Optimization. London, U. K.: Academic, 1981.
26. N. R. Draper and H. Smith, Applied Regression Analysis (Probability and Statistics), 3rd ed. New York: Wiley, 1998.
27. P. I. Feder, "On asymptotic distribution theory in segmented regression problems-identified case", Ann. Stat., vol. 3, no. 1, pp. 49-83, Jan. 1975.
28. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm", J. Royal Stat. Soc., Ser. B, vol. 39, no. 1, pp. 1-38, 1977.