Identification methods for Hammerstein nonlinear systems

Digital Signal Processing: A Review Journal

Volumn 21, Issue 2, 2011, Pages 215-238

  Ding, Feng ^a   Liu, Xiaoping Peter ^b   Liu, Guangjun ^c  

^a JIANGNAN UNIVERSITY   (China)

^b CARLETON UNIVERSITY   (Canada)

^c RYERSON UNIVERSITY   (Canada)

Author keywords

Hammerstein models; Least squares; Newton iterations; Parameter estimation; Projection algorithm; Recursive identification; Stochastic gradient; Wiener models

Indexed keywords

COMPUTATIONAL EFFICIENCY; NEWTON-RAPHSON METHOD; NONLINEAR SYSTEMS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS;

HAMMERSTEIN MODEL; LEAST SQUARE; NEWTON ITERATIONS; PROJECTION ALGORITHMS; RECURSIVE IDENTIFICATION; STOCHASTIC GRADIENT; WIENER MODELS;

PARAMETER ESTIMATION;

EID: 79551472381     PISSN: 10512004     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dsp.2010.06.006     Document Type: Article

References (104)

1. M.B. Malik, and M. Salman State-space least mean square Digital Signal Process. 18 3 2008 334 345
2. L.L. Han, and F. Ding Multi-innovation stochastic gradient algorithms for multi-input multi-output systems Digital Signal Process. 19 4 2009 545 554
3. J. Ding, Y. Shi, H.G. Wang, and F. Ding A modified stochastic gradient based parameter estimation algorithm for dual-rate sampled-data systems Digital Signal Process. 20 4 2010 1238 1249
4. D.Q. Wang, and F. Ding Input-output data filtering based recursive least squares identification for CARARMA systems Digital Signal Process. 20 4 2010 991 999
5. F. Ding, and T. Chen Parameter estimation for dual-rate systems with finite measurement data Dynam. Contin. Discrete Impuls. Syst. Ser. B: Appl. Algorithms 11 1-2 2004 101 121
6. H.Z. Yang, J. Li, and F. Ding A neural network learning algorithm of chemical process modeling based on the extended Kalman filter Neurocomputing 70 4-6 2007 625 632
7. F. Ding, and T. Chen Least squares based self-tuning control of dual-rate systems Int. J. Adapt. Control Signal Process. 18 8 2004 697 714
8. F. Ding, T. Chen, and Z. Iwai Adaptive digital control of Hammerstein nonlinear systems with limited output sampling SIAM J. Control Optim. 45 6 2006 2257 2276
9. F. Ding, and T. Chen A gradient based adaptive control algorithm for dual-rate systems Asian J. Control 8 4 2006 314 323
10. Y. Liu, and E.W. Bai Iterative identification of Hammerstein systems Automatica 43 2 2007 346 354
11. K.S. Narendra, and P.G. Gallman An iterative method for the identification of nonlinear systems using a Hammerstein model IEEE Trans. Automat. Control 11 3 1966 546 550
12. F. Chang, and R. Luus A noniterative method for identification using Hammerstein model IEEE Trans. Automat. Control 16 5 1971 464 468
13. N.D. Haist, F. Chang, and R. Luus Nonlinear identification in the presence of correlated noise using a Hammerstein model IEEE Trans. Automat. Control 18 5 1973 553 555
14. Y. Zhu Identification of Hammerstein models for control using ASYM Int. J. Control 73 18 2000 1692 1702
15. J. Vörös Iterative algorithm for parameter identification of Hammerstein systems with two-segment nonlinearities IEEE Trans. Automat. Control 44 11 1999 2145 2149
16. E.W. Bai, and D. Li Convergence of the iterative Hammerstein system identification algorithm IEEE Trans. Automat. Control 49 11 2004 1929 1940
17. J. Vörös Modeling and parameter identification of systems with multi-segment piecewise-linear characteristics IEEE Trans. Automat. Control 47 1 2002 184 188
18. J. Vörös Parameter identification of discontinuous Hammerstein systems Automatica 33 6 1997 1141 1146
19. J. Vörös Recursive identification of Hammerstein systems with discontinuous nonlinearities containing dead-zones IEEE Trans. Automat. Control 48 12 2003 2203 2206
20. H.F. Chen Strong consistency of recursive identification for Hammerstein systems with discontinuous piecewise-linear memoryless block IEEE Trans. Automat. Control 50 10 2005 1612 1617
21. E.W. Bai Identification of linear systems with hard input nonlinearities of known structure Automatica 38 5 2002 853 860
22. E.W. Bai A blind approach to the Hammerstein-Wiener model identification Automatica 38 6 2002 967 979
23. V. Cerone, and D. Regruto Parameter bounds for discrete-time Hammerstein models with bounded output errors IEEE Trans. Automat. Control 48 10 2003 1855 1860
24. F. Ding, and T. Chen Identification of Hammerstein nonlinear ARMAX systems Automatica 41 9 2005 1479 1489
25. F. Ding, Y. Shi, and T. Chen Gradient-based identification methods for Hammerstein nonlinear ARMAX models Nonlinear Dynam. 45 1-2 2006 31 43
26. F. Ding, Y. Shi, and T. Chen Auxiliary model based least-squares identification methods for Hammerstein output-error systems Systems Control Lett. 56 5 2007 373 380 (Pubitemid 46435731)
27. D.Q. Wang, and F. Ding Extended stochastic gradient identification algorithms for Hammerstein-Wiener ARMAX systems Comput. Math. Appl. 56 12 2008 3157 3164
28. J. Chen, Y. Zhang, and R.F. Ding Auxiliary model based multi-innovation algorithms for multivariable nonlinear systems Math. Comput. Modelling 2010 10.1016/j.mcm.2010.05.026
29. Y. Yu, J.B. Zhang, Y.W. Liao, and J. Ding Parameter estimation error bounds for Hammerstein finite impulsive response models Appl. Math. Comput. 202 2 2008 472 480
30. E.W. Bai An optimal two-stage identification algorithm for Hammerstein-Wiener nonlinear systems Automatica 34 3 1998 333 338
31. F. Ding, and T. Chen Author's reply to "Comments on a'Identification of Hammerstein nonlinear ARMAX systemsa" Automatica 43 8 2007 1497
32. M. Verhaegen, and D. Westwick Identifying MIMO Hammerstein systems in the context of subspace model identification methods Int. J. Control 63 2 1996 331 349 (Pubitemid 126713396)
33. M.I. Goethals, K. Pelckmans, J.A.K. Suykens, and B. De Moor Subspace identification of Hammerstein systems using least squares support vector machines IEEE Trans. Automat. Control 50 10 2005 1509 1519 (Pubitemid 41555601)
34. G. Golub, and V. Pereyra Separable nonlinear least squares: the variable projection method and its applications Inverse Problems 19 2 2003 R1 R26
35. L. Ljung System Identification: Theory for the User 2nd ed. 1999 Prentice-Hall Englewood Cliffs, NJ
36. J. Bruls, C.T. Chou, B. Haverkamp, and M. Verhaegen Linear and nonlinear system identification using separable least squares Eur. J. Control 5 11 1999 116 128
37. D. Westwick, and R. Kearney Separable least squares identification of nonlinear Hammerstein models: Application to stretch reflex dynamics Ann. Biomed. Eng. 29 8 2001 707 718
38. E.W. Bai, and M. Fu A blind approach to Hammerstein model identification IEEE Trans. Signal Process. 50 7 2002 1610 1619
39. J. Wang, A. Sano, D. Shook, T. Chen, and B. Huang A blind approach to closed-loop identification of Hammerstein systems Int. J. Control 80 2 2007 302 313
40. L. Vanbeylen, R. Pintelon, and J. Schoukens Blind maximum likelihood identification of Hammerstein systems Automatica 44 12 2008 3139 3146
41. F. Ding, and T. Chen Gradient based iterative algorithms for solving a class of matrix equations IEEE Trans. Automat. Control 50 8 2005 1216 1221
42. F. Ding, and T. Chen Iterative least squares solutions of coupled Sylvester matrix equations Systems Control Lett. 54 2 2005 95 107
43. F. Ding, and T. Chen On iterative solutions of general coupled matrix equations SIAM J. Control Optim. 44 6 2006 2269 2284
44. F. Ding, P.X. Liu, and J. Ding Iterative solutions of the generalized Sylvester matrix equations by using the hierarchical identification principle Appl. Math. Comput. 197 1 2008 41 50
45. L. Xie, J. Ding, and F. Ding Gradient based iterative solutions for general linear matrix equations Comput. Math. Appl. 58 7 2009 1441 1448
46. J. Ding, Y.J. Liu, and F. Ding Iterative solutions to matrix equations of form AiXBi=Fi Comput. Math. Appl. 59 11 2010 3500 3507
47. F. Ding Transformations between some special matrices Comput. Math. Appl. 59 8 2010 2676 2695
48. F. Ding, P.X. Liu, and G. Liu Gradient based and least-squares based iterative identification methods for OE and OEMA systems Digital Signal Process. 20 3 2010 664 677
49. Y.J. Liu, D.Q. Wang, and F. Ding Least-squares based iterative algorithms for identifying Box-Jenkins models with finite measurement data Digital Signal Process. 20 5 2010 1458 1467
50. D.Q. Wang, and F. Ding Gradient-based iterative parameter estimation for Box-Jenkins systems Comput. Math. Appl. 2010 10.1016/j.camwa.2010.06.001
51. F. Ding, and T. Chen Hierarchical gradient-based identification of multivariable discrete-time systems Automatica 41 2 2005 315 325 (Pubitemid 41536582)
52. F. Ding, and T. Chen Hierarchical least squares identification methods for multivariable systems IEEE Trans. Automat. Control 50 3 2005 397 402 (Pubitemid 40448592)
53. L.Y. Wang, F. Ding, and P.X. Liu Consistency of HLS estimation algorithms for MIMO ARX-like systems Appl. Math. Comput. 190 2 2007 1081 1093
54. H.Q. Han, L. Xie, F. Ding, and X.G. Liu Hierarchical least squares based iterative identification for multivariable systems with moving average noises Math. Comput. Modelling 51 9-10 2010 1213 1220
55. X.G. Liu, and J. Lu Least squares based iterative identification for a class of multirate systems Automatica 46 3 2010 549 554
56. P. Stoica On the convergence of an iterative algorithm used for Hammerstein system identification IEEE Trans. Automat. Control 26 4 1981 967 969
57. P. Stoica, and T. Söderström Instrumental variable methods for identification of Hammerstein systems Int. J. Control 35 3 1982 459 476
58. D.Q. Wang, Y.Y. Chu, and F. Ding Auxiliary model-based RELS and MI-ELS algorithms for Hammerstein OEMA systems Comput. Math. Appl. 59 9 2010 3092 3098
59. D.Q. Wang, Y.Y. Chu, G.W. Yang, and F. Ding Auxiliary model-based recursive generalized least squares parameter estimation for Hammerstein OEAR systems Math. Comput. Modelling 52 1-2 2010 309 317
60. J. Schoukens, W.D. Widanage, K.R. Godfrey, and R. Pintelon Initial estimates for the dynamics of a Hammerstein system Automatica 43 7 2007 1296 1301
61. F. Giri, Y. Rochdi, F.Z. Chaoui, and A. Brouri Identification of Hammerstein systems in presence of hysteresis-backlash and hysteresis-relay nonlinearities Automatica 44 3 2008 767 775
62. F. Ding, and T. Chen Combined parameter and output estimation of dual-rate systems using an auxiliary model Automatica 40 10 2004 1739 1748
63. F. Ding, and T. Chen Identification of dual-rate systems based on finite impulse response models Int. J. Adapt. Control Signal Process. 18 7 2004 589 598
64. F. Ding, and T. Chen Parameter estimation of dual-rate stochastic systems by using an output error method IEEE Trans. Automat. Control 50 9 2005 1436 1441
65. F. Ding, P.X. Liu, and G. Liu Auxiliary model based multi-innovation extended stochastic gradient parameter estimation with colored measurement noises Signal Process. 89 10 2009 1883 1890
66. Y.J. Liu, L. Xie, and F. Ding An auxiliary model based recursive least squares parameter estimation algorithm for non-uniformly sampled multirate systems Proc. Inst. Mech. Eng. Part I: J. Syst. Control Eng. 223 4 2009 445 454
67. L.L. Han, J. Sheng, F. Ding, and Y. Shi Auxiliary model identification method for multirate multi-input systems based on least squares Math. Comput. Modelling 50 7-8 2009 1100 1106
68. F. Ding, and J. Ding Least squares parameter estimation with irregularly missing data Int. J. Adapt. Control Signal Process. 24 7 2010 540 553
69. F. Ding, L. Qiu, and T. Chen Reconstruction of continuous-time systems from their non-uniformly sampled discrete-time systems Automatica 45 2 2009 324 332
70. L.L. Xiang, L.B. Xie, and R.F. Ding Hierarchical least squares algorithms for single-input multiple-output systems based on the auxiliary model Math. Comput. Modelling 52 5-6 2010 918 924
71. F. Ding, and T. Chen Performance analysis of multi-innovation gradient type identification methods Automatica 43 1 2007 1 14
72. F. Ding Several multi-innovation identification methods Digital Signal Process. 20 4 2010 1027 1039
73. D.Q. Wang, and F. Ding Performance analysis of the auxiliary models based multi-innovation stochastic gradient estimation algorithm for output error systems Digital Signal Process. 20 3 2010 750 762
74. J.B. Zhang, F. Ding, and Y. Shi Self-tuning control based on multi-innovation stochastic gradient parameter estimation Systems Control Lett. 58 1 2009 69 75
75. L.L. Han, and F. Ding Identification for multirate multi-input systems using the multi-innovation identification theory Comput. Math. Appl. 57 9 2009 1438 1449
76. F. Ding, H.B. Chen, and M. Li Multi-innovation least squares identification methods based on the auxiliary model for MISO systems Appl. Math. Comput. 187 2 2007 658 668
77. Y.J. Liu, Y.S. Xiao, and X.L. Zhao Multi-innovation stochastic gradient algorithm for multiple-input single-output systems using the auxiliary model Appl. Math. Comput. 215 4 2009 1477 1483
78. L. Xie, H.Z. Yang, and F. Ding Modeling and identification for non-uniformly periodically sampled-data systems IET Control Theory Appl. 4 5 2010 784 794
79. F. Ding, P. X Liu, and G. Liu Multi-innovation least squares identification for linear and pseudo-linear regression models IEEE Trans. Syst. Man Cybernet. Part B: Cybernet. 40 3 2010 767 778
80. Y.J. Liu, L. Yu, and F. Ding Multi-innovation extended stochastic gradient algorithm and its performance analysis Circuits Syst. Signal Process. 29 4 2010 649 667
81. Y.S. Xiao, Y. Zhang, J. Ding, and J.Y. Dai The residual based interactive least squares algorithms and simulation studies Comput. Math. Appl. 58 6 2009 1190 1197
82. L.Y. Wang, L. Xie, and X.F. Wang The residual based interactive stochastic gradient algorithms for controlled moving average models Appl. Math. Comput. 211 2 2009 442 449
83. A. Hagenblada, L. Ljung, and A. Wills Maximum likelihood identification of Wiener models Automatica 44 11 2008 2697 2705
84. J. Vörös Parameter identification of Wiener systems with multisegment piecewise-linear nonlinearities Systems Control Lett. 56 2 2007 99 105
85. G.C. Goodwin, and K.S. Sin Adaptive Filtering, Prediction and Control 1984 Prentice-Hall Englewood Cliffs, NJ
86. F. Ding, X.P. Liu, and Y. Shi Convergence analysis of estimation algorithms of dual-rate stochastic systems Appl. Math. Comput. 176 1 2006 245 261
87. J. Ding, and F. Ding The residual based extended least squares identification method for dual-rate systems Comput. Math. Appl. 56 6 2008 1479 1487
88. Y.S. Xiao, F. Ding, Y. Zhou, M. Li, and J.Y. Dai On consistency of recursive least squares identification algorithms for controlled auto-regression models Appl. Math. Model. 32 11 2008 2207 2215
89. J. Ding, L.L. Han, and X.M. Chen Time series AR modeling with missing observations based on the polynomial transformation Math. Comput. Modelling 51 5-6 2010 527 536
90. F. Ding, H.Z. Yang, and F. Liu Performance analysis of stochastic gradient algorithms under weak conditions Sci. China Ser. F Inform. Sci. 51 9 2008 1269 1280
91. F. Ding, P.X. Liu, and H.Z. Yang Parameter identification and intersample output estimation for dual-rate systems IEEE Trans. Syst. Man Cybernet. Part A: Syst. Humans 38 4 2008 966 975
92. Y. Shi, F. Ding, and T. Chen Multirate crosstalk identification in xDSL systems IEEE Trans. Commun. 54 10 2006 1878 1886
93. Y. Shi, F. Ding, and T. Chen 2-Norm based recursive design of transmultiplexers with designable filter length Circuits Syst. Signal Process. 25 4 2006 447 462
94. Y.J. Liu, J. Sheng, and R.F. Ding Convergence of stochastic gradient algorithm for multivariable ARX-like systems Comput. Math. Appl. 59 8 2010 2615 2627
95. F. Ding, T. Chen, and L. Qiu Bias compensation based recursive least squares identification algorithm for MISO systems IEEE Trans. Circuits Syst. II: Express Briefs 53 5 2006 349 353
96. F. Ding, and Y.S. Xiao A finite-data-window least squares algorithm with a forgetting factor for dynamical modeling Appl. Math. Comput. 186 1 2007 184 192
97. F. Ding, and T. Chen Performance bounds of the forgetting factor least squares algorithm for time-varying systems with finite measurement data IEEE Trans. Circuits Syst. I: Reg. Papers 52 3 2005 555 566
98. F. Ding, and T. Chen Hierarchical identification of lifted state-space models for general dual-rate systems IEEE Trans. Circuits Syst. 52 6 2005 1179 1187 (Pubitemid 40970287)
99. F. Ding, Y. Shi, and T. Chen Performance analysis of estimation algorithms of non-stationary ARMA processes IEEE Trans. Signal Process. 54 3 2006 1041 1053
100. F. Ding, Y. Shi, and T. Chen Amendments to "Performance analysis of estimation algorithms of non-stationary ARMA processes" IEEE Trans. Signal Process. 56 10 2008 4983 4984
101. Y.S. Xiao, D.Q. Wang, and F. Ding The residual based ESG algorithm and its performance analysis J. Franklin Inst. Eng. Appl. Math. 347 2 2010 426 437
102. J. Ding, F. Ding, and S. Zhang Parameter identification of multi-input, single-output systems based on FIR models and least squares principle Appl. Math. Comput. 197 1 2008 297 305
103. Y.S. Xiao, H.B. Chen, and F. Ding Identification of multi-input systems based on the correlation techniques Int. J. Syst. Sci. 2010 10.1080/ 00207720903470189
104. F. Ding, G. Liu, and X.P. Liu Partially coupled stochastic gradient identification methods for non-uniformly sampled systems IEEE Trans. Automat. Control 55 8 2010 10.1109/TAC.2010.2050713