Recursive Parameter Estimation Algorithms and Convergence for a Class of Nonlinear Systems with Colored Noise

Circuits, Systems, and Signal Processing

Volumn 35, Issue 10, 2016, Pages 3461-3481

  Wang, Yanjiao ^a   Ding, Feng ^a  

^a JIANGNAN UNIVERSITY   (China)

Author keywords

Gradient algorithm; Least squares; Nonlinear system; Performance analysis; Recursive identification

Indexed keywords

ALGORITHMS; LINEAR SYSTEMS; NONLINEAR ANALYSIS; NONLINEAR SYSTEMS; STOCHASTIC SYSTEMS;

EXTENDED LEAST SQUARES; GRADIENT ALGORITHM; IDENTIFICATION ALGORITHMS; LEAST SQUARE; PERFORMANCE ANALYSIS; RECURSIVE IDENTIFICATION; RECURSIVE PARAMETER ESTIMATION; STOCHASTIC GRADIENT;

PARAMETER ESTIMATION;

EID: 84961660335     PISSN: 0278081X     EISSN: 15315878     Source Type: Journal    
DOI: 10.1007/s00034-015-0210-6     Document Type: Article

References (43)

1. A. Al-Smadi, A least-squares-based algorithm for identification of non-Gaussian ARMA models. Circuits Syst. Signal Process. 26(5), 715–731 (2007)
2. R. Arablouei, K. Dogancay, Performance analysis of linear-equality-constrained least-squares estimation. IEEE Trans. Signal Process. 63(14), 3762–3769 (2015)
3. H.B. Chen, Y.S. Xiao, F. Ding, Hierarchical gradient parameter estimation algorithm for Hammerstein nonlinear systems using the key term separation principle. Appl. Math. Comput. 247, 1202–1210 (2014)
4. M. Dehghan, M. Hajarian, Analysis of an iterative algorithm to solve the generalized coupled Sylvester matrix equations. Appl. Math. Model. 35(7), 3285–3300 (2011)
5. M. Dehghan, M. Hajarian, Fourth-order variants of Newton’s method without second derivatives for solving non-linear equations. Eng. Comput. 29(4), 356–365 (2012)
6. M. Dehghan, M. Hajarian, Iterative algorithms for the generalized centro-symmetric and central anti-symmetric solutions of general coupled matrix equations. Eng. Comput. 29(5), 528–560 (2012)
7. F. Ding, System Identification—New Theory and Methods (Science Press, Beijing, 2013)
8. F. Ding, T. Chen, Performance analysis of multi-innovation gradient type identification methods. Automatica 43(1), 1–14 (2007)
9. F. Ding, Y. Gu, Performance analysis of the auxiliary model based least squares identification algorithm for one-step state delay systems. Int. J. Comput. Math. 89(15), 2019–2028 (2012)
10. J. Ding, L.L. Han, X.M. Chen, Time series AR modeling with missing observations based on the polynomial transformation. Math. Comput. Model. 51(5–6), 527–536 (2011)
11. F. Ding, X.H. Wang, Q.J. Chen, Y.S. Xiao, Recursive least squares parameter estimation for a class of output nonlinear systems based on the model decomposition. Circuits Syst. Signal Process. (2016). doi:10.1007/s00034-015-0190-6
12. F. Ding, Y.J. Wang, J. Ding, Recursive least squares parameter identification for systems with colored noise using the filtering technique and the auxiliary model. Digital Signal Process. 37, 100–108 (2015)
13. G.C. Goodwin, K.S. Sin, Adaptive Filtering, Prediction and Control (Prentice-Hall, Englewood Cliffs, 1984)
14. Y.B. Hu, Iterative and recursive least squares estimation algorithms for moving average systems. Simul. Model. Pract. Theory 34, 12–19 (2013)
15. Y.B. Hu, B.L. Liu, Q. Zhou, A multi-innovation generalized extended stochastic gradient algorithm for output nonlinear autoregressive moving average systems. Appl. Math. Comput. 247, 218–224 (2014)
16. Y.B. Hu, B.L. Liu, Q. Zhou, C. Yang, Recursive extended least squares parameter estimation for Wiener nonlinear systems with moving average noises. Circuits Syst. Signal Process. 33(2), 655–664 (2014)
17. Y. Ji, X.M. Liu et al., New criteria for the robust impulsive synchronization of uncertain chaotic delayed nonlinear systems. Nonlinear Dyn. 79(1), 1–9 (2015)
18. H. Li, Y. Shi, Robust H-infty filtering for nonlinear stochastic systems with uncertainties and random delays modeled by Markov chains. Automatica 48(1), 159–166 (2010)
19. Y.J. Liu, R. Ding, Consistency of the extended gradient identification algorithm for multi-input multi-output systems with moving average noises. Int. J. Comput. Math. 90(9), 1840–1852 (2013)
20. L. Ljung, System Identification: Theory for the User, 2nd edn. (Prentice-Hall, Englewood Cliffs, 1999)
21. M.X. Liu, X.T. Liu et al., T-S fuzzy-model-based H-2 and H-infinity filtering for networked control systems with two-channel Markovian random delays. Digital Signal Process. 27, 167–174 (2014)
22. Y.J. Liu, L. Yu et al., Multi-innovation extended stochastic gradient algorithm and its performance analysis. Circuits Syst. Signal Process. 29(4), 649–667 (2010)
23. J. Mateo, A. Torres, M.A. Garcia, R. Cervigon, Robust volterra filter design for enhancement of electroencephalogram signal processing. Circuits Syst. Signal Process. 32(1), 233–253 (2013)
24. D. Piga, R. Toth, A bias-corrected estimator for nonlinear systems with output-error type model structures. Automatica 50(9), 2373–2380 (2014)
25. J.C. Quinn, P.H. Bryant, D.R. Creveling, Parameter and state estimation of experimental chaotic systems using synchronization. Phys. Rev. E 80, 016201 (2009)
26. A. Rai, A.K. Kohli, Adaptive polynomial filtering using generalized variable step-size least mean pth power (LMP) algorithm. Circuits Syst. Signal Process. 3(12), 3931–3947 (2014)
27. Y. Shi, H. Fang, Kalman filter based identification for systems with randomly missing measurements in a network environment. Int. J. Control 83(3), 538–551 (2010)
28. C. Sun, F.L. Wang, X.Q. He, Robust fault estimation for Takagi–Sugeno nonlinear systems with time-varying state delay. Circuits Syst. Signal Process. 34(2), 641–661 (2015)
29. J. Vörös, Identification of Hammerstein systems with time-varying piecewise-linear characteristics. IEEE Trans. Circuits Syst. II: Express Brief 52(12), 865–869 (2005)
30. Y.J. Wang, F. Ding, Iterative estimation for a nonlinear IIR filter with moving average noise by means of the data filtering technique. IMA J. Math. Control Inf. (2016). doi:10.1093/imamci/dnv067
31. Y.J. Wang, F. Ding, Parameter estimation algorithms for Hammerstein-Wiener systems with autoregressive moving average noise. J. Comput. Nonlinear Dyn. 11(3) (2016). doi:10.1115/1.4031420
32. D.Q. Wang, F. Ding, Performance analysis of the auxiliary models based multi-innovation stochastic gradient estimation algorithm for output error systems. Digit. Signal Process. 20(3), 750–762 (2010)
33. X.H. Wang, F. Ding, Performance analysis of the recursive parameter estimation algorithms for multivariable Box–Jenkins systems. J. Frankli. Inst. 351(10), 4749–4764 (2014)
34. X.H. Wang, F. Ding, Convergence of the auxiliary model based multi-innovation generalized extended stochastic gradient algorithm for Box–Jenkins systems. Nonlinear Dyn. 82(1–2), 269–280 (2015)
35. D.Q. Wang, Y.P. Gao, Recursive maximum likelihood identification method for a multivariable controlled autoregressive moving average system. IMA J. Math. Control Inf. (2015). doi:10.1093/imamci/dnv021
36. D.Q. Wang, H.B. Liu, F. Ding, Highly efficient identification methods for dual-rate Hammerstein systems. IEEE Trans. Control Syst. Technol. 23(5), 1952–1960 (2015)
37. C. Wang, T. Tang, Several gradient-based iterative estimation algorithms for a class of nonlinear systems using the filtering technique. Nonlinear Dyn. 77(3), 769–780 (2014)
38. D.H. Wu, Y.Y. Li, Fault diagnosis of variable pitch for wind turbines based on the multi-innovation forgetting gradient identification algorithm. Nonlinear Dyn. 79(3), 2069–2077 (2015)
39. L. Xu, L. Chen, W.L. Xiong, Parameter estimation and controller design for dynamic systems from the step responses based on the Newton iteration. Nonlinear Dyn. 79(3), 2155–2163 (2015)
40. L. Xu, A proportional differential control method for a time-delay system using the Taylor expansion approximation. Appl. Math. Comput. 236, 391–399 (2014)
41. L. Xu, Application of the Newton iteration algorithm to the parameter estimation for dynamical systems. J. Comput. Appl. Math. 288, 33–43 (2015)
42. Y. Zhang, Unbiased identification of a class of multi-input single-output systems with correlated disturbances using bias compensation methods. Math. Comput. Model. 53(9–10), 1810–1819 (2011)
43. Y. Zhang, G.M. Cui, Bias compensation methods for stochastic systems with colored noise. Appl. Math. Model. 35(4), 1709–1716 (2011)