Multi-innovation stochastic gradient algorithm for Hammerstien nonlinear ARX systems

Proceedings - 4th International Conference on Genetic and Evolutionary Computing, ICGEC 2010

Volumn , Issue , 2010, Pages 868-871

  Liao, Yuwu ^a   Yu, Li ^b   Xiang, Lili ^b  

^a HUBEI UNIVERSITY OF ARTS AND SCIENCE   (China)

^b JIANGNAN UNIVERSITY   (China)

Author keywords

Hammerstein models; Parameter estimation; Recursive identification; Stochastic gradient

Indexed keywords

ARX SYSTEMS; AUTO REGRESSIVE MODELS; HAMMERSTEIN MODEL; LINEAR REGRESSION MODELS; MEMORYLESS; NONLINEAR REGRESSION MODELS; NUMERICAL RESULTS; PARAMETER ESTIMATE; RECURSIVE IDENTIFICATION; STOCHASTIC GRADIENT; STOCHASTIC GRADIENT ALGORITHMS;

EVOLUTIONARY ALGORITHMS; REGRESSION ANALYSIS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS;

PARAMETER ESTIMATION;

EID: 79952564084     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICGEC.2010.220     Document Type: Conference Paper

References (81)

1. F. Ding, P.X. Liu, G. Liu, Identification methods for Hammerstein nonlinear systems, Digital Signal Processing 2011 doi: 10.1016/j.dsp.2010.06.006
2. F. Ding, T. Chen, Identification of Hammerstein nonlinear ARMAX systems, Automatica 41 (9) (2005) 1479-1489. (Pubitemid 41000116)
3. F. Ding, T. Chen, Author's reply to "Comments on 'Identification of Hammerstein nonlinear ARMAX systems"', Automatica 43 (8) (2007) 1497.
4. F. Ding, Y. Shi, T. Chen, Gradient-based identification methods for Hammerstein nonlinear ARMAX models, Nonlinear Dynamics 45 (1-2) (2006) 31-43. (Pubitemid 44048446)
5. F. Ding, Y. Shi, T. Chen, Auxiliary model based least-squares identification methods for Hammerstein output-error systems, Systems & Control Letters 56 (5) (2007) 373-380. (Pubitemid 46435731)
6. D.Q. Wang, F. Ding, Extended stochastic gradient identification algorithms for Hammerstein-Wiener ARMAX Systems, Computers & Mathematics with Applications 56 (12) (2008) 3157-3164.
7. J. Chen, Y. Zhang, R.F. Ding, Auxiliary model based multi-innovation algorithms for multivariable nonlinear systems, Mathematical and Computer Modelling 52 (9-10) (2010) 1428-1434
8. Y. Yu, J.B. Zhang, Y.W. Liao, J. Ding, Parameter estimation error bounds for Hammerstein finite impulsive response models, Applied Mathematics and Computation 202 (2) (2008) 472-480.
9. D.Q. Wang, Y.Y. Chu, F. Ding, Auxiliary model-based RELS and MI-ELS algorithms for Hammerstein OEMA systems, Computers & Mathematics with Applications 59 (9) (2010) 3092-3098.
10. D.Q. Wang, Y.Y. Chu, G.W. Yang, F. Ding, Auxiliary model-based recursive generalized least squares parameter estimation for Hammerstein OEAR systems, Mathematical and Computer Modelling 52 (1-2) (2010) 309-317.
11. F. Ding, T. Chen, Combined parameter and output estimation of dual-rate systems using an auxiliary model, Automatica 40 (10) (2004) 1739-1748.
12. F. Ding, T. Chen, Identification of dual-rate systems based on finite impulse response models, International Journal of Adaptive Control and Signal Processing 18 (7) (2004) 589-598.
13. F. Ding, T. Chen, Parameter estimation of dual-rate stochastic systems by using an output error method, IEEE Transactions on Automatic Control 50 (9) (2005) 1436-1441. (Pubitemid 41388188)
14. F. Ding, P.X. Liu, G. Liu, Auxiliary model based multi-innovation extended stochastic gradient parameter estimation with colored measurement noises, Signal Processing 89 (10) (2009) 1883-1890.
15. Y.J. Liu, L. Xie, F. Ding, An auxiliary model based recursive least squares parameter estimation algorithm for non-uniformly sampled multirate systems, Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering 223 (4) (2009) 445-454.
16. L.L. Han, J. Sheng, F. Ding, Y. Shi, Auxiliary model identification method for multirate multi-input systems based on least squares, Mathematical and Computer Modelling 50 (7-8) (2009) 1100-1106.
17. F. Ding, J. Ding, Least squares parameter estimation with irregularly missing data, International Journal of Adaptive Control and Signal Processing 24 (7) (2010) 540-553.
18. F. Ding, T. Chen, Hierarchical gradient-based identification of multivariable discrete-time systems, Automatica 41 (2) (2005) 315-325. (Pubitemid 41536582)
19. F. Ding, T. Chen, Hierarchical least squares identification methods for multivariable systems, IEEE Transactions on Automatic Control 50 (3) (2005) 397-402. (Pubitemid 40448592)
20. L.Y. Wang, F. Ding, P.X. Liu, Consistency of HLS estimation algorithms for MIMO ARX-like systems, Applied Mathematics and Computation 190 (2) (2007) 1081-1093. (Pubitemid 46935850)
21. H.Q. Han, L. Xie, F. Ding, X.G. Liu, Hierarchical least squares based iterative identification for multivariable systems with moving average noises. Mathematical and Computer Modelling 51 (9-10) (2010) 1213-1220.
22. F. Ding, L. Qiu, T. Chen, Reconstruction of continuous-time systems from their non-uniformly sampled discrete-time systems, Automatica 45 (2) (2009) 324-332.
23. L.L. Xiang, L.B. Xie, Y.W. Liao, R.F. Ding, Hierarchical least squares algorithms for single-input multiple-output systems based on the auxiliary model, Mathematical and Computer Modelling 52 (5-6) (2010) 918-924.
24. F. Ding, T. Chen, Performance analysis of multi-innovation gradient type identification methods, Automatica 43 (1) (2007) 1-14. (Pubitemid 44792035)
25. F. Ding, Several multi-innovation identification methods, Digital Signal Processing 20 (4) (2010) 1027-1039.
26. D.Q. Wang, F. Ding, Performance analysis of the auxiliary models based multi-innovation stochastic gradient estimation algorithm for output error systems, Digital Signal Processing 20 (3) (2010) 750-762.
27. J.B. Zhang, F. Ding, Y. Shi, Self-tuning control based on multi-innovation stochastic gradient parameter estimation, Systems & Control Letters 58 (1) (2009) 69-75.
28. L.L. Han, F. Ding, Identification for multirate multi-input systems using the multi-innovation identification theory, Computers & Mathematics with Applications 57 (9) (2009) 1438-1449.
29. F. Ding, H.B. Chen, M. Li, Multi-innovation least squares identification methods based on the auxiliary model for MISO systems, Applied Mathematics and Computation 187 (2) (2007) 658-668. (Pubitemid 46627857)
30. Y.J. Liu, Y.S. Xiao, X.L. Zhao, Multi-innovation stochastic gradient algorithm for multiple-input single-output systems using the auxiliary model, Applied Mathematics and Computation 215 (4) (2009) 1477-1483.
31. L. Xie, H.Z. Yang, F. Ding, Modeling and identification for non-uniformly periodically sampled-data systems, IET Control Theory & Applications 4 (5) (2010) 784-794.
32. F. Ding, P.X Liu, G. Liu, Multi-innovation least squares identification for linear and pseudo-linear regression models, IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 40 (3) (2010) 767-778.
33. Y.J. Liu, L. Yu, F. Ding, Multi-innovation extended stochastic gradient algorithm and its performance analysis, Circuits, Systems and Signal Processing 29 (4) (2010) 649-667.
34. L.L. Han, F. Ding, Multi-innovation stochastic gradient algorithms for multi-input multi-output systems, Digital Signal Processing 19 (4) (2009) 545-554.
35. Y.S. Xiao, Y. Zhang, J. Ding, J.Y. Dai, The residual based interactive least squares algorithms and simulation studies, Computers & Mathematics with Applications 58 (6) (2009) 1190-1197.
36. L.Y. Wang, L. Xie, X.F. Wang, The residual based interactive stochastic gradient algorithms for controlled moving average models, Applied Mathematics and Computation 211 (2) (2009) 442-449.
37. F. Ding, P.X. Liu, G. Liu, Gradient based and least-squares based iterative identification methods for OE and OEMA systems, Digital Signal Processing 20 (3) (2010) 664-677.
38. Y.J. Liu, D.Q. Wang, F. Ding, Least-squares based iterative algorithms for identifying Box-Jenkins models with finite measurement data, Digital Signal Processing 20 (5) (2010) 1458-1467.
39. D.Q. Wang, G.W. Yang, R.F. Ding, Gradient-based iterative parameter estimation for Box-Jenkins systems, Computers & Mathematics with Applications 60 (5) (2010) 1200-1208.
40. X.G. Liu, J. Lu, Least squares based iterative identification for a class of multirate systems, Automatica 46 (3) (2010) 549-554.
41. J. Ding, Y. Shi, H.G. Wang, F. Ding, A modified stochastic gradient based parameter estimation algorithm for dual-rate sampled-data systems, Digital Signal Processing 20 (4) (2010) 1238-1249.
42. D.Q. Wang, F. Ding, Input-output data filtering based recursive least squares identification for CARARMA systems, Digital Signal Processing 20 (4) (2010) 991-999.
43. F. Ding, T. Chen, Parameter estimation for dual-rate systems with finite measurement data, Dynamics of Continuous, Discrete and Impulsive Systems, Series B: Applications & Algorithms 11 (1-2) (2004) 101-121. (Pubitemid 39258625)
44. H.Z. Yang, J. Li, F. Ding, A neural network learning algorithm of chemical process modeling based on the extended Kalman filter, Neuro computing 70 (4-6) (2007) 625-632. (Pubitemid 46043960)
45. F. Ding, T. Chen, Least squares based self-tuning control of dual-rate systems, International Journal of Adaptive Control and Signal Processing 18 (8) (2004) 697-714.
46. F. Ding, T. Chen, Z. Iwai, Adaptive digital control of Hammerstein nonlinear systems with limited output sampling, SIAM Journal on Control and Optimization 45 (6) (2007) 2257-2276. (Pubitemid 350171715)
47. F. Ding, T. Chen, A gradient based adaptive control algorithm for dual-rate systems, Asian Journal of Control 8 (4) (2006) 314-323.
48. Y.W. Liao, X.F. Wang, R.F. Ding. Stochastic gradient algorithm for multi-input systems based on the auxiliary model, 2008 International Conference on Computer Science and Software Engineering (CSSE2008), December 12-14, 2008 in Wuhan, China, pp. 168-172.
49. Y.W. Liao, D.Q. Wang, X.M. Chen, F. Ding, On the residual based stochastic gradient algorithm for dual-rate sampled-data systems using the polynomial transform technique, 2009 American Control Conference, June 10-12, 2009, St. Louis, USA, pp. 3184-3187.
50. Y.W. Liao, D.Q. Wang, F. Ding, Data filtering based recursive least squares parameter estimation for ARMAX models, International Conference on Communications and Mobile Computing (CMC2009), January 6-8, 2009, Kunming, Yunnan, China, pp. 331-335.
51. Y.W. Liao, Y.J. Liu, F. Ding, Comparisons of stochastic gradient and least squares algorithms for multivariable systems, The 2010 Chinese Control and Decision Conference (2010 CCDC), May 26-28, 2010, Xuzhou, China, pp. 3275-3279.
52. Y.W. Liao, Y.J. Liu, R.F. Ding, Convergence of the auxiliary model based stochastic gradient algorithm for multiple-input single-output systems, The 2nd International Conference on Computer Engineering and Technology (ICCET 2010), April 16-18, 2010, Chengdu, China, vol. 4, pp. 509-512.
53. W. Fan, F. Ding, Y. Shi, Parameter estimation for Hammerstein nonlinear controlled auto-regression models, Proceedings of the IEEE International Conference on Automation and Logistics, August 18-21, 2007, Jinan, China, pp. 1007-1012. (Pubitemid 351370542)
54. F. Ding, T. Chen, Gradient based iterative algorithms for solving a class of matrix equations, IEEE Transactions on Automatic Control 50 (8) (2005) 1216-1221. (Pubitemid 41410122)
55. F. Ding, T. Chen, Iterative least squares solutions of coupled Sylvester matrix equations, Systems & Control Letters 54 (2) (2005) 95-107.
56. F. Ding, T. Chen, On iterative solutions of general coupled matrix equations, SIAM Journal on Control and Optimization 44 (6) (2006) 2269-2284. (Pubitemid 44775259)
57. F. Ding, P.X. Liu, J. Ding, Iterative solutions of the generalized Sylvester matrix equations by using the hierarchical identification principle, Applied Mathematics and Computation 197 (1) (2008) 41-50. (Pubitemid 351215477)
58. L. Xie, J. Ding, F. Ding, Gradient based iterative solutions for general linear matrix equations, Computers & Mathematics with Applications 58 (7) (2009) 1441-1448.
59. J. Ding, Y.J. Liu, F. Ding. Iterative solutions to matrix equations of form AiXBi=Fi, Computers & Mathematics with Applications 59 (11) (2010) 3500-3507.
60. T D=F, Applied Mathematics and Computation 2011 doi:10.1016/j.amc.2010.07.019
61. F. Ding, Transformations between some special matrices, Computers & Mathematics with Applications 59 (8) (2010) 2676-2695.
62. F. Ding, X.P. Liu, Y. Shi, Convergence analysis of estimation algorithms of dual-rate stochastic systems, Applied Mathematics and Computation 176 (1) (2006) 245-261.
63. J. Ding, F. Ding, The residual based extended least squares identification method for dual-rate systems, Computers & Mathematics with Applications 56 (6) (2008) 1479-1487.
64. Y.S. Xiao, F. Ding, Y. Zhou, M. Li, J.Y. Dai, On consistency of recursive least squares identification algorithms for controlled auto-regression models, Applied Mathematical Modelling 32 (11) (2008) 2207-2215.
65. J. Ding, L.L. Han, X.M. Chen, Time series AR modeling with missing observations based on the polynomial transformation, Mathematical and Computer Modelling 51 (5-6) (2010) 527-536.
66. F. Ding, H.Z. Yang, F. Liu, Performance analysis of stochastic gradient algorithms under weak conditions, Science in China Series F- Information Sciences 51 (9) (2008) 1269-1280.
67. F. Ding, P.X. Liu, H.Z. Yang, Parameter identification and intersample output estimation for dual-rate systems, IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans 38 (4) (2008) 966-975.
68. Y. Shi, F. Ding, T. Chen, Multirate crosstalk identification in xDSL systems, IEEE Transactions on Communications 54 (10) (2006) 1878-1886. (Pubitemid 44637822)
69. Y. Shi, F. Ding, T. Chen, 2-Norm based recursive design of trans-multiplexers with designable filter length, Circuits, Systems and Signal Processing 25 (4) (2006) 447-462. (Pubitemid 44480296)
70. Y.J. Liu, J. Sheng, R.F. Ding, Convergence of stochastic gradient algorithm for multivariable ARX-like systems, Computers & Mathematics with Applications 59 (8) (2010) 2615-2627.
71. F. Ding, T. Chen, L. Qiu, Bias compensation based recursive least squares identification algorithm for MISO systems, IEEE Transactions on Circuits and Systems - II: Express Briefs 53 (5) (2006) 349-353. (Pubitemid 43786576)
72. F. Ding, Y.S. Xiao, A finite-data-window least squares algorithm with a forgetting factor for dynamical modeling, Applied Mathematics and Computation 186 (1) (2007) 184-192. (Pubitemid 46435609)
73. F. Ding, T. Chen, Performance bounds of the forgetting factor least squares algorithm for time-varying systems with finite measurement data, IEEE Transactions on Circuits and Systems - I: Regular Papers 52 (3) (2005) 555-566. (Pubitemid 40466884)
74. F. Ding, T. Chen, Hierarchical identification of lifted state-space models for general dual-rate systems, IEEE Transactions on Circuits and Systems - I: Regular Papers 52 (6) (2005) 1179-1187. (Pubitemid 40970287)
75. F. Ding, Y. Shi, T. Chen, Performance analysis of estimation algorithms of non-stationary ARMA processes, IEEE Transactions on Signal Processing 54 (3) (2006) 1041-1053. (Pubitemid 43280579)
76. F. Ding, Y. Shi, T. Chen, Amendments to "Performance analysis of estimation algorithms of non-stationary ARMA processes", IEEE Transactions on Signal Processing 56 (10) (2008) 4983-4984.
77. Y.S. Xiao, D.Q. Wang, F. Ding, The residual based ESG algorithm and its performance analysis, Journal of the Franklin Institute-Engineering and Applied Mathematics 347 (2) (2010) 426-437.
78. J. Ding, F. Ding, S. Zhang, Parameter identification of multi-input, single-output systems based on FIR models and least squares principle, Applied Mathematics and Computation 197 (1) (2008) 297-305. (Pubitemid 351215497)
79. Y.N. Cao, Z.Q. Liu, Signal frequency and parameter estimation for power systems using the hierarchical identification principle, Mathematical and Computer Modelling 52 (5-6) (2010) 854-861.
80. Y.S. Xiao, H.B. Chen, F. Ding, Identification of multi-input systems based on the correlation techniques, International Journal of Systems Science 2010 doi: 10.1080/00207720903470189
81. F. Ding, G. Liu, X.P. Liu, Partially coupled stochastic gradient identification methods for non-uniformly sampled systems, IEEE Transactions on Automatic Control, 2010, 55(8): 1976-1981.