Further results on almost sure convergence of the stochastic gradient algorithm

International Journal of Adaptive Control and Signal Processing

Volumn 13, Issue 3, 1999, Pages 161-181

  Radenkovic, Miloje S ^a  

^a The University of Colorado Denver   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; CONVERGENCE OF NUMERICAL METHODS; ERROR ANALYSIS; LEAST SQUARES APPROXIMATIONS; PARAMETER ESTIMATION; PROBLEM SOLVING; STOCHASTIC CONTROL SYSTEMS;

GRADIENT ALGORITHMS; STOCHASTIC ADAPTIVE CONTROL;

ADAPTIVE CONTROL SYSTEMS;

EID: 0032665660     PISSN: 08906327     EISSN: None     Source Type: Journal    
DOI: 10.1002/(SICI)1099-1115(199905)13:3<161::AID-ACS537>3.0.CO;2-S     Document Type: Article

References (19)

1. Ljung, L. and T. Soderstrom, Theory and Practice of Recursive Identification, MIT Press, Cambridge, MA, 1983.
2. Goodwin, G. C. and K. S. Sin, Adaptive Filtering, Prediction and Control, Prentice-Hall, Englewood Cliffs, NJ, 1984.
3. Kushner, H. J., Approximation and Weak Convergence Methods for Random Processes with Application, to Stochastic System Theory, MIT Press, Cambridge, 1984.
4. Beneviste, A., M. Metivier and P. Priouret, Adaptive Algorithms and Stochastic Approximations, Springer, Berlin, 1990.
5. Kumar, P. R. and P. P. Varayia, Stochastic Systems: Estimation, Identification, Adaptive Control, Prentice-Hall, Englewood Cliffs, NJ, 1986.
6. Chen, H. F. and L. Guo, Identification and Stochastic Adaptive Control, Birkhauser, Boston, 1991.
7. Lai, T. L. and C. Z. Wei, 'Least squares estimates in stochastic regression models with application to identification and control of dynamic systems', Ann. Statist., 10, 154-166 (1983).
8. Lai, T. L. and C. Z. Wei, 'Extended least squares and their applications to adaptive control and prediction in linear systems', IEEE Trans. Automat. Control, 31, 898-906 (1996)
9. Gip, L. and H. F. Chen, 'The Atrom-Wittenmark self-tuning regulator revisited and ELS-based adaptive trackers', IEEE, Trans. Automat. Control, 36, 802-812 (1991).
10. Guo, L., 'Further results on least squares based adaptive minimum variance control', SIAM J. Control Optim., 32, 187-212 (1994).
11. Meyn, S. P. and P. E. Caines, 'The zero divisor problem of multivariable stochastic adaptive control', Systems Control Lett., 6 (4), 235-238 (1985).
12. Kumar, P. R. and L. Praly, 'Self-tuning trackers', SIAM J. Control Optim., 25, 1053-1071 (1987).
13. Caines, P. E. and S. Lafortune, 'Adaptive control with recursive identification for stochastic linear systems', IEEE Trans. Automat. Control, 30, 185-189 (1985).
14. Radenkovic, M. S. and S. S. Stankovic, 'Strong consistency of parameter estimates in direct self-tuning control algorithms based on stochastic approximation'. Automatica, 26 (3), 533-544 (1990).
15. Anderson, B. D. O. and R. M. Johnson, 'Exponential convergence of adaptive identification and control algorithms', Automatica, 18, 1-13 (1982)
16. Anderson, B. D. O., R. Bitmead, C. R. Johnson, P. V. Kokotovic, R. Kosut, I. Mareels, L. Praly, and B. D. Riedle, Stability of Adaptive Systems: Passivity and Averaging Analysis, MIT Press, Cambridge, MA, 1986.
17. Nassiri-Toussi, K. and W Ren, 'On the convergence of least squares estimates in white noise', IEEE Trans. Automat. Control, 39, 364-368 (1994).
18. Guo, L., 'Self-convergence of weighted least-squares with applications to stochastic adaptive control', IEEE Trans. Automat. Control, 41, 79-89 (1996).
19. Chen, H. F. and L. Guo, 'Convergence rate of least squares identification and adaptive control for stochastic systems', Int. J. Control, 44, 1459-1476 (1986).