Stability and instability of limit points for stochastic approximation algorithms

IEEE Transactions on Automatic Control

Volumn 45, Issue 3, 2000, Pages 413-420

  Fang, Hai Tao ^a   Chen, Han Fu ^a,b  

^a INSTITUTE OF SYSTEMS SCIENCE   (China)

^b IEEE

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; ASYMPTOTIC STABILITY; CONVERGENCE OF NUMERICAL METHODS; LYAPUNOV METHODS; ORDINARY DIFFERENTIAL EQUATIONS; RANDOM PROCESSES; SET THEORY;

LIMIT POINTS; PATHWISE CONVERGENT; STOCHASTIC APPROXIMATION ALGORITHMS;

ALGORITHMS;

EID: 0033726482     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/9.847721     Document Type: Article

References (17)

1. H. Robbins and S. Monro, "A stochastic approximation method," Ann. Math. Statist., vol. 22, pp. 400-407, 1951.
2. L. Ljung, "Analysis of recursive stochastic algorithms," IEEE Trans. Automat. Contr., vol. AC-22, pp. 551-575, 1977.
3. H. F. Chen and X. R. Cao, "Controllability is not necessary for adaptive pole placement control," IEEE Trans. Automat. Contr., vol. 42, pp. 1222-1297, 1997.
4. J. C. Spall, "Multivariate stochastic approximation using a simultaneous perturbation gradient approximation," IEEE Trans. Automat. Contr., vol. 37, pp. 332-341, 1992.
5. H. J. Kushner and G. Yin, Stochastic Approximation Algorithms and Applications. Berlin: Springer-Verlag, 1997.
6. H. J. Kushner and D. S. Clark, Stochastic Approximation Methods for Constrained and Unconstrained Systems. Berlin: Springer-Verlag, 1978.
7. A. Benveniste, M. Métivier, and P. Priouret, Adaptive Algorithms and Stochastic Approximations. Berlin: Springer-Verlag, 1990.
8. H. F. Chen, "Stochastic approximation and its new applications," in Proc. 1994 Hong Kong Int. Workshop New Directions Contr. Manufact., 1994, pp. 2-12.
9. _, "Recent developments in stochastic approximation," in Preprints 13th IFAC World Congr., vol. D, San Francisco, CA, 1996, pp. 375-380.
10. H. F. Chen and Y. M. Zhu, "Stochastic approximation procedures with randomly varying truncations," Scientia Sinica, ser. A, vol. 29, pp. 914-926, 1986.
11. G. J. Wang and H. F. Chen, "Behavior of the stochastic approximation algorithm in the root set of regression function," Proc. Chinese Contr. Conf., pp. 1018-1021, 1996.
12. M. Benaim, "A dynamical system approach to stochastic approximations," SIAM J. Contr. Optim., vol. 34, pp. 437-472, 1996.
13. V. S. Borkar and S. P. Meyn, "Stability and convergence of stochastic approximation using ODE method,", Tech. Rep..
14. I. J. Wang, E. K. P. Chong, and S. R. Kulkarni, "Equivalent necessary and sufficient conditions on noise sequences for stochastic approximation algorithms," Adv. Appl. Probab., vol. 23, pp. 784-801, 1996.
15. B. Delyon, "General results on the convergence of stochastic algorithms," IEEE Trans. Automat. Contr., vol. 41, pp. 1245-1255, 1996.
16. R. Pemantle, "Non convergence to unstable points in urn models and stochastic approximations," Ann. Probab., vol. 18, pp. 689-712, 1990.
17. K. Deimling, Nonlinear Functional Analysis. Berlin: Springer-Verlag, 1985.