Stability of stochastic approximation under verifiable conditions

Proceedings of the 44th IEEE Conference on Decision and Control, and the European Control Conference, CDC-ECC '05

Volumn 2005, Issue , 2005, Pages 6656-6661

  Andrieu, Christophe ^a   Moulines, Éric ^b   Priouret, Pierre ^c  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b TELECOM PARISTECH   (France)

^c SORBONNE UNIVERSITÉ   (France)

Author keywords

[No Author keywords available]

Indexed keywords

PARAMETER SETS; STABILITY PROBLEM; STOCHASTIC APPROXIMATION; TRUNCATION SETS;

APPROXIMATION THEORY; PARAMETER ESTIMATION; PROBLEM SOLVING; SET THEORY; SYSTEM STABILITY;

STOCHASTIC CONTROL SYSTEMS;

EID: 33847194533     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2005.1583231     Document Type: Conference Paper

References (18)

1. J. Abounadi, D. Bertsekas, and V. Borkar. Stochastic approximation for nonexpansive maps: Application to q-learning algorithms. SIAM J. on Control and Optimization, 41:1-22, 2002.
2. A. Benveniste, M. Métivier, and P. Priouret. Adaptive Algorithms and Stochastic Approximations. Springer-Verlag, New York, 1990.
3. V. Borkar. Stability of annealing schemes and related processes. Systems Control Lett., 41:325-331, 2000.
4. V. Borkar and S. Meyn. The o.d.e. method for convergence of stochastic approximation and reinforcement learning. SIAM J. Control and Optimization, 38:447-469, 2000.
5. R. Buche and H. Kushner. Rate of convergence for constrained stochastic approximation algorithms. SIAM J. on Control and Optimization, 40:1011-1041, 2001.
6. H. Chen. Stochastic approxmation with state-dependent noise. Science in China Series E, 43(5):531-541, 2000.
7. H. Chen, L. Guo, and A. Gao. Convergence and robustness of the Robbins- Monro algorithm truncated at randomly varying bounds. Stochastic Processes and their Applications, 27:217-231, 1988.
8. H. Chen and Y.-M. Zhu. Stochastic approximation procedures with randomly varying truncations. Scientia Sinica 1, 29:914-926, 1986.
9. H.-F. Chen. Stochastic approximation and its applications, volume 64 of Nonconvex Optimization and its Applications. Kluwer Academic Publishers, Dordrecht, 2002.
10. B. Delyon. Stochastic approximation with decreasing gain: Convergence and asymptotic theory. Technical report, Universit de Rennes, 2000.
11. B. Delyon, M. Lavielle, and E. Moulines. On a stochastic approximation version of the EM algorithm. Annals of Statistics, 27(1), 1999.
12. M. Duflo. Random Iterative Systems. Applications of mathematics. Springer-Verlag, 1997.
13. L. Gerencer. Rate of convergence of recursive estimators. SIAM J. on Control and Optimization, 30:1200-1227, 1992.
14. H. Kushner and D. Clark. Stochastic Approximation for Constrained and Unconstrained Systems. Springer-Verlag, Berlin, Heidelberg, 1978.
15. H. Kushner and G. Yin. Stochastic Approximation Algorithms and Applications. Applications of Mathematics. Springer-Verlag, New-York, 1997.
16. S. Meyn and R. Tweedie. Markov Chains and Stochastic Stability. Communication and Control Engineering series. Springer-Verlag, London, 1993.
17. V. Tadic. Stochastic gradient with random truncations. European J. of Operational Research, 101:261-284, 1997.
18. V. Tadic. Stochastic approximations with random truncations, state dependent noise and discontinuous dynamics. Stochastics and Stochastics reports, 64:283-326, 1998.