Equivalent necessary and sufficient conditions on noise sequences for stochastic approximation algorithms

Advances in Applied Probability

Volumn 28, Issue 3, 1996, Pages 784-801

  Wang, I Jeng ^a   Chong, Edwin K P ^a   Kulkarni, Sanjeev R ^b,c  

^a PURDUE UNIVERSITY   (United States)

^b PRINCETON UNIVERSITY   (United States)

^c Princeton University   (United States)

Author keywords

Convergence: equivalent necessary and sufficient conditions; Noise sequences; Stochastic approximation

Indexed keywords

EID: 0001055484     PISSN: 00018678     EISSN: None     Source Type: Journal    
DOI: 10.1017/S0001867800046498     Document Type: Article

References (14)

1. BARTUSEK, J. D. AND MAKOWSKI, A. M. (1994) On stochastic approximations driven by sample averages: Convergence results via the ODE method. Manuscript. Electrical Engineering Department and Institute for Systems Research, University of Maryland.
2. CHEN, H.-F. (1994) Stochastic approximation and its new applications. In Proc. 1994 Hong Kong Int. Workshop on New Directions in Control and Manufacturing. pp. 2-12.
3. CHEN, H.-F., GUO, L. AND GAO, A. (1988) Convergence and robustness of the Robbins-Monro algorithm truncated at randomly varying bounds. Stoch. Proc. Appl. 27, 217-231.
4. CHEN, H.-F. AND ZHU, Y.-M. (1986) Stochastic approximation procedures with randomly varying truncations. Sci. Sinica A 29, 914-926.
5. CLARK, D. S. (1984) Necessary and sufficient conditions for the Robbins-Monro method. Stoch. Proc. Appl. 17, 359-367.
6. KULKARNI, S. R. AND HORN, C. (1994) Necessary and sufficient conditions for convergence of stochastic approximation algorithms under arbitrary disturbances. Manuscript. Department of Electrical Engineering, Princeton University.
7. KUSHNER, H. K. AND CLARK, D. S. (1978) Stochastic Approximation Methods for Constrained and Unconstrained Systems. Springer, New York.
8. LAI, T. L. (1985) Stochastic approximation and sequential search for optimum. In Proc. Berkeley Conf. in Honor of Jerzy Neyman and Jack Kiefer, ed. L. LeCam and R. A. Olshen. Vol. 2. Wadsworth, New York. pp. 557-577.
9. L'ECUYER, P. AND GLYNN, P. W. (1994) Stochastic optimization by simulation: Convergence proofs for the GI/G/1 queue in steady-state: Management Sci. 40, 152-1578.
10. LJUNG, L., PFLUG, G. AND WALK, H. (1992) Stochastic Approximation and Optimization of Random Systems. Birkhäuser, Basel.
11. MA, D.-J., MAKOWSKI, M. AND SCHWARTZ, A. (1990) Stochastic approximations for finite state Markov chains. Stock. Proc. Appl. 35, 27-45.
12. METIVIER, M. AND PRIOURET, P. (1984) Applications of a Kushner and Clark lemma to general classes of stochastic algorithms. IEEE Trans. Inf. Theory. IT-30, 140-151.
13. ROBBINS, H. AND MONRO, S. (1951) A stochastic approximation method. Ann. Math. Statist. 22, 400-407.
14. WANG, I.-J., CHONG, E. K. P. AND KULKARNI, S. R. (1994) Necessity of Kushner-Clark Condition for Convergence of Stochastic Approximation Algorithms. In Proc. 32nd Annual Allerton Conf. on Communication, Control and Computing. pp. 167-175.