An alternative proof for convergence of stochastic approximation algorithms

IEEE Transactions on Automatic Control

Volumn 41, Issue 3, 1996, Pages 419-424

  Kulkarni, S R ^a   Horn, C S ^a  

^a Princeton University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; DIFFERENTIAL EQUATIONS; FUNCTIONS; INTERPOLATION; RANDOM PROCESSES; SPURIOUS SIGNAL NOISE;

HILBERT SPACE; KUSHNER-CLARK CONDITION; STOCHASTIC APPROXIMATION ALGORITHMS;

ALGORITHMS;

EID: 0030109229     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/9.486642     Document Type: Article

References (14)

1. A. Benveniste, M. Métivier, and P. Priouret, Adaptive Algorithms and Stochastic Approximations. New York: Springer-Verlag, 1990.
2. H. F. Chen, "Stochastic approximation and its new applications," in Proc. 1994 Hong Kong Int. Wkshp. New Directions Contr. Manufact., pp. 2-12.
3. H. F. Chen, L. Guo, and A. Gao, "Convergence and robustness of the Robbins-Monro algorithm truncated at randomly varying bounds," Stochastic Processes Applicat., vol. 27, pp. 217-231, 1988.
4. D. S. Clark, "Necessary and sufficient conditions for the Robbins-Monro method," Stochastic Processes Applicat., vol. 17, pp. 359-367, 1984.
5. C. Horn and S. R. Kulkarni, "Convergence of the Kiefer-Wolfowitz algorithm under arbitrary disturbances," in Proc. 1994 Amer. Contr. Conf., July 1994, pp. 2673-2674.
6. J. Kiefer and J. Wolfowitz, "Stochastic estimation of the maximum of a regression function," Ann. Math. Stat., vol. 23, pp. 462-466, 1952
7. S. R. Kulkarni and C. S. Horn, "Necessary and sufficient conditions tor convergence of stochastic approximation algorithms under arbitrary disturbances," in Proc. 34th Conf. Decision Contr., Dec. 1995, pp. 3843-3848.
8. H. J. Kushner and D. S. Clark, Stochastic Approximation for Constrained and Unconstrained Systems. New York: Springer-Verlag, 1978.
9. L. Ljung, G. Pflug, and H. Walk, Stochastic Approximation and Optimization of Random Systems. Germany: Birkhauser, 1992.
10. L. Ljung, "Analysis of recursive stochastic algorithms," IEEE Trans. Automat. Contr., vol. AC-22, pp. 551-575, 1977.
11. M. Métivier and P. Priouret, "Applications of a Kushner and Clark lemma to general classes of stochastic algorithms," IEEE Trans. Inform. Theory, vol. IT-30, pp. 140-151, 1984.
12. H. Robbins and S. Monro, "A stochastic approximation method," Ann. Math. Stat., vol. 22, pp. 400-407, 1951.
13. I.-J. Wang, E. K. P. Chong, and S. R. Kulkarni, "Necessity of Kushner-Clark condition for convergence of stochastic approximation algorithms," in Proc. Allerton Conf., 1994.
14. _, "Equivalent necessary and sufficient conditions on noise sequences for stochastic approximation algorithms," to appear in Adv. Appl. Probability, Sept. 1996.