Weighted averaging and stochastic approximation

Mathematics of Control, Signals, and Systems

Volumn 10, Issue 1, 1997, Pages 41-60

  Wang, I J ^a   Chong, Edwin K P ^b   Kulkarni, Sanjeev R ^c  

^a UNIVERSITY OF MARYLAND   (United States)

^b PURDUE UNIVERSITY   (United States)

^c Princeton University   (United States)

Author keywords

Convergence; Necessary and sufficient noise conditions; Noise sequences; Stochastic approximation; Weighted averaging

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; RANDOM PROCESSES; SPURIOUS SIGNAL NOISE; STATISTICAL METHODS;

CONVERGENCE; WEIGHTED AVERAGING;

MATHEMATICAL TECHNIQUES;

EID: 0030658716     PISSN: 09324194     EISSN: None     Source Type: Journal    
DOI: 10.1007/BF01219775     Document Type: Article

References (32)

1. H.-F. Chen, Stochastic approximation and its new applications, in Proceedings of the 1994 Hong Kong International Workshop on New Directions of Control and Manufacturing, pp. 2-12, 1994.
2. H. F. Chen, Recent developments in stochastic approximation, in Proceedings of the 1996 IFAC World Congress, pp. 375-380, June 1996.
3. H.-F. Chen, L. Guo, and A.-J. Gao, Convergence and robustness of the Robbins-Monro algorithm truncated at randomly varying bounds, Stochastic Processes and Their Applications, vol. 27, pp. 217-231, 1988.
4. D.S. Clark, Necessary and sufficient conditions for the Robbins-Monro method, Stochastic Processes and Their Applications, vol. 17, pp. 359-367, 1984.
5. B. Delyon, General results on the convergence of stochastic algorithms, IEEE Transactions on Automatic Control, vol. 41, no. 9, pp. 1245-1255, Sept. 1996.
6. R. Durrett, Probability: Theory and Examples. Wadsworth & Brooks/Cole, Pacific Grove, CA, 1991.
7. L. Györfi and H. Walk, On the averaged stochastic approximation for linear regression, SIAM Journal on Control and Optimization, vol. 34, no. 1, pp. 31-61, Jan. 1996.
8. G. Kersting, Almost sure approximation of the Robbins-Monro process by sums of independent random variables, The Annals of Probability, vol. 5, no. 6, pp. 954-965, 1977.
9. S. R. Kulkarni and C. S. Horn, An alternative proof for convergence of stochastic approximation algorithms, IEEE Transactions on Automatic Control, vol. 41, no. 3, pp. 419-424, Mar. 1996.
10. H. J. Kushner and J. Yang, Stochastic approximation with averaging of the iterates: Optimal asymptotic rate of convergence for general processes, SIAM Journal on Control and Optimization, vol. 31, no. 4, pp. 1045-1062, 1993.
11. H. J. Kushner and J. Yang, Stochastic approximation with averaging and feedback: Rapidly convergent "on-line" algorithms, IEEE Transactions on Automatic Control, vol. 40, no. 1, pp. 24-34, 1995.
12. H. K. Kushner and D. S. Clark, Stochastic Approximation Methods for Constrained and Unconstrained Systems. Springer-Verlag, New York, 1978.
13. L. Ljung, Strong convergence of a stochastic approximation algorithm, The Annals of Statistics, vol. 6, no. 3, pp. 680-696, 1978.
14. L. Ljung, Aspects on accelerated convergence in stochastic approximation schemes, in Proceedings of the 33rd Conference on Decision and Control (Lake Buena Vista, FL), pp. 1649-1652, 1994.
15. L. Ljung, G. Pflug, and H. Walk, Stochastic Approximation and Optimization of Random Systems. Birkhäuser, Basel, 1992.
16. M. Loève, Probability Theory I, 4th edn. Springer-Verlag, New York, 1977.
17. M. Metivier and P. Priouret, Applications of a Kushner and Clark lemma to general classes of stochastic algorithms, IEEE Transactions on Information Theory, vol. 30, no. 2, pp. 140-151, Mar. 1984.
18. A. Pakes, Some remarks on the paper by Theodorescu and Wolff: "Sequential estimation of expectations in the presence of trend," Australian Journal of Statistics, vol. 24, pp. 89-97, 1982.
19. B. T. Polyak, New method of stochastic approximation type, Automatic Remote Control, vol. 51, pp. 937-946, 1990.
20. B. T. Polyak and A. B. Juditsky, Acceleration of stochastic approximation by averaging, SIAM Journal on Control and Optimization, vol. 30, no. 4, pp. 838-855, July 1992.
21. D. Ruppert, Almost sure approximations to the Robbins-Monro and Kiefer-Wolfowitz processes with dependent noise, The Annals of Probability, vol. 10, no. 1, pp. 178-187, 1982.
22. D. Ruppert, Efficient estimators from a slowly convergent Robbins-Monro process, Technical Report, School of Operations Research and Industrial Engineering, Cornell University, Ithaca, NY, 1988.
23. R. Schwabe, Strong representation of an adaptive stochastic approximation procedure, Stochastic Processes and Their Applications, vol. 23, pp. 115-130, 1986.
24. R. Schwabe, Stability results for smoothed stochastic approximation procedures, Zeitschrift für Angew andte Mathematik und Mechanik, vol. 73, pp. 639-643, 1993.
25. R. Schwabe and H. Walk, On a stochastic approximation procedure based on averaging, Metrika, 1996, to appear.
26. A. Shapiro and Y. Wardi, Convergence analysis of gradient descent stochastic algorithms, Manuscript, Schools of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, GA 30332, 1995.
27. J. C. Spall and J. A. Cristion, Model-free control of nonlinear stochastic systems in discrete time, in Proceedings of the 34th IEEE Conference on Decision and Control, pp. 2199-2204, 1995.
28. H. Walk and L. Zsidó, Convergence of Robbins-Monro method for linear problems in a Banach space, Journal of Mathematical Analysis and Applications, vol. 139, pp. 152-177, 1989.
29. I.-J. Wang, E. K. P. Chong, and S. R. Kulkarni, Equivalent necessary and sufficient conditions on noise sequences for stochastic approximation algorithms, Advances in Applied Probability, vol. 28, pp. 784-801, 1996.
30. Y. Wardi, Stochastic algorithms with Armijo step sizes for minimization of functions, Journal of Optimization Theory and Applications, vol. 64, pp. 399-417, 1990.
31. G. Yin, On extensions of Polyak's averaging approach to stochastic approximation, Stochastics and Stochastics Reports, vol. 36, pp. 245-264, 1991.
32. G. Yin and K. Yin, Asymptotically optimal rate of convergence of smoothed stochastic recursive algorithms, Stochastics and Stochastics Reports, vol. 47, pp. 21-46, 1994.