General results on the convergence of stochastic algorithms

IEEE Transactions on Automatic Control

Volumn 41, Issue 9, 1996, Pages 1245-1255

  Delyon, Bernard ^a  

^a CAMPUS DE BEAULIEU   (France)

Author keywords

[No Author keywords available]

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; MARKOV PROCESSES; PERTURBATION TECHNIQUES; PROBABILITY; RANDOM PROCESSES; VECTORS;

MARKOVIAN DYNAMICS; STOCHASTIC ALGORITHMS;

ALGORITHMS;

EID: 0030242092     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/9.536495     Document Type: Article

References (20)

1. A. Benveniste, M. Métivier, and P. Priouret, Adaptive Algorithms and Stochastic Approximations. New York: Springer-Verlag, 1990.
2. M. Métivier and P. Priouret, "Application of Kushner and Clark lemma to general classes of stochastic algorithms," IEEE Trans. Inform. Theory, vol. 30, 1984.
3. M. Duflo, Méthodes récursives aléatoires. Paris: Masson, 1990.
4. O. Brandière and M. Duflo, "Les algorithmes stochastiques contournentils les pièges?" Université de Marne-la Vallée, Internal Rep., Annales de l'IHP, to appear.
5. I. Fijalkow, P. Loubaton, and P. A. Regalia, "A new algorithm for rational subspace estimation based on cascadable adaptive lossless filters," IEEE Trans. Signal Processing, submitted.
6. F. R. Gantmacher, Theory of Matrices. Paris: Dunod, 1966.
7. P. W. Glynn and S. P. Meyn, "A Lyapunov bound for solutions of Poisson equation," Ann. Probub., to appear.
8. P. Hall and C. C. Heyde, Martingale Limit Theory and Its Applications. New York: Academic, 1980.
9. T. Kato, Perturbation Theory for Linear Operators. New York: Springer-Verlag, 1966.
10. H. J. Kushner and D. S. Clark, Stochastic Approximation Methods for Constrained and Unconstrained Systems. New York: Springer-Verlag, 1978.
11. Krasnovskii, Stability of Motion. New York: Stanford Univ. Press.
12. M. Lavielle, E. Moulines, and J.-F. Cardoso, "A maximum likelihood solution to DOA estimation for discrete sources," in Proc. IEEE Workshop Statistical Signal Array Processing, 1994, pp. 349-352.
13. V. A. Lazarev, "Convergence of stochastic-approximation procedures in the case of a regression equation with several roots," Problems Inform. Transmission, 1993.
14. S. P. Meyn and R. L. Tweedie, Markov Chains and Stochastic Stability. New York: Springer-Verlag, 1993.
15. B. M. Nevelson and R. Z. Khasminskii, "Stochastic approximation and recursive estimation," Amer. Math. Soc. Transl. Math. Monographs, vol. 47, 1976.
16. E. Oja, "On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix," J. Math. Anal. Appl., vol. 106, pp. 69-84, 1985.
17. R. Pemantle, "Nonconvergence to unstable points in urn models and stochastic approximation," Ann. Probab., vol. 18, no. 2, pp. 698-712, 1990.
18. B. T. Polyak, "New stochastic approximation type procedures," Automat. Remote Contr., vol. 51, no. 7.
19. V. U. Reddy, B. Egardt. and T. Kailath, "Least squares type algorithm for adaptive implementation of Pisarenko's harmonic retrieval method," IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-30, June 1982.
20. C. J. C. H. Watkins and P. Dayan, "Q-learning," Machine Learning, vol. 8, pp. 279-292, 1992.