On the almost sure asymptotic behaviour of stochastic algorithms

Stochastic Processes and their Applications

Volumn 78, Issue 2, 1998, Pages 217-244

  Pelletier, Mariane ^a  

^a UNIVERSITÉ GUSTAVE EIFFEL   (France)

Author keywords

60F05; 60F15; 62F12; 62L20; Law of the iterated logarithm; Quadratic strong law of large numbers; Stochastic algorithms

Indexed keywords

EID: 0001129018     PISSN: 03044149     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0304-4149(98)00029-5     Document Type: Article

References (27)

1. Benvéniste A., Métivier M., Priouret P. Adaptive Algorithms and Stochastic Approximation. 1990;Springer, Berlin.
2. Berger E. Asymptotic behavior of a class of stochastic approximation procedures. Probab. Theoret. Fields. 71:1986;517-552.
3. Chen H.F., Guo, L., Gao, A.J., 1988. Convergence and robustness of the Robbins-Monro algorithm truncated at randomly varying bounds. Stochastic Process. Appl., 217-231.
4. Duflo, M., 1996. Méthodes récursives aléatoires, Masson, 1990. In: English Stochastic Iterative Models, Springer, Berlin.
5. Duflo, M., 1996. Algorithmes Stochastiques. Springer collection mathématiques et applications.
6. Duflo M., Sénoussi R., Touati A. Sur la loi des grands nombres pour les martingales vectorielles et I'estimateur des moindres carrés d'un modéle de régression. Ann. Inst. H. Poincaré 26:1990;549-566.
7. Feller, W., 1968. An introduction to probability theory and its applications, vol. 2, 3rd ed. Wiley, New York.
8. Gaposhkin V.E., Krasulina T.P. On the law of the iterated logarithm in stochastic approximation processes. Theory Probab. Appl. 19:1974;844-850.
9. Heunis A.J. Rates of convergence for an adaptive filtering algorithm driven by stationary dependent data. SIAM J. Control Optim. 32:1994;113-139.
10. Kushner, H.J., Clark, D.S., 1978. Stochastic Approximation for Constrained and Unconstrained Systems, Applied Math. Science Series, 26, Springer, Berlin.
11. Lai T.Z., Robbins H. Limit theorems for weighted sums and stochastic approximation processes. Proc. Natl. Acad. Sci. USA. 75:1978;1068-1070.
12. Lai T.Z., Wei C.Z. A note on martingale difference sequences satisfying the local Marankiewicz-Zigmund condition, Bull. of the institute of mathematics. Academia Sinica. 11:1983;1-13.
13. Ljung L., Pflug G., Walk H. Stochastic Approximation and Optimization of Random Systems. 1992;Birkhäuser, Basel.
14. Le Breton, A., 1993. About the averaging approach schemes for stochastic approximation. Math. Methods Statist. 2, 295-315.
15. Le Breton, A., Novikov, A., 1994. Averaging for estimating covariances in stochastic approximation, Math. Methods Statist. 3, 244-266.
16. Le Breton, A., Novikov, A., 1995. Some results about averaging in stochastic approximation. Metrika 42, 153-171.
17. Mark, G., 1982. Log-log-invarianzprinzipien für prozess der stochastischen approximation. Mitteilungen Math. Sem. Giessen, 153.
18. Nevelson, M.B., Has'minskii, R.Z., 1973. Stochastic approximation and recursive estimations, Nauka, Moscow, 1972. Translation of Math. Monographs, 47. Amer. Math. Soc.
19. Pechtl A. Arithmetic means and invariance principles in stochastic approximation. J. theoret. Probab. 6:1993;153-173.
20. Pelletier M. Efficacité asymptotique presque sûre des algorithmes stochastiques moyennisés. C.R. Acad. Sci. Paris. 323:1996;813-816.
21. Pelletier, M., 1996b. Asymptotic almost sure efficiency of averaged stochastic algorithms, Preprint 3, University of Marne-la-Vallée, Marne-la-Vallée.
22. Pelletier, M., 1998. Weak convergence rates for stochastic approximation with application to multiple targets and simulated annealing. Ann. Appl. Probab. 8, 10-44.
23. Ruppert D. Almost sure approximations to the Robbins-Monro and Kiefer-Wolfowitz processes with dependent noise. Ann. Probab. 10:1982;178-187.
24. Seneta, 1976. Regularly Varying Function, Lect. Notes in Math., vol. 508. Springer, Berlin.
25. Stout W.F. A martingale analogue of Kolmogorov's law of the iterated logarithm. Z. Wahrscheinlichkeitstheorie. 15:1970;279-290.
26. Wei C.Z. Asymptotic properties of least-squares estimates in stochastic regression models. Ann. Statist. 13:1985;1498-1508.
27. Wei C.Z. Adaptive prediction by least squares predictors in stochastic regression models with applications to time series. Ann. Statist. 15:1987;1667-1682.