Stability of annealing schemes and related processes

Systems and Control Letters

Volumn 41, Issue 5, 2000, Pages 325-331

  Borkar, V S ^a  

^a TATA INSTITUTE OF FUNDAMENTAL RESEARCH   (India)

Author keywords

Annealing processes; Scaling limits; Stochastic algorithms; Stochastic stability

Indexed keywords

EID: 0346736747     PISSN: 01676911     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-6911(00)00073-6     Document Type: Article

References (12)

1. G. Basak, I. Hu, C.-Z. Wey, Weak convergence of recursions, Stochastic Process. Appl. 68 (1997) 65-82.
2. A. Benveniste, M. Metivier, P. Priouret, Adaptive Algorithms and Stochastic Approximation, Springer, New York, 1990.
3. P. Billingsley, Convergence of Probability Measures, Wiley, New York, 1968.
4. V. Borkar, Probability Theory: An Advanced Course, Springer, New York, 1995.
5. V. Borkar, S. Meyn, The O.D.E. method for convergence of stochastic approximation and reinforcement learning, SIAM J. Control Optim. 38 (2000) 447-469.
6. V. Borkar, S.K. Mitter, A strong approximation theorem for stochastic recursive algorithms, J. Optim. Theory Appl. 100 (1999) 499-513.
7. S. Ethier, T. Kurtz, Markov Processes: Characterization and Convergence, Wiley, New York, 1986.
8. H. Fang, G. Gong, M. Quian, Annealing of iterative stochastic schemes, SIAM J. Control Optim. 35 (1997) 1886-1907.
9. d, SIAM J. Control Optim. 29 (1991) 999-1018.
10. P.R. Kumar, P. Varaiya, Stochastic Systems: Estimation, Identification and Adaptive Control, Prentice-Hall, Englewood Cliffs, NJ, 1986.
11. R. Liptser, A. Shiryayev, Statistics of Random Processes I: General Theory, Springer, New York, 1977.
12. G. Pflug, Searching for the best: stochastic approximation, simulated annealing and related procedures, in: S. Bittanti, G. Picci (Eds.), Identification, Adaptation, Learning, Springer, Berlin, 1996, pp. 514-549.