Q-learning algorithms with random truncation bounds and applications to effective parallel computing

Journal of Optimization Theory and Applications

Volumn 137, Issue 2, 2008, Pages 435-451

  Yin, G ^a   Xu, C Z ^b   Wang, L Y ^b  

^a WAYNE STATE UNIVERSITY   (United States)

^b Wayne State University   (United States)

Author keywords

Convergence; Q learning; Rate of convergence; Recursive algorithms

Indexed keywords

SIGNAL PROCESSING;

CONVERGENCE; LOAD-BALANCING; MODIFIED ALGORITHMS; PARALLEL COM- PUTING; Q-LEARNING; Q-LEARNING ALGORITHMS; Q-LEARNING METHOD; RATE OF CONVERGENCE; RECURSIVE ALGORITHMS; RECURSIVE PROCEDURE;

LEARNING ALGORITHMS;

EID: 42449139197     PISSN: 00223239     EISSN: 15732878     Source Type: Journal    
DOI: 10.1007/s10957-007-9331-9     Document Type: Article

References (12)

1. Xu, C., Lau, F.: Load Balancing in Parallel Computers: Theory and Practice. Kluwer Academic, Boston (1997)
2. Yin, G., Xu, C., Wang, L.Y.: Optimal remapping in dynamic bulk synchronous computations via a stochastic control approach. IEEE Trans. Parallel Distrib. Syst. 14, 51-62 (2003)
3. Watkins, C.I.C.H., Dayan, P.: Q-learning. Mach. Learn. 8, 279-292 (1992)
4. Tsitsiklis, J.N.: Asynchronous stochastic approximation and Q-learning. Mach. Learn. 16, 185-202 (1994)
5. Kushner, H.J., Yin, G.: Stochastic Approximation and Recursive Algorithms and Applications, 2nd edn. Springer, New York (2003)
6. Kushner, H.J., Yin, G.: Asymptotic properties of distributed and communicating stochastic approximation algorithms. SIAM J. Control Optim. 25, 1266-1290 (1987)
7. Kushner, H.J., Yin, G.: Stochastic approximation algorithms for parallel and distributed processing. Stochastics 22, 219-250 (1987)
8. Chen, H.F., Zhu, Y.M.: Stochastic approximation procedure with randomly varying truncations. Sci. Sin. (Ser. A) 29, 914-926 (1986)
9. Yin, G., Zhu, Y.M.: On w.p.1 convergence of a parallel stochastic approximation algorithm. Probab. Eng. Inf. Sci. 3, 55-75 (1989)
10. Chen, H.-F.: Stochastic Approximation and Its Applications. Kluwer Academic, Dordrecht (2002)
11. Chen, H.-F., Yin, G.: Asymptotic properties of sign algorithms for adaptive filtering. IEEE Trans. Autom. Control 48, 1545-1556 (2003)
12. Yin, G.: Stochastic approximation: Theory and applications. In: Kannan, D., Lakshmikantham, V. (eds.) Handbook of Stochastic Analysis and Applications, pp. 577-624. Marcel Dekker, New York (2002)