Embedding a Priori Knowledge in Reinforcement Learning

Journal of Intelligent and Robotic Systems: Theory and Applications

Volumn 21, Issue 1, 1998, Pages 51-71

  Ribeiro, Carlos H C ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Experience generalisation; Q learning algorithm; Reinforcement learning

Indexed keywords

KNOWLEDGE BASED SYSTEMS; LEARNING ALGORITHMS; STATE SPACE METHODS;

EXPERIENCE GENERALIZATION; REINFORCEMENT LEARNING;

LEARNING SYSTEMS;

EID: 0031607078     PISSN: 09210296     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1007968115863     Document Type: Article

References (21)

1. Benveniste A., Métivier M., and Priouret P.: 1990, Adaptive Algorithms and Stochastic Approximations, Springer.
2. Bertsekas D. P.: 1987, Dynamic Programming: Deterministic and Stochastic Models, Prentice-Hall.
3. Boyan J. A. and Moore A. W.: 1995, Generalization in reinforcement learning: Safely approximating the value function, in: G. Tesauro, D. S. Touretzky, and T. K. Leen (eds), Advances in Neural Information Processing Systems Vol. 7, MIT Press.
4. Chapman D. and Kaelbling L. P.: 1991, Input generalization in delayed reinforcement learning: An algorithm and performance comparisons, in: Proc. of the International Joint Conf. on Artificial Intelligence (IJCAI'91), pp. 726-731.
5. Franke R.: 1982, Scattered data interpolation: Tests of some methods. Mathematics of Computation 38(157), 181-200.
6. Jaakola T., Jordan M. I., and Singh S. P.: 1994, On the convergence of stochastic iterative dynamic programming algorithms, Neural Computation 6(6), 1185-1201.
7. Karlin S. and Taylor H. M.: 1975, A First Course in Stochastic Processes, Academic Press.
8. Lin L.-Ji: 1992, Self-improving reactive agents based on reinforcement learning, planning and teaching, Machine Learning 8, 293-321.
9. Littman M. L. and Szepesvári C.: 1996, A generalized reinforcement learning model: Convergence and applications, in: Procs. of the Thirteenth International Conf. on Machine Learning (ICML'96), pp. 310-318.
10. Mahadevan S. and Connell J.: 1992, Automatic programming of behavior-based robots using reinforcement learning, Artificial Intelligence 55, 311-365.
11. Mahadevan S. and Kaelbling L. P.: 1996, The NSF workshop on reinforcement learning: Summary and observations, AI Magazine, in press.
12. Ribeiro C. H. C. and Szepesvári C.: 1996, Q-Learning combined with spreading: Convergence and results, in: Procs. of the ISRF-IEE International Conf. on Intelligent and Cognitive Systems (Neural Networks Symposium), pp. 32-36.
13. Ribeiro C. H. C.: 1995, Attentional mechanisms as a strategy for generalisation in the Q-learning algorithm, in: F. Fogelman-Soulié and P. Gallinari (eds), Procs. of the International Conf. on Artificial Neural Networks (ICANN'95), Vol. 1, EC2 et Cie, pp. 455-460.
14. Shepard D.: 1968, A two-dimensional interpolation function for irregularly spaced data, in: Procs. of the 23th National Conf. ACM, pp. 517-523.
15. Sutton R. S.: 1996, Generalization in reinforcement learning: Succesful examples using sparse coarse coding, in: D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo (eds), Advances in Neural Information Processing Systems Vol. 8, MIT Press, pp. 1038-1044.
16. Szepesvári C. and Littman M. L.: 1996, Generalized Markov decision processes: Dynamic-programming and reinforcement-learning algorithms, Cs-96-11, Brown University, Department of Computer Science, Providence.
17. Tesauro G.: 1992, Practical issues in temporal difference learning, Machine Learning 8, 257-277.
18. Tham C. K.: 1994, Modular on-line function approximation for scaling up reinforcement learning, PhD thesis, University of Cambridge.
19. Tsitsiklis J. N. and Van Roy B.: 1996, Feature-based methods for large scale dynamic programming, Machine Learning 22, 59-94.
20. Tsitsiklis J. N. and Van Roy B.: 1997, An analysis of temporal-difference learning with function approximation, IEEE Transactions on Automatic Control, in press.
21. Watkins C. J. C. H.: 1989, Learning from delayed rewards, PhD thesis, University of Cambridge.