Global versus local constructive function approximation for on-line reinforcement learning

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3809 LNAI, Issue , 2005, Pages 113-122

  Vamplew, Peter ^a   Ollington, Robert ^a  

^a UNIVERSITY OF TASMANIA   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; ARTIFICIAL INTELLIGENCE; COMPUTER SCIENCE; FUNCTIONS; LEARNING ALGORITHMS; LEARNING SYSTEMS; RESOURCE ALLOCATION;

CONSTRUCTIVE ARCHITECTURES; GLOBAL CONSTRUCTIVE FUNCTION; LOCAL CONSTRUCTIVE FUNCTION; REINFORCEMENT LEARNING (RL);

ONLINE SYSTEMS;

EID: 33745625397     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11589990_14     Document Type: Conference Paper

References (23)

1. Sutton, R.S. (1988). Learning to predict by the methods of temporal differences, Machine Learning, Vol. 3, pp 9-44.
2. Crites, R.H. and Barto, A.G. (1996), Improving Elevator Performance Using Reinforcement Learning, NIPS-8.
3. Tesauro, G. J. (1995), Temporal difference learning and TD-Gammon, Communications of the ACM. 38(3), pp.58-68.
4. Sutton R.S. (1996). Generalisation in reinforcement learning: Successful examples using sparse coarse coding. In Touretzky D.S., Mozer M.C., & Hasselmo M.E. (Eds.). Advances in Neural Information Processing Systems: Proceedings of the 1995 Conference (1038-1044). Cambridge, MA: The MIT Press.
5. Kretchmar, R. M. and C. W. Anderson (1997). Comparison of CMACs and RBFs for local function approximators in reinforcement learning. IEEE International Conference on Neural Networks.
6. Coulom, R. (2002). Feedforward Neural Networks in Reinforcement Learning Applied to High-dimensional Motor Control. ALT2002, Springer-Verlag.
7. Thrun, S. and Schwartz, A. (1993), Issues in Using Function Approximation for Reinforcement Learning, Proceedings of the Fourth Connectionist Models Summer School, Hillsdale, NJ, Dec 1993.
8. Anderson, C. W. (1993). Q-learning with hidden unit restarting. Advances in Neural Information Processing Systems.
9. Ratitch, B. and D. Precup (2004). Sparse Distributed Memories for On-Line Value-Based Reinforcement Learning. ECML.
10. Fahlman, S. E. and Lebiere, C. (1990). The Cascade-Correlation Learning Architecture. in Touretzky, D.S., Advances in Neural Information Processing II, Morgan Kauffman.
11. Waugh, S.G. (1995), Extending and benchmarking Cascade-Correlation, PhD thesis, Department of Computer Science, University of Tasmania
12. Rivest, F. and D. Precup (2003). Combining TD-learning with Cascade-correlation Networks. Twentieth International Conference on Machine Learning, Washington DC.
13. Bellemare, M.G., Precup, D. and Rivest, F. (2004), Reinforcement Learning Using Cascade-Correlation Neural Networks, Technical Report RL-3.04, McGill University.
14. Platt, J. (1991). "A Resource-Allocating Network for Function Interpolation." Neural Computation 3: 213-225.
15. Rummery, G. and M. Niranjan (1994). On-line Q-Learning Using Connectionist Systems. Cambridge, Cambridge University Engineering Department.
16. Adams, A. and S. Waugh (1995), Function Evaluation and the Cascade-Correlation Architecture, IEEE International Conference on Neural Networks, pp. 942-946.
17. Hwang, J.-H., S.-S. You, et al. (1996). "The Cascade-Correlation Learning: A Projection Pursuit Learning Perspective." IEEE Transactions on Neural Networks 7(2): 278-288.
18. Prechelt, L. (1997). Investigation of the CasCor Family of Learning Algorithms, in Neural Networks, 10 (5) : 885-896.
19. Lahnajarvi, J. J.T., Lehtokangas, M.I., Saarinen, J.P.P., (2002). Evaluation of constructive neural networks with cascaded architectures, in Neurocomputing 48: 573-607.
20. Fahlman, S. E. (1988) "Faster-Learning Variations on Back-Propagation: An Empirical Study", Proceedings of the 1988 Connectionist Models Summer School
21. Boyan, J.A. and Moore, A.W. (1995), Generalization in reinforcement learning: Safely approximating the value function, NIPS-7.
22. Adams, A and Vamplew, P (1998), "Encoding and Decoding Cyclic Data", The South Pacific Journal of Natural Science, Vol 16, pp. 54-58
23. Sutton, R. and Barto, S. (1998), Reinforcement Learning, MIT Press