Kernel rewards regression: An information efficient batch policy iteration approach

Proceedings of the IASTED International Conference on Artificial Intelligence and Applications, AIA 2006

Volumn , Issue , 2006, Pages 428-433

  Schneegaß, Daniel ^a   Udluft, Steffen ^a   Martinetz, Thomas ^b  

^a SIEMENS AG   (Germany)

^b UNIVERSITY OF LÜBECK   (Germany)

Author keywords

Intelligent control; Kernel based learning; Learning theory; Machine learning; Policy iteration; Reinforcement learning

Indexed keywords

CONTINUOUS TIME SYSTEMS; ITERATIVE METHODS; LEARNING ALGORITHMS; REINFORCEMENT LEARNING; SUPPORT VECTOR MACHINES;

KERNEL REWARDS REGRESSION (KRR); KERNEL-BASED LEARNING; LEARNING THEORY; POLICY ITERATION;

REGRESSION ANALYSIS;

EID: 38049121469     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Richard S. Sutton and Andrew Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, 1998.
2. Richard S. Sutton. Open theoretical questions in reinforcement learning. In EuroCOLT, pages 11-17, 1999.
3. A. G. Barto and S. Mahadevan. Recent advances in hierarchical reinforcement learning. In Discrete Event Dynamic Systems, 2003.
4. Anton Schaefer and Steffen Udluft. Solving partially observable reinforcement learning problems with recurrent neural networks. In Workshop Proc. of the European Conference on Machine Learning, 2005.
5. D. Ormoneit and S. Sen. Kernel-based reinforcement learning. Machine Learning, 49(2-3):161-178, 2002.
6. T. Dietterich and X. Wang. Batch value function approximation via support vectors. In NIPS, pages 1491-1498, 2001.
7. Michail G. Lagoudakis and Ronald Parr. Model-free least-squares policy iteration. In Advances in Neural Information Processing Systems, volume 14, 2002.
8. Michail G. Lagoudakis, Ronald Parr, and Michael L. Littman. Least-squares methods in reinforcement learning for control. In SETN, pages 249-260, 2002.
9. Justin A. Boyan. Least-squares temporal difference learning. In I. Bratko and S. Dzeroski, editors, Machine Learning: Proceedings of the Sixteenth International Conference, volume 14, pages 49-56. Morgan Kaufmann, San Francisco, CA, 1999.
10. O. Chapelle and B. Schoelkopf. Incorporating invariances in non-linear support vector machines. In T. G. Dietterich, S. Becker, and Z. Ghahramani, editors, Advances in Neural Information Processing Systems, volume 14, pages 609-616. MIT Press, Cambridge, MA, 2002.
11. B. Haasdonk and D. Keysers. Tangent distance kernels for support vector machines. In Proceedings of the 16th ICPR, pages 864-868, 2002.
12. Bernhard Schoelkopf, Patrice Simard, Alex J. Smola, and Vladimir Vapnik. Prior knowledge in support vector kernels. In NIPS, 1997.
13. AE Hoerl and RW Kennard. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, pages 55-68, 1970.
14. Trevor Hastie, Robert Tibshirani, and Jerome Friedman. The Elements Of Statistical Learning Theory, Data Mining, Inference, and Prediction. Springer, New York, 2001.
15. Vladimir N. Vapnik. Statistical Learning Theory. John Wiley & Sons, Inc., New York, 1998.
16. Nello Cristianini and John Shawe-Taylor. Support Vector Machines And Other Kernel-based Learning Methods. Cambridge University Press, Cambridge, 2000.
17. Alex J. Smola and Bernhard Schoelkopf. A tutorial on support vector regression. NeuroCOLT2 Technical Report NC-TR-98-030, Royal Holloway College, University of London, UK, 1998.
18. Volker Tresp. Scaling kernel-based systems to large data sets. Data Mining and Knowledge Discovery, 2001.
19. Volker Tresp. Mixtures of gaussian processes. In NIPS, volume 13, 2000.
20. Matthias Hein and Olivier Bousquet. Kernels, associated structures and generalizations. Max-Planck-Institut fuer biologische Kybernetik, Technical Report, 2004.
21. Yuhong Guo and Dale Schuurmans. Support vector machines on general confidence functions. Department of Computing Science, University of Alberta, Edmonton, Canada, Technical Report, 2005.
22. C.S. Ong, X. Mary, S. Canu, and A.J. Smola. Learning with non-positive kernels. In Proceedings of the 21st International Conference on Machine Learning, pages 639-646, 2004.
23. O. L. Mangasarian and David R.. Musicant. Data discrimination via nonlinear generalized support vector machines. Computer Sciences Department, University of Wisconsin, Madison, Wisconsin, Technical Report 99-03, 1999.
24. Andrew Y. Ng, Daishi Harada, and Stuart Russell. Policy invariance under reward transformations: Theory and application to reward shaping. In Proc. 16th Intl. Conf. on Machine Learning, pages 278-287, 1999.
25. Volker Tresp. The wet game of chicken. Siemens AG, CTIC 4, Technical Report, 1994.
26. John C. Piatt. Fast training of support vector machines using sequential minimal optimization. In Advances in kernel methods: support vector learning, pages 185-208. MIT Press, Cambridge, MA, USA, 1999.
27. T. Martinetz. Maxminover: A simple incremental learning procedure for support vector classification. Proc. of the International Joint Conference on Neural Networks (IEEE Press), pages 2065-2070, 2004.