Feature discovery in approximate dynamic programming

2009 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning, ADPRL 2009 - Proceedings

Volumn , Issue , 2009, Pages 109-116

  Preux, Philippe ^a   Girgin, Sertan ^a   Loth, Manuel ^a  

^a UNIV LILLE   (France)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATE DYNAMIC PROGRAMMING; BEST STATE; FEATURE DISCOVERY; MACHINE-LEARNING; NON-PARAMETRIC; NONPARAMETRIC APPROACHES; VALUE FUNCTION APPROXIMATION; VALUE FUNCTIONS;

DYNAMIC PROGRAMMING; EDUCATION; REINFORCEMENT; SYSTEMS ENGINEERING;

REINFORCEMENT LEARNING;

EID: 67650469386     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ADPRL.2009.4927533     Document Type: Conference Paper

References (22)

1. I. Guyon and A. Elisseeff, An introduction to feature extraction. Springer, 2006.
2. S. Girgin and P. Preux, "Feature discovery in reinforcement learning using genetic programming," in Proc. 11th European Conference on Genetic Programming (EuroGP), ser. Lecture Notes in Computer Science, M. O'Neill, L. Vanneschi, S. Gustafson, A. Esparcia-Alcázar, I. D. Falco, A. D. Cioppa, and E. Tarantino, Eds., Vol. 4971. Springer, 2008, pp. 218-229.
3. S. E. Fahlman and C. Lebière, "The cascade-correlation learning architecture," in Advances in Neural Information Processing Systems, D. S. Touretzky, Ed., Vol. 2. Denver 1989: Morgan Kaufmann, San Mateo, 1990, pp. 524-532.
4. M. Puterman, Markov Decision Processes - Discrete Stochastic Dynamic Programming. Wiley, 1994.
5. D. Bertsekas and J. Tsitsiklis, Neuro-Dynamic Programming. Belmont, MA: Athena Scientific, 1996.
6. W. Powell, Approximate Dynamic Programming. Wiley, 2007.
7. S. Girgin and P. Preux, "Incremental basis function expansion in reinforcement learning using cascade-correlation networks," in Proc. of the 8th International Conference on Machine Learning and Applications (ICML-A). La Jolla, USA: IEEE Press, Dec. 2008.
8. S. Girgin and P. Preux, "Basis expansion in natural actor critic methods," in Recent Advances in Reinforcement Learning, ser. Lecture Notes in Artificial Intelligence (LNAI), S. Girgin, M. Loth, R. Munos, P. Preux, and D. Ryabko, Eds., Vol. 5323. Springer, 2008, pp. 111-124.
9. J. N. Tsitsiklis and B. V. Roy, "Feature-based methods for large scale dynamic programming," Machine Learning, Vol. 22, pp. 59-94, 1996. (Pubitemid 126724363)
10. P. Utgoff and D. Precup, "Constructive function approximation," in Feature extraction, construction, and selection: A data-mining perspective. Kluwer, 1998, pp. 219-235.
11. S. Perkins, K. Lacker, and J. Theiler, "Grafting: Fast, incremental feature selection by gradient descent in function space," Journal of Machine Learning Research, Vol. 3, pp. 1333-1356, 2003.
12. P. Keller, S. Mannor, and D. Precup, "Automatic basis function construction for approximate dynamic programming and reinforcement learning," in Proc. of the 23rd International Conference on Machine Learning (ICML). NY, USA: ACM, 2006, pp. 449-456. (Pubitemid 44482964)
13. J.-H. Wu and R. Givan, "Feature-discovering approximate value iteration methods," in Abstraction, Reformulation and Approximation, ser. Lecture Notes in Computer Science, Vol. 3607. Springer, 2005, pp. 321-331.
14. J. Platt, "A resource-allocating network for function interpolation," Neural Computation, Vol. 3, no. 2, pp. 213-225, 1991.
15. G.-B. Huang, P. Saratchandran, and N. Sundararajan, "A generalized growing and pruning RBF (GGAP-RBF) neural netowrk for function approximation," IEEE Transactions on Neural Networks, Vol. 16, no. 1, pp. 57-67, Jan. 2005. (Pubitemid 40241910)
16. S. Vijayakumar, A. D'Souza, and S. Schaal, "Incremental online learning in high dimensions," Neural Computation, Vol. 17, no. 12, pp. 2602-2632, 2002.
17. M. Loth, M. Davy, and P. Preux, "Sparse temporal difference learning using LASSO," in Proceedings of the IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning (ADPRL). IEEE Press, Apr. 2007, pp. 352-359. (Pubitemid 47431407)
18. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani, "Least-angle regression," Annals of statistics, Vol. 32, no. 2, pp. 407-499, 2004.
19. M. Loth and P. Preux, "The equi-correlation network: A new kernelized-lars with automatic kernel parameters tuning," 2008, (submitted).
20. D. Jones, C. Perttunen, and B. Stuckman, "Lipschitzian optimization without the lipschitz constant," Journal of Optimization Theory and Aplications, Vol. 79, no. 1, pp. 157-181, Oct. 1993.
21. P. Vamplew and R. Ollington, "Global versus local constructive function approximation for on-line reinforcement learning," in AI 2005: Advances in Artificial Intelligence, ser. Lecture Notes in Computer Science, Vol. 3809. Springer, 2005, pp. 113-122. (Pubitemid 43987140)
22. R. Coulom, "Reinforcement learning using neural networks with applications to motor control," Ph.D. dissertation, Institut National Polytechnique de Grenoble, France, 2002.