Transfer learning for direct policy search: A reward shaping approach

2013 IEEE 3rd Joint International Conference on Development and Learning and Epigenetic Robotics, ICDL 2013 - Electronic Conference Proceedings

Volumn , Issue , 2013, Pages

  Doncieux, Stephane ^a  

^a UNIVERSITÉ PIERRE ET MARIE CURIE   (France)

Author keywords

[No Author keywords available]

Indexed keywords

DIRECT POLICY SEARCH; DISCRETE STATE; KNOWLEDGE BASE; LEARNING PHASE; LIFE LONG LEARNING; NEURO EVOLUTIONS; STEPPING STONE; TRANSFER LEARNING;

LEARNING ALGORITHMS; ROBOTICS; SENSORS;

KNOWLEDGE BASED SYSTEMS;

EID: 84891102838     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DevLrn.2013.6652568     Document Type: Conference Paper

References (19)

1. K. Deb, S. Agrawal, A. Pratab, and T. Meyarivan. A Fast Elitist Non-Dominated Sorting Genetic Algorithm for Multi-Objective Optimization: NSGA-II. In Proceedings of the PPSN VI Conference, pages 849-858, Paris, France, 2000. Springer. LNCS No. 1917.
2. S. Doncieux and J.-B. Mouret. Behavioral diversity measures for Evolutionary Robotics. In IEEE Congress on Evolutionary Computation, 2010 (CEC 2010), pages 1303-1310, 2010.
3. F. Fernández and M. Veloso. Probabilistic policy reuse in a reinforcement learning agent. In Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems-AAMAS '06, New York, New York, USA, 2006. ACM Press.
4. M. Grzes. Improving exploration in reinforcement learning through domain knowledge and parameter analysis. PhD thesis, Univ. of York, 2010.
5. G. Konidaris and A. Barto. Autonomous shaping: Knowledge transfer in reinforcement learning. In ICML '06 Proceedings of the 23rd international conference on Machine learning, pages 489-496, 2006.
6. M. Mataric. Reward Functions for Accelerated Learning. In ICML '94 Proceedings of the 11th international conference on Machine learning, pages 181-189. Morgan Kaufman, 1994.
7. J.-B. Mouret and S. Doncieux. Overcoming the bootstrap problem in evolutionary robotics using behavioral diversity. In IEEE Congress on Evolutionary Computation, 2009 (CEC 2009), pages 1161-1168, 2009.
8. J.-B. Mouret and S. Doncieux. Using Behavioral Exploration Objectives to Solve Deceptive Problems in Neuro-evolution. In GECCO'09: Proceedings of the 11th annual conference on Genetic and evolutionary computation, pages 627-634. ACM, 2009.
9. J.-B. Mouret and S. Doncieux. Sferesv2: Evolvin' in the Multi-Core World. In IEEE Congress on Evolutionary Computation, 2010 (CEC 2010), pages 4079-4086, 2010.
10. J.-B. Mouret and S. Doncieux. Encouraging Behavioral Diversity in Evolutionary Robotics: An Empirical Study. Evolutionary computation, 20(1):91-133, Aug. 2012.
11. M. Muja and D. Lowe. Fast approximate nearest neighbors with automatic algorithm configuration. In International Conference on Computer Vision Theory and Applications (VISAPP'09), pages 331-340, 2009.
12. C. Ollion and S. Doncieux. Why and How to Measure Exploration in Behavioral Space. In GECCO '11: Proceedings of the 13 th annual conference on Genetic and Evolutionary Computation, pages 267-294, 2011.
13. S. J. Pan and Q. Yang. A Survey on Transfer Learning. IEEE Transactions on Knowledge and Data Engineering, 22(10):1345-1359, Oct. 2010.
14. J. Randlov and P. Alstrom. Learning to Drive a Bicycle using Reinforcement Learning and Shaping. ICML '98 Proceedings of the 15th international conference on Machine learning, pages 463-471, 1998.
15. M. Snel and S. Whiteson. Multi-task evolutionary shaping without prespecified representations. Proceedings of the 12th annual conference on Genetic and evolutionary computation-GECCO '10, pages 1031-1038, 2010.
16. M. Taylor and P. Stone. Transfer learning for reinforcement learning domains: A survey. The Journal of Machine Learning Research, 10:1633-1685, 2009.
17. M. E. Taylor, P. Stone, and Y. Liu. Value Functions for RL-Based Behavior Transfer: A Comparative Study. In Proceedings of the 20th National Conference on Artificial Intelligence, 2005.
18. S. Thrun and T. M. Mitchell. Lifelong Robot Learning. Robotics and Autonomous Systems, 15:25-46, 1995.
19. L. Torrey and J. Shavlik. Transfer Learning. In Handbook of Research on Machine Learning Applications, pages 1-22. 2009.