Human-assisted neuroevolution through shaping, advice and examples

Genetic and Evolutionary Computation Conference, GECCO'11

Volumn , Issue , 2011, Pages 371-378

  Karpov, Igor V ^a   Valsalam, Vinod K ^a   Miikkulainen, Risto ^a  

^a University of Texas at Austin   (United States)

Author keywords

Advice; Human assisted machine learning; Imitation; Machine learning games; Neuroevolution; Shaping

Indexed keywords

ADVICE; HUMAN-ASSISTED MACHINE LEARNING; IMITATION; MACHINE-LEARNING; NEUROEVOLUTION; SHAPING;

ARTIFICIAL INTELLIGENCE; BIOLOGY; CALCULATIONS; INTELLIGENT AGENTS; MACHINE DESIGN;

LEARNING SYSTEMS;

EID: 84860391197     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2001576.2001628     Document Type: Conference Paper

References (15)

1. P. Abbeel and A. Ng. Apprenticeship Learning via Inverse Reinforcement Learning. In Proceedings of the twenty-first International Conference on Machine Learning ICML'04, page 1. ACM, 2004.
2. L. Cardamone, D. Loiacono, and P. L. Lanzi. Learning Drivers for TORCS through Imitation Using Supervised Methods. In Proceedings of the IEEE 2009 Symposium on Computational Intelligence and Games (CIG'09), 2009.
3. A. Coates, P. Abbeel, and A. Y. Ng. Apprenticeship Learning for Helicopter Control. Commun. ACM, 52:97-105, July 2009.
4. W. Knox and P. Stone. Interactively Shaping Agents via Human Reinforcement: the TAMER Framework. In Proceedings of the 5th International Conference on Knowledge Capture, pages 9-16. ACM, 2009.
5. W. Knox and P. Stone. Combining Manual Feedback with Subsequent MDP Reward Signals for Reinforcement Learning. In van der Hoek, Kaminka, Lespérance, Luck, and Sen, editors, Proceedings of the 9th Int'l Conf. on Autonomous Agents and Multiagent Systems (AAMAS 2010), pages 5-12, May 2010.
6. G. Kuhlmann, P. Stone, R. Mooney, and J. Shavlik. Guiding a reinforcement learner with natural language advice: Initial results in RoboCup soccer. In The AAAI-2004 Workshop on Supervisory Control of Learning and Adaptive Systems, July 2004.
7. R. Maclin and J. Shavlik. Creating advice-taking reinforcement learners. Machine Learning, 22:251-281, 1996. (Pubitemid 126724368)
8. M. N. Nicolescu and M. J. Mataric. Learning and Interacting in Human-Robot Domains. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 31(5):419-430, 2002.
9. D. Ramachandran and E. Amir. Bayesian Inverse Reinforcement Learning. In Twentieth International Joint Conference on Artificial Intelligence, 2007.
10. K. O. Stanley, B. D. Bryant, and R. Miikkulainen. Real-time neuroevolution in the NERO video game. IEEE Transactions on Evolutionary Computation, 9(6):653-668, 2005. (Pubitemid 41825241)
11. K. O. Stanley and R. Miikkulainen. Evolving neural networks through augmenting topologies. Evolutionary Computation, 10:99-127, 2002.
12. L. Torrey, J. Shavlik, T. Walker, and R. Maclin. Skill acquisition via transfer learning and advice taking. In Proceedings of the Seventeenth European Conference on Machine Learning (ECML'06), pages 425-436, Berlin, Germany, 2006. (Pubitemid 44618851)
13. C. H. Yong, K. O. Stanley, I. V. Karpov, and R. Miikkulainen. Incorporating Advice into Neuroevolution of Adaptive Agents. In Proceedings of the Artificial Intelligence and Interactive Digital Entertainment Conference (AIIDE'06), pages 98-104, 2006.
14. P. Zang, A. Irani, P. Zhou, C. L. Isbell, and A. Thomaz. Using Training Regimens to Teach Expanding Function Approximators. In Proceedings of the Ninth International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2010.
15. P. Zang, R. Tian, C. L. Isbell, and A. Thomaz. Batch versus Interactive Learning by Demonstration. In Proceedings of the Ninth International Conference on Development and Learning (ICDL), 2010.