Guiding a reinforcement learner with natural language advice: Initial results in RoboCup soccer

AAAI Workshop - Technical Report

Volumn WS-04-10, Issue , 2004, Pages 30-35

  Kuhlmann, Gregory ^a   Stone, Peter ^a   Mooney, Raymond ^a   Shavlik, Jude ^b  

^a University of Texas at Austin   (United States)

^b University of Wisconsin   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FORMAL ADVICE LANGUAGE; HUMAN-GENERATED ADVISE; REINFORCEMENT LEARNER;

FORMAL LANGUAGES; LEARNING ALGORITHMS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 32144462307     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Albus, J. S. 1981. Brains, Behavior, and Robotics. Peterborough, NH: Byte.Books.
2. Chamiak, E. 2000. A maximum-entropy-inspired parser. In Proceedings of the Meeting of the North American Association for Computational Linguistics.
3. Chen, M.; Foroughi, E.; Heintz, F.; Kapetanakis, S.; Kostiadis, K.; Kummeneje, J.; Noda, I.; Obst, O.; Rjley, P.; Steffens, T.; Wang, Y.; and Yin, X. 2003. Users manual: RoboCup soccer server manual for soccer server version 7:07 and later. Available at http://sourceforge.net/projects/sserver/.
4. Clouse, J., and Utgoff, P. 1992. A teaching method for reinforcement learning. In Proceedings of the Ninth International Conference on Machine Learning, 92-101.
5. Dzeroski, S.; Raedt, L. D.; and Driessens, K. 2001. Relational reinforcement learning. Machine Learning 43:7-52.
6. Eliassi-Rad, T., and Shavlik, J. 2003. A system for building intelligent agents that learn to retrieve and extract information.International Journal on User Modeling and User-Adapted Interaction, Special Issue on User Modeling and Intelligent Agents 13:35-88.
7. Fung, G. M.; Mangasarian, O. L.; and Shavlik, J. W. 2002. Knowledge-based support vector machine classifiers. In Advances in Neural Information Processing Systems 14. MIT Press.
8. Jurafsky, D., and Martin, J. H. 2000. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition. Upper Saddle River, NJ: Prentice Hall.
9. Kate, R. J.; Wong, Y. W.; Ge, R.; and Mooney, R. J. 2004. Learning transformation rules for semantic parsing, under review, available at: http://www.cs.utexas.edu/users/ml/publication/nl.html.
10. Kuhlmann, G., and Stone, P. 2004. Progress in learning 3 vs. 2 keepaway. In Polani, D.; Browning, B.; Bonarini, A.; and Yoshida, K., eds., RoboCup-2003: Robot Soccer World Cup VII. Berlin: Springer Verlag.
11. Maclin, R., and Shavlik, J. 1994. Incorporating advice into agents that learn from reinforcements. In Proceedings of the Twelfth National Conference on Artificial Intelligence, 694-699.
12. Maclin, R. 1995. Learning from instruction and experience: Methods for incorporating procedural domain theories into knowledge-based neural networks. Ph.D. Dissertation, Computer Sciences Department, University of Wisconsin, Madison, WI.
13. Noda, I.; Matsubara, H.; Hiraki, K.; and Frank, I. 1998. Soccer server: A tool for research on multiagent systems. Applied Artificial Intelligence 12:233-250.
14. Noelle, D., and Cottrell, G. 1994. Towards instructable connectionist systems. In Sun, R., and Bookman, L., eds., Computational Architectures Integrating Neural and Symbolic Processes. Boston: Kluwer Academic.
15. Norvig, P. 1992. Paradigms of Artificial Intelligence Programming: Case Studies in Common Lisp. San Mateo, CA: Morgan Kaufmann.
16. Siegelmann, H. 1994. Neural programming language. In Proceedings of the Twelfth National Conference on Artificial Intelligence, 877-882.
17. Stone, P., and Sutton, R. S. 2001. Scaling reinforcement learning toward RoboCup soccer. In Proceedings of the Eighteenth International Conference on Machine Learning, 537-544. Morgan Kaufmann, San Francisco, CA.
18. Stone, P.; Riley, P.; and Veloso, M. 2000. The CMUnited-99 champion simulator team. In Veloso, M.; Pagello, E.; and Kitano, H., eds., RoboCup-99: Robot Soccer World Cup III. Berlin: Springer. 35-48.
19. Sutton, R. S., and Barto, A. G. 1998. Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
20. Tang, L. R., and Mooney, R. J. 2001. Using multiple clause constructors in inductive logic programming for semantic parsing. In Proceedings of the 12th European Conference on Machine Learning, 466-477.
21. Thompson C. A., and Mooney, R. J. 2003. Acquiring wordmeaning mappings for natural language interfaces. Journal of Artificial Intelligence Research 18:1-44.
22. Zeile, J. M., and Mooney, R. J. 1996. Learning to parse database queries using inductive logic programming. In Proceedings of the Thirteenth National Conference on Artificial Intelligence, 1050-1055.