Towards adaptive programming integrating reinforcement learning into a programming language

ACM SIGPLAN Notices

Volumn 43, Issue 10, 2008, Pages 603-613

  Simpkins, Christopher ^a   Bhat, Sooraj ^a   Isbell Jr , Charles ^a   Mateas, Michael ^b  

^a Georgia Institute of Technology   (United States)

^b University of California Santa Cruz   (United States)

Author keywords

Adaptive programming; Object oriented programming; Partial programming; Reinforcement learning

Indexed keywords

ADAPTIVE AGENTS; ADAPTIVE BEHAVIOR; ADAPTIVE PROGRAMMING; CODE-WRITING; COMPLEX BEHAVIOR; CURRENT PROGRAMMING; DYNAMIC ENVIRONMENTS; INTELLIGENT MULTI AGENT SYSTEMS; INTERACTIVE GAMES; PARTIAL PROGRAMMING; PROGRAMMING LANGUAGE; RUNTIME SYSTEMS; SOFTWARE ENGINEERING PARADIGM; SUPPORT FOR ADAPTIVITY;

ADA (PROGRAMMING LANGUAGE); ADAPTIVE SYSTEMS; C (PROGRAMMING LANGUAGE); EDUCATION; EMBEDDED SYSTEMS; INTELLIGENT AGENTS; INTELLIGENT BUILDINGS; LINGUISTICS; MULTI AGENT SYSTEMS; QUERY LANGUAGES; REINFORCEMENT; REINFORCEMENT LEARNING; SOFTWARE AGENTS; SOFTWARE ENGINEERING;

OBJECT ORIENTED PROGRAMMING;

EID: 67650032850     PISSN: 15232867     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (16)

1. David Andre and Stuart Russell. Programmable reinforcement learning agents. In Advances in Neural Information Processing Systems, volume 13, 2001. URL citeseer.ist.psu.edu/article/andre00programmable.html.
2. David Andre and Stuart Russell. State abstraction for programmable reinforcement learning agents. In AAAI-02, Edmonton, Alberta, 2002. AAAI Press.
3. Sooraj Bhat, Charles Isbell, and Michael Mateas. On the difficulty of modular reinforcement learning for real-world partial programming. In Proceedings of the Twenty-First National Conference on Artificial Intelligence (AAAI-06), Boston, MA, USA, July 2006.
4. Thomas G. Dietterich. The MAXQ method for hierarchical reinforcement learning. In Proc. 15th International Conf. on Machine Learning, pages 118-126.
5. Morgan Kaufmann, San Francisco, CA, 1998. URL citeseer.ist.psu.edu/ dietterich98maxq.html.
6. Leslie Pack Kaelbling, Michael L. Littman, and Andrew P. Moore. Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4:237-285, 1996. URL citeseer.ist.psu.edu/ kaelbling96reinforcement.html.
7. A. B. Loyall and J. Bates. Hap: A reactive adaptive architecture for agents. Technical Report CMU-CS-91-147, 1991. URL citeseer.ist.psu.edu/ loyall91hap. html.
8. Michael Mateas and Andrew Stern. Facade: An experiment in building a fully-realized interactive drama. In Game Developers Conference: Game Design Track, San Jose, CA, March 2003.
9. Michael Mateas and Andrew Stern. Life-like Characters. Tools, Affective Functions and Applications, chapter A Behavior Language: Joint Action and Behavioral Idioms. Springer, 2004. URL http://www.interactivestory. net/papers/MateasSternLifelikeBook04.pdf.
10. Tom Mitchell. Machine Learning. McGraw-Hill, 1997.
11. Peter Norvig. Decision theory: The language of adaptive agent software. Presentation, March 1998. URL http://www.norvig.com/adaptive/index.htm.
12. Peter Norvig and David Cohn. Adaptive software, 1998. URL http://norvig.com/adapaper-pcai.html.
13. Ronald Parr and Stuart Russell. Reinforcement learning with hierarchies of machines. In Michael I. Jordan, Michael J. Kearns, and Sara A. Solla, editors, Advances in Neural Information Processing Systems, volume 10. The MIT Press, 1998. URL citeseer.ist.psu.edu/parr97reinforcement.html.
14. Stuart Russell and Peter Norvig. Artificial Intelligence: A Modern Approach. Prenticce Hall, Upper Saddle River, NJ, 2003.
15. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998. URL citeseer.ist.psu.edu/ sutton98reinforcement.html.
16. Sprague, N., and Ballard, D. 2003. Multiple-Goal Reinforcement Learning with Modular Sarsa (0). In Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence. Workshop paper.