Advice generation from observed execution: Abstract Markov decision process learning

Proceedings of the National Conference on Artificial Intelligence

Volumn , Issue , 2004, Pages 631-636

  Riley, Patrick ^a   Veloso, Manuela ^a  

^a Carnegie Mellon University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADVICE GENERATION; DOMAINS; EXECUTABLE ADVICE; MARKOV DECISION PROCESS (MDP);

ALGORITHMS; BANDWIDTH; COMPUTER SIMULATION; CONSTRAINT THEORY; DECISION MAKING; MARKOV PROCESSES; SOFTWARE AGENTS;

LEARNING SYSTEMS;

EID: 9444229271     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Barto, A., and Mahadevan, S. 2003. Recent advances in hierarchical reinforcement learning. Discrete-Event Systems Journal 13:41-77.
2. Charniak, E., and Goldman, R. 1993. A Bayesian model of plan recognition. Artificial Intelligence 64(1):53-79.
3. Dearden, R., and Boutilier, C. 1997. Abstraction and approximate decision theoretic planning. Artificial Intelligence 89(1):219-283.
4. Jensen, R. M.; Veloso, M. M.; and Bryant, R. E. 2004. Fault Tolerant Planning: Toward Probabilistic Uncertainty Models in Symbolic Non-Deterministic Planning. In ICAPS04.
5. Kautz, H. A. 1991. A Formal theory of plan recognition and its implementation. In Allen, J. F.; Kautz, H. A.; Pelavin, R. N.; and Tenenberg, J. D., eds., Reasoning About Plans. Los Altos, CA: Morgan Kaufmann. chapter 2.
6. Kitano, H.; Tambe, M.; Stone, P.; Veloso, M.; Coradeschi, S.; Osawa, E.; Matsubara, H.; Noda, I.; and Asada, M. 1997. The RoboCup synthetic agent challenge. In IJCAI-97, 24-49.
7. Kuhlmann, G.; Stone, P.; and Lallinger, J. 2004. The champion UT Austin Villa 2003 simulator online coach team. In Polani, D.; Browning, B.; Bonarini, A.; and Yoshida, K., eds., RoboCup-2003: Robot Soccer World Cup VII. Berlin: Springer Verlag. (to appear).
8. Maclin, R., and Shavlik, J. W. 1996. Creating advice-taking reinforcement learners. Machine Learning 22:251-282.
9. Noda, I.; Matsubara, H.; Hiraki, K.; and Frank, I. 1998. Soccer server: A tool for research on multiagent systems. Applied Artificial Intelligence 12(2-3):233-250.
10. Paolucci, M.; Suthers, D. D.; and Weiner, A. 1996. Automated advice-giving strategies for scientific inquiry. In ITS-96, 372-381.
11. Puterman, M. L. 1994. Markov Decision Processes. New York: John Wiley & Sons.
12. Raines, T.; Tambe, M.; and Marsella, S. 2000. Automated assistant to aid humans in understanding team behaviors. In Agents-2000.
13. Riley, P.; Veloso, M.; and Kaminka, G. 2002. An empirical study of coaching. In Asama, H.; Arai, T.; Fukuda, T.; and Hasegawa, T., eds., Distributed Autonomous Robotic Systems 5. Springer-Verlag. 215-224.
14. Schweitzer, P. L.; Puterman, M. L.; and Kindle, K. W. 1985. Iterative aggregation-deaggregation procedures for discounted semi-Markov reward processes. Operations Research 33:589-605.
15. Shani, G.; Brafman, R. I.; and Heckerman, D. 2002. An MDP-based recommender system. In UAI-2002, 453-460.
16. Uther, W., and Veloso, M. 2002. TTree: Tree-based state generalization with temporally abstract actions. In Proceedings of SARA-2002.
17. Visser, U., and Weland, H.-G. 2004. Using online learning to analyze the opponent behavior. In Polani, D.; Bonarini, A.; Browning, B.; and Yoshida, K., eds., RoboCup-2003: The Sixth RoboCup Competitions and Conferences. Berlin: Springer Verlag. (to appear).