Controlling deliberation in a markov decision process-based agent

Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

Volumn 1, Issue , 2008, Pages 454-461

  Alexander, George ^a   Raja, Anita ^a   Musliner, David J ^b  

^a University of North Carolina at Charlotte   (United States)

^b HONEYWELL TECHNOLOGY CENTER   (United States)

Author keywords

Bounded rationality; Markov decision process; Meta level control

Indexed keywords

AUTONOMOUS AGENTS; MARKOV PROCESSES; MULTI AGENT SYSTEMS;

BOUNDED RATIONALITY; MARKOV DECISION; MARKOV DECISION PROCESSES; META-LEVEL CONTROL; PARTIAL UNROLLING; RE-PRIORITIZATION; REASONING PROCESS; SCHEDULING AGENTS;

LEVEL CONTROL;

EID: 84899945823     PISSN: 15488403     EISSN: 15582914     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. G. Alexander, A. Raja, E. H. Durfee, and D. J. Musliner. Design paradigms for meta-control in multi-agent systems. In Proceedings of the AAMAS 2007 Workshop on Metareasomng in Agent-based Systems, pages 92-103, Honolulu, HI, May 2007.
2. D. P. Bertsekas and J. N. Tsitsiklis. Neuro-Dynamic Programming. Athena Scientific, Belmont, MA, 1996.
3. M. Boddy and T. Dean. Decision-theoretic deliberation scheduling for problem solving in time-constrained environments, 1994.
4. V. Conitzer and T. Sandholm. Definition and complexity of some basic metareasoning problems. In IJCAI, pages 1099-1106, 2003.
5. M. T. Cox. Metacognition in computation: A selected research review. Artif. Intell, 169(2):104-141, 2005.
6. T. Dean and M. Boddy. An analysis of time-dependent planning. In Proceedings of the Seventh National Conference on Artificial Intelligence (AAAI-88), pages 49-54, Saint Paul, Minnesota, USA, 1988. AAAI Press/MIT Press.
7. Gnuplot. http://www.gnuplot.info.
8. R. P. Goldman, D. J. Musliner, and K. D. Krebsbach. Managing online self-adaptation in real-time environments. In Lecture Notes in Computer Science, volume 2614, pages 6-23. Springer-Verlag, 2003.
9. E. A. Hansen and S. Zilberstein. Monitoring and control of anytime algorithms: A dynamic programming approach. Artif. Inteli, 126(1-2):139-157, 2001.
10. B. Horling, V. Lesser, R. Vincent, T. Wagner, A. Raja, S. Zhang, K. Decker, and A. Garvey. The TAEMS White Paper, January 1999.
11. K. Larson and T. Sandholm. Using performance profile trees to improve deliberation control. In AAAI, pages 73-79, 2004.
12. M. L. Littman, T. Dean, and L. P. Kaelbling. On the complexity of solving markov decision problems. In VAI, pages 394-402, Proceedings of the Eleventh Annual Conference on Uncertainty in Artificial Intelligence (UAI-95).
13. D. W. Marquardt. An algorithm for least-squares estimation of nonlinear parameters. Journal of the Society for Industrial and Applied Mathematics, 11(2):431-441, June 1963.
14. D. J. Musliner, E. H. Durfee, J. Wu, D. A. Dolgov, R. P. Goldman, and M. S. Boddy. Coordinated plan management using multiagent MDPs. In Working Notes of the AAAI 2006 Spring Symposium on Distributed Plan and Schedule Management, pages 73-80, March 2006.
15. D. J. Musliner, R. P. Goldman, and K. D. Krebsbach. Deliberation scheduling strategies for adaptive mission planning in real-time environments. In Proc. Third International Workshop on Self Adaptive Software, 2003.
16. A. Raja and V. Lesser. A framework for meta-level control in multi-agent systems. Autonomous Agents and Multi-Agent Systems, 15(2):147-196, October 2007.
17. S. Russell and E. Wefald. Principles of metareasoning. In Proceedings of the First International Conference on Principles of Knowledge Representation and Reasoning, pages 400-411, 1989.
18. R. Sutton and A. Barto. Reinforcement Learning. MIT Press, 1998.
19. J. Wu and E. H. Durfee. Solving large TAEMS problems efficiently by selective exploration and decomposition. In Proceedings of the Sixth International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS 07), pages 291-298, Honolulu. HI, May 2007002E