On the relationship between MDPs and the BDI architecture

Proceedings of the International Conference on Autonomous Agents

Volumn 2006, Issue , 2006, Pages 1041-1048

  Simari, Gerardo I ^a   Parsons, Simon ^b  

^a Institute of Advanced Computer Science   (United States)

^b CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

Intention; Markov decision process; Policy

Indexed keywords

ALGORITHMIC MAPPINGS; BDI ARCHITECTURE; INTENTION; MARKOV DECISION PROCESS;

ALGORITHMS; DECISION THEORY; MAPPING; MARKOV PROCESSES;

COMPUTER ARCHITECTURE;

EID: 34247253862     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1160633.1160818     Document Type: Conference Paper

References (24)

1. D. Aberdeen. A (revised) survey of approximate methods for solving partially observable markov decision processes. Technical report, National ICT Australia, Canberra, Austalia, 2003.
2. C. Boutilier, R. Dearden, and M. Goldszmidt. Stochastic dynamic programming with factored representations. Artificial Intelligence, 121(1-2):49-107, 2000.
3. M. E. Bratman, D. Israel, and M. Pollack. Plans and resource-bounded practical reasoning. In R. Cummins and J. L. Pollock, editors, Philosophy and AI: Essays at the Interface, pages 1-22. The MIT Press, Cambridge, Massachusetts, 1991.
4. T. Dean, R. Givan, and S. Leach. Model reduction techniques for computing approximately optimal solutions for Markov decision processes. In Proceedings of the 13th Conference on Uncertainty in Artificial Intelligence, pages 124-131, 1997.
5. M. P. Georgeff and F. F. Ingrand. Decision-making in embedded reasoning systems. In Proceedings of the 6th International Joint Conference on Artificial Intelligence, pages 972-978, 1989.
6. J. Goldsmith and R. H. Sloan. The complexity of model aggregation. In Artificial Intelligence Planning Systems, pages 122-129, 2000.
7. W. S. Lovejoy. A survey of algorithmic methods for partially observed Markov decision processes. Annals of Operations Research, 28(1-4):47-66, Apr. 1991.
8. J. Pineau, G. Gordon, and S. Thrun. Policy-contingent abstraction for robust robot control. In Proceedings of the Conference on Uncertainty in AI, Acapulco, Mexico, 2003.
9. M. Pollack and M. Ringuette. Introducing the Tileworld: experimentally evaluating agent architectures. In Proceedings of the 8th National Conference on Artificial Intelligence, pages 183-189, 1990.
10. M. L. Puterman. Markov decision processes: Discrete Stochastic Dynamic Programming. John Wiley and Sons, Inc., New York, 1994.
11. A. S. Rao and M. P. Georgeff. Deliberation and its role in the formation of intentions. In Proceedings of the 7th Annual Conference on Uncertainty in Artificial. Intelligence, pages 300-307, 1991.
12. A. S. Rao and M. P. Georgeff. BDI-agents: from theory to practice. In Proceedings of the First International Conference on Multiagent Systems, 1995.
13. M. J. Schoppers. Universal plans for reactive robots in unpredictable environments. In Proceedings of the 10th International Joint Conference on Artificial Intelligence, pages 1039-1046, 1987.
14. M. Schut and M. Wooldridge. Intention reconsideration in complex environments. In Proceedings of the Fourth International Conference on Autonomous Agents, pages 209-216, 2000.
15. M. Schut and M. Wooldridge. Principles of intention reconsideration. In Proceedings of the Fifth International Conference on Autonomous Agents, pages 340-347, 2001.
16. M. Schut, M. Wooldridge, and S. Parsons. On partially observable MDPs and BDI models. Lecture Notes in Computer Science, 2403:243-, 2002.
17. M. Schut, M. Wooldridge, and S. Parsons. The theory and practice of intention reconsideration. Journal of Theoretical and Experimental AI, 16(4):261-293, 2004.
18. M. C. Schut. Intention Reconsideration. PhD thesis, University of Liverpool, 2002.
19. G. I. Simari and S. Parsons. On approximating the best decision for and autonomous agent. In Proceedings of the Sixth Workshop on Game Theoretic and Decision Theoretic Agents, pages 91-100, 2004.
20. R. S. Sutton and A. G. Barto. Reinforcement learning: An introduction. MIT Press, Cambridge, MA, 1998.
21. J. Tsitsiklis and B. van Roy. Feature-based methods for large scale dynamic programming. Machine Learning, 22(1/2/3):59-94, 1996.
22. C. J. C. H. Watkins. Learning with delayed rewards. PhD thesis, Cambridge University, 1989.
23. M. Wooldridge. Intelligent Agents. In G. Weiss, editor, Multiagent Systems - A Modern Approach to Distributed Artificial Intelligence, chapter 1, pages 27-78. The MIT Press, Cambridge, Massachussetts, 1999.
24. M. Wooldridge and S. Parsons. Intention reconsideration reconsidered. In J. Müller, M. P. Singh, and A. S. Rao, editors, Agent Theories, Architectures, and Languages V, pages 63-80. Springer-Verlag: Heidelberg, Germany, July 1999.