The permutable POMDP: Fast solutions to POMDPs for preference elicitation

Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

Volumn 1, Issue , 2008, Pages 486-493

  Doshi, Finale ^a   Roy, Nicholas ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Decision making under uncertainty

Indexed keywords

MULTI AGENT SYSTEMS;

DECISION-MAKING UNDER UNCERTAINTY; NOISY OBSERVATIONS; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; PLANNING APPLICATIONS; PLANNING DOMAINS; POINT-BASED APPROXIMATION; PREFERENCE ELICITATION; REAL-WORLD PROBLEM;

AUTONOMOUS AGENTS;

EID: 84899990618     PISSN: 15488403     EISSN: 15582914     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. C. Boutilier. Planning and programming with first-order markov decision processes: insights and challenges. Morgan Kaufmann, 2001.
2. C. Boutilier. A pomdp formulation of preference elicitation problems. Proceedings of the Eighteenth National Conference on Artificial Intelligence, 2002.
3. F. Doshi and N. Roy. Efficient model learning for dialog management. In Proceedings of Human-Robot Interaction (HRI2007), Washington, DC, March 2007.
4. G. J. Gordon. Stable function approximation in dynamic programming. In Proceedings of the Twelfth International Conference on Machine Learning, San Francisco, CA, 1995. Morgan Kaufmann.
5. M. Kearns and S. Singh. Near-optimal reinforcement learning in polynomial time. ICML, 1998.
6. J. Pineau, G. Gordon, and S. Thrun. Point-based value iteration: An anytime algorithm forpomdps. IJCAI, 2003.
7. K Regan, R. Cohen, and P. Poupart. The advisor-pomdp: A principled approach to trust through reputation in electronic markets. Conference on Privacy Security and Trust, 2005.
8. N. Roy, J. Pineau, and S. Thrun. Spoken dialogue management using probabilistic reasoning. In Proceedings of the 38th Annual Meeting of the ACL, Hong Kong, 2000.
9. G. Shani, R. Brafman, and S. Shimony. Forward search value iteration for pomdps. IJCAI, 2007.
10. T. Smith and R. Simmons. Heuristic search value iteration for pomdps. In Proc. of UAI 2004, Banff, Alberta, 2004.
11. E. Sondik. The Optimal Control of Partially Observable Markov Decision Processes. PhD thesis, Stanford University, Stanford, California, 1971.
12. M. T. J. Spaan and N. Vlassis. Perseus: Randomized point-based value iteration for POMDPs. Journal of Artificial Intelligence Research, 24:195-220, 2005.
13. J. Williams and S. Young. Scaling up pomdps for dialogue management: The "summary pomdp" method. In Proceedings of the IEEE ASRU Workshop, 2005.