Hierarchical POMDP controller optimization by likelihood maximization

AAAI Workshop - Technical Report

Volumn WS-08-01, Issue , 2008, Pages 55-60

  Toussaint, Marc ^a   Charlin, Laurent ^b   Poupart, Pascal ^c  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^b UNIVERSITY OF TORONTO   (Canada)

^c UNIVERSITY OF WATERLOO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

CONTROLLER OPTIMIZATION; DYNAMIC BAYESIAN NETWORK; HIERARCHICAL STRUCTURES; MAXIMUM LIKELIHOOD APPROACHES; NONCONVEX OPTIMIZATION; OPTIMIZATION PROBLEMS; PLANNING PROBLEM; REAL-WORLD PROBLEM;

BAYESIAN NETWORKS; CONVEX OPTIMIZATION; INFERENCE ENGINES; MAXIMUM LIKELIHOOD ESTIMATION; OPTIMIZATION; SECURITY OF DATA;

PROBLEM SOLVING;

EID: 66149171506     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Amato, C.; Bernstein, D.; and Zilberstein, S. 2007. Solving POMDPs using quadratically constrained linear programs. In IJCAI, 2418-2424.
2. Braziunas, D., and Boutilier, C. 2004. Stochastic local search for POMDP controllers. In AAAI, 690-696.
3. Charlin, L.; Poupart, P.; and Shioda, R. 2006. Automated hierarchy discovery for planning in partially observable environments. In NIPS, 225-232.
4. Dempster, A.; Laird, N.; and Rubin, D. 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B 39(1):1-38.
5. Hansen, E., and Zhou, R. 2003. Synthesis of hierarchical finite-state controllers for POMDPs. In ICAPS, 113-122.
6. Hansen, E. 1998. An improved policy iteration algorithm for partially observable MDPs. In NIPS.
7. Hoey, J.; von Bertoldi, A.; Poupart, P.; and Mihailidis, A. 2007. Assisting persons with dementia during handwashing using a partially observable Markov decision process. In ICVS.
8. Meuleau, N.; Peshkin, L.; Kim, K.-E.; and Kaelbling, L. 1999. Learning finite-state controllers for partially observable environments. In UAI, 427-436.
9. Murphy, K., and Paskin, M. 2001. Linear time inference in hierarchical HMMs. In NIPS.
10. Neal, R., and Hinton, G. 1998. A view of the EM algorithm that justifies incremental, sparse, and other variants. In Jordan, M. I., ed., Learning in Graphical Models. Kluwer.
11. Pineau, J.; Gordon, G.; and Thrun, S. 2003. Policy-contingent abstraction for robust robot control. In UAI, 477-484.
12. Pineau, J. 2004. Tractable Planning Under Uncertainty: Exploiting Structure. Ph.D. Dissertation, Robotics Institute, Carnegie Mellon University.
13. Poupart, P., and Boutilier, C. 2003. Bounded finite state controllers. In NIPS.
14. Theocharous, G.; Murphy, K.; and Kaelbling, L. P. 2004. Representing hierarchical POMDPs as DBNs for multi-scale robot localization. In ICRA, 1045-1051. IEEE.
15. Toussaint, M.; Harmeling, S.; and Storkey, A. 2006. Probabilistic inference for solving (PO)MDPs. Technical Report EDI-INF-RR-0934, School of Informatics, University of Edinburgh.