Model-based online learning of POMDPs

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3720 LNAI, Issue , 2005, Pages 353-364

  Shani, Guy ^a   Brafman, Ronen I ^a   Shimony, Solomon E ^a  

^a BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC NOISE; ALGORITHMS; COMPUTATION THEORY; MATHEMATICAL MODELS; ONLINE SYSTEMS; PROBLEM SOLVING; SENSORS;

MCCALLUMS' UTILE SUFFIX MEMORY (USM); MODEL-FREE METHODS; REINFORCEMENT LEARNING PARADIGM; SENSOR NOISE;

LEARNING SYSTEMS;

EID: 33646435268     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11564096_35     Document Type: Conference Paper

References (13)

1. R. E. Bellman. Dynamic Programming. Princeton University Press, 1962.
2. J. Bilmes. A gentle tutorial on the em algorithm and its application to parameter estimation for gaussian mixture and hidden markov models. Technical Report ICSI-TR-97-021, 1997.
3. A. R. Cassandra, L. P. Kaelbling, and M. L. Littman. Acting optimally in partially observable stochastic domains. In AAAI'94, pages 1023-1028, 1994.
4. L. Chrisman. Reinforcement learning with perceptual aliasing: The perceptual distinctions approach. In AAAI'02, pages 183-188, 1992.
5. R. A. Howard. Dynamic Programming and Markov Processes. MIT Press, 1960.
6. M. L. Littman, A. R. Cassandra, and L. P. Kaelbling. Learning policies for partially observable environments: Scaling up. In ICML'95.
7. A. K. McCallum. Reinforcement Learning with Selective Perception and Hidden State. PhD thesis, University of Rochester, 1996.
8. N. Meuleau, L. Peshkin, K. Kim, and L. P. Kaelbling. Learning finite-state controllers for partially observable environments. In UAI'99, pages 427-436, 1999.
9. D. Nikovski. State-Aggregation Algorithms for Learning Probabilistic Models for Robot Control. PhD thesis, Carnegie Mellon University, 2002.
10. G. Shani and R. I. Brafman. Resolving perceptual aliasing in the presence of noisy sensors. In NIPS'17, 2004.
11. G. Shani, R. I. Brafman, and S. E. Shimony. Partial observability under noisy sensors - from model-free to model-based. In ICML RRfRL Workshop, 2005.
12. M. T. J. Spaan and N. Vlassis. Perseus: Randomized point-based value iteration for POMDPs. Technical Report IAS-UVA-04-02, University of Amsterdam, 2004.
13. D. Wierstra and M. Wiering. Utile distinction hidden markov models. In ICML, July 2004.