Equivalence relations in fully and partially observable Markov decision processes

IJCAI International Joint Conference on Artificial Intelligence

Volumn , Issue , 2009, Pages 1653-1658

  Castro, Pablo Samuel ^a   Panangaden, Prakash ^a   Precup, Doina ^a  

^a MCGILL UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EQUIVALENCE CLASSES; PROBABILITY DISTRIBUTIONS; SET THEORY;

ACTION SEQUENCES; CONDITIONAL PROBABILITY DISTRIBUTIONS; EQUIVALENCE NOTIONS; EQUIVALENCE RELATIONS; MARKOV DECISION PROCESSES; PARTIAL OBSERVABILITY; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; TRACE EQUIVALENCE;

MARKOV PROCESSES;

EID: 78751679102     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. Thomas Dean and Robert Givan. Model minimization in Markov Decision Processes. In Proceedings of AAAI, pages 106-111, 1997.
2. Norman F. Ferns, Prakash Panangaden, and Doina Precup. Metrics for finite Markov decision processes. In Proceedings of the 20th UAI, pages 162-169, 2004.
3. Robert Givan, Thomas Dean, and Matthew Greig. Equivalence Notions and Model Minimization in Markov Decision Processes. Artificial Intelligence, 147(1-2):163-223, 2003.
4. Charles A. R. Hoare. Communicating Sequential Processes. On the Construction of Programs - an Advanced Course. Cambridge University Press, 1980.
5. Leslie Pack Kaelbling, Michael L. Littman, and Anthony R. Cassandra. Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101(1-2):99-134, 1998.
6. Kim G. Larsen and Arne Skou. Bisimulation through probabilistic testing. Information and Computation, 94(1):1-28, 1991.
7. Michael L. Litman, Richard S. Sutton, and Satinder Singh. Predictive representations of state. In Advances in Neural Information Processing Systems 14, pages 1555-1561, 2002.
8. Robin Milner. A Calculus of communicating systems. Springer-Verlag, New York, NY, 1980.
9. Joelle Pineau. Tractable Planning Under Uncertainty: Exploiting Structure. PhD thesis, Carnegie Mellon University, 2004.
10. Pascal Poupart and Craig Boutilier. Value-directed compression of POMDPs. In Advances in Neural Information Processing Systems 15, pages 1547-1554, 2003.
11. Martin L. Puterman. Markov Decision Processes. John Wily & Sons, 1994.
12. Jonathan Taylor, Doina Precup, and Prakash Panangaden. Bounding performance loss in approximate MDP homomorphisms. In Advances in Neural Information Processing Systems 21, pages 1649-1656, 2009.
13. Glynn Winskel. The Formal Semantics of Programming Languages. MIT Press, 1993.
14. Sami Zhioua. Stochastic systems divergence through reinforcement learning. PhD thesis, Université Laval, 2008.