Policy explanation in factored Markov decision processes

Proceedings of the 4th European Workshop on Probabilistic Graphical Models, PGM 2008

Volumn , Issue , 2008, Pages 97-104

  Elizalde, Francisco ^a   Sucar, L Enrique ^b   Luque, Manuel ^c   Díez, Francisco Javier ^c   Reyes, Alberto ^d  

^a SCHOOL OF ENGINEERING AND SCIENCES   (Mexico)

^b INSTITUTO NACIONAL DE ASTROFÍSICA   (Mexico)

^c UNIVERSIDAD NACIONAL DE EDUCACIÓN A DISTANCIA   (Spain)

^d INSTITUTO DE INVESTIGACIONES ELÉCTRICAS   (Mexico)

Author keywords

[No Author keywords available]

Indexed keywords

DOMAIN EXPERTS; EXPECTED UTILITY; FACTORED MARKOV DECISION PROCESS; HEURISTIC RULES; HUMAN EXPERT; INTELLIGENT ASSISTANTS; MARKOV DECISION PROCESSES; OPERATOR TRAINING; OPTIMAL ACTIONS; POTENTIAL CHANGE; REPRESENTATIVE SAMPLE;

MARKOV PROCESSES; OPTIMIZATION; PERSONNEL TRAINING;

LEARNING ALGORITHMS;

EID: 76549099978     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. R.E. Bellman. 1957. Dynamic Programming. Princeton U. Press, Princeton, N.J.
2. C. Bielza, J.A. Ferńandez del Pozo, and P. Lucas. 2003. Optimal decision explanation by extracting regularity patterns. In F. Coenen, A. Preece, and A.L. Macintosh, editors, Research and Development in Intelligent Systems XX, pages 283-294. Springer-Verlag.
3. C. Boutilier, T. Dean, and S. Hanks. 1999. Decision-theoretic planning: structural assumptions and computational leverage. Journal of AI Research, 11:1-94.
4. T. Dean and R. Givan. 1997. Model minimization in markov decision processes. In AAAI, editor, In Proceedings AAAI-97, pages 106-111, Cambridge, Massachusetts. MIT Press.
5. T. Dean and K. Kanasawa. 1989. A model for reasoning about persistence and causation. Computational Intelligence, 5:142-150.
6. M.J. Druzdzel. 1991. Explanation in probabilistic systems: Is it feasible? Will it work? In Intelligent information systems V, Proceedings of the workshop, pages 12-24, Poland.
7. F. Elizalde, E. Sucar, and P. deBuen. 2005. A prototype of an intelligent assistant for operator's training. In International Colloquium for the Power Industry, Ḿexico. CIGRE-D2.
8. Elvira-Consortium. 2002. Elvira: An environment for creating and using probabilistic graphical models. In Jośe A. Ǵomez and Antonio Salmeŕon, editors, First European Workshop on Probabilistic Graphical Models, PGM'02, pages 222-230, Cuenca, Spain.
9. R. Givan, T. Dean, and M. Greig. 2003. Equivalence notions and model minimization in markov decision processes. Artif. Intell., 147(1-2):163-223.
10. J. Herrmann, M. Kloth, and F. Feldkamp. 1998. The role of explanation in an intelligent assistant system. In Artificial Intelligence in Engineering, volume 12, pages 107-126. Elsevier Science Limited.
11. O. Zia Khan, P. Poupart, and J. Black. 2008. Explaining recommendations generated by MDPs. In T. Roth-Berghofer et al., editor, 3rd International Workshop on Explanation-aware Computing ExaCt 2008, Patras, Greece. Proceedings of the 3rd International ExaCt Workshop.
12. C. Lacave, R. Atienza, and F.J. Díez. 2000. Graphical explanations in Bayesian networks. In Lecture Notes in Computer Science, volume 1933, pages 122-129. Springer-Verlag.
13. C. Lacave, M. Luque, and F. J. Díez. 2007. Explanation of Bayesian networks and influence diagrams in Elvira. IEEE Transactions on Systems, Man and Cybernetics-Part B: Cybernetics, 37:952-965.
14. R. Munos and A.W. Moore. 1999. Variable resolution discretization for high-accuracy solutions of optimal control problems. In IJCAI '99: Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, pages 1348-1355, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.
15. J. Pearl. 1988. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Mateo, CA.
16. M. Puterman. 1994. Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, New York.
17. S. Renooij and L. van der Gaag. 1998. Decision making in qualitative influence diagrams. In Proceedings of the Eleventh International FLAIRS Conference, pages 410-414, Menlo Park, California. AAAI Press.
18. A. Reyes, L. E. Sucar, E. Morales, and P. H. Ibar-guengoytia. 2006. Solving hybrid Markov decision proceses. In MICAI 2006: Advances in Artificial Intelligence, Apizaco, Mexico. SpringerVerlag.
19. M. Wellman. 1990. Graphical inference in qualitative probabilistic networks. Networks, 20:687-701.