Sensitivity analysis for finite Markov chains in discrete time

Proceedings of the 24th Conference on Uncertainty in Artificial Intelligence, UAI 2008

Volumn , Issue , 2008, Pages 129-136

  De Cooman, Gert ^a   Hermans, Filip ^a   Quaeghebeur, Erik ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

CREDAL SETS; DISCRETE TIME; FINITE MARKOV CHAIN; GENERALISATION; INITIAL STATE; MARKOV CHAIN; NON-TRIVIAL; PERRON-FROBENIUS THEOREM; TIME EVOLUTIONS; TRANSITION PROBABILITIES; UNCERTAINTY MODELS;

ARTIFICIAL INTELLIGENCE; PROBABILITY; SENSITIVITY ANALYSIS;

MARKOV PROCESSES;

EID: 80053137958     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. M. A. Campos, G. P. Dimuro, A. C. da Rocha Costa, and V. Kreinovich. Computing 2-step predictions for intervalvalued finite stationary Markov chains. Technical Report UTEP-CS-03-20a, University of Texas at El Paso, 2003.
2. L. M. de Campos, J. F. Huete, and S. Moral. Probability intervals: a tool for uncertain reasoning. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 2:167-196, 1994.
3. Gert de Cooman and Filip Hermans. Imprecise probability trees: Bridging two theories of imprecise probability. Artificial Intelligence, 2008. doi: 10.1016/j.artint.2008.03. 001. In press.
4. Gert de Cooman and Enrique Miranda. Symmetry of models versus models of symmetry. In W. L. Harper and G. R. Wheeler, editors, Probability and Inference: Essays in Honor of Henry E. Kyburg, Jr., pages 67-149. King's College Publications, 2007.
5. D. Harmanec. Generalizing Markov decision processes to imprecise probabilities. Journal of Statistical Planning and Inference, 105:199-213, January 2002.
6. H. Itoh and K. Nakamura. Partially observable Markov decision processes with imprecise parameters. Artificial Intelligence, 171:453-490, January 2007. (Pubitemid 46830913)
7. John G. Kemeny and J. Laurie Snell. Finite Markov Chains. Undergraduate Text in Mathematics. Springer-Verlag, New York, 1976. Reprint of the 1960 Edition.
8. Igor O. Kozine and Lev V. Utkin. Interval-valued finite Markov chains. Reliable Computing, 8(2):97-113, April 2002. doi: doi:10.1023/A:1014745904458. (Pubitemid 34254805)
9. David G. Luenberger. Introduction to Dynamic Systems. Theory, Models & Applications. John Wiley & Sons, New York, 1979.
10. Enrique Miranda and Gert de Cooman. Marginal extension in the theory of coherent lower previsions. International Journal of Approximate Reasoning, 46(1):188-225, September 2007. doi: 10.1016/j.ijar.2006.12.009. (Pubitemid 47299294)
11. A. Nilim and L. El Ghaoui. Robust control of Markov decision processes with uncertain transition matrices. Operations Research, 53:780-798, January 2005. (Pubitemid 41525849)
12. R. D. Nussbaum, M. Scheutzow, and S. M. Verduyn Lunel. Periodic points of nonexpansive maps and nonlinear generalizations of the Perron-Frobenius theory. Selecta Mathematica, 4:141-181, January 1998. (Pubitemid 128138584)
13. J. K. Satia and R. E. Lave. Markovian decision processes with uncertain transition probabilities. Operations Research, 21:728-740, January 1973.
14. G. Shafer. A Mathematical Theory of Evidence. Princeton University Press, Princeton, NJ, 1976.
15. G. Shafer. The Art of Causal Conjecture. The MIT Press, Cambridge, MA, 1996.
16. R Sine. A nonlinear Perron-Frobenius theorem. Proceedings of the American Mathematical Society, 109(2):331-336, January 1990.
17. D. Škulj. Finite discrete time Markov chains with interval probabilities. In J. Lawry, E. Miranda, A. Bugarin, S. Li, M. A. Gil, P. Grzegorzewski, and O. Hryniewicz, editors, Soft Methods for Integrated Uncertainty Modelling, pages 299-306. Springer, Berlin, 2006.
18. D. Škulj. Regular finite Markov chains with interval probabilities. In G. de Cooman, J. Vejnarová, and M. Zaffalon, editors, ISIPTA '07 - Proceedings of the Fifth International Symposium on Imprecise Probability: Theories and Applications, pages 405-413. SIPTA, 2007.
19. P. Walley. Statistical Reasoning with Imprecise Probabilities. Chapman and Hall, London, 1991.
20. P. Walley. Measures of uncertainty in expert systems. Artificial Intelligence, 83(1):1-58, May 1996. (Pubitemid 126375458)
21. K. Weichselberger. Elementare Grundbegriffe einer allgemeineren Wahrscheinlichkeitsrechnung. I. Intervallwahrscheinlichkeit als umfassendes Konzept. Physica-Verlag Heidelberg, June 2001.
22. C. C. White and H. K. Eldeib. Markov decision-processes with imprecise transition-probabilities. Operations Research, 42:739-749, January 1994.