Discrete time Markov chains with interval probabilities

International Journal of Approximate Reasoning

Volumn 50, Issue 8, 2009, Pages 1314-1329

  Škulj, Damjan ^a  

^a UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

Imprecise Markov chains; Imprecise probabilities; Interval probabilities; Markov chains; Regularity

Indexed keywords

IMPRECISE MARKOV CHAINS; IMPRECISE PROBABILITIES; INTERVAL PROBABILITIES; MARKOV CHAINS; REGULARITY;

MARKOV PROCESSES; PROBABILISTIC LOGICS; SET THEORY;

PROBABILITY;

EID: 70349767966     PISSN: 0888613X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijar.2009.06.007     Document Type: Article

References (22)

1. De Campos L.M., Huete J.F., and Moral S. Probability intervals: a tool for uncertain reasoning. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 2 2 (1994)
2. M.A. Campos, G.P. Dimuro, A.C. da Rocha Costa, V. Kreinovich, Computing 2-step predictions for interval-valued finite stationary Markov chains, Technical report utep-cs-03-20a, University of Texas at El Paso, 2003.
3. Crossman R.J., Coolen-Schrijner P., and Coolen F.P.A. Time-homogeneous birth-death processes with probability intervals and absorbing state. Journal of Statistical Theory and Practice 3 1 (2009) 103-118
4. da Rocha J.C.F., and Cozman F.G. Evidence propagation in credal networks: an exact algorithm based on separately specified sets of probability. Advances in Artificial Intelligence, Proceedings 2507 (2002) 376-385
5. Darroch J.N., and Seneta E. On quasi-stationary distributions in absorbing discrete-time finite Markov chains. Journal of Applied Probability 2 1 (1965) 88-100
6. de Cooman G., and Hermans F. Imprecise probability trees: bridging two theories of imprecise probability. Artificial Intelligence 172 11 (2008) 1400-1427
7. de Cooman G., Hermans F., and Quaeghebeur E. Imprecise Markov chains and their limit behaviour. Probability in the Engineering and Informational Sciences (2009)
8. Denneberg D. Non-additive Measure and Integral (1997), Kluwer Academic Publishers, Dordrecht
9. Harmanec D. Generalizing Markov decision processes to imprecise probabilities. Journal of Statistical Planning and Inference 105 (2002) 199-213
10. Hartfiel D.J. Markov Set-Chains (1998), Springer-Verlag, Berlin
11. Hartfiel D.J., and Seneta E. On the theory of Markov set-chains. Advances in Applied Probability 26 4 (1994) 947-964
12. Itoh H., and Nakamura K. Partially observable Markov decision processes with imprecise parameters. Artificial Intelligence 171 8-9 (2007) 453-490
13. Kozine I., and Utkin L.V. Interval-valued finite Markov chains. Reliable Computing 8 2 (2002) 97-113
14. Nilim A., and El Ghaoui L. Robust control of Markov decision processes with uncertain transition matrices. Operations Research 53 (2005) 780-798
15. Satia J.K., and Lave R.E. Markovian decision processes with uncertain transition probabilities. Operations Research 21 3 (1973) 728-740
16. Shafer G. Belief functions and parametric models. Journal of the Royal Statistical Society Series B-Methodological 44 3 (1982) 322-352
17. D. Škulj, Finite discrete time Markov chains with interval probabilities, in: J. Lawry, E. Miranda, A. Bugarín, S. Li, M.A. Gil, P. Grzegorzewski, O. Hryniewicz (Eds.), SMPS, Advances in Soft Computing, vol. 37, Springer, 2006, pp. 299-306.
18. D. Škulj, Regular finite Markov chains with interval probabilities, in: G. de Cooman, M. Zaffalon, J. Vejnarová (Eds.), ISIPTA'07 - Proceedings of the Fifth International Symposium on Imprecise Probability: Theories and Applications, SIPTA, 2007, pp. 405-413.
19. Walley P. Statistical Reasoning with Imprecise Probabilities (1991), Chapman and Hall, London, New York
20. Walley P. Towards a unified theory of imprecise probability. International Journal of Approximate Reasoning 24 (2000) 125-148
21. Weichselberger K. Elementare Grundbegriffe einer allgemeineren Wahrscheinlichkeitsrechnung. I: Intervallwahrscheinlichkeit als umfassendes Konzept (2001), Physica-Verlag, Heidelberg
22. White C.C., and Eldeib H.K. Markov decision processes with imprecise transition probabilities. Operations Research 42 4 (1994) 739-749