Imprecise markov chains and their limit behavior

Probability in the Engineering and Informational Sciences

Volumn 23, Issue 4, 2009, Pages 597-635

  De Cooman, Gert ^a   Hermans, Filip ^a   Quaeghebeur, Erik ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

SENSITIVITY ANALYSIS;

FINITE MARKOV CHAIN; IMPRECISE MARKOV CHAINS; LIMIT BEHAVIOR; MATHEMATICAL REPRESENTATIONS; PERRON-FROBENIUS THEOREM; TIME EVOLUTIONS; TRANSITION PROBABILITIES; UNCERTAINTY MODELS;

MARKOV CHAINS;

EID: 75049083465     PISSN: 02699648     EISSN: 14698951     Source Type: Journal    
DOI: 10.1017/S0269964809990039     Document Type: Article

References (37)

1. Avis, D., Bremner, D., & Seidel, R. (1997). How good are convex hull algorithms? Computational Geometry 7(5-6): 265-301.
2. Campos, M.A., Dimuro, G.P., da Rocha Costa, A.C., & Kreinovich, V. (2003). Computing 2-step predictions for interval-valued finite stationary Markov chains. Technical report UTEP-CS-03-20a, University of Texas at El Paso.
3. de Campos, L.M., Huete, J.F., & Moral, S. (1994). Probability intervals: A tool for uncertain reasoning. InternationalJournal of Uncertainty, Fuzziness and Knowledge-Based Systems 2: 167-196.
4. Cozman, F.G. (2000). Credal networks. Artificial Intelligence 120: 199-233.
5. Cozman, F.G. (2005). Graphical models for imprecise probabilities. International Journal of Approximate Reasoning 39(2-3): 167-184.
6. De Cooman, G. & Hermans, F. (2008). Imprecise probability trees: Bridging two theories of imprecise probability. Artificial Intelligence 172(11): 1400-1427.
7. De Cooman, G. & Miranda, E. (2007). Symmetry of models versus models of symmetry. In W.L. Harper & G.R. Wheeler (eds.), Probability and inference: Essays in honor of Henry E. Kyburg, Jr. London: King's College Publications, pp. 67-149.
8. De Cooman, G., Troffaes, M.C.M., & Miranda, E. (2008). n-Monotone exact functionals. Journal of Mathematical Analysis and Applications 347: 143-156.
9. de Finetti, B. (1970). Teoria delle Probabilità. Turin: Einaudi.
10. de Finetti, B. (1974-1975). Theory of probability: A critical introductory treatment. Chichester: Wiley. English translation of [9], two volumes.
11. Dhaenens, S. (2007). Onderzoek van imprecieze Markov-modellen. Master's thesis, Ghent University.
12. Harmanec, D. (2002). Generalizing Markov decision processes to imprecise probabilities. Journal of Statistical Planning and Inference 105: 199-213.
13. Hartfiel, D.J. (1991). Sequential limits in Markov set-chains. Journal of Applied Probability 28(4): 910-913.
14. Hartfiel, D.J. (1998). Markov set-chains. Lecture Notes in Mathematics No, 1695. Berlin: Springer.
15. Hartfiel, D.J. &Seneta, E. (1994). On the theory of Markov set-chains. Advances in Applied Probability 479-964.
16. Huygens, C. (1656-1657). Van Rekeningh in Spelen van Geluck. Reprinted in Volume XIV of [17].
17. Huygens, C. (1888-1950). Oeuvres complètes de Christiaan Huygens. Den Haag: Martinus Nijhoff. Twenty-two volumes. Available in digitized form from the Bibliothèque nationale de France (http://gallica.bnf.fr).
18. Itoh, H. & Nakamura, K. (2007). Partially observable Markov decision processes with imprecise parameters. Artificial Intelligence 171: 453-490.
19. Kemeny, J.G. & Snell, J.L. (1976). Finite markov chains. Undergraduate Text in Mathematics. New York: Springer-Verlag.
20. Koutras, M.V. (1996). On a Markov chain approach for the study of reliability structures. Journal of Applied Probability 33(2): 357-367.
21. Kozine, I.O. & Utkin, L.V. (2002). Interval-valued finite Markov chains. Reliable Computing 8(2): 97-113.
22. Luenberger, D.G. (1979). Introduction to dynamic systems. Theory, models & applications. New York: Wiley.
23. Miranda, E. & de Cooman, G. (2007). Marginal extension in the theory of coherent lower previsions. International Journal of Approximate Reasoning 46(1): 188-225.
24. Moral, S. (2005). Epistemic irrelevance on sets of desirable gambles. Annals ofMathematics and Artificial Intelligence 45: 197-214.
25. Nilim, A. &El Ghaoui, L. (2005). Robust control of Markov decision processes with uncertain transition matrices. Operations Research 53: 780-798.
26. Nussbaum, R.D., Scheutzow, M., & Verduyn Lunel, S.M. (1998). Periodic points of nonexpansive maps and nonlinear generalizations of the Perron-Frobenius theory. Selecta Mathematica 4: 141-181.
27. Satia, J.K. & Lave, R.E. (1973). Markovian decision processes with uncertain transition probabilities. Operations Research 21: 728-740.
28. Shafer, G. (1976). A mathematical theory ofevidence. Princeton, NJ: Princeton University Press.
29. Shafer, G. (1996). The art of causal conjecture. Cambridge, MA: The MIT Press.
30. Sine, R. (1990). A nonlinear Perron-Frobenius theorem. Proceedings of the American Mathematical Society 109(2): 331-336.
31. Škulj, D. (2006). Finite discrete time Markov chains with interval probabilities. In J. Lawry, E. Miranda, A. Bugarin, S. Li, M.A. Gil, P. Grzegorzewski, & O. Hryniewicz (eds.), Soft methods for integrated uncertainty modelling. Berlin: Springer, pp. 299-306.
32. S^caron;kulj, D. (2007). Regular finite Markov chains with interval probabilities. In G. de Cooman, J. Vejnarová, & M. Zaffalon (eds.), ISIPTA '07 - Proceedings of the fifth international symposium on imprecise probability: Theories and applications. Prague: SIPTA, pp. 405-413.
33. Walley, P. (1991). Statistical reasoning with imprecise probabilities. London: Chapman & Hall.
34. Walley, P. (1996). Measures of uncertainty in expert systems. Artificial Intelligence 83(1): 1-58.
35. Weichselberger, K. (2001). Elementare Grundbegriffe einer allgemeineren Wahrscheinlichkeitsrech-nung. I. Intervallwahrscheinlichkeit als umfassendes Konzept. Heidelberg: Physica-Verlag.
36. White, C.C. & Eldeib, H.K. (1994). Markov decision-processes with imprecise transition-probabilities. Operations Research 42: 739-749.
37. Whittle, P. (2000). Probability via expectation. 4th ed. New York: Springer.