On polynomial cases of the unichain classification problem for Markov Decision Processes

Operations Research Letters

Volumn 36, Issue 5, 2008, Pages 527-530

  Feinberg, Eugene A ^a   Yang, Fenghsu ^a  

^a USA   (United States)

Author keywords

Markov Decision Process; Recurrent state; Unichain condition

Indexed keywords

POLYNOMIAL APPROXIMATION; POLYNOMIALS;

#P-HARD; FINITE STATES; MARKOV DECISION PROCESS; MARKOV DECISION PROCESSES; POLYNOMIAL ALGORITHMS; RECURRENT STATE; UNICHAIN CONDITION;

CLASSIFICATION (OF INFORMATION);

EID: 50249167647     PISSN: 01676377     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.orl.2008.06.002     Document Type: Article

References (11)

1. Ahuja R.K., Magnanti T.L., and Orlin J.B. Network Flows (1993), Prentice-Hall, New Jersey
2. Bather J. Optimal decision procedures for finite Markov chains. Part III. Adv. in Appl. Probab. 5 (1973) 541-553
3. T. Bountourelis, S. Reveliotis, Optimal node visitation in stochastic digraphs, School of Industrial & Systems Engineering. Georgia Institute of Technology, 2007, Preprint
4. Derman C. Finite State Markov Decision Processes (1970), Academic Press, New York
5. Dynkin E.B., and Yushkevich A.A. Controlled Markov Processes (1979), Springer-Verlag, New York
6. Howard R.A. Dynamic Programming and Markov Processes (1960), MIT Press, Cambridge, MA
7. Kallenberg L.C.M. Classification problems in MDPs. In: How Z., Filar J.A., and Chen A. (Eds). Markov Processes and Controlled Markov Chains (2002), Kluwer, Boston 151-165
8. Kallenberg L.C.M. Finite state and action MDPs. In: Feinberg E.A., and Shwartz A. (Eds). Handbook of Markov Decision Processes (2002), Kluwer, Boston 21-87
9. McCuaig W. Intercyclic Digraphs. In: Robertson N., and Seymour P. (Eds). Graph Structure Theory, Contemporary Mathematics vol. 147 (1993), Amer. Math. Soc., Providence, RI 203-245
10. Puterman M.L. Markov Decision Processes (1994), Wiley, New York
11. Tsitsiklis J.N. N P-hardness of checking the unichain condition in average cost MDPs. Oper. Res. Lett. 35 (2007) 319-323