Robust dynamic programming for discounted infinite-horizon markov decision processes with uncertain stationary transition matrice

Proceedings of the 2007 IEEE Symposium on Approximate Dynamic Programming and Reinforcement Learning, ADPRL 2007

Volumn , Issue , 2007, Pages 96-102

  Li, Baohua ^a   Si, Jennie ^a  

^a Arizona State University

Author keywords

[No Author keywords available]

Indexed keywords

CORRELATION METHODS; DECISION MAKING; FINITE AUTOMATA; MATRIX ALGEBRA; ROBUST CONTROL;

INFINITE-HORIZON MARKOV DECISION; TRANSITION MATRICES; UNCERTAIN STATIONARY PARAMETRIC TRANSITION MATRICES;

DYNAMIC PROGRAMMING;

EID: 34548772562     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ADPRL.2007.368175     Document Type: Conference Paper

References (11)

1. P. Bellman and R. kalaba, Dynamic Programming and Modern Control Theory, New York: Academic Press, 1965.
2. M. Putterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley-Interscince, New York, 1994.
3. Hyeong Soo Chang, Hong-Gi Lee, Michael C. Fu, and Steven I. Marcus, "Evolutionary Policy Iteration for Solving Markov Decision Processes," IEEE Transactions on Automatic Cntrol, vol. 50, n. 11, pp. 1804-1808, 2005.
4. D. Berstsekas and J. Tsitsiklis, Neuro-Dynamic Programming, Athena Scientific Massachusetts, 1996.
5. J. Si, A. G. Barto, W. B. Powell and D. Wunsch, Handbook of Learning and Approximate Dynamic Programming, Wiley-IEEE Press, 2004.
6. A. Nilim and L. E. Ghaoui, "Robust Control of Markov Decision Processes with Uncertain Transition Matrices," Operations Research, vol. 53, n. 5, pp. 780-798, 2005.
7. J. K. Satia and R. E. Lave, Jr., "Markov Decision Processes with Uncertain Transition Probabilities," Operations Research, vol. 21, pp. 728-740, 1973.
8. C. C. White and H. K. Eldeib, "Markov Decision Processes with Imprecise Transition Probabilities," Operations Research, vol. 42, pp. 739-749, 1994.
9. R. Givan, S. Leach, and T. Dean, "Bounded Parameter Markov Decision Processes," Artificial Intelligence, vol. 122, no. 1-2, pp. 71-109, 2000.
10. S. Kalyanasundaram, E. K. P. Chong, and N. B. Shroff, "Markov Decision Processes with Uncertain Transition Rates: Sensitivity and Robust Control," Proceedings of the 41st IEEE Conference on Decision and Control, vol. 4, pp. 3799-3804, 2002.
11. M. Abbad, and J. A. Filar, "Perturbation and Stability Theory for Markov Control Problems," IEEE transations on Automatic Control, vol. 37, pp. 1415-1420, 1992.