Robust Markov decision processes using sigma point sampling

Proceedings of the American Control Conference

Volumn , Issue , 2008, Pages 5003-5008

  Bertuccelli, L F ^a   How, J P ^a  

^a Massachusetts Institute of Technology Cambridge   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MARKOV PROCESSES; UNCERTAINTY ANALYSIS;

DIRECT SAMPLING; MACHINE REPAIR; MARKOV DECISION PROCESSES; MODEL UNCERTAINTIES; MULTI-STAGE; NUMERICAL EXAMPLES; OBJECTIVE FUNCTION; OPTIMAL CONTROL; OPTIMAL RESULTS; ROBUST OPTIMIZATION; ROBUST SOLUTIONS; SIGMA POINTS; TRANSITION MODELING;

SAMPLING;

EID: 52649091902     PISSN: 07431619     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACC.2008.4587287     Document Type: Conference Paper

References (17)

1. A. Nilim and L. E. Ghaoui, "Robust solutions to markov decision problems with uncertain transition matrices," Operations Research, vol. 53, no. 5, 2005.
2. J. Satia and R. E. Lave., "Markovian decision processes with uncertain transition probabilities," Operations Research, 1973.
3. P. Kumar and A. Becker., "A new family of optimal adaptive controllers for markov chains.," IEEE Trans. on Automatic Control, vol. AC-27, no. 1, 1982.
4. P. Kumar and W. Lin., "Optimal adaptive controllers for unknown markov chains.," IEEE Trans. on Automatic Control, vol. AC-27, no. 4, 1982.
5. P. Kumar and W. Lin., "Simultaneous identification and adaptive control of unknown systems over finite parameters sets.," IEEE Trans. on Automatic Control, vol. AC-28, no. 1, 1983.
6. C. White and H. K. Eldeib., "Markov decision processes with imprecise transition probabilities," Operations Research, 1994.
7. J. Buckley and E. Eslami, "Fuzzy markov chains: Uncertain probabilities.," Mathware and Soft Computing, vol. 9, pp. 33-41, 2002.
8. R. Israel, J. S. Rosenthal, and J. Z. Wei., "Finding generators for markov chains via empirical transition matrices with applications to credit ratings," Mathematical Finance, Vol. 11, No. 2, vol. 11, no. 2, pp. 245-265, 2001.
9. M. Sato, K. Abe, and H. Takeda., "Learning control of finite markov chains with unknown transition probabilities," IEEE Trans. on Automatic Control, 1982.
10. R. Jaulmes, J. Pineau, and D. Precup., "Active learning in partially observable markov decision processes," European Conference on Machine Learning (ECML), 2005.
11. R. Jaulmes, J. Pineau, and D. Precup., "Learning in non-stationary partially observable markov decision processes," ECML Workshop on Reinforcement Learning in Non-Stationary Environments, 2005.
12. S. Mannor, D. Simester, P. Sun, and J. Tsitsiklis, "Bias and variance approximation in value function estimates.," Management Science, vol. 52, no. 2, pp. 308-322, 2007.
13. E. Delage and S. Mannor, "Percentile optimization for markov decision processes with parameter uncertainty," subm to Operations Research, 2007.
14. S. Julier and J. Uhlmann, "Unscented filtering and nonlinear estimation," Proc. of IEEE, vol. 92, no. 3, 2004.
15. A. Papoulis, Probability, Random Variables, and Stochastic Processes. McGraw-Hill, 1991.
16. N. Wicker, J. Mullera, R. Kiran, R. Kalathura, and O. Pocha, "A maximum likelihood approximation method for dirichlet's parameter estimation," Computational Statistics and Data Analysis, vol. 52, no. 3, pp. 1315-1322, 2008.
17. D. Bertsekas, Dynamic Programming and Optimal Control. Athena Scientific, 2005.