Experimental demonstration of adaptive MDP-based planning with model uncertainty

AIAA Guidance, Navigation and Control Conference and Exhibit

Volumn , Issue , 2008, Pages

  Bethke, Brett ^a   Bertuccelli, Luca F ^a   How, Jonathan P ^a  

^a Massachusetts Institute of Technology   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; MARKOV PROCESSES; MULTI AGENT SYSTEMS; STOCHASTIC CONTROL SYSTEMS; STOCHASTIC SYSTEMS; UNCERTAINTY ANALYSIS;

ADAPTATION MECHANISM; DEGRADED PERFORMANCE; EXPERIMENTAL DEMONSTRATIONS; MARKOV DECISION PROCESSES; MODEL UNCERTAINTIES; MULTI-AGENT PLANNING; PERFORMANCE BENEFITS; PERSISTENT SURVEILLANCE;

STOCHASTIC MODELS;

EID: 77958493967     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.2514/6.2008-6322     Document Type: Conference Paper

References (15)

1. Bethke, B., How, J. P., and Vian, J., "Group Health Management of UAV Teams With Applications to Persistent Surveillance," American Control Conference, June 2008, pp. 3145-3150.
2. Iyengar, G., "Robust Dynamic Programming," Math. Oper. Res., Vol. 30, No. 2, 2005, pp. 257-280.
3. Nilim, A. and Ghaoui, L. E., "Robust solutions to Markov decision problems with uncertain transition matrices," Operations Research, Vol. 53, No. 5, 2005.
4. Jaulmes, R., Pineau, J., and Precup., D., "Active learning in partially observable Markov decision processes," European Conference on Machine Learning (ECML), 2005.
5. Bertuccelli, L. F. and How, J. P., "Robust Decision-Making for Uncertain Markov Decision Processes Using Sigma Point Sampling," American Control Conference, June 2008, pp. 5003-5008.
6. Doshi, F. and Roy, N., "Efficient Model Learning for Dialog Management," ACM/IEEE inter- national conference on Human-robot interaction, 2007, pp. 65-72. (Pubitemid 47327128)
7. Jaulmes, R., Pineau, J., and Precup., D., "Learning in Non-Stationary Partially Observable Markov Decision Processes," ECML Workshop on Reinforcement Learning in Non-Stationary Environments, 2005.
8. J. How, B. Bethke, A. Frank, D. Dale, and J. Vian, "Real-Time Indoor Autonomous Vehicle Test Environment," Control Systems Magazine, Vol. 28, No. 2, April 2008, pp. 51-64.
9. Astrom, K. J. and Wittenmark, B., Adaptive Control, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, 1994.
10. Barto, A., Bradtke, S., and Singh., S., "Learning to Act using Real-Time Dynamic Programming." Artificial Intelligence, Vol. 72, 2001, pp. 81-138.
11. Coraluppi, S., Optimal Control of Markov Decision Processes for Performance and Robustness, Ph.D. thesis, Univ of Maryland, 1997.
12. Kaelbling, L. P., Littman, M. L., and Moore, A. P., "Reinforcement Learning: A Survey," Journal of Artificial Intelligence Research, Vol. 4, 1996, pp. 237-285.
13. Bertuccelli, L. F. and How, J. P., "Estimation of Non-stationary Markov Chain Transition Models." Conference on Decision and Control (to appear), Cancun, Mexico, 2008.
14. D. Bertsekas, Dynamic Programming and Optimal Control, Athena Scientific, Belmont, MA, 2007.
15. B. Bethke, J. How, A. Ozdaglar, "Approximate Dynamic Programming Using Support Vector Regression," Conference on Decision and Control (to appear), Cancun, Mexico, 2008.