Non-deterministic policies in markovian decision processes

Journal of Artificial Intelligence Research

Volumn 40, Issue , 2011, Pages 1-24

  Fard, Mahdi Milani ^a   Pineau, Joelle ^a  

^a MCGILL UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION SELECTION; CONVENTIONAL METHODS; DECISION MAKING PROCESS; DECISION-MAKING PROBLEM; DISCRETE DOMAINS; HUMAN SUBJECTS; MARKOVIAN DECISION PROCESS; MARKOVIAN ENVIRONMENT; MARKOVIAN PROCESS; MEDICAL DOMAINS; NEAR-OPTIMAL SOLUTIONS; REAL-WORLD PROBLEM; RUNNING TIME; STOCHASTIC ENVIRONMENT; WEB NAVIGATION;

ARTIFICIAL INTELLIGENCE; DECISION SUPPORT SYSTEMS; MEDICAL PROBLEMS; REINFORCEMENT LEARNING; STOCHASTIC MODELS; USER INTERFACES;

DECISION MAKING;

EID: 79956364385     PISSN: None     EISSN: 10769757     Source Type: Journal    
DOI: 10.1613/jair.3175     Document Type: Article

References (22)

1. Bellman, R. (1957). Dynamic Programming. Princeton University Press.
2. Bertsekas, D. (1995). Dynamic Programming and Optimal Control, Vol 2. Athena Scientific.
3. Ernst, D., Stan, G. B., Concalves, J., & Wehenkel, L. (2006). Clinical data based optimal STI strategies for HIV: A reinforcement learning approach. In Proceedings of the Fifteenth Machine Learning conference of Belgium and The Netherlands (Benelearn), pp. 65-72.
4. Fava, M., Rush, A., Trivedi, M., Nierenberg, A., Thase, M., Sackeim, H., Quitkin, F., Wis- niewski, S., Lavori, P., Rosenbaum, J., & Kupfer, D. (2003). Background and rationale for the sequenced treatment alternatives to relieve depression (STAR*D) study. Psy- chiatric Clinics of North America, 26 (2), 457-494. (Pubitemid 36583573)
5. Grffiths, T. L., & Steyvers, M. (2004). Finding scientific topics. Proceedings of the National Academy of Sciences, 101 (Suppl. 1), 5228-5235. (Pubitemid 38469131)
6. Hauskrecht, M., & Fraser, H. (2000). Planning treatment of ischemic heart disease with partially observable Markov decision processes. Artificial Intelligence in Medicine, 18 (3), 221-244. (Pubitemid 30089530)
7. Heger, M. (1994). Consideration of risk in reinforcement learning. In Proceedings of the Eleventh International Conference on Machine Learning (ICML), pp. 105-111.
8. Karmarkar, N. (1984). A new polynomial-time algorithm for linear programming. Combi- natorica, 4 (4), 373-395.
9. Kearns, M., & Singh, S. (2002). Near-optimal reinforcement learning in polynomial time. Machine Learning, 49.
10. Magni, P., Quaglini, S., Marchetti, M., & Barosi, G. (2000). Deciding when to intervene: A Markov decision process approach. International Journal of Medical Informatics, 60 (3), 237-253. (Pubitemid 32007952)
11. Mannor, S., Simester, D., Sun, P., & Tsitsiklis, J. N. (2004). Bias and variance in value function estimation. In Proceedings of the Twenty-First International Conference on Machine Learning (ICML), pp. 308-322.
12. Mannor, S., Simester, D., Sun, P., & Tsitsiklis, J. N. (2007). Bias and variance approxima- tion in value function estimates. Management Science, 53 (2), 308-322. (Pubitemid 46326182)
13. MTurk (2010). Amazon mechanical turk. In http://www.mturk.com/.
14. Murphy, S. A. (2005). An experimental design for the development of adaptive treatment strategies. Statistics in Medicine, 24 (10), 1455-1481. (Pubitemid 40716347)
15. Pineau, J., Bellemare, M. G., Rush, A. J., Ghizaru, A., & Murphy, S. A. (2007). Construct- ing evidence-based treatment strategies using methods from computer science. Drug and Alcohol Dependence, 88 (Supplement 2), S52 - S60. (Pubitemid 46546455)
16. Russell, S. J., & Norvig, P. (2003). Artificial Intelligence: A Modern Approach (Second Edition). Prentice Hall.
17. Sato, M., & Kobayashi, S. (2000). Variance-penalized reinforcement learning for risk-averse asset allocation. In Proceedings of the Second International Conference on Intelligent Data Engineering and Automated Learning, Data Mining, Financial Engineering, and Intelligent Agents, pp. 244-249. Springer-Verlag. (Pubitemid 33211324)
18. Schaefer, A., Bailey, M., Shechter, S., & Roberts, M. (2004). Handbook of Operations Research / Management Science Applications in Health Care, chap. Medical decisions using Markov decision processes. Kluwer Academic Publishers.
19. Schools-Wikipedia (2009). 2008/9 wikipedia selection for schools. In http://schools- wikipedia.org/.
20. Sutton, R. S., & Barto, A. G. (1998). Reinforcement Learning: An Introduction (Adaptive Computation and Machine Learning). The MIT Press.
21. Thapa, D., Jung, I., & Wang, G. (2005). Agent based decision support system using re- inforcement learning under emergency circumstances. Lecture Notes in Computer Science, 3610, 888.
22. West, R., Pineau, J., & Precup, D. (2009). Wikispeedia: An online game for inferring semantic distances between concepts. In Proceedings of the Twenty-First International Jont Conference on Artifical Intelligence (IJCAI), pp. 1598-1603, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.