Optimal resource allocation and policy formulation in loosely-coupled Markov decision processes

Proceedings of the 14th International Conference on Automated Planning and Scheduling, ICAPS 2004

Volumn , Issue , 2004, Pages 315-324

  Dolgov, Dmitri A ^a   Durfee, Edmund H ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

GRIDS; MARKOV DECISION PROCESSES (MDP); STOCHASTIC POLICY OPTIMIZATION PROBLEM;

CONSTRAINT THEORY; DECISION THEORY; LINEAR PROGRAMMING; MARKOV PROCESSES; MULTI AGENT SYSTEMS; OPTIMIZATION; RESOURCE ALLOCATION;

AUTONOMOUS AGENTS;

EID: 13444251629     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Altman, E. 1999. Constrained Markov Decision Processes. Chapman and HALL/CRC.
2. Bellman, R. 1957. Dynamic Programming. Princeton University Press.
3. Boutilier, C.; Brafman, R.; and Geib, C. 1997. Prioritized goal decomposition of Markov decision processes: Towards a synthesis of classical and decision theoretic planning. In Pollack, M., ed., Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence, 1156-1163. San Francisco: Morgan Kaufmann.
4. Boutilier, C.; Dean, T.; and Hanks, S. 1999. Decision-theoretic planning: Structural assumptions and computational leverage. Journal of Artificial Intelligence Research 11:1-94.
5. Boutilier, C.; Dearden, R.; and Goldszmidt, M. 1995. Exploiting structure in policy construction. In Mellish, C., ed., Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, 1104-1111. San Francisco: Morgan Kaufmann.
6. Boutilier, C. 1999. Sequential optimality and coordination in multiagent systems. In Proceedings of the 1999 International Joint Conference on Artificial Intelligence, 478-485.
7. Bresina, J.; Dearden, R.; Meuleau, N.; Ramkrishnan, S.; Smith, D.; and Washington, R. 2002. Planning under continuous time and resource uncertainty: A challenge for ai. In Uncertainty in Artificial Intelligence: Proceedings of the Eighteenth Conference (UAI-2002), 77-84. San Francisco, CA: Morgan Kaufmann Publishers.
8. Dean, T., and Lin, S.-H. 1995. Decomposition techniques for planning in stochastic domains. In Proceedings of the 1995 International Joint Conference on Artificial Intelligence.
9. Dearden, R., and Boutilier, C. 1997. Abstraction and approximate decision-theoretic planning. Artificial Intelligence 89(1-2):219-283.
10. D'Epenoux. 1963. A probabilistic production and inventory problem. Management Science 10:98-108.
11. Dolgov, D. A., and Durfee, E. H. 2003. Approximating optimal policies for agents with limited execution resources. In Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence, 1107-1112.
12. Dolgov, D. A., and Durfee, E. H. 2004. Approximate probabilistic constraints and risk-sensitive optimization criteria in Markov decision processes. In Proceedings of the Eighth International Symposiums on Artificial Intelligence and Mathematics (AI&M 7-2004).
13. Garey, M. R., and Johnson, D. S. 1979. Computers and Intractability: A Guide to the Theory of NP-Completeness. W. H. Freeman & Co.
14. Kallenberg, L. 1983. Linear Programming and Finite Markovian Control Problems. Math. Centrum, Amsterdam.
15. Meuleau, N.; Hauskrecht, M.; Kim, K.-E.; Peshkin, L.; Kaelbling, L.; Dean, T.; and Boutilier, C. 1998. Solving very large weakly coupled Markov decision processes. In AAAI/IAAI, 165-172.
16. Puterman, M. L. 1994. Markov Decision Processes. New York: John Wiley & Sons.
17. Ross, K., and Chen, B. 1988. Optimal scheduling of interactive and non-interactive traffic in telecommunication systems. IEEE Transactions on Auto Control 33:261-267.
18. Singh, S., and Cohn, D. 1998. How to dynamically merge Markov decision processes. In Jordan, M. I.; Kearns, M. J.; and Solla, S. A., eds., Advances in Neural Information Processing Systems, volume 10. The MIT Press.
19. Sobel, M. 1985. Maximal mean/standard deviation ratio in undiscounted mdp. OR Letters 4:157-188.
20. Wolsey, L. 1998. Integer Programming. John Wiley & Sons.