A dynamic programming algorithm for decentralized Markov decision processes with a broadcast structure

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2010, Pages 6143-6148

  Wu, Jeff ^a   Lall, Sanjay ^a,b  

^a Stanford University   (United States)

^b Department of Aeronautics and Astronautics Department of Mechanical Engineering and Industrial for Computational and Mathematical Engineering   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIORAL RESEARCH; MARKOV PROCESSES;

CENTRAL NODES; DECENTRALIZED MARKOV DECISION PROCESSES; DYNAMIC PROGRAMMING ALGORITHM; DYNAMIC PROGRAMS; FINITE HORIZONS; INFORMATION STRUCTURES; OPTIMAL DYNAMICS; PARTIALLY OBSERVED MARKOV DECISION PROCESS;

DYNAMIC PROGRAMMING;

EID: 79953138754     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2010.5718187     Document Type: Conference Paper

References (10)

1. R. Becker, S. Zilberstein, V. Lesser, and C. V. Goldman. Solving transition independent decentralized Markov decision processes. Journal of Artificial Intelligence Research, 22:423-455, 2004. (Pubitemid 41525892)
2. D. Bernstein, R. Givan, N. Immerman, and S. Zilberstein. The complexity of decentralized control of Markov decision processes. Mathematics of Operations Research, 27(4):819-840, 2002.
3. A. R. Cassandra, M. L. Littman, and N. L. Zhang. Incremental pruning: A simple, fast, exact method for partially observable Markov decision processes. Proceedings of the 13th Conference on Uncertainty in Artificial Intelligence, 2008.
4. K. Hsu and S. I. Marcus. Decentralized control of finite state Markov processes. IEEE Transactions on Automatic Control, 27(2):426-431, 1982.
5. A. Mahajan, A. Nayyar, and D. Tenenketzis. Identifying tractable decentralized control problems on the basis of information structure. Proceedings of the 46th Allerton Conference, pages 1440-1449, 2008.
6. C. H. Papadimitriou and J. N. Tsitsiklis. Intractable problems in control theory. SIAM Journal of Control and Optimization, 24(4):639-654, 1986.
7. C. H. Papadimitriou and J. N. Tsitsiklis. The complexity of Markov decision processes. Mathematics of Operations Research, 12(3):441-450, 1987.
8. R. D. Smallwood and E. J. Sondik. The optimal control of partially observable Markov processes over a finite horizon. Operations Research, 21(5):1071-1088, 1973.
9. J. Swigart and S. Lall. An explicit state-space solution for a decentralized two-player linear-quadratic regulator. 2010 American Control Conference, submitted.
10. H. S. Witsenhausen. A counterexample in stochastic optimal control. SIAM Journal of Control, 6(1):131-147, 1968.