Optimal control of distributed Markov decision processes with network delays

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2007, Pages 3308-3314

  Adlakha, Sachin ^a   Madan, Ritesh ^a,b   Lall, Sanjay ^c   Goldsmith, Andrea ^a  

^a Stanford University

^b QUALCOMM INC   (United States)

^c 496 Lomita Mall   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONTROL EQUIPMENT; DECISION MAKING; DYNAMIC PROGRAMMING; FEEDBACK CONTROL;

DELAYED STATE MEASUREMENTS; SUBSYSTEMS; TRANSMITTED NOISE;

MARKOV PROCESSES;

EID: 62749192571     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2007.4434792     Document Type: Conference Paper

References (19)

1. E. Altman and P. Nain. Closed-loop control with delayed information. Performance Evaluation Review, 20:193-204, 1992.
2. K. J. Astrom. Optimal control of Markov processes with incomplete state estimation. Journal of Mathematical Analysis and Applications, 10:174-205, 1965.
3. T. Basar and N. Bansal. The theory of teams: a selective annotated bibliography. Lecture Notes in Contol and Information Sciences, 119:186-201, 1989.
4. R. E. Bellman. Dynamic Programming. Princeton University Press, 1957.
5. D. S. Bernstein, R. Givan, N. Immerman, and S. Zilberstein. The complexity of decentralized control of Markov decision processes. Mathematics of Operations Research, 27(4):819-840, 2002.
6. S. P. Boyd and C. H. Barratt. Linear controller design. Prentice Hall, 1991.
7. Y. C. Ho and K. C. Chu. Team decision theory and infromation structures in optimal control problems - Part I. IEEE Transactions on Automatic Control, 17:15-22, 1972.
8. K. Hsu and H. I. Marcus. Decentralized control of finite state Markov processes. IEEE Transactions on Automatic Control, 2:426-431, 1982.
9. P. R. Kumar and P. Varaiya. Stochastic Systems: Estimation, Identification and Adaptive Control. Prentice Hall, 1986.
10. B. Kurtaran and R. Sivan. Linear-Quadratic-Gaussian control with one-step-delay sharing pattern. IEEE Transactions on Automatic Control, 19(5):571-574, 1974.
11. M. L. Puterman. Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, 1994.
12. A. Rantzer. Linear quadratic team theory revisited. Proceedings of the American Control Conference, pages 1637-1641, 2006.
13. M. Rotkowitz. Information structures preserved under nonlinear time-varying feedback. Proceedings of the American Control Conference, pages 4207-4212, 2006.
14. M. Rotkowitz, R. Cogill, and S. Lall. A simple condition for the convexity of optimal control over networks with delays. Proceedings of the Joint IEEE Conference on Decision and Control and European Control Conference, pages 6686-6691, 2005.
15. M. Rotkowitz and S. Lall. A characterization of convex problems in decentralized control. IEEE Transactions on Automatic Control, 51(2):274-286, 2006.
16. N. R. Sandell and M. Athans. Solution of some nonclassical LQG stochastic decision problems. IEEE Transactions on Automatic Control, 19:108-116, 1974.
17. R. D. Smallwood and E. J. Sondik. The optimal control of partially observable Markov processes over a finite horizon. Operations Research, 21(5):1071-1088, 1973.
18. P. Varaiya and J. Walrand. On delayed sharing patterns. IEEE Transactions on Automatic Control, 23:443-445, 1978.
19. P. G. Voulgaris. Optimal control of systems with delayed observation sharing patterns via input-output methods. Proceedings of the IEEE Conference on Decision and Control, pages 2311-2316, 2000.