Decentralized stochastic control with partial history sharing: A common information approach

IEEE Transactions on Automatic Control

Volumn 58, Issue 7, 2013, Pages 1644-1658

  Nayyar, Ashutosh ^a   Mahajan, Aditya ^b   Teneketzis, Demosthenis ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b MCGILL UNIVERSITY   (Canada)

^c UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Decentralized control; information structures; Markov decision theory; stochastic control; team theory

Indexed keywords

INFORMATION SHARING; INFORMATION STRUCTURES; MARKOV DECISION THEORY; OPTIMAL CONTROL PROBLEM; OPTIMAL CONTROL STRATEGY; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; STOCHASTIC CONTROL; TEAM THEORY;

CONTROLLERS; DECENTRALIZED CONTROL; DECISION THEORY; OPTIMAL CONTROL SYSTEMS;

STOCHASTIC CONTROL SYSTEMS;

EID: 84879911824     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2013.2239000     Document Type: Article

References (44)

1. A. Mahajan, A. Nayyar, and D. Teneketzis, "Identifying tractable decentralized control problems on the basis of information structures," in Proc. 46th Allerton Conf. Commun., Control, Comput., Sep. 2008, pp. 1440-1449.
2. Y.-C. Ho, "Team decision theory and information structures," Proc. IEEE, vol. 68, no. 6, pp. 644-654, Jun. 1980.
3. H. S.Witsenhausen, "On the structure of real-time source coders," Bell Syst. Tech. J., vol. 58, no. 6, pp. 1437-1451, Jul.-Aug. 1979.
4. J. C. Walrand and P. Varaiya, "Optimal causal coding-decoding problems," IEEE Trans. Inf. Theory, vol. IT-29, no. 6, pp. 814-820, Nov. 1983.
5. D. Teneketzis, "On the structure of optimal real-time encoders and decoders in noisy communication," IEEE Trans. Inf. Theory, vol. 52, no. 9, pp. 4017-4035, Sep. 2006. (Pubitemid 44363831)
6. A. Nayyar and D. Teneketzis, "On the structure of real-time encoders and decoders in a multi-terminal communication system," IEEE Trans. Inf. Theory, vol. 57, no. 9, pp. 6196-6214, Sep. 2011.
7. Y. Kaspi and N.Merhav, "Structure theorem for real-time variable-rate lossy source encoders andmemory-limited decoderswith side information," in Proc. Int. Symp. Inf. Theory, 2010.
8. R. R. Tenney and N. R. Sandell, Jr., "Detection with distributed sensors," IEEE Trans. Aerosp. Electron. Syst., vol. AES-17, no. 4, pp. 501-510, Jul. 1981.
9. J. N. Tsitsiklis, "Decentralized detection," in Advances in Statistical Signal Processing. Greenwich, CT, USA: JAI, 1993, pp. 297-344.
10. D. Teneketzis and Y. C. Ho, "The Decentralized Wald problem," Inf. Comput., vol. 73, pp. 23-44, 1987.
11. V. V. Veeravalli, T. Basar, and H. Poor, "Decentralized sequential detection with a fusion center performing the sequential test," IEEE Trans. Inf. Theory, vol. 39, no. 2, pp. 433-442, Mar. 1993.
12. V. V. Veeravalli, T. Basar, and H. Poor, "Decentralized sequential detection with sensors performing sequential tests," Math. Control, Signals, Syst., vol. 7, no. 4, pp. 292-305, 1994.
13. A. Nayyar and D. Teneketzis, "Sequential problems in decentralized detection with communication," IEEE Trans. Inf. Theory, vol. 57, no. 8, pp. 5410-5435, Aug. 2011.
14. A. Nayyar and D. Teneketzis, "Decentralized detectionwith signaling," in Proc. Workshop Math. Theory of Netw. Syst.(MTNS), 2010.
15. D. Teneketzis and P. Varaiya, "The decentralized quickest detection problem," IEEE Trans. Autom. Control, vol. AC-29, no. 7, pp. 641-644, Jul. 1984.
16. V. V. Veeravalli, "Decentralized quickest change detection," IEEE Trans. Inf. Theory, vol. 47, no. 4, pp. 1657-1665, May 2001. (Pubitemid 32508512)
17. J. C. Walrand and P. Varaiya, "Causal coding and control of Markov chains," Syst. Control Lett., vol. 3, pp. 189-192, 1983.
18. A. Mahajan and D. Teneketzis, "Optimal performance of networked control systems with non-classical infromation structures," SIAM J. Control Optimiz., vol. 48, no. 3, pp. 1377-1404, May 2009.
19. J. Wu and S. Lall, "A dynamic programming algorithm for decentralized markov decision processes with a broadcast structure," in Proc. 49th IEEE Conf. Decision Control, 2010, pp. 6143-6148.
20. R. Radner, "Team decision problems," Ann. Math. Statist., vol. 33, pp. 857-881, 1962.
21. J. Krainak, J. Speyer, and S. Marcus, "Static team problems-Part I: Sufficient conditions and the exponential cost criterion," IEEE Trans. Autom. Control, vol. AC-27, no. 4, pp. 839-848, Aug. 1982. (Pubitemid 12549381)
22. H. S. Witsenhausen, "A standard form for sequential stochastic control," Math. Syst. Theory, vol. 7, no. 1, pp. 5-11, 1973.
23. A. Mahajan, "Sequential decomposition of sequential dynamic teams: Applications to real-time communication and networked control systems," Ph.D. dissertation, Univ. of Michigan, Ann Arbor, MI, USA, 2008.
24. A.Mahajan and D. Teneketzis, "On the design of globally optimal communication strategies for real-time communcation systems with noisy feedback," IEEE J. Sel. Areas Commun., 26, no. 4, pp. 580-595, May 2008. (Pubitemid 351658775)
25. A. Mahajan and D. Teneketzis, "Optimal design of sequential real-time communication systems," IEEE Trans. Inf. Theory, vol. 55, no. 11, pp. 5317-5337, Nov. 2009.
26. Y.-C. Ho and K.-C. Chu, "Team decision theory and information structures in optimal control problems-Part I," IEEE Trans. Autom. Control, vol. AC-17, no. 1, pp. 15-22, Feb. 1972.
27. J. Kim and S. Lall, "A unifying condition for separable two player optimal control problems," in Proc. 50th IEEE Conf. Decision Control, Dec. 2011, pp. 3818-3823.
28. L. Lessard and S. Lall, "A state-space solution to the two-player decentralized optimal control problem," in Proc. 49th Annu. Allerton Conf. Commun., Control, Comput., 2011.
29. A. Rantzer, "Linear quadratic team theory revisited," in Proc. Amer. Control-Conf., 2006.
30. A. Gattami, "Control and estimation problems under partially nested information pattern," in Proc. 48th IEEE Conf. Decision Control, Dec. 2009, pp. 5415-5419.
31. S. Yuksel, "Stochastic nestedness and the belief sharing information pattern," IEEE Trans. Autom. Control, vol. 54, no. 12, pp. 2773-2786, Dec. 2009.
32. B. Bamieh and P. G. Voulgaris, "A convex characterization of distributed control problems in spatially invariant systems with communication constraints," Syst. Control Lett., pp. 575-583, 2005. (Pubitemid 40584040)
33. M. Rotkowitz and S. Lall, "A characterization of convex problems in decentralized control," IEEE Trans. Autom. Control, vol. 51, no. 2, pp. 274-286, Feb. 2006.
34. P. Varaiya and J.Walrand, "On delayed sharing patterns," IEEE Trans. Autom. Control, vol. AC-23, no. 3, pp. 443-445, Jun. 1978.
35. M. Aicardi, F. Davoli, and R. Minciardi, "Decentralized optimal control of Markov chains with a common past information set," IEEE Trans. Autom. Control, vol. AC-32, no. 11, pp. 1028-1031, Nov. 1987. (Pubitemid 18521638)
36. A. Nayyar, A.Mahajan, and D. Teneketzis, "Optimal control strategies in delayed sharing information structures," IEEE Trans. Autom. Control, vol. 57, no. 7, pp. 1606-1620, Jul. 2011.
37. J. M. Ooi, S. M. Verbout, J. T. Ludwig, and G. W.Wornell, "A separation theorem for periodic sharing information patterns in decentralized control," IEEE Trans. Autom. Control, vol. 42, no. 11, pp. 1546-1550, Nov. 1997. (Pubitemid 127760299)
38. J.-M. Bismut, "An example of interaction between information and control: The transparency of a game," IEEE Trans. Autom. Control, vol. AC-18, no. 5, pp. 518-522, Oct. 1972.
39. A. Mahajan, "Optimal decentralized control of coupled subsystems with control sharing," in Proc. 50th IEEE Conf. Decision Control, Dec. 2011, pp. 5726-5731.
40. A. Nayyar, "Sequential decision-making in decentralized systems," Ph.D. dissertation, Univ. of Michigan, Ann Arbor, MI, USA, 2011.
41. H. S. Witsenhausen, "Separation of estimation and control for discrete time systems," Proc. IEEE, vol. 59, no. 11, pp. 1557-1566, Nov. 1971.
42. N. R. Sandell, Jr., "Control of finite-state, finite-memory stochastic systems," Ph.D. dissertation, Mass. Inst. of Technol., Cambridge, MA, USA, 1974.
43. P. Whittle, Optimization Over Time, ser. Wiley Series in Probability and Mathematical Statistics. New York, NY, USA:Wiley, 1983, vol. 2.
44. H. Zhang, "Partially observable Markov decision processes: A geometric technique and analysis," Operat. Res., 2009.