Stochastic nestedness and the belief sharing information pattern

IEEE Transactions on Automatic Control

Volumn 54, Issue 12, 2009, Pages 2773-2786

  Yüksel, Serdar ^a  

^a QUEEN S UNIVERSITY   (Canada)

Author keywords

Communication complexity; Decentralized control; Information control structure (ICS); Stochastic control; Team decision theory

Indexed keywords

AMOUNT OF INFORMATION; CLASSICAL DYNAMICS; COMMUNICATION COMPLEXITY; CONTROL ACTIONS; CONTROL STRUCTURE; DECISION MAKERS; DELAYED INFORMATION; EQUIVALENT MODEL; INFORMATION CHANNELS; INFORMATION EXCHANGES; INFORMATION STRUCTURES; JOINT INFORMATION; MARKOV CHAIN; NESTEDNESS; OPTIMAL SOLUTIONS; OPTIMIZATION PROBLEMS; RECURSIONS; SHARING INFORMATION; SINGLE DECISION; STATE SPACE; STOCHASTIC CONTROL; STOCHASTIC OPTIMIZATION PROBLEMS; TEAM DECISION; TIME HORIZONS; VERY LARGE DATUM;

DECENTRALIZED CONTROL; DECISION THEORY; DYNAMIC PROGRAMMING; GAME THEORY; INTELLIGENT CONTROL; MARKOV PROCESSES; OPTIMIZATION; STOCHASTIC CONTROL SYSTEMS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS; SYSTEMS ENGINEERING;

INFORMATION DISSEMINATION;

EID: 72349084492     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2009.2031723     Document Type: Article

References (44)

1. M. Aicardi, F. Davoli, and R. Minciardi, "Decentralized optimal control of Markov chains with a common past information set" IEEE Trans. Autom. Control, vol. AC-32, no. 11, pp. 1028-1031, Nov. 1987.
2. M. Aoki, "On decentralized linear stochastic control problems with quadratic cost" IEEE Trans. Autom. Control, vol. AC-18, no. 3, pp. 243-250, Jun. 1973.
3. A. Arapostathis, V. S. Borkar, E. Fernandez-Gaucherand, M. K. Ghosh, and S. I. Marcus, "Discrete-time controlled Markov processes with average cost criterion: A survey" SIAM J. Control Optim., vol. 31, pp. 282-344, 1993.
4. Y. Azrieli and E. Lehrer, "The value of a stochastic information structure" Game Econ. Behav., pp. 679-693, 2006.
5. B. Bamieh and P. Voulgaris, "A convex characterization of distributed control problems in spatially invariant systems with communication constraints" Syst. Control Lett., vol. 54, pp. 575-583, 2005.
6. T. Başar, "Decentralized multicriteria optimization of linear stochastic systems" IEEE Trans. Autom. Control, vol. AC-23, no. 2, pp. 233-243, Apr. 1978.
7. T. Başar and J. Cruz, "Concepts and methods in multiperson coordination and control" in Optimization and Control of Dynamic Operational Research Models (Editor: S. G. Tzafestas). Amsterdam, The Netherlands: North Holland, 1982, ch. 11, pp. 351-387.
8. J. M. Bismut, "An example of interaction between information and control: The transparency of a game" presented at the Joint Harvard University-Imperial College Conf. Information Structures and Extensive Games, Jun. 1972.
9. D. Blackwell, "Equivalent comparison of experiments" Annals Math. Stat., vol. 24, pp. 265-272, 1953.
10. V. Borkar and P. Varaiya, "Asymptotic agreement in distributed estimation" IEEE Trans. Autom. Control, vol. AC-27, no. 3, pp. 650-655, Jun. 1982.
11. G. Casalino, F. Davoli, R. Minciardi, P. P. Puliafito, and R. Zoppoli, "Partially nested information structures with a common past" IEEE Trans. Autom. Control, vol. AC-29, pp. 846-850, Sep. 1984.
12. I. Csiszar and J. Korner, Information Theory: Coding Theorems for Discrete Memoryless Channels. Budapest, Hungary: Akademiai Kiado, 1981.
13. T. M. Cover and J. A. Thomas, Elements of Information Theory.New York: Wiley, 1991.
14. B. J. Frey, Graphical Models for Machine Learning and Digital Communication. Cambridge, MA: MIT Press, 1998.
15. O. Hernandez-Lerma, J. Gonzales-Hernandez, and R. R. Lopez-Martinez, "Constrained average cost Markov control processes in Borel spaces" SIAM J. Control Optim., vol. 42, pp. 442-468, 2003.
16. Y. C. Ho, "Team decision theory and information structures" Proc. IEEE, vol. 68, no. 6, pp. 644-654, 1980.
17. Y. C. Ho and K. C. Chu, "Team decision theory and information structures in optimal control problems-Part I" IEEE Trans. Autom. Control, vol. AC-17, no. 1, pp. 15-22, Feb. 1972.
18. B. Kurtaran, "Corrections and extensions to decentralized control with delayed sharing information pattern" IEEE Trans. Autom. Control, vol. AC-24, no. 4, pp. 656-657, Aug. 1979.
19. A. Mahajan, A. Nayyar, and D. Teneketzis, "Identifying tractable decentralized control problems on the basis of information structure" in Proc. Annual Allerton Conf. Commun., Control Comp., Allerton, IL, Sep. 2008, pp. 1440-1449.
20. M. Mooij and H. J. Kappen, "Sufficient conditions for convergence of the sum-product algorithm" IEEE Trans. Inform. Theory, vol. 53, no. 12, pp. 4422-4437, Dec. 2007.
21. J. Ooi, S. Verbout, J. Ludwig, and G. Wornell, "A separation theorem for periodic sharing information patterns in decentralized control" IEEE Trans. Autom. Control, vol. 42, no. 11, pp. 1546-1550, Nov. 1997.
22. A. Orlitsky and J. R. Roche, "Coding for computing" IEEE Trans. Inform. Theory, vol. 47, no. 3, pp. 903-917, Mar. 2001.
23. C. H. Papadimitriou and J. Tsitsiklis, "On the complexity of designing distributed protocols" Inform. Control, vol. 53, pp. 211-218, 1982.
24. S. S. Pradhan and K. Ramchandran, "Distributed source coding using syndromes (DISCUS): Design and construction" IEEE Trans. Inform. Theory, vol. 49, no. 3, pp. 626-643, Mar. 2003.
25. R. Radner, "Team decision problems" Annals Math. Stat., vol. 33, pp. 857-881, 1962.
26. A. Rantzer, "Linear quadratic team theory revisited" in Proc. IEEE Amer. Control Conf., Minneapolis, MN, Jun. 2006, pp. 1637-1641.
27. M. Rotkowitz and S. Lall, "A characterization of convex problems in decentralized Control" IEEE Trans. Autom. Control, vol. 51, no. 2, pp. 274-286, Feb. 2006.
28. A. Sahai and S. Mitter, "The necessity and sufficiency of anytime capacity for stabilization of a linear system over a noisy communication link part I: Scalar systems" IEEE Trans. Inform. Theory, vol. 52, no. 8, pp. 3369-3395, Aug. 2006.
29. N. Sandell, P. Varaiya, M. Athans, and M. Safonov, "Survey of decentralized control methods for large scale systems" IEEE Trans. Autom. Control, vol. AC-23, no. 2, pp. 108-128, Apr. 1978.
30. N. Sandell and M. Athans, "Solution of some nonclassical LQG stochastic decision problems" IEEE Trans. Autom. Control, vol. AC-19, no. 1, pp. 108-116, Feb. 1974.
31. A. N. Shiryaev, "On Markov sufficient statistics in nonadditive Bayes problems of sequential analysis" Theory Probab. Appl., vol. 9, pp. 604-618, 1964.
32. J. D. Slepian and J. K. Wolf, "Noiseless coding of correlated information sources" IEEE Trans. Inform. Theory, vol. IT-19, no. 4, pp. 471-480, Jul. 1973.
33. S. Tatikonda and M. I. Jordan, "Loopy belief propagation and Gibbs measures" in Proc. Uncertainty Artif. Intell., Aug. 2002, vol. 18, pp. 493-500.
34. D. Teneketzis, "On information structures and nonsequential stochastic control" CWI Quarterly, vol. 9, pp. 241-260, 1996.
35. J. N. Tsitsiklis and M. Athans, "Convergence and asymptotic agreement in distributed decision problems" IEEE Trans Autom. Control, vol. AC-29, no. 1, pp. 42-50, Jan. 1984.
36. P. Varaiya and J. Walrand, "On delayed-sharing patterns" IEEE Trans Autom. Control, vol. AC-23, no. 3, pp. 443-445, Jun. 1978.
37. P. G. Voulgaris, "A convex characterization of classes of problems in control with specific interaction and communication structures" in Proc. IEEE Amer. Control Conf., Arlington, VA, Jun. 2001, pp. 3128-3133.
38. J. C. Walrand and P. Varaiya, "Optimal causal coding-decoding problems" IEEE Trans. Inform. Theory, vol. IT-19, no. 6, pp. 814-820, Nov. 1983.
39. H. S. Witsenhausen, "Equivalent stochastic control problems" Math. Control, Signals, Syst., vol. 1, pp. 3-11, 1988.
40. H. S. Witsenhausen, "A counterexample in stochastic optimum control" SIAM J. Control Optim., vol. 6, pp. 131-147, 1968.
41. T. Yoshikawa, "Decomposition of dynamic team decision problems" IEEE Trans. Autom. Control, vol. AC-23, no. 4, pp. 627-632, Aug. 1978.
42. S. Yüksel, H. Hindi, and L. S. Crawford, "Optimal tracking with a feed-back-feedforward control separation over a network" in Proc. IEEE
43. S. Yüksel and T. Bassar, "Optimal signaling policies for decentralized multi-controller stabilizability over communication channels" IEEE Trans. Autom. Control, vol. 52, no. 10, pp. 1969-1974, Oct. 2007. (Pubitemid 350138936)
44. S. Yüksel and T. Başar, "Communication constraints for decentralized stabilizability with time-invariant policies" IEEE Trans. Autom. Control, vol. 52, no. 6, pp. 1060-1066, Jun. 2007. (Pubitemid 47034033)