Coordination capacity

IEEE Transactions on Information Theory

Volumn 56, Issue 9, 2010, Pages 4181-4206

  Cuff, Paul Warner ^a   Permuter, Haim H ^b   Cover, Thomas M ^c  

^a Princeton University   (United States)

^b BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

^c Stanford University   (United States)

Author keywords

Common randomness; cooperation capacity; coordination capacity; network dependence; rate distortion; source coding; strong Markov lemma; task assignment; Wyner common information

Indexed keywords

COMMON INFORMATION; COMMON RANDOMNESS; COOPERATION CAPACITY; COORDINATION CAPACITY; NETWORK DEPENDENCE; RATE DISTORTIONS; SOURCE-CODING; STRONG MARKOV LEMMA; TASK ASSIGNMENT;

DISTRIBUTED PARAMETER CONTROL SYSTEMS; ELECTRIC DISTORTION; INTERFERENCE SUPPRESSION; SIGNAL DISTORTION;

RANDOM PROCESSES;

EID: 77955754773     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2010.2054651     Document Type: Article

References (35)

1. R. Ahlswede, N. Cai, S.-Y. Li, and R. Yeung, "Network information flow," IEEE Trans. Inf. Theory, vol.46, no.4, pp. 1204-1216, Jul. 2000.
2. J. Tsitsiklis, D. Bertsekas, and M. Athans, "Distributed asynchronous deterministic and stochastic gradient optimization algorithms," IEEE Trans. Autom. Control, vol.31, no.9, pp. 803-812, Sep. 1986.
3. L. Xiao, S. Boyd, and S.-J. Kim, "Distributed average consensus with least-mean-square deviation," J. Parallel Distrib. Comput., vol.67, no.1, pp. 33-46, Jan. 2007.
4. B. Bollobas, The Art of Mathematics: Coffee Time in Memphis. Cambridge, U.K.: Cambridge Univ. Press, 2006.
5. A. Yao, "Some complexity questions related to distributive computing( preliminary report)," in Proc. ACM Symp. Theory of Computing, 1979, pp. 209-213.
6. A. Orlitsky and A. El Gamal, "Average and randomized communication complexity," IEEE Trans. Inf. Theory, vol.36, no.1, pp. 3-16, Jan. 1990.
7. O. Ayaso, D. Shah, and M. Dahleh, "Distributed computation under bit constraints," in Proc. IEEE Conf. Decision and Control, Dec. 2008, pp. 4837-4842.
8. T. Cover and H. Permuter, "Capacity of coordinated actions," presented at the IEEE Int. Symp. Information Theory, Nice, France, 2007.
9. A. Wyner, "The common information of two dependent random variables," IEEE Trans. Inf. Theory, vol.IT-21, no.2, pp. 163-179, Mar. 1975.
10. V. Anantharam and V. Borkar, "Common randomness and distributed control; A counterexample," Syst. Control Lett., vol.56, pp. 568-572, 2007.
11. H. Barnum, C. Caves, C. Fuchs, R. Jozsa, and B. Schumacher, "On quantum coding for ensembles of mixed states," J. Phys. A: Math. Gen., vol.34, pp. 6767-6785, 2001. (Pubitemid 33577103)
12. G. Kramer and S. Savari, "Communicating probability distributions," IEEE Trans. Inf. Theory, vol.53, no.2, pp. 518-525, Feb. 2007.
13. T. Weissman and E. Ordentlich, "The empirical distribution of rateconstrained source codes," IEEE Trans. Inf. Theory, vol.51, no.11, pp. 3718-3733, Nov. 2005.
14. T. Han and S. Verdú, "Approximation theory of output statistics," IEEE Trans. Inf. Theory, vol.39, no.3, pp. 752-772, May 1993.
15. C. Bennett, P. Shor, J. Smolin, and A. Thapliyal, "Entanglement- assisted capacity of a quantum channel and the reverse Shannon theorem," IEEE Trans. Inf. Theory, vol.48, no.10, pp. 2637-2655, Oct. 2002.
16. C. Shannon, "Coding theorems for a discrete source with fidelity criterion," in Information and Decision Processes, R. E. Machol, Ed. New York: McGraw-Hill, 1960, pp. 93-126.
17. H. Yamamoto, "Source coding theory for cascade and branching communication systems," IEEE Trans. Inf. Theory, vol.IT-27, no.3, pp. 299-308, May 1981.
18. A. Kaspi and T. Berger, "Rate-distortion for correlated sources with partially separated encoders," IEEE Trans. Inf. Theory, vol.IT-28, pp. 828-840, Nov. 1982.
19. J. Barros and S. Servetto, "A note on cooperative multiterminal source coding," presented at the Conf. Information Sciences and Systems, Mar. 2004.
20. H. Yamamoto, "Source coding theory for a triangular communication system,"IEEETrans. Inf. Theory, vol.42, no.3, pp. 848-853,May1996.
21. J. Wolf, A. Wyner, and J. Ziv, "Source coding for multiple descriptions," Bell Syst. Tech. J., vol.59, pp. 1417-1426, Oct. 1980.
22. Z. Zhang and T. Berger, "New results in binary multiple descriptions," IEEE Trans. Inf. Theory, vol.IT-33, pp. 502-521, Jul. 1987.
23. T. Berger, "Multiterminal source coding," in Information Theory Approach to Communications, G. Longo, Ed. New York: Springer-Verlag, 1978, CISM Course and Lecture, pp. 171-231.
24. D. Vasudevan, C. Tian, and S. Diggavi, "Lossy source coding for a cascade communication system with side-informations," presented at the Allerton Conf. Communication, Control, and Computing, Sep. 2006.
25. W. Gu and M. Effros, "On multi-resolution coding and a two-hop network," presented at the Data Compression Conf., 2006.
26. M. Bakshi, M. Effros, W. Gu, and R. Koetter, "On network coding of independent and dependent sources in line networks," presented at the IEEE Int. Symp. Information Theory, Nice, France, 2007.
27. A. Wyner and J. Ziv, "The rate-distortion function for source coding with side information at the decoder," IEEE Trans. Inf. Theory, vol.22, no.1, pp. 1-10, Jan. 1976.
28. P. Cuff, H. Su, and A. El Gamal, "Cascade multiterminal source coding," presented at the IEEE Int. Symp. Information Theory, Seoul, Korea, 2009.
29. A. Orlitsky and J. Roche, "Coding for computing," IEEE Trans. Inf. Theory, vol.47, no.3, pp. 903-917, Mar. 2001.
30. P. Cuff, "Communication requirements for generating correlated random variables," in Proc. IEEE Int. Symp. Information Theory, Toronto, ON, Canada, 2008, pp. 1393-1397.
31. Y. Steinberg and S. Verdú, "Simulation of random processes and ratedistortion theory," IEEE Trans. Inf. Theory, vol.42, no.1, pp. 63-86, Jan. 1996.
32. I. Devetak, A. Harrow, P. Shor, A. Winter, and C. Bennett, Quantum Reverse Shannon Theorem 2007 [Online]. Available: http://www.research. ibm.com/people/b/bennetc/QRSTonlineVersion.pdf
33. T. Cover and J. Thomas, Elements of Information Theory, 2nd ed. Hoboken, NJ: Wiley, 2006.
34. A. Wyner, "On source coding with side-information at the decoder," IEEE Trans. Inf. Theory, vol.21, no.3, pp. 294-300, May 1975.
35. I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic, 1981.