An extremal inequality motivated by multiterminal information-theoretic problems

IEEE Transactions on Information Theory

Volumn 53, Issue 5, 2007, Pages 1839-1851

  Liu, Tie ^a   Viswanath, Pramod ^b  

^a Texas AandM University   (United States)

^b University of Illinois at Urbana Champaign   (United States)

Author keywords

Differential entropy; Distributed source coding; Entropy power inequality (EPI); Fisher information; Vector Gaussian broadcast channel

Indexed keywords

ENCODING (SYMBOLS); FISHER INFORMATION MATRIX; RANDOM VARIABLES; SIGNAL DISTORTION; VECTORS;

DIFFERENTIAL ENTROPY; DISTRIBUTED SOURCE CODING; ENTROPY-POWER INEQUALITY; EXTREMAL INEQUALITY; VECTOR GAUSSIAN BROADCAST CHANNEL;

INFORMATION THEORY;

EID: 34248373869     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2007.894680     Document Type: Article

References (20)

1. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, pp. 623-656, Oct. 1948.
2. A. J. Stam, "Some inequalities satisfied by the quantities of information of Fisher and Shannon," Inf. Contr.., vol. 2, no. 2, pp. 101-112, June 1959.
3. N. M. Blachman, "The convolution inequality for entropy powers," IEEE Trans. Inf. Theory, vol. IT-11, no. 2, pp. 267-271, Apr. 1965.
4. P. P. Bergman, "Asimple converse for broadcast channels with additive white Gaussian noise," IEEE Trans. Inf. Theory, vol. IT-20, no. 2, pp. 279-280, Mar. 1974.
5. Y. Oohama, "The rate-distortion function for the quadratic Gaussian CEO problem," IEEE Trans. Inf. Theory, vol. 44, no. 3, pp. 1057-1070, May 1998.
6. L. Ozarow, "On a source coding problem with two channels and three receivers," Bell Syst. Tech. J., vol. 59, no. 10, pp. 1909-1921, Dec. 1980.
7. H. Weingarten, Y. Steinberg, and S. Shamai (Shitz), "The capacity region of the Gaussian MIMO broadcast channel," IEEE Trans. Inf. Theory, vol. 52, no. 9, pp. 3936-3964, Sep. 2006.
8. S. Ihara, "On the capacity of channels with additive non-Gaussian noise," Inf. Contr., vol. 37, no. 1, pp. 34-39, Apr. 1978.
9. S. N. Diggavi and T. M. Cover, "The worst additive noise under a covariance constraint," IEEE Trans. Inf. Theory, vol. 47, no. 7, pp. 3072-3081, Nov. 2001.
10. A. Dembo, T. M. Cover, and J. A. Thomas, "Information theoretic inequalities," IEEE Trans. Inf. Theory, vol. 37, no. 6, pp. 1501-1518, Nov. 1991.
11. R. Zamir, "A proof of the Fisher information inequality via a data processing argument," IEEE Trans. Inf. Theory, vol. 44, no. 3, pp. 1246-1250, May 1998.
12. D. Guo, S. Shamai (Shitz), and S. Verdú, "Additive non-Gaussian noise channels: Mutual information and conditional mean estimation," in Proc. IEEE Int. Symp. Information Theory, Adelaide, Australia, Sep. 2005, pp. 719-723.
13. T. M. Cover and Z. Zhang, "On the maximum entropy of the sum of two dependent random variables," IEEE Trans. Inf. Theory, vol. 40, no. 4, pp. 1244-1246, Jul. 1994.
14. K. Marton, "A coding theorem for the discrete memoryless broadcast channel," IEEE Trans. Inf. Theory, vol. IT-25, no. 3, pp. 306-311, May 1979.
15. O. Johnson, Information Theory and The Central Limit Theorem. London, U.K.: Imperial College Press, 2004.
16. G. Caire and S. Shamai (Shitz), "On the achievable throughput of a multiple-antenna Gaussian broadcast channel," IEEE Trans. Inf. Theory, vol. 49, no. 7, pp. 1691-1706, Jul. 2003.
17. W. Yu, A. Sutivong, D. Juian, T. M. Cover, and M. Chiang, "Writing on colored paper," in Proc. IEEE. Int. Symp. Information Theory, Washington, DC, Jun. 2001, p. 302.
18. D. Slepian and J. K. Wolf, "Noiseless coding of correlated information sources," IEEE Trans. Inf. Theory, vol. IT-19, no. 4, pp. 471-480, Jul. 1973.
19. R. Gallager, "Capacity and coding for degraded broadcast channels," Probl. Pered. Inform., vol. 10, no. 3, pp. 3-14, Jul.-Sep. 1974.
20. H. Weingarten, T. Liu, S. Shamai (Shitz), Y. Steinberg, and P. Viswanath, "The capacity region of the degraded multiple input multiple output broadcast channel," IEEE Trans. Inf. Theory, submitted for publication.