A vector generalization of costa's entropy-power inequality with applications

IEEE Transactions on Information Theory

Volumn 56, Issue 4, 2010, Pages 1865-1879

  Liu, Ruoheng ^a   Liu, Tie ^b   Poor, H Vincent ^a   Shamai, Shlomo ^c  

^a Princeton University   (United States)

^b Texas AandM University   (United States)

^c TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Entropy power inequality (EPI); Extremal entropy inequality; Information theoretic security; Mutual information and minimum mean square error (MMSE) estimate; Vector Gaussian broadcast channel

Indexed keywords

ENTROPY INEQUALITY; EXTREMAL; GAUSSIAN BROADCAST CHANNEL; INFORMATION-THEORETIC SECURITY; MINIMUM MEAN-SQUARE ERROR; MUTUAL INFORMATIONS;

BROADCASTING; COMMUNICATION CHANNELS (INFORMATION THEORY); VECTORS;

ENTROPY;

EID: 77950269477     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2010.2040879     Document Type: Article

References (30)

1. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol.27, pp. 623-656, Jul./Oct. 1948.
2. A. J. Stam, "Some inequalities satisfied by the quantities of information of Fisher and Shannon," Inf. Control, vol.2, pp. 101-112, Jun. 1959.
3. P. P. Bergmans, "Random coding theorem for broadcast channels with degraded components," IEEE Trans. Inf. Theory, vol.IT-19, pp. 197-207, Mar. 1973.
4. S. K. Leung-Yan-Cheong and M. E. Hellman, "The Gaussian wire-tap channel," IEEE Trans. Inf. Theory, vol.IT-24, pp. 51-456, Jul. 1978.
5. L. Ozarow, "On a source coding problem with two channels and three receivers," Bell Syst. Tech. J., vol.59, pp. 1909-1921, Dec. 1980.
6. Y. Oohama, "The rate-distortion function for the quadratic Gaussian CEO problem," IEEE Trans. Inf. Theory, vol.44, pp. 1057-1070, May 1998.
7. H. Weingarten, Y. Steinberg, and S. Shamai (Shitz), "The capacity region of the Gaussian multiple-input multiple-output broadcast channel," IEEE Trans. Inf. Theory, vol.52, pp. 3936-3964, Sep. 2006.
8. M. H. M. Costa, "A new entropy power inequality," IEEE Trans. Inf. Theory, vol.31, pp. 751-760, Nov. 1985.
9. M. H. M. Costa, "On the Gaussian interference channel," IEEE Trans. Inf. Theory, vol.31, pp. 607-615, Sep. 1985.
10. A. Lapidoth and S. M. Moser, "Capacity bounds via duality with applications to multiple-antenna systems on flat-fading channels," IEEE Trans. Inf. Theory, vol.49, pp. 2426-2467, Oct. 2003.
11. A. Jafarian and S. Vishwanath, "On the capacity of one-sided two user Gaussian fading broadcast channels," in Proc. Inf. Theory Applicat. Workshop, San Diego, CA, Jan. 2008, pp. 428-432.
12. J. Chen, "Rate region of Gaussian multiple description coding with individual and central distortion constraints," IEEE Trans. Inf. Theory, vol.55, pp. 3991-4005, Sep. 2009.
13. A. Dembo, T. M. Cover, and J. A. Thomas, "Information theoretic inequalities," IEEE Trans. Inf. Theory, vol.37, pp. 1501-1518, Nov. 1991.
14. D. Guo, S. Shamai (Shitz), and S. Verdú, "Mutual information and minimum mean-square error in Gaussian channels," IEEE Trans. Inf. Theory, vol.51, pp. 1261-1282, Apr. 2005.
15. A. Dembo, "Simple proof on the concavity of the entropy power with respect to added Gaussian noise," IEEE Trans. Inf. Theory, vol.35, pp. 887-888, Jul. 1989.
16. D. Guo, S. Shamai (Shitz), and S. Verdú, "Proof of entropy power inequalities via MMSE," in Proc. IEEE Int. Symp. Inf. Theory, Seattle, WA, Jul. 2006, pp. 1011-1015.
17. M. Payaró and D. P. Palomar, "Hessian and concavity of mutual information, differential entropy, and entropy power in linear vector Gaussian channels," IEEE Trans. Inf. Theory, vol.55, pp. 3613-3628, Aug. 2009.
18. T. Liu and P. Viswanath, "An extremal inequality motivated by multiterminal information-theoretic problems," IEEE Trans. Inf. Theory, vol.53, pp. 1839-1851, May 2007.
19. K. Marton, "A coding theorem for the discrete memoryless broadcast channel," IEEE Trans. Inf. Theory, vol.IT-25, pp. 306-311, May 1979.
20. D. P. Palomar and S. Verdú, "Gradient of mutual information in linear vector Gaussian channels," IEEE Trans. Inf. Theory, vol.52, pp. 141-154, Jan. 2006.
21. D. P. Bertsekas, A. Nedic, and A. E. Ozdaglar, Convex Analysis and Optimization. Belmont, MA: Athena Scientific, 2003.
22. A. D. Wyner, "The wire-tap channel," Bell Syst. Tech. J, vol.54, pp. 1355-1387, Oct. 1975.
23. I. Csiszár and J. Körner, "Broadcast channels with confidential messages," IEEE Trans. Inf. Theory, vol.24, pp. 339-348, May 1978.
24. G. Bagherikaram, A. S. Motahari, and A. K. Khandani, "Secrecy rate region of the broadcast channel with an eavesdropper," IEEE Trans. Inf. Theory.
25. G. Bagherikaram, A. S. Motahari, and A. K. Khandani, "The secrecy capacity region of the Gaussian MIMO broadcast channel," IEEE Trans. Inf. Theory, to be published.
26. E. Ekrem and S. Ulukus, "The secrecy capacity region of the Gaussian MIMO multi-receiver wiretap channel," IEEE Trans. Inf. Theory, to be published.
27. G. Strang, Linear Algebra and Its Applications. Wellesley, MA: Wellesley-Cambridge Press, 1998.
28. T. Cover and J. Thomas, Elements of Information Theory. New York: Wiley, 1991.
29. S. N. Diggavi and T. M. Cover, "The worst additive noise under a covariance constraint," IEEE Trans. Inf. Theory, vol.47, pp. 3072-3081, Nov. 2001.
30. T. Liu and S. Shamai (Shitz), "A note on the secrecy capacity of the multiple-antenna wiretap channel," IEEE Trans. Inf. Theory, vol.55, pp. 2547-2553, Jun. 2009.