A New Outlook on Shannon'S Information Measures

IEEE Transactions on Information Theory

Volumn 37, Issue 3, 1991, Pages 466-474

  Yeung, Raymond W ^a  

^a LUCENT TECHNOLOGIES   (United States)

Author keywords

Shannon's information measures I Measure I Diagram

Indexed keywords

PROBABILITY--RANDOM PROCESSES;

I DIAGRAM; I MEASURE; INFORMATION MEASURES; RANDOM VARIABLES; SHANNON'S INFORMATION MEASURES;

INFORMATION THEORY;

EID: 0026155039     PISSN: 00189448     EISSN: 15579654     Source Type: Journal    
DOI: 10.1109/18.79902     Document Type: Article

References (15)

1. C. E. Shannon, “A mathematical theory of communication,” Bell Syst. Tech. J., vol. 27, pp. 379–423, 623–656, 1948.
2. F. M. Reza, An Introduction to Information Theory. New York: McGraw-Hill, 1961.
3. N. M. Abramson, Information Theory and Coding. New York: McGraw-Hill, 1963.
4. Hu Guo Ding, “On the amount of information,” Teor. Veroyatnost. i Primenen. 4, pp. 447–455, 1962 (in Russian).
5. H. L. Dyckman, private communication, 1987.
6. R. G. Gallagher, Information Theory and Reliable Communication. New York: Wiley, 1968.
7. T. Berger, Rate Distortion Theory: a Mathematical Basis for Data Compression. Englewood Cliffs, NJ: Prentice Hall, 1971.
8. I. Csiszar and J. Korner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic Press, and Budapest: Akademiai Kiado, 1981.
9. R. E. Blahut, Principles and Practice of Information Theory. New York: Addison-Wesley, 1987.
10. T. Berger and R. W. Yeung, “Multiterminal source coding with encoder breakdown,” IEEE Trans. Inform. Theory, vol. 35, no. 2, pp. 237–244, Mar. 1989.
11. R. W. Yeung, “Some results on multiterminal source coding,” Ph.D. dissertation, School of Elect. Eng., Cornell Univ., Ithaca, NY, May 1988.
12. A. P. Hekstra and F. M. J. Willems, “Dependence balance bounds for single-output two-way channel,” IEEE Trans. Inform. Theory, vol. 35, no. 1, pp. 44–53, Jan. 1989.
13. Te Sun Han, “Nonnegative entropy measures of multivariate symmetric correlations,” Inform. Contr., vol. 36, pp. 133–156, 1978.
14. R. W. Yeung, “The structure of the I-Measure of a Markov chain,” submitted to IEEE Trans. Inform. Theory.
15. A. Papoulis, Probability, Random Variables and Stochastic Processes, 2nd ed. New York: McGraw Hill, 1984.