A framework for linear information inequalities

IEEE Transactions on Information Theory

Volumn 43, Issue 6, 1997, Pages 1924-1934

  Yeung, Raymond W ^a,b  

^a IEEE   (Hong Kong)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Entropy; I Measure; Information identities; Information inequalities; Mutual information

Indexed keywords

COMPUTER SOFTWARE; DATA COMMUNICATION SYSTEMS; PROBABILITY; THEOREM PROVING; WIDE AREA NETWORKS;

INFORMATION IDENTITY/INEQUALITY; SOFTWARE PACKAGE ITIP;

INFORMATION THEORY;

EID: 0031268521     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.641556     Document Type: Article

References (30)

1. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
2. I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic, 1981.
3. A. P. Dawid, "Conditional independence in statistical theory (with discussion)," J. Roy. Statist. Soc., Ser. B, vol. 41, pp. 1-31, 1979.
4. T. S. Han, "Linear dependence structure of the entropy space," Inform. Contr. vol. 29, pp. 337-368, 1975.
5. _, "Nonnegative entropy measures of multivariate symmetric correlations," Inform. Contr., vol. 36, pp. 133-156, 1978.
6. _, "A uniqueness of Shannon's information distance and related nonnegativity problems," J. Combin., Inform. Syst. Sci., vol. 6, no. 4, pp. 320-331, 1981.
7. T. Kawabata and R. W. Yeung, "The structure of the I-Measure of a Markov chain," IEEE Trans. Inform. Theory, vol. 38, pp. 1146-1149, May 1992.
8. J. L. Massey, "Determining the independence of random variables," in 1995 IEEE Int. Symp. on Information Theory (Whistler, BC, Canada, Sept. 17-22, 1995).
9. _, "Causal interpretations of random variables," in 1995 IEEE Int. Symp. on Information Theory (Special session in honor of Mark Pinsker on the occasion of his 70th birthday) (Whistler, BC, Canada, Sept. 17-22, 1995).
10. F. Matúš, "Abstract functional dependency structures," Theor. Comput. Sci., vol. 81, pp. 117-126, 1991.
11. _, "On equivalence of Markov properties over undirected graphs," J. Appl. Probab., vol. 29, pp. 745-749, 1992.
12. _, "Ascending and descending conditional independence relations," in Trans. 11th Prague Conf. on Information Theory, Statistical Decision Functions and Random Processes (Academia, Prague, 1992), vol. B, pp. 181-200.
13. _, "Probabilistic conditional independence structures and matroid theory: Background," Int. J. General Syst., vol. 22, pp. 185-196, 1994.
14. _, "Extreme convex set functions with many nonnegative differences," Discr. Math., vol. 135, pp. 177-191, 1994.
15. _, "Conditional independence among four random variables II," Combin., Prob. Comput., to be published.
16. _, "Conditional independence structures examined via minors," Ann. Math. Artificial Intell., submitted for publication.
17. F. Matúš and M. Studený, "Conditional independence among four random variables I," Combin., Prob. Comput., to be published.
18. J. Pearl, Probabilistic Reasoning in Intelligent Systems. San Mateo, CA: Morgan Kaufman, 1988.
19. G. Strang, Linear Algebra and Its Applications, 2nd ed. New York: Academic, 1980.
20. M. Studený, "Attempts at axiomatic description of conditional independence," in Proc. Work, on Uncertainty Processing in Expert Systems, supplement to Kybernetika, vol. 25, nos. 1-3, pp. 65-72, 1989.
21. _, "Multiinformation and the problem of characterization of conditional independence relations," Probl. Contr. and Inform. Theory, vol. 18, pp. 3-16, 1989.
22. _, "Conditional independence relations have no finite complete characterization," in Trans, 11th Prague Conf. on Information Theory, Statistical Decision Functions and Random Processes (Academia, Prague, 1992), vol. B, pp. 377-396.
23. _, "Structural semigraphoids," Int. J. Gen. Syst., submitted for publication.
24. _, "Descriptions of structures of stochastic independence by means of faces and imsets (in three parts)," Int. J. Gen. Syst., submitted for publication.
25. _, "A new outlook on Shannon's information measures," IEEE Trans. Inform. Theory, vol. 37, pp. 466-474, May 1991.
26. _, "Multilevel diversity coding with distortion," IEEE Trans. Inform. Theory, vol. 41, pp. 412-422, Mar. 1995.
27. R. W. Yeung and Y.-O. Yan, ITIP, [Online] Available WWW: http://www.ie.cuhk.edu.hk/̃ITIP.
28. R. W. Yeung and Z. Zhang, "Miltilevel distributed source coding," in 1997 IEEE Int. Symp. on Information Theory (Ulm, Germany, June 1997), p. 276.
29. Z. Zhang and R. W. Yeung, "A non-Shannon type conditional information inequality," this issue, pp. 1982-1986.
30. _, "On the characterization of entropy function via information inequalities," to be published in IEEE Trans. Inform. Theory.