An efficient algorithm for information decomposition and extraction

2015 53rd Annual Allerton Conference on Communication, Control, and Computing, Allerton 2015

Volumn , Issue , 2016, Pages 972-979

  Makur, Anuran ^a   Kozynski, Fabian ^a   Huang, Shao Lun ^a   Zheng, Lizhong ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; FUNCTIONS; INFORMATION THEORY; PROBABILITY DISTRIBUTIONS;

ALTERNATING CONDITIONAL EXPECTATIONS; AMOUNT OF INFORMATION; CORRELATION FUNCTION; INFORMATION DECOMPOSITION; INFORMATION-THEORETIC APPROACH; MAXIMAL CORRELATION; NONLINEAR FUNCTIONS; STATISTICAL DEPENDENCE;

SINGULAR VALUE DECOMPOSITION;

EID: 84969800151     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ALLERTON.2015.7447113     Document Type: Conference Paper

References (8)

1. A. Rényi, "On measures of dependence," Acta Mathematica Academiae Scientiarum Hungarica, vol. 10, no. 3-4, pp. 441-451, 1959
2. S.-L. Huang, A. Makur, F. Kozynski, and L. Zheng, "Efficient statistics: Extracting information from iid observations," in Proceedings of the 52nd Annual Allerton Conference on Communication, Control, and Computing, Allerton House, UIUC, Illinois, USA, October 1-3 2014
3. A. Makur and L. Zheng, "Bounds between contraction coefficients," in Proceedings of the 53rd Annual Allerton Conference on Communication, Control and Computing, Allerton House, UIUC, Illinois, USA, September 29-October 2 2015
4. A. Makur, "A study of local approximations in information theory," Master's thesis, Massachusetts Institute of Technology, June 2015
5. V. Anantharam, A. Gohari, S. Kamath, and C. Nair, "On maximal correlation, hypercontractivity, and the data processing inequality studied by erkip and cover," April 2013, arXiv:1304.6133 [cs.IT]
6. L. Breiman and J. H. Friedman, "Estimating optimal transformations for multiple regression and correlation," Journal of the American Statistical Association, vol. 80, no. 391, pp. 580-598, September 1985
7. J. W. Demmel, Applied Numerical Linear Algebra, 1st ed. Philadelphia: Society for Industrial and Applied Mathematics (SIAM), 1997
8. W. K. Härdle and L. Simar, Applied Multivariate Statistical Analysis, 4th ed. New York: Springer, 2015