Erasure entropy

IEEE International Symposium on Information Theory - Proceedings

Volumn , Issue , 2006, Pages 98-102

  Verdú, Sergio ^a   Weissman, Tsachy ^b  

^a Princeton University   (United States)

^b Stanford University   (United States)

Author keywords

Data compression; Discrete denoising; Entropy; Erasure channels; Markov processes; Rate distortion theory; Shannon theory

Indexed keywords

DISCRETE DENOISING; ERASURE CHANNELS; RATE-DISTORTION THEORY; SHANNON THEORY;

CHANNEL ESTIMATION; DATA COMPRESSION; ENTROPY; FINITE DIFFERENCE METHOD; MARKOV PROCESSES; SIGNAL DISTORTION;

RANDOM VARIABLES;

EID: 39049163975     PISSN: 21578101     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2006.261682     Document Type: Conference Paper

References (12)

1. R. Landauer, "Irreversibility and heat generation in the computing process," IBM J. Res. Dev. vol. 5, pp. 183-191, 1961
2. G. Casella and E. I. George, "Explaining the Gibbs sampler," The American Statistician, 46:167-174, 1992.
3. T. Weissman, E. Ordentlich, G. Seroussi, S. Verd- and M. Weinberger, "Universal Discrete Denoising: Known Channel," IEEE Trans. Information Theory, vol. 51, no. 1, pp. 5-28, Jan. 2005.
4. J. Yu and S. Verd-, "Universal Estimation of Erasure Entropy," Proc. 2006 IEEE Int Symp. on Information Theory, Seattle, WA, July 9-14, 2006
5. A. Cohen, N. Merhav and T. Weissman, "Universal Scanning and Sequential Decision Making for Multi-Dimensional Data," 2006 IEEE Int Symp. on Information Theory, Seattle, WA, July 9-14, 2006
6. S. Verdú and T. Weissman, "Erasure Entropy," in preparation.
7. D. Slepian and J. K. Wolf, "Noiseless Coding of correlated information sources," IEEE Trans. Inform. Theory, vol. IT-19, pp. 471-480, 1973.
8. T. M. Cover, A proof of the data compression theorem of Slepian and Wolf for ergodic sources, vol. IT-22, pp. 226228, Mar. 1975.
9. H. Cai, S. Kulkami and S. Verdú, "A Universal Lossless Compressor with Side Information based on Context Tree Weighting," 2005 IEEE Int. Symp. Information Theory, Adelaide, Australia, Sep. 2005.
10. T. Berger, "Rate Distortion Theory," Prentice-Hall, Englewood Cliffs, NJ, 1971
11. R. M. Gray. "Rate distortion functions for finite-state finite-alphabet Markov sources," IEEE Trans. Inform. Theory, IT-17(2): 127-134, March 1971.
12. D. Blackwell, "The entropy of functions of finite-state Markov chains," "Trans. First Prague Conf. Information Theory: Statistical Decision Functions, Random Processes," pp. 1320, 1957.