Achieving the Gaussian rate-distortion function by prediction

IEEE Transactions on Information Theory

Volumn 54, Issue 7, 2008, Pages 3354-3364

  Zamir, Ram ^a   Kochman, Yuval ^a   Erez, Uri ^a  

^a TEL AVIV UNIVERSITY   (Israel)

Author keywords

Decision feedback; Differential pulse code modulation (DPCM); Directed information; Entropy coded dithered quantization (ECDQ); Equalization; Minimum mean square error (MMSE) estimation; Pre post filtering; Shannon lower bound; Test channel; Water filling

Indexed keywords

ELECTRIC DISTORTION; FORECASTING; GAUSSIAN DISTRIBUTION; INTERSYMBOL INTERFERENCE; MODULATION; MOTION ESTIMATION; POWER SPECTRUM; TESTING; TRELLIS CODES;

DECISION FEEDBACK EQUALIZATION (DFE); DIFFERENTIAL PULSES; DISTORTION (DEFORMATION); FREQUENCY-DOMAIN (FD); GAUSSIAN; GAUSSIAN SOURCES; INTER-SYMBOL INTERFERENCE (ISI); LINEAR PREDICTION (LP); OPTIMALITY; RATE DISTORTION FUNCTIONS; TIME DOMAIN (OCT); WATER FILLING;

SIGNAL DISTORTION;

EID: 46749127871     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2008.924683     Document Type: Article

References (19)

1. J. Barry, E. A. Lee, and D. G. Messerschmitt, Digital Communication 3rd ed. Boston, MA: Kluwer, 2004.
2. T. Berger, Rate Distortion Theory: A Mathematical Basis for Data Compression. Englewood Cliffs, NJ: Prentice-Hall, 1971.
3. J. Chen, C. Tian, T. Berger, and S. S. Hemami, "Multiple description quantization via Gram-Schmidt orthogonalization," IEEE Trans. Inf. Theory, vol. 52, no. 12, pp. 5197-5217, Dec. 2006.
4. J. M. Cioffi, G. P. Dudevoir, M. V. Eyuboglu, and G. D. J. Forney, "MMSE decision-feedback equalizers and coding - Part I: Equalization results," IEEE Trans. Commun., vol. 43, no. 10, pp. 2582-2594, Oct. 1995.
5. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
6. U. Erez and R. Zamir, "Achieving 1/2 log(1 + SNR) on the AWGN channel with lattice encoding and decoding," IEEE Trans. Inf. Theory vol. 50, no. 10, pp. 2293-2314, Oct. 2004.
7. G. D. Forney Jr., "Shannon meets Wiener II: On MMSE estimation in successive decoding schemes," in Proc. 42st Annu. Allerton Conf. Communication, Control, and Computing, Monticello, IL, Oct. 2004 Online. Available: http://arxiv.org/abs/cs/0409011
8. R. G. Gallager, Information Theory and Reliable Communication. New York: Wiley, 1968.
9. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression Boston, MA: Kluwer, 1992.
10. G. D. Gibson, T. Berger, T. Lookabaugh, D. Lindbergh, and R. L. Baker, Digital Compression for Multimedia: Principles and Standards'. San Francisco, CA: Morgan Kaufmann, 1998.
11. T. Guess and M. K. Varanasi, "An information-theoretic framework for deriving canonical decision-feedback receivers in gaussian channels," IEEE Trans. Inf. Theory, vol. 51, no. 1, pp. 173-187, Jan. 2005.
12. N. S. Jayant and P. Noll, Digital Coding of Waveforms. Englewood Cliffs, NJ: Prentice-Hall, 1984.
13. K. T. Kim and T. Berger, "Sending a lossy version of the innovations process is suboptimal in QG rate-distortion," in Proc. IEEE Int. Symp. Information Theory (ISIT' 2005), Adelaide, Australia, Sep. 2005, pp. 209-213.
14. T. Linder and R. Zamir, "Causal coding of stationary sources and individual sequences with high resolution," IEEE Trans. Inf. Theory vol. 52, no. 2, pp. 662-680, Feb. 2006.
15. J. Massey, "Causality, feedback and directed information," in Proc. IEEE Int. Symp. Information Theory and Its Applicatios, Honolulu, HI, Nov. 1990, pp. 303-305.
16. R. Zamir and M. Feder, "On universal quantization by randomized uniform/lattice quantizer," IEEE Trans. Inf. Theory, vol. 38, no. 2, pp. 428-436, Mar. 1992.
17. R. Zamir and M. Feder, "On lattice quantization noise," IEEE Trans. Inf. Theory, vol. 42, no. 4, pp. 1152-1159, Jul. 1996.
18. R. Zamir and M. Feder, "Information rates of pre/post filtered dithered quantizers," IEEE Trans. Inf. Theory, vol. 42, no. 5, pp. 1340-1353, Sep. 1996.
19. O. G. Guleryuz and M. T. Orchard, "On the DPCM compression of Gaussian autoregressive sequences," IEEE Trans. Inf. Theory, vol. 47, no. 3, pp. 945-956, Mar. 2001.