Multiple description quantization via Gram-Schmidt orthogonalization

IEEE Transactions on Information Theory

Volumn 52, Issue 12, 2006, Pages 5197-5217

  Chen, Jun ^a,b,c   Tian, Chao ^a,b,d   Berger, Toby ^a,b,e   Hemami, Sheila S ^a,b  

^a IEEE

^b Cornell University   (United States)

^c IBM T J WATSON RESEARCH CENTER   (United States)

^d EPFL   (Switzerland)

^e University of Virginia   (United States)

Author keywords

Gram Schmidt orthogonalization; Lattice quantization; Minimum mean square error (MMSE); Multiple descriptions (MDs); Quantization splitting

Indexed keywords

GRAM SCHMIDT ORTHOGONALIZATION; LATTICE QUANTIZATION; MINIMUM MEAN SQUARE ERROR (MMSE); MULTIPLE DESCRIPTIONS (MD); QUANTIZATION SPLITTING;

CHANNEL CODING; GEOMETRY; INFORMATION THEORY; MATHEMATICAL MODELS; MEAN SQUARE ERROR; PROBLEM SOLVING;

CARRIER COMMUNICATION;

EID: 33947413944     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2006.885498     Document Type: Article

References (70)

1. H. Witsenhausen, "On source networks with minimal breakdown degradation," Bell Syst. Tech. J., vol. 59, no. 6, pp. 1083-1087, July/Aug. 1980.
2. J. Wolf, A. Wyner, and J. Ziv, "Source coding for multiple descriptions," Bell Syst. Tech. J., vol. 59, no. 8, pp. 1417-1426, Oct. 1980.
3. L. Ozarow, "On a source coding problem with two channels and three receivers," Bell Syst. Tech. J., vol. 59, no. 10, pp. 1909-1921, Dec. 1980.
4. H. S. Witsenhausen and A. D. Wyner, "Source coding for multiple descriptions, II: A binary source," Bell Syst. Tech. J., vol. 60, pp. 2281-2292, Dec. 1981.
5. A. A. El Gamal and T. M. Cover, "Achievable rates for multiple descriptions," IEEE Trans. Inf. Theory, vol. IT-28, no. 6, pp. 851-857, Nov. 1982.
6. R. Ahlswede, "The rate-distortion region for multiple descriptions without excess rate," IEEE Trans. Inf. Theory, vol. IT-31, no. 6, pp. 721-726, Nov. 1985.
7. Z. Zhang and T. Berger, "New results in binary multiple descriptions," IEEE Trans. Inf. Theory, vol. IT-33, no. 4, pp. 502-521, Jul. 1987.
8. H. S. Witsenhausen and A. D. Wyner, "On team guessing with independent information," Math. Oper. Res., vol. 6, pp. 293-304, May 1981.
9. T. Berger and Z. Zhang, "Minimum breakdown degradation in binary source coding," IEEE Trans. Inf. Theory, vol. IT-29, no. 6, pp. 807-814, Nov. 1983.
10. R. Ahlswede, "On multiple descriptions and team guessing," IEEE Trans. Inf. Theory, vol. IT-32, no. 4, pp. 543-549, Jul. 1986.
11. R. Zamir, "Gaussian codes and Shannon bounds for multiple descriptions," IEEE Trans. Inf. Theory, vol. 45, no. 7, pp. 2629-2635, Nov. 1999.
12. F. W. Fu, R. W. Yeung, and R. Zamir, "On the rate-distortion region for multiple descriptions," IEEE Trans. Inf. Tlieory, vol. 48, no. 7, pp. 2012-2021, Jul. 2002.
13. H. Feng and M. Effros, "On the rate loss of multiple description source codes," IEEE Trans. Inf. Theory, vol. 51, no. 2, pp. 671-683, Feb. 2005.
14. L. Lastras-Montano and V. Castelli, "Near sufficiency of random coding for two descriptions," IEEE Trans. Inf. Tlieory, vol. 52, no. 2, pp. 681-695, Feb. 2006.
15. R. Venkataramani, G. Kramer, and V. K. Goyal, "Multiple description coding with many channels," IEEE Trans. Inf. Theory, vol. 49, no. 9, : pp. 2106-2114, Sep. 2003.
16. S. S. Pradhan, R. Puri, and K. Ramchandran, "n-channel symmetric multiple descriptions - Part I: (n, k) source-channel erasure codes," IEEE Trans. Inf. Theory, vol. 50, no. I, pp. 47-61, Jan. 2004.
17. P. Ishwar, R. Puri, S. S. Pradhan, and K. Ramchandran, "On compression for robust estination in sensor networks," in Proc. IEEE Int. Symp. Information Theory, Yokohama, Japan, Jim.Jul. 2003, p. 193.
18. J. Chen and T. Berger, "Robust distributed source coding," IEEE Trans. Inf. Theory, submitted for publication.
19. V. K. Goyal, "Multiple description coding: Compression meets the network," IEEE Signal Process. Mag., vol. 18, no. 5, pp. 74-93, Sep. 2001.
20. V. A. Vaishampayan, "Design of multiple description scalar quantizers," IEEE Trans. Inf. Theory, vol. 39, no. 3, pp. 821-834, May 1993.
21. V. A. Vaishampayan and J. Domaszewicz, "Design of entropy-constrained multiple-description scalar quantizers," IEEE Trans. Inf. Theory, vol. 40, no. 1, pp. 245-250, Jan. 1994.
22. V. A. Vaishampayan and J. C. Batllo, "Asymptotic analysis of multiple-description quantizers," IEEE Trans. Inf. Theory, vol. 44, no. 1, pp. 278-284, Jan. 1998.
23. C. Tian and S.S. Hemami, "Universal multiple description scalar quantizer: Analysis and design," IEEE Trans. Inf. Theory, vol. 50, no. 9, pp. 2089-2102, Sep. 2004.
24. J. Balogh and J. A. Csirik, "Index assignment for two-channel quantization," IEEE Trans. Inf. Theory, vol. 50, no. 11, pp. 2737-2751, Nov. 2004.
25. T. Y. Berger-Wolf and E. M. Reingold, "Index assignment for multichannel communication under failure," IEEE Trans. Inf. Theory, vol. 48, no. 10, pp. 2656-2668, Oct. 2002.
26. N. Gortz and P. Leelapornchai, "Optimization of the index assignments for multiple description vector quantizers," IEEE Trans. Commun., vol. 51, no. 3, pp. 336-340, Mar. 2003.
27. P. Koulgi, S. L. Regunathan, and K. Rose, "Multiple description quantization by deterministic annealing," IEEE Trans. Inf. Theory, vol. 49, no. 8, pp. 2067-2075, Aug. 2003.
28. V. A. Vaishampayan, N. Sloane, and S. Servetto, "Multiple description vector quantization with lattice codebooks: Design and analysis," IEEE Trans. Inf. Theory, vol. 47, no. 4, pp. 1718-1734, Jul. 2001.
29. S. N. Diggavi, N. J. A. Sloane, and V. A. Vaishampayan, "Asymmetric multiple description lattice vector quantizers," IEEE Trans. Inf. Theory, vol. 48, no. 1, pp. 174-191, Jan. 2002.
30. V. K. Goyal, J. A. Keiner, and J. Kovacevic, "Multiple description vector quantization with a coarse lattice," IEEE Trans. Inf. Theory, vol. 48, no. 3, pp. 781-788, Mar. 2002.
31. C. Tian and S. S. Hemami, "Optimality and sub-optimality of multiple description vector quantization with a lattice codebook," IEEE Trans. Inf. Theory, vol. 50, no. 10, pp. 2458-2468, Oct. 2004.
32. Y. Frank-Dayan and R. Zamir, "Dithered lattice-based quantizers for multiple descriptions," IEEE Trans. Inf. Theory, vol. 48, no. 1, pp. 192-204, Jan. 2002.
33. M. T. Orchard, Y. Wang, V. A. Vaishampayan, and A. R. Reibman, "Redundancy rate-distortion analysis of multiple description coding using pairwise correlating transforms," in Proc. IEEE Int. Conf. Image Processing, Santa Barbara, CA, Oct. 1997, vol. 1, pp. 608-611.
34. Y. Wang, M. T. Orchard, and A. R. Reibman, "Optimal pairwise correlating transforms for multiple description coding," in Proc. Int. Conf. Image Processing, Chicago, IL, Oct. 1998, pp. 679-683.
35. S. S. Pradhan and K. Ramchandran, "On the optimality of block orthogonal transforms for multiple description coding of Gaussian vector sources," IEEE Signal Process. Lett., vol. 7, no. 4, pp. 76-78, Apr. 2000.
36. V. K. Goyal and J. Kovacevic, "Generalized multiple description coding with correlating transforms," IEEE Trans. Inf. Theory, vol. 47, no. 6, pp. 2199-2224, Sep. 2001.
37. R. Zamir and M. Feder, "On universal quantization by randomized uniform/lattice quantizer," IEEE Trans. Inf. Theory, vol. 38, no. 2, pp. 428-436, Mar. 1992.
38. _, "On lattice quantization noise," IEEE Trans. Inf. Theory, vol. 42, no. 4, pp. 1152-1159, Jul. 1996.
39. _, "Information rates of pre/post filtered dithered quantizers," IEEE Trans. Inf. Theory, vol. 42, no. 5, pp. 1340-1353, Sep. 1996.
40. R. Zamir, S. Shamai (Shitz), and U. Erez, "Nested linear/lattice codes for structured multiterminal binning," IEEE Trans. Inf. Theory, vol. 48, no. 6, pp. 1250-1276, Jun. 2002.
41. T. Kailath, A. Sayed, and B. Hassibi, Linear Estimation. Upper Saddle River, NJ: Prentice-Hall, 2000.
42. T. Guess and M. K. Varanasi, "An information-theoretic framework for deriving canonical decision-feedback receivers in Gaussian channels," IEEE Trans. Inf. Theory, vol. 51, no. 1, pp. 173-187, Jan. 2005.
43. K. Marton, "A coding theorem for the discrete memoryless broadcast channel," IEEE Trans. Inf. Theory, vol. IT-25, no. 3, pp. 306-311, May 1979.
44. A. A. El Gamal and E. van der Meulen, "A proof of Marions coding, theorem for the discrete memoryless broadcast channel," IEEE Trans. Inf. Theory, vol. IT-27, no. 1, pp. 120-122, Jan. 1981.
45. X. Zhang, J. Chen, S. B. Wicker, and T. Berger, "Successive coding in multiuser information theory," IEEE Trans. Inf. Theory, submitted for publication.
46. S. I. Gel'fand and M. S. Pinsker, "Coding for channel with random parameters," Probl. Control Inform. Tlieory, vol. 9, no. 1, pp. 19-31, 1980.
47. M. Costa, "Writing on dirty paper," IEEE Trans. Inf. Theory, vol. IT-29, no. 3, pp. 439-441, May 1983.
48. T. Berger, "Multiterminal source coding," in The Information Theory Approach to Communications, CISM Courses and Lectures, G. Longo, Ed. Vienna/New York: Springer-Verlag, 1978, vol. 229, pp. 171-231.
49. D. Slepian and J. K. Wolf, "Noiseless coding of correlated information sources," IEEE Trans. Inf. Theory, vol. IT-19, no. 4, pp. 471-480, Jul. 1973.
50. S. Y. Tung, "Multiterminal source coding," Ph.D. dissertation, School of Elec. Eng., Cornell Univ., Ithaca, NY, May 1978.
51. T. Berger, K. Housewright, J. Omura, S. Y. Tung, and J. Wolfowitz, "An upper bound on the rate-distortion function for source coding with partial side information at the decoder," IEEE Trans. Inf. Theory, vol. IT-25, no. 6, pp. 664-666, Nov. 1979.
52. R. Ahlswede, "Multi-way communication channels," in Proc. 2nd Int. Symp. Information Theory. Budapest, Hungary: Hungarian Acad. Sci., 1973, pp. 23-52.
53. H. Liao, "Multiple access channels," Ph.D. dissertation, Dept. Elec. Eng., Univ. Hawaii, Honolulu, 1972.
54. B. Rimoldi and R. Urbanke, "Asynchronous Slepian-Wolf coding via source-splitting," in Proc. IEEE Int. Symp. Information Theory, Ulm, Germany, Jun./Ju. 1997, p. 271.
55. T. P. Coleman, A. H. Lee, M. Médard, and M. Effros, "Low-complexity approaches to Slepian-Wolf near-lossless distributed data compression," IEEE Trans. Inf. Tlreory, vol. 52, no. 8, pp. 3546-3561, Aug. 2006.
56. J. Chen and T. Berger, "Successive Wyner-Ziv coding scheme and its application to the quadratic gaussian CEO problem," IEEE Trans. Inf. Theory, submitted for publication.
57. A. B. Carleial, "On the capacity of multiple-terminal communication networks," Ph.D. dissertation, Stanford Univ., Stanford, CA, Aug. 1975.
58. B. Rimoldi and R. Urbanke, "A rate-splitting approach to the Gaussian multiple- access channel," IEEE Trans. Inf. Theory, vol. 42, no. 2, pp. 364-375, Mar. 1996.
59. A. J. Grant, B. Rimoldi, R. L. Urbanke, and P. A. Whiting, "Rate-splitting multiple access for discrete memoryless channels," IEEE Trans. Inf. Theory, vol. 47, no. 3, pp. 873-890, Mar. 2001.
60. B. Rimoldi, "Generalized time sharing: A low-complexity capacity-achieving multiple- access technique," IEEE Trans. Inf. Theory, vol. 47, no. 6, pp. 2432-2442, Sep. 2001.
61. R. Gallager, Information Theory and Reliable Communication. New York: Wiley, 1968.
62. H. Feng and M. Effros, "On the achievable region for multiple description source codes on gaussian sources," in Proc. IEEE Int. Symp. Information Theory, Yokohama, Japan, Jun./Jul. 2003, p. 195.
63. R. M. Gray and D. L. Neuhoff, "Quantization," IEEE Trans. Inf. Theory, vol. 44, no. 6, pp. 2325-2383, Oct. 1998.
64. R. Zamir, private communication.
65. C. Tian and S.S. Hemami, "A new class of multiple description scalar quantizers and its application to image coding," IEEE Signal Process. Lett., vol. 12, no. 4, pp. 329-332, Apr. 2005.
66. S. D. Servetto, K. Ramchandran, V. A. Vaishampayan, and K. Nahrstedt, "Multiple description wavelet based image coding," IEEE Trans. Image Process., vol. 9, no. 5, pp. 813-826, May 2000.
67. W.-Y. Chan, S. Gupta, and A. Gersho, "Enhanced multistage vector quantization by joint codebook design," IEEE Trans. Commun., vol. 40, no. 11, pp. 1693-1697, Nov. 1992.
68. U. Erez and R. Zamir, "Achieving 1/2 log(1 + SNR) on the AWGN channel with lattice encoding and decoding," IEEE Trans. Inf. Theory, vol. 48, no. 10, pp. 2293-2314, Oct. 2004.
69. G. D. Fomey Jr., "On the role of MMSE estimation in approaching the information-theoretic limits of linear Gaussian channels: Shannon meets Wiener," in Proc. 41st Anna. Allerton Conf. Communication, Control, and Computing, Monticello, IL, Oct. 2003, pp. 430-439.
70. _, "Shannon meets Wiener II: On MMSE estimation in successive decoding schemes," in Proc. 42nd Annu. Allerton Conf. Communication, Control, and Computing, Monticello, IL, Oct. 2004.