High-resolution scalar quantization with rényi entropy constraint

IEEE Transactions on Information Theory

Volumn 57, Issue 10, 2011, Pages 6837-6859

  Kreitmeier, Wolfgang ^a   Linder, Tamás ^b  

^a UNIVERSITY OF PASSAU   (Germany)

^b QUEEN S UNIVERSITY   (Canada)

Author keywords

Companding; high resolution asymptotics; optimal quantization; R nyi entropy

Indexed keywords

ACHIEVABILITY; ASYMPTOTICS; COMPANDING; CONTINUOUS DISTRIBUTION; HIGH RATE; HIGH RESOLUTION; LARGE CLASS; OPTIMAL QUANTIZATION; OPTIMAL SCALAR QUANTIZATION; QUANTIZERS; RTH POWER; SCALAR QUANTIZATION; SOURCE DISTRIBUTION;

OPTIMIZATION;

ENTROPY;

EID: 80053969373     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2011.2165809     Document Type: Article

References (31)

1. J. Aczél and Z. Daróczy, On Measures of Information and their Characterizations. London, U.K.: Academic , 1975.
2. M. B. Baer, "Coding for General Penalties," Ph.D., Stanford Univ., Stanford, CA, 2003.
3. W. R. Bennett, "Spectra of quantized signals," Bell. Syst. Tech. J., vol. 27, pp. 446-472, 1948.
4. P. Billingsley, Probability and Measure, 2nd ed. New York: Wiley, 1986.
5. J. A. Bucklew and G. L. Wise, "Multidimensional asymptotic quantization theory with th power distortion measures," IEEE Trans. Inf. Theory, vol. 28, pp. 239-247, Mar. 1982.
6. L. L. Campbell, "A coding theorem and Rényi's entropy," Inf. Contr., vol. 8, pp. 423-429, 1965.
7. D. L. Cohn, Measure Theory. Boston, MA: Birkhäuser, 1980.
8. I. Csiszár, "Generalized entropy and quantization problems," in Proc. Trans. 6th Prague Conf. Inf. Theory, Statist. Decision Functions, Random Processes, Prague, 1973, pp. 29-35.
9. S. Graf and H. Luschgy, Foundations of Quantization for Probability Distributions. Berlin, Heidelberg: Springer-Verlag, 2000.
10. R.M. Gray, T. Linder, and J. T. Gill, "Lagrangian vector quantization with combined entropy and codebook size constraints," IEEE Trans. Inf. Theory, vol. 54, pp. 2220-2242, May 2008.
11. R.M.Gray, T. Linder, and J. Li, "ALagrangian formulation of Zador's entropy-constrained quantization theorem," IEEE Trans. Inf. Theory, vol. 48, pp. 695-707, Mar. 2002.
12. R. M. Gray and D. L. Neuhoff, "Quantization," IEEE Trans. Inf. Theory, (Special Commemorative Issue), vol. 44, pp. 2325-2383, Oct. 1998.
13. A. György and T. Linder, "Optimal entropy-constrained scalar quantization of a uniform source," IEEE Trans. Inf. Theory, vol. 46, pp. 2704-2711, Nov. 2000.
14. P. Harremoës, "Joint range of Rényi entropies," Kybernetika, vol. 45, pp. 901-911, 2009.
15. A. S. Holevo, "The additivity problem in quantum information theory," in Proc. Int. Congress of Math., Madrid, Spain, 2006, pp. 999-1018.
16. F. Jelinek, "Buffer overflow in variable length coding of fixed rate sources," IEEE Trans. Inf. Theory, vol. 14, pp. 490-501, May 1968.
17. R. Jenssen, "Information theoretic learning and kernel methods," in Information Theory and Statistical Learning, F. Emmert-Streib andM. Dehmer, Eds. New York: Springer, 2009, pp. 209-230.
18. W. Kreitmeier, "Error bounds for high-resolution quantization with Rényi- -entropy constraints," Acta Math. Hungar., vol. 127, pp. 34-51, 2010.
19. W. Kreitmeier, "Optimal quantization for the one-dimensional uniform distribution with Rényi- -entropy constraints," Kybernetika, vol. 46, pp. 96-113, 2010.
20. W. Kreitmeier, "Optimal vector quantization in terms of Wasserstein distance," J.Multivar. Anal., vol. 102, no. 8, pp. 1225-1239, Sep. 2011.
21. A. Krishnamacharia, V. moyMandalb, and Karmeshu, "Study of DNA binding sites using the Rényi parametric entropy measure," J. Theoret. Biol., vol. 227, no. 3, pp. 429-436, 2004.
22. T. Linder, "On asymptotically optimal companding quantization," Probl. Contr. Inf. Theory, vol. 20, no. 6, pp. 383-393, 1991.
23. H. Luschgy and G. Pagès, "Functional quantization rate and mean regularity of processes with an application to Lévy processes," Ann. Appl. Probab., vol. 18, pp. 427-469, 2008.
24. P. Nath, "On a coding theorem connected with Rényi's entropy," Inf. Contr., vol. 29, pp. 234-242, 1975.
25. J. N. Pierce, "Asymptotic quantizing error for unbounded random variables," IEEE Trans. Inf. Theory, vol. 16, pp. 81-83, Jan. 1970.
26. A. Rényi, "On measures of entropy and information," in Proc. 4th Berkeley Symp. Math. Stat. Probab., 1960, vol. 1, pp. 547-561.
27. A. Rényi, "Some fundamental problems of information theory," (in Hungarian) Magyar Tud. Akad. Mat. Fiz. Oszt. Közl, vol. 10, pp. 251-282, 1960.
28. H. L. Royden, Real Analysis. New York: Macmillan, 1968.
29. A. Sagna, "Méthodes de Quantification Optimale Avec Applications à la Finance," Ph.D., Univ. Paris VI, , 2008.
30. J. Serrin and D. E. Varberg, "A general chain rule for derivatives and the change of variables formula for the Lebesgue integral," Am. Math. Mon., vol. 76, pp. 514-520, May 1969.
31. P. Zador, "Development and Evaluation of Procedures for Quantizing Multivariate Distributions," Ph.D., Stanford Univ., Stanford, CA