Lower bounds on expected redundancy for nonparametric classes

IEEE Transactions on Information Theory

Volumn 42, Issue 1, 1996, Pages 272-275

  Yu, Bin ^a,b  

^a IEEE

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CALCULATIONS; CHANNEL CAPACITY; CODES (SYMBOLS); DATA COMPRESSION; MATHEMATICAL MODELS; REDUNDANCY; THEOREM PROVING;

LOWER BOUNDS; SHANNON CAPACITY; UNIVERSAL CODING;

ENCODING (SYMBOLS);

EID: 0029779159     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.481802     Document Type: Article

References (13)

1. B. S. Clarke and A. R. Barron, "Information-theoretic asymptotics of Bayes methods," IEEE Trans. Inform. Theory, vol. 36, pp. 453-471, May 1990.
2. I. Csiszár, "Information theoretical methods in statistics," class notes, University of Maryland, College Park, Spring 1990.
3. L. Davisson, "Universal noiseless coding," IEEE Trans. Inform. Theory, vol. IT-19, pp. 783-795, Nov. 1973.
4. L. Devroye, A Course in Density Estimation. Basel, Switzerland: Birkhäuser-Verlag, 1987.
5. R. G. Gallager, "Source coding with side information and universal coding," unpublished manuscript, Sept. 1979.
6. D. Haussler, "A general minimax result for relative entropy," preprint.
7. _ "General bounds on the mutual information between a parameter and n conditionally independent observations," preprint.
8. I. A. Ibragimov and R. Z. Has'minsky, "On the information in a sample about a parameter," in Proc. 2nd Int. Symp. on Information Theory, B. N. Petrov and F. Csáki, Eds. Budapest, Hungary: Akademiai Kiado, 1973.
9. N. Merhav and M. Feder, "A strong version of the redundancy-capacity theorem of universal coding," IEEE Trans. Inform. Theory, vol. 41, pp. 714-722, May 1995.
10. J. Rissanen, "Stochastic complexity and modeling," Annals Statist., vol. 14, pp. 1080-1100, 1986.
11. J. Rissanen, T. Speed, and B. Yu, "Density estimation by stochastic complexity," IEEE Trans. Inform. Theory, vol. 38, pp. 315-323, May 1993.
12. B. Yu, "Assouad, Fano, and Le Cam," to appear in Festschrift in Honor of L. Le Cam on His 70th Birthday, 1995.
13. B. Yu and T. Speed, "Data compression and histograms," Probab. Theory Related Fields, vol. 92, pp. 195-229, 1992.