Sequential prediction and ranking in universal context modeling and data compression

IEEE Transactions on Information Theory

Volumn 43, Issue 5, 1997, Pages 1697-1706

  Weinberger, Marcelo J ^a,b   Seroussi, Gadiel ^a,b  

^a IEEE   (United States)

^b HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Context algorithm; Image compression; Prediction; Ranking; Universal coding

Indexed keywords

ALGORITHMS; COMBINATORIAL MATHEMATICS; COMPUTER SIMULATION; DATA STRUCTURES; IMAGE CODING; PROBABILITY;

CONTEXT ALGORITHM; MODELING TOOLS; UNIVERSAL CODER;

IMAGE COMPRESSION;

EID: 0031238386     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.623176     Document Type: Article

References (26)

1. A. Netravali and J. O. Limb, "Picture coding: A review," Proc. IEEE, vol. 68, pp. 366-406, 1980.
2. M. Feder, N. Merhav, and M. Gutman, "Universal prediction of individual sequences," IEEE Trans. Inform. Theory, vol. 38, pp. 1258-1270, July 1992.
3. M. Feder and N. Merhav, "Relations between entropy and error probability," IEEE Trans. Inform. Theory, vol. 40, pp. 259-266, Jan. 1994.
4. S. Todd, G. G. Langdon, Jr., and J. Rissanen, "Parameter reduction and context selection for compression of the gray-scale images," IBM J. Res. Develop., vol. 29, no. 2, pp. 188-193, Mar. 1985.
5. T. M. Cover, "Behavior of sequential predictors of binary sequences," in Proc. 4th Prague Conf. on Information Theory, Statistical Decision Functions, and Random Processes. Prague, Czechoslovakia: Publishing House of the Czechoslovak Acad. Sci., 1967, pp. 263-272.
6. T. M. Cover and A. Shenhar, "Compound Bayes predictors for sequences with apparent Markov structure," IEEE Trans. Syst. Man Cybern., vol. SMC-7, pp. 421-424, May/June 1977.
7. N. Merhav, M. Feder, and M. Gutman, "Some properties of sequential predictors for binary Markov sources," IEEE Trans. Inform. Theory, vol. 39, pp. 887-892, May 1993.
8. J. L. Mitchell and W. B. Pennebaker, JPEG Still Image Data Compression Standard. New York: Van Nostrand Reinhold, 1993.
9. M. J. Weinberger, J. Rissanen, and R. Arps, "Applications of universal context modeling to lossless compression of gray-scale images," IEEE Trans. Image Processing, vol. 5, pp. 575-586, Apr. 1996.
10. X. Wu, "An algorithmic study on lossless image compression," in Proc. 1996 Data Compression Conf. (Snowbird, UT, Mar. 1996), pp. 150-159.
11. M. J. Weinberger, G. Seroussi, and G. Sapiro, "LOCO-I: A low complexity, context-based, lossless image compression algorithm," in Proc. 1996 Data Compression Conf. (Snowbird, UT, Mar. 1996), pp. 140-149.
12. J. Rissanen, "A universal data compression system," IEEE Trans. Inform. Theory, vol. IT-29, pp. 656-664, Sept. 1983.
13. M. J. Weinberger, A. Lempel, and J. Ziv, "A sequential algorithm for the universal coding of finite-memory sources," IEEE Trans. Inform. Theory, vol. 38, pp. 1002-1014, May 1992.
14. M. J. Weinberger, J. Rissanen, and M. Feder, "A universal finite memory source," IEEE Trans. Inform. Theory, vol. 41, pp. 643-652, May 1995.
15. F. M. J. Willems, Y. M. Shtarkov, and T. J. Tjalkens, "The context-tree weighting method: Basic properties," IEEE Trans. Inform. Theory, vol. 41, pp. 653-664, May 1995.
16. J. Rissanen, "Universal coding, information, prediction, and estimation," IEEE Trans. Inform. Theory, vol. IT-30, pp. 629-636, July 1984.
17. M. Feder and N. Merhav, "Hierarchical universal coding," IEEE Trans. Inform. Theory, 1996, to be published.
18. B. Ryabko, "Twice-universal coding," Probl. Inform. Transm., vol. 20, pp. 173-177, July/Sept. 1984.
19. M. J. Weinberger, N. Merhav, and M. Feder, "Optimal sequential probability assignment for individual sequences," IEEE Trans. Inform. Theory, vol. 40, pp. 384-396, Mar. 1994.
20. P. G. Howard and J. S. Vitter, "Fast and efficient lossless image compression," in Proc. 1993 Data Compression Conf. (Snowbird, UT, Mar. 1993), pp. 351-360.
21. L. R. Bahl, P. V. de Souza, P. S. Gopalakrishnan, D. Nahamoo, and M. A. Picheny, "Robust methods for using context-dependent features and models in a continuous speech recognizer," in Proc. IEEE ICASSP-94 (Adelaide, So. Australia, 1994), pp. 1533-1536.
22. A. Dembo and O. Zeitouni, Large Deviations Techniques and Applications. Boston/London: Jones and Bartlett, 1993.
23. I. Csiszár, T. M. Cover, and B.-S. Choi, "Conditional limit theorems under Markov conditioning," IEEE Trans. Inform. Theory, vol. IT-33, pp. 788-801, Nov. 1987.
24. S. I. Resnick, Adventures in Stochastic Processes. Boston, MA: Birkhäuser, 1992.
25. R. E. Krichevskii and V. K. Trofimov, "The performance of universal encoding," IEEE Trans. Inform. Theory, vol. IT-27, pp. 199-207, Mar. 1981.
26. M. J. Weinberger and G. Seroussi, "Sequential prediction and ranking in universal context modeling and data compression," Tech. Rep. HPL-94-111, Hewlett-Packard Labs., Nov. 1994; revised version Jan. 1997.