Bayes risk weighted vector quantization with posterior estimation for image compression and classification

IEEE Transactions on Image Processing

Volumn 5, Issue 2, 1996, Pages 347-360

  Perlmutter, Keren O ^a,b   Perlmutter, Sharon M ^a,b   Gray, Robert M ^a,b   Olshen, Richard A ^a,c   Oehler, Karen L ^a,d  

^a IEEE

^b Stanford University   (United States)

^c STANFORD UNIVERSITY   (United States)

^d TEXAS INSTRUMENTS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; CALCULATIONS; CODES (SYMBOLS); ERRORS; IMAGE CODING; IMAGE COMPRESSION; IMAGE PROCESSING; LEARNING ALGORITHMS; PARAMETER ESTIMATION; PROBABILITY;

BAYES RISK; BAYES RISK WEIGHTED VECTOR QUANTIZATION; IMAGE CLASSIFICATION; POSTERIOR ESTIMATION; VECTOR QUANTIZATION BASED ALGORITHMS;

VECTOR QUANTIZATION;

EID: 0030083869     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/83.480770     Document Type: Article

References (49)

1. J. D. Gorman, "Vector quantizer designs for joint compression and terrain categorization of multispectral imagery," in Proc. NASA Conf. 3255, 1994 Space Earth Sci. Data Compression Workshop, Salt Lake City, UT, Apr. 1994.
2. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression. Boston: Kluwer, 1992.
3. H. Abut, Ed., Vector Quantization. Piscataway, NJ: IEEE, May 1990, IEEE Reprint Collection.
4. T. Kohonen, "An introduction to neural computing," Neural Networks, vol. 1, pp. 3-16, 1988.
5. _, Self-Organization and Associative Memory. Berlin: Springer-Verlag, 1989, 3rd ed.
6. T. Kohonen, G. Barna, and R. Chrisley, "Statistical pattern recognition with neural networks: benchmarking studies," in Proc. IEEE Int. Conf. Neural Networks, July 1988, pp. 61-68.
7. J. Kramer, "Tree structured neural net classifier," Tech. Rep. 19900805, Stanford Univ. Center for Design Res., 1990.
8. K. L. Oehler, P. C. Cosman, R. M. Gray, and J. May, "Classification using vector quantization," in Conf. Rec. Twenty-Fifth Asilomar Conf. Signals, Syst., and Comput., Pacific Grove, CA, Nov. 1991, pp. 439-445.
9. G. F. McLean, "Vector quantization for texture classification," IEEE Trans. Syst., Man, Cybern., vol. 23, no. 3, pp. 637-649, May/June 1993.
10. M. B. Skouson, "Learning-based pattern classification using vector quantization," Master's thesis, Brigham Young Univ., Provo, UT, Mar. 1994.
11. S. P. Lloyd, "Least squares quantization in PCM," Unpublished Bell Lab. Tech. Note. Portions presented at the Inst. Math. Stat. Meeting, Atlantic City, NJ, Sept. 1957. Published in the Mar. 1982 Special Issue on Quantization of the IEEE Trans. Inform. Theory, 1957.
12. Y. Linde, A. Buzo, and R. M. Gray, "An algorithm for vector quantizer design," IEEE Trans. Commun., vol. COM-28, pp. 84-95, Jan. 1980.
13. L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stone, Classification and Regression Trees. Belmont, CA: Wadsworth, 1984.
14. P. A. Chou, T. Lookabaugh, and R. M. Gray, "Optimal pruning with applications to tree-structured source coding and modeling," IEEE Trans. Inform. Theory, vol. IT-35, no. 2, pp. 299-315, Mar. 1989.
15. _, "Entropy-constrained vector quantization," IEEE Trans. Acoust., Speech, Signal Processing, vol. 37, pp. 31-42, Jan. 1989.
16. E. A. Riskin and R. M. Gray, "A greedy tree growing algorithm for the design of variable rate vector quantizers," IEEE Trans. Signal Processing, vol. 39, pp. 2500-2507, Nov. 1991.
17. L. Gordon and R. A. Olshen, "Almost surely consistent nonparametric regression from recursive partitioning schemes," J. Multivariate Anal., vol. 15, pp. 147-163, 1984.
18. L. Gordon and R. A. Olshen, "Consistent nonparametric regression from recursive partitioning schemes," J. Multivariate Anal., vol. 10, pp. 610-627, 1980.
19. _, "Asymptotically efficient solutions to the classification problem," Ann. Stat., vol. 6, pp. 515-533, 1978.
20. K. L. Oehler and R. M. Gray, "Combining image compression and classification using vector quantization," IEEE Trans. Patt. Anal. Machine Intell., vol. 17, no. 5, pp. 461-473, May 1995.
21. E. E. Hilbert, "Cluster compression algorithm: a joint clustering/data compression concept," Pub. 77-43, Jet Propulsion Lab, Pasadena, CA, Dec. 1977.
22. H. V. Poor and J. B. Thomas, "Applications of Ali-Silvey distance measures in the design of generalized quantizers for binary decision systems," IEEE Trans. Commun., vol. COM-25, pp. 893-900, Sept. 1977.
23. G. Lugosi and A. B. Nobel, "Consistency of data-driven histogram methods for density estimation and classification," Beckman Inst. Tech. Rep. UIUC-BI-93-01, Univ. of Illinois, Urbana-Champaign, 1993; to appear in Ann. Statist.
24. A. B. Nobel, "Histogram regression estimation using data-dependent partitions," Beckman Inst. Tech. Rep. UIUC-BI-94-01, Univ. Illinois, Urbana-Champaign, 1994.
25. A. B. Nobel and R. A. Olshen, "Termination and continuity of greedy growing for tree structured vector quantizers," IEEE Trans. Inform. Theory, to appear.
26. A. B. Nobel, "Recursive partitioning to reduce distortion," Beckman Inst. Tech. Rep. UIUC-BI-95-01, University of Illinois, Urbana-Champaign, 1995.
27. B. Ramamurthi and A. Gersho, "Classified vector quantization of images," IEEE Trans. Commun., vol. COM-34, no. 11, pp. 1105-1115, Nov. 1986.
28. R. D. Wesel and R. M. Gray, "Bayes risk weighted VQ and learning VQ," in Proc. 1994 IEEE Data Compression Conf., J. A. Storer and M. Cohn, Eds., Snowbird, UT, Mar. 1994, pp. 400-409.
29. C. J. Stone, "Consistent nonparametric regression (with discussion)," Ann. Stat., vol. 5, pp. 595-645, 1977.
30. Q. Xie, C. A. Laszlo, and R. K. Ward, "Vector quantization technique for nonparametric classifier design," IEEE Trans. Patt. Anal. Machine Intell., vol. 15, no. 12, pp. 1326-1330, Dec. 1993.
31. K. Popat and R. W. Picard, "Novel cluster-based probability model for texture synthesis, classification, and compression," in Proc. SPIE Visual Commun. Image Processing, Boston, MA, Nov. 1993.
32. _, "Cluster-based probability model applied to image restoration and compression," in Proc. ICASSP, Adelaide, Australia, vol. 5, Apr. 1994, pp. 381-384.
33. B. D. Ripley, "Neural networks and related methods for classification," J. Royal Stat. Soc. B, vol. 56, no. 3, pp. 409-456, 1994.
34. K. L. Oehler, "Image compression and classification using vector quantization," Ph.D. Dissertation, Stanford Univ., Elect. Eng. Dept., Sept. 1993.
35. K. L. Oehler and R. M. Gray, "Combining image classification and image compression using vector quantization," in Proc. 1993 IEEE Data Compression Conf. (DCC), J. A. Storer and M. Cohn, Eds., Snowbird, UT, Mar. 1993, pp. 2-11.
36. R. M. Gray, K. L. Oehler, K. O. Perlmutter, and R. A. Olshen, "Combining tree-structured vector quantization with classification and regression trees," in Proc. 27th Asilomar Conf. Circuits Syst. Comput., Pacific Grove, CA, 1993.
37. K. O. Perlmutter, C. L. Nash, and R. M. Gray, "A comparison of bayes risk weighted vector quantization with posterior estimation with other VQ-based classifiers," in IEEE Int. Conf. Image Processing, Austin, TX, vol. 2, Nov. 1994, pp. 217-221.
38. M. J. Sabin and R. M. Gray, "Global convergence and empirical consistency of the generalized Lloyd algorithm," IEEE Trans. Inform. Theory, vol. IT-32, pp. 148-155, Mar. 1986.
39. M. G. Walker, "Probability estimation for classification trees and sequence analysis," Ph.D. Dissertation, Stanford Univ. Dept. of Medicine Comput. Sci., June 1992.
40. M. G. Walker, R. A. Olshen, and D. A. Bloch, "Probability estimation for classification trees," submitted for publication, 1994.
41. C. Giampaolo, A.T. Gray, R.A. Olshen, and S. Szabo, "Predicting induced duodenal ulcer and adrenal necrosis with classification trees," in Proc. National Acad. Sci., vol. 88, 1991, pp. 6928-6302.
42. T. Kailath, "The divergence and Bhattacharyya distance measures in signal selection," IEEE Trans. Commun. Technol., vol. COM-15, pp. 52-60, Feb. 1967.
43. J. E. Shore and R. M. Gray, "Minimum-cross-entropy pattern classification and cluster analysis," IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-4, pp. 11-17, Jan. 1982.
44. P. A. Chou, "Applications of information theory to pattern recognition and the design of decision trees and trellises," Ph.D. Dissertation, Stanford Univ. Elect. Eng. Dept., June 1988.
45. E. A. Riskin, "Variable rate vector quantization of images," Ph.D. Dissertation, Stanford Univ., 1990.
46. T. Kohonen, J. Kangas, J. Laaksonen, and K. Torkkola, "LVQ_PAK: The learning vector quantization program package, version 2.1," Tech. Rep., Helsinki Univ. of Technol., Lab. of Comput. Inform. Sci., Finland, Oct 1992, Available via anonymous ftp to cochlea.hut.fi (130.233.168.48).
47. P.C. Cosman et al., "Tree-structured vector quantization of CT chest scans: image quality and diagnostic accuracy," IEEE Trans. Medical Imaging, vol. 12, no. 4, pp. 727-739, Dec. 1993.
48. K. O. Perlmutter, "Compression and classification of images using vector quantization and decision trees," Ph.D. Dissertation, Stanford Univ., Elect. Eng. Dept., Dec. 1995.
49. K. O. Perlmutter, R. M. Gray, R. A. Olshen, and S. M. Perlmutter, "Bayes risk weighted vector quantization with CART estimated class posteriors," in Proc. ICASSP, Detroit, MI, May 1995.