Vector Quantization by Deterministic Annealing

IEEE Transactions on Information Theory

Volumn 38, Issue 4, 1992, Pages 1249-1257

  Rose, Kenneth ^a   Gurewitz, Eitan ^b   Fox, Geoffrey C ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Physics Nuclear Research ^*  (United States)

Author keywords

Vector quantization annealing maximum entropy clustering

Indexed keywords

EID: 84899025015     PISSN: 00189448     EISSN: 15579654     Source Type: Journal    
DOI: 10.1109/18.144705     Document Type: Article

References (24)

1. S. P. Lloyd. “Least-squares quantization in PCM,” IEEE Trans. Inform. Theory, vol. IT-28, pp. 129–137, Mar. 1982. (Reprint of the 1957 paper).
2. J. Max, “Quantizing for minimum distortion,” IRE Trans. Inform. Theory, vol. IT-6, pp. 7–12, Mar. 1960.
3. Y. Linde, A. Buzo, and R. M. Gray, “An algorithm for vector quantizer design,” IEEE Trans. Communications, vol. COM-28, pp. 84–95, Jan. 1980.
4. G. Ball and D. Hall, “A clustering technique for summarizing multivariate data,” Behavioral Sci., vol. 12, pp. 153–155, 1967.
5. J. C. Dunn, “A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters,” J. Cybern., vol. 3, pp. 32–57, 1974.
6. J. C. Bezdek, “A convergence theorem for the fuzzy ISODATA clustering algorithms,” IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-2, pp. 1–8, Jan. 1980.
7. S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi, “Optimization by simulated annealing,” Science, vol. 220, pp. 671–680, 1983.
8. N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller, “Equations of state calculations by fast computing machines,” J. Chem. Phys., vol. 21, pp. 1087–1091, 1953.
9. K. Zeger and A. Gersho, “Stochastic relaxation algorithm for improved vector quantizer design,” Electron. Lett., vol. 25, pp. 896–898, 1989.
10. K. Zeger, J. Vaisey, and A. Gersho, “Globally optimal vector quantizer design by stochastic relaxation,” IEEE Trans. Signal Processing, vol. 40, pp. 310–322, Feb. 1992.
11. S. Geman and D. Geman, “Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images,” IEEE Trans. Pattern Anal. Machine Intell:, vol. 6, 721–741, Nov. 1984.
12. B. Hajek, “A tutorial survey of theory and applications of simulated annealing,” in 24th IEEE Conf. Decision Contr., 1985, pp. 755–760.
13. R. Durbin, R. Szeliski, and A. Yuille, “An analysis of the elastic net approach to the travelling salesman problem,” Neural Computat., vol. 1, pp. 348–358, 1989.
14. P. D. Simic, “Statistical mechanics as the underlying theory of elastic and neural optimization,” Network, vol. 1, pp. 89–103, 1990.
15. K. Rose, E. Gurewitz, and G. C. Fox, “A deterministic annealing approach to clustering,” Pattern Recognition Lett., vol. 11, pp. 589–594, 1990.
16. K. Rose, E. Gurewitz, and G. C. Fox, “Statistical mechanics and phase transitions in clustering,” Physical Rev. Lett., vol. 65, pp. 945–948, 1990.
17. E. Yair, K. Zeger, and A. Gersho, “Competitive learning and soft competition for vector quantizer design,” IEEE Trans. Signal Processing, vol. 40, pp. 294–309, Feb. 1992.
18. T. Kohonen, Self Organization and Associative Memory. Berlin: Springer-Verlag, 1984.
19. P.C. Chang and R. M. Gray, “Gradient algorithms for designing predictive vector quantizers,” IEEE Trans. Acoust., Speech, and Signal Processing, vol. ASSP-34, pp. 679–690, Aug. 1986.
20. E. T. Jaynes, “Information theory and statistical mechanics,” in Papers on Probability, Statistics and Statistical Physics, R. D. Rosenkrantz, Ed. Dordrecht, The Netherlands: Kluwer Academic Publishers, 1989.
21. C. Shannon and W. Weaver, The Mathematical Theory of Communication. Urbana, III.: Univ. of Illinois Press, 1949.
22. S. Kullback, Information Theory and Statistics. New York, NY: Dover, 1969.
23. J. E. Shore and R. W. Johnson, “Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy,” IEEE Tran. Inform. Theory, vol. IT-26, pp. 26–37, Jan. 1980.
24. K. Rose, E. Gurewitz, and G. C. Fox, “Constrained clustering as an optimization method,” IEEE Trans. Pattern Anal. machine Intell., 1992, to appear.