Lloyd clustering of Gauss mixture models for image compression and classification

Signal Processing: Image Communication

Volumn 20, Issue 5, 2005, Pages 459-485

  Aiyer, Anuradha ^a   Pyun, Kyungsuk ^b   Huang, Ying Zong ^c   O'Brien, Deirdre B ^a   Gray, Robert M ^a  

^a Stanford University   (United States)

^b HEWLETT PACKARD COMPANY   (United States)

^c USA   (United States)

Author keywords

Clustering; Compression; Gauss mixture; Quantization; Segmentation; Statistical classification

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; CLASSIFICATION (OF INFORMATION); IMAGE SEGMENTATION; MATHEMATICAL MODELS; SIGNAL DISTORTION; STATISTICAL METHODS;

EXPECTATION-MAXIMIZATION (EM) ALGORITHM; GAUSS MIXTURE MODELS; LLOYD CLUSTERING; STATISTICAL CLASSIFICATION;

VECTOR QUANTIZATION;

EID: 18444363930     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.image.2005.03.003     Document Type: Article

References (72)

1. A.K. Aiyer, Robust image compression using Gauss mixture models, Ph.D. Thesis, Stanford University, 2001.
2. H. Akaike, Information theory and an extension of the maximum likelihood principle, in: Proceedings IEEE International Symposium Information Theory, 1973, pp. 267-281.
3. J.D. Banfield, and A.E. Raftery Model-based Gaussian and non-Gaussian clustering Biometrics 49 1993 803 821
4. S. Belongie, C. Carson, H. Greenspan, and J. Malik Color- and texture-based image segmentation using em and its application to content-based image retrieval Proceedings of International Conference on Computer Vision 1998 Bombay India 675 682
5. P. Brodatz Textures: Photographic Album for Artists & Designers 1966 Dover New York
6. J.A. Bucklew, and G.L. Wise Multidimensional asymptotic quantization theory with r th power distortion measures IEEE Trans. Inform. Theory 28 March 1982 239 247
7. T. Chang, and C.-C.J. Kuo Texture analysis and classification with tree-structured wavelet transform IEEE Trans. Image Process. 2 4 October 1993 429 441
8. R. Chellappa, and S. Chatterjee Classification of textures using Gaussian-Markov random fields IEEE Trans. Acoust. Speech Signal Process. 33 August 1985 959 969
9. P.C. Chen, and T. Pavlidis Segmentation by texture using correlation IEEE Trans. Pattern Anal. Machine Intell. 5 January 1983 695 707
10. P.A. Chou, T. Lookabaugh, and R.M. Gray Entropy-constrained vector quantization IEEE Trans. Acoust. Speech Signal Process. 37 January 1989 31 42
11. P.A. Chou, T. Lookabaugh, and R.M. Gray Optimal pruning with applications to tree-structured source coding and modeling IEEE Trans. Inform. Theory 35 2 March 1989 299 315
12. T.M. Cover, and J.A. Thomas Elements of Information Theory 1991 Wiley New York, NY
13. N.M.B. de Pinho Cruzde Vasconcelos, Bayesian models for visual information retrieval, Ph.D. Thesis, Massachusetts Institute of Technology, 2000.
14. A.P. Dempster, N.M. Laird, and D.B. Rubin Maximum likelihood from incomplete data via the EM algorithm J. Roy. Statist. Soc. 39 1 1977 1 21
15. R.O. Duda, and P.E. Hart Pattern Classification and Scene Analysis 1973 Wiley New York
16. B.S. Everitt A finite mixture model for the clustering of mixed-mode data Statist. Probab. Lett. 6 5 1988 305 309
17. B.S. Everitt, and D.J. Hand Finite Mixture Distributions 1981 Chapman & Hall London
18. O.D. Faugeras, and W.K. Pratt Decorrelation methods of texture feature extraction IEEE Trans. Pattern Anal. Machine Intell. 2 July 1980 323 332
19. M. Figueiredo, A.K. Jain, Unsupervised learning of finite mixture models, IEEE Trans. Pattern Anal. Mach. Intell. 2000.
20. C. Fraley Algorithms for model-based gaussian hierarchical clustering SIAM J. Sci. Comput. 20 1 1998 270 281
21. J.F. Friedman Regularized discriminant analysis J. Amer. Statist. Assoc. 84 1989 17 42
22. J. Friedman Greedy function approximation: a gradient boosting machine Ann. Statist. 39 5 2001
23. A. Gersho Asymptotically optimal block quantization IEEE Trans. Inform. Theory 25 July 1979 373 380
24. A. Gersho, and R.M. Gray Vector Quantization and Signal Compression 1992 Kluwer Academic Publishers Boston
25. S. Graf, and H. Luschgy Foundations of Quantization for Probability Distributions 2000 Springer Berlin
26. R.M. Gray, Gauss mixture vector quantization, Proceedings 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), vol. 3, Salt Lake City, May 2001, pp. 1769-1772.
27. R.M. Gray, A. Buzo, A.H. Gray Jr., and Y. Matsuyama Distortion measures for speech processing IEEE Trans. Acoust. Speech Signal Process. ASSP-28 August 1980 367 376
28. R.M. Gray Jr., A.H. Gray, G. Rebolledo, and J.E. Shore Rate distortion speech coding with a minimum discrimination information distortion measure IEEE Trans. Inform. Theory 27 6 November 1981 708 721
29. R.M. Gray, and T. Linder Mismatch in high rate entropy constrained vector quantization IEEE Trans. Inform. Theory 49 May 2003 1204 1217
30. R.M. Gray, T. Linder, and J. Li A Lagrangian formulation of zador's entropy-constrained quantization theorem IEEE Trans. Inform. Theory 48 3 March 2002 695 707
31. R.M. Gray, and D.L. Neuhoff Quantization IEEE Trans. Inform. Theory 44 6 October 1998 2325 2383
32. R.M. Gray, J.C. Young, A.K. Aiyer, Minimum discrimination information clustering: modeling and quantization with gauss mixtures, in: Proceedings 2001 IEEE International Conference on Image Processing, vol. 2, Thessaloniki, Greece, October 2001, pp. 14-17.
33. G.M. Haley, and B.S. Manjunath Rotation-invariant texture classification using a complete space-frequency model IEEE Trans. Image Process. 8 2 1999 255 269
34. R.M. Haralick Statistical and structural approaches to texture Proc. IEEE 67 May 1979 786 804
35. T. Hastie, and R. Tibshirani Discriminant analysis by Gaussian mixtures J. Roy. Statist. Soc. B 58 1996 155 176
36. T. Hastie, R. Tibshirani, and J. Friedman The Elements of Statistical Learning 2001 Springer New York
37. P. Hedelin, and J. Skoglund Vector quantization based on Gaussian mixture models IEEE Trans. Speech Audio Process. 8 4 July 2000 385 401
38. F. Itakura, and S. Saito A statistical method for estimation of speech spectral density and formant frequencies Electron. Comm. Japan 53-A 1970 36 43
39. A.K. Jain, and J.V.Moreau. Bootstrap technique in cluster analysis Pattern Recognition 20 5 1987 547 568
40. A. Jain, and A. Vailaya Image retrieval using color and shape Pattern Recognition J. 29 August 1996 1233 1244
41. T. Kohonen An introduction to neural computing Neural Networks 1 1988 3 16
42. S. Kullback, Information Theory and Statistics, Dover, New York, 1968, Reprint of 1959 edition published by Wiley.
43. J. Li, A. Najmi, and R.M. Gray Image classification by a two dimensional hidden Markov model IEEE Trans. Signal Process. 48 February 2000 517 533
44. X.Q. Li, I. King, Gaussian mixture distance for information retrieval, in: Proceedings International Conference on Neural Networks, vol. 4, Washington, DC, July 1999, pp. 2544-2549.
45. H. Lev-Ari, S.R. Parker, and T. Kailath Multidimensional maximum-entropy covariance extension IEEE Trans. Inform. Theory 35 May 1989 497 508
46. Y. Linde, A. Buzo, and R.M. Gray An algorithm for vector quantizer design IEEE Trans. Comm. 28 1980 84 95
47. S.P. Lloyd, Least squares quantization in PCM, IEEE Trans. Inform. Theory (1957). Bell Laboratories Technical Note, Reprinted in IEEE Trans. Inform. Theory 28 (March 1982) 127-135.
48. S.P. Lloyd, Least squares quantization in PCM, IEEE Trans. Inform. Theory (1957). Bell Laboratories Technical Note, Reprinted in IEEE Trans. Inform. Theory 28 (March 1982) 127-135.
49. J. MacQueen, Some methods for classification and analysis of multivariate observations, in: Proceedings of the Fifth Berkeley Symposium on Mathematics, Statistics and Probability, vol. 1, 1967, pp. 281-296.
50. G.J. McLachlan, and K.E. Basford Mixture Models: Inference and Applications to Clustering 1988 Marcel Dekker Inc. New York
51. G.F. McLean Vector quantization for texture classification IEEE Trans. Systems Man Cybernet. 23 3 May/June 1993
52. D.B. O'Brien, M. Gupta, R.M. Gray, J.K. Hagene, Automatic Classification of Images from Internal Optical Insepection of Gas Pipelines, ICPIIT VIII Conference 2003, Houston.
53. D.B. O'Brien, M. Gupta, R.M. Gray, J.K. Hagene, Analysis and classification of internal pipeline images, Proceedings of ICIP 2003, Barcelona, Spain.
54. K.L. Oehler, and R.M. Gray Combining image compression and classification using vector quantization IEEE Trans. Pattern Anal. Mach. Intell. 17 May 1995 461 473
55. K.O. Perlmutter, C.L. Nash, R.M. Gray, A comparison of Bayes risk weighted vector quantization with posterior estimation with other VQ-based classifiers, in: Proceedings of International Conference on Image Processing, vol. 2, Austin, TX, 1994, pp. 217-221.
56. K. Pyun, Classification and segmentation of images using hidden Markov gauss mixture Models, Ph.D. Dissertation, Department of Electrical Engineering, Stanford University, June 2003.
57. K. Pyun, C.S. Won, J. Lim, R.M. Gray, Texture classification based on multiple Gauss mixture vector quantizers, Multimedia and Expo, 2002, 2002, pp. 501-504.
58. B. Ramamurthi, and A. Gersho Classified vector quantization of images IEEE Trans. Commu. Technol. COM-34 11 November 1986 1105 1115
59. R.A. Redner, and H.F. Walker Mixture densities, maximum likelihood and the em algorithm SIAM Rev. 26 2 1984 195 239
60. Y. Rui, T. Huang, and S.-F. Chang Image retrieval: current techniques, promising directions and open issues J. Visual Commu. Image Represent. 10 March 1999 39 62
61. D.J. Sakrison Worst sources and robust codes for difference distortion measures IEEE Trans. Inform. Theory 21 May 1975 301 309
62. G. Schwarz Estimating the dimension of a model Ann. Statist. 6 2 1978 461 464
63. C.E. Shannon, Coding theorems for a discrete source with a fidelity criterion, IRE National Convention Record, Part 4, 1959, pp. 142-163.
64. J.E. Shore, D.K. Burton, Discrete utterance speech recognition without time alignment, in: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, May 1982, p. 907.
65. J. Smith, S. Chang, Visualseek: a fully automated content-based image query system, ACM Multimedia (1996) 87-98.
66. J.R. Smith, S.F. Chang, Tools and techniques for color image retrieval, in: IST/SPIE - Storage Retrieval for Image and Video Databases, vol. 2670, San Jose, CA, February 1996, pp. 426-437.
67. M. Stone Cross-validation Math. Operationsforsch. Statist. Ser. Statist. 9 1 1978 127 139
68. N. Vasconcelos, Bayesian models for visual information retrieval, Ph.D. dissertation, Massachusetts Institute of Technology, Programs in Media Arts and Science, 2000.
69. A. Weber, Image database, USCIPI Report 1070, Image Processing Institute, March 1983.
70. J.C. Young, Clustered gauss mixture models for image retrieval, Ph.D. Dissertation, Stanford University, Electrical Engineering Department, April 2003.
71. P.L. Zador, Topics in the asymptotic quantization of continuous random variables, 1966, Unpublished Bell Laboratories Memorandum.
72. X. Zhuang, Y. Huang, K. Palaniappan, and Y. Zhao Gaussian mixture density modeling decomposition and applications IEEE Trans. Image Process. 5 9 September 1996 1293 1301