A Generalized Lloyd-Type Algorithm for Adaptive Transform Coder Design

IEEE Transactions on Signal Processing

Volumn 52, Issue 1, 2004, Pages 255-264

  Archer, Cynthia ^a   Leen, Todd K ^b  

^a RTI INTERNATIONAL   (United States)

^b OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

Author keywords

Adaptive transform coding; Compression; Entropy constrained quantization; Expectation maximization; Gaussian mixtures; Generalized Lloyd algorithms

Indexed keywords

ALGORITHMS; CODE CONVERTERS; DATABASE SYSTEMS; MATHEMATICAL MODELS; PROBABILITY; RADAR IMAGING; SIGNAL TO NOISE RATIO; SYNTHETIC APERTURE RADAR; VECTORS;

ADAPTIVE TRANSFORM CODING; ENTROPY-CONSTRAINED QUANTIZATION; EXPECTATION-MINIMIZATION; GAUSSIAN MIXTURES; GENERALIZED LLYOD ALGORITHMS; QUANTIZERS;

SIGNAL PROCESSING;

EID: 0347603363     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2003.819980     Document Type: Article

References (22)

1. S. Lloyd, "Least square optimization in PCM," IEEE Trans. Inform. Theory, vol. IT-28, pp. 129-137, Apr. 1982.
2. N. Farvardin and J. Modestino, "Optimum quantizer performance for a class of non-Gaussian memoryless sources," IEEE Trans. Inform. Theory, vol. IT-30, pp. 485-497, June 1984.
3. G. Wallace, "Overview of JPEG (ISO/CCITT) still image compression standard," Commun. ACM, vol. 4, no. 4, pp. 30-40, 1991.
4. R. Dony and S. Haykin, "Optimally adaptive transform coding," IEEE Trans. Image Processing, vol. 4, pp. 1358-1370, Oct. 1995.
5. M. Effros, P. Chou, and R. Gray, "Weighted universal image compression," IEEE Trans. Image Processing, vol. 8, pp. 1317-1328, Oct. 1999.
6. M. Tipping and C. Bishop, "Mixture of probabilistic principal component analyzers," Neural Comput., vol. 11, no. 2, pp. 443-483, 1999.
7. C. Archer and T. Leen, "Optimal dimension reduction and transform coding with mixture principal components," in Proc. Int. Joint Conf. Neural Networks, July 1999.
8. J. MacQueen, "Some methods for classification and analysis of multi-variate observations," in Proc. 5th Berkeley Symp. Math. Stat. Prob., vol. 3, 1967, p. 281.
9. N. Kambhatla and T. K. Leen, "Optimal dimension reduction by local PCA," Neural Comput., vol. 9, no. 7, pp. 1493-1516, 1997.
10. Y. Linde, A. Buzo, and R. Gray, "An algorithm for vector quantizer design," IEEE Trans. Commun., vol. COM-28, pp. 84-95, Jan. 1980.
11. P. Chou, T. Lookabaugh, and R. Gray, "Entropy-constrained vector quantization," IEEE Trans. Acoust., Speech, Signal Processing, vol. 37, pp. 31-41, Jan. 1989.
12. S. Nowlan, "Soft competitive adaptation: Neural network learning algorithms based on fitting statistical mixtures," Ph.D. dissertation. School of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, 1991.
13. A. Dempster, N. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Stat. Soc. B, vol. 39, pp. 1-38, 1977.
14. S. Roweis and Z. Ghahramani, "A unifying review of linear Gaussian models," Neural Comput., vol. 11, no. 2, pp. 306-345, 1999.
15. R. Neal and G. Hinton, "A View of the EM algorithm that justifies incremental, sparse, and other variants," in Learning in Graphical Models, M. Jordan, Ed. Boston, MA: Kluwer, 1998.
16. C. Archer and T. Leen, "From mixtures of mixtures to adaptive transform coding," in Advances in Neural Information Processing Systems 13, T. Leen, T. Dietterich, and T. Tresp, Eds. Cambridge, MA: MIT Press, 2001.
17. G. Golub and C. V. Loan, Matrix Computations. Baltimore, MD: John Hopkins Univ. Press, 1989.
18. C. Archer and T. Leen, "The coding-optimal transform," in Proc. IEEE Comput. Soc. Data Compression Conf., Mar. 2001.
19. V. Goyal, J. Zhuang, and M. Vetterli, "Transform coding with backward adaptive updates," IEEE Trans. Inform. Theory, vol. 46, pp. 1623-1633, July 2000.
20. R. Gray and D. Neuhoff, "Quantization," IEEE Trans. Inform. Theory, vol. 44, pp. 2325-2383, Nov. 1998.
21. What is Imaging RADAR?, T. Freeman. (1996, Jan.). http://south-port.jpl.nasa.gov/desc/imagingradarv3.html [Online]
22. SIR-C/X-SAR Images of Earth, Jet Propulsion Labs.. [Online], Available: http://www.jpl.nasa.gov/radar/sircxsar