Convergence properties of a class of learning vector quantization algorithms

IEEE Transactions on Image Processing

Volumn 5, Issue 2, 1996, Pages 361-368

  Kosmatopoulos, Elias B ^a,b   Christodoulou, Manolis A ^a,c  

^a IEEE

^b UNIVERSITY OF VICTORIA   (Canada)

^c TECHNICAL UNIVERSITY OF CRETE   (Greece)

Author keywords

[No Author keywords available]

Indexed keywords

DIFFERENCE EQUATIONS; MATHEMATICAL TRANSFORMATIONS; NUMERICAL ANALYSIS; RANDOM PROCESSES; VECTOR QUANTIZATION;

CONVERGENCE; LEARNING VECTOR QUANTIZATION ALGORITHMS; LINEAR TIME VARYING STOCHASTIC DIFFERENCE EQUATIONS; MATHEMATICAL ANALYSIS; STOCHASTIC LYAPUNOV STABILITY; TIME COORDINATE TRANSFORMATION;

LEARNING ALGORITHMS;

EID: 0030085873     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/83.480771     Document Type: Article

References (24)

1. G. H. Ball and D. J. Hall, "A clustering technique for summarizing multivariate data," Behavioral Sci., vol. 12, pp. 153-155, Mar. 1967.
2. J. S. Baras and A. La Vigna, "Convergence of Kohonen's learning vector quantization," in Proc. Int. Conf. Neural Networks, vol. 3, pp. 17-20, 1992.
3. H. F. Chen, Recursive Estimation and Control of Stochastic Systems. New York: Wiley, 1985.
4. D. M. Clark and K. Ravishankar, "A convergence theorem for Grossberg learning," Neural Networks, vol. 3, pp. 87-92, 1990.
5. M. Cotrell and J. C. Fort, "A stochastic model of retinotopy: A self organizing process," Biological Cybern., vol. 53, pp. 405-411, 1986.
6. G. C. Goodwin and K. S. Sin, Adaptive Filtering, Prediction, and Control. Englewood Cliffs, NJ: Prentice Hall, 1984.
7. R. M. Gray, "Vector quantization," IEEE Acoust., Speech, Signal Processing Mag., vol. 1, no. 2, pp. 4-29, 1984.
8. T. Kohonen, Self-Organization and Associative Memory, (2nd ed.). New-York: Springer Verlag, 1988.
9. H. J. Kushner and D. S. Clark, Stochastic Approximation Methods for Constrained and Unconstrained Systems. New York: Springer-Verlag, 1978.
10. A. La Vigna, "Nonparametric classification using learning VQ," Ph.D. Dissertation, Dept. Elect. Eng., Univ. of Maryland, College Park, 1989.
11. M. Lemmon, "Topologically ordered competitive sampling," Neural Networks, vol. 7, no. 1, pp. 101-112, 1994.
12. M. Lemmon and B. V. K. Vijaya Kumar, "Competitive learning with generalized winner-take-all activation," IEEE Trans. Neural Networks, vol. 3, no. 2, pp. 167-175, Mar. 1992.
13. Y. Linde, A. Buzo, and R.M. Gray, "An algorithm for vector quantizer design," IEEE Trans. Commun., vol. COM-28, pp. 84-95, Jan. 1980.
14. Z.-P. Lo, Y. Yu, and B. Bavarian, "Analysis of the convergence properties of topology preserving neural networks," IEEE Trans. Neural Networks, vol. 4, no. 3, pp. 207-220, Mar. 1993.
15. G. Lugosi and A. B. Nobel, "Consistency of data-driven histogram methods for density estimation and classification," Beckman Inst. Tech. Rep. (UIUC)-(BI)-93-01, Univ. of Illinois, 1993.
16. S. P. Luttrell, "Derivation of a class of training algorithms," IEEE Trans. Neural Networks, vol. 1, no. 2, pp. 229-232, June 1990.
17. J. MacQueen, "Some methods for classification and analysis of multivariate observations," in Proc. Fifth Berkeley Symp. Math. Stat. Prob., vol. 1, 1967, pp. 281-297.
18. T. M. Martinez, S. G. Berkovich, and K. J. Schulten, "Neural-gas network for vector quantization and its application to time-series prediction," IEEE Trans. Neural Networks, vol. 4, no. 4, pp. 558-569, July 1993.
19. N. R. Pal, J. C. Bezdek, and E. C.-K. Tsao, "Generalized clustering networks and Kohonen's self-organizing scheme," IEEE Trans. Neural Networks, vol. 4, no. 4, pp. 549-557, July 1993.
20. H. Ritter and K. J. Schulten, "Convergence properties of Kohonen's topology conserving mappings: Fluctuations, stability, and dimension selection," Biolog. Cybern., vol. 60, pp. 59-71, 1989.
21. H. Robbins and S. Monro, "A stochastic approximation method," Ann. Math. Stat., vol. 22, pp. 400-407, 1951.
22. W. Rudin, Real and Complex Analysis, 3rd ed. New York: McGraw-Hill, 1987.
23. M. J. Sabin and R. M. Gray, "Global convergence and empirical consistency of the generalized Lloyd algorithm," IEEE Trans. Inform. Theory, vol. IT-32, no. 2, pp. 148-155, Mar. 1986.
24. C. J. Stone, "Consistent nonparametric regression," Ann. Stat., vol. 5, no. 4, pp. 596-645, 1977.