Learning dynamics and robustness of vector quantization and neural gas

Neurocomputing

Volumn 71, Issue 7-9, 2008, Pages 1210-1219

  Witoelar, Aree ^a   Biehl, Michael ^a   Ghosh, Anarta ^b   Hammer, Barbara ^c  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

^b UNIVERSITY OF WASHINGTON   (United States)

^c CLAUSTHAL UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Clustering; Neural gas; Online learning; Vector quantization; Winner takes all algorithms

Indexed keywords

ASYMPTOTIC ANALYSIS; CLUSTERING ALGORITHMS; E-LEARNING; NUMERICAL ANALYSIS; ONLINE SYSTEMS; ROBUSTNESS (CONTROL SYSTEMS); VECTOR QUANTIZATION;

MATHEMATICAL ANALYSIS; ONLINE LEARNING; WINNER-TAKES-ALL ALGORITHM;

LEARNING ALGORITHMS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; CLUSTER ANALYSIS; CONCEPTUAL FRAMEWORK; CONTROLLED STUDY; INTERMETHOD COMPARISON; LEARNING ALGORITHM; LEARNING THEORY; MATHEMATICAL COMPUTING; NORMAL DISTRIBUTION; ONLINE SYSTEM; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS; SUPPORT VECTOR MACHINE; SYSTEM ANALYSIS; SYSTEMATIC ERROR;

EID: 40649121456     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2007.11.022     Document Type: Article

References (16)

1. Bezdek J.C. Pattern Recognition with Fuzzy Objective Function Algorithms (1981), Plenum Press, New York
2. Bibliography on the Self Organising Map (SOM) and Learning Vector Quantization (LVQ), Neural Networks Research Centre, Helsinki University of Technology, 2002.
3. M. Biehl, A. Freking, A. Ghosh, G. Reents, A theoretical framework for analysing the dynamics of LVQ, Technical Report, Technical Report 2004-09-02, Mathematics and Computing Science, University Groningen, P.O. Box 800, 9700 AV Groningen, The Netherlands, December 2004, available from 〈 www.cs.rug.nl/∼biehl〉.
4. Biehl M., Freking A., and Reents G. Dyn. On-line Competitive Learn. Europhys. Lett. 38 (1996) 73-78
5. Biehl M., Ghosh A., and Hammer B. Learning Vector Quantization: The Dynamics of Winner-Takes-All Algorithms. Neurocomputing 69 (2006) 660-670
6. Biehl M., Ghosh A., and Hammer B. Dynamics and generalization ability of LVQ algorithms. J. Mach. Learn. Res. 8 (2007) 323-360
7. Buhmann J. Stochastic Algorithms for Exploratory Data Analysis: Data Clustering and Data Visualization. In: Jordan M. (Ed). Learning in Graphical Models (1997), Kluwer Academic Publishers, Dordrecht
8. Engel A., and van Broeck C. The Statistical Mechanics of Learning (2001), Cambridge University Press, Cambridge
9. Gersho A., and Gray R.M. Vector Quantization and Signal Compression (1992), Kluwer Academic Press, Dordrecht
10. Ghosh A., Biehl M., and Hammer B. Performance analysis of LVQ algorithms: a statistical physics approach. Neural Networks 19 (2006) 817-829 (special issue on Advances in Self-Organizing Maps)
11. Kohonen T. Self Organising Maps (2001), Springer, Berlin
12. Martinetz T., Berkovich S., and Schulten K. 'Neural Gas' network for vector quantization and its application to time series prediction. IEEE Trans. Neural Networks 4 4 (1993) 558-569
13. Murty M.N., Jain A.K., and Flynn P.J. Data clustering: a review. ACM Comput. Surveys 31 (1999) 264-323
14. Reents G., and Urbanczik R. Self Averaging and On-line Learning. Phys. Rev. Lett. 80 (1998) 5445-5448
15. Watkin T.L.H., Rau A., and Biehl M. The statistical mechanics of learning a rule. Rev. Mod. Phys. 65 (1993) 499-556
16. Witoelar A., Biehl M., Ghosh A., and Hammer B. On the Dynamics of Vector Quantization and Neural Gas. In: Verleysen M. (Ed). European Symposium on Artificial Neural Networks, ESANN '07, d-side (2007), Evere, Belgium 127-132