Local matrix adaptation in topographic neural maps

Neurocomputing

Volumn 74, Issue 4, 2011, Pages 522-539

  Arnonkijpanich, Banchar ^a   Hasenfuss, Alexander ^b   Hammer, Barbara ^c  

^a Khon Kaen University   (Thailand)

^b CLAUSTHAL UNIVERSITY OF TECHNOLOGY   (Germany)

^c BIELEFELD UNIVERSITY   (Germany)

Author keywords

Convergence; Matrix learning; Metric adaptation; Neural gas; Topographic maps

Indexed keywords

CONVERGENCE; MATRIX; METRIC ADAPTATION; NEURAL GAS; TOPOGRAPHIC MAP;

BENCHMARKING; CLUSTER ANALYSIS; CONFORMAL MAPPING; CONVERGENCE OF NUMERICAL METHODS; COST FUNCTIONS; COSTS; IMAGE COMPRESSION; LEARNING ALGORITHMS; MAPS; MATRIX ALGEBRA; OPTIMIZATION; PRINCIPAL COMPONENT ANALYSIS;

CLUSTERING ALGORITHMS;

ALGORITHM; ARTICLE; AUDIOVISUAL EQUIPMENT; CLUSTER ANALYSIS; MACHINE LEARNING; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; TOPOGRAPHY;

EID: 78650239815     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.08.016     Document Type: Article

References (49)

1. C. Ambroise, G. Govaert, Analyzing dissimilarity matrices using Kohonen maps, in: Proceeding of IFCS96, vol. 1, 1996, pp. 425-430.
2. B. Arnonkijpanich, C. Lursinsap, Adaptive second order self-organizing mapping for 2D pattern representation, in: International Joint Conference on Neural Networks 2004, 2004, pp. 775-780.
3. A. Asuncion, D.J. Newman, UCI Machine Learning Repository [〈〉], Irvine, CA, University of California, School of Information and Computer Science, 2007. http://www.ics.uci.edu/~mlearn/MLRepository.html.
4. Bottou L., Bengio Y. Convergence properties of the k-means algorithm. Neural Information Processing Systems 1994 1995, 585-592. MIT Press. G. Tesauro, D.S. Touretzky, T.K. Leen (Eds.).
5. Bouveyron C., Girard S., Schmid C. High-dimensional data clustering. Computational Statistics & Data Analysis 2007, 52(1):502-519.
6. Cottrell M., Fort J.C., Pagès G. Theoretical aspects of the SOM algorithm. Neurocomputing 1999, 21:119-138.
7. G. Cottrell, P. Munro, D. Zipser, Learning internal representations from grey-scale images: an example of extensional programming, in: Ninth Annual Conference of the Cognitive Science Society, Hillsdale Erlbaum, 1987, pp. 462-473.
8. Cottrell M., Hammer B., Hasenfuss A., Villmann T. Batch and median neural gas. Neural Networks 2006, 19:762-771.
9. Y. Feng, G. Hamerly, Pg-means: learning the number of clusters in data, in: NIPS, 2006, pp. 393-400.
10. J.-C. Fort, P. Letrémy, M. Cottrell, Advantages and drawbacks of the Batch Kohonen algorithm, in: M. Verleysen (Ed.), European Symposium on Artificial Neural Networks'2002, D Facto, 2002, pp. 223-230.
11. Geszti T. Physical Models of Neural Networks 1990, World Scientific.
12. Graepel T., Burger M., Obermayer K. Self-organizing maps: generalizations and new optimization techniques. Neurocomputing 1998, 21:173-190.
13. Hammer B., Hasenfuss A. Relational neural gas. Künstliche Intelligenz 2007 2007, 190-204. Springer. J. Hertzberg (Ed.).
14. G. Hamerly, C. Elkan, Learning the k in k-means, in: NIPS, 2003, pp. 281-288.
15. Hartigan J.A. Clustering Algorithms 1975, Wiley.
16. Heskes T. Self-organizing maps, vector quantization, and mixture modeling. IEEE Transactions on Neural Networks 2001, 12:1299-1305.
17. Heskes T., Kappen B. Error potentials for self-organization. International Conference on Neural Networks 1993, vol. 3:1219-1223. San Francisco, IEEE, New York.
18. Höppner F., Klawonn F., Kruse R., Runkler T. Fuzzy Cluster Analysis 1999, Wiley.
19. Kambhatla A., Leen T.K. Dimension reduction by local principal component analysis. Neural Computation 1997, 9(7):1493-1516.
20. Kohonen T. Self-Organizing Maps 1995, Springer.
21. Kohonen T. Self-organizing maps: optimization approaches. Artificial Neural Networks 1991, 981-990. North-Holland, Amsterdam. T. Kohonen (Ed.).
22. Kohonen T., Kaski S., Lappalainen H. Self-organized formation of various invariant-feature filters in the adaptive-subspace SOM. Neural Computation 1997, 9(6):1321-1344.
23. Kohonen T., Somervuo P. Self-organizing maps of symbol strings. Neurocomputing 1998, 21(1-3):19-30.
24. K. Krishna, K.R. Ramakrishnan, M.A.L. Thathachar, Vector quantization using genetic K-means algorithm for image compression, in: International Conference on Information, Communications and Signal Processing, vol. 3, 1997, pp. 1585-1587.
25. Liu Z.-Y., Xu L. Topological local principal component analysis. Neurocomputing 2003, 55:739-745.
26. López-Rubio E., Muñoz-Pérez J., Gómez-Ruiz J.A. A principal components analysis self-organizing map. Neural Networks 2004, 17(2):261-270.
27. Luttrell S. Self-organisation: a derivation from first principles of a class of learning algorithms. International Joint Conference on Neural Networks 1989, vol. 2:495-498. IEEE Computer Society Press.
28. L.J.P. van der Maaten, E.O. Postma, H.J. van den Herik, Matlab Toolbox for Dimensionality Reduction, MICC, Maastricht University, [〈〉], 2007. http://www.cs.unimaas.nl/l.vandermaaten/Laurens_van_der_Maaten/Matlab_Toolbox_for_Dimensionality_Reduction.html.
29. T. Martinetz, Selbstorganisierende neuronale Netzwerkmodelle zur Bewegungssteuerung, Sankt Augustin, 1992, Dissertationen zur künstlichen Intelligenz, 1992.
30. Martinetz T., Berkovich S., Schulten K. 'Neural gas' network for vector quantization and its application to time series prediction. IEEE Transactions on Neural networks 1993, 4(4):558-569.
31. Martinetz T., Schulten K.J. Topology representing networks. Neural Networks 1994, 7:507-522.
32. Mochihashi D., Kikui G., Kita K. Learning an optimal distance metric in a linguistic vector space. Systems and Computers in Japan 2006, 37(9):12-21.
33. Möller R., Hoffmann H. An extension of neural gas to local PCA. Neurocomputing 2004, 62:305-326.
34. Möller R., Könies A. Coupled principal component analysis. IEEE Transactions on Neural Networks 2004, 15(1):214-222.
35. Peltonen J., Klami A., Kaski S. Improved learning of Riemannian metrics for exploratory analysis. Neural Networks 2004, 17:1087-1100.
36. Rose K. Deterministic annealing for clustering, compression, classification, regression, and related optimization problems. Proceedings of the IEEE 1998, 86(11):2210-2239.
37. Sanger T.D. Optimal unsupervised learning in a single-layer linear feedforward neural network. Neural Networks 1989, 2(6):459-473.
38. Seo S., Obermayer K. Self organizing maps and clustering for matrix data. Neural Networks 2004, 17(8-9):1211-1229.
39. Schleif F.-M., Villmann Th., Hammer B. Prototype based fuzzy classification in clinical proteomics. International Journal of Approximate Reasoning 2008, 47(1):4-16.
40. P. Schneider, M. Biehl, B. Hammer, Relevance matrices in LVQ, in: M. Verleysen (Ed.), European Symposium on Neural Networks 2007, 2007, pp. 37-42.
41. L.Z. Stones, Y. Zhang, C.L. Jian, Growing hierarchical principal components analysis self-organizing map, in: Advances in Neural Networks-ISNN 2006, Lecture Notes in Computer Science, vol. 3971, Springer, 2006, pp. 701-706.
42. Teboulle M. A unified continuous optimization framework for center-based clustering methods. Journal of Machine Learning Research 2007, 8:65-102.
43. Tipping M.E., Bishop C.M. Mixtures of probabilistic principal component analyzers. Neural Computation 1999, 11:443-482.
44. Tolat V. An analysis of Kohonens self-organizing maps using a system of energy functions. Biological Cybernetics 1990, 64:155-164.
45. Villmann T., Der R., Herrmann M., Martinetz T. Topology preservation in self-organizing feature maps: exact definition and measurement. IEEE Transactions on Neural Networks 1997, 8(2):256-266.
46. Wang Y., Freedman M.I., Kung S.-K. Probabilistic principal component subspaces: a hierarchical finite mixture model for data visualization. IEEE Transactions on Neural Networks 2000, 11(3):625-636.
47. Xu R., Wunsch D. Survey of clustering algorithms. IEEE Transactions on Neural Networks 2005, 16(3):645-678.
48. Yin H., Allinson N.M. Self-organizing mixture networks for probability density estimation. IEEE Transactions on Neural Networks 2001, 12(2):405-411.
49. Zhong S., Ghosh J. A unified framework for model-based clustering. Journal of Machine Learning Research 2003, 4:1001-1037.