Patch clustering for massive data sets

Neurocomputing

Volumn 72, Issue 7-9, 2009, Pages 1455-1469

  Alex, Nikolai ^a   Hasenfuss, Alexander ^b   Hammer, Barbara ^b  

^a OSTFALIA UNIVERSITY OF APPLIED SCIENCES   (Germany)

^b CLAUSTHAL UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Clustering streaming data; Neural gas; Parallelization

Indexed keywords

BATCH OPTIMIZATIONS; CLUSTERING STREAMING DATA; DATA POINTS; DATA SETS; MAIN MEMORIES; MASSIVE DATA SETS; MEMORY SPACES; NEURAL GAS; PARALLELIZATION; SELF-ORGANISING; SINGLE PASS; TIME CONSTRAINTS; TRAINING TIME; VISUALIZATION ALGORITHMS;

DATA VISUALIZATION; STRENGTH OF MATERIALS;

CLUSTERING ALGORITHMS;

ACCURACY; ARTICLE; CLASSIFICATION; CLASSIFIER; CLUSTER ANALYSIS; COMPUTER MEMORY; CONTROLLED STUDY; DATA BASE; DATA MINING; INFORMATION PROCESSING; LEARNING ALGORITHM; MACHINE LEARNING; NEURAL GAS; PRIORITY JOURNAL; PROCESS OPTIMIZATION; SELF ORGANIZING MAP;

EID: 61849124176     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2008.12.026     Document Type: Article

References (40)

1. F. Ancona, S. Rovetta, R. Zunino, A parallel approach to plastic neural gas, in: ICNN'1996, 1996.
2. S. Ben-David, A notion of stability for statistical clustering with applications to model selection, Technical Report, University of Waterloo, Canada, 2005.
3. Ben-David S. A framework for statistical clustering with constant time approximation algorithms for k-median clustering. In: Shawe-Taylor J., and Singer Y. (Eds). Proceedings of the 17th Annual Conference on Learning Theory (COLT) (2004), Springer 415-426
4. Bibliography on the self-organizing map (SOM) and learning vector quantization (LVQ), Neural Networks Research Centre, Helsinki University of Technology, 2002.
5. Bottou L., and Bengio Y. Convergence properties of the k-means algorithms. Advances in Neural Information Processing Systems vol. 7 (1995), MIT, Cambridge, MA 585-592
6. Bousquet O., and Elisseeff A. Stability and generalization. Journal of Machine Learning Research 2 (2002) 499-526
7. Bradley P.S., Fayyad U., and Reina C. Scaling clustering algorithms to large data sets. Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining (1998), AAAI Press, New York 9-15
8. Carpenter G.A., and Grossberg S. Adaptive resonance theory. In: Arbib M.A. (Ed). The Handbook of Brain Theory and Neural Networks. second ed. (2003), MIT, Cambridge, MA 87-90
9. Cottrell M., Hammer B., Hasenfuss A., and Villmann T. Batch and median neural gas. Neural Networks 19 (2006) 762-771
10. I.S. Dhillon, D.S. Modha, A Data-Clustering Algorithm on Distributed Memory Multiprocessors, Large-Scale Parallel Data Mining, in: Lecture Notes in Artificial Intelligence, vol. 1759, 2000, pp. 245-260.
11. Domingos P., and Hulten G. A general method for scaling up machine learning algorithms and its application to clustering. Proceedings of the ICML (2001) 106-113
12. Farnstrom F., Lewis J., and Elkan C. Scalability for clustering algorithms revisited. SIGKDD Explorations 2 1 (2000) 51-57
13. Fritzke B. A growing neural gas network learns topologies. In: Tesauro G., Touretzky D.S., and Leen T.K. (Eds). Advances in Neural Information Processing Systems vol. 7 (1995), MIT, Cambridge, MA 625-632
14. Garey M.R., and Johnson D.S. Computers and Intractability: A Guide to the Theory of NP-Completeness (1979), Freeman, New York
15. Guha S., Mishra N., Motwani R., and O'Callaghan L. Clustering data streams: theory and practice. IEEE Symposium on Foundations of Computer Science (2000) 359-366
16. Guha S., Rastogi R., and Shim K. CURE: an efficient clustering algorithm for large datasets. Proceedings of ACM SIGMOD International Conference on Management of Data (1998) 73-84
17. Hammer B., Hasenfuss A., Schleif F.-M., and Villmann T. Supervised batch neural gas. In: Schwenker F. (Ed). Proceedings of Conference Artificial Neural Networks in Pattern Recognition (ANNPR) (2006), Springer, Berlin 33-45
18. Hammer B., and Hasenfuss A. Relational neural gas. In: Hertzberg J., Beetz M., and Englert R. (Eds). KI 2007 (2007), Springer, Berlin 190-204
19. Hartigan J. Clustering Algorithms (1975), Wiley, New York
20. Heskes T. Self-organizing maps, vector quantization, and mixture modeling. IEEE Transactions on Neural Networks 12 (2001) 1299-1305
21. Höppner F., Klawonn F., Kruse R., and Runkler T. Fuzzy Cluster Analysis (1999), Wiley, New York
22. R. Jin, A. Goswami, G. Agrawal, Fast and exact out-of-core and distributed k-means clustering, Knowledge and Information System 10 (1) (2006) 17-40.
23. I.A. Klampanos, J.M. Jose, C.J. 'Keith' van Rijsbergen, Single-pass clustering for peer-to-peer information retrieval: the effect of document ordering, in: ACM International Conference Proceeding Series, Proceedings of the 1st International Conference on Scalable Information Systems, Hong Kong, vol. 152, 2006, Article No. 36.
24. Kohonen T. Self-organized formation of topologically correct feature maps. Biological Cybernetics 43 (1982) 59-69
25. Kohonen T., and Somervuo P. How to make large self-organizing maps for nonvectorial data. Neural Networks 15 (2002) 945-952
26. Kolinummi P., Pulkkinen P., Hämäläinen T., and Saarinen J. Parallel implementation of self-organizing map on the partial tree shape neurocomputer. Neural Process. Lett. 12 2 (2000) 171-182
27. Kuncheva L.I. Classifier ensembles for changing environments. In: Roli F., Kittler J., and Windeatt T. (Eds). Proceedings of the 5th International Workshop on Multiple Classifier Systems (2004), Springer, Berlin 1-15
28. Kuncheva L.I., Bezdek J.C., and Duin R.P.W. Decision templates for multiple classier fusion: an experimental comparison. Pattern Recognition 34 (2001) 31-34
29. Ma J., Xu L., and Michael J. Asymptotic convergence rate of the EM algorithm for Gaussian mixtures. Neural Computation 12 12 (2000) 2881-2907
30. Martinetz T., Berkovich S.G., and Schulten K.J. 'Neural-gas' network for vector quantization and its application to time-series prediction. IEEE Transactions on Neural Networks 4 (1993) 558-569
31. Martinetz T., and Schulten K.J. Topology representing networks. Neural Networks 7 3 (1994) 507-522
32. Nittel S., and Leung K.T. Parallelizing clustering of geoscientific data sets using data streams. Scientific and Statistical Database Management (2004) 73-84
33. Polikar R. Ensemble Based Systems in Decision Making. IEEE Circuits and Systems Magazine 6 3 (2006) 21-45
34. M. Porrmann, M. Franzmeier, H. Kalte, U. Witkowski, U. Rückert, A reconfigurable SOM hardware accelerator, in: ESANN'2000, 2000.
35. Ritter H. Self-organizing maps in non-Euclidean spaces. In: Oja E., and Kaski S. (Eds). Kohonen Maps (1999) 97-108
36. U. Seiffert, Artificial Neural Networks on Massively Parallel Computer Hardware, in: ESANN'2000, 2000.
37. P. Tomsich, A. Rauber, D. Merkl, parSOM: using parallelism to overcome memory latency in self-organizing neural networks, in: HPCN, Europe, 2000, pp. 136-145.
38. U. von Luxburg, S. Ben-David, Towards a statistical theory for clustering, in: PASCAL Workshop on Statistics and Optimization of Clustering Workshop, London, UK, 2005.
39. Wang W., Yang J., and Muntz R.R. STING: a statistical information grid approach to spatial data mining. Proceedings of the 23rd VLDB Conference (1997) 186-195
40. Zhang T., Ramakrishnan R., and Livny M. BIRCH: an efficient data clustering method for very large databases. Proceedings of the 15th ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems (1996) 103-114