Competitive repetition suppression (CoRe) clustering: A biologically inspired learning model with application to robust clustering

IEEE Transactions on Neural Networks

Volumn 19, Issue 11, 2008, Pages 1922-1941

  Bacciu, Davide ^a   Starita, Antonina ^b  

^a IMT SCHOOL FOR ADVANCED STUDIES LUCCA   (Italy)

^b UNIVERSITY OF PISA   (Italy)

Author keywords

Neural nets; Rival penalized competitive learning (RPCL); Robust clustering; Soft competitive learning; Unsupervised learning

Indexed keywords

CLUSTER ANALYSIS; EDUCATION; FLOW OF SOLIDS; LEARNING ALGORITHMS; LEARNING SYSTEMS; MARINE BIOLOGY; NEURAL NETWORKS; POLARIZATION; POWDERS; PROBABILITY DENSITY FUNCTION; PROGRAMMING THEORY; UNSUPERVISED LEARNING;

ARTIFICIAL NEURAL NETWORK MODELS; BIOLOGICAL PLAUSIBILITIES; BIOLOGICALLY INSPIRED; CEREBRAL CORTICES; CLUSTER NUMBERS; CLUSTERING MODELS; ERROR FUNCTIONS; LEARNING DYNAMICS; LEARNING MODELS; LOSS FUNCTIONS; MEMORY MECHANISMS; NEURAL CODING; NEURAL NETS; NEURAL REPRESENTATIONS; OPEN PROBLEMS; OPTIMAL NETWORK STRUCTURES; OUT-LIERS; PRIORI INFORMATIONS; RIVAL PENALIZED COMPETITIVE LEARNING (RPCL); RIVAL PENALIZED COMPETITIVE LEARNINGS; ROBUST CLUSTERING; ROBUST STATISTICS; SOFT COMPETITIVE LEARNING; VISUAL STIMULUS;

CLUSTERING ALGORITHMS;

ALGORITHM; ANIMAL; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMIMETICS; CLUSTER ANALYSIS; COMPUTER SIMULATION; HUMAN; LEARNING; METHODOLOGY; RECALL; THEORETICAL MODEL;

ALGORITHMS; ANIMALS; ARTIFICIAL INTELLIGENCE; BIOMIMETICS; CLUSTER ANALYSIS; COMPUTER SIMULATION; HUMANS; LEARNING; MENTAL RECALL; MODELS, THEORETICAL; PATTERN RECOGNITION, AUTOMATED;

EID: 56449089158     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2008.2004407     Document Type: Article

References (53)

1. R. Xu and D. Wunsch, "Survey of clustering algorithms," IEEE Trans. Neural Netw., vol. 16, no. 3, pp. 645-678, May 2005.
2. C. Constantinopoulos and A. Likas, "Unsupervised learning of Gaussian mixtures based on variational component splitting," IEEE Trans. Neural Netw., vol. 18, no. 3, pp. 745-755, May 2007.
3. M. Girolami, "Mercer kernel-based clustering in feature space," IEEE Trans. Neural Netw., vol. 13, no. 3, pp. 780-784, May 2002.
4. A. Ben-Hur, D. Horn, H. T. Siegelmann, and V. Vapnik, "Support vector clustering," J. Mach. Learn. Res., vol. 2, pp. 125-137, 2002.
5. F. Camastra and A. Verri, "A novel kernel method for clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 5, pp. 801-805, May 2005.
6. A. Ng, M. Jordan, and Y. Weiss, "On spectral clustering: Analysis and an algorithm," in Proc. Adv. Neural Inf. Process. Syst., 2001, pp. 849-856.
7. Y.-J. Zhang and Z.-Q. Liu, "Self-splitting competitive learning: A new on-line clustering paradigm," IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 369-380, Mar. 2002.
8. H. Frigui and R. Krishnapuram, "A robust competitive clustering algorithm with applications in computer vision," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 5, pp. 450-465, May 1999.
9. H. Frigui and O. Nasraoui, "Unsupervised learning of prototypes and attribute weights," Pattern Recognit., vol. 37, no. 3, pp. 567-581, Mar. 2004.
10. R. Desimone, "Neural mechanisms for visual memory and their role in attention," in Proc. Nat. Acad. Sci., Nov. 1996, vol. 93, pp. 13494-13499.
11. D. Rumelhart and D. Zipser, "Competitive learning," Cogn. Sci., vol. 9, pp. 75-112, 1985.
12. E. Yair, K. Zeger, and A. Gersho, "Competitive learning and soft competition for vector quantizer design," IEEE Trans. Signal Process., vol. 40, no. 2, pp. 294-309, Feb. 1992.
13. S. Seo and K. Obermayer, "Soft learning vector quantization," Neural Comput., vol. 15, no. 7, pp. 1589-1604, 2003.
14. D. Bacciu and A. Starita, "Competitive repetition suppression learning," in Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2006.
15. T. Poggio and F. Girosi, "Networks for approximation and learning," Proc. IEEE, vol. 78, no. 9, pp. 1481-1497, Sep. 1990.
16. D. Bacciu and A. Starita, "A robust bio-inspired clustering algorithm for the automatic determination of unknown cluster number," in Proc. IEEE Int. Joint Conf. Neural Netw., Aug. 2007, pp. 1314-1319.
17. L. Xu, A. Krzyzak, and E. Oja, "Rival penalized competitive learning for clustering analysis, RBF net, and curve detection," IEEE Trans. Neural Netw., vol. 4, no. 4, pp. 636-649, Jul. 1993.
18. L. Xu, "A unified perspective and new results on RHT computing, mixture based learning and multi-learner based problem solving," Pattern Recognit., vol. 40, pp. 2129-2153, 2007.
19. L. Xu, "Data smoothing regularization, multi-sets-learning, and problem solving strategies," Neural Netw., vol. 16, pp. 817-825, 2003.
20. T. Nair, C. Zheng, J. Fink, R. Stuart, and M. Gribskov, "Rival penalized competitive learning (RPCL): A topology-determining algorithm for analyzing gene expression data," Comput. Biol. Chem., vol. 27, pp. 565-574, 2003.
21. S. Nakkrase and P. Sophatsathit, "An RPCL-based indexing approach for software component classification," Int. J. Soft Eng. Knowl., vol. 14, pp. 497-518, 2004.
22. G. Acciani, E. Chiarantoni, G. Fornarelli, and S. Vergura, "A feature extraction unsupervised neural network for an environmental data set," Neural Netw., vol. 16, pp. 427-436, 2003.
23. Y.-M. Cheung and L.-T. Law, "Rival-model penalized self-organizing map," IEEE Trans. Neural Netw., vol. 18, no. 1, pp. 289-295, Jan. 2007.
24. Y. M. Cheung, "On rival penalization controlled competitive learning for clustering with automatic cluster number selection," IEEE Trans. Knowl. Data Eng., vol. 17, no. 11, pp. 1583-1588, Nov. 2005.
25. C. L. Wiggs and A. Martin, "Properties and mechanism of perceptual priming," Curr. Opin. Neurobiol., vol. 8, pp. 227-233, 1998.
26. K. Grill-Spector, R. Henson, and A. Martin, "Repetition and the brain: Neural models of stimulus-specific effects," Trends Cogn. Sci., vol. 10, no. 1, pp. 14-23, Jan. 2006.
27. E. Miller and R. Desimone, "Parallel neuronal mechanisms for short-term memory," Science, vol. 263, pp. 520-522, 1994.
28. S. Sobotka and J. Ringo, "Mnemonic responses of single units recorded from monkey inferotemporal cortex, accessed via transcommissural versus direct pathways: A dissociation between unit activity and behavior," J. Neurosci., no. 16, pp. 4222-4230, 1996.
29. T. James and I. Gauthier, "Repetition-induced changes in bold response reflect accumulation of neural activity," Human Brain Mapping, vol. 27, no. 1, pp. 37-46, Jun. 2005.
30. R. M. French, "Semi-distributed representations and catastrophic forgetting in connectionist networks," Connection Sci., no. 4, pp. 365-377, 1992.
31. K. Norman and R. O'Reilly, "Modeling hippocampal and neocortical contributions to recognition memory: A complementary learning systems approach," Psychol. Rev., no. 110, pp. 611-646, 2003.
32. S. C. Ahalt, A. K. Krishnamurthy, P. Chen, and D. E. Melton, "Competitive learning algorithms for vector quantization," Neural Netw., vol. 3, no. 3, pp. 277-290, 1990.
33. M.-S. Yang and K.-L. Wu, "A similarity-based robust clustering method," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 4, pp. 434-448, Apr. 2004.
34. T. Kohonen, "Self-organized formation of topologically correct feature maps," Biol. Cybern., vol. 43, no. 1, pp. 59-69, Jan. 1982.
35. T. Kohonen, "Learning vector quantization," Neural Netw., vol. 1, no. suppl 1, pp. 302-88, 1988.
36. R. Rizzo and A. Chella, "A comparison between habituation and conscience mechanism in self-organizing maps," IEEE Trans. Neural Netw., vol. 17, no. 3, pp. 807-810, May 2006.
37. G. Carpenter and S. Grossberg, "The ART of adaptive pattern recognition by a self-organizing neural network," Computer, vol. 21, no. 3, pp. 77-88, Mar. 1988.
38. R. A. Fisher, "The use of multiple measurements in taxonomic problems," Ann. Eugenics, vol. 7, no. 2, pp. 179-188, 1936.
39. N. Pal, J. Bezdek, and E. C.-K. Tsao, "Generalized clustering networks and Kohonen's self-organizing scheme," IEEE Trans. Neural Netw., vol. 4, no. 4, pp. 549-557, Jul. 1993.
40. R. J. Hathaway and J. Bezdek, "Fuzzy c-means clustering of incomplete data," IEEE Trans. Syst. Man Cybern. B, Cybern., vol. 31, no. 5, pp. 735-744, Oct. 2001.
41. B. Gabrys and A. Bargiela, "General fuzzy min-max neural network for clustering and classification," IEEE Trans. Neural Netw., vol. 11, no. 3, pp. 769-783, May 2000.
42. T. Eltoft and R. D. Figueiredo, "New neural network for cluster-detection-and-labeling," IEEE Trans. Neural Netw., vol. 9, no. 5, pp. 1021-1035, Sep. 1998.
43. R. Mollineda and E. Vidal, "A relative approach to hierarchical clustering," in Frontiers in Artificial Intelligence and Applications, ser. Pattern Recognition and Applications, M. Torres and A. Sanfeliu, Eds. Amsterdam, The Netherlands: IOS, 2000, vol. 56, pp. 19-28.
44. A. Baraldi and E. Alpaydin, "Constructive feedforward ART clustering networks," IEEE Trans. Neural Netw., vol. 13, no. 3, pp. 645-677, May 2002.
45. S. Wu and T. W. S. Chow, "Self-organizing-map based clustering using a local clustering validity index," Neural Process. Lett., vol. 17, no. 3, pp. 253-271, 2003.
46. Y. El-Sonbaty and M. A. Ismail, "On-line hierarchical clustering," Pattern Recognit. Lett., vol. 19, no. 14, pp. 1285-1291, Dec. 1998.
47. P. Huber, Robust Statistics. New York: Wiley, 1981.
48. K.-L.Wu and M.-S.Yang, "Alternative c-means clustering algorithms," Pattern Recognit., vol. 35, no. 10, pp. 2267-2278, Oct. 2002.
49. J. Ma and T. Wang, "A cost-function approach to rival penalized competitive learning (RPCL)," IEEE Trans. Syst. Man Cybern. B, Cybern., vol. 36, no. 4, pp. 722-737, Aug. 2006.
50. D. Bacciu and A. Starita, "Convergence behavior of competitive-repetition suppression clustering," in Proceedings of the 2007 International Conference on Neural Information Processing, ser. Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2008, vol. 4984, pp. 497-506.
51. B. Scholkopf, A. Smola, and K.-R. Muller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, no. 5, pp. 1299-1319, 1998.
52. J. Bezdek, Pattern Recognition With Fuzzy Objective Function Algorithms. Norwell, MA: Kluwer, 1981.
53. D.-Q. Zhang and S.-C. Chen, "A novel kernelized fuzzy c-means algorithm with application in medical image segmentation," Artif. Intell. Med. vol. 32, no. 1, pp. 37-50, 2004.