Associative memory for online learning in noisy environments using self-organizing incremental neural network

IEEE Transactions on Neural Networks

Volumn 20, Issue 6, 2009, Pages 964-972

  Sudo, Akihito ^a   Sato, Akihiro ^a   Hasegawa, Osama ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

Associative memory; Neural network; Online learning; Robustness to noise

Indexed keywords

ASSOCIATIVE MEMORIES; ASSOCIATIVE MEMORY; LEARNED PATTERNS; LEARNING PATTERNS; MANY-TO-ONE; MEMORY SIZE; NOISY DATA; NOISY ENVIRONMENT; ONLINE INCREMENTAL LEARNING; ONLINE LEARNING; RANDOM PATTERN; REAL ENVIRONMENTS; REAL-VALUED DATA; ROBUSTNESS TO NOISE; SELF-ORGANIZING INCREMENTAL NEURAL NETWORK; SELF-ORGANIZING NETWORK; TWO-POINT;

E-LEARNING; EDUCATION; INTELLIGENT ROBOTS; INTERNET; NEURAL NETWORKS; SPEECH RECOGNITION;

ASSOCIATIVE PROCESSING;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; ASSOCIATION; AUTOMATED PATTERN RECOGNITION; BIOMIMETICS; COMPUTER SIMULATION; METHODOLOGY; ONLINE SYSTEM; ROBOTICS; THEORETICAL MODEL;

ALGORITHMS; ASSOCIATION; BIOMIMETICS; COMPUTER SIMULATION; MODELS, THEORETICAL; NEURAL NETWORKS (COMPUTER); ONLINE SYSTEMS; PATTERN RECOGNITION, AUTOMATED; ROBOTICS;

EID: 67649361724     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2009.2014374     Document Type: Article

References (28)

1. A. Bisler, "An associative memory for autonomous agents," in Proc. 4th Int. Conf. Intell. Syst. Design Appl., 2004, pp. 765-770.
2. B. J. Rhodes, "Margin notes: Building a contextually aware associative memory," in Proc. Int. Conf. Intell. User Interface, 2000, pp. 9-12.
3. K. Itoh, H. Miwa, Y. Nukariya, M. Zecca, H. Takanobu, P. Dario, and A. Takanishi, "New memory model for humanoid robots - introduction of co-associative memory using mutually coupled chaotic neural networks," in Proc. Int. Joint Conf. Neural Netw., 2005, pp. 2790-2795.
4. K. Mizutani and T. Omori, "On-line map formation and path planning for mobile robot by associative memory with controllable attention," in Proc. Int. Joint Conf. Neural Netw., 1999, pp. 2051-2056.
5. J. J. Hopfield, "Neural networks and physical systems with emergent collective computational abilities," Proc. Nat. Acad. Sci. USA, vol. 79, no. 8, pp. 2554-2558, 1982.
6. B. Kosko, "Bidirectional associative memories," IEEE Trans. Syst. Man Cybern., vol. SMC-18, no. 1, pp. 49-60, Jan./Feb. 1988.
7. A. F. R. Araujo and G. M. Haga, "Two simple strategies to improve bidirectional associative memory's performance: Unlearning and delta role," in Proc. Int. Conf. Neural Netw., 1997, vol. 2, pp. 1178-1182.
8. P. Sussner and M. E. Valle, "Gray-scale morphological associative memories," IEEE Trans. Neural Netw., vol. 17, no. 3, pp. 559-570, May 2006.
9. B.-L. Zhang, H. Zhang, and S. S. Ge, "Face recognition by applying wavelet subband representation and kernel associative memory," IEEE Trans. Neural Netw., vol. 15, no. 1, pp. 166-177, Jan. 2004.
10. M. Mézard, J. P. Nadal, and G. Toulouse, "Solvable models of working memories," J. Physique, vol. 47, pp. 1457-1462.
11. T. Kimoto and M. Okada, "Sparsely encoded associative memory model with forgetting process," IEICE Trans. Inf. Syst. (Inst. Electron. Inf. Commun. Eng.), vol. E85-D, no. 12, pp. 1938-1945, 2002.
12. R. M. French, "Using semi-distributed representation to overcome catastrophic forgetting in connectionist networks," in Proc. 13th Annu. Cogn. Sci. Soc. Conf. 1991, pp. 173-178.
13. R. M. French, "Catastrophic forgetting in connectionist networks," Trends Cogn. Sci., vol. 3, no. 4, pp. 128-135, 1999.
14. H. Ichiki, M. Hagiwara, and M. Nakagawa, "Kohonen feature maps as a supervised learning machine," in Proc. IEEE Int. Conf. Neural Netw. 1993, pp. 1944-1948.
15. G. Barreto and A. Araujo, "Identification and control of dynamical systems using the self-organizing map," IEEE Trans. Neural Netw., vol. 15, no. 5, pp. 1244-1259, Sep. 2004.
16. S. Kondo, R. Futami, and N. Hoshimiya, "Pattern recognition with feature map and the improvement on sequential learning ability," IEICE Tech. Rep., vol. 95, no. 599, pp. 55-60, 1996.
17. T. Yamada, M. Hattori, M. Morisawa, and H. Ito, "Sequential learning for associative memory using Kohonen feature map," in Proc. Int. Joint Conf. Neural Netw., 1999, pp. 1920-1923.
18. S. Yoshizawa, S. Doki, and S. Okuma, "A new associative memory system for supplemental learning under restriction on memory capacity," IEICE Trans. Inf. Syst., vol. J82-D, no. II(6), pp. 1072-1081, 1999.
19. F. Shen and O. Hasegawa, "An incremental network for on-line unsupervised classification and topology learning," Neural Netw., vol. 19, no. 1, pp. 90-106, 2006.
20. M. Hagiwara, "Multidirectional associative memory," in Proc. Int. Joint Conf. Neural Netw., 1990, pp. 3-6.
21. P. Watta and M. H. Hassoun, "Generalizations of the Hamming associative memory," Neural Process. Lett., vol. 13, pp. 183-194.
22. I. Valovaa, D. Szera, N. Gueorguievab, and A. Buer, "A parallel growing architecture for self-organizing maps with unsupervised learning," Neurocomputing, vol. 68, pp. 177-195, 2005.
23. S. Marsland, J. Shapiro, and U. Nehmzow, "A self-organizing network that grows when required," Neural Netw., vol. 15, no. 8-9, pp. 1041-1058, 2002.
24. B. Fritzke, "Growing cell structures - a self-organizing network for unsupervised and supervised learning," Neural Netw., vol. 7, no. 9, pp. 1441-1460, 1994.
25. B. Fritzke, "A self-organizing network that can follow non-stationary distributions," in Proc. Int. Conf. Artif. Neural Netw., 1997, pp. 613-618.
26. J. Jockusch and H. Ritter, "An instantaneous topological mapping model for correlated stimuli," in Proc. Int. Joint Conf. Neural Netw., 1999, pp. 529-534.
27. B. Fritzke, "A growing neural gas network learns topologies," in Advances in Neural Information Processing Systems (NIPS). Cambridge, MA: MIT Press, 1995, pp. 625-632.
28. H. Oh and S. C. Kothari, "Adaptation of the relaxation method for learning in bidirectional associative memory," IEEE Trans. Neural Netw., vol. 5, no. 4, pp. 576-583, Jul. 1994.