Neural associative memories for the integration of language, vision and action in an autonomous agent

Neural Networks

Volumn 22, Issue 2, 2009, Pages 134-143

  Markert, H ^a   Kaufmann, U ^a   Kara Kayikci, Z ^a   Palm, G ^a  

^a UNIVERSITY OF ULM   (Germany)

Author keywords

Associative memory; Functional neural modeling; Hybrid systems; Language understanding; Neural networks; Robot control; Speech understanding; Visual object recognition

Indexed keywords

ASSOCIATIVE MEMORY; FUNCTIONAL NEURAL MODELING; LANGUAGE UNDERSTANDING; ROBOT CONTROL; SPEECH UNDERSTANDING; VISUAL OBJECT RECOGNITION;

ASSOCIATIVE PROCESSING; AUTONOMOUS AGENTS; DATA STORAGE EQUIPMENT; ELECTRIC GROUNDING; HYBRID COMPUTERS; HYBRID SYSTEMS; LINGUISTICS; OBJECT RECOGNITION; QUERY LANGUAGES; ROBOTICS; ROBOTS; SPEECH ANALYSIS; SPEECH RECOGNITION;

NEURAL NETWORKS;

ARTICLE; ASSOCIATIVE MEMORY; LANGUAGE PROCESSING; LEARNING; NERVE CELL NETWORK; NERVE CONDUCTION; PRIORITY JOURNAL; ROBOTICS; VISUAL MEMORY; WORD RECOGNITION;

ALGORITHMS; ATTENTION; BRAIN; HUMANS; LANGUAGE; MEMORY; MODELS, NEUROLOGICAL; MOVEMENT; NEURAL NETWORKS (COMPUTER); PSYCHOLINGUISTICS; RECOGNITION (PSYCHOLOGY); ROBOTICS; VISION, OCULAR;

EID: 61449252406     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2009.01.011     Document Type: Article

References (32)

1. Bi G., and Poo M. Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type. Journal of Neuroscience 15 (1998) 10464-10472
2. Braitenberg V., and Schüz A. Anatomy of the cortex: Statistics and geometry (1991), Springer, Berlin
3. Fay, R. (2007). Feature Selection and information fusion in hierarchical neural networks for iterative 3D-object recognition. Ph.D. thesis. University of Ulm, Institute for Neural Information Processing, Germany
4. Fay R., Kaufmann U., Knoblauch A., Markert H., and Palm G. Combining visual attention, object recognition and associative information processing in a neurobotic system. In: Wermter S., Palm G., and Elshaw M. (Eds). Biomimetic neural learning for intelligent robots. intelligent systems, cognitive robotics, and neuroscience. Lecture notes in artificial intelligence LNAI Vol. 3575 (2005), Springer, Berlin, Heidelberg 118-143
5. Fay, R., Schwenker, F., & Palm, G. (2005). Incremental learning in hierarchical neural networks for object recognition. In 2nd International conference on informatics in control, automation and robotics ICINCO 2005 (pp. 298-303)
6. Fay R., Schwenker F., Thiel C., and Palm G. Hierarchical neural networks utilising Dempster-Shafer evidence theory. In: Schwenker F., and Marinai S. (Eds). Artificial neural networks in pattern recognition. LNAI Vol. 4087 (2006), Springer, Berlin, Heidelberg, New York 198-209
7. Hawkins J. On intelligence (2004), Times Books
8. Hebb D. The organization of behavior. A neuropsychological theory (1949), Wiley, New York
9. Hecht-Nielsen R. Confabulation theory (2007), Springer
10. Hecht-Nielsen R. Confabulation theory. Scholarpedia 2 3 (2007) 1763
11. Kara Kayikci, Z., & Palm, G. (2008a). Word recognition and incremental learning based on neural associative memories and hidden Markov models. In 16th European symposium on artificial neural networks ESANN 2008, 119-124
12. Kara Kayikci, Z., & Palm, G. (2008b). Word recognition and learning based on associative memories and hidden markov models. In IV. International conference on computer, electrical, and systems science, and engineering CESSE 2008
13. Kaufmann, U., Fay, R., Markert, H., & Palm, G. (2005). Neural networks for visual object recognition based on selective attention. In International sense maker workshop on life-like perception systems. University of Ulster, N Ireland
14. Kayikci Z.K., Markert H., and Palm G. Neural associative memories and hidden markov models for speech recognition. IJCNN 2007 conference proceedings (2007), IEEE. 1-4244-1380-X ISSN: 1098-7576
15. Kirchmar J., and Edelman G. Machine psychology: Autonomous behaviour, perceptual categorization and conditioning in a brain-based device. Cerebral Cortex 12 (2002) 818-830
16. Markert H., Knoblauch A., and Palm G. Modelling of syntactical processing in the cortex. BioSystems 89 (2007) 300-315
17. Mavridis, N., & Roy, D. (2006). Grounded situation models for robots: Where words and percepts meet. In International conference on intelligent robots and systems. http://www.media.mit.edu/cogmac/publications/IEEE_IROS_2006.pdf
18. Mayer, G., Melchert, J., Utz, H., Kraetzschmar, G., & Palm, G. (2005). Neural object classification and tracking. In Proceedings of the 4th IEEE SMC UK-RI chapter conference on applied cybernetics, AC2005
19. Mayer G., Utz H., and Palm G. Information integration in a multi-stage object classifier. Proceedings 19. Fachgespräch Autonome Mobile Systeme, AMS (2005), Springer, Stuttgart
20. National Institute of Standards and Technology Speech Disc 1-1 1. (1990). TIMIT Acoustic-Phonetic Continuous Speech Corpus. NTIS Order No. PB91-505065
21. Palm G. On associative memories. Biological Cybernetics 36 (1980) 19-31
22. Palm G. Neural assemblies. An alternative approach to artificial intelligence (1982), Springer, Berlin
23. Palm G. Cell assemblies as a guideline for brain research. Concepts in Neuroscience 1 (1990) 133-148
24. Palm G., and Aertsen A. Brain theory (1986), Springer, Berlin, Heidelberg
25. Pulvermüller F. The neuroscience of language (2002), Cambridge University Press
26. Rabiner L., and Juang B.-H. Fundamentals of speech recognition (1993), Prentice-Hall, Inc., Upper Saddle River
27. Roy, D., Hsiao, K., Mavridis, N., & Gorniak, P. (2003). Ripley, hand me the cup (sensorimotor representations for grounding word meaning). In International conference of automatic speech recognition and understanding. http://www.media.mit.edu/cogmac/publications/asru03.pdf
28. Sameer, A., Shree, K., & Hiroshi, M. (1996a). Columbia object image library, COIL-100. Technical report CUCS-006-96. Department of Computer Science, Columbia University
29. Sameer, A., Shree, K., & Hiroshi, M. (1996b). Columbia object image library, COIL-20. Technical report CUCS-005-96. Department of Computer Science, Columbia University
30. Song S., Miller K., and Abbott L. Competitive hebbian learning through spike-timing-dependent synaptic plasticity. Nature Neuroscience 3 (2000) 919-926
31. Willshaw D., Buneman O., and Longuet-Higgins H. Non-holographic associative memory. Nature 222 (1969) 960-962
32. Young, S. et al. (1993). The HTK book for HTK version 3.2.1. Cambridge University, Engineering Department