Vision and action in the language-ready brain: From mirror neurons to SemRep

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4729 LNCS, Issue , 2007, Pages 104-123

  Arbib, Michael A ^a,b   Lee, Jinyong ^a  

^a University of Southern California ^*  (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Action; Action recognition; Brain mechanisms; Competition and cooperation; Construction grammar; Dynamic visual scenes; Language perception; Language production; Mirror neurons; Scene descriptions; Schema theory; SemRep; Vision; Visual perception

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTATIONAL LINGUISTICS; CYBERNETICS; GRAPHIC METHODS; INFORMATION THEORY; LINGUISTICS; MECHANISMS; MIRRORS; NEURONS; STATIC ANALYSIS;

ACTION; ACTION RECOGNITION; BRAIN FUNCTIONS; BRAIN MECHANISMS; COMPETITION AND COOPERATION; COMPUTER ANALYSIS; CONSTRUCTION GRAMMAR; DYNAMIC VISUAL SCENES; GRAPHICAL REPRESENTATIONS; INTERNATIONAL SYMPOSIUM; LANGUAGE PERCEPTION; LANGUAGE PRODUCTION; MIRROR NEURONS; NEW FORMS; SCENE DESCRIPTIONS; SCHEMA THEORY; SCHEMAS; SEMREP; VISION; VISUAL PERCEPTION;

FORMAL LANGUAGES;

EID: 44949155631     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-75555-5_11     Document Type: Conference Paper

References (30)

1. Arbib, M.A.: Rana computatrix to human language: towards a computational neuroethology of language evolution. Philos. Transact. A Math. Phys. Eng. Sci. 361, 2345-2379 (2003)
2. Arbib, M. A., Liaw, J.-S.: Sensorimotor Transformations in the Worlds of Frogs and Robots. Artificial Intelligence 72, 53-79 (1995)
3. Arbib, M.A.: Perceptual structures and distributed motor control. In: Brooks, V.B. (ed.) Handbook of Physiology -The Nervous System II. Motor Control, pp. 1449-1480. American Physiological Society, Bethesda, MD (1981)
4. Draper, B.A., Collins, R.T., Brolio, J., Hanson, A.R., Riseman, E.M.: The schema system. International Journal of Computer Vision 2, 209-250 (1989)
5. Erman, L.D., Hayes-Roth, F., Lesser, V.R., Reddy, D.R.: The HEARSAY-II speech understanding system: Integrating knowledge to resolve uncertainty. Computing Surveys 12, 213-253 (1980)
6. Itti, L., Arbib, M.A.: Attention and the minimal subscene. In: Arbib, M.A. (ed.) Action to language via the mirror neuron system, pp. 289-346. Cambridge University Press, Cambridge (2006)
7. Fagg, A.H., Arbib, M.A.: Modeling parietal-premotor interactions in primate control of grasping. Neural Netw. 11, 1277-1303 (1998)
8. Gibson, J.J.: The ecological approach to visual perception. Houghton Mifflin, Boston (1979)
9. Bonaiuto, J., Rosta, E., Arbib, M.: Extending the mirror neuron system model, I: Audible actions and invisible grasps. Biol. Cybern. 96, 9-38 (2007)
10. Oztop, E., Arbib, M.A.: Schema design and implementation of the grasp-related mirror neuron system. Biol. Cybern. 87, 116-140 (2002)
11. Gershkoff-Stowe, L., Goldin-Meadow, S.: Is there a natural order for expressing semantic relations? Cognitive Psychology 45, 375-412 (2002)
12. Arbib, M.A., Rizzolatti, G.: Neural expectations: a possible evolutionary path from manual skills to language. Communication and Cognition 29, 393-424 (1997)
13. Arbib, M.A.: From Monkey-like Action Recognition to Human Language: An Evolutionary Framework for Neurolinguistics (with commentaries and author's response). Behavioral and Brain Sciences 28, 105-167 (2005)
14. Arbib, M.A.: Broca's Area in System Perspective: Language in the Context of Action-Oriented Perception. In: Grodzinsky, Y., Amunts, K. (eds.) Broca's Region, pp. 153-168. Oxford University Press, Oxford (2006)
15. Saussure, F.: Cours de linguistique générale. In: Bally, C., Sechehaye, A., Riedlinger, A. (eds.) Payot Lausanne and Paris (1916) (English translation by W. Baskin, Course in General Linguistics, Fontana/Collins, Glasgow (1977))
16. Gallese, V., Goldman, A.: Mirror neurons and the simulation theory of mind-reading. Trends Cognit. Sci. 2, 493-501 (1998)
17. Chomsky, N.: Lectures on Government and Binding. Foris, Dordrecht (1981)
18. Croft, W., Cruse, D.A.: Cognitive Linguistics. Cambridge University Press, Cambridge (2005)
19. Goldberg, A.E.: Constructions: A new theoretical approach to language. Trends in Cognitive Science 7, 219-224 (2003)
20. Fillmore, C.J., Kay, P., O'Connor, M.K.: Regularity and idiomaticity in grammatical constructions: the case of let alone. Language & Cognitive Processes 64, 501-538 (1988)
21. De Beule, J., Steels, L.: Hierarchy in Fluid Construction Grammar. In: Furbach, U. (ed.) KI2005. LNCS (LNAI), vol. 3698, pp. 1-15. Springer, Heidelberg (2005)
22. Roy, D.: Semiotic schemas: A framework for grounding language in action and perception. Artificial Intelligence 167, 170-205 (2005)
23. Steels, L.: Evolving grounded communication for robots. Trends in Cognitive Sciences 7, 308-312 (2003)
24. Cangelosi, A., Riga, T.: An Embodied Model for Sensorimotor Grounding and Grounding Transfer: Experiments With Epigenetic Robots. Cognitive Science 30, 673-689 (2006)
25. Dominey, P.F., Hoen, M.: Structure mapping and semantic integration in a constructionbased neurolinguistic model of sentence processing. Cortex 42, 476-479 (2006)
26. Feldman, J., Narayanan, S.: Embodied meaning in a neural theory of language. Brain Lang. 89, 385-392 (2004)
27. Steels, L., Loetzsch, M.: Perspective Alignment in Spatial Language. In: Coventry, K.R., Tenbrink, T., Bateman, J.A. (eds.) Spatial Language and Dialogue, Oxford University Press, Oxford (2007)
28. Kosko, B.: Bidirectional associative memories. IEEE Transactions on Systems, Man and Cybernetics 18, 49-60 (1988)
29. Navalpakkam, V., Itti, I.: Modeling the influence of task on attention. Vision Research 45, 205-231 (2005)
30. Guazzelli, A., Corbacho, F.J., Bota, M., Arbib, M.A.: Affordances, Motivation, and the World Graph Theory. Adaptive Behavior 6, 435-471 (1998)