Connecting language to the world

Artificial Intelligence

Volumn 167, Issue 1-2, 2005, Pages 1-12

  Roy, Deb ^a   Reiter, Ehud ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF ABERDEEN   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER VISION; KNOWLEDGE REPRESENTATION; NEURAL NETWORKS; ROBOTICS;

COGNITIVE SCIENCE; CONNECTING LANGUAGE; NATURAL LANGUAGE PROCESSING; PATTERN ANALYSIS;

COGNITIVE SYSTEMS;

EID: 24144449919     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2005.06.002     Document Type: Short Survey

References (48)

1. D. Bailey, J. Feldman, S. Narayanan, and G. Lakoff Embodied lexical development Proceedings of the Nineteenth Annual Meeting of the Cognitive Science Society 1997 Erlbaum Mahwah, NJ
2. K. Barnard, P. Duygulu, D. Forsyth, N. de Freitas, D. Blei, and M. Jordan Matching words and pictures J. Machine Learning Res. 3 2003 1107 1135
3. L. Barsalou Perceptual symbol systems Behavioural and Brain Sciences 22 1999 577 609
4. R. Barzilay, E. Reiter, J.M. Siskind, in: HLT-NAACL03 Workshop on Learning Word Meaning from Non-Linguistic Data, 2003
5. B. Bergen, N. Chang, S. Narayanan, Simulated action in an embodied construction grammar, in: Proceedings of the 26th Annual Meeting of the Cognitive Science Society, 2004
6. A. Clark Being There: Putting Brain, Body and World Together again 1997 MIT Press Cambridge, MA
7. H. Clark Using Language 1996 Cambridge University Press Cambridge
8. S. Coradeschi, A. Saffiotti, Special issue of robotics and autonomous systems on perceptual anchoring, 43 (2-3) (2003)
9. K. Coventry, and S. Garrod Saying, Seeing and Acting 2004 Psychology Press
10. R. Dale, and E. Reiter Computational interpretations of the gricean maxims in the generation of referring expressions Cognitive Sci. 19 2 1995 233 263
11. J. Feldman, G. Lakoff, D. Bailey, S. Narayanan, T. Regier, and A. Stolcke Lzero: The first five years Artificial Intelligence Rev. 10 1996 103 129
12. A.P. Fern, R.L. Givan, and J.M. Siskind Specific-to-general learning for temporal events with application to learning event definitions from video J. Artificial Intelligence Res. 17 2002 379 449
13. P. Gärdenfors Conceptual Spaces: The Geometry of Thought 2000 MIT Press Cambridge, MA
14. A. Glenberg, and M. Kaschak Grounding language in action Phychonomic Bull. Rev. 9 3 2002 558 565
15. P. Gorniak, and D. Roy Grounded semantic composition for visual scenes J. Artificial Intelligence Res. 21 2004 429 470
16. P. Gorniak, D. Roy, Speaking with your sidekick: Understanding situated speech in computer role playing games, in: Proceedings of Artificial Intelligence and Interactive Digital Entertainment, 2005
17. S. Harnad The symbol grounding problem Physica D 42 1990 335 346
18. G. Herzog, and P. Wazinski VIsual TRAnslator: Linking perceptions and natural language descriptions Artificial Intelligence Rev. 8 1994 175 187
19. J. Juster, D. Roy, Elvis: Situated speech and gesture understanding for a robotic chandilier, in: Proceedings of the International Conference on Multimodal Interfaces, 2004
20. G. Lakoff Women, Fire, and Dangerous Things 1987 University of Chicago Press Chicago, IL
21. G. Lakoff, and M. Johnson Metaphors We Live By 1980 University of Chicago Press Chicago, IL
22. J.M. Lammens, A computational model of color perception and color naming, PhD thesis, State University of New York, 1994
23. A. Mojsilovic A computational model for color naming and describing color composition of images IEEE Trans. Image Process. 14 5 2005 690 699
24. S. Narayanan, Moving right along: A computational model of metaphoric reasoning about events, in: Proceedings of the National Conference on Artificial Intelligence AAAI-99, Orlando, FL, 1999
25. N. Nilsson, Shakey the robot, Technical Report 323, A.I. Center, SRI International, 1984
26. M. Pickering, and S. Garrod Toward a mechanistic psychology of dialogue Behav. Brain Sci. 274 2004 169 226
27. P. McKevitt Integration of Natural Language and Vision Processing 1995 Kluwer Academic Dordrecht
28. P.E. Hart, R.O. Duda, and D.G. Stork Pattern Classification 2001 Wiley New York
29. T. Regier The Human Semantic Potential 1996 MIT Press Cambridge, MA
30. T. Regier Emergent constraints on word-learning: A computational perspective Trends Cognitive Sci. 7 6 2003 263 268
31. T. Regier, and L. Carlson Grounding spatial language in perception: An empirical and computational investigation J. Experimental Psychol. 130 2 2001 273 298
32. T. Regier, M. Zheng, An attentional constraint on spatial meaning, in: R. Alterman, D. Kirsh (Eds.), Proceedings of the 25th Annual Meeting of the Cognitive Science Society, 2003
33. E. Reiter, and S. Sripada Human variation and lexical choice Computational Linguistics 28 2002 545 553
34. J. Robin, and K. McKeown Empirically designing and evaluating a new revision-based model for summary generation Artificial Intelligence 85 1996 135 179
35. D. Roy Learning visually-grounded words and syntax for a scene description task Comput. Speech Language 16 3 2002
36. D. Roy, Grounding words in perception and action: Computational insights, Trends in Cognitive Sciences, in press
37. D. Roy, K. Hsiao, and N. Mavridis Mental imagery for a conversational robot IEEE Trans. Systems Man, Cybernet. B 34 3 2004 1374 1383
38. D. Roy, and N. Mukherjee Towards situated speech understanding: Visual context priming of language models Comput. Speech Language 19 2 2005 227 248
39. D. Roy, and A. Pentland Learning words from sights and sounds: A computational model Cognitive Sci. 26 1 2002 113 146
40. J. Siskind, Naive physics, event perception, lexical semantics, and language acquisition, PhD thesis, Massachusetts Institute of Technology, 1992
41. J. Siskind Grounding language in perception Artificial Intelligence Rev. 8 1995 371 391
42. J. Siskind Grounding the lexical semantics of verbs in visual perception using force dynamics and event logic J. Artificial Intelligence Res. 15 2001 31 90
43. M. Skubic, D. Perzanowski, S. Blisard, A. Schultz, W. Adams, M. Bugajska, and D. Brock Spatial language for human-robot dialogs IEEE Trans. Systems Man, Cybernet. C 34 2 2004 154 167
44. L. Steels Evolving grounded communication for robots Trends Cognitive Sci. 7 7 2003 308 312
45. L. Talmy Force dynamics in language and cognition Cognitive Sci. 12 1988 49 100
46. L. Talmy Toward a Cognitive Semantics 2000 MIT Press Cambridge, MA
47. M.K. Tanenhaus, M. Spivey-Knowlton, K. Eberhard, and J. Sedivy Integration of visual and linguistic information during spoken language comprehension Sci. 268 1995 1632 1634
48. T. Winograd A Process Model of Language Understanding 1973 Freeman New York pp. 152-186