Toward understanding natural language directions

5th ACM/IEEE International Conference on Human-Robot Interaction, HRI 2010

Volumn , Issue , 2010, Pages 259-266

  Kollar, Thomas ^a   Tellex, Stefanie ^b   Roy, Deb ^b   Roy, Nicholas ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b MIT MEDIA LAB   (United States)

Author keywords

Direction understanding; Route instructions; Spatial language

Indexed keywords

CO-OCCURRENCE STATISTICS; KEY COMPONENT; NATURAL LANGUAGES; PROBABILISTIC GRAPHICAL MODELS; SPATIAL DESCRIPTIONS; SPATIAL LANGUAGE; SPATIAL REASONING; SPATIAL RELATIONS; UNCERTAIN ENVIRONMENTS;

HUMAN COMPUTER INTERACTION; LINGUISTICS; MAN MACHINE SYSTEMS; QUERY LANGUAGES;

HUMAN ROBOT INTERACTION;

EID: 77951550992     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1734454.1734553     Document Type: Conference Paper

References (19)

1. G. Bugmann, E. Klein, S. Lauria, and T. Kyriacou, "Corpus-based robotics: A route instruction example," Proceedings of Intelligent Autonomous Systems, pp. 96-103, 2004.
2. M. Levit and D. Roy, "Interpretation of spatial language in a map navigation task," Systems, Man, and Cybernetics, Part B, IEEE Transactions on, vol. 37, no. 3, pp. 667-679, 2007. (Pubitemid 46784600)
3. M. MacMahon, B. Stankiewicz, and B. Kuipers, "Walk the talk: Connecting language, knowledge, and action in route instructions," Proceedings of the National Conference on Artificial Intelligence, pp. 1475-1482, 2006.
4. G. Look, B. Kottahachchi, R. Laddaga, and H. Shrobe, "A location representation for generating descriptive walking directions," in International Conference on Intelligent User Interfaces, 2005, pp. 122-129. (Pubitemid 43310473)
5. J. Dzifcak, M. Scheutz, C. Baral, and P. Schermerhorn, "What to do and how to do it: Translating natural language directives into temporal and dynamic logic representation for goal management and action execution," in IEEE International Conference on Robotics and Automation, 2009, pp. 4163-4168.
6. M. Skubic, D. Perzanowski, S. Blisard, A. Schultz, W. Adams, M. Bugajska, and D. Brock, "Spatial language for human-robot dialogs," Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, vol. 34, no. 2, pp. 154-167, 2004.
7. A. Bauer, K. Klasing, G. Lidoris, Q. Mhlbauer, F. Rohrmller, S. Sosnowski, T. Xu, K. Khnlenz, D. Wollherr, and M. Buss, "The Autonomous City Explorer: Towards natural human-robot interaction in urban environments," International Journal of Social Robotics, vol. 1, no. 2, pp. 127-140, Apr. 2009.
8. B. Landau and R. Jackendoff, ""What" and "where" in spatial language and spatial cognition," Behavioral and Brain Sciences, vol. 16, pp. 217-265, 1993.
9. L. Talmy, "The fundamental system of spatial schemas in language," in From Perception to Meaning: Image Schemas in Cognitive Linguistics, B. Hamp, Ed. Mouton de Gruyter, 2005.
10. B. Levin, English Verb Classes and Alternations: A Preliminary Investigation. University Of Chicago Press, Sep. 1993.
11. T. P. Regier, "The acquisition of lexical semantics for spatial terms: A connectionist model of perceptual categorization," Ph.D. dissertation, University of California at Berkeley, 1992.
12. J. D. Kelleher and F. J. Costello, "Applying computational models of spatial prepositions to visually situated dialog," Computational Linguistics, vol. 35, no. 2, pp. 271-306, Jun. 2009.
13. Y. Wei, E. Brunskill, T. Kollar, and N. Roy, "Where to go: Interpreting natural directions using global inference," in IEEE International Conference on Robotics and Automation, 2009.
14. G. Grisetti, C. Stachniss, and W. Burgard, "Improved techniques for grid mapping with Rao-Blackwellized particle filters," IEEE Transactions on Robotics, vol. 23, no. 1, pp. 34-46, 2007. (Pubitemid 46443340)
15. T. Kudo, "CRF++: Yet another CRF toolkit," http://crfpp. sourceforge.net, 2009.
16. E. Brunskill, T. Kollar, and N. Roy, "Topological mapping using spectral clustering and classification," in International Conference on Intelligent Robots and Systems, October 2007, pp. 3491-3496.
17. T. Kollar and N. Roy, "Utilizing object-object and object-scene context when planning to find things." in IEEE International Conference on Robotics and Automation, 2009.
18. S. Tellex and D. Roy, "Grounding spatial prepositions for video search," in Proceedings of the International Conference on Multimodal Interfaces, 2009.
19. A. Viterbi, "Error bounds for convolutional codes and an asymptotically optimum decoding algorithm," Information Theory, IEEE Transactions on, vol. 13, no. 2, pp. 260-269, 1967.