Learning spatial-semantic representations from natural language descriptions and scene classifications

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2014, Pages 2623-2630

  Hemachandra, Sachithra ^a   Walter, Matthew R ^a   Tellex, Stefanie ^b   Teller, Seth ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b Brown Univerity   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONFORMAL MAPPING; NATURAL LANGUAGE PROCESSING SYSTEMS; TOPOLOGY;

ENVIRONMENT MODELS; NATURAL LANGUAGES; SCENE CLASSIFICATION; SEMANTIC INFORMATION; SEMANTIC PROPERTIES; SEMANTIC REPRESENTATION; TOPOLOGICAL HYPOTHESIS; TOPOLOGICAL REPRESENTATION;

SEMANTICS;

EID: 84929224891     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2014.6907235     Document Type: Conference Paper

References (21)

1. G. Bugmann, E. Klein, S. Lauria, and T. Kyriacou, "Corpus-based robotics: A route instruction example, " Proc. Intelligent Autonomous Systems, pp. 96-103, 2004.
2. J. Dzifcak, M. Scheutz, C. Baral, and P. Schermerhorn, "What to do and how to do it: Translating natural language directives into temporal and dynamic logic representation for goal management and action execution, " in Proc. IEEE Int'l Conf. on Robotics and Automation (ICRA), 2009, pp. 4163-4168.
3. C. Matuszek, D. Fox, and K. Koscher, "Following directions using statistical machine translation, " in Proc. ACM/IEEE Int'l. Conf. on Human-Robot Interaction (HRI), 2010, pp. 251-258.
4. S. Tellex, T. Kollar, S. Dickerson, M. R. Walter, A. G. Banerjee, S. Teller, and N. Roy, "Understanding natural language commands for robotic navigation and mobile manipulation, " in Proc. Nat'l Conf. on Artificial Intelligence (AAAI), 2011, pp. 1507-1514.
5. D. L. Chen and R. J. Mooney, "Learning to interpret natural language navigation instructions from observations, " in Proc. Nat'l Conf. on Artificial Intelligence (AAAI), 2011, pp. 859-865.
6. K. Nickel and R. Stiefelhagen, "Visual recognition of pointing gestures for human-robot interaction, " Image and Vision Computing, vol. 25, no. 12, pp. 1875-1884, Dec. 2007.
7. B. Kuipers, "The spatial semantic hierarchy, " Artificial Intelligence, vol. 119, no. 1, pp. 191-233, 2000.
8. H. Zender, O. Martínez Mozos, P. Jensfelt, G. Kruijff, and W. Burgard, "Conceptual spatial representations for indoor mobile robots, " Robotics and Autonomous Systems, vol. 56, no. 6, pp. 493-502, 2008.
9. S. Hemachandra, T. Kollar, N. Roy, and S. Teller, "Following and interpreting narrated guided tours, " in Proc. IEEE Int'l Conf. on Robotics and Automation (ICRA), 2011, pp. 2574-2579.
10. A. Pronobis and P. Jensfelt, "Large-scale semantic mapping and reasoning with heterogeneous modalities, " in Proc. IEEE Int'l Conf. on Robotics and Automation (ICRA), 2012, pp. 3515-3522.
11. M. R. Walter, S. Hemachandra, B. Homberg, S. Tellex, and S. Teller, "Learning semantic maps from natural language descriptions, " in Proc. Robotics: Science and Systems (RSS), 2013.
12. M. MacMahon, B. Stankiewicz, and B. Kuipers, "Walk the talk: Connecting language, knowledge, and action in route instructions, " in Proc. Nat'l Conf. on Artificial Intelligence (AAAI), 2006, pp. 1475-1482.
13. M. Skubic, D. Perzanowski, S. Blisard, A. Schultz, W. Adams, M. Bugajska, and D. Brock, "Spatial language for human-robot dialogs, " IEEE Trans. on Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol. 34, no. 2, pp. 154-167, 2004.
14. T. Kollar, S. Tellex, D. Roy, and N. Roy, "Toward understanding natural language directions, " in Proc. ACM/IEEE Int'l. Conf. on Human-Robot Interaction (HRI), 2010, pp. 259-266.
15. S. Tellex, P. Thaker, R. Deits, T. Kollar, and N. Roy, "Toward information theoretic human-robot dialog, " in Proc. Robotics: Science and Systems (RSS), 2012.
16. C. Matuszek, N. FitzGerald, L. Zettlemoyer, L. Bo, and D. Fox, "A joint model of language and perception for grounded attribute learning, " in Proc. Int'l Conf. on Machine Learning (ICML), 2012.
17. J.-L. Blanco, J. Gonzalez, and J. Fernandez-Madrigal, "Consistent observation grouping for generating metric-topological maps that improves robot localization, " in Proc. IEEE Int'l Conf. on Robotics and Automation (ICRA), 2006.
18. M. Kaess, A. Ranganathan, and F. Dellaert, "iSAM: Incremental smoothing and mapping, " Trans. on Robotics, vol. 24, no. 6, pp. 1365-1378, 2008.
19. J. M. Mooij, "libDAI: A free and open source C++ library for discrete approximate inference in graphical models, " J. Machine Learning Research, vol. 11, pp. 2169-2173, Aug. 2010.
20. O. Mozos, C. Stachniss, and W. Burgard, "Supervised learning of places from range data using adaboost, " in Proc. IEEE Int'l Conf. on Robotics and Automation (ICRA), 2005.
21. A. Pronobis, O. M. Mozos, B. Caputo, and P. Jensfelt, "Multimodal semantic place classification, " Int'l J. of Robotics Research, vol. 29, no. 2-3, pp. 298-320, Feb. 2010. [Online]. Available: http://www.pronobis.pro/publications/pronobis2010ijrr