Learning models for following natural language directions in unknown environments

Proceedings - IEEE International Conference on Robotics and Automation

Volumn 2015-June, Issue June, 2015, Pages 5608-5615

  Hemachandra, Sachithra ^a   Duvallet, Felix ^b   Howard, Thomas M ^c   Roy, Nicholas ^a   Stentz, Anthony ^b   Walter, Matthew R ^d  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c UNIVERSITY OF ROCHESTER   (United States)

^d TOYOTA TECHNOLOGICAL INSTITUTE AT CHICAGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGRICULTURAL ROBOTS; INFERENCE ENGINES; ROBOTICS; ROBOTS; SEMANTICS;

ENVIRONMENT MODELING; IMITATION LEARNING; LEARNING FRAMEWORKS; NATURAL LANGUAGES; NAVIGATION COMMANDS; ROUTE DIRECTIONS; SEMANTIC INFORMATION; SEMANTIC PROPERTIES;

LEARNING SYSTEMS;

EID: 84938271968     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2015.7139984     Document Type: Conference Paper

References (23)

1. S. Hemachandra, T. Kollar, N. Roy, and S. Teller, "Following and interpreting narrated guided tours," in Proc. IEEE Int'l Conf. on Robotics and Automation (ICRA), 2011.
2. M. MacMahon, B. Stankiewicz, and B. Kuipers, "Walk the talk: Connecting language, knowledge, and action in route instructions," in Proc. Nat'l Conf. on Artificial Intelligence (AAAI), 2006.
3. T. Kollar, S. Tellex, D. Roy, and N. Roy, "Toward understanding natural language directions," in Proc. Int'l. Conf. on Human-Robot Interaction, 2010.
4. D. L. Chen and R. J. Mooney, "Learning to interpret natural language navigation instructions from observations," in Proc. Nat'l Conf. on Artificial Intelligence (AAAI), 2011.
5. C. Matuszek, N. FitzGerald, L. Zettlemoyer, L. Bo, and D. Fox, "A joint model of language and perception for grounded attribute learning," in Proc. Int'l Conf. on Machine Learning (ICML), 2012.
6. S. Tellex, T. Kollar, S. Dickerson, M. R. Walter, A. G. Banerjee, S. Teller, and N. Roy, "Understanding natural language commands for robotic navigation and mobile manipulation," in Proc. Nat'l Conf. on Artificial Intelligence (AAAI), 2011.
7. T. Howard, S. Tellex, and N. Roy, "A natural language planner interface for mobile manipulators," in Proc. IEEE Int'l Conf. on Robotics and Automation (ICRA), 2014.
8. M. R. Walter, S. Hemachandra, B. Homberg, S. Tellex, and S. Teller, "Learning semantic maps from natural language descriptions," in Proc. Robotics: Science and Systems (RSS), 2013.
9. S. Hemachandra, M. R. Walter, S. Tellex, and S. Teller, "Learning spatial-semantic representations from natural language descriptions and scene classifiers," in Proc. IEEE Int'l Conf. on Robotics and Automation (ICRA), 2014.
10. F. Duvallet, M. R. Walter, T. Howard, S. Hemachandra, J. Oh, S. Teller, N. Roy, and A. Stentz, "Inferring maps and behaviors from natural language instructions," in Proc. Int'l. Symp. on Experimental Robotics (ISER), 2014.
11. C. Matuszek, E. Herbst, L. Zettlemoyer, and D. Fox, "Learning to parse natural language commands to a robot control system," in Proc. Int'l. Symp. on Experimental Robotics (ISER), 2012.
12. F. Duvallet, T. Kollar, and A. Stentz, "Imitation learning for natural language direction following through unknown environments," in Proc. IEEE Int'l Conf. on Robotics and Automation (ICRA), 2013.
13. H. Zender, O. Martínez Mozos, P. Jensfelt, G. Kruijff, and W. Burgard, "Conceptual spatial representations for indoor mobile robots," Robotics and Autonomous Systems, 2008.
14. A. Pronobis, O. Martínez Mozos, B. Caputo, and P. Jensfelt, "Multimodal semantic place classification," Int'l J. of Robotics Research, 2010.
15. T. Williams, R. Cantrell, G. Briggs, P. Schermerhorn, and M. Scheutz, "Grounding natural language references to unvisited and hypothetical locations," in Proc. Nat'l Conf. on Artificial Intelligence (AAAI), 2013.
16. T. M. Howard, I. Chung, O. Propp, M. R. Walter, and N. Roy, "Efficient natural language interfaces for assistive robots," in IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems (IROS) Work. on Rehabilitation and Assistive Robotics, 2014.
17. M. Kaess, A. Ranganathan, and F. Dellaert, "iSAM: Incremental smoothing and mapping," Trans. on Robotics, 2008.
18. A. Doucet, N. de Freitas, K. Murphy, and S. Russell, "Rao-Blackwellised particle filtering for dynamic Bayesian networks," in Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI), 2000.
19. E. Olson, "AprilTag: A robust and flexible visual fiducial system," in Proc. IEEE Int'l Conf. on Robotics and Automation (ICRA), May 2011.
20. A. Smola, A. Gretton, L. Song, and B. Schlkopf, "A Hilbert space embedding for distributions," in In Algorithmic Learning Theory: 18th International Conference, 2007.
21. K. Crammer and Y. Singer, "On the Algorithmic Implementation of Multiclass Kernel-based Vector Machines," Journal of Machine Learning Research, 2002.
22. N. D. Ratliff, J. A. Bagnell, and M. A. Zinkevich, "Maximum Margin Planning," in Proc. Int'l Conf. on Machine Learning (ICML), 2006.
23. S. Ross, G. J. Gordon, and J. A. Bagnell, "A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning," in International Conference on Artificial Intelligence and Statistics, 2011.