Grounding new words on the physical world in multi-domain human-robot dialogues

AAAI Fall Symposium - Technical Report

Volumn FS-10-05, Issue , 2010, Pages 74-79

  Nakano, Mikio ^a   Iwahashi, Naoto ^b,c   Nagai, Takayuki ^d   Sumii, Taisuke ^b,e   Zuo, Xiang ^b,e   Taguchi, Ryo ^b,f   Nose, Takashi ^b,g   Mizutani, Akira ^d   Nakamura, Tomoaki ^d   Attamim, Muhanmad ^d   Narimatsu, Hiromi ^d   Funakoshi, Kotaro ^a   Hasegawa, Yuji ^a  

^a HONDA RESEARCH INSTITUTE JAPAN CO LTD   (Japan)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^c NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

^d UNIVERSITY OF ELECTRO COMMUNICATIONS   (Japan)

^e KYOTO INSTITUTE OF TECHNOLOGY   (Japan)

^f NAGOYA INSTITUTE OF TECHNOLOGY   (Japan)

^g TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; TECHNICAL PRESENTATIONS;

CONVERSATIONAL SERVICES; HOUSEHOLD ROBOTS; HUMAN-ROBOT DIALOGUE; LEXICAL ACQUISITION; MULTIPLE DOMAINS; PHYSICAL BEHAVIORS; SPEECH UNDERSTANDING; SPOKEN INTERACTION;

ROBOTS;

EID: 79960147222     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Attamimi, M.; Mizutani, A.; Nakamura, T.; Nagai, T.; Funakoshi, K.; and Nakano, M. (to appear). Real-time 3D visual sensor for robust object recognition. In Proc. IROS-2010.
2. Bazzi, I., and Glass, J. R. 2002. A multi-class approach for modelling out-of-vocabulary words. In Proc. 7th ICSLP, 1613-1616.
3. Choueiter, G. F.; Seneff, S.; and Glass, J. R. 2007. New word acquisition using subword modeling. In Proc. Interspeech-2007, 1765-1768.
4. Chung, G.; Seneff, S.; and Wang, C. 2003. Automatic acquisition of names using speak and spell mode in spoken dialogue systems. In Proc. NAACL-03, 32-39.
5. Gold, K.; Doniec, M.; Crick, C.; and Scassellati, B. 2009. Robotic vocabulary building using extension inference and implicit contrast. Artificial Intelligence 173:145-166.
6. Hartikainen, M.; Turunen, M.; Hakulinen, J.; Salonen, E.-P.; and Funk, J. A. 2004. Flexible dialogue management using distributed and dynamic dialogue control. In Proc. Interspeech-2004 (ICSLP), 197-200.
7. Holzapfel, H.; Neubig, D.; and Waibel, A. 2008. A dialogue approach to learning object descriptions and semantic categories. Robotics and Autonomous Systems 56(11):1004-1013.
8. Iwahashi, N. 2003. Language acquisition through a human-robot interface by combining speech, visual, and behavioral information. Information Sciences 156:109-121.
9. Kawahara, T.; Lee, A.; Takeda, K.; Itou, K.; and Shikano, K. 2004. Recent progress of open-source LVCSR engine Julius and Japanese model repository. In Proc. Interspeech-2004 (ICSLP), 3069-3072.
10. Komatani, K.; Kanda, N.; Nakano, M.; Nakadai, K.; Tsujino, H.; Ogata, T.; and Okuno, H. G. 2006. Multi-domain spoken dialogue system with extensibility and robustness against speech recognition errors. In Proc. 7th SIGdial Workshop, 9-17.
11. Lin, B.; Wang, H.; and Lee, L. 1999. Consistent dialogue across concurrent topics based on an expert system model. In Proc. 6th Eurospeech, 1427-1430.
12. Nakano, M.; Funakoshi, K.; Hasegawa, Y.; and Tsujino, H. 2008. A framework for building conversational agents based on a multiexpert model. In Proc. 9th SIGdial Workshop, 88-91.
13. Nishida, Y.; Aizawa, H.; Hori, T.; Hoffman, N.; Kanade, T.; and Kakikura, M. 2003. 3D ultrasonic tagging system for observing human activity. In Proc. IROS-2003, 785-791.
14. O'Neill, I.; Hanna, P.; Liu, X.; and McTear, M. 2004. Cross domain dialogue modelling: an object-based approach. In Proc. Interspeech-2004 (ICSLP), 205-208.
15. Onishi, S.; Yamamoto, H.; and Sagisaka, Y. 2001. Structured language model for class identification of out-of-vocabulary words arising from multiple word-classes. In Proc. Eurospeech-2001, 693-696.
16. Roy, D., and Pentland, A. 2002. Learning words from sights and sounds: a computational model. Cognitive Science 26:113-146.
17. Schaaf, T. 2001. Detection of OOV words using generalized word models and a semantic class language model. In Proc. Eurospeech-2007, 2581-2584.
18. Sumii, T.; Iwahashi, N.; Funakoshi, K.; Nakano, M.; and Oka, N. 2010. A speech interface for correcting misrecognized phonemes in out-of-vocabulary word acquisition. In Proc. Annual Conference of Japanese Society for Artificial Intelligence. (in Japanese).
19. Yu, C., and Ballard, D. 2004. On the integration of grounding language and learning objects. In Proc. 19th AAAI, 488-494.
20. Zuo, X.; Iwahashi, N.; Taguchi, R.; Matsuda, S.; Sugiura, K.; Funakoshi, K.; Nakano, M.; and Oka, N. 2010. Robot-directed speech detection using multimodal semantic confidence based on speech, image, and motion. In Proc. ICASSP-2010, 2458-2461.