Two-way adaptation for robust input interpretation in practical multimodal conversation systems

International Conference on Intelligent User Interfaces, Proceedings IUI

Volumn , Issue , 2005, Pages 35-42

  Pan, Shimei ^a   Shen, Siwei ^b   Zhou, Michelle X ^a   Houck, Keith ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b Department of Ecology and Evolutionary Biology   (United States)

Author keywords

Adaptive systems; Context sensitive help; Intelligent multimodal interfaces; Multimodal input interpretation; Natural language understanding; Robust input interpretation

Indexed keywords

ADAPTIVE SYSTEMS; GESTURE RECOGNITION; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS;

CONTEXT-SENSITIVE HELP; INTELLIGENT MULTIMODAL INTERFACES; MULTIMODAL INPUT INTERPRETATION; ROBUST INPUT INTERPRETATION;

COMMUNICATION SYSTEMS;

EID: 33644597577     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1040830.1040849     Document Type: Conference Paper

References (24)

1. G. Ball. Mixing scripted interaction with task-oriented language processing in a conversational interface. In Proc. IUI '98, pages 101-103, 1998.
2. S. Bangalore and M. Johnston. Balancing data-driven and rule-based approaches in the context of a multimodal conversational system. In Proc. HLT-NAACL'04, 2004.
3. J. Chai, P. Hong, and M. Zhou. A probabilistic approach to reference resolution in multimodal user interfaces. In Proc. IUI'04, pages 70-77, 2004.
4. J. Chai, S. Pan, M. Zhou, and K. Houck. Context-based multi-modal input understanding in conversation systems. In Proc. ICMI '02, pages 87-92, 2002.
5. M. Gavalda. Interactive sentence repair. In Proc. ESSLLI '98, 1998.
6. M. Gilleland. Levenshtein distance, in three flavors, http://www.merriampark.com/ld.htm.
7. H. Hastie, M. Johnston, and P. Ehlen. Context-sensitive help for multimodal dialogue. In Proc. ICMI '02, 2002.
8. K. Houck. Contextual revision in information-seeking conversation systems. In Proc. ICSLP '04, 2004. To appear.
9. L. D. Kamm, C. and M. Walker. From novice to expert: The effect of tutorials on user expertise with spoken dialogue systems. In Proc. ICSLP'98, 1998.
10. C. Lee and Y. Xu. Online interactive learning of gestures for human-robot interfaces. In Proc. Robotics and Automation '96, pages 2982-2987. IEEE, 1996.
11. J. Lehman. Adaptive parsing: Self-extending natural language interfaces. PhD thesis, CMU, 1989.
12. V. Levenshtein. Binary codes capable of correcting deletions, insertions and reversals. Soviet Physics-Doklady, 10(8):707-710, 1966.
13. D. Litman, S. Pan, and M. Walker. Evaluating response strategies in a web-based spoken dialogue agent. In Proc. ACL/ COLING'98, 1998.
14. C. Manning and H. Schutze. Foundations of statistical natural language processing. 2001.
15. M. McCord. Heuristics for broad-coverage natural language parsing. In Proc. ARPA HLT Workshop, 1993.
16. S. Oviatt. Multimodal interfaces for dynamic interactive maps. In Proc. CHI '96, pages 95-102. ACM, 1996.
17. S. Oviatt. Mutual disambiguation of recognition errors in a multimodal architecture. In Proc. CHI '99, pages 576-583, 1999.
18. S. Pan and J. Shaw. SEGUE: A hybrid case-based natural language generator. In Proc. INLG '04, pages 130-140, 2004.
19. A. Rashid, I. Albert, D. Cosley, S. Lam, S. McNee, and J. a. Konstan. Getting to know you: learning new user preferences in recommender systems. In Proc. IUI '02, pages 127-134, 2002.
20. P. Resnick, N. Iacovou, M. Sushak, P. Bergstrom, and J. Riedl. Grouplens: an open architecture for collaborative filtering of netnews. In Proc. CSCW'94, pages 175-186, 1994.
21. D. Roy and A. Pentland. Word learning in a multimodal environment. In Proc. ICASSP'98, 1998.
22. G. Salton. Automatic Text Processing: The Transformation, Analysis and Retrieval of Information by Computer. Addison-Wesley, 1989.
23. M. Walker, D. Litman, C. Kamm, and A. Abella. Evaluating spoken dialogue agents with paradise: Two case studies. Computer Speech and Language, 12.
24. M. Walker, D. Litman, C. Kamm, and A. Abella. PARADISE: A framework for evaluating spoken dialogue agents. In Proceedings ACL-97, pages 271-280, 1997.