Skipping spare information in multimodal inputs during multimodal input fusion

International Conference on Intelligent User Interfaces, Proceedings IUI

Volumn , Issue , 2009, Pages 451-455

  Sun, Yong ^a,b   Shi, Yu ^a   Chen, Fang ^a,b   Chung, Vera ^a  

^a CSIRO   (Australia)

^b UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Processing of multimodal input; Spare information in multimodal input

Indexed keywords

CRITICAL COMPONENT; EYE-GAZE; MULTI-MODAL; MULTI-MODAL INTERFACES; MULTIMODAL INPUT FUSION; MULTIPLE MODALITIES; SEMANTIC INTERPRETATION; SPARE INFORMATION IN MULTIMODAL INPUT;

INTERACTIVE COMPUTER SYSTEMS; KNOWLEDGE MANAGEMENT; SEMANTICS; USER INTERFACES;

HUMAN COMPUTER INTERACTION;

EID: 77953870230     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1502650.1502717     Document Type: Conference Paper

References (8)

1. Bangalore S., and Johnston M. Integrating multimodal language processing with speech recognition. In Proceedings of Sixth International Conference on Spoken Language Processing. October 16-20, Beijing, China, 2000.
2. Jacob R. J. K. The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look At is What You Get. ACM Transactions on Information Systems. Vol. 9, No3, April 1991, Pages 152-169.
3. Johnston M. Unification-based Multimodal Parsing. In Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics - Volume 1. p624-630, Montreal, Quebec, Canada 1998.
4. Kaiser E., Demirdjian D., Gruenstein A., Li X., Niekrasz J., Wesson M., and Kumar S. Demo: A Multimodal Learning Interface for Sketch, Speak, and Point Creation of a Schedule Chart. In Proceedings of the 6th International Conference on Multimodal Interfaces. October 13-15, State College, PA, USA 2004.
5. Oviatt S. Mutual Disambiguation of Recognition Errors in a Multimodal Architecture. In Proceedings of Proceeding of the CHI 99 Conference on Human Factors in Computing Systems. p576-583, May 15-20, Pittsburgh, PA, USA, 1999.
6. Rudzicz F. Clavius: Bi-Directional Parsing for Generic Multimodal Interaction. In Proceedings of Joint Conference of the International Committee on Computational Linguistics and the Association for Computational Linguistics (COLING/ACL-06 SRW), July 17-21, Sydney, Australia 2006.
7. Sun Y., Prendinger H., Shi Y., Chen F., Chung V. and Ishizuka M. THE HINGE between Input and Output: Understanding the Multimodal Input Fusion Results in an Agent-based Multimodal Presentation System. In Proceedings of CHI '08 extended abstracts on Human factors in computing systems. Florence, Italy, 2008.
8. Sun Y., Shi Y., Chen F. and Chung V. An Efficient Unification-based Multimodal Language Processor in Multimodal Input Fusion. In Proceedings of Proceedings of the 19th Australasian conference on Computer-Human Interaction. Adelaide, Australia 2007.