Overriding errors in a speech and gaze multimodal architecture

International Conference on Intelligent User Interfaces, Proceedings IUI

Volumn , Issue , 2004, Pages 346-348

  Zhang, Qiaohui ^a   Go, Kentaro ^a   Imamiya, Atsumi ^a   Mao, Xiaoyang ^a  

^a UNIVERSITY OF YAMANASHI   (Japan)

Author keywords

Eye tracking; Multimodal architecture; Multimodal errors; Recognition errors; Speech input

Indexed keywords

COMPUTER ARCHITECTURE; COMPUTER SYSTEM RECOVERY; MULTIMEDIA SYSTEMS; PROBLEM SOLVING; SPEECH ANALYSIS; SPEECH PROCESSING;

EYE TRACKING; MULTIMODAL ARCHITECTURE; MULTIMODAL ERRORS; RECOGNITION ERRORS; SPEECH INPUT; SPEECH SIGNALS;

ERROR DETECTION;

EID: 18744368155     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/964482.964527     Document Type: Conference Paper

References (8)

1. Bolt, R. A. Put-that-there: Voice and Gesture in the graphics interface, in Proceedings of the ACM conference on Computer Graphics (New York, 1980), 262-270.
2. Campana, E. Baldridge, J. Dowding, J. Hockey, B. A. Remington, R.W. Stone, L.S. Using eye movements to determine referents in a spoken dialogue system, in Proceedings of Perceptive User Interface (Orland, FL, 2001).
3. Jacob, R. J. K. (1995). Eye tracking in advanced interface design, In W. Barfield & T. Furness (Ed.), Advanced Interface Design and Virtual Environments (pp. 258-288). Oxford: Oxford University Press
4. Koons, D.B., Sparrell, C.J., & Thorisson, K.R. Integrating simultaneous input from speech, gaze and hand gestures. M.Maybury (Eds.), Intelligent Multimedia Interfaces. Menlo Park, CA: MIT Press, 1993, 257-276.
5. Neal, J.G. Thielman C.Y. Dobes A. Haller S.M. Shapiro S.C. Natural language with integrated deictic and graphic gestures. M.T. Maybury & W. Wahlster(Eds.), Readings In Intelligent User Interfaces. San Francisco, CA: Morgan Kaufmann Press, 1998, 38-51.
6. Oviatt S.L. Mutual disambiguation of recognition errors in a multimodal Architecture, in Proceedings of CHI '99 (New York, N.Y., 1999). ACM Press, 576-583.
7. Tanaka, K. A robust selection system using real-time multimodal user-agent interactions, in Proceedings of the 1999 conference on Intelligent User Interfaces (Redondo Beach CA, 1999), 105-108.
8. Zhang Q.H., Imamiya A. & Go K. Text entry application based on gaze pointing, in Proceedings of 7th ERCIM Workshop User Interfaces For All (Paris, 2002). 87-102.