Multimodal interaction history and its use in error detection and recovery

ICMI 2014 - Proceedings of the 2014 International Conference on Multimodal Interaction

Volumn , Issue , 2014, Pages 164-171

  Schüssel, Felix ^a   Honold, Frank ^a   Schmidt, Miriam ^a   Bubalo, Nikola ^a   Huckauf, Anke ^a   Weber, Michael ^a  

^a UNIVERSITY OF ULM   (Germany)

Author keywords

HCI; Input error detection and recovery; Interaction history; Multimodal interaction; User behavior

Indexed keywords

BEHAVIORAL RESEARCH; ERRORS; HUMAN COMPUTER INTERACTION; INTERACTIVE COMPUTER SYSTEMS; RECOVERY; USER INTERFACES;

CLASSIFICATION SCHEME; ERROR DETECTION AND RECOVERY; INTERACTION HISTORY; MULTI-MODAL INTERACTIONS; MULTIMODAL INPUTS; MULTIMODAL SYSTEM; TEMPORAL DISTRIBUTION; USER BEHAVIORS;

ERROR DETECTION;

EID: 84947272531     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2663204.2663255     Document Type: Conference Paper

References (10)

1. P. Dey, S. Madhvanath, A. Ranjan, and S. Das. An exploration of gesture-speech multimodal patterns for touch interfaces. In Proc. of the 3rd Int. Conference on Human Computer Interaction, IndiaHCI '11, pages 79{83, New York, 2011. ACM.
2. E. C. Haas, K. S. Pillalamarri, C. C. Stachowiak, and G. McCullough. Temporal binding of multimodal controls for dynamic map displays: A systems approach. In Proc. of the 13th international conference on multimodal interfaces, ICMI '11, pages 409{416, New York, 2011. ACM.
3. X. Huang and S. L. Oviatt. Toward adaptive information fusion in multimodal systems. In S. Renals and S. Bengio, editors, Machine Learning for Multimodal Interaction, MLMI 2005, Edinburgh, UK, volume 3869/2006 of Lecture Notes in Computer Science, pages 15{27. Springer, 2005.
4. X. Huang, S. L. Oviatt, and R. Lunsford. Combining user modeling and machine learning to predict users' multimodal integration patterns. In S. Renals, S. Bengio, and J. G. Fiscus, editors, Machine Learning for Multimodal Interaction, MLMI 2006, Bethesda, USA, volume 4299/2006 of LNCS, pages 50{62. Springer, 2006.
5. M. Lee and M. Billinghurst. A wizard of oz study for an ar multimodal interface. In Proc. of the 10th international conference on Multimodal interfaces, ICMI '08, pages 249{256, New York, 2008. ACM.
6. S. Oviatt, P. Cohen, L. Wu, J. Vergo, L. Duncan, B. Suhm, J. Bers, T. Holzman, T. Winograd, J. Landay, J. Larson, and D. Ferro. Designing the user interface for multimodal speech and pen-based gesture applications: state-of-the-art systems and future research directions. Human-Computer Interaction, 15(4):263{322, 2000.
7. S. Oviatt, R. Coulston, and R. Lunsford. When do we interact multimodally?: cognitive load and multimodal communication patterns. In ICMI '04: Proc. of the 6th international conference on Multimodal interfaces, pages 129{136, New York, 2004. ACM.
8. S. Oviatt, R. Coulston, S. Tomko, B. Xiao, R. Lunsford, M. Wesson, and L. Carmichael. Toward a theory of organized multimodal integration patterns during human-computer interaction. In ICMI '03: Proc. of the 5th international conference on Multimodal interfaces, pages 44{51, New York, 2003. ACM.
9. S. Oviatt, R. Lunsford, and R. Coulston. Individual di-erences in multimodal integration patterns: What are they and why do they exist? In CHI '05: Proc. of the SIGCHI conference on Human factors in computing systems, pages 241{249, New York, 2005. ACM.
10. F. Schüssel, F. Honold, and M. Weber. Using the transferable belief model for multimodal input fusion in companion systems. In F. Schwenker, S. Scherer, and L.-P. Morency, editors, Multimodal Pattern Recognition of Social Signals in HCI, volume 7742 of LNCS, pages 100{115. Springer Berlin Heidelberg, 2013.