Benchmarking fusion engines of multimodal interactive systems

ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces

Volumn , Issue , 2009, Pages 169-176

  Dumas, Bruno ^a   Ingold, Rolf ^a   Lalanne, Denis ^a  

^a UNIVERSITY OF FRIBOURG   (Switzerland)

Author keywords

Fusion engines evaluation; Multimodal fusion; Multimodal interfaces; Multimodal toolkit

Indexed keywords

EVALUATION FRAMEWORK; FUSION ENGINES; MULTI-MODAL; MULTI-MODAL FUSION; MULTI-MODAL INTERFACES; MULTIMODAL INTERACTIVE SYSTEMS; PERFORMANCE LEVEL; QUANTITATIVE EVALUATION;

INTERACTIVE COMPUTER SYSTEMS; LEARNING SYSTEMS; TEST FACILITIES; TESTBEDS;

ENGINES;

EID: 74049107197     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1647314.1647345     Document Type: Conference Paper

References (22)

1. Bertoncini, M. Cavazza, M. Emotional Multimodal Interfaces for Digital Media: The CALLAS Challenge. In Proceedings of HCI International 2007, Beijing (2007).
2. Bolt, R.A. Put-that-there: voice and gesture at the graphics interface. Computer Graphics, 14(3), pp. 262-270 (1980).
3. Bouchet, J., Nigay, L., Ganille, T.: ICARE Software Components for Rapidly Developing Multimodal Interfaces. In: Conference Proceedings of ICMI'2004, State College, Pennsylvania, USA, Oct. 2004, ACM Press, pp. 251-258.
4. Bourguet, M. L.: A Toolkit for Creating and Testing Multimodal Interface Designs. In: companion proceedings of UIST'02, Paris, Oct. 2002, pp. 29-30 (2002).
5. Bui T.H.: Multimodal Dialogue Management - State of the Art. CTIT Technical Report series No. 06-01, University of Twente (UT), Enschede, The Netherlands (2006).
6. Cohen, P. R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., Clow, J.: QuickSet: multimodal interaction for distributed applications. In: Proceedings of the Fifth ACM international Conference on Multimedia, Seattle, USA, pp. 31-40, (1997).
7. Coutaz, J., Nigay, L., Salber, D., Blandford, A., May, J. Young, R.: Four Easy Pieces for Assessing the Usability of Multimodal Interaction: The CARE properties. In: Proceedings of INTERACT'95, Lillehammer, Norway, June 1995, pp. 115-120, Chapman & Hall Publ. (1995).
8. Dumas, B., Lalanne, D., Ingold, R.: Prototyping Multimodal Interfaces with SMUIML Modeling Language. In: CHI 2008 Workshop on User Interface Description Languages for Next Generation User Interfaces, CHI 2008, Firenze, Italy, pp. 63-66 (2008).
9. Dumas, B., Lalanne, D., Oviatt, S. "Multimodal Interfaces: A Survey of Principles, Models and Frameworks". In Denis Lalanne, Jürg Kohlas eds. Human Machine Interaction, LNCS 5440, Springer-Verlag, pp. 3-26 (2009)
10. Dumas, B., Lalanne, D., Guinard, D., Ingold, R., Koenig, R.: Strengths and Weaknesses of Software Architectures for the Rapid Creation of Tangible and Multimodal Interfaces. In: Proceedings of 2nd international conference on Tangible and Embedded Interaction (TEI 2008), Bonn (Germany), February 19-21 2008 , pp. 47-54 (2008).
11. EMMA: Extensible MultiModal Annotation markup language: W3C recommandation. http://www.w3.org/TR/emma/
12. Flippo, F., Krebs, A. Marsic I.: A Framework for Rapid Development of Multimodal Interfaces. In: Proceedings of ICMI'03, Vancouver, BC, Nov. 5-7, pp. 109-116 (2003).
13. Garofolo, J. Overcoming Barriers to Progress in Multimodal Fusion Research. In AAAI Fall 2008 Symposium Proceedings (2008).
14. Holzapfel, H., Nickel, K., and Stiefelhagen, R. Implementation and evaluation of a constraint-based multimodal fusion system for speech and 3D pointing gestures. In Proceedings of ICMI '04 (State College, PA, USA, October 13-15, 2004). ACM, New York, NY, pp. 175-182 (2004).
15. Johnston, M., Cohen, P. R., McGee, D., Oviatt, S. L., Pittman, J. A., Smith, I.: Unification-based multimodal integration. In: Proceedings of the Eighth Conference on European Chapter of the Association For Computational Linguistics (Madrid, Spain, July 07-12, 1997), pp. 281-288.
16. Krahnstoever, N., Kettebekov, S., Yeasin, M. Sharma, R.: A real-time framework for natural multimodal interaction with large screen displays. In: ICMI'02, Pittsburgh, USA, Oct. 2002 (2002).
17. Lawson, J-Y., Al-Akkad, A., Vanderdonckt, J. and Macq, B. An Open Source Workbench for Prototyping Multimodal Interactions Based on Off-The-Shelf Heterogeneous Components. Proceedings of the First ACM SIGCHI Symposium on Engineering Interactive Computing Systems, ACM Press, USA, July 14-17, 2009.
18. Nigay, L., Coutaz, J.A.: Design space for multimodal systems: concurrent processing and data fusion. In Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (Amsterdam, The Netherlands, April 24-29, 1993). ACM, New York, NY, pp. 172-178 (1993).
19. Oviatt, S.L.: Ten myths of multimodal interaction. In: Communications of the ACM, 42(11), New York: ACM Press, pp. 74-81 (1999).
20. Oviatt, S. L., Cohen, P. R., Wu, L., Vergo, J., Duncan, L., Suhm, B., Bers, J., Holzman, T., Winograd, T., Landay, J., Larson, J., Ferro, D.: Designing the user interface for multimodal speech and gesture applications: State-of-the-art systems and research directions. In: Human Computer Interaction, 2000, vol. 15, no. 4, pp. 263-322 [Reprinted in Human-Computer Interaction in the New Millennium (ed. J. Carroll), Addison-Wesley Press, Reading, MA, 2001; chapter 19, pp. 421-456] (2000).
21. Oviatt, S.L., Coulston, R., Tomko, S., Xiao, B., Lunsford, R., Wesson, M., Carmichael, L.: Toward a theory of organized multimodal integration patterns during human-computer interaction. In: Proceedings of ICMI 2003, ACM Press, pp. 44-51 (2003).
22. Sharma, R., Pavlovic, V. I., Huang, T.S.: Toward multimodal human-computer interface. In: Proceedings IEEE, 86(5) [Special issue on Multimedia Signal Processing], pp. 853-860 (1998).