The automated interplay of multimodal fission and fusion in adaptive HCI

Proceedings - 2014 International Conference on Intelligent Environments, IE 2014

Volumn , Issue , 2014, Pages 170-177

  Honold, Frank ^a   Schussel, Felix ^a   Weber, Michael ^a  

^a UNIVERSITY OF ULM   (Germany)

Author keywords

companion technology; fission; fusion; HCI; interaction management; multi modal; multimodal

Indexed keywords

FUSION REACTIONS;

COMMUNICATION SKILLS; CONTEXT-AWARE SYSTEMS; FISSION; INTERACTION MANAGEMENT; MULTI-MODAL; MULTIMODAL INPUTS; TWO-COMPONENT; USER INITIATIVES;

HUMAN COMPUTER INTERACTION;

EID: 84908641707     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IE.2014.32     Document Type: Conference Paper

References (25)

1. B. Dumas, D. Lalanne, and S. Oviatt, "Multimodal interfaces: A survey of principles, models and frameworks," in Human Machine Interaction-Research Results of the MMI Program, ser. LNCS. Berlin: Springer, March 2009, vol. 5440/2009, ch. 1, pp. 3-26.
2. M. Blumendorf, D. Roscher, and S. Albayrak, "Dynamic user interface distribution for flexible multimodal interaction," in ICMI-Workshop on Machine Learning for Multimodal Interaction, ser. ICMI-MLMI '10. New York, NY, USA: ACM, 2010, pp. 20:1-20:8.
3. C. Duarte and L. Carrico, "A conceptual framework for developing adaptive multimodal applications," in IUI '06: Proc. of the 11th int. conf. on Intelligent User Interfaces. New York, USA: ACM, 2006, pp. 132-139.
4. S. Oviatt, "Multimodal interfaces," in The Human-Computer Interaction Handbook, A. Sears and J. A. Jacko, Eds. CRC Press, 2007, pp. 413-432.
5. W. Wahlster, SmartKom: Foundations of Multimodal Dialogue Systems, ser. Cognitive Technologies Series, J. te Vrugt, V. Zeissler, and W. Wahlster, Eds. Heidelberg: Springer, 2006.
6. F. Nothdurft, G. Bertrand, T. Heinroth, and W. Minker, "GEEDI-Guards for Emotional and Explanatory DIalogues," in 6th Int. Conf. on Intelligent Environments (IE'10). IEEE Computer Society, 2010, pp. 90-95.
7. D. Costa and C. Duarte, "Adapting multimodal fission to user's abilities," in Proc. of the 6th int. conf. on Universal access in human-computer interaction: design for all and eInclusion-Volume Part I, ser. UAHCI'11. Berlin: Springer, 2011, pp. 347-356.
8. M. E. Foster, "State of the art review: Multimodal fission," University of Edinburgh, Public Deliverable 6.1, September 2002, cOMIC Project.
9. C. Rousseau, Y. Bellik, F. Vernier, and D. Bazalgette, "A framework for the intelligent multimodal presentation of information," Signal Process., vol. 86, no. 12, pp. 3696-3713, 2006.
10. M. D. Hina, C. Tadj, A. Ramdane-Cherif, and N. Levy, "A Multi-Agent based Multimodal System Adaptive to the User's Interaction Context," in Multi-Agent Systems-Modeling, Interactions, Simulations and Case Studies. InTech, 2011, ch. 2, pp. 29-56.
11. D. Roscher, M. Blumendorf, and S. Albayrak, "A meta user interface to control multimodal interaction in smart environments," in Proc. of the 14th int. conf. on Intelligent user interfaces, ser. IUI '09. NY, USA: ACM, 2009, pp. 481-482.
12. F. Honold, F. Schüssel, and M. Weber, "Adaptive probabilistic fission for multimodal systems," in Proceedings of the 24th Australian Computer-Human Interaction Conference, ser. OzCHI '12. New York, NY, USA: ACM, November, 26-30 2012, pp. 222-231.
13. P. Atrey, M. Hossain, A. El Saddik, and M. Kankanhalli, "Multimodal fusion for multimedia analysis: a survey," Multimedia Systems, vol. 16, pp. 345-379, 2010.
14. L. Nigay and J. Coutaz, "A generic platform for addressing the multimodal challenge," in CHI '95: Proc. of the SIGCHI conf. on Human factors in computing systems. ACM Press, 1995, pp. 98-105.
15. M. T. Vo and C. Wood, "Building an application framework for speech and pen input integration in multimodal learning interfaces," in Int. Conf. on Acoustics, Speech, and Signal Processing, 1996. ICASSP-96, vol. 6. IEEE, May 1996, pp. 3545-3548 vol. 6.
16. H. Holzapfel, K. Nickel, and R. Stiefelhagen, "Implementation and evaluation of a constraint-based multimodal fusion system for speech and 3D pointing gestures," in Proc. of the 6th Int. Conf. on Multimodal Interfaces, ser. ICMI '04. New York, NY, USA: ACM, 2004, pp. 175-182.
17. N. Pfleger, "Context based multimodal fusion," in ICMI '04: Proc. of the 6th int. conf. on Multimodal interfaces. NY, USA: ACM, 2004, pp. 265-272.
18. J. Bouchet, L. Nigay, and T. Ganille, "Icare software components for rapidly developing multimodal interfaces," in ICMI '04: Proc. of the 6th int. conf. on Multimodal interfaces. New York, NY, USA: ACM, 2004, pp. 251-258.
19. B. Dumas, R. Ingold, and D. Lalanne, "Benchmarking fusion engines of multimodal interactive systems," in ICMIMLMI '09: Proc. of the 2009 Int. Conf. on Multimodal Interfaces. New York, NY, USA: ACM, 2009, pp. 169-176.
20. L. Wu, S. Oviatt, and P. Cohen, "From members to teams to committee-a robust approach to gestural and multimodal recognition," IEEE Transactions on Neural Networks, vol. 13, no. 4, pp. 972-982, Jul 2002.
21. F. Schüssel, F. Honold, and M. Weber, "Using the transferable belief model for multimodal input fusion in companion systems," in Multimodal Pattern Recognition of Social Signals in HCI, ser. LNCS, vol. 7742. Springer, 2013, pp. 100-115.
22. U. Brandes, M. Eiglsperger, I. Herman, M. Himsolt, and M. Marshall, "Graphml progress report: Structural layer proposal," in Graph Drawing, ser. LNCS, P. Mutzel, M. Jünger, and S. Leipert, Eds. Springer Berlin, 2002, vol. 2265, pp. 501-512.
23. M. Schröder, "The semaine api towards a standards-based framework for building emotion-oriented systems," Adv. in Hum.-Comp. Int., vol. 2010, p. 21, January 2010.
24. A. Schmidt, "Implicit human computer interaction through context," Personal Technologies, vol. 4, pp. 191-199, June 2000.
25. F. Honold, F. Schüssel, M. Weber, F. Nothdurft, G. Bertrand, and W. Minker, "Context models for adaptive dialogs and multimodal interaction," in Proc. of the 9th Int. Conf. on Intelligent Environments-IE'13. Athens, Greece: IEEE, July 2013.