A fusion framework for multimodal interactive applications

ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces

Volumn , Issue , 2009, Pages 161-168

  Mendonça, Hildeberto ^a   Lawson, Jean Yves Lionel ^a   Vybornova, Olga ^a   MacQ, Benoit ^a   Vanderdonckt, Jean ^a  

^a UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

Author keywords

Context sensitive interaction; Multi modal fusion; Speech recognition

Indexed keywords

CONTEXT-SENSITIVE; INTERACTIVE APPLICATIONS; LOW-LEVEL FEATURES; MULTI-MODAL; MULTI-MODAL FUSION; OFFICE ENVIRONMENTS; USER EXPERIENCE; USER INTENTION;

INTERACTIVE COMPUTER SYSTEMS; LEARNING SYSTEMS;

SPEECH RECOGNITION;

EID: 74049112783     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1647314.1647344     Document Type: Conference Paper

References (28)

1. V. Akman. From discourse to logic: Introduction to model-theoretic semantics of natural language, formal logic and discourse representation theory. Computational Linguistics, 21(2):265-268, June 1995.
2. J. Bouchet and L. Nigay. Icare: A component-based approach for the design and development of multimodal interfaces. In CHI '04 Extended Abstracts on Human Factors in Computing Systems, Vienna, 2004.
3. G. Calvary, J. Coutaz, D. Thevenin, Q. Limbourg, L. Bouillon, and J. Vanderdonckt. A unifying reference framework for multi-target user interfaces. Interacting with Computers, Vol. 15(No. 3):289-308, June 2003.
4. U. catholique de Louvain. Interface de recherche multimodale dans le contenu audivisuel - irma. http://www.irmaproject.net/, December 2008.
5. L. Cole and D. Austin. Visual object recognition using template matching. In Proceedings of Australasian Conference on Robotics and Automation, 2004.
6. I. Corporation. Open source computer vision library - opencv. http://www.intel.com/technology/computing/opencv/index.htm, January 2009.
7. J. Curran, S. Clark, and J. Bos. Linguistically motivated large-scale nlp with c&c and boxer. In Proceedings of the ACL 2007 Demonstrations Session, pages 29-32, 2007.
8. R. D. and M. B. A master-slaves volumetric framework for 3d reconstruction from images. In Proceedings of the SPIE'07, volume Vol. 6491, San Jose, USA, 2007.
9. B. A. Davis J. The representation and recognition of action using temporal templates. Technical Report 402, MIT Media Lab Technical Report, 1997.
10. R. Engel and N. Pfleger. SmartKom: Foundations of Multimodal Dialogue Systems. Springer, Berlin, Germany, 2006.
11. J. Hockenmaier and M. Steedman. Ccgbank: A corpus of ccg derivations and dependency structures extracted from the penn treebank. Comput. Linguist., 33(3):355-396, 2007.
12. S. M. Inc. Project grizzly. https://grizzly.dev.java.net/, May 2009.
13. J.-Y. L. Lawson, A.-A. Al-Akkad, J. Vanderdonckt, and B. Macq. An open source workbench for prototyping multimodal interactions based on off-the-shelf heterogeneous components. In Proceedings of the EICS'09, Pittsburgh, USA, July 2009.
14. J.-Y. L. Lawson and B. Macq. Openinterface platform for multimodal applications prototyping. In ICASSP Show & Tell '08, Las Vegas, USA, April 2008.
15. J. C. Martin. Tycoon: Theoretical framework and software tools for multimodal interfaces, 1998.
16. J. C. Martin and M. Kipp. Annotating and measuring multimodal behaviour - tycoon metrics in the anvil tool, 2002.
17. H. Mendonça. Meanings4fusion. http://kenai.com/projects/ meanings4fusion, May 2009.
18. U. of Michigan. Soar. http://sitemaker.umich.edu/soar/home, August 2008.
19. N. Pfleger. Context based multimodal fusion. In Proceedings of the ICMI'04, Pennsylvania, USA, October 2004.
20. D. Reynolds and R. Rose. Robust text-independent speaker identification using gaussian mixture speaker models. Speech and Audio Processing, IEEE Transactions on, Vol. 3(No. 1):72-83, 1995.
21. S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall, New Jersey, 2 ed. edition, 2002.
22. Y. Shoham and K. Leyton-Brown. Multiagent Systems. Cambridge, New York, 2009.
23. D. o. C. S. Stanford University. Protégé platform. http://protege.stanford.edu, January 2009.
24. C. Town. Multi-sensory and multi-modal fusion for sentient computing. International Journal of Computer Vision, 71(2):235-253, February 2007.
25. O. Vybornova, H. Mendonça, L. Lawson, and B. Macq. High level data fusion on a multimodal interactive application platform. In Proceedings of IEEE ISM'08, Berkeley, USA, December 2008.
26. W3C. Resource description framework - rdf. http://www.w3.org/TR/PR-rdf- syntax/, January 1999.
27. W. Walker. Sphinx-4: A flexible open source framework for speech recognition. Technical Report SMLI TR2004-0811, Sun Mycrosystems Inc., 2004.
28. X. Zou and B. Bhanu. Tracking humans using multi-modal fusion. In CVPR'2005, IEEE Computer Society Conference on, San Diego, USA, June 2005.