Multimodal fusion: A new hybrid strategy for dialogue systems

ICMI'06: 8th International Conference on Multimodal Interfaces, Conference Proceeding

Volumn , Issue , 2006, Pages 357-363

  Portillo, Pilar Manchón ^a   García, Guillermo Pérez ^a   Carredano, Gabriel Amores ^a  

^a UNIVERSITY OF SEVILLE   (Spain)

Author keywords

Dialogue systems; Multimodal fusion; NLP

Indexed keywords

DIALOGUE SYSTEMS; HYBRID FUSION STRATEGY; MULTIMODAL DIALOGUE SYSTEMS; MULTIMODAL FUSION;

COMPUTER SCIENCE; CONSTRAINT THEORY; CONTEXT SENSITIVE GRAMMARS; INFORMATION RETRIEVAL; INFORMATION TECHNOLOGY;

DATA FUSION;

EID: 34547200427     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1180995.1181061     Document Type: Conference Paper

References (16)

1. Gabriel Amores & José Francisco Quesada (1997) Episteme Procesamiento del Lenguaje Natural 21. pp 1-16.
2. Gabriel Amores, José Francisco Quesada (2000) Diseño e Implementación de Sistemas de Traducción Automática. Sevilla: Secretariado de Publicaciones de la Universidad de Sevilla.
3. Michael Johnston, Philip R. Cohen, David McGee, Sharon L. Oviatt, James A. Pittman, Ira A. Smith (1997): Unification-based Multimodal Integration. ACL 1997: pp 281-288
4. Michael Johnston (1998): Unification-based Multimodal Parsing. COLING-ACL 1998, 624-630.
5. Michael Johnston, Srinivas Bangalore (2000). Finite State Multimodal Parsing and Understanding. Proceedings of the 18th conference on Computational linguistics - Volume 1. pp 369-375.
6. Michael Johnston, Srinivas Bangalore (2001). Finite-state Methods for Multimodal Parsing and Integration, Finite State Methods in Natural Language Processing, August 2001.
7. Pilar Manchón, Guillermo Pérez, Gabriel Amores (2005). WOZ experiments in Multimodal Dialogue Systems. Proceedings of Dialor'05, Nancy, France, pp 131-135.
8. Sharon Oviatt (1999). Ten myths of multimodal interaction, Communications of the ACM, Vol. 42, No. 11, pp. 74-81.
9. Sharon Oviatt (2003). Multimodal interfaces. In The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications. J. Jacko & A. Sears, Eds. Lawrence Erlbaum Assoc., Mahwah, NJ, chap. 14, pp 286-304
10. José Francisco Quesada, Doroteo Torre, Gabriel Amores (2000). Design of a Natural Command Language Dialogue System. Deliverable 3.2, Siridus Project
11. Guillermo Pérez, Gabriel Amores & Pilar Manchón (2005) Proceedings of ICMI'05 Workshop on Multimodal Interaction for the Visualisation and Exploration of Scientific Data. Trento, Italy.
12. Dafydd Gibbon, Inge Mertins & Roger Moore Eds. (2000). Handbook of Multimodal and Spoken Dialogue Systems. Kluwer Academic Publishers, Norwell, MA.
13. Laurence Nigay & Joëlle Coutaz (1995). A generic platform for addressing the multimodal challenge. International Conference on Human-Computer Interaction, pp 98-105, Denver (CO). ACM
14. Minh Tue Vo (1998). A Framework and Toolkit for the Construction of Multimodal Learning Interfaces. PhD. Thesis, Carnegie Mellon University, Pittsburgh, USA.
15. Minh Tue Vo & Alex Waibel (1997). Modelling and interpreting multimodal inputs. A semantic integration approach. Technical Report CMU-CS-97-192, Carnegie Mellon University, Pittsburgh, USA
16. Minh Tue Vo & Wood, C (1996). Building an application framework for speech and pen input integration in multimodal learning interfaces. International Conference on Acoustics, Speech and Signal Processing, Atlanta, GA. IEEE.