An approach to multimodal input interpretation in human-computer interaction

19th International Conference on Software Engineering and Knowledge Engineering, SEKE 2007

Volumn , Issue , 2007, Pages 664-669

  Ferri, Fernando ^a   Grifoni, Patrizia ^a   Paolozzi, Stefano ^a  

^a Inst for Res Pop/Social Policies   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN COMMUNICATIONS; HUMAN-TO-HUMAN CONVERSATION; MULTI-MODAL INTERACTIONS; NATURAL APPROACHES; NATURAL INTERACTIONS; SENTENCE SIMILARITY; USER'S INTENTIONS; VISUAL INFORMATION;

BEHAVIORAL RESEARCH; KNOWLEDGE BASED SYSTEMS; KNOWLEDGE ENGINEERING; SOFTWARE ENGINEERING; USER INTERFACES;

HUMAN COMPUTER INTERACTION;

EID: 84885440465     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Adler, A., Davis, R.ü"Speech and sketching for multimodal design", in Proc. of the 9th Int. Conf. on Intelligent User Interfaces, ACM Press, 2004, pp. 214-216.
2. Binot, J. L., Falzon, P., Sedlock, D., Wilson, M. D. ü"Architecture of a multimodal dialogue interface for knowledge-based systems", in the Proc.of Esprit'90 Conference, Kluwer Academic PublishersüDordrecht, 1990, pp. 412-433.
3. Bottoni, P., Costabile, M. F., Levialdi, S., Mussio, P. ü"Formalizing visual languages", in Proc. of IEEE Symp. Vis. Lang. '95, IEEE CS Press, 1995, pp. 334-341.
4. Caschera, M. C., Ferri, F., Grifoni, P.ü"Multimodal interaction systemsüinformation and time features", in Int. Journal of Web and Grid Services 2007 - Vol. 3, No.1 pp. 82 - 99, to be published.
5. Celentano, A., Fogli, D., Mussio, P., Pittarello, F.ü"Model- based Specification of Virtual Interaction Environments" in Proc. of the 2004 IEEE Symposium on Visual Languages - Human Centric Computing (VLHCC'04) - Volume 00, 2004, pp. 257-260.
6. Johnston, M., Cohen, P. R., McGee, D., Oviatt, S. L., Pittman, J. A, Smith, I.ü"Unification-based Multimodal Integration", in Proc. of the 35th Annual Meeting of the Association for Computational Linguistics and 8th Conference of the European Chapter of the Association for Computational Linguistics, Madrid, 1997, pp. 281- 288.
7. Lee, J. H., Kim, M. H., Lee, Y. J.ü"Information retrieval based on conceptual distance in is-A hierarchies", in Journ..of Documentation, Vol.49, n.2, 1989, pp. 188-207.
8. Lee, B-W., Yeo, A.W.ü"Integrating sketch and speech inputs using spatial information", in Proc. of the 7th Int. Conf. on Multimodal interfaces, ACM Press, 2005, pp.2-9.
9. Li, Y., McLean, D., Bandar, Z. A.ü"An Approach for Measuring Semantic Similarity Using Multiple Information Sources", IEEE Trans. Knowledge and Data Eng., vol. 15, no. 4, 2003, pp. 871-882.
10. Li, Y., McLean, D., Bandar, Z. A., O'Shea, J. D., Crockett, K.ü"Sentence Similarity Based on Semantic Nets and Corpus Statistics" in IEEE Trans. Knowledge and Data Eng, vol. 18, n. 8, 2006, pp. 1138-1150.
11. Martin, J.C.ü"Toward intelligent cooperation between modalitiesüthe example of a system enabling multimodal interaction with a map", in Proc. of Int. Conf. on Artificial Intelligence (IJCAI'97) Workshop on "Intelligent Multimodal Systems", Nagoya, Japan, 1997.
12. Rada, R., Mili, H., Bichnell, E., Blettner, M.ü"Development and Application of a Metric on Semantic Nets", IEEE Trans. System, Man, and Cybernetics, vol. 9, no. 1, 1989, pp. 17-30.
13. Resnik, P. "Using information content to evaluate semantic similarity in a taxonomy", in International Joint Conference for Artificial Intelligence, 1995, pp. 448-453.
14. Wahlster, W.ü"User and discourse models for multimodal communication", in Readings in intelligent user interfaces, Morgan Kaufmann Publishers Inc, San Francisco, 1998, pp. 359-371.
15. WordNet 2.1üA lexical database for the English language. http://www.cogsci.princeton.edu/cgi-bin/webwn 2005.