Multiml - a general purpose representation language for multimodal human utterances

ICMI'08: Proceedings of the 10th International Conference on Multimodal Interfaces

Volumn , Issue , 2008, Pages 165-172

  Giuliani, Manuel ^a   Knoll, Alois ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Languages; Standardization

Indexed keywords

INTERACTIVE COMPUTER SYSTEMS; LINGUISTICS; QUERY LANGUAGES; STANDARDIZATION;

ACTION SCENARIOS; GENERAL PURPOSE; HUMAN-ROBOT INTERACTIONS; LANGUAGES; MULTI MODALS; PROOF OF CONCEPTS; REPRESENTATION LANGUAGES; UNDER SPECIFICATIONS;

MARKUP LANGUAGES;

EID: 63449140826     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1452392.1452424     Document Type: Conference Paper

References (20)

1. A. Kranstedt, S. Kopp, and I. Wachsmuth, "Murml: A multimodal utterance representation markup language for conversational agents," in Proc. of the AAMAS Workshop on Embodied conversational agents Let's specify and evaluate them, 2002.
2. S. Prillwitz, R. Leven, H. Zienert, T. Hanke, and J. Henning, HamNoSys. Version 2.0; Hamburger Notationssystem für Gebärdensprache. Eine Einführung. Hamburg: Signum, 1989.
3. F. Landragin, A. Denis, A. Ricci, and L. Romary, "Multimodal meaning representation for generic dialogue systems architectures," in Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 2004), 2004, pp.521-524.
4. D. Gibbon, U. Gut, B. Hell, K. Looks, and A. T. T. Trippel, "A computational model of arm gestures in conversation," in EUROSPEECH-2003, 2003, pp.813-816.
5. J. Y. Chai, "Semantics-based representation for multimodal interpretation in conversational systems," in Proceedings of the 19th international conference on Computational Linguistics, vol. 1. Association for Computational Linguistics Morristown, NJ, USA,2002, pp. 1-7.
6. M. E. Foster, T. By, M. Rickert, and A. Knoll, "Human-robot dialogue for joint construction tasks," in Proceedings, Eighth International Conference on Multimodal Interfaces (ICMI 2006), Ban- November 2006.
7. T. Müller, P. Ziaie, and A. Knoll, "A wait-free realtime system for optimal distribution of vision tasks on multicore architectures," in Proc. 5th International Conference on Informatics in Control, Automation and Robotics, May 2008.
8. P. Ziaie, T. Müller, M. E. Foster, and A. Knoll, "Using a näive Bayes classifier based on k-nearest neighbors with distance weighting for static hand-gesture recognition in a human-robot dialog system," in Proceedings of CSICC 2008, Kish Island, Iran, Mar. 2008.
9. M. Henning, "A new approach to object-oriented middleware," IEEE Computer Society, vol. 8, no. 1, pp. 66-75, Jan-Feb 2004.
10. M. Giuliani and A. Knoll, "Integrating multimodal cues using grammar based models," in Proceedings of HCI International 2007, Beijing, China, July 2007, pp.858-867.
11. M. Rickert, M. E. Foster, M. Giuliani, T. By, G. Panin, and A. Knoll, "Integrating language, vision and action for human robot dialog systems," in Proceedings of the International Conference on Human-Computer Interaction, C. Stephanidis, Ed.Beijing: Springer, July 2007, pp. 987-995.
12. J. F. Allen and G. Ferguson, "Actions and events in interval temporal logic," Journal of Logic and Computation, vol. 4, pp. 531-579, 1994.
13. A. E. Ades and M. J. Steedman, "On the order of words," Linguistics and philosophy, vol. 4, pp.517-558, 1982.
14. M. Steedman, The syntactic process. Cambridge, MA, USA: MIT Press, 2000.
15. K. Ajdukiewicz, "Die syntaktische konnexität," Studia Philosophica, vol. 1, pp. 1-27, 1935.
16. Y. Bar-Hillel, "A quasi-arithmetic notation for syntactic description," Language, vol. 29, pp. 47-58,1953.
17. M. White, "Efficient realization of coordinate structures in combinatory categorial grammar," Research on Language & Computation, vol. 4, no. 1,pp. 39-75, 2006.
18. J. Baldridge and G.-J. Kruijfi, "Coupling ccg and hybrid logic dependency semantics," in Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL 02), Philadelphia,PA: University of Pennsylania, 2002.
19. D. McNeill, Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press, 1992.
20. A. Kendon, Gesture: Visible Action as Utterance. Cambridge University Press, 2004.