Towards the integration of shape-related information in 3-D gestures and speech

ICMI'06: 8th International Conference on Multimodal Interfaces, Conference Proceeding

Volumn , Issue , 2006, Pages 92-99

  Sowa, Timo ^a  

^a UNIVERSITY OF CHICAGO   (United States)

Author keywords

Gesture; Multimodal integration; Shape; Speech

Indexed keywords

ICONIC GESTURES; MULTIMODAL INTEGRATION; SHAPE-RELATED ADJECTIVES;

GESTURE RECOGNITION; MATHEMATICAL MODELS; SEMANTICS; SOFTWARE PROTOTYPING; SPEECH RECOGNITION;

USER INTERFACES;

EID: 34547175169     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1180995.1181014     Document Type: Conference Paper

References (15)

1. I. Biederman. Recognition-by-components: A theory of human image understanding. Psychological Review, 94(2):115-147, 1987.
2. M. Johnston and S. Bangalore. Finite-state methods for multimodal parsing and integration. In Proceedings of the ESSLLI Summer School on Logic, Language, and Information, Helsinki, Finland, 2001.
3. M. Johnston, P. R. Cohen, D. McGee, S. L. Oviatt, J. A. Pittman, and I. Smith. Unification-based multimodal integration. In Proc. of the 35th Annual Meeting of the Association for Computational Linguistics, Madrid, pages 281-288, 1997.
4. D. B. Koons, C. J. Sparrell, and K. R. Thorisson. Integrating simultaneous input from speech, gaze and hand gestures. In M. T. Maybury, editor, Intelligent Multimedia Interfaces, chapter 11, pages 257-276. MIT Press, Cambridge, MA, 1993.
5. S. Kopp, P. Tepper, and J. Cassell. Towards integrated microplanning of language and iconic gesture for multimodal output. In Proceedings of the 6th International Conference on Multimodal Interfaces, pages 97-104, New York, 2004. ACM Press.
6. E. Lang. The semantics of dimensional designation of spatial objects. In M. Bierwisch and E. Lang, editors, Dimensional adjectives: Grammatical structure and conceptual interpretation, pages 263-417. Springer, Berlin, 1989.
7. M. E. Latoschik. A user interface framework for multimodal VR-interactions. In Proceedings of the 7th International Conference on Multimodal Interfaces, pages 76-83, New York, 2005. ACM Press.
8. D. Marr and H. Nishihara. Representation and recognition of the spatial organization of three-dimensional shapes. Proceedings of the Royal Society, Series B, 200:269-294, 1978.
9. D. McNeill. Gesture & Thought. The University of Chicago Press, Chicago, 2005.
10. L. Nigay and J. Coutaz. A generic platform for addressing the multimodal challenge. In I. R. Katz, R. Mack, L. Marks, M. B. Rosson, and N. Jakob, editors, Human Factors In Computing Systems: CHI '95 Conference Proceedings, pages 98-105, New York, 1995. ACM Press.
11. S. Oviatt. Multimodal interfaces. In J. Jacko and A. Sears, editors, The Human-Computer Interaction Handbook, pages 286-304. Lawrence Erlbaum, Manwah, NJ, 2003.
12. T. Sowa. Understanding Coverbal Iconic Gestures in Shape Descriptions. DISKI 294. Akademische Verlagsgesellschaft Aka, Berlin, 2006.
13. T. Sowa, and I. Wachsmuth. A model for the representation and processing of shape in coverbal iconic gestures. In K. Opwis and I. Penner, editors, Proceedings of KogWis05. The German Cognitive Science Conference 2005., pages 183-188, Basel, 2005. Schwabe.
14. C. J. Sparrell and D. B. Koons. Interpretation of coverbal depictive gestures. In Proceedings of Intelligent Multi-Modal Multi-Media Interface Systems, AAAI Spring Symposium Series, pages 8-12. Stanford University, March 1994.
15. A. Waibel, M. Tue Vo, P. Duchnowski, and S. Manke. Multimodal interfaces. Artificial Intelligence Review, 10:299-319, 1996.