MacVisSTA: A system for multimodal analysis

ICMI'04 - Sixth International Conference on Multimodal Interfaces

Volumn , Issue , 2004, Pages 259-264

  Rose, R Travis ^a   Quek, Francis ^a   Shi, Yang ^a  

^a WRIGHT STATE UNIVERSITY   (United States)

Author keywords

Embodied communication; Flexible visualization and annotation; Gesture; Multimodal interaction; Multiple linked representation

Indexed keywords

EMBODIED COMMUNICATION; FLEXIBLE VISUALIZATION AND ANNOTATION; GESTURE; MULTIMODAL ANALYSIS; MULTIMODAL INTERACTION; MULTIPLE LINKED REPRESENTATION;

COMMUNICATION SYSTEMS; COMPUTER SYSTEMS; GESTURE RECOGNITION; MATHEMATICAL MODELS; METADATA; MULTIMEDIA SYSTEMS; XML;

HUMAN COMPUTER INTERACTION;

EID: 14944348286     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. McNeill, D., Hand and Mind: What Gestures Reveal about thought. 1992, Chicago: University of Chicago Press.
2. Kendon, A., Gesticulation and speech: Two apsects of the process of utterance, in Relationship Between Verbal and Nonverbal Communication, M.R. Key, Editor. 1980: The Hague, p. 207-227.
3. Kozma, R.B., A Reply: Media and Methods. Educational Technology Research and Development, 1994. 42(3): p. 1-14.
4. Kozma, R.B., et al., The Use of Multiple, Linked Representations to Facilitate Science Understanding, in International Perspectives on the Design of Technology-Supported Learning Environments, S. Vosniadou, et al., Editors. 1996: Mahwah, New Jersey.
5. Kipp, M., Anvil: Annotation of Video and Spoken Language. 2003.
6. Neidle, C., SignStream™: A Database Tool for Research on Visual-Gestural Language. Sign Transcription and Database Storage of Sign Information, a special issue of Sign Language and Linguistics, 2002. 4(1/2): p. 203-214.
7. Sanderson, P.M., et al., MacSHAPA and the enterprise of Exploratory Sequential Data Analysis (ESDA). International Journal of Human-Computer Studies, 1994. 41: p. 633-668.
8. Nivre, J., et al. Towards Multimodal Spoken Language Corpora: TransTool and SyncTool. in Proceedings of the Workshop on Partially Automated Techniques for Transcribing Naturally Occurring Speech at COLING-ACL '98. 1998. Montreal, Canada.
9. Hanke, T. and S. Prillwitz. SyncWRITER: Integrating Video into the Transcription and Analysis of Sign Language. in Proceedings of the Fourth European Congress on Sign Language Research. 1994. Munich, Germany.
10. CHILDES, Using CLAN (Manual available for download). 2003, CHILDES Project, Carnegie Mellon University.
11. Wittenberg, P., MediaTagger. 2000, Max Planck Institute for Psycholinguistics.
12. Dybkjær, L., et al., Survey of Existing Tools, Standards and User Needs for Annotation of Natural Interaction and Multimodal Data. 2001, International Standards for Language Engineering, Natural Interaction and MultiModality Project: Odense, Denmark, p. 1-111.
13. Bigbee, T., D. Loehr, and L. Harper. Emerging Requirements for Multi-Modal Annotation and Analysis Tools, in In Proceedings, Eurospeech 2001 Special Event: Existing and Future Corpora - Acoustic, Linguistic, and Multi-modal Requirements. 2001.
14. Quek, F., et al. VisSTA: A Tool for Analyzing Multimodal Discourse Data, in Seventh International Conference on Spoken Language Processing. 2002. Denver, CO.
15. Quek, F., et al., A multimedia database system for temporally situated perceptual psycholinguistic analysis. Multimedia Tools and Applications, 2002. 18(2): p. 91-113.