Image-language multimodal corpora: Needs, lacunae and an ai synergy for annotation

Proceedings of the 4th International Conference on Language Resources and Evaluation, LREC 2004

Volumn , Issue , 2004, Pages 767-770

  Pastra, Katerina ^a   Wilks, Yorick ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ASSOCIATION REACTIONS; SOFTWARE PROTOTYPING;

ANNOTATION SCHEME; GROWING DEMAND; INTELLIGENT MULTIMEDIA SYSTEMS; LANGUAGE INTEGRATION; LINGUISTIC DATA; MULTI-MODAL; PROCESSING TOOLS; SEMI-AUTOMATICS;

MULTIMEDIA SYSTEMS;

EID: 58449121084     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. André, E. and Th. Rist, 1993. The design of illustrated documents as a planning task. In M. Maybury (ed.), Intelligent Multimedia Interfaces, chapter 4. AAAI Press/MIT Press, pages 94-116.
2. Buisine, St., S. Abrilian, Chr. Rendu, and J. Martin, 2002. Towards experimental specification and evaluation of lifelike multimodal behavior. In Proceedings of the Pacific Rim Conference on AI Workshop on Lifelike animated agents: tools, functions and applications.
3. Gorniak, P. and D. Roy, 2003. Grounded semantic composition for visual scenes. Journal of Artificial Intelligence Research. In press.
4. Herzog, G., 1995. From visual input to verbal output in the visual translator. In Proceedings of the AAAI Fall Symposium on computational models for integrating language and vision.
5. Martin, J., S. Grimard, and K. Alexandri, 2001. On the annotation of multimodal behavior and computation of cooperation between modalities. In Proceedings of the International Conference on Autonomous Agents workshop on Representing, annotating, evaluating non-verbal and verbal communicative acts to achieve contextual embodied agents.
6. Martin, J., L. Julia, and A. Cheyer, 1998. A theoretical framework for multimodal user studies. In Proceedings of the second International Conference on Cooperative Multimodal Communication.
7. Martin, J. and M. Kipp, 2002. Annotating and measuring multimodal behaviour-tycoon metrics in the anvil tool. In Proceedings of the Language Resources and Evaluation Conference 2002.
8. Maybury, M. andW.Wahlster (eds.), 1998. Intelligent User Interfaces. Morgan Kaufmann Publishers.
9. McCown, I., S. Bengio, D. Gatica-Perez, G. Lathoud, F. Monay, D. Moore, P. Wellner, and H. Boulard, 2003. Modelling human interaction in meetings. In Proceedings of IEEE ICASSP.
10. Regier, T. and L. Carlson, 2001. Grounding spatial language in perception: An empirical and computational investigation. Journal of Experimental Psychology, 130(2):273-298.
11. Reithinger, N., G. Herzog, and A. Ndiaye, 2003. Situated multimodal interaction in smartkom. Computers and Graphics, 27:899-903.
12. Roy, D., 2002. Learning visually grounded words and syntax for a scene description task. Computer speech and language, 16:353-385.
13. Searle, J., 1983. Intentionality: an essay in the philosophy of mind. Cambridge University Press.
14. Shapiro, St. and H. Ismail, 2003. Anchoring in a grounded layered architecture with integrated reasoning. Robotics and Autonomous Systems, 43:97-108.
15. Tansley, R., C. Bird, W. Hall, P. Lewis, and M. Weal, 2000. Automating the linking of content and concept. In Proceedings of the 8th ACM International Conference on Multimedia.
16. Towns, St., Ch. Callaway, and J. Lester, 1998. Generating co-ordinated natural language and 3d animations for complex spatial explanations. In Proceedings of the 15th National Conference on Artificial Intelligence.