Grounding spatial prepositions for video search

ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces

Volumn , Issue , 2009, Pages 253-260

  Tellex, Stefanie ^a   Roy, Deb ^a  

^a MIT MEDIA LAB   (United States)

Author keywords

Spatial language; Video retrieval

Indexed keywords

MATCHING QUERY; NATURAL LANGUAGE QUERIES; NATURAL LANGUAGES; REAL-WORLD PROBLEM; SEMANTIC STRUCTURES; SPATIAL LANGUAGE; SPATIAL PREPOSITIONS; TEST MODELS; VIDEO CLIPS; VIDEO RETRIEVAL; VIDEO RETRIEVAL SYSTEM; VIDEO SEARCH;

EQUIPMENT TESTING; IMAGE RETRIEVAL; INTERACTIVE COMPUTER SYSTEMS; LEARNING SYSTEMS; VIDEO CAMERAS;

LINGUISTICS;

EID: 74049083737     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1647314.1647369     Document Type: Conference Paper

References (25)

1. R. Cucchiara, C. Grana, A. Prati, and R. Vezzani. Computer vision techniques for PDA accessibility of in-house video surveillance. In First ACM SIGMM International Workshop on Video surveillance, pages 87-97, Berkeley, California, 2003. ACM.
2. J. Demsar and B. Zupan. Orange: From experimental machine learning to interactive data mining. Technical report, Faculty of Computer and Information Science, University of Ljubljana, 2004. URL http://www.ailab.si/orange.
3. M. Fleischman, P. DeCamp, and D. Roy. Mining temporal patterns of movement for video content classification. In Proceedings of the 8th ACM SIGMM International Workshop on Multimedia Information Retrieval, 2006.
4. S. Harada, Y. Itoh, and H. Nakatani. Interactive image retrieval by natural language. Optical Engineering, 36(12):3281-3287, Dec. 1997.
5. Y. Ivanov, A. Sorokin, C. Wren, and I. Kaur. Tracking people in mixed modality systems. Technical Report TR2007-011, Mitsubishi Electric Research Laboratories, 2007.
6. Y. A. Ivanov and C. R. Wren. Toward spatial queries for spatial surveillance tasks. In Pervasive: Workshop Pervasive Technology Applied Real-World Experiences with RFID and Sensor Networks (PTA), 2006.
7. R. S. Jackendoff. Semantics and Cognition, pages 161-187. MIT Press, 1983.
8. P. Jodoin, J. Konrad, and V. Saligrama. Modeling background activity for behavior subtraction. In Distributed Smart Cameras, 2008. ICDSC 2008. Second ACM/IEEE International Conference on, pages 1-10, 2008.
9. B. Katz, J. Lin, C. Stauffer, and E. Grimson. Answering questions about moving objects in surveillance videos. In M. Maybury, editor, New Directions in Question Answering, pages 113-124. Springer, 2004.
10. J. D. Kelleher and F. J. Costello. Applying computational models of spatial prepositions to visually situated dialog. Computational Linguistics, 35(2):271-306, June 2009.
11. B. Landau and R. Jackendoff. "What" and "where" in spatial language and spatial cognition. Behavioral and Brain Sciences, 16:217-265, 1993.
12. X. Li, D. Wang, J. Li, and B. Zhang. Video search in concept subspace: a text-like paradigm. In Proceedings of the 6th ACM international conference on Image and video retrieval, pages 603-610, Amsterdam, The Netherlands, 2007. ACM.
13. T. Lochmatter, P. Roduit, C. Cianci, N. Correll, J. Jacot, and A. Martinoli. Swistrack - a flexible open source tracking software for multi-agent systems. In IEEE/RSJ International Conference on Intelligent Robots and Systems, 2008.
14. G. Marton and L. B. Westrick. Sepia: a framework for natural language semantics. Technical report, Massachusetts Institute of Technology, 2009.
15. M. Naphade, J. Smith, J. Tesic, S. Chang, W. Hsu, L. Kennedy, A. Hauptmann, and J. Curtis. Large-scale concept ontology for multimedia. Multimedia, IEEE, 13(3):86-91, 2006.
16. T. Regier and M. Zheng. Attention to endpoints: A Cross-Linguistic constraint on spatial meaning. Cognitive Science, 31(4):705, 2007.
17. T. P. Regier. The Acquisition of Lexical Semantics for Spatial Terms: A Connectionist Model of Perceptual Categorization. PhD thesis, University of California at Berkeley, 1992.
18. W. Ren, S. Singh, M. Singh, and Y. Zhu. State-of-the-art on spatio-temporal information-based video retrieval. Pattern Recognition, 42(2):267-282, Feb. 2009. ISSN 0031-3203.
19. D. Roy, R. Patel, P. DeCamp, R. Kubat, M. Fleischman, B. Roy, N. Mavridis, S. Tellex, A. Salata, J. Guinness, M. Levit, and P. Gorniak. The Human Speechome Project. In Proceedings of the 28th Annual Cognitive Science Conference, pages 192-196, 2006.
20. L. Talmy. The fundamental system of spatial schemas in language. In B. Hamp, editor, From Perception to Meaning: Image Schemas in Cognitive Linguistics. Mouton de Gruyter, 2005.
21. S. Tellex and D. Roy. Towards surveillance video search by natural language query. In Conference on Image and Video Retrieval (CIVIR-2009), 2009.
22. J. Vlahos. Welcome to the panopticon. Popular Mechanics, 185(1):64, 2008. ISSN 00324558.
23. T. Yamasaki, Y. Nishioka, and K. Aizawa. Interactive retrieval for multi-camera surveillance systems featuring spatio-temporal summarization. In Proceeding of the 16th ACM international conference on Multimedia, pages 797-800, Vancouver, British Columbia, Canada, 2008. ACM.
24. A. Yoshitaka, Y. Hosoda, M. Yoshimitsu, M. Hirakawa, and T. Ichikawa. Violone: Video retrieval by motion example. Journal of Visual Languages and Computing, 7:423-443, 1996.
25. L. Zhang, Y. Li, and R. Nevatia. Global data association for multi-object tracking using network flows. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pages 1-8, 2008.