Snap-and-ask: Answering multimodal question by naming visual instance

MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia

Volumn , Issue , 2012, Pages 609-618

  Zhang, Wei ^a   Pang, Lei ^a   Ngo, Chong Wah ^a  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

multimedia question answering; similar question search; visual instance search

Indexed keywords

COMPUTATIONAL FRAMEWORK; CROP CIRCLES; FUZZY MATCHING; IMAGE DATASETS; LOCAL VARIATIONS; MULTI-MODAL; NON-RIGID; QUESTION ANSWERING; SEARCH RESULTS; SIMILAR QUESTION SEARCH; SPATIAL CONFIGURATION; SYNTACTIC TREES; TEXTING; VISUAL INSTANCE SEARCH; VISUAL PROPERTIES;

EID: 84871378394     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2393347.2393432     Document Type: Conference Paper

References (32)

1. J. Cao and J. F. Nunamaker. Question answering on lecture videos: a multifaceted approach. In ACM/IEEE Conf. on Digital Libraries, 2004.
2. B. N. Delaunay. Sur la sphère vide. Bulletin of Academy of Sciences of the USSR, (6):793-800, 1934.
3. B. Erol, J. Luo, S.-F. Chang, M. Etoh, H.-W. Hon, Q. Lin, and V. Setlur. Mobile media search: Has media search finally found its perfect platform? Part II. In ACM Multimedia, pages 911-912, 2009.
4. M. Gilbert, A. Acero, J. Cohen, H. Bourlard, S.-F. Chang, and M. Etoh. Mobile search in mobile devices. IEEE Multimedia Magazine, 2010.
5. T. Hughes and D. Ramage. Lexical semantic relatedness with random graph walks. In EMNLP-CoNLL 2007, pages 581-589. ACL, 2007.
6. M. J. Huiskes and M. S. Lew. The MIR flickr retrieval evaluation. In ACM MIR, 2008.
7. H. Jégou, M. Douze, and C. Schmid. On the burstiness of visual elements. In CVPR, 2009.
8. H. Jégou, M. Douze, and C. Schmid. Improving bag-of-features for large scale image search. IJCV, 87(3):192-212, May 2010.
9. Y. Kalantidis, L. Pueyo, M. Trevisiol, R. van Zwol, and Y. Avrithis. Scalable triangulation-based logo recognition. In ICMR, April 2011.
10. M. Kamvar and S. Baluja. Query suggestions for mobile search: understanding usage patterns. In SIGCHI, pages 1013-1016, 2008.
11. D. Le, C. Zhu, S. Poullot, and S. Satoh. National institute of informatics, Japan at TRECVID 2011. TRECVID, 2011.
12. M. S. Lew, N. Sebe, C. Djeraba, and R. Jain. Content-based multimedia information retrieval: State of the art and challenges. ACM Trans. Multimedia Comput. Commun. Appl., 2(1):1-19, Feb. 2006.
13. G. Li, R. Hong, Y.-T. Zheng, S. Yan, and T.-S. Chua. Learning cooking techniques from youtube. In Multimedia Modeling, pages 713-718, 2010.
14. G. Li, Z.-Y. Ming, R. Hong, T.-S. Chua, H. Li, and S. TangChua. Question answering over community-contributed web videos. IEEE Multimedia, 17:46-57, 2010.
15. Y. Li, D. McLean, Z. Bandar, J. O'Shea, and K. A. Crockett. Sentence similarity based on semantic nets and corpus statistics. IEEE Trans. Knowl. Data Eng., 18(8):1138-1150, 2006.
16. L. Nie, M. Wang, Z. Zha, G. Li, and T.-S. Chua. Multimedia answering: enriching text QA with media information. In ACM SIGIR, pages 695-704, 2011.
17. D. Nister and H. Stewenius. Scalable recognition with a vocabulary tree. In CVPR, pages 2161-2168, 2006.
18. L. Page, S. Brin, R. Motwani, and T. Winograd. The pagerank citation ranking: Bringing order to the web. In World Wide Web Conference, pages 161-172, 1998.
19. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman. Object retrieval with large vocabularies and fast spatial matching. In CVPR, 2007.
20. J. Philbin, M. Isard, J. Sivic, and A. Zisserman. Lost in quantization: Improving particular object retrieval in large scale image databases. In CVPR, 2008.
21. J. Sivic and A. Zisserman. Video Google: A text retrieval approach to object matching in videos. In ICCV, volume 2, pages 1470-1477, Oct. 2003.
22. A. F. Smeaton, P. Over, and W. Kraaij. Evaluation campaigns and trecvid. In ACM MIR, 2006.
23. K. Wang, Z. Ming, and T.-S. Chua. A syntactic tree matching approach to finding similar questions in community-based qa services. In SIGIR, pages 187-194, 2009.
24. X.-J. Wang, L. Zhang, X. Li, and W.-Y. Ma. Annotating images by mining image search results. IEEE Trans. Pattern Anal. Mach. Intell., 30(11):1919-1932, Nov. 2008.
25. X. Wu, A. G. Hauptmann, and C.-W. Ngo. Practical elimination of near-duplicates from web video search. In ACM Multimedia, pages 218-227, 2007.
26. Y.-C. Wu and J.-C. Yang. A robust passage retrieval algorithm for video question answering. IEEE Trans. on Circuits and Systems for Video Technology, 18(10):1411-1421, 2008.
27. Z. Wu, Q. Ke, M. Isard, and J. Sun. Bundling features for large scale partial-duplicate web image search. In CVPR, pages 25-32, Aug. 2009.
28. H. Yang, L. Chaisorn, Y. Zhao, S. yong Neo, and T. seng Chua. VideoQA: Question answering on news video. In ACM MM, pages 632-641, 2003.
29. T. Yeh, J. J. Lee, and T. Darrell. Photo-based question answering. In ACM MM, 2008.
30. Y. Zhang, Z. Jia, and T. Chen. Image retrieval with geometry preserving visual phrases. In CVPR, 2011.
31. W. Zhao, X. Wu, and C. W. Ngo. On the annotation of web videos by efficient near-duplicate search. IEEE Trans. on Multimedia, 12(5):448-461, 2010.
32. W. Zhou, Y. Lu, H. Li, Y. Song, and Q. Tian. Spatial coding for large scale partial-duplicate web image search. In ACM Multimedia, 2010.