Utilizing related samples to enhance interactive concept-based video search

IEEE Transactions on Multimedia

Volumn 13, Issue 6, 2011, Pages 1343-1355

  Yuan, Jin ^a   Zha, Zheng Jun ^a   Zheng, Yan Tao ^b   Wang, Meng ^a   Zhou, Xiangdong ^c   Chua, Tat Seng ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^c FUDAN UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE FUSION; CONCEPT-BASED VIDEO SEARCH; DATA SETS; INTERACTIVE VIDEO; PERFORMANCE IMPROVEMENTS; RANKING MODEL; SEARCH RESULTS; STATE-OF-THE-ART APPROACH; TEMPORAL RELATIONSHIPS; TRECVID; VIDEO DATASETS; VIDEO SEGMENTS; YOUTUBE;

MULTIMEDIA SYSTEMS; SIGNAL PROCESSING;

SEMANTICS;

EID: 82055197368     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2168813     Document Type: Article

References (43)

1. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of the early years," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 12, pp. 1349-1380, Dec. 2000. (Pubitemid 32088465)
2. C. Snoek and M. Worring, "Concept-based video retrieval," Found. Trends Inf. Retriev., 2009.
3. Y.-G. Jiang, J. Yang, C.-W. Ngo, and A. G. Hauptmann, "Representations of keypoint-based semantic concept detection: A comprehensive study," IEEE Trans. Multimedia, vol. 12, no. 1, pp. 42-53, Jan. 2010.
4. C. Snoek, M. Worring, J. C. V. Gemert, J.-M. Geusebroek, and A. W. M. Smeulders, "The challenge problem for automated detection of 101 semantic concepts in multimedia," in Proc. ACM Int. Conf. on Multimedia, 2006.
5. A. Yanagawa, S.-F. Chang, L. S. Kennedy, and W. Hsu, Columbia University's Baseline Detectors for 374 lscom Semantic Visual Concepts, ADVENT Tech. Rep. 222-2006-8, 2007.
6. M. Naphade and J. R. Smith, "Large-scale concept ontology for multimedia," IEEE Trans. Multimedia, vol. 13, no. 3, pp. 86-91, Jul.-Sep. 2006. (Pubitemid 44263760)
7. TRECVID. [Online]. Available: http://trecvid.nist.gov/.
8. YouTube. [Online]. Available: http://www.youtube.com/.
9. U. Gargi, R. Kasturi, and S. H. Strayer, "Performance characterization of video-shot-change detection methods," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 1, pp. 1-13, Feb. 2000. (Pubitemid 30559996)
10. J. Yuan, Z.-J. Zha, Z. D. Zhao, X. D. Zhou, and T.-S. Chua, "Utilizing related samples to learn complex queries in interactive concept-based video search," in Proc. ACM Int. Conf. Image and Video Retrieval, 2010.
11. M. Koskela, M. Sjoberg, and J. Laaksonen, "Improving automatic video retrieval with semantic concept detection," in Proc. Scand. Conf. Image Analysis, 2009.
12. Z. J. Zha, X. S. Hua, and T. Mei et al., "Joint multi-label multi-instance learning for image classification," in Proc. ACM Int. Conf. Computer Vision and Pattern Recognition, 2008.
13. Z. J. Zha, M.Wang, and Y. T. Zheng et al., "Interactive video indexing with statistical active learning," IEEE Trans. Multimedia, to be published.
14. Z. J. Zha and T. Mei et al., "Graph-based semi-supervised learning with multiple labels," J. Vis. Commun. Image Represent., vol. 20, no. 2, pp. 97-103, Feb. 2009.
15. S.-F. Chang, W. Hsu, W. Jiang, L. S. Kennedy, D. Xu, A. Yanagawa, and E. Zavesky, "Columbia university TRECVID-2006 video search and high-level feature extraction," in Proc. TRECVIDWorkshop, 2006.
16. J. Yuan, Z. J. Zha, Y. T. Zheng, M.Wang, X. D. Zhou, and T. S. Chua, "Learning concept bundles for video search with complex queries," in Proc. ACM Int. Conf. Multimedia, 2011.
17. D. Wang, X. Liu, L. Luo, J. Li, and B. Zhang, "The importance of query-concept-mapping for automatic video retrieval," in Proc. ACM Int. Conf. Multimedia, 2007.
18. X.-Y.Wei, C.-W. Ngo, and Y.-G. Jiang, "Selection of concept detectors for video search by ontology-enriched semantic spaces," IEEE Trans. Multimedia, vol. 10, no. 6, pp. 1085-1096, Oct. 2008.
19. A. G. Hauptmann, W.-H. Lin, R. Yan, J. Yang, and M.-Y. Chen, "Extreme video retrieval: Joint maximization of human and computer performance," in Proc. ACM Int. Conf. Multimedia, 2006.
20. Z. Wang, D. Wang, J. Li, and B. Zhang, "Learning structured conceptsegments for interactive video retrieval," in Proc. ACMInt. Conf. Image and Video Retrieval, 2008.
21. C. Snoek, B. Huurnink, L. Hollink, M. de Rijke, G. Schreiber, and M.Worring, "Adding semantics to detectors for video retrieval," IEEE Trans. Multimedia, vol. 9, no. 5, pp. 975-986, Aug. 2007. (Pubitemid 47171254)
22. X. Hu, L. Tang, and H. Liu, "Enhancing accessibility of microblogging messages using semantic knowledge," in Proc. ACM Int. Conf. Information and Knowledge Management, 2011.
23. R. L. Cilibrasi and P. M. B. Vitanyi, "The Google similarity distance," IEEE Trans. Knowl. Data Eng., vol. 19, no. 3, pp. 370-383, Mar. 2007. (Pubitemid 46374534)
24. L. Wu, X. S. Hua, N. Yu, W. Y. Ma, and S. Li, "Flickr distance," in Proc. ACM Int. Conf. Multimedia, 2008.
25. S.-Y. Neo, J. Zhao, M.-Y. Kan, and T.-S. Chua, "Video retrieval using high level features: Exploiting query matching and confidence- based weighting," in Proc. ACM Int. Conf. Image and Video Retrieval, 2006.
26. Y.-G. Jiang, C.-W. Ngo, and S.-F. Chang, "Semantic context transfer across heterogeneous sources for domain adaptive video search," in Proc. ACM Int. Conf. Multimedia, 2009.
27. R. Aly, D. Hiemstra, and R. Ordelmann, "Building detectors to support searches on combined semantic concepts," in Proc. SIGIR Workshop Multimedia Information Retrieval, 2007.
28. C. Snoek, K. van de Sande, O. de Rooij, B. Huurnink, and J. van Gemert et al., The Mediamill Trecvid 2008 Semantic Video Search Engine, TRECvid Working Notes, 2008.
29. Y.-T. Zheng, S.-Y. Neo, X. Y. Chen, and T.-S. Chua, "Visiongo: Towards true interactivity," in Proc. ACM Int. Conf. Image and Video Retrieval, 2009.
30. Y. Rui, T. S. Huang, M. Ortega, and S. Mehrotra, "Relevance feedback: A power tool in interactive content-based image retrieval," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 5, pp. 644-655, Sep. 1998. (Pubitemid 128743730)
31. J. Pickens, J. Adcock, M. Cooper, and A. Girgensohn, Fxpal Interactive Search Experiments for Trecvid 2008, TRECvid Working Notes, 2008.
32. P. Toharia, O. D. Robles, A. F. Smeaton, and A. Rodriguez, "Measuring the influence of concept detection on video retrieval," in Proc. ACMInt. Conf. Computer Analysis of Images and Patterns, 2009.
33. Flickr. [Online]. Available: http://www.flickr.com/.
34. Lucene. [Online]. Available: http://lucene.apache.org/java/docs/index. html.
35. F. R. Bach, G. R. G. Lanckriet, and M. I. Jordan, "Multiple kernel learning, conic duality, and the SMO algorithm," in Proc. IEEE Int. Conf. Machine Learning, 2004.
36. X. Zhu, "Semi-supervised learning with graphs," Ph.D. dissertation, Carnegie Mellon Univ., Pittsburgh, PA, 2005.
37. Z. J. Zha, L. J. Yang, T. Mei, M.Wang, and Z. F.Wang, "Visual query suggestion," in Proc. ACM Int. Conf. Multimedia, 2009.
38. S. Tang and J. T. Li et al., "TRECVID 2008 high-level feature extraction by MCG-ICT-CAS," in Proc. TRECVID Workshop, 2008.
39. T.-S. Chua, J.-H. Tang, R. C. Hong, H. J. Li, Z. P. Luo, and Y.-T. Zheng, "Nus-wide: A real-world web image database from National University of Singapore," in Proc. ACM Int. Conf. Image and Video Retrieval, 2009.
40. T. Mei, Z. J. Zha, and Y. Liu et al., "MSRA ATT TRECVID 2008: High-level feature extraction and automatic search," in Proc. TRECVID Workshop, 2008.
41. Y.-G. Jiang, C.-W. Ngo, and J. Yang,Vireo-374: Lscom Semantic Concept Detectors Using Local Keypoint Features. [Online]. Available: http://vireo.cs.cityu.edu.hk/research/vireo374/.
42. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. ACM Int. Conf. Computer Vision and Pattern Recognition, 2005.
43. A. Oliva and A. Torralba, "Building the gist of a scene: The role of global image features in recognition," Progr. Brain Res., 2006.