Visual word proximity and linguistics for semantic video indexing and near-duplicate retrieval

Computer Vision and Image Understanding

Volumn 113, Issue 3, 2009, Pages 405-414

  Jiang, Yu Gang ^a   Ngo, Chong Wah ^a  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

CEMD matching; Linguistic similarity; Near duplicate keyframe; Semantic concept; Soft weighting; Visual ontology

Indexed keywords

BINS; CONTENT BASED RETRIEVAL; INDEXING (OF INFORMATION); INFORMATION RETRIEVAL; INFORMATION THEORY; LINGUISTICS; ONTOLOGY; SEMANTICS; VIDEO RECORDING;

CEMD MATCHING; LINGUISTIC SIMILARITY; NEAR-DUPLICATE KEYFRAME; SEMANTIC CONCEPT; SOFT-WEIGHTING; VISUAL ONTOLOGY;

WEIGHING;

EID: 59349100009     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2008.10.002     Document Type: Article

References (40)

1. Nowak E., Jurie F., and Triggs B. Sampling strategies for bag-of-features image classification. European Conference on Computer Vision (2006)
2. Zhang J., Marszałek M., Lazebnik S., and Schmid C. Local features and kernels for classification of texture and object categories: a comprehensive study. International Journal of Computer Vision 73 2 (2007) 213-238
3. Lazebnik S., Schmid C., and Ponce J. Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. IEEE Conference on Computer Vision and Pattern Recognition (2006)
4. Snoek C.G.M., van Gemert J.C., Gevers Th., Huurnink B., Koelma D.C., Van Liempt M., De Rooij O., van de Sande K.E.A., Seinstra F.J., Smeulders A.W.M., Thean A.H.C., Veenman C.J., and Worring M. The mediamill TRECVID 2006 semantic video search engine. TRECVID Online Proceedings (2006)
5. Fellbaum C. WordNet: An Electronic Lexical Database (1998), MIT Press, Cambridge, MA
6. Manjunath B.S., and Ma W. Texture features for browsing and retrieval of image data. IEEE Transactions on Pattern Analysis and Machine Intelligence 18 8 (1996) 837-842
7. Barnard K., Duygulu P., Forsyth D., de Freitas N., Blei D., and Jordan M.I. Matching words and pictures. Journal of Machine Learning Research 3 (2003) 1107-1135
8. A.G. Hauptmann, M.-Y. Chen, M. Christel, W.-H. Lin, R. Yan, J. Yang, Multi-lingual broadcast news retrieval, in: TRECVID Online Proceedings, 2006.
9. J. Cao, Y. Lan, J. Li, Q. Li, X. Li, F. Lin, X. Liu, L. Luo, W. Peng, D. Wang, H. Wang, Z. Wang, Z. Xiang, J. Yuan, W. Zheng, B. Zhang, J. Zhang, L. Zhang, X. Zhang, Intelligent multimedia group of Tsinghua University at TRECVID 2006 TRECVID, in: Online Proceedings, 2006.
10. Lowe D. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60 2 (2004) 91-110
11. Mikolajczyk K., Tuytelaars T., Schmid C., Zisserman A., Matas J., Schaffalitzky F., Kadir T., and Van Gool L. A comparison of affine region detectors. International Journal of Computer Vision 65 1/2 (2005) 43-72
12. Mikolajczyk K., and Schmid C. A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 10 (2005)
13. C.-W. Ngo, W.-L. Zhao, Y.-G. Jiang, Fast tracking of near-duplicate keyframes in broadcast domain with transitivity propagation, in: ACM International Conference on Multimedia, 2006.
14. Y. Ke, R. Suthankar, L. Huston, Efficient near-duplicate detection and sub-image retrieval, in: ACM International Conference on Multimedia, 2004, pp. 869-876.
15. Philbin J., Chum O., Isard M., Sivic J., and Zisserman A. Object retrieval with large vocabularies and fast spatial matching. IEEE Conference on Computer Vision and Pattern Recognition (2007)
16. X. Wu, W.-L. Zhao, C.-W. Ngo, Near-duplicate keyframe retrieval with visual keywords and semantic context, in: ACM International Conference on Image and Video Retrieval, 2007.
17. J. Sivic, A. Zisserman, Video google: a text retrieval approach to object matching in videos, in: International Conference on Computer Vision, 2003.
18. Y.-G. Jiang, C.-W. Ngo, J. Yang, Towards optimal bag-of-features for object categorization and semantic video retrieval, in: ACM International Conference on Image and Video Retrieval, 2007.
19. Y.-G. Jiang C.-W. Ngo, Bag-of-visual-words expansion using visual relatedness for video indexing, in: ACM SIGIR Conference on Research & Development on Information Retrieval, 2008.
20. F. Jurie, B. Triggs, Creating efficient codebooks for visual recognition, in: International Conference on Computer Vision, 2005.
21. F. Moosmann, B. Triggs, F. Jurie, Randomized clustering forests for building fast and discriminative visual vocabularies, in: Conference on Neural Information Processing Systems (NIPS), 2006.
22. T. Pedersen, S. Patwardhan, J. Michelizzi, WordNet::Similarity - measuring the relatedness of concepts, in: National Conference on Artificial Intelligence (AAAI), 2004.
23. P. Resnik, Using information content to evaluate semantic similarity in a taxonomy, in: International Joint Conferences on Artificial Intelligence, 1995.
24. J.J. Jiang, D.W. Conrath, Semantic similarity based on corpus statistics and lexical taxonomy, in: Proc. of ROCLING X, 1997.
25. Z. Wu, M. Palmer, Verb semantic and lexical selection in Annual Meeting of the ACL, 1994, pp. 133-138.
26. A. Agarwal, B. Triggs, Hyperfeatures - multilevel local coding for visual recognition, in: European Conference on Computer Vision, 2006.
27. D. Nister, H. Stewenius, Scalable recognition with a vocabulary tree, in: IEEE Conference on Computer Vision and Pattern Recognition, 2006.
28. K. Grauman, T. Darrell, Approximate correspondences in high dimensions, in: Advances in Neural Information Processing Systems (NIPS), 2007.
29. Rubner Y., Tomasi C., and Guibas L.J. The earth mover's distance as a metric for image retrieval. International Journal of Computer Vision 40 2 (2000) 99-121
30. Y.-G. Jiang, C.-W. Ngo, Ontology-based visual word matching for near-duplicate retrieval, in: IEEE International Conference on Multimedia & Expo, 2008.
31. Shi J., and Malik J. Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 8 (2000) 888-905
32. TREC Video Retrieval Evaluation (TRECVID), Available from: .
33. LSCOM lexicon definitions and annotations, in: DTO Challenge Workshop on Large Scale Concept Ontology for Multimedia, Columbia University ADVENT Technical Report #217-2006-3, 2006.
34. Vapnik V. The Nature of Statistical Learning Theory (1995), Springer, New York
35. J.A. Aslam, V. Pavlu, E. Yilmaz, Statistical method for system evaluation using incomplete judgments, in: ACM SIGIR Conference, 2006.
36. S. Petrov, A. Faria, P. Michaillat, A. Berg, D. Klein, J. Malik, A. Stolcke, Detecting categories in news video using acoustic, speech, and image features, in: TRECVID Online Proceedings, 2006.
37. M. Campbell, S. Ebadollahi, D. Joshi, M. Naphade, A. Natsev, J. Seidl, J.R. Smith, K. Scheinberg, J. Tesic, L. Xie, IBM research TRECVID-2006 video retrieval system, in: TRECVID Online Proceedings, 2006.
38. D.-Q. Zhang, S.-F. Chang, Detecting image near-duplicate by stochastic attributed relational graph matching with learning, in: ACM International Conference on Multimedia, 2004.
39. Salton G., Wong A., and Yang C.S. A vector space model for automatic indexing. Communications of the ACM 18 (1975) 613-620
40. H. Ling, K. Okada, Diffusion distance for histogram comparison, in: IEEE Conference on Computer Vision and Pattern Recognition, 2006.