Uniting keypoints: Local visual information fusion for large-scale image search

IEEE Transactions on Multimedia

Volumn 17, Issue 4, 2015, Pages 538-548

  Liu, Zhen ^a   Li, Houqiang ^a   Zhou, Wengang ^a   Hong, Richang ^b   Tian, Qi ^c  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b HEFEI UNIVERSITY OF TECHNOLOGY   (China)

^c Science Building   (United States)

Author keywords

Descriptor encoding; image search; local features; united keypoints

Indexed keywords

DATABASE SYSTEMS; IMAGE RETRIEVAL;

COMPUTATION EFFICIENCY; DESCRIPTORS; IMAGE SEARCH; K-MEANS CLUSTERING ALGORITHM; KEYPOINTS; LARGE-SCALE DATABASE; LOCAL FEATURE; VISUAL INFORMATION FUSION;

CLUSTERING ALGORITHMS;

EID: 84925041631     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2015.2399851     Document Type: Article

References (46)

1. J.-M. Guo and H. Prasetyo, "Content-based image retrieval using features extracted from halftoning-based block truncation coding," IEEE Trans. Image Process., vol. 24, no. 3, pp. 1010-1024, Mar. 2015.
2. J.-M. Guo, H. Prasetyo, and J.-H. Chen, "Content-based image retrieval using error diffusion block truncation coding features," IEEE Trans. Circuits Syst. Video Technol., to be published.
3. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. 9th IEEE Int. Conf. Comput. Vis., Oct. 2003, vol. 2, pp. 1470-1477.
4. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
5. H. Jegou, M. Douze, and C. Schmid, "Hamming embedding and weak geometric consistency for large scale image search," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 304-317.
6. Y. Zhang, Z. Jia, and T. Chen, "Image retrieval with geometry-preserving visual phrases," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2011, pp. 809-816.
7. W. Zhou, Y. Lu, H. Li, Y. Song, and Q. Tian, "Spatial coding for large scale partial-duplicate web image search," in Proc. ACM Int. Conf. Multimedia, 2010, pp. 511-520.
8. S. Zhang, M. Yang, X. Wang, Y. Lin, and Q. Tian, "Semantic-aware co-indexing for image retrieval," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1673-1680.
9. L. Chu, S. Jiang, S. Wang, Y. Zhang, and Q. Huang, "Robust spatial consistency graph model for partial duplicate image retrieval," IEEE Trans. Multimedia, vol. 15, no. 8, pp. 1982-1996, Dec. 2013.
10. J. He, J. Feng, X. Liu, T. Cheng, T.-H. Lin, H. Chung, and S.-F. Chang, "Mobile product search with bag of hash bits and boundary reranking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 3005-3012.
11. X. Zhang, L. Zhang, and H.-Y. Shum, "Qsrank: Query-sensitive hash code ranking for efficient ε-neighbor search," in IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2058-2065.
12. X. Li, C. G. M. Snoek, M. Worring, and A. W. M. Smeulders, "Fusing concept detection and geo context for visual search," in Proc. ACM Int. Conf. Multimedia Retrieval, Jun. 2012, pp. 41-46.
13. L. Zhang and Y. Rui, "Image search from thousands to billions in 20 years," ACM Trans. Multimedia Comput., Commun., Appl., vol. 9, no. 1, pp. 36:1-36:20, 2013.
14. M. Wang, R. Hong, X.-T. Yuan, S. Yan, and T.-S. Chua, "Movie2comics: Towards a lively video content presentation," Proc. IEEE Trans. Multimedia, vol. 14, no. 3, pt. 2, pp. 858-870, Jun. 2012.
15. X. Yang, X. Gao, D. Tao, X. Li, and J. Li, "An efficient MRF embedded level set method for image segmentation," IEEE Trans. Image Process., vol. 24, no. 1, pp. 9-21, Jan. 2015.
16. H. Zhang, Z.-J. Zha, Y. Yang, S. Yan, Y. Gao, and T.-S. Chua, "Attribute-augmented semantic hierarchy: Towards bridging semantic gap and intention gap in image retrieval," in Proc. 21st ACMInt. Conf. Multimedia, 2013, pp. 33-42.
17. E. Gavves and C. G. Snoek, "Landmark image retrieval using visual synonyms," in Proc. ACM Int. Conf. Multimedia, 2010, pp. 1123-1126.
18. M. W. B. Z. Lingxi Xie and Q. Tian, "Spatial pooling of heterogeneous features for image classification," IEEE Trans. Image Process., vol. 23, no. 5, pp. 1994-2008, May 2014.
19. L. Zheng, S. Wang, Z. Liu, and Q. Tian, "Lp-norm IDF for large scale image search," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 1626-1633.
20. Y. Jing and S. Baluja, "Pagerank for product image search," in Proc. 17th ACM Int. Conf. World Wide Web, 2008, pp. 307-316.
21. S. Wang, F. Jing, J. He, Q. Du, and L. Zhang, "Igroup: Presenting web image search results in semantic clusters," in Proc. SIGCHI Conf. Human Factors Comput. Syst., 2007, pp. 587-596.
22. X. Yang, X. Gao, D. Tao, and X. Li, "Improving level set method for fast auroral oval segmentation," IEEE Trans. Image Process., vol. 23, no. 7, pp. 2854-2865, Jul. 2014.
23. R. Arandjelovic and A. Zisserman, "Three things everyone should know to improve object retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2012, pp. 2911-2918.
24. L. Zheng and S. Wang, "Visual phraselet: Refining spatial constraints for large scale image search," IEEE Signal Process. Lett., vol. 20, no. 4, pp. 391-394, Apr. 2013.
25. R. Hong, M. Wang, Y. Gao, D. Tao, X. Li, and X. Wu, "Image annotation by multiple-instance learning with discriminative feature mapping and selection," IEEE Trans. Cybern., vol. 44, no. 5, pp. 669-680, May 2014.
26. L. Xie, Q. Tian, W. Zhou, and B. Zhang, "Fast and accurate near-duplicate image search with affinity propagation on the imageweb," in Proc. Comput. Vis. Image Understand., 2014, vol. 124, pp. 31-41.
27. Z. Liu, H. Li, W. Zhou, R. Zhao, and Q. Tian, "Contextual hashing for large-scale image search," IEEE Trans. Image Process., vol. 23, no. 4, pp. 1606-1614, Apr. 2014.
28. W. Zhou, M. Yang, H. Li, X. Wang, Y. Lin, and Q. Tian, "Towards codebook-free: Scalable cascaded hashing for mobile image search," IEEE Trans. Multimedia, vol. 16, no. 3, pp. 1-11, Apr. 2014.
29. S. Zhang, Q. Tian, K. Lu, Q. Huang, and W. Gao, "Edge-sift: Discriminative binary descriptor for scalable partial-duplicate mobile search," IEEE Trans. Image Process., vol. 22, no. 7, pp. 2889-2902, Jul. 2013.
30. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
31. K. Mikolajczyk and C. Schmid, "An affine invariant interest point detector," in Proc. Eur. Conf. Comput. Vis., 2002, pp. 128-142.
32. J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust wide-baseline stereo from maximally stable extremal regions," Image Vis. Comput., vol. 22, no. 10, pp. 761-767, 2004.
33. H. Bay, T. Tuytelaars, and L. Van Gool, "Surf: Speeded up robust features," in Proc. Eur. Conf. Comput. Vis., 2006, pp. 404-417.
34. W. Zhou, H. Li, Y. Lu, and Q. Tian, "SIFT match verification by geometric coding for large-scale partial-duplicate web image search," ACM Trans. Multimedia Comput., Commun., Appl., vol. 9, no. 1, p. 4, 2013.
35. D. Nister and H. Stewenius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2006, vol. 2, pp. 2161-2168.
36. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Lost in quantization: Improving particular object retrieval in large scale image databases," in IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
37. W. Zhou, Y. Lu, H. Li, and Q. Tian, "Scalar quantization for large scale image search," in Proc. ACM Int. Conf. Multimedia, 2012, pp. 169-178.
38. Z. Liu, H. Li, L. Zhang, W. Zhou, and Q. Tian, "Cross-indexing of binary SIFT codes for large-scale image search," IEEE Trans. Image Process., vol. 23, no. 5, pp. 2047-2057, May 2014.
39. Z. Liu, H. Li, W. Zhou, and Q. Tian, "Embedding spatial context information into inverted file for large-scale image retrieval," in Proc. 20th ACM Int. Conf. Multimedia, 2012, pp. 199-208.
40. Y. Avrithis and G. Tolias, "Hough pyramid matching: Speeded-up geometry re-ranking for large scale image retrieval," Int. J. Comput. Vis., vol. 107, no. 1, pp. 1-19, Mar. 2014.
41. H. Jégou, F. Perronnin, M. Douze, and C. Schmid et al., "Aggregating local image descriptors into compact codes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 9, pp. 1704-1716, Sep. 2012.
42. H. Jégou, M. Douze, and C. Schmid, "Product quantization for nearest neighbor search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 117-128, Jan. 2011.
43. H. Jégou, M. Douze, C. Schmid, and P. Pérez, "Aggregating local descriptors into a compact image representation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 3304-3311.
44. R. Arandjelovic and A. Zisserman, "All about VLAD," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 1578-1585.
45. H. Jégou and O. Chum, "Negative evidences and co-occurences in image retrieval: The benefit of PCA and whitening," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 774-787.
46. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2006, vol. 2, pp. 2169-2178.