Embedding multi-order spatial clues for scalable visual matching and retrieval

IEEE Journal on Emerging and Selected Topics in Circuits and Systems

Volumn 4, Issue 1, 2014, Pages 130-141

  Zhang, Shiliang ^a   Tian, Qi ^a   Huang, Qingming ^b   Rui, Yong ^c  

^a University of Texas at San Antonio   (United States)

^b UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^c MICROSOFT RESEARCH ASIA   (China)

Author keywords

Image local descriptor; image matching; large scale image retrieval; visual vocabulary

Indexed keywords

IMAGE MATCHING; IMAGE PROCESSING;

BINARY REPRESENTATIONS; FLOATING POINTS; LOCAL DESCRIPTORS; QUANTIZATION ERRORS; VISUAL CONSISTENCY; VISUAL CONTENT; VISUAL MATCHING; VISUAL VOCABULARIES;

IMAGE RETRIEVAL;

EID: 84897029196     PISSN: 21563357     EISSN: None     Source Type: Journal    
DOI: 10.1109/JETCAS.2014.2298272     Document Type: Article

References (47)

1. H. Bay, T. Tuytelaars, and L. V. Gool, "Speeded-up robust features (SURF)," Comput. Vis. Image Undetstand., vol. 110, no. 3, pp. 346-359, 2008.
2. M. Brown and D. Lowe, "Unsupervised 3-D object recognition and reconstruction in unordered datasets," in Proc. IEEE Int. Conf. 3-D Digital Imag. Model., Jun. 2005, pp. 56-63.
3. M. Brown and D. G. Loww, "Automatic panoramic image stitching using invariant features," Int. J. Comput. Vis., vol. 74, no. 1, pp. 59-73, 2007. (Pubitemid 46673104)
4. M. Calonder, V. Lepetit, C. Strecha, and P. Fua, "Brief: Binary robust independent elementary features," in Eur. Conf. Comput. Vis., 2010, pp. 778-792.
5. V. Chandrasekhar, G. Takacs, D. Chen, S. Tsai, R. Grzeszczuk, and B. Girod, "CHOG: Compressed histogram of gradients a low bit-rate feature descriptor," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 2504-2511.
6. L. Chu, S. Jiang, S. Wang, Y. Zhang, and Q. Huang, "Robust spatial consistency graph model for partial duplicate image retrieval," IEEE Trans. Multimedia, vol. 15, no. 8, pp. 1982-1996, Aug. 2013.
7. M. Fischler and R. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-391, 1981.
8. H. Jégou, M. Douze, and C. Schmid, "Hamming embedding and weak geometric consistency for large scale image search," in Eur. Conf. Comput. Vis., 2008, pp. 304-317.
9. H. Jégou, M. Douze, and C. Schmid, "Improving bag-of-feature for large scale image search," Int. J. Comput. Vis., vol. 87, no. 3, pp. 316-336, 2010.
10. H. Jégou, M. Douze, C. Schmid, and P. Pérez, "Aggregating local descriptor into a compact image representation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 3304-3311.
11. L. Juan and O. Gwun, "A comparison of SIFT, PCA-SIFT and SURF," Int. J. Image Process., vol. 3, no. 4, pp. 143-152.
12. Y. Ke and R. Sukthankar, "PCA-SIFT: A more distinctive representation for local image descriptors," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2004, vol. 2, pp. 506-513.
13. Y. Ke, R. Sukthankar, and L. Huston, "Efficient near-duplicated detection and sub-image retrieval," in ACM Multimedia, 2004, vol. 4, no. 1, pp. 869-876. (Pubitemid 40211882)
14. S. Leutenegger, M. Chli, and R. Y. Siegwart, "BRISK: Binary robust invariant scalable keypoints," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 2548-2555.
15. A. Levin, A. Zomet, S. Peleg, and Y. Weiss, "Seamless image stitching in the gradient domain," in Proc. Eur. Conf. Comput. Vis., 2004, pp. 377-389.
16. G. Li, M. Wang, Z. Lu, R. Hong, and T.-S. Chua, "In-video product annotation with web information mining," ACM Trans. Multimedia Comput., Commun., Appl., vol. 8, no. 4, p. 55, Dec. 2012.
17. D. Liu, G. Hua, P. Viola, and T. Chen, "Integrated feature selection and higher-order spatial feature extraction for object categorization," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
18. D. G. Lowe, "Distinctive image features from scale invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
19. E. Mair, G. D. Hager, D. Burschka, M. Suppa, and G. Hirzinger, "Adaptive and generic corner detection based on the accelerated segment test," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 183-196.
20. J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust wide baseline stereo from maximally stable extremal regions," Image Vis. Comput., vol. 22, no. 10, pp. 761-767, 2004.
21. K. Mikolajczyk and C. Schmid, "A performance evaluation of local descriptors," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 10, pp. 1615-1630, Oct. 2005. (Pubitemid 41555406)
22. D. Nistér and H. Stewénius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, vol. 2, pp. 2161-2168. (Pubitemid 44931581)
23. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
24. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Lost in quantization: Improving particular object retrieval in large scale image databases," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
25. E. Rosten and T. Drummond, "Machine learning for high-speed corner detection," in Proc. Eur. Conf. Comput. Vis., 2006, pp. 430-443. (Pubitemid 44029797)
26. E. Rublee, V. Rabaud, K. Konolige, and G. Bradski, "ORB: An effcient alternative to SIFT or SURF," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 2564-2571.
27. S. Savarese, J. Winn, and A. Criminisi, "Discriminative object class models of appearance and shape by correlatons," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, vol. 2, pp. 2033-2040. (Pubitemid 44931565)
28. X. Shen, Z. Lin, J. Brandt, S. Avidan, and Y. Wu, "Object retrieval and localization with spatially-constrained similarity measure and k-NN reranking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 3013-3020.
29. H. Y. Shum and R. Szeliski, "Systems and experiment paper: Construction of panoramic image mosaics with global and local alignment," Int. J. Comput. Vis., vol. 36, no. 2, pp. 101-130, 2000. (Pubitemid 30588074)
30. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2003, pp. 1470-1477.
31. Q. Tian, S. Zhang, W. Zhou, R. Ji, B. Ni, and N. Sebe, "Building descriptive and discriminative visual codebook for large-scale image applications," Int. J. Multimedia Tools Appl., vol. 51, no. 2, pp. 441-477, 2011.
32. P. Viola and M. J. Jones, "Robust real-time face detection," Int. J. Comput. Vis., vol. 57, no. 2, pp. 137-154, 2004.
33. B. Wang, Z. Li, M. Li, and W. Y. Ma, "Large-scale duplicate detection for web image search," in Proc. IEEE Int. Conf. Multmedia Expo, Jul. 2006, pp. 353-356. (Pubitemid 46679727)
34. M. Wang, G. Li, Z. Lu, Y. Gao, and T.-S. Chua, "When Amazon meets Google: Product visualization by exploring multiple web sources," ACM Trans. Internet Technol., vol. 12, no. 4, p. 12, 2013.
35. M. Wang, H. Li, D. Tao, K. Lu, and X. Wu, "Multimodal graph-based reranking for web image search," IEEE Trans. Image Process., vol. 21, no. 11, pp. 4649-4661, Nov. 2012.
36. M. Wang, K. Yang, X. Hua, and H. Zhang, "Towards a relevant and diverse search of social images," IEEE Trans. Multimedia, vol. 12, no. 8, pp. 829-842, Dec. 2010.
37. X. Wang, M. Yang, T. Cour, S. Zhu, K. Yu, and T. X. Han, "Contextual weighting for vocabulary tree based image retrieval," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 209-216.
38. Z. Wu, Q. Ke, M. Isard, and J. Sun, "Bundling feature for large scale partial-duplicated web image search," in Proc. IEEE Conf. Computer Vis. Pattern Recognit., 2009, pp. 25-32.
39. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 1794-1801.
40. S. Zhang, Q. Huang, G. Hua, S. Jiang, W. Gao, and Q. Tian, "Building contextual visual vocabulary for large-scale image applications," in ACM Multimedia, 2010, pp. 501-510.
41. S. Zhang, Q. Huang, Y. Lu, W. Gao, and Q. Tian, "Building pair-wise visual word tree for efficient image re-ranking," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Mar. 2010, pp. 794-797.
42. S. Zhang, Q. Tian, G. Hua, Q. Huang, and S. Li, "Descriptive visual words and visual phrases for image applications," in ACM Multimedia, 2009, pp. 75-84.
43. S. Zhang, Q. Tian, K. Lu, Q. Huang, and W. Gao, "Edge-SIFT: Discriminative binary descriptor for scalable partial-duplicate mobile search," IEEE Trans. Image Process., vol. 22, no. 7, pp. 2889-2902, Jul. 2013.
44. S. Zhang, M. Yang, X. Wang, Y. Lin, and Q. Tian, "Semantic-aware co-indexing for image retrieval," in Proc. IEEE Int. Conf. Comput. Vis., 2013.
45. Y. Zhang, Z. Jia, and T. Chen, "Image retrieval with geometry-preserving visual phrases," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 809-816.
46. Y. Zheng, M. Zhao, S.-Y. Neo, T.-S. Chua, and Q. Tian, "Visual synset: Towards a higher-level visual representation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
47. W. Zhou, Y. Lu, H. Li, Y. Song, and Q. Tian, "Spatial coding for large scale partial-duplicate web image search," in ACM Multimedia, 2010, pp. 511-520.