Scalable Mobile Image Retrieval by Exploring Contextual Saliency

IEEE Transactions on Image Processing

Volumn 24, Issue 6, 2015, Pages 1709-1721

  Yang, Xiyu ^a   Qian, Xueming ^a   Xue, Yao ^a  

^a XI'AN JIAOTONG UNIVERSITY   (China)

Author keywords

mobile image retrieval; multiple queries; salient visual vocabulary pair; scalable image retrieval; spatial layout descriptor

Indexed keywords

BANDWIDTH; SEMANTICS; SMARTPHONES; TELEPHONE SETS;

DESCRIPTORS; HIGH LEVEL SEMANTICS; MULTIPLE QUERIES; QUERY IMAGES; RETRIEVAL PERFORMANCE; SALIENT FEATURES; VISUAL SIMILARITY; VISUAL VOCABULARIES;

IMAGE RETRIEVAL;

EID: 84927153421     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2411433     Document Type: Article

References (46)

1. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. 9th IEEE ICCV, Oct. 2003, pp. 1470-1477.
2. D. G. Lowe, "Distinctive image features from scale-invariant keypoints,"Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
3. H. Bay, T. Tuytelaars, and L. Van Gool, "SURF: Speeded up robust features," in Proc. 9th ECCV, 2006, pp. 404-417.
4. D. Nistér and H. Stewénius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Comput. Soc. Conf. CVPR, Jun. 2006, pp. 2161-2168.
5. E. Gavves and C. G. M. Snoek, "Landmark image retrieval using visual synonyms," in Proc. Int. Conf. MM, 2010, pp. 1123-1126.
6. E. Gavves, C. G. M. Snoek, and A. W. M. Smeulders, "Visual synonyms for landmark image retrieval," Comput. Vis. Image Understand., vol. 166, no. 2, pp. 238-249, Feb. 2012.
7. W. Tang, R. Cai, Z. Li, and L. Zhang, "Contextual synonym dictionary for visual object retrieval," in Proc. 19th ACM Int. Conf. MM, 2011, pp. 503-512.
8. Y. Xue, X. Qian, and B. Zhang, "Mobile image retrieval using multiphotos as query," in Proc. IEEE ICMEW, Jul. 2013, pp. 1-4.
9. J. Chen, B. Feng, L. Zhu, P. Ding, and B. Xu, "Effective near-duplicate image retrieval with image-specific visual phrase selection," in Proc. IEEE ICIP, Sep./Oct. 2012, pp. 1909-1912.
10. S. Zhang, Q. Huang, G. Hua, S. Jiang, W. Gao, and Q. Tian, "Building contextual visual vocabulary for large-scale image applications," in Proc. Int. Conf. MM, 2010, pp. 501-510.
11. W. Zhou, Y. Lu, H. Li, Y. Song, and Q. Tian, "Spatial coding for large scale partial-duplicate web image search," in Proc. Int. Conf. MM, 2010, pp. 511-520.
12. Y. Zhang, Z. Jia, and T. Chen, "Image retrieval with geometry-preserving visual phrases," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 809-816.
13. S. Zhang, Q. Tian, G. Hua, Q. Huang, and S. Li, "Descriptive visual words and visual phrases for image applications," in Proc. 17th ACM Int. Conf. MM, 2009, pp. 75-84.
14. Y. Xue and X. Qian, "Visual summarization of landmarks via viewpoint modeling," in Proc. 19th IEEE ICIP, Sep./Oct. 2012, pp. 2873-2876.
15. O. Chum, J. Philbin, J. Sivic, M. Isard, and A. Zisserman, "Total recall: Automatic query expansion with a generative feature model for object retrieval," in Proc. IEEE 11th ICCV, Oct. 2007, pp. 1-8.
16. O. Chum, A. Mikulík, M. Perdoch, and J. Matas, "Total recall II: Query expansion revisited," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 889-896.
17. V. Chandrasekhar, G. Takacs, D. Chen, and S. Tsai, "CHoG: Compressed histogram of gradients - A low bit-rate feature descriptor," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 2504-2511.
18. B. Girod et al., "Mobile visual search," IEEE Signal Process. Mag., vol. 28, no. 4, pp. 61-76, Jun. 2011.
19. D. Chen, S. S. Tsai, V. Chandrasekhar, G. Takacs, J. Singh, and B. Girod, "Tree histogram coding for mobile image matching," in Proc. DCC, 2009, pp. 143-152.
20. J. Chen, L.-Y. Duan, R. Ji, and W. Gao, "Pruning tree-structured vector quantizer towards low bit rate mobile visual search," in Proc. IEEE ICASSP, Mar. 2012, pp. 965-968.
21. J. Lin, L.-Y. Duan, J. Chen, R. Ji, S. Luo, and W. Gao, "Learning multiple codebooks for low bit rate mobile visual search," in Proc. IEEE ICASSP, Mar. 2012, pp. 933-936.
22. R. Ji, L.-Y. Duan, J. Chen, H. Yao, Y. Rui, and W. Gao, "Location discriminative vocabulary coding for mobile landmark search," Int. J. Comput. Vis., vol. 96, no. 3, pp. 290-314, Feb. 2012.
23. Y. Wu, S. Lu, T. Mei, J. Zhang, and S. Li, "Local visual words coding for low bit rate mobile visual search," in Proc. 20th ACM Int. Conf. MM, 2012, pp. 989-992.
24. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching," in Proc. IEEE Conf. CVPR, Jun. 2007, pp. 1-8.
25. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, 1981.
26. X. Wang, M. Yang, T. Cour, S. Zhu, K. Yu, and T. X. Han, "Contextual weighting for vocabulary tree based image retrieval," in Proc. IEEE ICCV, Nov. 2011, pp. 209-216.
27. M. Perd'och, O. Chum, and J. Matas, "Efficient representation of local geometry for large scale object retrieval," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 9-16.
28. M. Marszalek and C. Schmid, "Spatial weighting for bag-of-features,"in Proc. IEEE Comput. Soc. Conf. CVPR, Jun. 2006, pp. 2118-2125.
29. Z. Wu, Q. Ke, M. Isard, and J. Sun, "Bundling features for large scale partial-duplicate web image search," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 25-32.
30. J. Yuan, Y. Wu, and M. Yang, "Discovery of collocation patterns: From visual words to visual phrases," in Proc. IEEE Conf. CVPR, Jun. 2007, pp. 1-8.
31. Y. Ke and R. Sukthankar, "PCA-SIFT: A more distinctive representation for local image descriptors," in Proc. IEEE Comput. Soc. Conf. CVPR, Jun./Jul. 2004, pp. II-506-II-513.
32. S. A. Chatzichristofis and Y. S. Boutalis, "CEDD: Color and edge directivity descriptor: A compact descriptor for image indexing and retrieval," in Proc. ICVS, May 2008, pp. 312-322.
33. R. Ji, L.-Y. Duan, J. Chen, and W. Gao, "Towards compact topical descriptors," in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 2925-2932.
34. R. Ji, H. Yao, W. Liu, X. Sun, and Q. Tian, "Task-dependent visual-codebook compression," IEEE Trans. Image Process., vol. 21, no. 4, pp. 2282-2293, Apr. 2012.
35. R. Ji, L. Duan, J. Chen, H. Yao, and W. Gao, "A lowbit rate vocabulary coding scheme for mobile landmark search," in Proc. IEEE ICASSP, May 2011, pp. 2316-2319.
36. R. Tibshirani, "Regression shrinkage and selection via the lasso,"J. Roy. Statist. Soc., Ser. B (Methodological), vol. 58, no. 1, pp. 267-288, 1996.
37. A. Qamra and E. Y. Chang, "Scalable landmark recognition using EXTENT," Multimedia Tools Appl., vol. 38, no. 2, pp. 187-208, Jun. 2008.
38. J. Li, X. Qian, Y. Y. Tang, L. Yang, and C. Liu, "GPS estimation from users' photos," in Proc. 19th Int. Conf. MMM, 2013, pp. 118-129.
39. Q. Luo, S. Zhang, T. Huang, W. Gao, and Q. Tian, "Scalable mobile search with binary phrase," in Proc. 5th ICIMCS, 2013, pp. 66-70.
40. B. Fernando and T. Tuytelaars, "Mining multiple queries for image retrieval: On-the-fly learning of an object-specific mid-level representation,"in Proc. IEEE ICCV, Dec. 2013, pp. 2544-2551.
41. S. Zhang, M. Yang, T. Cour, K. Yu, and D. N. Metaxas, "Query specific rank fusion for image retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 803-815, Apr. 2015.
42. R. Arandjelović and A. Zisserman, "Multiple queries for large scale specific object retrieval," in Proc. BMVC, 2012, pp. 1-11.
43. Y. Liu, D. Xu, I. W. Tsang, and J. Luo, "Textual query of personal photos facilitated by large-scale web data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 1022-1036, May 2011.
44. X. Qian, Y. Xue, X. Yang, Y. Y. Tang, X. Hou, and T. Mei, "Landmark summarization with diverse viewpoints," IEEE Trans. Circuits Syst. Video Technol., to be published. [Online]. Available: http://dx.doi.org/10.1109/TCSVT.2014.2369731
45. J. Li, X. Qian, Y. Y. Tang, L. Yang, and T. Mei, "GPS estimation for places of interest from social users' uploaded photos," IEEE Trans. Multimedia, vol. 15, no. 8, pp. 2058-2071, Dec. 2013.
46. X. Yang, X. Qian, and T. Mei, "Learning salient visual word for scalable mobile image retrieval," Pattern Recognit., to be published. [Online]. Available: http://dx.doi.org/10.1016/j.patcog.2014.12.017