Coupled binary embedding for large-scale image retrieval

IEEE Transactions on Image Processing

Volumn 23, Issue 8, 2014, Pages 3368-3380

  Zheng, Liang ^a   Wang, Shengjin ^a   Tian, Qi ^b  

^a TSINGHUA NATIONAL LABORATORY FOR INFORMATION SCIENCE AND TECHNOLOGY   (China)

^b University of Texas at San Antonio   (United States)

Author keywords

coupled binary embedding; Feature fusion; image retrieval; multi IDF

Indexed keywords

EXPERIMENTS;

BINARY EMBEDDING; COMPETITIVE PERFORMANCE; DISCRIMINATIVE POWER; FEATURE FUSION; LARGE SCALE EXPERIMENTS; LOCAL TEXTURE FEATURE; MULTI-IDF; VERIFICATION METHOD;

IMAGE RETRIEVAL;

ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; INFORMATION RETRIEVAL; PHOTOGRAPHY; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; MODELS, BIOLOGICAL; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE;

EID: 84904301816     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2330763     Document Type: Article

References (72)

1. H. Jégou, M. Douze, and C. Schmid, "Hamming embedding and weak geometric consistency for large scale image search," in Proc. 10th Eur. Conf. Comput. Vis. ECCV, 2008, pp. 304-317.
2. W. Lu, J. Wang, X.-S. Hua, S. Wang, and S. Li, "Contextual image search," in Proc. 19th ACM Multimedia, 2011, pp. 513-522.
3. X. Li, Y.-J. Zhang, B. Shen, and B.-D. Liu, "Image tag completion by low-rank factorization with dual reconstruction structure preserved," in Proc. IEEE Int. Conf, Image Process. (ICIP), Oct. 2014.
4. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. IEEE Int. Conf. Comput. Vis., (ICCV), Oct. 2003, pp. 1470-1477.
5. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
6. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching," in Proc. Comput. Vis. Pattern Recognit. (CVPR), 2007, pp. 1-8.
7. D. Nister and H. Stewenius, "Scalable recognition with a vocabulary tree," in Proc. Comput. Vis. Pattern Recognit. (CVPR), vol. 2. 2006, pp. 2161-2168. (Pubitemid 44931581)
8. L. Zheng, S. Wang, Z. Liu, and Q. Tian, "Lp-norm IDF for large scale image search," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 1626-1633.
9. L. Zheng, S. Wansg, and Q. Tian, "Lp-norm IDF for scalable image retrieval," IEEE Trans. Image Process., to be published.
10. D. Qin and C. W. L. van Gool, "Query adaptive similarity for large scale object retrieval," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 1610-1617.
11. G. Tolias, Y. Avrithis, and H. Jégou, "To aggregate or not to aggregate: Selective match kernels for image search," in Proc. IEEE Int. Conf. Comput. Vis., (ICCV), Dec. 2013, pp. 1401-1408.
12. Z. Liu, H. Li, W. Zhou, R. Zhao, and Q. Tian, "Contextual hashing for large-scale image search," IEEE Trans. Image Process., vol. 23, no. 4, pp. 1606-1614, Apr. 2014.
13. C. Wengert, M. Douze, and H. Jégou, "Bag-of-colors for improved image search," in Proc. 19th ACM Multimedia, 2011, pp. 1437-1440.
14. R. Arandjelovic and A. Zisserman, "Three things everyone should know to improve object retrieval," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 2911-2918.
15. K. Simonyan, A. Vedaldi, and A. Zisserman, "Descriptor learning using convex optimisation," in Proc. 12th Eur. Conf. Comput. Vis. (ECCV), Oct. 2012, pp. 243-256.
16. H. Jégou, M. Douze, and C. Schmid, "Improving bag-of-features for large scale image search," Int. J. Comput. Vis., vol. 87, no. 3, pp. 316-336, 2010.
17. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Lost in quantization: Improving particular object retrieval in large scale image databases," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2008, pp. 1-8.
18. F. Perronnin, J. Sánchez, and T. Mensink, "Improving the fisher kernel for large-scale image classification," in Proc. 11th Eur. Conf. Comput. Vis. (ECCV), 2010, pp. 143-156.
19. L. Xie, Q. Tian, and B. Zhang, "Spatial pooling of heterogeneous features for image classification," IEEE Trans. Image Process., vol. 23, no. 5, pp. 1994-2008, May 2014.
20. W. Zhou, H. Li, Y. Lu, and Q. Tian, "Principal visual word discovery for automatic license plate detection," IEEE Trans. Image Process., vol. 21, no. 9, pp. 4269-4279, Sep. 2012.
21. W. Zhou, M. Yang, H. Li, X. Wang, Y. Lin, and Q. Tian, "Towards codebook-free: Scalable cascaded hashing for mobile image search," IEEE Trans. Image Process., vol. 16, no. 3, pp. 601-611, Apr. 2014.
22. X. Blix, G. Roig, and L. V. Gool, "Nested sparse quantization for efficient feature coding," in Proc. 12th Eur. Conf. Comput. Vis. (ECCV), 2012, pp. 744-758.
23. Z. Niu, G. Hua, X. Gao, and Q. Tian, "Semi-supervised relational topic model for weakly annotated image recognition in social media," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014.
24. Z. Niu, G. Hua, X. Gao, and Q. Tian, "Context aware topic model for scene recognition," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 2743-2750.
25. F. He and S. Wang, "Beyond χ2 difference: Learning optimal metric for boundary detection," arXiv:1406.0946, 2014.
26. B. Su, X. Ding, L. Peng, and C. Liu, "A novel baseline-independent feature set for arabic handwriting recognition," in Proc. 12th Int. Conf. Document Anal. Recognit. (ICDAR), Aug. 2013, pp. 1250-1254.
27. F. S. Khan, J. van de Weijer, and M. Vanrell, "Modulating shape features by color attention for object recognition," Int. J. Comput. Vis., vol. 98, no. 1, pp. 49-64, 2012.
28. F. S. Khan, R. M. Anwer, J. van de Weijer, A. D. Bagdanov, M. Vanrell, and A. M. Lopez, "Color attributes for object detection," in Proc. IEEE IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 3306-3313.
29. L. Dong, L. Yali, H. Fei, and W. Shengjin, "Object detection in image with complex background," in Proc. 3rd Int. Conf. Multimedia Technol., Nov. 2013.
30. P. Gehler and S. Nowozin, "On feature combination for multiclass object classification," in Proc. IEEE 12th Int. Conf. Comput. Vis. (ICCV), Oct. 2009, pp. 221-228.
31. M. Douze, A. Ramisa, and C. Schmid, "Combining attributes and Fisher vectors for efficient image retrieval," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 745-752.
32. S. Zhang, M. Yang, T. Cour, K. Yu, and D. N. Metaxas, "Query specific fusion for image retrieval," in Proc. 12th Eur. Conf. Comput. Vis. (ECCV), Oct. 2012, pp. 660-673.
33. S. Zhang, M. Yang, X. Wang, Y. Lin, and Q. Tian, "Semantic-aware coindexing for near-duplicate image retrieval," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2013.
34. L. Zheng, S. Wang, F. He, and Q. Tian, "Seeing the big picture: Deep embedding with contextual evidences," arXiv:1406.0132, 2014.
35. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
36. X. Zhang, Z. Li, L. Zhang, W.-Y. Ma, and H.-Y. Shum, "Efficient indexing for large scale visual search," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Oct. 2009, pp. 1103-1110.
37. L. Zheng, S. Wang, Z. Liu, and Q. Tian, "Packing and padding: Coupled multi-index for accurate image retrieval," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014.
38. W. Zhou, H. Li, Y. Lu, and Q. Tian, "SIFT match verification by geometric coding for large-scale partial-duplicate web image search," ACM Trans. Multimedia Comput., Commun., Appl., vol. 9, no. 1, p. 4, 2013.
39. L. Zheng and S. Wang, "Visual phraselet: Refining spatial constraints for large scale image search," IEEE Signal Process. Lett., vol. 20, no. 4, pp. 391-394, Apr. 2013.
40. L. Zheng, S. Wang, W. Zhou, and Q. Tian, "Bayes merging of multiple vocabularies for scalable image retrieval," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014.
41. Z. Liu, H. Li, L. Zhang, W. Zhou, and Q. Tian, "Cross-indexing of binary SIFT codes for large-scale image search," IEEE Trans. Image Process., vol. 23, no. 5, pp. 2047-2057, Apr. 2014.
42. A. Babenko and V. Lempitsky, "The inverted multi-index," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 3069-3076.
43. H. Jegou, M. Douze, and C. Schmid, "Product quantization for nearest neighbor search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 117-128, Jan. 2011.
44. E. Rublee, V. Rabaud, K. Konolige, and G. Bradski, "ORB: An efficient alternative to SIFT or SURF," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Nov. 2011, pp. 2564-2571.
45. S. Leutenegger, M. Chli, and R. Y. Siegwart, "BRISK: Binary robust invariant scalable keypoints," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Nov. 2011, pp. 2548-2555.
46. A. Alahi, R. Ortiz, and P. Vandergheynst, "FREAK: Fast retina keypoint," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 510-517.
47. X. Wang, M. Yang, T. Cour, S. Zhu, K. Yu, and T. X. Han, "Contextual weighting for vocabulary tree based image retrieval," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Nov. 2011, pp. 209-216.
48. S. Robertson, "Understanding inverse document frequency: On theoretical arguments for IDF," J. Documentation, vol. 60, no. 5, pp. 503-520, 2004. (Pubitemid 39538229)
49. J. Van De Weijer and C. Schmid, "Coloring local feature extraction," in Computer Vision. Berlin, Germany: Springer-Verlag, 2006, pp. 334-348. (Pubitemid 44029738)
50. A. Bosch, A. Zisserman, and X. Muoz, "Scene classification using a hybrid generative/discriminative approach," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 4, pp. 712-727, Apr. 2008. (Pubitemid 351559723)
51. J. Van De Weijer, T. Gevers, and A. D. Bagdanov, "Boosting color saliency in image feature detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 1, pp. 150-156, Jan. 2006. (Pubitemid 46395313)
52. K. E. Van De Sande, T. Gevers, and C. G. Snoek, "Evaluating color descriptors for object and scene recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1582-1596, Sep. 2010.
53. T. Tuytelaars and C. Schmid, "Vector quantizing feature space with a regular lattice," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Oct. 2007, pp. 1-8.
54. M. Datar, N. Immorlica, P. Indyk, and V. S. Mirrokni, "Locality-sensitive hashing scheme based on p-stable distributions," in Proc. 28th Annu. Symp. Comput. Geometry, 2004, pp. 253-262.
55. B. Kulis and K. Grauman, "Kernelized locality-sensitive hashing for scalable image search," in Proc. IEEE 12th Int. Conf. Comput. Vis. (ICCV), Oct. 2009, pp. 2130-2137.
56. B. T. Mark J. Huiskes and M. S. Lew, "New trends and ideas in visual concept detection: The MIR flickr retrieval evaluation initiative," in Proc. ACM Multimedia Inform. Retr. (MIR), 2010, pp. 527-536.
57. H. Jégou, M. Douze, and C. Schmid, "On the burstiness of visual elements," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 1169-1176.
58. T. Ojala, M. Pietikainen, and T. Maenpaa, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002. (Pubitemid 34835471)
59. O. Chum, J. Philbin, J. Sivic, M. Isard, and A. Zisserman, "Total recall: Automatic query expansion with a generative feature model for object retrieval," in Proc. IEEE 11th Int. Conf. Comput. Vis. (ICCV), Oct. 2007, pp. 1-8.
60. X. Shen, Z. Lin, J. Brandt, S. Avidan, and Y. Wu, "Object retrieval and localization with spatially-constrained similarity measure and k-NN reranking," in Proc. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 3013-3020.
61. Z. Liu, S. Wang, L. Zheng, and Q. Tian, "Visual reranking with improved image graph," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2014, pp. 6909-6913.
62. R. Arandjelovic and A. Zisserman, "Three things everyone should know to improve object retrieval," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 2911-2918.
63. L. Xie, Q. Tian, W. Zhou, and B. Zhang, "Fast and accurate nearduplicate image search with affinity propagation on the imageweb," Comput. Vis. Image Understand., vol. 124, pp. 31-41, Jul. 2014.
64. M. Jain, H. Jégou, and P. Gros, "Asymmetric hamming embedding: Taking the best of our bits for large scale image search," in Proc. ACM Multimedia, 2011, pp. 1441-1444.
65. J. Wang, J. Wang, Q. Ke, G. Zeng, and S. Li, "Fast approximate k-means via cluster closures," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 3037-3044.
66. A. Torii, J. Sivic, T. Pajdla, and M. Okutomi, "Visual place recognition with repetitive structures," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 883-890.
67. A. Mikulík, M. Perdoch, O. Chum, and J. Matas, "Learning a fine vocabulary," in Proc. 11th Eur. Conf. Comput. Vis. (ECCV), 2010, pp. 1-14.
68. X. Yang, X. Gao, D. Tao, and X. Li, "Improving level set method for fast auroral oval segmentation," IEEE Trans. Image Process., vol. 23, no. 7, pp. 2854-2865, Jul. 2014.
69. X. Zhang, S. Wang, and X. Ding, "Beyond dominant plane assumption: Moving objects detection in severe dynamic scenes with multi-classes ransac," in Proc. Int. Conf. Audio, Lang. Image Process. (ICALIP), Jul. 2012, pp. 822-827.
70. D. Qin, S. Gammeter, L. Bossard, T. Quack, and L. Van Gool, "Hello neighbor: Accurate object retrieval with k-reciprocal nearest neighbors," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 777-784.
71. H. Jegou, C. Schmid, H. Harzallah, and J. Verbeek, "Accurate image search using the contextual dissimilarity measure," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 1, pp. 2-11, Jan. 2010.
72. C. Deng, R. Ji, W. Liu, D. Tao, and X. Gao, "Visual reranking through weakly supervised multi-graph learning," in Proc. IEEE Int. Conf. Comput. Vis.(ICCV), Dec. 2013, pp. 2600-2607.