SIFT Meets CNN: A Decade Survey of Instance Retrieval

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 40, Issue 5, 2018, Pages 1224-1244

  Zheng, Liang ^a   Yang, Yi ^a   Tian, Qi ^b  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^b One UTSA Circle   (United States)

Author keywords

convolutional neural network; Instance retrieval; literature survey; SIFT

Indexed keywords

CONTENT BASED RETRIEVAL; CONVOLUTION; NEURAL NETWORKS;

CONTENT-BASED IMAGE RETRIEVAL; CONVOLUTIONAL NEURAL NETWORK; CONVOLUTIONAL NEURAL NETWORKS (CNN); IMAGE TRANSFORMATIONS; INSTANCE RETRIEVAL; LITERATURE SURVEY; RETRIEVAL PERFORMANCE; SIFT;

SURVEYS;

EID: 85040080737     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2017.2709749     Document Type: Review

References (169)

1. L. Torresani, M. Szummer, and A. Fitzgibbon, "Efficient object category recognition using classemes," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 776-789.
2. A. W. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of the early years," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 12, pp. 1349-1380, Dec. 2000.
3. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. Int. Conf. Comput. Vis., 2003, Art. no. 1470.
4. G. Csurka, C. Dance, L. Fan, J. Willamowski, and C. Bray, "Visual categorization with bags of keypoints," in Proc. Workshop Statist. Learn. Comput. Vis., 2004, pp. 1-22.
5. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
6. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Proc. Int. Conf. Neural Inf. Process. Syst., 2012, pp. 1097-1105.
7. A. Sharif Razavian , H. Azizpour, J. Sullivan, and S. Carlsson, "CNN features off-The-shelf: An astounding baseline for recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops, 2014, pp. 512-519.
8. A. Babenko, A. Slesarev, A. Chigorin, and V. Lempitsky, "Neural codes for image retrieval," in Proc. Eur. Conf. Comput. Vis., 2014, pp. 584-599.
9. J. Ng, F. Yang, and L. Davis, "Exploiting local features from deep networks for image retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recog. Workshops, 2015, pp. 53-61.
10. G. Tolias, R. Sicre, and H. Jegou, "Particular object retrieval with integral max-pooling of CNN activations," in Proc. Int. Conf. Learn. Representations, 2016.
11. D. Nister and H. Stewenius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2006, pp. 2161-2168.
12. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-8.
13. H. Jegou, M. Douze, and C. Schmid, "Hamming embedding and weak geometric consistency for large scale image search," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 304-317.
14. F. Perronnin, J. Sanchez, and T. Mensink, "Improving the Fisher kernel for large-scale image classification," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 143-156.
15. H. Jegou, M. Douze, C. Schmid, and P. Perez, "Aggregating local descriptors into a compact image representation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 3304-3311.
16. Y. Kalantidis, C. Mellina, and S. Osindero, "Cross-dimensional weighting for aggregated deep convolutional features," in Proc. Eur. Conf. Comput. Vis., 2016, pp. 685-701.
17. A. Gordo, J. Almazan, J. Revaud, and D. Larlus, "Deep image retrieval: Learning global representations for image search," in Proc. Eur. Conf. Comput. Vis., 2016, pp. 241-257.
18. H. Jegou and A. Zisserman, "Triangulation embedding and democratic aggregation for image search," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 3310-3317.
19. M. Shi, Y. Avrithis, and H. Jegou, "Early burst detection for memory-efficient image retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 605-613.
20. G. Tolias, Y. Avrithis, and H. Jegou, "To aggregate or not to aggregate: Selective match kernels for image search," in Proc. IEEE Conf. Comput. Vis., 2013, pp. 1401-1408.
21. Y. Zhang, Z. Jia, and T. Chen, "Image retrieval with geometrypreserving visual phrases," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 809-816.
22. Y. Gong, L. Wang, R. Guo, and S. Lazebnik, "Multi-scale orderless pooling of deep convolutional activation features," in Proc. Eur. Conf. Comput. Vis., 2014, pp. 392-407.
23. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, "ImageNet: A large-scale hierarchical image database," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 248-255.
24. F. Radenovic, G. Tolias, and O. Chum, "CNN image retrieval learns from BoW: Unsupervised fine-tuning with hard examples," in Proc. Eur. Conf. Comput. Vis., 2016, pp. 3-20.
25. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Lost in quantization: Improving particular object retrieval in large scale image databases," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
26. T. Tuytelaars and K. Mikolajczyk, "Local invariant feature detectors: A survey," Found. Trends Comput. Graph. Vis., vol. 3, no. 3, pp. 177-280, 2008.
27. P. R. Beaudet, "Rotationally invariant image operators," in Proc. 4th Int. Joint Conf. Pattern Recognit, 1978, pp. 579-583.
28. J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust widebaseline stereo from maximally stable extremal regions," Image Vis. Comput., vol. 22, no. 10, pp. 761-767, 2004.
29. Z. Wu, Q. Ke, M. Isard, and J. Sun, "Bundling features for large scale partial-duplicate web image search," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 25-32.
30. K. Mikolajczyk, et al., "A comparison of affine region detectors," Int. J. Comput. Vis., vol. 65, no. 1/2, pp. 43-72, 2005.
31. L. Zheng, S. Wang, Z. Liu, and Q. Tian, "Packing and padding: Coupled multi-index for accurate image retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 1947-1954.
32. M. Perdoch, O. Chum, and J. Matas, "Efficient representation of local geometry for large scale object retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 9-16.
33. R. Arandjelovic and A. Zisserman, "Three things everyone should know to improve object retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 2911-2918.
34. K. Simonyan, A. Vedaldi, and A. Zisserman, "Learning local feature descriptors using convex optimisation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 8, pp. 1573-1585, Aug. 2014.
35. T. Ge, Q. Ke, and J. Sun, "Sparse-coded features for image retrieval," in Proc. British Mach. Vis. Conf., 2013, pp. 1-11.
36. R. Arandjelovic and A. Zisserman, "Smooth object retrieval using a bag of boundaries," in Proc. Int. Conf. Comput. Vis., 2011, pp. 375-382.
37. R. Sicre and T. Gevers, "DENSE sampling of features for image retrieval," in Proc. IEEE Int. Conf. Image Process., 2014, pp. 3057-3061.
38. W.-L. Zhao, H. Jegou, and G. Gravier, "Oriented pooling for dense and non-dense rotation-invariant features," in Proc. 24th British Mach. Vis. Conf., 2013, pp. 99.1-99.11.
39. A. Iscen, G. Tolias, P.-H. Gosselin, and H. Jegou, "A comparison of dense region detectors for image search and fine-grained classification," IEEE Trans. Image Process., vol. 24, no. 8, pp. 2369-2381, Aug. 2015.
40. K. Mikolajczyk and C. Schmid, "A performance evaluation of local descriptors," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 10, pp. 1615-1630, Oct. 2005.
41. Y. Ke and R. Sukthankar, "PCA-SIFT: A more distinctive representation for local image descriptors," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2004, pp. II-506-II-513.
42. H. Bay, T. Tuytelaars, and L. Van Gool, "SURF: Speeded up robust features," in Proc. Eur. Conf. Comput. Vis., 2006, pp. 404-417.
43. L. Juan and O. Gwun, "A comparison of SIFT, PCA-SIFT and SURF," Int. J. Image Process., vol. 3, no. 4, pp. 143-152, 2009.
44. E. Rublee, V. Rabaud, K. Konolige, and G. Bradski, "ORB: An efficient alternative to SIFT or SURF," in Proc. IEEE Conf. Comput. Vis., 2011, pp. 2564-2571.
45. J. Philbin, M. Isard, J. Sivic, and A. Zisserman, "Descriptor learning for efficient retrieval," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 677-691.
46. F. Radenovic, H. Jegou, and O. Chum, "Multiple measurements and joint dimensionality reduction for large scale image search with short vectors," in Proc. ACM Int. Conf. Multimedia Retrieval, 2015, pp. 587-590.
47. F. Perronnin, Y. Liu, J. Sanchez, and H. Poirier, "Large-scale image retrieval with compressed fisher vectors," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 3384-3391.
48. P. Koniusz, F. Yan, and K. Mikolajczyk, "Comparison of midlevel feature coding approaches and pooling strategies in visual concept detection," Comput. Vis. Image Understanding, vol. 117, no. 5, pp. 479-492, 2013.
49. P.-H. Gosselin, N. Murray, H. Jegou, and F. Perronnin, "Revisiting the Fisher vector for fine-grained classification," Pattern Recognit. Lett., vol. 49, pp. 92-98, 2014.
50. R. G. Cinbis, J. Verbeek, and C. Schmid, "Approximate Fisher kernels of non-iid imagemodels for image categorization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 6, pp. 1084-1098, Jun. 2015.
51. K. Chatfield, V. S. Lempitsky, A. Vedaldi, and A. Zisserman, "The devil is in the details: An evaluation of recent feature encoding methods," in Proc. British Mach. Vis. Conf., 2011, pp. 76.1-76.12.
52. H. Jegou, F. Perronnin, M. Douze, J. Sanchez, P. Perez, and C. Schmid, "Aggregating local image descriptors into compact codes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 9, pp. 1704-1716, Sep. 2012.
53. H. Jegou and O. Chum, "Negative evidences and co-occurences in image retrieval: The benefit of PCA and whitening," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 774-787.
54. R. Arandjelovic and A. Zisserman, "All about VLAD," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 1578-1585.
55. J. Delhumeau, P.-H. Gosselin, H. Jegou, and P. Perez, "Revisiting the VLAD image representation," in Proc. ACM Int. Conf. Multimedia, 2013, pp. 653-656.
56. S. S. Husain and M. Bober, "Improving large-scale image retrieval through robust aggregation of local descriptors," IEEE Trans. Pattern Anal. Mach. Intell., 2016, Doi: 10.1109/TPAMI.2016.2613873.
57. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Localityconstrained linear coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 3360-3367.
58. G. Tolias, T. Furon, and H. Jegou, "Orientation covariant aggregation of local descriptors with embeddings," in Proc. Eur. Conf. Comput. Vis., 2014, pp. 382-397.
59. N. Murray and F. Perronnin, "Generalized max pooling," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 2473-2480.
60. Z. Liu, S. Wang, and Q. Tian, "Fine-residual VLAD for image retrieval," Neurocomputing, vol. 173, pp. 1183-1191, 2016.
61. H. Jegou, M. Douze, and C. Schmid, "Product quantization for nearest neighbor search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 117-128, Jan. 2011.
62. M. Muja and D. G. Lowe, "Scalable nearest neighbor algorithms for high dimensional data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 11, pp. 2227-2240, Nov. 2014.
63. P. Indyk and R. Motwani, "Approximate nearest neighbors: Towards removing the curse of dimensionality," in Proc. Annu. ACM Symp. Theory Comput., 1998, pp. 604-613.
64. Y. Weiss, A. Torralba, and R. Fergus, "Spectral hashing," in Proc. Int. Conf. Neural Inf. Process. Syst., 2009, pp. 1753-1760.
65. E. Spyromitros-Xioufis, S. Papadopoulos, I. Y. Kompatsiaris, G. Tsoumakas, and I. Vlahavas, "A comprehensive study over VLAD and product quantization in large-scale image retrieval," IEEE Trans. Multimedia, vol. 16, no. 6, pp. 1713-1728, Oct. 2014.
66. M. Douze, H. Jegou, and F. Perronnin, "Polysemous codes," in Proc. Eur. Conf. Comput. Vis., 2016, pp. 785-801.
67. J. Wang, T. Zhang, J. Song, N. Sebe, and H. T. Shen, "A survey on learning to hash," IEEE Trans. Pattern Anal. Mach. Intell., 2017, Doi: 10.1109/TPAMI.2017.2699960.
68. M. Shi, T. Furon, and H. Jegou, "A group testing framework for similarity search in high-dimensional spaces," in Proc. ACM Int. Conf. Multimedia, 2014, pp. 407-416.
69. A. Iscen, M. Rabbat, and T. Furon, "Efficient large-scale similarity search using matrix factorization," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2016, pp. 2073-2081.
70. A. Iscen, T. Furon, V. Gripon, M. Rabbat, and H. Jegou, "Memory vectors for similarity search in high-dimensional spaces," IEEE Trans. Big Data, 2017, Doi: 10.1109/TBDATA.2017.2677964.
71. A. Mikulik, M. Perdoch, O. Chum, and J. Matas, "Learning a fine vocabulary," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 1-14.
72. S. Zhang, M. Yang, X. Wang, Y. Lin, and Q. Tian, "Semanticaware co-indexing for image retrieval," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 1673-1680.
73. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 1794-1801.
74. Y. Cai, W. Tong, L. Yang, and A. G. Hauptmann, "Constrained keypoint quantization: Towards better bag-of-words model for large-scale multimedia retrieval," in Proc. ACM Int. Conf. Multimedia Retrieval, 2012, Art. no. 16.
75. W. Zhou, Y. Lu, H. Li, and Q. Tian, "Scalar quantization for large scale image search," in Proc. ACM Int. Conf. Multimedia, 2012, pp. 169-178.
76. H. Jegou, M. Douze, and C. Schmid, "On the burstiness of visual elements," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 1169-1176.
77. J. Revaud, M. Douze, and C. Schmid, "Correlation-based burstiness for logo retrieval," in Proc. ACM Int. Conf. Multimedia, 2012, pp. 965-968.
78. L. Zheng, S. Wang, Z. Liu, and Q. Tian, "Lp-norm IDF for large scale image search," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 1626-1633.
79. M. Murata, H. Nagano, R. Mukai, K. Kashino, and S. Satoh, "BM25 with exponential IDF for instance search," IEEE Trans. Multimedia, vol. 16, no. 6, pp. 1690-1699, Oct. 2014.
80. A. Torii, J. Sivic, T. Pajdla, and M. Okutomi, "Visual place recognition with repetitive structures," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 883-890.
81. P. Turcot and D. G. Lowe, "Better matching with fewer features: The selection of useful features in large database recognition problems," in Proc. IEEE 12th Int. Conf. Comput. Vis. Workshops, 2009, pp. 2109-2116.
82. X. Wang, M. Yang, T. Cour, S. Zhu, K. Yu, and T. X. Han, "Contextual weighting for vocabulary tree based image retrieval," in Proc. IEEE Conf. Comput. Vis., 2011, pp. 209-216.
83. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 1794-1801.
84. A. Babenko and V. Lempitsky, "The inverted multi-index," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3069-3076.
85. H. Jegou, M. Douze, and C. Schmid, "Improving bag-of-features for large scale image search," Int. J. Comput. Vis., vol. 87, no. 3, pp. 316-336, 2010.
86. L. Zheng, S. Wang, L. Tian, F. He, Z. Liu, and Q. Tian, "Query-adaptive late fusion for image search and person reidentification," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 1741-1750.
87. M. Douze, H. Jegou, and C. Schmid, "An image-based approach to video copy detection with spatio-temporal post-filtering," IEEE Trans. Multimedia, vol. 12, no. 4, pp. 257-266, Jun. 2010.
88. M. Jain, R. Benmokhtar, H. Jegou, and P. Gros, "Hamming embedding similarity-based image classification," in Proc. ACM Int. Conf. Multimedia Retrieval, 2012, Art. no. 19.
89. G. Tolias and H. Jegou, "Visual query expansion with or without geometry: Refining local descriptors by feature aggregation," Pattern Recognit., vol. 47, no. 10, pp. 3466-3476, 2014.
90. M. Jain, H. Jegou, and P. Gros, "Asymmetric hamming embedding: Taking the best of our bits for large scale image search," in Proc. ACM Int. Conf. Multimedia, 2011, pp. 1441-1444.
91. D. Qin, C. Wengert, and L. Gool, "Query adaptive similarity for large scale object retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 1610-1617.
92. H. Jegou, C. Schmid, H. Harzallah, and J. Verbeek, "Accurate image search using the contextual dissimilarity measure," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 1, pp. 2-11, Jan. 2010.
93. K. Van De Sande, T. Gevers, and C. Snoek, "Evaluating color descriptors for object and scene recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1582-1596, Sep. 2010.
94. A. Bosch, A. Zisserman, and X. Munoz, "Scene classification using a hybrid generative/discriminative approach," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 4, pp. 712-727, Apr. 2008.
95. J. Van de Weijer, T. Gevers, and A. D. Bagdanov, "Boosting color saliency in image feature detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 1, pp. 150-156, Jan. 2006.
96. C. Wengert, M. Douze, and H. Jegou, "Bag-of-colors for improved image search," in Proc. ACM Int. Conf. Multimedia, 2011, pp. 1437-1440.
97. S. Zhang, M. Yang, T. Cour, K. Yu, and D. N. Metaxas, "Query specific fusion for image retrieval," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 660-673.
98. C. Deng, R. Ji, W. Liu, D. Tao, and X. Gao, "Visual reranking through weakly supervised multi-graph learning," in Proc. IEEE Conf. Comput. Vis., 2013, pp. 2600-2607.
99. R. Tao, A. W. Smeulders, and S.-F. Chang, "Attributes and categories for generic instance search from one example," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 177-186.
100. O. Chum, J. Philbin, J. Sivic, M. Isard, and A. Zisserman, "Total recall: Automatic query expansion with a generative feature model for object retrieval," in Proc. IEEE Int. Conf. Comput. Vis., 2007, pp. 1-8.
101. O. Chum, A. Mikulik, M. Perdoch, and J. Matas, "Total recall II: Query expansion revisited," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 889-896.
102. J. Philbin, J. Sivic, and A. Zisserman, "Geometric latent dirichlet allocation on a matching graph for large-scale image datasets," Int. J. Comput. Vis., vol. 95, no. 2, pp. 138-153, 2011.
103. Q.-F. Zheng, W.-Q. Wang, and W. Gao, "Effective and efficient object-based image retrieval using visual phrases," in Proc. ACM Int. Conf. Multimedia, 2006, pp. 77-80.
104. S. Zhang, Q. Tian, G. Hua, Q. Huang, and S. Li, "Descriptive visual words and visual phrases for image applications," in Proc. ACM Int. Conf. Multimedia, 2009, pp. 75-84.
105. M. A. Sadeghi and A. Farhadi, "Recognition using visual phrases," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 1745-1752.
106. Y. Jiang, J. Meng, and J. Yuan, "Randomized visual phrases for object search," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3100-3107.
107. L. Torresani, M. Szummer, and A. Fitzgibbon, "Learning querydependent prefilters for scalable image retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 2615-2622.
108. P. Koniusz, F. Yan, P.-H. Gosselin, and K. Mikolajczyk, "Higherorder occurrence pooling for bags-of-words: Visual concept detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 39, no. 2, pp. 313-326, Feb. 2017.
109. J. Yuan, Y. Wu, and M. Yang, "Discovery of collocation patterns: From visual words to visual phrases," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-8.
110. C. L. Zitnick, J. Sun, R. Szeliski, and S. Winder, "Object instance recognition using triplets of feature symbols," Microsoft Research, Cambridge, U.K., Tech. Rep. MSR-TR-200753, 2007.
111. X. Shen, Z. Lin, J. Brandt, S. Avidan, and Y. Wu, "Object retrieval and localization with spatially-constrained similarity measure and k-NN re-ranking," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3013-3020.
112. Y. Avrithis and G. Tolias, "Hough pyramid matching: Speededup geometry re-ranking for large scale image retrieval," Int. J. Comput. Vis., vol. 107, no. 1, pp. 1-19, 2014.
113. X. Wu and K. Kashino, "Adaptive dither voting for robust spatial verification," in Proc. IEEE Conf. Comput. Vis., 2015, pp. 1877-1885.
114. X. Li, M. Larson, and A. Hanjalic, "Pairwise geometric matching for large-scale object retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 5153-5161.
115. J. L. Sch€onberger, T. Price, T. Sattler, J.-M. Frahm, and M. Pollefeys, "A vote-and-verify strategy for fast spatial verification in image retrieval," Proc. Asian Conf. Comput. Vis., 2016, pp. 321-337.
116. D. Qin, S. Gammeter, L. Bossard, T. Quack, and L. Van Gool, "Hello neighbor: Accurate object retrieval with k-reciprocal nearest neighbors," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 777-784.
117. G. Awad, et al., "TRECVID 2016: Evaluating video search, video event detection, localization, and hyperlinking," in Proc. 20th Int. Workshop Video Retrieval Eval., 2016, pp. 1-18.
118. O. Chum, M. Perdoch, and J. Matas, "Geometric min-hashing: Finding a (thick) needle in a haystack," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 17-24.
119. Y. Kalantidis, L. G. Pueyo, M. Trevisiol, R. van Zwol, and Y. Avrithis, "Scalable triangulation-based logo recognition," in Proc. ACM Int. Conf. Multimedia Retrieval, 2011, Art. no. 20.
120. S. Romberg and R. Lienhart, "Bundle min-hashing for logo recognition," in Proc. ACM Int. Conf. Multimedia Retrieval, 2013, pp. 113-120.
121. C.-Z. Zhu, H. Jegou, and S. Satoh, "Query-adaptive asymmetrical dissimilarities for visual object retrieval," in Proc. IEEE Conf. Comput. Vis., 2013, pp. 1705-1712.
122. Z. Chen, W. Zhang, B. Hu, X. Can, S. Liu, and D. Meng, "Retrieving objects by partitioning," IEEE Trans. Big Data, vol. 3, no. 1, pp. 44-54, Jan.-Mar. 2017.
123. A. Iscen, G. Tolias, Y. Avrithis, T. Furon, and O. Chum, "Efficient diffusion on region manifolds: Recovering small objects with compact CNN representations," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2017.
124. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," in Proc. Int. Conf. Learn. Representations, 2015.
125. C. Szegedy, et al., "Going deeper with convolutions," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 1-9.
126. K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2016, pp. 770-778.
127. M. D. Zeiler and R. Fergus, "Visualizing and understanding convolutional networks," in Proc. Eur. Conf. Comput. Vis., 2014, pp. 818-833.
128. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman, "Return of the devil in the details: Delving deep into convolutional nets," in Proc. British Mach. Vis. Conf., 2014, pp. 1-12.
129. B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva, "Learning deep features for scene recognition using places database," in Proc. Int. Conf. Neural Inf. Process. Syst., 2014, pp. 487-495.
130. H. Azizpour, A. S. Razavian, J. Sullivan, A. Maki, and S. Carlsson, "Factors of transferability for a generic convnet representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 9, pp. 1790-1802, Sep. 2016.
131. V. Chandrasekhar, J. Lin, O. Morere, H. Goh, and A. Veillard, "A practical guide to CNNs and Fisher vectors for image instance retrieval," Signal Process., vol. 128, pp. 426-439, 2016.
132. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. LeCun, "OverFeat: Integrated recognition, localization and detection using convolutional networks," in Proc. Int. Conf. Learn. Representations, 2014.
133. A. S. Razavian, J. Sullivan, S. Carlsson, and A. Maki, "Visual instance retrieval with deep convolutional networks," in Proc. Int. Conf. Learn. Representations Workshops, 2015.
134. L. Zheng, Y. Zhao, S. Wang, J. Wang, and Q. Tian, "Good practice in CNN feature transfer," arXiv:1604.00133, 2016.
135. L. Zheng, S. Wang, J. Wang, and Q. Tian, "Accurate image search with multi-scale contextual evidences," Int. J. Comput. Vis., vol. 120, pp. 1-13, 2016.
136. B. Hariharan, P. Arbelaez, R. Girshick, and J. Malik, "Hypercolumns for object segmentation and fine-grained localization," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 447-456.
137. R. Arandjelovic, P. Gronat, A. Torii, T. Pajdla, and J. Sivic, "NetVLAD: CNN architecture for weakly supervised place recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2016, pp. 5297-5307.
138. P. Kulkarni, J. Zepeda, F. Jurie, P. Perez, and L. Chevallier, "Hybrid multi-layer deep CNN/aggregator feature for image classification," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., 2015, pp. 1379-1383.
139. E. Mohedano, K. McGuinness, N. E. O'Connor, A. Salvador, F. Marques, and X. Giro-i Nieto, "Bags of local convolutional features for scalable instance search," in Proc. ACM Int. Conf. Multimedia, 2016, pp. 327-331.
140. A. Babenko and V. Lempitsky, "Aggregating local deep features for image retrieval," in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 1269-1277.
141. L. Xie, L. Zheng, J. Wang, A. Yuille, and Q. Tian, "Interactive: Inter-layer activeness propagation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2016, pp. 270-279.
142. K. Lai, L. Bo, X. Ren, and D. Fox, "A large-scale hierarchical multi-view RGB-D object dataset," in Proc. IEEE Int. Conf. Robot. Autom., 2011, pp. 1817-1824.
143. S. Bell and K. Bala, "Learning visual similarity for product design with convolutional neural networks," ACM Trans. Graph., vol. 34, no. 4, 2015, Art. no. 98.
144. A. Salvador, X. Giro-i Nieto, F. Marques, and S. Satoh, "Faster R-CNN features for instance search," in Proc. IEEE Conf. Comput. Vis. Pattern Recog. Workshops, 2016, pp. 394-401.
145. S. Zagoruyko and N. Komodakis, "Learning to compare image patches via convolutional neural networks," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 4353-4361.
146. P. Fischer, A. Dosovitskiy, and T. Brox, "Descriptor matching with convolutional neural networks: A comparison to sift," arXiv:1405.5769, 2014.
147. K. Mopuri and R. Babu, "Object level deep feature pooling for compact image representation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog. Workshops, 201, pp. 62-70.
148. J. R. Uijlings, K. E. van de Sande, T. Gevers, and A. W. Smeulders, "Selective search for object recognition," Int. J. Comput. Vis., vol. 104, pp. 154-171, 2013.
149. C. L. Zitnick and P. Dollar, "Edge boxes: Locating object proposals from edges," in Proc. Eur. Conf. Comput. Vis., 2014, pp. 391-405.
150. T. Uricchio, M. Bertini, L. Seidenari, and A. Bimbo, "Fisher encoded convolutional bag-of-windows for efficient image retrieval and social image tagging," in Proc. IEEE Int. Conf. Comput. Vis. Workshops, 2015, pp. 1020-1026.
151. S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: Towards real-time object detection with region proposal networks," in Proc. Int. Conf. Neural Inf. Process. Syst., 2015, pp. 91-99.
152. L. Xie, R. Hong, B. Zhang, and Q. Tian, "Image classification and retrieval are ONE," in Proc. ACM Int. Conf. Multimedia Retrieval, 2015, pp. 3-10.
153. M. Paulin, M. Douze, Z. Harchaoui, J. Mairal, F. Perronin, and C. Schmid, "Local convolutional features with unsupervised training for image retrieval," in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 91-99.
154. K. M. Yi, E. Trulls, V. Lepetit, and P. Fua, "LIFT: Learned invariant feature transform," in Proc. Eur. Conf. Comput. Vis., 2016, pp. 467-483.
155. Y. Liu, Y. Guo, S. Wu, and M. S. Lew, "Deepindex for accurate and efficient image retrieval," in Proc. ACM Int. Conf. Multimedia Retrieval, 2015, pp. 43-50.
156. Y. Li, X. Kong, L. Zheng, and Q. Tian, "Exploiting hierarchical activations of neural network for image retrieval," in Proc. ACM Int. Conf. Multimedia, 2016, pp. 132-136.
157. F. Perronnin and D. Larlus, "Fisher vectors meet neural networks: A hybrid classification architecture," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 3743-3752.
158. C. Strecha, A. Bronstein, M. Bronstein, and P. Fua, "LDAHash: Improved matching with smaller descriptors," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1, pp. 66-78, Jan. 2012.
159. K. Lin, H.-F. Yang, J.-H. Hsiao, and C.-S. Chen, "Deep learning of binary hash codes for fast image retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recog. Workshops, 2015, pp. 27-35.
160. F. Zhao, Y. Huang, L. Wang, and T. Tan, "Deep semantic ranking based hashing for multi-label image retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 1556-1564.
161. Y. Gong and S. Lazebnik, "Iterative quantization: A procrustean approach to learning binary codes," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 817-824.
162. A. Gordo, J. Almazan, J. Revaud, and D. Larlus, "End-to-end learning of deep visual representations for image retrieval," arXiv:1610.07940, 2016.
163. S. Zhang, X. Wang, Y. Lin, and Q. Tian, "Cross indexing with grouplets," IEEE Trans. Multimedia, vol. 17, no. 11, pp. 1969-1979, Nov. 2015.
164. O. Morere, A. Veillard, J. Lin, J. Petta, V. Chandrasekhar, and T. Poggio, "Group invariant deep representations for image instance retrieval," in Proc. AAAI Symp. Sci. Intell., 2017.
165. J. Wang, Y. Song, T. Leung, C. Rosenberg, J. Wang, J. Philbin, B. Chen, and Y. Wu, "Learning fine-grained image similarity with deep ranking," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014.
166. Y. Bengio, I. J. Goodfellow, and A. Courville, "Deep learning," Nature, vol. 521, pp. 436-444, 2015.
167. A. Torii, R. Arandjelovic, J. Sivic, M. Okutomi, and T. Pajdla, "24/7 place recognition by view synthesis," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 1808-1817.
168. L. Zheng, L. Shen, L. Tian, S. Wang, J. Wang, and Q. Tian, "Scalable person re-identification: A benchmark," in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 1116-1124.
169. X. Liu, W. Liu, H. Ma, and H. Fu, "Large-scale vehicle re-identification in urban surveillance videos," in Proc. IEEE Int. Conf. Multimedia Expo, 2016, pp. 1-6.