The inverted multi-index

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 37, Issue 6, 2015, Pages 1247-1260

  Babenko, Artem ^a,b   Lempitsky, Victor ^c  

^a YANDEX   (Russian Federation)

^b NATIONAL RESEARCH UNIVERSITY HIGHER SCHOOL OF ECONOMICS   (Russian Federation)

^c SKOLKOVO INSTITUTE OF SCIENCE AND TECHNOLOGY   (Russian Federation)

Author keywords

Image retrieval; Index; nearest neighbor search; product quantization

Indexed keywords

IMAGE RETRIEVAL;

APPROXIMATE NEAREST NEIGHBOR SEARCH; HIGH-DIMENSIONAL; INDEX; INVERTED INDICES; MEMORY EFFICIENCY; MEMORY OVERHEADS; PRODUCT QUANTIZATIONS; SIMILARITY SEARCH;

NEAREST NEIGHBOR SEARCH;

EID: 84929191645     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2361319     Document Type: Article

References (41)

1. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. 9th IEEE Int. Conf. Comput. Vis., 2003, pp. 1470-1477.
2. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
3. O. Boiman, E. Shechtman, and M. Irani, "In defense of nearestneighbor based image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
4. J. Deng, A. C. Berg, K. Li, and F.-F. Li, "What does classifying more than 10,000 image categories tell us?" in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 71-84.
5. T. Malisiewicz and A. A. Efros, "Beyond categories: The visual memex model for reasoning about object relationships," in Proc. Adv. Neural Inf. Process. Syst., 2009, pp. 1222-1230.
6. J. Hays and A. A. Efros, "Scene completion using millions of photographs," ACM Trans. Graph., vol. 26, no. 3, p. 4, 2007.
7. Google Goggles. [Online]. Available: http://www.google.com/mobile/goggles, 2010.
8. H. Lejsek, B. T. Jónsson, and L. Amsaleg, "NV-Tree: Nearest neighbors at the billion scale," in Proc. 1st ACM Int. Conf. Multimedia Retrieval, 2011, p. 54.
9. A. Torralba, R. Fergus, and W. T. Freeman, "80 million tiny images: A large data set for nonparametric object and scene recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 11, pp. 1958-1970, Nov. 2008.
10. D. Nistér and H. Stewénius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, pp. 2161-2168.
11. J. L. Bentley, "Multidimensional binary search trees used for associative searching," Commun. ACM, vol. 18, no. 9, pp. 509-517, 1975.
12. H. Jégou, M. Douze, and C. Schmid, "Product quantization for nearest neighbor search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 117-128, Jan. 2010.
13. H. Jégou, R. Tavenard, M. Douze, and L. Amsaleg, "Searching in one billion vectors: Re-rank with source coding," in Proc. Int. Conf. Acoust., Speech Signal Process., 2011, pp. 861-864.
14. C. D. Manning, P. Raghavan, and H. Schutze, Introduction to Information Retrieval. Cambridge, U.K.: Cambridge Univ. Press, 2008.
15. O. Chum, J. Philbin, J. Sivic, M. Isard, and A. Zisserman, "Total recall: Automatic query expansion with a generative feature model for object retrieval," in Proc. 9th IEEE Int. Conf. Comput. Vis., 2007, pp. 1-8.
16. J. Philbin, M. Isard, J. Sivic, and A. Zisserman, "Descriptor learning for efficient retrieval," in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 677-691.
17. W.-L. Zhao, X. Wu, and C.-W. Ngo, "On the annotation of web videos by efficient near-duplicate search," in IEEE Trans. Multimedia, vol. 12, no. 5, pp. 448-461, May 2010.
18. P. Indyk and R. Motwani, "Approximate nearest neighbors: Towards removing the curse of dimensionality," in Proc. 13th Annu. ACM Symp. Theory Comput., 1998, pp. 604-613.
19. M. Charikar, "Similarity estimation techniques from rounding algorithms," in Proc. 13th Annu. ACM Symp. Theory Comput., 2002, pp. 380-388.
20. Q. Lv, M. Charikar, and K. Li, "Image similarity search with compact data structures," in Proc. 13th ACM Int. Conf. Inf. Knowl. Manage., 2004, pp. 208-217.
21. R. Salakhutdinov and G. E. Hinton, "Semantic hashing," Int. J. Approx. Reasoning, vol. 50, no. 7, pp. 969-978, 2009.
22. A. Torralba, R. Fergus, and Y. Weiss, "Small codes and large image databases for recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
23. M. Raginsky and S. Lazebnik, "Locality-sensitive binary codes from shift-invariant kernels," in Proc. Adv. Neural Inf. Process. Syst., 2009, pp. 1509-1517.
24. H. Jegou, M. Douze, C. Schmid, and P. Pérez, "Aggregating local descriptors into a compact image representation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 3304-3311.
25. H. Jegou, M. Douze, and C. Schmid, "Hamming embedding and weak geometric consistency for large scale image search," in Proc. 10th Eur. Conf. Comput. Vis., 2008, pp. 304-317.
26. A. Babenko and V. Lempitsky, "The inverted multi-index," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 3069-3076.
27. T. Ge, K. He, Q. Ke, and J. Sun, "Optimized product quantization," Tech. Rep. MSR-TR-2013-59, 2013.
28. T. Ge, K. He, Q. Ke, and J. Sun, "Optimized product quantization for approximate nearest neighbor search," CVPR '2013, pp. 2946-2953.
29. M. Norouzi and D. J. Fleet, "Cartesian k-means," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 3017-3024.
30. Y. Kalantidis and Y. Avrithis, "Locally optimized product quantization for approximate nearest neighbor search," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2014, pp. 2329-2336.
31. A. Babenko and V. Lempitsky, "Improving bilayer product quantization for billion-scale approximate nearest neighbors in high dimensions," CoRR, vol. abs/1404.1831, 2014.
32. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
33. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001.
34. M. Douze, H. Jegou, H. Sandhawalia, L. Amsaleg, and C. Schmid, "Evaluation of gist descriptors for web-scale image search," in Proc. ACM Int. Conf. Image Video Retrieval, 2009, p. 9.
35. A. Vedaldi and B. Fulkerson. VLFeat: An open and portable library of computer vision algorithms [Online]. Available: http://www.vlfeat.org/, 2010.
36. M. I. David, C. Lee, and Q. Ke, "Partition min-hash for partial duplicate image discovery," in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 648-662.
37. O. Chum, J. Philbin, M. Isard, and A. Zisserman, "Scalable near identical image and shot detection," in Proc. ACM Int. Conf. Image Video Retrieval, 2007, pp. 549-556.
38. Y. Ke, R. Sukthankar, and L. Huston, "Efficient near-duplicate detection and sub-image retrieval," in Proc. ACM Multimedia, 2004, pp. 869-876.
39. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Lost in quantization: Improving particular object retrieval in large scale image databases," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
40. H. Jégou, M. Douze, and C. Schmid, "Exploiting descriptor distances for precise image search," Institut National De Recherche En Informatique Et En Automatique, Rocquencourt, Paris, Tech. Rep. 7656, 2011.
41. T. Malisiewicz, A. Gupta, and A. A. Efros, "Ensemble of exemplar-SVMs for object detection and beyond," in Proc. 9th IEEE Int. Conf. Comput. Vis., 2011, pp. 89-96.