Indexing and searching 100M images with map-reduce

ICMR 2013 - Proceedings of the 3rd ACM International Conference on Multimedia Retrieval

Volumn , Issue , 2013, Pages 17-24

  Moise, Diana ^a   Shestakov, Denis ^a   Gudmundsson, Gylfi ^a   Amsaleg, Laurent ^b  

^a INRIA   (France)

^b CAMPUS DE BEAULIEU   (France)

Author keywords

hadoop; high dimensional indexing; map reduce

Indexed keywords

FAILURE DETECTION; HADOOP; HIGH-DIMENSIONAL INDEXING; INDEXING ALGORITHMS; MAP-REDUCE; MULTIMEDIA COLLECTIONS; PERFORMANCE IMPROVEMENTS; SIFT DESCRIPTORS;

CODING ERRORS; FAULT TOLERANCE; SCALABILITY;

INDEXING (OF INFORMATION);

EID: 84877606551     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2461466.2461470     Document Type: Conference Paper

References (23)

1. M. Batko, F. Falchi, C. Lucchese, D. Novak, R. Perego, F. Rabitti, J. Sedmidubský, and P. Zezula. Building a web-scale image similarity search system. Multimedia Tools Appl., 47(3), 2010.
2. F. Chierichetti, A. Panconesi, P. Raghavan, M. Sozio, A. Tiberi, and E. Upfal. Finding near neighbors through cluster pruning. In PODS, 2007.
3. M. Datar, N. Immorlica, P. Indyk, and V. S. Mirrokni. Locality-sensitive hashing scheme based on p-stable distributions. In SCG, 2004.
4. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. Commun. ACM, 51(1), 2008.
5. M. Douze, H. Jégou, H. Singh, L. Amsaleg, and C. Schmid. Evaluation of gist descriptors for web-scale image search. In CIVR, 2009.
6. S. Ghemawat, H. Gobioff, and S.-T. Leung. The google file system. In SOSP, 2003.
7. A. Gionis, P. Indyk, and R. Motwani. Similarity search in high dimensions via hashing. In VLDB, 1999.
8. G. Gudmundsson, B. T. Jónsson, and L. Amsaleg. A large-scale performance study of cluster-based high-dimensional indexing. In VLS-MCMR Workshop with ACM MM, 2010.
9. J. S. Hare, S. Samangooei, D. P. Dupplaw, and P. H. Lewis. Imageterrier: an extensible platform for scalable high-performance image retrieval. In ICMR, 2012.
10. H. Jégou, M. Douze, and C. Schmid. Hamming embedding and weak geometric consistency for large scale image search. In ECCV, 2008.
11. H. Jégou, M. Douze, and C. Schmid. Product quantization for nearest neighbor search. IEEE Trans. on PAMI, 2011.
12. H. Jégou, F. Perronnin, M. Douze, J. Sánchez, P. Pérez, and C. Schmid. Aggregating local image descriptors into compact codes. IEEE Trans. on PAMI, 2011.
13. H. Jégou, R. Tavenard, M. Douze, and L. Amsaleg. Searching in one billion vectors: Re-rank with source coding. In ICASSP, 2011.
14. Y. Jégou, S. Lantéri, J. Leduc, and all. Grid'5000: a large scale and highly reconfigurable experimental Grid testbed. Intl. Journal of HPC Applications, 20(4), 2006.
15. A. Joly and O. Buisson. A posteriori multi-probe locality sensitive hashing. In MM, 2008.
16. H. Lejsek, F. H. Amundsson, B. T. Jónsson, and L. Amsaleg. NV-Tree: An efficient disk-based index for approximate search in very large high-dimensional collections. IEEE Trans. on PAMI, 2009.
17. H. Lejsek, B. T. Jónsson, and L. Amsaleg. NV-Tree: nearest neighbors at the billion scale. In ICMR, 2011.
18. D. Lowe. Distinctive image features from scale invariant keypoints. IJCV, 60(2), 2004.
19. Q. Lv, W. Josephson, Z. Wang, M. Charikar, and K. Li. Multi-probe lsh: efficient indexing for high-dimensional similarity search. In VLDB, 2007.
20. L. Paulevé, H. Jégou, and L. Amsaleg. Locality sensitive hashing: A comparison of hash function types and querying mechanisms. Pattern Recognition Letters, 2010.
21. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman. Lost in quantization: Improving particular object retrieval in large scale image databases. In CVPR, 2008.
22. K. Shvachko, H. Kuang, S. Radia, and R. Chansler. The hadoop distributed file system. In MSST, 2010.
23. J. Sivic and A. Zisserman. Video google: A text retrieval approach to object matching in videos. In ICCV, 2003.