Distributed high-dimensional index creation using Hadoop, HDFS and C++

Proceedings - International Workshop on Content-Based Multimedia Indexing

Volumn , Issue , 2012, Pages 83-88

  Gudmundsson, Gylfi Pór ^a   Amsaleg, Laurent ^b   Jónsson, Björn Pór ^c  

^a INRIA   (France)

^b CAMPUS DE BEAULIEU   (France)

^c REYKJAVIK UNIVERSITY   (Iceland)

Author keywords

[No Author keywords available]

Indexed keywords

CONSTRUCTION PHASE; HIGH-DIMENSIONAL INDEX; LARGE DATASETS; OPEN-SOURCE; PERFORMANCE GAIN; PRACTICAL PROBLEMS; RUNTIME ENVIRONMENTS;

INDEXING (OF INFORMATION);

EID: 84866636304     PISSN: 19493991     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CBMI.2012.6269848     Document Type: Conference Paper

References (14)

1. M. Batko, F. Falchi, C. Lucchese, D. Novak, R. Perego, F. Rabitti, J. Sedmidubský, and P. Zezula. Building a webscale image similarity search system. MTAP, 2010.
2. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. CACM, 2008.
3. M. Douze, H. Jégou, H. Singh, L. Amsaleg, and C. Schmid. Evaluation of gist descriptors for web-scale image search. In CIVR, 2009.
4. S. Ghemawat, H. Gobioff, and S.-T. Leung. The google file system. In SOSP, 2003.
5. G. Gudmundsson, B. Jónsson, and L. Amsaleg. A largescale performance study of cluster-based high-dimensional indexing. In VLS-MCMR Workshop with ACM MM, 2010.
6. H. Jégou, M. Douze, and C. Schmid. Product quantization for nearest neighbor search. TPAMI, 2011.
7. H. Jégou, F. Perronnin, M. Douze, J. Sánchez, P. Pérez, and C. Schmid. Aggregating local image descriptors into compact codes. TPAMI, 2011.
8. H. Jégou, R. Tavenard, M. Douze, and L. Amsaleg. Searching in one billion vectors: Re-rank with source coding. In ICASSP, 2011.
9. H. Lejsek, F. Amundsson, B. Jónsson, and L. Amsaleg. NVTree: An efficient disk-based index for approximate search in very large high-dimensional collections. TPAMI, 2009.
10. H. Lejsek, B. Jónsson, and L. Amsaleg. NV-Tree: nearest neighbors at the billion scale. In ICMR, 2011.
11. D. Lowe. Distinctive image features from scale invariant keypoints. IJCV, 2004.
12. L. Paulevé, H. Jégou, and L. Amsaleg. Locality sensitive hashing: A comparison of hash function types and querying mechanisms. Pattern Recognition Letters, 2010.
13. J. Sivic and A. Zisserman. Video google: A text retrieval approach to object matching in videos. In ICCV, 2003.
14. T. White. Hadoop: The Definitive Guide. O'Reilly, 2010.