Large-scale similarity data management with distributed Metric Index

Information Processing and Management

Volumn 48, Issue 5, 2012, Pages 855-872

  Novak, David ^a   Batko, Michal ^a   Zezula, Pavel ^a  

^a MASARYK UNIVERSITY   (Czech Republic)

Author keywords

Distributed data structures; Metric space; Peer to peer structured networks; Performance tuning; Scalability; Similarity search

Indexed keywords

DISTRIBUTED DATA STRUCTURES; METRIC SPACES; PERFORMANCE TUNING; SIMILARITY SEARCH; STRUCTURED NETWORKS;

DATA STRUCTURES; PEER TO PEER NETWORKS; QUERY PROCESSING; SCALABILITY; SET THEORY; TOPOLOGY;

INFORMATION MANAGEMENT;

EID: 84864282212     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2010.12.004     Document Type: Article

References (33)

1. K. Aberer P-Grid: A self-organizing access structure for P2P information systems Lecture Notes in Computer Science 2172 2001 179 194
2. Amato, G.; & Savino, P. (2008). Approximate similarity search in metric spaces using inverted files. In InfoScale '08: Proceedings of the 3rd International Conference on Scalable Information Systems (pp. 1-10). ICST, Brussels, Belgium.
3. J. Aspnes, and G. Shah Skip graphs SODA '03: Proceedings of the fourteenth annual ACM-SIAM symposium on discrete algorithms 2003 Society for Industrial and Applied Mathematics Philadelphia, PA, USA 384 393
4. M. Batko, F. Falchi, C. Lucchese, D. Novak, R. Perego, and F. Rabitti Building a Web-scale image similarity search system Multimedia Tools and Applications 47 2010 599 629
5. Batko, M.; Gennaro, C.; & Zezula, P. (2005). Similarity grid for searching in metric spaces. DELOS workshop: Digital library architectures, lecture notes in computer science 3664/2005 (pp. 25-44).
6. M. Batko, P. Kohoutkova, and D. Novak Cophir image collection under the microscope SISAP '09: Proceedings of the 2009 second international workshop on similarity search and applications 2009 IEEE Computer Society Washington, DC, USA 47 54
7. M. Batko, D. Novak, F. Falchi, and P. Zezula On scalability of the similarity search in the world of peers Proceedings of the first international conference on scalable information systems (INFOSCALE'06), Hong Kong, May 30-June 1 2006 ACM Press New York, NY, USA 1 12
8. M. Batko, D. Novak, F. Falchi, and P. Zezula Scalability comparison of peer-to-peer similarity search structures Future Generation Computer Systems 24 8 2008 834 848
9. M. Batko, D. Novak, and P. Zezula MESSIF: Metric similarity search implementation framework First international DELOS conference, Pisa, Italy, revised selected papers. Lecture notes in computer science (Vol. 4877) 2007 Springer 1 10
10. M. Bawa, T. Condie, and P. Ganesan LSH forest: Self-tuning indexes for similarity search WWW '05: Proceedings of the 14th international conference on World Wide Web 2005 ACM New York, NY, USA 651 660
11. Bolettieri, P.; Esuli, A.; Falchi, F.; Lucchese, C.; Perego, R.; Piccioli, T.; et al. (2009). CoPhIR: A test collection for content-based image retrieval. CoRR abs/0905.4627v2.
12. E. Chávez, K. Figueroa, and G. Navarro Effective proximity retrieval by ordering permutations IEEE Transactions of Pattern Analysis and Machine Intelligence 30 9 2008 1647 1658
13. Chávez, E.; & Navarro, G. (2000). Measuring the dimensionality of general metric spaces. Tech. Rep. TR/DCC-00-1, Department of Computer Science, University of Chile.
14. Ciaccia, P.; Patella, M.; & Zezula, P. (1997). M-Tree: An efficient access method for similarity search in metric spaces. In Proceedings of 23rd International Conference on Very Large Data Bases (pp. 426-435), August 25-29, 1997, Athens, Greece.
15. A. Crainiceanu, P. Linga, J. Gehrke, and J. Shanmugasundaram Querying peer-to-peer networks using P-Trees WebDB '04: Proceedings of the 7th international workshop on the web and databases 2004 ACM Press New York, NY, USA 25 30
16. J. Dean, and S. Ghemawat MapReduce: Simplified data processing on large clusters Vol. 51 2008 ACM New York, NY, USA January, pp. 107-113
17. Doulkeridis, C.; Vlachou, A.; Kotidis, Y.; Vazirgiannis, M. (2007). Peer-to-peer similarity search in metric spaces. In VLDB 2007: 33rd international conference on very large data bases (pp. 986-997). September 23-27 2007, University of Vienna, Austria: ACM.
18. Esuli, A. (2009a). Mipai: Using the pp-index to build an efficient and scalable similarity search system. In Second international workshop on similarity search and applications (SISAP'09) (pp. 146-148).
19. Esuli, A. (2009b). PP-Index: Using permutation prefixes for efficient and scalable approximate similarity search. In Proceedings of the 7th workshop on large-scale distributed systems for information retrieval (LSDS-IR09) (pp. 17-24).
20. R. Fagin, J. Nievergelt, N. Pippenger, and H.R. Strong Extendible hashing - A fast access method for dynamic files ACM Transactions on Database Systems 4 3 1979 315 344
21. Falchi, F.; Gennaro, C.; & Zezula, P. (2007). A content-addressable network for similarity search in metric spaces. In: Databases, information systems, and peer-to-peer computing, international workshops, DBISP2P 2005/2006, Trondheim, Norway, August 28-29, 2005, Seoul, Korea, September 11, 2006, Revised Selected Papers. Vol. 4125 of Lecture notes in computer science (pp. 98-110). Springer (August).
22. A. Gionis, P. Indyk, and R. Motwani Similarity search in high dimensions via hashing VLDB '99: Proceedings of the 25th international conference on very large data bases 1999 Morgan Kaufmann Publishers Inc. San Francisco, CA, USA 518 529
23. Lv, Q.; Josephson, W.; Wang, Z.; Charikar, M.; & Li, K. (2007). Multi-probe LSH: Efficient indexing for high-dimensional similarity search. In VLDB '07: Proceedings of the 33rd international conference on Very large data bases (pp. 950-961). VLDB Endowment.
24. MPEG-7, 2002. Multimedia content description interfaces. Part 3: Visual. ISO/IEC 15938-3:2002.
25. Novak, D.; Batko, M.; & Zezula, P. (2008). Web-scale system for image similarity search: When the dreams are coming true. In Proceedings of the sixth international workshop on content-based multimedia indexing (CBMI 2008) (p. 8). IEEE.
26. Novak, D.; Batko, M.; & Zezula, P. (2009). Generic similarity search engine demonstrated by an image retrieval application. In Proceedings of the 32nd annual international ACM SIGIR conference on research and development in information retrieval (p. 840).
27. Novak, D.; Batko, M.; & Zezula, P. (in press). Metric Index: An efficient and scalable solution for precise and approximate similarity search. Information Systems. doi:10.1016/j.is.2010.10.002.
28. Novak, D.; Kyselak, M.; & Zezula, P. (2010). On locality-sensitive indexing in generic metric spaces. In Proceedings of the third international conference on similarity search and applications. SISAP '10 (pp. 59-66) New York, NY, USA: ACM.
29. D. Novak, and P. Zezula M-Chord: A scalable distributed similarity search structure Proceedings of the first international conference on scalable information systems (INFOSCALE 2006), Hong Kong, May 30-June 1, 2006 2006 ACM Press New York, NY, USA 1 10
30. H. Samet Foundations of multidimensional and metric data structures Computer graphics and geometric modeling 2005 Morgan Kaufmann Publishers San Francisco, USA
31. M. Skala Counting distance permutations Journal of Discrete Algorithms 7 1 2009 49 61
32. Zezula, P.; Amato, G.; Dohnal, V.; & Batko, M. (2006). Similarity search: The metric space approach. Advances in Database Systems (Vol. 32). Springer.
33. P. Zezula, P. Savino, G. Amato, and F. Rabitti Approximate similarity retrieval with M-Trees The VLDB Journal 7 4 1998 275 293