Efficient parallel kNN joins for large data in MapReduce

ACM International Conference Proceeding Series

Volumn , Issue , 2012, Pages 38-49

  Zhang, Chi ^a   Li, Feifei ^b   Jestes, Jeffrey ^b  

^a Florida State University   (United States)

^b University of Utah   (United States)

Author keywords

Algorithms; H.2.4 Information Systems : Database Management Systems; Subject: Query processing

Indexed keywords

DATA MINING APPLICATIONS; DATA SETS; H.2.4 [INFORMATION SYSTEMS]: DATABASE MANAGEMENT-SYSTEMS; K-NEAREST NEIGHBORS; LARGE DATA; MAP-REDUCE; MULTIMEDIA DATABASE; SHARED NOTHING; SYNTHETIC DATASETS;

ALGORITHMS; DATA PROCESSING;

DATABASE SYSTEMS;

EID: 84863510705     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2247596.2247602     Document Type: Conference Paper

References (26)

1. A. Akdogan, U. Demiryurek, F. Banaei-Kashani, and C. Shahabi. Voronoi-based geospatial query processing with mapreduce. In CloudCom, 2010.
2. C. Böhm and F. Krebs. The k-nearest neighbor join: Turbo charging the kdd process. KAIS, 6:728-749, 2004.
3. T. Brinkhoff, H.-P. Kriegel, and B. Seeger. Parallel processing of spatial joins using R-trees. In ICDE, 1996.
4. K. S. Candan, P. Nagarkar, M. Nagendra, and R. Yu. RanKloud: a scalable ranked query processing framework on hadoop. In EDBT, 2011.
5. M. Connor and P. Kumar. Parallel construction of k-nearest neighbor graphs for point clouds. In Eurographics Symposium on PBG, 2008.
6. J. Dean and S. Ghemawat. MapReduce: simplified data processing on large clusters. In OSDI, 2004.
7. E. Hoel and H. Samet. Data-parallel spatial join algorithms. In ICPP, 1994.
8. M. Kitsuregawa and Y. Ogawa. Bucket spreading parallel hash: A new, robust, parallel hash join method for data skew in the super database computer. In VLDB, 1990.
9. Y. Lin, D. Agrawal, C. Chen, B. C. Ooi, and S. Wu. Llama: leveraging columnar storage for scalable join processing in the mapreduce framework. In SIGMOD, 2011.
10. G. Luo, J. Naughton, and C. Ellmann. A non-blocking parallel spatial join algorithm. In ICDE, 2002.
11. L. Mutenda and M. Kitsuregawa. Parallel R-tree spatial join for a shared-nothing architecture. In DANTE, 1999.
12. A. Okcan and M. Riedewald. Processing theta-joins using mapreduce. In SIGMOD, 2011.
13. J. M. Patel and D. J. DeWitt. Clone join and shadow join: two parallel spatial join algorithms. In ACM GIS, 2000.
14. E. Plaku and L. E. Kavraki. Distributed computation of the kNN graph for large high-dimensional point sets. J. Parallel Distrib. Comput., 67(3):346-359, 2007.
15. D. Schneider and D. DeWitt. A performance evaluation of four parallel join algorithms in a shared-nothing multiprocessor environment. In SIGMOD, 1989.
16. A. Stupar, S. Michel, and R. Schenkel. RankReduce - processing K-Nearest Neighbor queries on top of MapReduce. In LSDS-IR, 2010.
17. R. Vernica, M. J. Carey, and C. Li. Efficient parallel set-similarity joins using mapreduce. In SIGMOD, 2010.
18. J. Wang, S. Wu, H. Gao, J. Li, and B. C. Ooi. Indexing multi-dimensional data in a cloud system. In SIGMOD, 2010.
19. S. Wu, D. Jiang, B. C. Ooi, and K.-L. Wu. Efficient b-tree based indexing for cloud data processing. PVLDB, 3(1):1207-1218, 2010.
20. C. Xia, H. Lu, B. C. Ooi, and J. Hu. Gorder: an efficient method for knn join processing. In VLDB, 2004.
21. B. Yao, F. Li, and P. Kumar. K nearest neighbor queries and knn-joins in large relational databases (almost) for free. In ICDE, 2010.
22. C. Yu, B. Cui, S. Wang, and J. Su. Efficient index-based knn join processing for high-dimensional data. Inf. Softw. Technol., 49(4):332-344, 2007.
23. C. Yu, R. Zhang, Y. Huang, and H. Xiong. High-dimensional knn joins with incremental updates. Geoinformatica, 14(1):55-82, 2010.
24. S. Zhang, J. Han, Z. Liu, K. Wang, and S. Feng. Spatial queries evaluation with mapreduce. In GCC, 2009.
25. S. Zhang, J. Han, Z. Liu, K. Wang, and Z. Xu. SJMR: Parallelizing spatial join with MapReduce on clusters. In CLUSTER, 2009.
26. X. Zhou, D. Abel, and D. Truffet. Data partitioning for parallel spatial join processing. Geoinformatica, 2:175-204, 1998.