Distributed In-Memory Processing of All k Nearest Neighbor Queries

IEEE Transactions on Knowledge and Data Engineering

Volumn 28, Issue 4, 2016, Pages 925-938

  Chatzimilioudis, Georgios ^a   Costa, Constantinos ^a   Zeinalipour Yazti, Demetrios ^a   Lee, Wang Chien ^b   Pitoura, Evaggelia ^c  

^a UNIVERSITY OF CYPRUS   (Cyprus)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

^c UNIVERSITY OF IOANNINA   (Greece)

Author keywords

All kNN queries; data replication; main memory processing; shared nothing architectures; space partitioning

Indexed keywords

ALGORITHMS; BATCH DATA PROCESSING; EFFICIENCY; MOTION COMPENSATION; NEAREST NEIGHBOR SEARCH; PARTITIONS (BUILDING); SCALABILITY;

DATA REPLICATION; K-NN QUERY; MAIN MEMORY; SHARED NOTHING; SPACE PARTITIONING;

DATA HANDLING;

EID: 84963728902     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2015.2503768     Document Type: Article

References (30)

1. F. N. Afrati, A. D. Sarma, S. Salihoglu, and J. D. Ullman, "Upper and lower bounds on the cost of a Map-reduce computation, " in Proc. 39th Int. Conf. Very Large Data Bases, 2013, pp. 277-288.
2. T. Brinkhoff, "A framework for generating network-based moving objects, " Geoinformatica, vol. 6, pp. 153-180, 2002.
3. P. B. Callahan, "Optimal parallel all-nearest-neighbors using the well-separated pair decomposition, " in Proc. 34th IEEE Annu. Found. Comput. Sci., 1993, pp. 332-340.
4. G. Chatzimilioudis, D. Zeinalipour-Yazti, W.-C. Lee, and M. D. Dikaiakos, "Continuous all K-nearest neighbor querying in smartphone networks, " in Proc. 13th IEEE Int. Conf. Mobile Data Manage., 2012, pp. 79-88.
5. Y. Chen and J.M. Patel, "Efficient evaluation of all-nearest-neighbor queries, " in Proc. 23rd IEEE Int. Conf. Data Eng., 2007, pp. 1056-1065.
6. K. L. Clarkson, "Fast algorithms for the all nearest neighbors problem, " in Proc. 24th Annu. Symp. Found. Comput. Sci., 1983, pp. 226-232.
7. C. Costa, C. Anastasiou, G. Chatzimilioudis, and D. Zeinalipour-Yazti, "Rayzit: An anonymous and dynamic crowd messaging architecture, " in Proc. 3rd IEEE Int. Workshop Mobile Data Manage., Mining, Comput. Social Netw., 2015, vol. 2, pp. 98-103.
8. J. Dean and S. Ghemawat, "MapReduce: Simplified data processing on large clusters, " in Proc. 6th Conf. Symp. Operating Syst. Des. Implementation, 2004, vol. 6, pp. 10-23.
9. F. Dehne, A. Fabri, and A. Rau-Chaplin, "Scalable parallel computational geometry for coarse grained multicomputers, " Int. J. Comput. Geometry, vol. 6, pp. 379-400, 1996.
10. D. J. DeWitt, R. H. Katz, F. Olken, L. D. Shapiro, M. R. Stonebraker, and D. Wood, "Implementation techniques for main memory database systems, " in Proc. ACM SIGMOD Int. Conf. Manage. Data, 1984, pp. 1-8.
11. S. Ewen, S. Schelter, K. Tzoumas, D. Warneke, and V. Markl, "Iterative parallel data processing with stratosphere: An inside look, " in Proc. ACM SIGMOD Int. Conf. Manage. Data, 2013, pp. 1053-1056.
12. H. N. Gabow, J. L. Bentley, and R. E. Tarjan, "Scaling and related techniques for geometry problems, " in Proc. 16th ACM Symp. Theory Comput., 1984, pp. 135-143.
13. B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. D. Joseph, R. Katz, S. Shenker, and I. Stoica, "Mesos: A platform for Finegrained resource sharing in the data center, " in Proc. 8th USENIX Conf. Netw. Syst. Des. Implementation, 2011, pp. 22-35.
14. E. H. Jacox and H. Samet, "Spatial join techniques, " ACM Trans. Database Syst., vol. 32, pp. 1-8, 2007.
15. T. H. Lai and M.-J. Sheng, "Constructing euclidean minimum spanning trees and all nearest neighbors on reconfigurable meshes, " IEEE Trans. Parallel Distrib. Syst., vol. 7, no. 8, pp. 806-817, Aug. 1996.
16. W. Lu, Y. Shen, S. Chen, and B. C. Ooi, "Efficient processing of k nearest neighbor joins using MapReduce, " in Proc. 38th Int. Conf. Very Large Data Bases, 2012, pp. 1016-1027.
17. M. Muralikrishna and D. J. DeWitt, "Equi-depth multidimensional histograms, " in Proc. ACM SIGMOD Int. Conf. Manage. Data, 1988, pp. 28-36.
18. E. C. Ngai, M. B. Srivastava, and L. Jiangchuan, "Context-aware sensor data dissemination for mobile users in remote areas, " in Proc. IEEE Int. Conf. Comput. Commun., 2012, pp. 2711-2715.
19. N. Nodarakis, E. Pitoura, S. Sioutas, A. Tsakalidis, D. Tsoumakos, G. Tzimas, "Efficient multidimensional AkNN query processing in the cloud, " in Proc. 25th Int. Conf. Database Expert Syst. Appl., 2014, pp. 477-491.
20. P. Pacheco, Parallel Programming With MPI. San Mateo, CA, USA: Morgan Kaufman, 1997.
21. E. Plaku and L. E. Kavraki, "Distributed computation of the Knn graph for large High-dimensional point sets, " J. Parallel Distrib. Comput., vol. 67, no. 3, pp. 346-359, 2007.
22. M. Renz, N. Mamoulis, T. Emrich, Y. Tang, R. Cheng, A. Zufle, and P. Zhang, "Voronoi-based nearest neighbor search for Multidimensional uncertain databases, " in Proc. 29th IEEE Int. Conf. Data Eng., 2013, pp. 158-169.
23. N. Roussopoulos, S. Kelley, and F. Vincent, "Nearest neighbor queries, " in Proc. ACM SIGMOD Int. Conf. Manage. Data, 1995, pp. 71-79.
24. P. M. Vaidya, "An o(n log n) algorithm for the All-nearest-neighbors problem, " Discrete Comput. Geometry, vol. 4, pp. 101-115, 1989.
25. C. Xia, H. Lu, B. C. Ooi, and J. Hu, "Gorder: An efficient method for knn join processing, " in Proc. 30th Int. Conf. Very Large Data Bases, 2004, pp. 756-767.
26. B. Yao, F. Li and P. Kumar, "K nearest neighbor queries and kNNjoins in large relational databases (almost) for free, " in Proc. 26th IEEE Int. Conf. Data Eng., 2010, pp. 4-15.
27. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M. J. Franklin, S. Shenker, and I. Stoica, "Resilient distributed datasets: A Fault-tolerant abstraction for In-memory cluster computing, " in Proc. 9th USENIX Conf. Netw. Syst. Des. Implementation, 2012, pp. 10-16.
28. C. Zhang, F. Li, and J. Jestes, "Efficient parallel kNN joins for large data in MapReduce, " in Proc. 15th Int. Conf. Extending Database Technol., 2012, pp. 38-49.
29. J. Zhang, N. Mamoulis, D. Papadias, and Y. Tao, "All-nearestneighbors queries in spatial databases, " in Proc. 16th Int. Conf. Sci. Statistical Database Manage., 2004, pp. 297-306.
30. Y. Zheng, L. Liu, L. Wang, and X. Xie, "Learning transportation mode from raw GPS data for geographic applications on the web, " in Proc. 17th Int. Conf. World Wide Web, 2008, pp. 247-256.