Spatial indexing and analytics on Hadoop

GIS: Proceedings of the ACM International Symposium on Advances in Geographic Information Systems

Volumn 04-07-November-2014, Issue , 2014, Pages 73-82

  Whitman, Randall T ^a   Park, Michael B ^a   Ambrose, Sarah M ^a   Hoel, Erik G ^a  

^a ESRI   (United States)

Author keywords

Analytics; Distributed processing; Hadoop; HDFS; K NN; MapReduce; Quadtree; Spatial indexing

Indexed keywords

CLUSTERING ALGORITHMS; DISTRIBUTED COMPUTER SYSTEMS; GEOGRAPHIC INFORMATION SYSTEMS; INDEXING (MATERIALS WORKING); INDEXING (OF INFORMATION); INFORMATION SYSTEMS; NEAREST NEIGHBOR SEARCH; NETWORK MANAGEMENT;

ANALYTICS; DISTRIBUTED PROCESSING; HADOOP; HDFS; MAP-REDUCE; QUAD TREES; SPATIAL INDEXING;

SPATIAL DISTRIBUTION;

EID: 84961206662     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2666310.2666387     Document Type: Conference Paper

References (26)

1. Aji, A., Wang, F., Vo, H., Lee, R., Liu, Q., Zhang, X., and Saltz, J. 2013. Hadoop-GIS: A High Performance Spatial Data Warehousing System over MapReduce, Proc. VLDB Endow. 6, 11 (August 2013), 1009-1020. DOI=http://dx.doi.org/10.14778/2536222.2536227.
2. Aji A., Vo H., and Wang, F. 2014. Effective Spatial Data Partitioning for Scalable Query Processing in MapReduce, In Proceedings of the 40th International Conference on Very Large Data Bases (VLDB '14), Hangshou, China.
3. Beckmann, N., Kriegel, H.-P., Schneider, R., and Seeger, B. 1990. The R∗-tree: an efficient and robust access method for points and rectangles. In Proceedings of the 1990 ACM SIGMOD International Conference on Management of Data (SIGMOD '90). ACM, New York, NY, USA, 322-331. DOI=http://doi.acm.org/10.1145/93597.98741.
4. Cary, A., Sun, Z., Hristidis, V., and Rishe, N. 2009. Experiences on Processing Spatial Data with MapReduce. Scientific and Statistical Database Management, 302-319.
5. Cordova, A., Rinaldi, B., Wall, M. 2014. Accumulo. O'Reilly Media, Inc., Sebastopol, CA, USA.
6. Dean, J., and Ghemawat, S. 2008. MapReduce: simplified data processing on large clusters. Commun. ACM, 51, 1 (January 2008), 107-113. DOI= http://dx.doi.org/10.1145/1327452.1327492.
7. Dittrich, J., Richter, S., Schuh, S., and Quiané-Ruiz, J.-A. 2013. Efficient OR Hadoop: Why not both? IEEE Data Engineering Bulletin. 36, 1, 15-23.
8. Eldawy, A., and Mokbel, M. 2013. A Demonstration of SpatialHadoop: An Efficient MapReduce Framework for Spatial Data, Proc. VLDB Endow. 6, 12 (August 2013), 1230-1233. DOI=http://dx.doi.org/10.14778/2536274.2536283.
9. Eldawy, A., Li, Y., Mokbel, M., and Janardan, R. 2013. CG-Hadoop: Computational Geometry in MapReduce, In Proceedings of the 21st ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL'13). ACM, New York, NY, USA, 294-303. DOI=http://doi.acm.org/10.1145/2525314.2525349.
10. Esri. 2013. GIS Tools for Hadoop. https://github.com/Esri/gis-tools-for-hadoop.
11. Fox, A., Eichelberger, C., Hughes, J., and Lyon, S. 2013. Spatio-temporal Indexing in Non-relational Distributed Databases, In Proceedings of the IEEE International Conference on Big Data, October 2013.
12. Gargantini, I. 1982. An effective way to represent quadtrees. Commun. ACM 25, 12 (December 1982), 905-910. DOI= http://doi.acm.org/10.1145/358728.358741.
13. Geohash.org. Tips & Tricks. http://geohash.org/site/tips.html.
14. Getis, A., and Ord, K. 1992. The Analysis of Spatial Association by Use of Distance Statistics, Geographical Analysis, 24, 3 (July 1992), 189-206. DOI= http://dx.doi.org/10.1111/j.1538-4632.1992.tb00261.x
15. Hjaltason, G., and Samet, H. 1999. Distance Browsing in Spatial Databases, ACM Trans. Database Syst. 24, 2 (June 1999), 265-318. DOI=http://doi.acm.org/10.1145/320248.320255.
16. Hjaltason, G., and Samet, H. 2002. Speeding up construction of PMR quadtree-based spatial indexes. VLDB Journal, 11, 2 (October 2002), 109-137. DOI=http://dx.doi.org/10.1007/s00778-002-0067-8.
17. Hoel, E, and Samet, H. 1991. Efficient Processing of Spatial Queries in Line Segment Databases, In Proceedings of the 2nd International Symposium on Advances in Spatial Databases (SSD'91), Zurich, August 1991.
18. Hoel, E., and Samet, H. 2003. Data-parallel Polygonization, Parallel Computing, 29, 10 (October 2003), 1381-1401. DOI=http://dx.doi.org/10.1016/j.parco.2003.05.001.
19. Leetaru, K., and Schrodt, P. 2013. GDELT: Global Database of Events, Language, and Tone, 1979-2012. International Studies Association Annual Conference, San Francisco, (April 2013).
20. Neis, P., Zipf, A. 2012. Analyzing the Contributor Activity of a Volunteered Geographic Information Project-The Case of OpenStreetMap. ISPRS International Journal of Geo-Information, 1, 2, 146-165.
21. Nelson, R., and Samet, H. 1986. A consistent hierarchical representation for vector data. In Proceedings of the 13th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '86), Evans, D., and Athay, R., (Eds.). ACM, New York, NY, USA, 197-206. DOI=http://doi.acm.org/10.1145/15922.15908.
22. Raad, M. 2013. BigData Spatial Joins, Blog post. http://thunderheadxpler.blogspot.com/2013/10/bigdataspatial-joins.html.
23. Thusoo, A., Sarma, J., Jain, N., Shao, Z., Chakka, P., Anthony, S., Liu, H., Wyckoff, P., and Murthy, A. 2009. Hive-A Warehousing Solution Over a Map-Reduce Framework. Proc. VLDB Endow. 2, 2 (August 2009), 1626-1629.
24. White, T. 2009. Hadoop: The Definitive Guide (1st ed.). O'Reilly Media, Inc., Sebastopol, CA, USA.
25. Whong, C. 2014. FOILing NYC's Taxi Trip Data, Blog post, http://chriswhong.com/open-data/foil-nyc-taxi.
26. Zaharia, M., Chowdhury, M., Franklin, M., Shenker, S., and Stoica, I. 2010. Spark: cluster computing with working sets. In Proceedings of the 2nd USENIX Workshop on Hot Topics in Cloud Computing (HotCloud '10), Boston, June 2010.