Evaluation of MapReduce for gridding LIDAR data

Proceedings - 2nd IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2010

Volumn , Issue , 2010, Pages 33-40

  Krishnan, Sriram ^a   Baru, Chaitanya ^a   Crosby, Christopher ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Digital elevation models; Gridding; LIDAR; MapReduce

Indexed keywords

DATA PARALLEL; DIGITAL ELEVATION MODEL; GRID CELLS; GRIDDING; GRIDDING ALGORITHMS; IMPLEMENTATION COMPLEXITY; LARGE AMOUNTS OF DATA; LIDAR; LIDAR DATA; MAP-REDUCE; PROGRAMMING MODELS; SEARCH AREA; SHARED NOTHING;

ALGORITHMS; CLOUD COMPUTING; COMPUTER SYSTEMS; DIGITAL INSTRUMENTS; GEOMORPHOLOGY; OPTICAL RADAR; TECHNOLOGY;

SURVEYING;

EID: 79952367060     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CloudCom.2010.34     Document Type: Conference Paper

References (26)

1. J. Dean, and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters", Communications of the ACM, vol. 51, no. 1, pp. 107-113, 2008
2. Apache Software Foundation, "Hadoop MapReduce Framework", http://hadoop.apache.org/mapreduce/, 2010
3. Nokia Research Center, "Disco MapReduce Framework", http://discoproject.org/, 2010
4. Greenplum, "Greenplum MapReduce: Bringing Next-Generation Analytics Technology to the Enterprise" http://www.greenplum.com/resources/mapreduce/ , 2010
5. Aster Data Systems, Inc., "In-Database MapReduce for Rich Analytics", http://www.asterdata.com/product/mapreduce.php, 2010
6. A. Pavlo, E. Paulson, A. Rasin, D. J. Abadi, D. J. DeWitt, S. Madden, and M. Stonebraker, "A comparison of approaches to large-scale data analysis", Proceedings of the 35th SIGMOD International Conference on Management of Data, 2009
7. ESRI, "The ESRI Grid Format", http://en.wikipedia.org/wiki/ ESRI-grid, 2010
8. H. Kim, et al, "An Efficient Implementation of a Local Binning Algorithm for Digital Elevation Model Generation of LiDAR/ALSM Dataset", Eos Trans. AGU, 87(52), Fall Meet. Suppl., Abstract G53C-0921, 2006
9. El-Sheimy, N, Valeo, C., and Habib, A., "Digital terrain modeling: acquisition, manipulation, and applications", Artech House: Boston, MA, 257pp, 2005
10. Cluster Resources Inc, "The TORQUE Resource Manager", http://www.clusterresources.com/products/torque-resource-manager.php, 2010
11. D. Borthakur, "The Hadoop Distributed File System: Architecture and Design", http://hadoop.apache.org/core/docs/current/hdfs-design.pdf, 2007
12. P. Schwan, "Lustre: Building a File System for 1,000-node Clusters", Proceedings of the Linux Symposium, 2003
13. IBM DB2 Information Center, http://publib.boulder.ibm.com/infocenter/ db2luw/v8/index.jsp, 2010
14. W. Gropp, E. Lusk, and A. Skjellum, "Using MPI: Portable Parallel Programming with the Message-Passing Interface", Cambridge: MIT Press, 1994
15. LAS Industry Initiative, "Common LIDAR data exchange format," http://www.asprs.org/society/committees/LIDAR/LIDAR-format.html
16. M. Isenburg, Y. Liu, J. Shewchuk, J. Snoeyink, and T. Thirion, "Generating Raster DEM from Mass Points via TIN Streaming", GIScience'06 Conference Proceedings, pp. 186-198, 2006.
17. Carter, W.E., Shrestha, R.L., and Slatton, K.C., "Geodetic Laser Scanning", Phys. Today 60, 41, 2007
18. El-Sheimy, N, Valeo, C., and Habib, A., "Digital terrain modeling: acquisition, manipulation, and applications", ArtechHouse: Boston, MA, pp 257, 2005
19. J. S. Sarma, "Hadoop", Facebook Engineering Note, http://www.facebook.com/note.php?note-id=16121578919, June 2008
20. Yahoo Inc, "Hadoop at Yahoo!", http://developer.yahoo.com/ hadoop/, 2010.
21. L. A. Barroso, J. Dean and U. Holzle, "Web search for a planet: The google cluster architecture", Micro IEEE, 2003.
22. M. L. Stein, "Interpolation of spatial data: some theory for kriging", Springer Verlag, 1999
23. Apache Hadoop Wiki, "Hadoop Streaming", http://wiki.apache.org/ hadoop/HadoopStreaming, 2010
24. V, Nandigam, C. Baru, C., and C. J. Crosby, "Database Design for High-Resolution LIDAR Topography Data", in SSDBM 2010, Lecture Notes in Computer Science 6187, pp. 151-159, 2010
25. Apache Hadoop Wiki, "Performance Tuning", http://wiki.apache. org/hadoop/PerformanceTuning, 2010
26. Apache Software Foundation, "Hadoop on Demand (HOD)", http://hadoop.apache.org/common/docs/current/hod-scheduler.html, 2010