GeoBase: Indexing netCDF files for large-scale data analysis

Big Data Management, Technologies, and Applications

Volumn , Issue , 2013, Pages 295-313

  Malik, Tanu ^a  

^a UNIVERSITY OF CHICAGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BINS; DIGITAL STORAGE; INFORMATION ANALYSIS;

BINARY FILE FORMATS; END-TO-END SYSTEMS; EXPLORATORY DATA ANALYSIS; KEY-VALUE STORES; LARGE-SCALE DATA ANALYSIS; MINIMAL SUPPORTS; MULTIDIMENSIONAL DATA; SCIENTIFIC DISCIPLINE;

DATA HANDLING;

EID: 84944394256     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-4666-4699-5.ch012     Document Type: Chapter

References (41)

1. Abadi, D., Madden, S., & Hachem, N. (2008). Column-stores vs. row-stores: How different are they really? In Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data. ACM.
2. Abouzeid, A., Bajda-Pawlikowski, K., Abadi, D., Silberschatz, A., & Rasin, A. (2009). HadoopDB: An architectural hybrid of MapReduce and DBMS technologies for analytical workloads. Proceedings of the VLDB Endowment, 2(1), 922-933.
3. Apache. (2010). HBase: Bigtable-like structured storage for Hadoop HDFS. Retrieved from http://hadoop.apache.org/hbase/
4. Baumann, P. (1999). A database array algebra for spatio-temporal data and beyond. In Proceedings of the Workshop on Next Generation Information Technologies and Systems. IEEE.
5. Buck, J., Watkins, N., LeFevre, J., Ioannidou, K., Maltzahn, C., Polyzotis, N., & Brandt, S. (2011). SciHadoop: Array-based query processing in Hadoop. Supercomputing.
6. Chang, F., Dean, J., Ghemawat, S., Hsieh, W., Wallach, D., & Burrows, M. et al. (2008). BigTable: A distributed storage system for structured data. ACM Transactions on Computer Systems, 26(2). doi:10.1145/1365815.1365816.
7. Fenk, R., Markl, V., & Bayer, R. (2002). Interval processing with the UB-tree. In Proceedings of the Database Engineering and Applications Symposium. IEEE.
8. Folk, M., Cheng, A., & Yates, K. (1999). HDF5: A file format and I/O library for high performance computing applications. Supercomputing.
9. George, L. (2008). HBase: The definitive Guide. Sebastopol, CA: O'Reilly Media.
10. Hill, D., & Werpy, J. (2011). Satellite imagery production and processing using Apache Hadoop. In Proceedings ofthe American Geophysical Union Fall Meeting. AGU.
11. Howe, B. (2007). GridFields: Model-driven data transformation in the physical sciences. (PhD, Dissertation). Portland State University, Portland, OR.
12. Jagadish, H. (1997). Analysis of hilbert curve for representing 2-dimensional space. Information Processing Letters, 62(1), 17-22. doi:10.1016/S0020-0190(97)00014-8.
13. Jensen, C., Lin, D., & Ooi, B. (2004). Query and update efficient B+-tree based indexing of moving objects. In Proceedings of the Thirtieth International Conference on Very Large Data Bases. IEEE.
14. Li, J., Liao, W., Choudhary, A., Ross, R., Thakur, R., Gropp, W., ... Zingale, M. (2003). Parallel NetCDF: A high performance scientific I/O interface. Supercomputing.
15. Libkin, L., Machlin, R., & Wong, L. (1996). A query language for multidimensional arrays: Design, implementation, and optimization techniques. SIGMOD Record, 25(2), 228-239. doi:10.1145/235968.233335.
16. Lu, M., & Zwaenepoel, W. (2010). HadoopToSQL: A MapReduce query optimizer. In Proceedings of the European Conference on Computer Systems. IEEE.
17. NASA. (n.d.a). AQUA. Retrieved from http://aqua.nasa.gov/
18. NASA. (n.d.b). Landsat 7. Retrieved from http://landsat.gsfc.nasa.gov
19. NASA. (n.d.c). Pomegranate. Retrieved from http://pomegranate.nasa.gov/
20. Nishimura, S., Das, S., Agrawal, D., & Abbadi, A. (2011). MD-HBase: A scalable multi-dimensional data infrastructure for location aware services. In Proceedings of the 12th IEEE International Conference on Mobile Data Management. IEEE.
21. NOAA. (n.d.). Geostationary satellite server. Retrieved from http://www.goes.noaa.gov/
22. O'Neil, P., Cheng, E., Gawlick, D., & O'Neil, E. (1996). The log-structured merge-tree (LSM-tree). Acta Informatica, 33(4).
23. OPeNDAP. (n.d.). Retrieved from http://opendap.org/
24. Rew, R., & Davis, G. (1990). NetCDF: An interface for scientific data access. IEEE Computer Graphics and Applications, 10(4). doi:10.1109/38.56302.
25. Samet, H. (2005). Foundations of multidimensional and metric data structures. San Francisco, CA: Morgan Kaufmann Publishers Inc..
26. Stonebraker, M., Becla, J., Dewitt, D., Lim, K., Maier, D., Ratzesberger, O., & Zdonik, S. (2009). Requirements for science databases and SciDB. In Proceedings of the Conference on Innovative Database Research. IEEE.
27. Tao, Y., Yi, K., Sheng, C., & Kalnis, P. (2009). Quality and efficiency in high dimensional nearest neighbor search. In Proceedings of the 35th SIGMOD International Conference on Management of Data. ACM.
28. Unidata. (n.d.). NetCDF Java API. Retrieved from http://http://www.unidata.ucar.edu/software/netcdf-java/
29. Wang, D., Zender, C., & Jenks, S. (2008). Clustered workflow execution of retargeted data analysis scripts. In Proceedings of the 8th IEEE International Symposium on Cluster Computing and the Grid. IEEE.
30. Wu, K., Ahern, S., Bethel, E., Chen, J., Childs, H., & Cormier-Michel, E. et al. (2009). FastBit: Interactively Searching massive data. Journal of Physics, 180(2).
31. Zhao, H., Ai, S., Lv, Z., & Li, B. (2010). Parallel accessing massive NetCDF data based on MapReduce. Berlin: Springer. doi:10.1007/978-3-642-16515-3_53. and presentation language. IEEE Transactions on Knowledge and Data Engineering, 6(1), 86-95. doi:10.1109/69.273029.
32. George, L. (2011). HBase: The definitive guide. Sebastopol, CA: O'Reilly Media, Inc..
33. Hjaltason, G. R., & Samet, H. (2003). Index-driven similarity search in metric spaces. ACM Transactions on Database Systems, 28(4), 517-580. doi:10.1145/958942.958948.
34. Lam, C. (2010). Hadoop in action. Manning Publications Co..
35. Lin, J., & Dyer, C. (2010). Data-intensive text processing with MapReduce. Synthesis Lectures on Human Language Technologies, 3(1), 1-177. doi:10.2200/S00274ED1V01Y201006HLT007.
36. Miller, M. (2008). Cloud computing: Web-based applications that change the way you work and collaborate online. Que Publishing.
37. Rew, R., Davis, G., Emmerson, S., Davies, H., & Hartnett, E. (1993). NetCDF user's guide. Boulder, CO: Unidata Program Center.
38. Samet, H. (1990). The design and analysis of spatial data structures. Reading, MA: Addison-Wesley.
39. Silberschatz, A., Korth, H. F., & Sudarshan, S. (1997). Database system concepts (Vol. 4). Hightstown, NJ: McGraw-Hill.
40. Vora, M. N. (2011). Hadoop-HBase for large-scale data. [ICCSNT]. Proceedings of Computer Science and Network Technology, 1, 601-605.
41. White, T. (2012). Hadoop: The definitive guide. Sebastopol, CA: O'Reilly.