Supporting a light-weight data management layer over HDF5

Proceedings - 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2013

Volumn , Issue , 2013, Pages 335-342

  Wang, Yi ^a   Su, Yu ^a   Agrawal, Gagan ^a  

^a The Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGGREGATION QUERIES; CONTENT BASED FILTERING; DATA AGGREGATION; DATA DISSEMINATION; DATA MANAGEMENT TOOLS; INHERENT LIMITATIONS; SCIENTIFIC SIMULATIONS; TEMPORAL AND SPATIAL SCALE;

ALGORITHMS; DATA TRANSFER; GRID COMPUTING; INFORMATION MANAGEMENT;

TOOLS;

EID: 84881277221     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2013.9     Document Type: Conference Paper

References (20)

1. HDF5. http://hdf.ncsa.uiuc.edu/HDF5/.
2. HDF5 High-level APIs. http://www.hdfgroup.org/HDF5/doc/HL/.
3. NetCDF Operator (NCO). http://nco.sourceforge.net/.
4. SQLite. http://wwww.sqlite.org.
5. Universal File Interface (UFI). http://www.barrodale.com/bcs/universal- fileinterface-ufi/.
6. Barrodale Computing Services. http://www.barrodale.com/, 2010.
7. J. B. Buck, N. Watkins, J. LeFevre, K. Ioannidou, C. Maltzahn, N. Polyzotis, and S. Brandt. SciHadoop: Array-based Query Processing in Hadoop. In Proceedings of SC, 2011.
8. P. Cornillon, J. Gallagher, and T. Sgouros. OPeNDAP: Accessing Data in a Distributed, Heterogeneous Environment. Data Science Journal, 2(0):164- 174, 2003.
9. Z. Gong, T. Rogers, J. Jenkins, H. Kolla, S. Ethier, J. Chen, R. Ross, S. Klasky, and N. F. Samatova. MLOC: Multi-level Layout Optimization Framework for Compressed Scientific Data Exploration with Heterogeneous Access Patterns. In Proceedings of ICPP, September 2012.
10. J. Gray, D. T. Liu, M. Nieto-Santisteban, A. Szalay, D. J. DeWitt, and G. Heber. Scientific data management in the coming decade. SIGMOD Rec., 34:34-41, December 2005.
11. C. Jerry, W. Kesheng, and Prabhat. FastQuery: A Parallel Indexing System for Scientific Data. In CLUSTER, pages 455-464. IEEE, 2011.
12. C. Johnson and R. Ross. Visualization and knowledge discovery: Report from the DOE/ASCR workshop on visual analysis and data exploration at extreme scale. Technical report, Department of Energy Office of Science ASCR, Oct. 2007.
13. R. Musick and T. Critchlow. Practical lessons in supporting large-scale computational science. SIGMOD Rec., 28:49-57, December 1999.
14. J. No, R. Thakur, and A. Choudhary. Integrating Parallel File I/O and Database Support for High-Performance Scientific Data Management, 2000.
15. M. Stonebraker, J. Becla, D. Dewitt, K.-T. Lim, D. Maier, O. Ratzesberger, and S. Zdonik. Requirements for Science Data Bases and SciDB. In Conference on Innovative Data Systems Research (CIDR), Jan. 2009.
16. Y. Su and G. Agrawal. Supporting User-Defined Subsetting and Aggregation over Parallel NetCDF Datasets. In Proceedings of CCGRID, pages 212-219, may 2012.
17. A. S. Szalay, P. Z. Kunszt, A. Thakar, J. Gray, D. Slutz, and R. J. Brunner. Designing and mining multi-terabyte astronomy archives: the Sloan Digital Sky Survey. In Proceedings of the 2000 ACM SIGMOD international conference on Management of data, pages 451-462, New York, NY, USA, 2000. ACM.
18. D. Wang, C. Zender, and S. Jenks. Clustered Workflow Execution of Retargeted Data Analysis Scripts. In Proceedings of CCGRID, pages 449- 458, Washington, DC, USA, may 2008. IEEE Computer Society.
19. Y. Wang, W. Jiang, and G. Agrawal. SciMATE: A Novel MapReduce- Like Framework for Multiple Scientific Data Formats. In Proceedings of CCGRID, pages 443-450, may 2012.
20. L. Weng, G. Agrawal, U. Catalyurek, T. Kurc, S. Narayanan, and J. Saltz. An Approach for Automatic Data Virtualization. In Proceedings of HPDC, pages 24-33, Washington, DC, USA, 2004. IEEE Computer Society.