Parallel accessing massive NetCDF data based on MapReduce

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6318 LNCS, Issue M4D, 2010, Pages 425-431

  Zhao, Hui ^a   Ai, Siyun ^b   Lv, Zhenhua ^a   Li, Bo ^a  

^a EAST CHINA NORMAL UNIVERSITY   (China)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Data intensive; MapReduce; NetCDF; Parallel access

Indexed keywords

ATMOSPHERIC SCIENCE; DATA FORMAT; DATA INTENSIVE; DISTRIBUTED ENVIRONMENTS; MAP-REDUCE; NETCDF; PARALLEL ACCESS; PARALLEL METHOD; RETRIEVAL METHODS; SCIENTIFIC DATA; STORAGE AND ACCESS;

INFORMATION SYSTEMS;

WORLD WIDE WEB;

EID: 78649508618     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-16515-3_53     Document Type: Conference Paper

References (10)

1. Gra, J., Liu, D. T., Nieto-Santisteban, M., Szalay, A., DeWitt, D. J., Heber, G.: Scientific Data Management in the Coming Decade. SIGMOD Record 34(4) (December 2005)
2. Rew, R., Davis, G., Emmerson, S., Davies, H., Hartnett, E.: The NetCDF Users' Guide Version 4.0, http://www.unidata.ucar.edu/software/netcdf/docs/
3. Zender, C. S.: Analysis of self-describing gridded geoscience data with netCDF Operators (NCO). Environmental Modelling & Software 23, 1338-1342 (2008)
4. Jie, L.: Research and Development on the Key Technology of Marine Data Sharing Platform. Tianjin University (2008)
5. Jun-tao, J., Chan-yuan, M., Hai-ying, S., Qiang, L., Ji-chuan, T.: Setting up and Managing of Seafloor Terrain Grid Model Based on NetCDF. Hydrographic Surveying and Charting 27(5) (2007)
6. Li, J., Liao, W., Choudhary, A.: Parallel netCDF: A High Performance Scientific I/O Interface. ACM, 479-492 (2003)
7. The Hadoop Project, http://hadoop. apache.org/
8. Venner, J.: Pro Hadoop. United States of America, Apress (2009)
9. Dean, J., Ghemawat, S.: MapReduce: Simplified Data Processing on Large Clusters. Communications of the ACM 51(1), 107-113 (2008)
10. China Argo Real-time Data Center, http://www.argo-cndc.org/argo-china/ legend/ARGO%20DATA.htm