Climate Analytics as a Service

Cloud Computing in Ocean and Atmospheric Sciences

Volumn , Issue , 2016, Pages 187-219

  Schnase, J L ^a  

^a NASA GODDARD SPACE FLIGHT CENTER   (United States)

Author keywords

Archive management; Big data; Climate models; Climate reanalysis; Cloud computing; Hadoop; High performance computing; IPCC; MapReduce; MERRA; OAIS

Indexed keywords

APPLICATION PROGRAMMING INTERFACES (API); CLIMATE MODELS; CLOUD COMPUTING; DIGITAL STORAGE; DISTRIBUTED COMPUTER SYSTEMS; NASA;

HADOOP; HIGH PERFORMANCE COMPUTING; IPCC; MAP-REDUCE; MERRA; OAIS; REANALYSIS;

BIG DATA;

EID: 84969699830     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-803192-6.00011-6     Document Type: Chapter

References (44)

1. Agrawal, D., Das, S., Abbadi, A.E., 2011. Big data and cloud computing: current state and future opportunities. In: Electronic Proceedings of the 14th International Conference on Extending Database Technology (EBDT 2011) 4 pp. http://www.cs.ucsb.edu/~sudipto/papers/edbt-tutorial.pdf.
2. Burned Area Emergency Response (BAER), 2015. http://www.nifc.gov/BAER.
3. Baker, K.S., Bowker, G.C., 2007. Information ecology: open system environment for data, memories, and knowing. Journal of Intelligent Information Systems: Integrating Artificial Intelligence and Database Technologies 29 (1), 127-144.
4. Buck, J.B., Watkins, N., LeFevre, J., Ioannidou, K., Maltzahn, C., Polyzotis, N., Brandt, S., 2011. SciHadoop: array-based query processing in Hadoop. In: Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC '11), pp. 1-11. Also available online at: https://users.soe.ucsc.edu/~carlosm/Papers/buck-sc11.pdf.
5. Copernicus Climate Change Service (CCCS), 2015. http://www.ecmwf.int/en/about/what-we-do/copernicus/copernicus-climate-change-service.
6. Climate Model Data Services (CDS), 2015. https://cds.nccs.nasa.gov.
7. Climate and Forecast Conventions and Metadata (CF), 2015. http://cfconventions.org.
8. Cloudera, 2015. http://cloudera.com.
9. Climate Model Intercomparison Project (CMIP), 2015. http://cmip-pcmdi.llnl.gov.
10. Collaborative REAnalysis Technical Environment - Intercomparison Project (CREATE-IP), 2015. https://www.earthsystemcog.org/projects/create-ip/aboutus/.
11. Dean, J., Ghemawat, S., 2008. MapReduce: simplified data processing on large clusters. Communications of the ACM 51 (1), 107-113.
12. Edwards, P.N., 2010. A Vast Machine: Computer Models, Climate Data, and the Politics of Global Warming. MIT Press, Cambridge, Mass. 518 pp.
13. Earth Observing System Distributed Information System (EOSDIS), 2015. https://earthdata.nasa.gov.
14. Ernst, Young, 2011. Cloud Computing Issues and Impacts. Publication in the Ernst & Young Global Technology Industry Discussion Series. https://www.hashdoc.com/documents/10977/cloud-computing-issues-and-impacts.
15. Earth System Grid Federation (ESGF), 2015. http://esgf.llnl.gov.
16. Hierarchical Data Format Version 5 (HDF-5), 2015. https://www.hdfgroup.org/HDF5/.
17. Hadoop Distributed File System (HDFS), 2015. http://hadoop.apache.org.
18. Intergovernmental Panel on Climate Change (IPCC), 2015. http://www.ipcc.ch.
19. iPlant Collaborative (iPlant), 2015. http://www.iplantcollaborative.org.
20. Integrated Rule-Oriented Data System (iRODS), 2015. http://www.irods.org.
21. Leskovec, J., Rajaraman, A., Ullman, J.D., 2014. Mining of Massive Datasets. Cambridge University Press. 513 pp. Available online at: http://www.mmds.org.
22. Li, Z., Schnase, J.L., Duffy, D.Q., Lee, T., Bowen, M., Yang, C., 2016. A spatiotemporal indexing approach for efficient processing of big array-based climate data with MapReduce. International Journal of Geographical Information Science, (in press).
23. Lohr, S., August 17, 2014. For Big-Data Scientists, "Janitor Work" Is Key Hurdle to Insights. The New York Times. Technology Section http://www.nytimes.com/2014/08/18/technology/for-big-data-scientists-hurdle-to-insights-is-janitor-work.html?_r=2.
24. Modern-Era Retrospective Analysis for Research and Applications (MERRA), 2015. http://gmao.gsfc.nasa.gov/merra/.
25. Nadeau, D., Schnase, J.L., Duffy, D.Q., McInerney, M.A., Tamkin, G.S., Thompson, J.H., Strong, S.L., 2014. Cloud-enabled climate analytics-as-a-service using reanalysis data (IN53A-3787). In: American Geophysical Union (AGU) Fall Meeting, December 15-19, 2014, San Francisco, CA.
26. NASA, 2012. A.40 Computational Modeling Algorithms and Cyberinfrastructure. NASA Research Announcement Solicitation NNH11ZDA001N-CMAC. http://nspires.nasaprs.com/external/viewrepositorydocument/cmdocumentid=257069/solicitationId=%7B074C12AB-FE57-8247-AC16D620E429359F%7D/viewSolicitationDocument=1/A%2040%20CMAC%20Amend%2034.pdf.
27. NASA Center for Climate Simulation (NCCS), 2015. http://www.nccs.nasa.gov.
28. Network Common Data Form (NetCDF), 2015. http://www.unidata.ucar.edu/software/netcdf/.
29. Open Archive Information System (OAIS) Reference Model, 2012. http://public.ccsds.org/publications/archive/650x0m2.pdf.
30. Open Geospatical Consortium (OGC), 2015. http://www.opengeospatial.org.
31. Reanalysis.org, 2015. http://reanalysis.org.
32. Reed, D.A., Dongarra, J., 2015. Exascale computing and big data. Communications of the ACM 58 (7), 56-68.
33. Rienecker, M.M., etal., 2011. MERRA: NASA's Modern-era retrospective analysis for research and applications. Journal of Climate 24 (14), 3624-3648. Available online at: http://dx.doi.org/10.1175/JCLI-D-11-00015.1.
34. Schnase, J.L., Webster, W.P., Parnell, L.A., Duffy, D.Q., 2011. The NASA Center for Climate Simulation Data Management System: toward an iRODS-based approach to scientific data services. In: IEEE Xplore Digital Library Proceedings of the 27th IEEE Symposium on Massive Storage Systems and Technologies (MSST 2011), (May 26-27, 2011, Denver, CO) 6 pp.
35. Schnase, J.L., Duffy, D.Q., Tamkin, G.S., Nadeau, D., Thompson, J.H., Grieg, C.M., McInerney, M.A., Webster, W.P., 2014a. MERRA analytic services: meeting the big data challenges of climate science through cloud-enabled climate analytics-as-a-service. Computers, Environment and Urban Systems. http://dx.doi.org/10.1016/j.compenvurbsys.2013.12.003.
36. Schnase, J.L., Duffy, D.Q., McInerney, M.A., Webster, W.P., Lee, T.J., 2014b. Climate analytics as a service. In: Proceedings of the 2014 Conference on Big Data from Space (BiDS '14), (European Space Agency (ESA)-ESRIN, November 12-14, 2014, Frascati, Italy), pp. 90-94. http://dx.doi.org/10.2788/1823.
37. Schnase, J.L., Carroll, M.L., Weber, K.T., Brown, M.E., Gill, R.L., Wooten, M., May, J., Serr, K., Smith, E., Goldsby, R., Newtoff, K., Bradford, K., Doyle, C., Volker, E., Weber, S., 2014c. RECOVER: an automated cloud-based decision support system for post-fire rehabilitation planning. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL-1, 363-370. http://dx.doi.org/10.5194/isprsarchives-XL-1-363-2014.
38. Schnase, J.L., et al., 2016. Big data challenges in climate science. IEEE Geoscience and Remote Sensing Magazine, (in press).
39. Skytland, N., 2012. Big Data: What Is NASA Doing with Big Data Today? Open.Gov open access article. http://open.nasa.gov/blog/2012/10/04/what-is-nasa-doing-with-big-data-today/.
40. Taylor, K.E., Balaji, V., Hankin, S., Juckes, M., Lawrence, B., Pascoe, S., 2012. CMIP5 Data Reference Syntax (DRS) and Controlled Vocabularies. 16 pp. http://cmip-pcmdi.llnl.gov/cmip5/docs/cmip5_data_reference:syntax.pdf.
41. Tony, H., Tansley, S., Tolle, K. (Eds.), 2009. The Fourth Paradigm: Data-Intensive Scientific Discovery. Microsoft Research, Redmond. 252 pp. Also available online at: http://research.microsoft.com/en-us/collaboration/fourthparadigm/4th_paradigm_book_complete_lr.pdf.
42. World Wide web Consortium (W3C), 2015. http://www.w3.org.
43. Wei, J., Dirmeyer, P.A., Wisser, D., Bosilovich, M.G., Mocko, D.M., 2013. Where does irrigation water go? An estimate of the contribution of irrigation to precipitation using MERRA. Journal of Hydrometeorology 14 (2), 271-289.
44. Zittrain, J., 2008. The Future of the Internet-And How to Stop it. Yale University Press, New Haven. 342 pp.