Big data challenges in climate science: Improving the next-generation cyberinfrastructure

IEEE Geoscience and Remote Sensing Magazine

Volumn 4, Issue 3, 2016, Pages 10-22

  Schnase, John L ^a   Lee, Tsengdar J ^b   Mattmann, Chris A ^c   Lynnes, Christopher S ^a   Cinquini, Luca ^d   Ramirez, Paul M ^c   Hart, Andrew F ^c   Williams, Dean N ^e   Waliser, Duane ^c   Rinsland, Pamela ^e   Webster, W Phillip ^a   Duffy, Daniel Q ^a   McInerney, Mark A ^a   Tamkin, Glenn S ^a   Potter, Gerald L ^a   Carriere, Laura ^a  

^a NASA GODDARD SPACE FLIGHT CENTER   (United States)

^b NASA HEADQUARTERS   (United States)

^c CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^d CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^e Program for Climate Model Diagnosis and Intercomparison   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BIG DATA; CLIMATE CHANGE; EARTH (PLANET); EARTH SYSTEM MODELS; INTEROPERABILITY; QUALITY CONTROL;

CLIMATE RESEARCH; CLIMATE SCIENCE; CYBERINFRASTRUCTURE; DATA CHALLENGES; GLOBAL REACH; HIGH QUALITY DATA; LARGE AMOUNTS; MODEL INTER COMPARISONS; REANALYSIS; SOCIAL PRACTICES;

CLIMATE MODELS;

CLIMATE CHANGE; CLIMATE MODELING; COMPUTER; DATA ASSIMILATION; GLOBAL CLIMATE; INTERGOVERNMENTAL PANEL ON CLIMATE CHANGE; RESEARCH WORK;

EID: 84988938526     PISSN: 24732397     EISSN: 21686831     Source Type: Journal    
DOI: 10.1109/MGRS.2015.2514192     Document Type: Article

References (33)

1. C. Snijders, U. Matzat, and U. D. Reips, "Big data: Big gaps of knowledge in the field of Internet science," Int. J. Internet Sci., vol. 7, no. 1, pp. 1-5, 2012.
2. P. N. Edwards, A Vast Machine: Computer Models, Climate Data, and the Politics of Global Warming. Cambridge, MA: MIT Press, 2010.
3. J. L. Schnase, D. Q. Duffy, G. S. Tamkin, D. Nadeau, J. H. Thompson, C. M. Grieg, M. A. McInerney, and W. P. Webster, "MERRA analytic services: Meeting the big data challenges of climate science through cloud-enabled climate analytics-as-a-service," Computers Environ. Urban Syst., to be published, DOI: 10.1016/j. compenvurbsys.2013.12.003.
4. S. L. Star, "The politics of formal representations: Wizards, gurus and organizational complexity," in Ecologies of Knowledge: Work and Politics in Science and Technology, S. L. Star, Ed., Albany, NY: SUNY Press, 1995, pp. 88-118.
5. J. L. Schnase, M. A. Lane, B. C. Bowker, S. L. Star, and A. Silberschatz. (1997). Building the next generation biological information infrastructure. Proc. 1997 National Academy of Sciences Forum Biodiversity: The Quest for a Sustainable World. pp. 291-300. Online. Available: http://www.nap.edu/read/6142/chapter/6#291
6. C. A. Mattmann, C. S. Lynnes, L. Cinquini, P. M. Ramirez, A. F. Hart, D. Williams, D. Waliser, and P. Rinsland, "Next generation cyberinfrastructure to support comparison of satellite observations with climate models," in Proc. 2014 Conf. Big Data from Space (BiDS 14), Frascati, Italy, 2014, pp. 82-85, DOI: 10.2788/1823
7. G. L. Potter, T. J. Lee, and L. Carriere, "Improving access to climate model, observational, and reanalysis data," in Proc. 2014 Conf. Big Data from Space (BiDS 14), Frascati, Italy, 2014, pp. 86-89, DOI: 10.2788/1823
8. J. L. Schnase, D. Q. Duffy, M. A. McInerney, W. P. Webster, and T. J. Lee, "Climate analytics as a service," in Proc. 2014 Conf. Big Data from Space (BiDS 14), Frascati, Italy, 2014, pp. 90-94, DOI: 10.2788/1823
9. J. T. Overpeck, G. A. Meehl, S. Bony, and D. R. Easterling, "Climate data challenges in the 21st century," Science, vol. 331, pp. 700-702, Feb. 2011, DOI: 10.1126/science.1197869
10. Intergovernmental Panel on Climate Change (IPCC). Online. Available: http://www.ipcc.ch/organization/organization.shtml
11. Climate Model Intercomparison Project (CMIP). Online. Available: http://cmip-pcmdi.llnl.gov
12. K. E. Taylor, R. J. Stouffer, and G. A. Meehl, "An overview of CMIP5 and the experimental design," Bull. Amer. Meteor. Soc, vol. 93, no. 4, pp. 485-498, 2012, DOI: 10.1175/BAMS-D-11-00094.1
13. Earth System Grid Federation (ESGF). Online. Available: http://esgf.llnl.gov
14. L. Cinquini, D. Crichton, C. Mattmann, J. Harney, G. Shipman, F. Wang, R. Ananthakrishnan, N. Miller, S. Denvil, M. Morgan, Z. Pobre, G. M. Bell, C. Doutriaux, R. Drach, D. Williams, P. Kershaw, S. Pascoe, and E. Gonzalez, "The Earth System Grid Federation: An open infrastructure for access to distributed geospatial data," Futur. Gener. Comput. Syst, vol. 36, pp. 400-417, July 2014, DOI: 10.1016/j.future.2013.07.002
15. P. Gleckler, R. Ferraro, and D. Waliser, "Improving use of satellite data in evaluating climate models," EOS Trans. Am. Geophys. Union, vol. 92, no. 20, pp. 172, 2011, DOI: 10.1029/2011EO200005
16. M. G. Bosilovich, A. H. Chaudhuri, and M. Rixen, "Earth system reanalysis: Progress, challenges, and opportunities," Bull. Am. Meteorol. Soc, vol. 94, no. 8, pp. 110-113, 2013, DOI: 10.1175/BAMS-D-12-00191.1
17. K. H. Rosenlof, L. Terray, C. Deser, A. Clement, H. Goosee, and S. Davis, "Changes in variability associated with climate change," in Climate Science for Serving Society, G. R. Asrar and J. W. Hurrell, Eds., New York: Springer, 2013, pp. 249-271, DOI: 10.1007/978-94-007-6692-1
18. C. Mattmann, A. Braverman, and D. Crichton, "Understanding architectural tradeoffs necessary to increase climate model intercomparison efficiency," ACM SIGSOFT Soft. Eng. Notes, vol. 35, no. 3, pp. 1-6, 2010.
19. C. Mattmann, D. Crichton, N. Medvidovic, and S. Hughes, "A software architecture-based framework for highly distributed and data intensive scientific applications," in Proc. Int. Conf. Software Engineering (ICSE), Shanghai, China, 2006, pp. 721-730.
20. Analytics and Informatics Management Systems (AIMS). Online. Available: http://aims.llnl.gov/mission.html
21. C. Page, S. Joussaume, M. Juckes, W. S. de Cerff, M. Pleiger, E. de Vreede, L. Barring, M. Kolax, R. Hutjes, F. de Jong, E. Bucchignani, N. Tatarinova, and A. Cofino. (2014). Providing and facilitating climate model data access in Europe: IS-ENES and CLIPC initiatives. Proc. 14th European. Meteorol. Soc. (EMS) Annual Meeting and 10th European Conf. on Applied Climatology (ECAC). Online. Available: http://meetingorganizer. copernicus.org/EMS2014/EMS2014-265-1.pdf
22. S. Fiore, A. DAnca, C. Palazzo, I. Foster, D. N. Williams, and G. Aloisio, "Ophidia: Toward big data analytics for eScience," Procedia Computer Sci., vol. 18, pp. 2376-2285, June 2013, DOI: 10.1016/j. procs.2013.05.409
23. J. L. Schnase. (2014). Climate analytics as a service. Proc. European Centre for Medium-Range Weather Forecasts (ECMWF) Copernicus Climate Change Service (C3S) Data Store Workshop. Online. Available: http://www.ecmwf.int/sites/default/files/COP-CDS-WS-Schnase.pdf
24. J. L. Schnase, "Climate analytics as a service," in Cloud Computing in the Ocean and Atmospheric Sciences, T. C. Vance, N. Merati, C. Yang, M. Yuan, Eds., New York: Elsevier, 2016.
25. Open Archive Information System (OAIS) Reference Model. Online. Available: http://public.ccsds.org/sites/cwe/rids/Lists/CCSDS%206500P11/Attachments/650x0p11.pdf
26. M. M. Rienecker, M. J. Suarez, R. Gelaro, R. Todling, J. Bacmeister, E. Liu, M. G. Bosilovich, S. D. Schubert, L. Takacs, G. -K. Kim, S. Bloom, J. Chen, D. Collins, A. Conaty, A. da Silva, W. Gu, J. Joiner, R. D. Koster, R. Lucchesi, A. Molod, R. Owens, S. Pawson, P. Pegion, C. R. Redder, R. Reichle, F. R. Robertson, A. G. Ruddick, M. Sienkiewicz, and J. Woollen, "MERRA: NASAs modern-era retrospective analysis for research and applications," J. Climate, vol. 24, no. 14, pp. 3624-3648, 2011, DOI: 10.1175/JCLI-D-11-00015.1
27. NASA Climate Model Data Services. Online. Available: https://cds.nccs.nasa.gov/wp-content/test/
28. J. L. Schnase, M. L. Carroll, K. T. Weber, M. E. Brown, R. L. Gill, M. Wooten, J. May, K. Serr, E. Smith, R. Goldsby, K. Newtoff, K. Bradford, C. Doyle, E. Volker, and S. Weber, "RECOVER: An automated cloud-based decision support system for post-fire rehabilitation planning," in Proc. Int. Soc. Photogrammetry and Remote Sensing, C. Toth, T. Holm, and B. Jutzi, Eds., Denver, CO, 2014, pp. 17-20, DOI: 10.5194/isprsarchives-XL-1-363-2014
29. iPlant Collaborative. Online. Available: http://www.iplantcollaborative.org
30. D. Duffy, private communication, Dec. 2015.
31. Open Geospatical Consortium (OGC). Online. Available: http://www.opengeospatial.org
32. World Wide Web Consortium (W3C). Online. Available: http:// www.w3.org
33. Web Processing Service (WPS). Online. Available: http://www. opengeospatial.org/standards/wps