Storing and manipulating environmental big data with JASMIN

Proceedings - 2013 IEEE International Conference on Big Data, Big Data 2013

Volumn , Issue , 2013, Pages 68-75

  Lawrence, B N ^a,b,d   Bennett, V L ^c,d   Churchill, J ^e   Juckes, M ^b,d   Kershaw, P ^c,d   Pascoe, S ^b,d   Pepler, S ^b,c,d   Pritchard, M ^b,c,d   Stephens, A ^b,d  

^a UNIVERSITY OF READING   (United Kingdom)

^b University of Birmingham   (United Kingdom)

^c National Centre for Earth Observation   (United Kingdom)

^d Centre for Environmental Data Archival (CEDA)   (United Kingdom)

^e RUTHERFORD APPLETON LABORATORY   (United Kingdom)

Author keywords

Big Data; Climate; Cloud Computing; Curation; Earth Observation

Indexed keywords

BIG DATA; CLOUD COMPUTING; DIGITAL STORAGE; EARTH (PLANET); INFORMATION ANALYSIS; OBSERVATORIES;

ATMOSPHERIC SCIENCE; CLIMATE; CURATION; EARTH OBSERVATIONS; ENVIRONMENTAL DATA; ENVIRONMENTAL SCIENCE; EXPLOSIVE GROWTH; SCIENTIFIC WORKFLOWS;

DATA CURATION;

EID: 84893285704     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BigData.2013.6691556     Document Type: Conference Paper

References (12)

1. B. N. Lawrence, V. Bennett, J. Churchill, M. Juckes, P. Kershaw, P. Oliver, M. Pritchard, and A. Stephens, "The JASMIN super-datacluster," ArXiv e-prints, Apr. 2012.
2. K. E. Taylor, R. J. Stouffer, and G. A. Meehl, "An overview of CMIP5 and the experiment design," Bulletin of the American Meteorological Society, vol. 93, pp. 485-498, Oct. 2011. [Online]. Available: http://journals.ametsoc.org/doi/abs/10.1175/BAMS-D-11-00094.1
3. D. N. Williams, B. N. Lawrence, M. Lautenschlager, D. Middleton, and V. Balaji, "The earth system grid federation: Delivering globally accessible petascale data for CMIP5," in Proceedings of the 32nd Asia-Pacific Advanced Network Meeting, New Delhi, Dec. 2011, pp. 121-130. [Online]. Available: http://usymposia.upm.my/index.php/ APAN Proceedings/32nd APAN/paper/view/155
4. M. S. Mizielinski, M. J. Roberts, P. L. Vidale, R. Schiemann, M. E. Demory, J. Strachan, T. Edwards, A. Stephens, M. Pritchard, P. Chiu, A. Iwi, J. Churchill, C. D. C. Novales, J. Kettleborough, W. Roseblade, P. Selwood, M. Foster, M. Glover, and A. Malcolm, "High resolution climate modelling; the UPSCALE project, a large simulation campaign," Geoscientific Model Development, vol. In preparation, 2013.
5. J.-P. Muller, P. Lewis, J. Fischer, P. North, and U. Framer, "The ESA GlobAlbedo project for mapping the earths land surface albedo for 15 years from european sensors," in Geophysical Research Abstracts, vol. 13, Vienna, 2011, p. 10969. [Online]. Available: http://www.globalbedo.org/docs/Muller- GlobAlbedo-abstractV4.pdf
6. D. Ghent and J. Remedios, "Developing first time-series of land surface temperature from AATSR with uncertainty estimates," in Geophysical Research Abstracts, vol. 15, 2013, p. 5016. [Online]. Available: http://adsabs.harvard.edu/abs/2013EGUGA.15.5016G
7. C. A. Poulsen, R. Siddans, G. E. Thomas, A. M. Sayer, R. G. Grainger, E. Campmany, S. M. Dean, C. Arnold, and P. D. Watts, "Cloud retrievals from satellite data using optimal estimation: evaluation and application to ATSR," Atmospheric Measurement Techniques, vol. 5, no. 8, pp. 1889-1910, Aug. 2012. [Online]. Available: http://www.atmos-meas-tech.net/5/1889/2012
8. J. Cohen, B. Dolan, M. Dunlap, J. M. Hellerstein, and C. Welton, "MAD skills: new analysis practices for big data," Proceedings of the VLDB Endowment, vol. 2, no. 2, pp. 1481-1492, 2009. [Online]. Available: http://dl.acm.org/citation.cfm?id=1687576
9. K. Shvachko, H. Kuang, S. Radia, and R. Chansler, "The hadoop distributed file system," in Mass Storage Systems and Technologies (MSST), 2010 IEEE 26th Symposium on, 2010, pp. 1-10. [Online]. Available: http://ieeexplore.ieee.org/xpls/abs all.jsp? arnumber=5496972
10. H. Herodotou, H. Lim, G. Luo, N. Borisov, L. Dong, F. B. Cetin, and S. Babu, "Starfish: A self-tuning system for big data analytics," in Proc. of the Fifth CIDR Conf, 2011. [Online]. Available: http://x86.cs.duke.edu/ ?gang/documents/CIDR11 Paper36.pdf
11. J. Buck, N. Watkins, J. Lefevre, K. Ioannidou, C. Maltzahn, N. Polyzotis, and S. Brandt, "Scihadoop: Array-based query processing in hadoop," Technical Report UCSC-SOE-11-04, UCSC, Tech. Rep., 2011.
12. G. Sakellari and G. Loukas, "A survey of mathematical models, simulation approaches and testbeds used for research in cloud computing," Simulation Modelling Practice and Theory. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S1569190X13000658