Parallel high-resolution climate data analysis using swift

MTAGS'11 - Proceedings of the 2011 ACM International Workshop on Many Task Computing on Grids and Supercomputers, Co-located with SC'11

Volumn , Issue , 2011, Pages 5-14

  Woitaszek, Matthew ^a   Dennis, John M ^a   Sines, Taleena R ^b  

^a NATIONAL CENTER FOR ATMOSPHERIC RESEARCH   (United States)

^b FROSTBURG STATE UNIVERSITY   (United States)

Author keywords

climate modeling; data intensive computing; many task computing; workflow orchestration

Indexed keywords

ANALYSIS PROCESS; ATMOSPHERE MODELS; CLIMATE DATA; CLIMATE MODELING; COMPUTATIONAL SYSTEM; DATA-INTENSIVE COMPUTING; EARTH SYSTEM MODEL; FILE SYSTEMS; HIGH PERFORMANCE SYSTEMS; HIGH RESOLUTION; MANY-TASK COMPUTING; MODEL OUTPUTS; OUTPUT DATA; PARALLEL VERSION; POST PROCESS; SCRIPTING LANGUAGES; SINGLE-THREADED; SOFTWARE PARALLELISM; WORKFLOW ORCHESTRATION;

EARTH (PLANET); RANDOM ACCESS STORAGE; SUPERCOMPUTERS;

CLIMATE MODELS;

EID: 84857668965     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2132876.2132882     Document Type: Conference Paper

References (15)

1. AMWG Diagnostics Package, August 2004. http://www.cgd.ucar.edu/cms/ diagnostics/.
2. CISL's NCAR Command Language (NCL), December 2010. http://www.ncl.ucar. edu/.
3. Community Earth System Model (CESM) 1.0, November 2010. http://www.cesm.ucar.edu/models/cesm1.0/.
4. The Kepler Project, December 2010. http://kepler-project.org/.
5. NCO Homepage, November 2010. http://nco.sourceforge.net/.
6. D. Bernholdt, S. Bharathi, D. Brown, K. Chanchio, M. Chen, A. Chervenak, L. Cinquini, B. Drach, I. Foster, P. Fox, J. Garcia, C. Kesselman, R. Markel, D. Middleton, V. Nefedova, L. Pouchard, A. Shoshani, A. Sim, G. Strand, and D. Williams. The earth system grid: Supporting the next generation of climate modeling research. Proceedings of the IEEE, 93(3):485-495, 2005. (Pubitemid 40851204)
7. J. He, A. Jagatheesan, S. Gupta, J. Bennett, and A. Snavely. DASH: a recipe for a ash-based data intensive supercomputer. In Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC '10, New Orleans, LA, November 2010.
8. R. Jacob. Personal Conversation, November 2010. Argoone National Laboratory.
9. B. Ludäscher, I. Altintas, C. Berkley, D. Higgins, E. Jaeger, M. Jones, E. A. Lee, J. Tao, and Y. Zhao. Scientific workflow management and the Kepler system. Concurr. Comput. : Pract. Exper., 18:1039-1065, August 2006.
10. V. Nefedova, R. Jacob, I. Foster, Z. Liu, Y. Liu, E. Deelman, G. Mehta, M.-H. Su, and K. Vahi. Automating climate science: Large ensemble simulations on the TeraGrid with the GriPhyN Virtual Data System. In Second IEEE International Conference on e-Science and Grid Computing, page 32, Los Alamitos, CA, USA, 2006. IEEE Computer Society.
11. I. Raicu, I. Foster, and Y. Zhao. Many-task computing for grids and supercomputers. In Proceedings of the IEEE Workshop on Many-Task Computing on Grids and Supercomputers (MTAGS08), 2008.
12. M. Wilde, I. Foster, K. Iskra, P. Beckman, Z. Zhang, A. Espinosa, M. Hategan, B. Clifford, and I. Raicu. Parallel scripting for applications at the petascale and beyond. Computer, 42:50-60, 2009.
13. J. M. Wozniak. Swift-user mailing list: handling prestaged data on multiple sites, May 2010. http://mail.ci.uchicago.edu/pipermail/swiftuser/2010- May/001479.html.
14. J. M. Wozniak and M. Wilde. Case studies in storage access by loosely coupled petascale applications. In Proceedings of the 4th Annual Workshop on Petascale Data Storage, PDSW '09, pages 16-20, New York, NY, USA, 2009.
15. Y. Zhao, M. Hategan, B. Clifford, I. Foster, G. von Laszewski, V. Nefedova, I. Raicu, T. Stef-Praun, and M. Wilde. Swift: Fast, reliable, loosely coupled parallel computation. In IEEE Congress on Services, pages 199-206, 2007.