I/O analysis and optimization for an AMR cosmology application

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn 2002-January, Issue , 2002, Pages 119-126

  Li, Jianwei ^a   Liao, Wei Keng ^a   Choudhary, A ^a   Taylor, V ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Adaptive mesh refinement; Computational modeling; Concurrent computing; Costs; Degradation; File systems; Libraries; Linux; Parallel processing; Production

Indexed keywords

CLUSTER COMPUTING; COMPUTER ARCHITECTURE; COMPUTER OPERATING SYSTEMS; COSTS; DEGRADATION; DOMAIN DECOMPOSITION METHODS; FILE ORGANIZATION; LIBRARIES; LINUX; MESH GENERATION; NUMERICAL ANALYSIS; PRODUCTION;

ADAPTIVE MESH REFINEMENT; COMPUTATIONAL MODEL; CONCURRENT COMPUTING; FILE SYSTEMS; PARALLEL PROCESSING;

PARALLEL PROCESSING SYSTEMS;

EID: 84906503371     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2002.1137736     Document Type: Conference Paper

References (21)

1. M. Berger and P. Colella, "Local Adaptive Mesh Refinement for Shock Hydodynamics", Journal of Computational Physics, Vol. 82, No. 1, pp. 64-84, May 1989
2. G. Bryan. "Fluid in the universe: Adaptive mesh refinement in cosmology". In Computing in Science and Engineering, 1(2):46-53, March/April, 1999.
3. A. Choudhary, R. Bordawekar, M. Harry, R. Krishnaiyer, R. Ponnusamy, T. Singh, and R. Thakur. "PASSION: Parallel And Scalable Software for Input-Output", Technical Report SCCS-636, NPAC, Syracuse University, September 1994
4. W. Gropp, E. Lusk, and R. Thakur. Using MPI-2: Advanced Features of the Message Passing Interface, MIT Press, Cambridge, MA, 1999
5. Z. Lan, V. Taylor, and G. Bryan. "Dynamic Load Balancing For Structured Adaptive Mesh Refinement Applications", in Proceeding of ICPP'2001, Valencia, Spain, 2001.
6. Z. Lan, V. Taylor, and G. Bryan, "Dynamic Load Balancing of SAMR applications on Distributed Systems", in Proceeding of SC'2001 (formerly known as Supercomputing), Denver, CO, November, 2001.
7. W. Liao, X. Shen, and A. Choudhary. "Meta-Data Management System for High-Performance Large-Scale Scientific Data Access", in the 7th International Conference on High Performance Computing, Bangalore, India, December 17-20, 2000
8. M.L. Norman, J. Shalf, S. Levy, and G. Daues. "Diving deep: Data management and visualization strategies for adaptive mesh refinement simulations", Computing in Science and Engineering, 1(4):36-47, July/August 1999
9. J.M. Rosario, R. Bordawekar, and A. Choudhary. "Improved Parallel I/O via a Two-phase Run-time Access Strategy", IPPS '93 Parallel I/O Workshop, February 9, 1993
10. H. Taki and G. Utard. "MPI-IO on a parallel file system for cluster of workstations", in Proceeding of the First IEEE International Workshop on Cluster Computing, 1999
11. R. Thakur, R. Bordawekar, A. Choudhary, R. Ponnusamy, and T. Singh. "PASSION Runtime Library for Parallel I/O", Scalable Parallel Libraries Conference, Oct. 1994
12. R. Thakur and A. Choudhary. "An Extended Two-Phase Method for Accessing Sections of Out-of-Core Arrays", Scientific Programming, 5(4):301-317, Winter 1996
13. R. Thakur, W. Gropp, and E. Lusk. "An Abstract-Device interface for Implementing Portable Parallel-I/O Interfaces"(ADIO), in Proceeding of the 6th Symposium on the Frontiers of Massively Parallel Computation, October 1996, pp. 180-187
14. R. Thakur, W. Gropp, and E. Lusk. "Data Sieving and Collective I/O in ROMIO", in Proceeding of the 7th Symposium on the Frontiers of Massively Parallel Computation, February 1999, pp. 182-189
15. Rajeev Thakur, Ewing Lusk, and William Gropp, "Users Guide for ROMIO: A High-Performance, Portable MPI-IO Implementation", Technical Memorandum ANL/MCS-TM-234, Mathematics and Computer Science Division, Argonne National Laboratory, Revised July 1998.
16. Chiba City, the Argonne National Laboratory scalable cluster. http://www.mcs.anl.gov/chiba.
17. HDF4 Home Page. The National Center for Supercomputing Applications. http://hdf.ncsa.uiuc.edu/hdf4.html.
18. HDF5 Home Page. The National Center for Supercomputing Applications. http://hdf.ncsa.uiuc.edu/HDF5/.
19. Message Passing Interface Forum. "MPI-2: Extensions to the message-passing interface", July 1997. http://www.mpiforum.org/docs/docs.html
20. Pablo Research Group. "Analysis of I/O Activity of the ENZO Code", University of Illinois at Urbana-Champaign, July 2000. http://www-pablo.cs.uiuc.edu/Data/enzo/enzoData.htm
21. The Parallel Virtual File System Project. http://parlweb.parl.clemson.edu/pvfs/