A new flexible MPI collective I/O implementation

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn , Issue , 2006, Pages

  Coloma, Kenin ^a   Ching, Avery ^a   Choudhary, Alok ^a   Liao, Wei Keng ^a   Ross, Rob ^b   Thakur, Rajeev ^b   Ward, Lee ^c  

^a NORTHWESTERN UNIVERSITY   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

^c SANDIA NATIONAL LABORATORIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTER COMPUTING; COLLECTIVE I/O; COMMUNICATION INFRASTRUCTURES; FILE SYSTEMS; INTERNATIONAL CONFERENCES; USER INTERVENTION;

DATA DESCRIPTION; OPTIMIZATION; STANDARDS;

CHLORINE COMPOUNDS;

EID: 46049103977     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2006.311865     Document Type: Conference Paper

References (16)

1. A. Ching, A. Choudhary, K. Coloma, W. K. Liao, R. Ross, and W. Gropp. Noncontiguous access through MPI-IO. In Proceedings of the IEEE/ACM International Symposium on Cluster Computing and the Grid, May 2003.
2. A. Ching, A. Choudhary, W. K. Liao, R. Ross, and W. Gropp. Noncontiguous I/O through PVFS. In Proceedings of the IEEE International Conference on Cluster Computing, September 2002.
3. A. Ching, A. Choudhary, W. K. Liao, R. Ross, and W. Gropp. Efficient structured data access in parallel file systems. In Proceedings of the IEEE International Conference on Cluster Computing, December 2003.
4. A. Ching, A. Choudhary, W. K. Liao, L. Ward, and N. Pundit. Evaluating I/O characteristics and methods for storing structured scientific data. In Proceedings of the International Parallel & Distributed Processing Symposium, April 2006.
5. K. Coloma, A. Choudhary, W. K. Liao, L. Ward, E. Russell, and N. Pundit. Scalable high-level caching for parallel I/O. In Proceedings of the IEEE International Parallel & Distributed Processing Symposium, April 2004.
6. J. M. del Rosario, R. Bordawekar, and A. Choudhary. Improved parallel I/O via a two-phase run-time access strategy. In Proceedings of the IPPS '93 Workshop on Input/Output in Parallel Computer Systems, pages 56-70, Newport Beach, CA, 1993. Also published in Computer Architecture News 21(5), December 1993, pages 31-38.
7. W. Gropp, E. Lusk, and R. Thakur. Using MPI-2: Advanced Features of the Message-Passing Interface. MIT Press, Cambridge, MA, 1999.
8. F. Isaila, G. Malpohl, V. Olaru, G. Szeder, and W. Tichy. Integrating collective I/O and cooperative caching into the "clusterfile" parallel file system. In Proceedings of the 18th Annual International Conference on Supercomputing, pages 58-67, Sain-Malo, France, July 2004. ACM Press.
9. D. Kotz. Disk-directed I/O for MIMD multiprocessors. In Proceedings of the 1994 Symposium on Operating Systems Design and Implementation, pages 61-74. USENIX Association, November 1994. Updated as Dartmouth TR PCS-TR94-226 on November 8, 1994.
10. D. Kotz and N. Nieuwejaar. Dynamic file-access characteristics of a production parallel scientific workload. In Proceedings of Supercomputing '94, pages 640-649, Washington, DC, November 1994. IEEE Computer Society Press.
11. J.-P. Prost, R. Treumann, R. Hedges, B. Jia, and A. Koniges. MPI-IO/GPFS, an Optimized Implementation of MPI-IO on top of GPFS. In Proceedings of Supercomputing, November 2001.
12. R. Rew and G. Davis. The Unidata netCDF: Software for scientific data access. In Proceedings of the 6th International Conference on Interactive Information and Processing Systems for Meterology, Oceanography and Hydrology, February 1990.
13. ROMIO: A high-performance, portable MPI-IO implementation, http://www.mcs.anl.gov/romio.
14. R. Thakur, W. Gropp, and E. Lusk. Data sieving and collective I/O in ROMIO. In Proceedings of the Seventh Symposium on the Frontiers of Massively Parallel Computation, pages 182-189. IEEE Computer Society Press, February 1999.
15. R. Thakur, W. Gropp, and E. Lusk. On implementing MPI-IO portably and with high performance. In Proceedings of the Sixth Workshop on Input/Output in Parallel and Distributed Systems, pages 23-32, May 1999.
16. J. Worringen, J. L. Traff, and H. Ritzdorf. Improving generic non-contiguous file access for MPI-IO. In Proceedings of the 10th EuroPVM/MPI Conference, September 2003.