Cooperative write-behind data buffering for MPI I/O

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3666 LNCS, Issue , 2005, Pages 102-109

  Liao, Wei Keng ^a   Coloma, Kenin ^a   Choudhary, Alok ^a   Ward, Lee ^b  

^a NORTHWESTERN UNIVERSITY   (United States)

^b SANDIA NATIONAL LABORATORIES   (United States)

Author keywords

Data buffering; File consistency; I O thread; MPI I O; Write behind

Indexed keywords

DATA BUFFERING; FILE CONSISTENCY; I/O THREAD; MPI I/O;

BENCHMARKING; CONTROL SYSTEMS; DATA ACQUISITION; DISTRIBUTED COMPUTER SYSTEMS; LARGE SCALE SYSTEMS; PROBLEM SOLVING;

BUFFER STORAGE;

EID: 33646136245     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11557265_17     Document Type: Conference Paper

References (16)

1. Callaghan, B.: NFS Illustrated. Addison-Wesley (2000)
2. Ma, X., Winslett, M., Lee, J., Yu, S.: Improving MPI-IO Output Performance with Active Buffering Plus Threads. In: the International Parallel and Distributed Processing Symposium (IPDPS). (2003)
3. Thakur, R., Gropp, W., Lusk, E.: Users Guide for ROMIO: A High-performance, Portable MPI-IO Implementation. Technical Report ANL/MCS-TM-234, Mathematics and Computer Science Division, Argonne National Laboratory. (1997)
4. Message Passing Interface Forum: MPI-2: Extensions to the Message Passing Interface. (1997) http://www.mpi-forum.org/docs/docs.html.
5. Purakayaslha, A., Ellis, C.S., Kolz, D.: ENWRICH: A Compute-Processor Write Caching Scheme for Parallel File Systems. In: the Fourth Workshop on Input/Output in Parallel and Distributed Systems (IOPADS). (1996)
6. Prosl, J., Treumann, R., Hedges, R., Jia, B., Koniges, A.: MPI-IO/GPFS, an Optimised Implementation of MPI-IO on top of GPFS. In: Supercomputing. (2001)
7. Schmuck, F., Haskin, R.: GPFS: A Shared-Disk File System for Large Computing Clusters. In: the Conference on File and Storage Technologies (FAST'02). (2002) 231-244
8. Bernstein, P., Haclzilacos, V., Goodman, N.: Concurrency Control and Recovery in Database Systems. Addison-Wesley (1987)
9. IEEE/ANSI Std. 1003.1: Portable Operating System Interface (POSIX)-Part 1: System Application Program Interface (API) [C Language]. (1996)
10. Thakur, R., Gropp, W., Lusk, E.: On Implementing MPI-IO Portably and wilh High Performance. In: the Sixth Workshop on I/O in Parallel and Distributed Systems. (1999) 23-32
11. Thakur, R., Gropp, W., Lusk, E.: An Abstract-Device Interface for Implementing Portable Parallel-I/O Interfaces. In: the 6th Symposium on the Frontiers of Massively Parallel Compulation. (1996)
12. Thakur, R., Gropp, W., Lusk, E.: Data Sieving and Collective I/O in ROMIO. In: the 7th Symposium on the Frontiers of Massively Parallel Computation. (1999)
13. Wong, P., der Wijngaart, R.: NAS Parallel Benchmarks I/O Version 2.4. Technical Report NAS-03-002, NASA Ames Research Center, Moffet Field, CA (2003)
14. Fineberg, S., Wong, P., Nitzberg, B., Kuszmaul, C.: PMPIO - A Portable Implementation of MPI-IO. In: the 6th Symposium on the Frontiers of Massively Parallel Computation. (1996)
15. Fryxell, B., Olson, K., Ricker, P., Timmes, F.X., Zingale, M., Lamb, D.Q., MacNeice, P., Rosner, R., Tufo, H.: FLASH: An Adaptive Mesh Hydrodynamics Code for Modelling Astrophysical Thermonuclear Flashes. Asirophysical Journal Suppliment (2000) 131-273
16. Zingale, M.: FLASH I/O Benchmark Routine - Parallel HDF 5 (2001) http://flash.uchicago.edu/~zingale/flash_benchmark_io.