Improving MPI-IO output performance with active buffering plus threads

Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2003

Volumn , Issue , 2003, Pages

  Ma, Xiaosong ^a   Winslett, Marianne ^a   Lee, Jonghyun ^a   Yu, Shengke ^a  

^a University of Illinois at Urbana Champaign   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DISTRIBUTED PARAMETER NETWORKS;

DEDICATED SERVERS; INTERMEDIATE RESULTS; OUTPUT PERFORMANCE; PLATFORM INDEPENDENT; PROCESSING POWER; SCIENTIFIC SIMULATIONS; SECONDARY STORAGE; SYSTEM BANDWIDTH;

BANDWIDTH;

EID: 84947207861     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2003.1213165     Document Type: Conference Paper

References (14)

1. R. Bordawekar, J. Rosario, and A. Choudhary. Design and evaluation of primitives for parallel I/O. In Proceedings of Supercomputing '93, 1993.
2. Phillip Dickens and Rajeev Thakur. Improving collective I/O performance using threads. In Proceedings of the Joint International Parallel Processing Symposium and IEEE Symposium on Parallel and Distributed Processing, April 1999.
3. D. Kotz. Disk-directed I/O for MIMD multiprocessors. In Proceedings of the Symposium on Operating Systems Design and Implementation, November 1994.
4. J. Lee, X. Ma, M. Winslett, and S. Yu. Active buffering plus compressed migration: An integrated solution to parallel simulations' data transport needs. In Proceedings of the 16th ACM International Conference on Supercomputing, June 2002.
5. X. Ma, M. Winslett, J. Lee, and S. Yu. Faster collective output through active buffering. In Proceedings of the 2002 International Parallel and Distributed Processing Symposium, april 2002.
6. Message Passing Interface Forum. MPI-2: Extensions to the Message-Passing Standard, July 1997.
7. J. Moore and M. J. Quinn. Enhancing disk-directed I/O for fine-grained redistribution of file data. Parallel Computing, 23(4-5):447-499, June 1997.
8. Sachin More, Alok Choudhary, Ian Foster, and Ming Q. Xu. MTIO: A multi-threaded parallel I/O system. In Proceedings of the Eleventh International Parallel Processing Symposium, April 1997.
9. J. No, S. Park, J. Carretero, A. Choudhary, and P. Chen. Design and implementation of a parallel I/O runtime system for irregular applications. In Proceedings of the Joint International Parallel Processing Symposium and IEEE Symposium on Parallel and Distributed Processing, March 1998.
10. A. Purakayastha, C. S. Ellis, and D. Kotz. ENWRICH: A compute-processor write caching scheme for parallel file systems. In Proceedings of the Fourth Workshop on Input/Output in Parallel and Distributed Systems, May 1996.
11. K. E. Seamons, Y. Chen, P. Jones, J. Jozwiak, and M. Winslett. Server-directed collective I/O in Panda. In Proceedings of Supercomputing '95, November 1995.
12. F. Schmuck and R. Haskin. GPFS: A shared-disk file system for large computing clusters. In Proceedings of FAST '02, January 2002.
13. R. Thakur, W. Gropp, and E. Lusk. Data sieving and collective I/O in ROMIO. In Proc. of the 7th Symposium on the Frontiers of Massively Parallel Computation, February 1999.
14. R. Thakur, W. Gropp, and E. Lusk. On implementing MPI-IO portably and with high performance. In Proceedings of the Sixth Workshop on I/O in Parallel and Distributed Systems, May 1999.