A case for using MPI's derived datatypes to improve I/O performance

Proceedings of the International Conference on Supercomputing

Volumn 1998-November, Issue , 1998, Pages

  Thakur, Rajeev ^a   Gropp, William ^a   Lusk, Ewing ^a  

^a ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

MPI IO; Parallel I O

Indexed keywords

COLLECTIVE I/O; DERIVED DATATYPES; FILE VIEW; FUNCTION CALLS; KEY FEATURE; MPI-IO; OPTIMISATIONS; PARALLEL I/O; PARALLEL MACHINE; PERFORMANCE;

EID: 0742309931     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.1998.10006     Document Type: Conference Paper

References (16)

1. S. Baylor and C. Wu. Parallel I/O Workload Characteristics Using Vesta. In R. Jain, J. Werth, and J. Browne, editors, Input/Output in Parallel and Distributed Computer Systems, chapter 7, pages 167-185. Kluwer Academic Publishers, 1996.
2. P. Crandall, R. Aydt, A. Chien, and D. Reed. Input-Output Characteristics of Scalable Parallel Applications. In Proceedings of Supercomputing '95. ACM Press, December 1995.
3. J. del Rosario, R. Bordawekar, and A. Choudhary. Improved Parallel I/O via a Two-Phase Run-time Access Strategy. In Proceedings of the Workshop on I/O in Parallel Computer Systems at IPPS '93, pages 56-70, April 1993.
4. Also published in Computer Architecture News, 21(5):31-38, December 1993.
5. W. Gropp, E. Lusk, N. Doss, and A. Skjellum. A High-Performance, Portable Implementation of the MPI Message-Passing Interface Standard. Parallel Computing, 22 (6):789-828, September 1996.
6. D. Kotz. Disk-directed I/O for MIMD Multiprocessors. ACM Transactions on Computer Systems, 15(1):41-74, February 1997.
7. Message Passing Interface Forum. MPI: A Message-Passing Interface Standard. Version 1.1, June 1995. On the World-Wide Web at http://www.mpi-forum.org/docs/docs.html.
8. Message Passing Interface Forum. MPI-2: Extensions to the Message-Passing Interface. July 1997. On the World-Wide Web at http://www.mpi-forum.org/docs/docs.html.
9. N. Nieuwejaar, D. Kotz, A. Purakayastha, C. Ellis, and M. Best. File-Access Characteristics of Parallel Scientific Workloads. IEEE Transactions on Parallel and Distributed Systems, 7 (10):1075-1089, October 1996.
10. K. Seamons, Y. Chen, P. Jones, J. Jozwiak, and M. Winslett. Server-Directed Collective I/O in Panda. In Proceedings of Supercomputing '95. ACM Press, December 1995.
11. E. Smirni, R. Aydt, A. Chien, and D. Reed. I/O Requirements of Scientific Applications: An Evolutionary View. In Proceedings of the Fifth IEEE International Symposium on High Performance Distributed Computing, pages 49-59. IEEE Computer Society Press, 1996.
12. R. Thakur and A. Choudhary. An Extended Two-Phase Method for Accessing Sections of Out-of-Core Arrays. Scientific Programming, 5(4):301-317, Winter 1996.
13. R. Thakur, A. Choudhary, R. Bordawekar, S. More, and S. Kuditipudi. Passion: Optimized I/O for Parallel Applications. Computer, 29(6):70-78, June 1996.
14. R. Thakur, W. Gropp, and E. Lusk. An Abstract-Device Interface for Implementing Portable Parallel-I/O Interfaces. In Proceedings of the 6th Symposium on the Frontiers of Massively Parallel Computation, pages 180-187, October 1996.
15. R. Thakur, W. Gropp, and E. Lusk. An Experimental Evaluation of the Parallel I/O Systems of the IBM SP and Intel Paragon Using a Production Application. In Proceedings of the 3rd International Conference of the Austrian Center for Parallel Computation (ACPC) with Special Emphasis on Parallel Databases and Parallel I/O, pages 24-35. Lecture Notes in Computer Science 1127. Springer-Verlag., September 1996.
16. R. Thakur, E. Lusk, and W. Gropp. Users Guide for ROMIO: A High-Performance, Portable MPI-IO Implementation. Technical Report ANL/MCS-TM-234, Mathematics and Computer Science Division, Argonne National Laboratory, Revised July 1998.