ParColl: Partitioned collective I/O on the cray XT

Proceedings of the International Conference on Parallel Processing

Volumn , Issue , 2008, Pages 562-569

  Yu, Weikuan ^a   Vetter, Jeffrey ^a  

^a OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COLLECTIVE I/O; GLOBAL PROCESSES; GLOBAL SYNCHRONIZATIONS; I/O BANDWIDTHS; LARGE SCALE PLATFORMS; NEW MECHANISMS; NOVEL TECHNIQUES; PARALLEL PROCESSES; SCIENTIFIC APPLICATIONS;

AGGLOMERATION; BENCHMARKING; KETONES;

DATA STORAGE EQUIPMENT;

EID: 55849104878     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2008.76     Document Type: Conference Paper

References (33)

1. FLASH I/O Benchmark Routine -- Parallel HDF 5,
2. IOR Benchmark, http://www.llnl.gov/asci/purple/benuhmarks/limited/ior.
3. The Parallel Virtual File System, Version 2, http://www.pvfs.oig/pvfs2.
4. TOP 500 Supercomputers, htp://www.top500.org/.
5. MPI-2: Extensions to the Message-Passing Interface, 1997.
6. Argonne National Laboratory, ROMIO: A High-Performance, Portable MPI-IO Implementation,
7. R. Brightwell, W. Camp, B. Cole, E. DeBenedictis, R. Leland, J. Tomkins, and A. B. MacCabe, Architectural specification for massively parallel computers: an experience and measurement-based approach: Research Articles, Concurr. Comput. : Pract. Exper., vol. 17, 2005.
8. R. Brightwell, K. T. Pedretti, K. D. Underwood, and T. Hudson, SeaStar Interconnect: Balanced Bandwidth for Scalable Performance, IEEE Micro, vol. 26, pp. 41-57, 2006.
9. Bull Direct, French Atomic Energy Authority (CEA) takes delivery of Tera-10, http://www.bull.coni/bulldirect/0601/hot.html
10. Cluster File System, Lustre: A Scalable, High Performance File System,
11. K. David, Disk-directed I/O for MIMD multiprocessors, ACM Trans. Comput. Syst., vol. 15, pp. 41-74, 1997.
12. DON, Products: S2A9550,
13. P. M. Dickens and R. Thakur, Improving Collective I/O Performance Using Threads, in Proceedings of the 13th International Symposium on Parallel Processing and the 10th Symposium on Parallel and Distributed Processing: IEEE Computer Society, 1999.
14. M. Fahey, J. Larkin, and J. Adams, I/O Performance on a Massively Parallel Cray XT3/XT4, in 22ndIEEE International Parallel & Distributed Processing Symposium (IPDPS'08), Miami, FL, 2008.
15. R. Juan Miguel del, B. Rajesh, and C. Alok, Improved parallel I/O via a two-phase run-time access strategy, SIGARCH Comput. Archit. News, vol. 21, pp. 31-38, 1993.
16. W.-k. Liao, K. Coloma, A. Choudhary, L. Ward, E. Russell, and S. Tideman, Collective caching: applicationaware client-side file caching, in High Performance Distributed Computing (HPDC-14), 2005.
17. National Center for Computational Sciences, http://nccs.gov/computing- resouces/jaguar/.
18. K. Pedretti, R. Brightwell, and J. Williams, Cplant" Runtime System Support for Multi-Processor and Heterogeneous Compute Nodes, in Proceedings of the IEEE International Conference on Cluster Computing: IEEE Computer Society, 2002.
19. R. B. Ross, Parallel I/O Benchmarking Consortium,
20. Sandia National Laboratories, Scalable IO,
21. F. Schmuck and R. Haskin, GPFS: A Shared-Disk File System for Large Computing Clusters, in FAST '02, 2002, pp. 231-244.
22. O. Tatebe, Y. Morita, S. Matsuoka, N. Soda, and S. Sekiguchi, Grid Datafarm Architecture for Petascale Data Intensive Computing, in Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid: IEEE Computer Society, 2002.
23. R. Thakur and A. Choudhary, An Extended Two-Phase Method for Accessing Sections of Out-of-Core Arrays, Scientific Programming, vol. 5, pp. 301-317, Winter 1996.
24. R. Thakur, W. Gropp, and E. Lusk, An Abstract-Device Interface for Implementing Portable Parallel-I/O Interfaces, in Proceedings of Frontiers '96: The Sixth Symposium on the Frontiers of Massively Parallel Computation, 1996.
25. R. Thakur, W. Gropp, and E. Lusk, Data Sieving and Collective I/O in ROMIO, in Proceedings of the Seventh Symposium on the Frontiers of Massively Parallel Computation, 1999, pp. 182-189.
26. R. Thakur, W. Gropp, and E. Lusk, Optimizing noncontiguous accesses in MPI- IO, Parallel Computing, vol. 28, pp. 83-105, 2002.
27. The National Center for SuperComputing, HDF5 Home Page,
28. G. M. Timothy, S. David, and R. W. Stephen, A TeraFLOP Supercomputer in 1996: The ASCI TFLOP System, in Proceedings of the 10th International Parallel Processing Symposium: IEEE Computer Society, 1996.
29. J. S. Vetter, S. R. Alam, T. H. Dunigan, Jr.., M. R. Fahey, P. C. Roth, and P. H. Worley, Early Evaluation of the Cray XT3, in IEEE International Parallel & Distributed Processing Symposium (IPDPS), Greece, 2006.
30. P. Wong and R. F. Van der Wijngaart, NAS Parallel Benchmarks I/O Version 2.4, NASA Advanced Supercomputing (NAS) Division NAS-03-002, 2002.
31. H. Yu, R. K. Sahoo, C. Howson, et al., High performance file I/O for the Blue Gene/L supercomputer, in High-Performance Computer Architecture (HPCA-12), Austin, Texas, 2006.
32. W. Yu, J. S. Vetter, and R. S. Canon, OPAL: An Open-Source MPI-IO Library over Cray XT, in International Workshop on Storage Network Architecture and Parallel I/O (SNAPI'07), San Diego, CA, 2007.
33. W. Yu, J. S. Vetter, and H. S. Oral, Performance Characterization and Optimization of Parallel I/O on the Cray XT, in 22nd IEEE International Parallel and Distributed Processing Symposium (IPDPS'08), Miami, FL, 2008.