Investigation of leading HPC I/O performance using a scientific-application derived benchmark

Proceedings of the 2007 ACM/IEEE Conference on Supercomputing, SC'07

Volumn , Issue , 2007, Pages

  Borrill, Julian ^a   Oliker, Leonid ^a   Shalf, John ^a   Shan, Hongzhang ^a  

^a LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL SCIENTISTS; COMPUTATIONAL SETTINGS; COMPUTING POWERS; COSMIC MICROWAVE BACKGROUNDS; CRAY XT3; DATA ANALYSIS; EXPONENTIAL GROWTHS; FILE ACCESSES; HPC RESOURCES; I/O PERFORMANCES; KEY PARAMETERS; OPTERON; SCIENTIFIC COMMUNITIES; SIMULATED DATUMS; SYSTEM ARCHITECTURES; SYSTEM DESIGNERS;

COMPUTERS; COSMOLOGY;

BENCHMARKING;

EID: 56749106163     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1362622.1362636     Document Type: Conference Paper

References (23)

1. K. Antypas, A.C.Calder, A. Dubey, R. Fisher, M.K. Ganapathy, J.B. Gallagher, L.B. Reid, K. Reid, K. Riley, D. Sheeler, and N. Taylor. Scientific applications on the massively parallel bg/1 machines. In PDPTA 2006, pages 292-298, 2006.
2. J. Borrill. MADCAP: The Microwave Anisotropy Dataset Computational Analysis Package. In 5th European SGI/Cray MPP Workshop, Bologna, Italy, 1999.
3. J. Borrill, J. Carter, L. Oliker, D. Skinner, and R, Biswas. Integrated performance monitoring of a, cosmology application on leading hec platforms. In ICPP: International Conference on Parallel Processing, Oslo, Norway, 2005.
4. P. Braam. File systems for clusters from a protocol perspective. In Proceedings of the Second Extreme Linux Topics Workshop, Monterey, CA, June 1999.
5. J. Carter, J. Borrill, and L. Oliker. Performance characteristics of a cosmology package on leading HPC architectures. In HiPC:International Conference on High Performance Computing, Bangalore, India, 2004.
6. A. Clung, A. Choudhary, W. Liao, R, Ross, and W. Gropp. Efficient structured data access in parallel file systems. In Cluster 2003 Conference, Dec 4, 2003.
7. D. Duffy, N. Acks, V. Noga, T. Schardt, J. Gary, B. Fink, B. Kobler, M. Donovan, J. McElvaney, and K. Kamischke. Beyond the storage area network: Data intensive computing in a distributed environment. In Conference on Mass Storage Systems and Technologies, Monterey, CA, April 11-14 2005.
8. FLASH-10 Benchmark on NERSC Platforms. http://pdsi.nersc.gov/I0Benchmark/ FLASH-IOBenchmark.pdf.
9. W. Gropp, E. Lusk, and R. Thakur. Using MPI-2: Advanced Features of the Message Passing Interface. MIT Press, 1984.
10. HECRTF:Workshop on the Roadmap for the Revitalization of High-End Computing, http://www.cra.org/Activities/workshops/nitrd/.
11. J. H. Howard, M. L. Kazar, S. G. Menees, D. A. Nichols, M. Satyanarayanan, R.. N. Sidebotham, and M.J.West. Scale and performance in a distributed file system. ACM Transactions on Computer Systems, 6(1):51-81, Feb,1988.
12. The ASCI I/O stress benchmark. http://www.llnl.gov/asci/purple/ benchmarks/limited/lor/.
13. lozone filesystem benchmark, http://www.iozone.org.
14. R. Latham, N. Miller, R. Ross, and P. Cams. A next-generation parallel file system for linux clusters: An introduction to the second parallel virtual file system. Linux Journal, pages 56-59, January 2004.
15. R. McDougall and J. Mauro. FileBench. http: //www.solarisinternals,com/ si/tools/filebench.
16. The PIORAW Test, http://cbcg.lbl.gov/nusers/systems/bassi/code-profiles. php.
17. R, R.abenseifner and A. E. Koniges. Effective file-l/O bandwidth benchmark. In European Conference on Parallel Processing (Euro-Par), Aug 29-Sep 1, 2000.
18. S. Saini, D. Talcott, R. Thakur, P. Adamidis, R. Rabenseifner, and R. Ciotti. Parallel I/O performance characterization of Columbia and NEC SX-8 superclusters. In "International Parallel and Distributed Processing Symposium (IPDPS)", Long Beach, CA, USA, March 26-30, 2007.
19. ScaLAPACK home page. http://www.netlib.org/scalapack/scalapack-home.html.
20. SCALES: Science Case for Large-scale Simulation. http://www.pnl.gov/ scales/.
21. F. Schmuck and Roger Haskin. GPFS: A shared-disk file system for large computing clusters. In First USENIX Conference on File and Storage Technologies Fastm, Monterey, CA, January 2002.
22. H. Shan and J. Shalf. Using 10R, to analyze the I/O performance of HPC platforms. In Cray Users Group Meeting (CUG) 2007, Seattle, Washington, May 7-10, 2007.
23. SP10BENCH: Streaming Parallel I/O Benchmark. http://www.nsf.gov/pubs/ 2006/nsf0605/spiobench.tar .gz, 2005.