HPC global file system performance analysis using a scientific-application derived benchmark

Parallel Computing

Volumn 35, Issue 6, 2009, Pages 358-373

  Borrill, Julian ^a   Oliker, Leonid ^a   Shalf, John ^a   Shan, Hongzhang ^a   Uselton, Andrew ^a  

^a LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

Author keywords

Cosmic microwave background; CXFS; Global parallel file system; GPFS; I O benchmarking; Lustre; PVFS2

Indexed keywords

COSMIC MICROWAVE BACKGROUND; CXFS; GLOBAL PARALLEL FILE SYSTEM; GPFS; I/O BENCHMARKING; LUSTRE; PVFS2;

COSMOLOGY; MICROWAVES; PARALLEL ARCHITECTURES;

BENCHMARKING;

EID: 67349083509     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2009.02.002     Document Type: Article

References (28)

1. K. Antypas, A.C.Calder, A. Dubey, R. Fisher, M.K. Ganapathy, J.B. Gallagher, L.B. Reid, K. Reid, K. Riley, D. Sheeler, N. Taylor, Scientific applications on the massively parallel BG/L machines, in: PDPTA 2006, 2006, pp. 292-298.
2. J. Borrill, J. Carter, L. Oliker, D. Skinner, R. Biswas, Integrated performance monitoring of a cosmology application on leading HEC platforms, in: ICPP: International Conference on Parallel Processing, Oslo, Norway, 2005.
3. J. Borrill, L. Oliker, J. Shalf, H. Shan, Investigation of leading HPC I/O performance using a scientific-application derived benchmark, in: Proceedings of SC07: High Performance Computing, Networking, and Storage Conference, Reno, NV, 2007.
4. J. Borrill, MADCAP: The microwave anisotropy dataset computational analysis package, in: Fifth European SGI/Cray MPP Workshop, Bologna, Italy, 1999.
5. P. Braam, File systems for clusters from a protocol perspective, in: Proceedings of the Second Extreme Linux Topics Workshop, Monterey, CA, June 1999.
6. J. Carter, J. Borrill, L. Oliker, Performance characteristics of a cosmology package on leading HPC architectures, in: HiPC: International Conference on High Performance Computing, Bangalore, India, 2004.
7. A. Ching, A. Choudhary, W. Liao, R. Ross, W. Gropp, efficient structured data access in parallel file systems, in: Cluster 2003 Conference, December 4, 2003.
8. D. Duffy, N. Acks, V. Noga, T. Schardt, J. Gary, B. Fink, B. Kobler, M. Donovan, J. McElvaney, K. Kamischke, Beyond the storage area network: data intensive computing in a distributed environment, in: Conference on Mass Storage Systems and Technologies, Monterey, CA, April 11-14, 2005.
9. Flash I/O Benchmark. .
10. Gropp W., Lusk E., and Thakur R. Using MPI-2: Advanced Features of the Message Passing Interface (1984), MIT Press
11. HECRTF:Workshop on the Roadmap for the Revitalization of High-End Computing. .
12. Howard J.H., Kazar M.L., Menees S.G., Nichols D.A., Satyanarayanan M., Sidebotham R.N., and West M.J. Scale and performance in a distributed file system. ACM Transactions on Computer Systems 6 1 (1988) 51-81
13. Hpio the High-Performance I/O Benchmark. .
14. The ASCI I/O Stress Benchmark. .
15. Iozone Filesystem Benchmark. .
16. Latham R., Miller N., Ross R., and Carns P. ; A next-generation parallel file system for linux clusters: an introduction to the second parallel virtual file system. Linux Journal (2004) 56-59
17. MADbench2: A Scientific-Application Derived I/O Benchmark. .
18. R. McDougall, J. Mauro, FileBench. .
19. Performance Testing with the PIORAW Benchmark. .
20. R. Rabenseifner, A.E. Koniges, Effective file-I/O bandwidth benchmark, in: European Conference on Parallel Processing (Euro-Par), August 29-September 1, 2000.
21. S. Saini, D. Talcott, R. Thakur, P. Adamidis, R. Rabenseifner, R. Ciotti, Parallel I/O performance characterization of Columbia and NEC SX-8 superclusters, in: International Parallel and Distributed Processing Symposium (IPDPS), Long Beach, CA, USA, March 26-30, 2007.
22. ScaLAPACK Home Page. .
23. SCALES: Science Case for Large-Scale Simulation. .
24. F. Schmuck, Roger Haskin, GPFS: a shared-disk file system for large computing clusters, in: First USENIX Conference on File and Storage Technologies Fast02, Monterey, CA, January 2002.
25. H. Shan, K. Anypas, J. Shalf, Characterizing and predicting the I/O performance of HPC applications using a parameterized synthetic benchmark, in: Proceedings of SC2008: High Performance Computing, Networking, and Storage Conference, Austin, TX, November 15-21.
26. SPIOBENCH: Streaming Parallel I/O Benchmark. , 2005.
27. MPI-Tile-I/O. .
28. P. Wong, R.F. Wijngaart, NAS parallel benchmarks I/O version 2.4, in: Technical Report NAS-03-002, Computer Sciences Corporation, NASA Arms Research Center, Moffett Field, CA 94035-1000, January 2003.