Multi-layer event trace analysis for parallel I/O performance tuning

Proceedings of the International Conference on Parallel Processing

Volumn , Issue , 2007, Pages 12-21

  Lu, Pin ^a   Shen, Kai ^a  

^a University of Rochester

Author keywords

[No Author keywords available]

Indexed keywords

FILE ORGANIZATION; OPEN SOURCE SOFTWARE;

ANOMALY IDENTIFICATION; C-RUNTIME LIBRARY; EMPIRICAL CASE STUDIES; PARALLEL FILE SYSTEM; PARALLEL I/O SYSTEMS; PERFORMANCE PROBLEMS; PERFORMANCE TUNING; THROUGHPUT IMPROVEMENT;

TRACE ANALYSIS;

EID: 47249139177     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2007.59     Document Type: Conference Paper

References (18)

1. P. H. Carns, W. B. L. III, R. B. Ross, and R. Thakur. PVFS: A Parallel File System For Linux Clusters. In Proc. of the 4th Annual Linux Showcase and Conf., pages 317-327, Oct. 2000.
2. S.A. Fineberg, P. Wong, B. Nitzberg, and C. Kuszmaul. PM-PIO - A Portable Implementation of MPI-IO. In Proc. of the 6th Symp. on The Frontiers of Massively Parallel Computation, pages 188-195, Oct. 1996.
3. I/O Stress Benchmark Codes Web Page at LLNL. http://www.llnl.gov/asci/ purple/benchmarks/limited/ior/.
4. S. Iyer and P. Druschel. Anticipatory Scheduling: A Disk Scheduling Framework to Overcome Deceptive Idleness in Synchronous I/O. In Proc. of the 18th ACM Symp. on Operating Systems Principles, pages 117-130, Oct. 2001.
5. D. Kotz and N. Nieuwejaar. File System Workload on a Scientific Multiprocessor. IEEE Parallel and Distributed Technology, 3(1):51-60, 1995.
6. C. Li, K. Shen, and A. E. Papathanasiou. Competitive Prefetching for Concurrent Sequential I/O. In Proc. of the Second EuroSys Conf., pages 189-202, Mar. 2007.
7. Lustre Cluster File System. http://www.lustre.org.
8. E. Miller and R. Katz. Input/Output Behavior of Supercomputing Applications. In Proc. of Supercomputing, pages 567-576, Nov. 1991.
9. Parallel I/O Benchmarking Consortium at ANL. http://www-unix.mcs.anl.gov/ rross/pio-benchmark/.
10. NAS Parallel Benchmarks Web Page. http://www.nas.nasa.gov/Software/NPB/.
11. B. Pasquale and G. Polyzos. A Static Analysis of I/O characteristics of Scientific Applications in a Production Workload. In Proc. of Supercomputing, pages 388-397, 1993.
12. The Parallel Virtual File System, Version 2. http://www.pvfs.org/pvfs2.
13. R. B. Ross. Argonne National Lab, Aug. 2006. Personal Communication.
14. F. Schmuck and R. Haskin. GPFS: A Shared-Disk File System for Large Computing Clusters. In Proc. of the USENIX Conf. on File and Storage Technologies, pages 231-244, Jan. 2002.
15. K. Shen, M. Zhong, and C. Li. I/O System Performance Debugging Using Model-driven Anomaly Characterization. In Proc. of the 4th USENIX Conf. on File and Storage Technologies, pages 309-322, Dec. 2005.
16. E. Smirni, R. Aydt, A. Chien, and D. Reed. I/O Requirements of Scientific Applications: An Evolutionary View. In Proc. of the 5th IEEE Int'l Symp. on High Performance Distributed Computing, pages 49-59, 1996.
17. R. Thakur, W. Gropp, and E. Lusk. On Implementing MPI-IO Portably and with High Performance. In Proc. of the 6th Workshop on I/O in Parallel and Distributed Systems, pages 23-32, May 1999.
18. Y. Wang. Dept. of Electrical and Computer Engineering, Northeastern University, 2006. Personal Communication.