Lessons from characterizing the input/output behavior of parallel scientific applications

Performance Evaluation

Volumn 33, Issue 1, 1998, Pages 27-44

  Smirni, E ^a,b   Reed, D A ^c,d  

^a The College of William and Mary   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^c University of Illinois at Urbana Champaign   (United States)

^d MISSOURI UNIVERSITY OF SCIENCE AND TECHNOLOGY   (United States)

Author keywords

Parallel input output; Scientific applications; Workload characterization

Indexed keywords

COMPUTER ARCHITECTURE; COMPUTER HARDWARE; CONGESTION CONTROL (COMMUNICATION); INPUT OUTPUT PROGRAMS; INTERFACES (COMPUTER); TELECOMMUNICATION TRAFFIC;

APPLICATION PROGRAMMING INTERFACES; PABLO PERFORMANCE ANALYSIS TOOLS; PARALLEL INPUT/OUTPUT APPLICATIONS; WORKLOAD CHARACTERIZATION;

PARALLEL PROCESSING SYSTEMS;

EID: 0032095755     PISSN: 01665316     EISSN: None     Source Type: Journal    
DOI: 10.1016/s0166-5316(98)00009-1     Document Type: Article

References (30)

1. R. Bennett, K. Bryant, A. Sussman, R. Das, J. Saltz, Jovian: A framework for optimizing parallel I/O, in: Proc. Scalable Parallel Libraries Conf., IEEE Computer Soc. Press, Silver Spring, 1994, pp. 10-20.
2. R. Bordawekar, R. Thakur, A. Choudhary, Efficient compilation of out-of-core data parallel programs, Tech. Rep. SCCS-622, NPAC 1994.
3. C.W.H. Prichard, V. McKoy, Parallel computation of electron-molecule collisions, IEEE Comput. Sci. Eng. (1995) 34-42.
4. P.F. Corbett, S.J. Baylor, D.G. Feitelson, Overview of the vesta parallel file system, in: IPPS'93 Workshop on Input/Output in Parallel Computer Systems, 1993, pp. 1-16.
5. P.F. Corbett, D.G. Feitelson, J.-P. Prost, S.J. Baylor, Parallel access to files in the Vesta file system, in: Proc. Supercomputing, 1993, pp. 472-481.
6. P.F. Corbett, J.-P. Prost, C. Demetriou, G. Gibson, E. Riedel, J. Zelenka, Y. Chen, E. Felten, K. Li, J. Hartman, L. Peterson, B. Bershad, A. Wolman, R. Aydt, Proposal for a common parallel file system programming interface, version 1.0, 1996.
7. P. Crandall, R.A. Aydt, A.A. Chien, D.A. Reed, Input/output characterization of scalable parallel applications, in: Proc. Supercomputing, 1995.
8. I. Foster, J. Nieplocha, ChemIO: High-performance I/O for computational chemistry applications, http://www. mcs.anl.gov/chemio, 1996.
9. R.D. Henderson, G.E. Karniadakis, Unstructured spectral element methods or simulation of turbulent flows, J. Comput. Phys. 122 (2) (1995) 191-217.
10. High Performance Computational Chemistry Group, Pacific Northwest National Laboratory, NWChem: A Computational Chemistry Package for Parallel Computers, Version 1.1, Richland, Washington 99352, USA, 1995.
11. Intel Corporation, Paragon System User's Guide, Intel SSD, Beaverton, OR, 3124890-004, EAR 1995.
12. S.M. King, Installing, Managing, and using the IBM AIX Parallel I/O File System, Information Development Department, IBM Kingston, New York, 1994.
13. D. Kotz, N. Nieuwejaar, Dynamic file-access characteristics of a production parallel scientific workload, in: Proc. Supercomputing, 1994, pp. 640-649.
14. S.J. LoVerso, M. Isman, A. Nanopoulos, W. Nesheim, E.D. Milne, R. Wheeler, sfs: A parallel file system for the CM-5, in: Proc. Summer USENIX Conf., 1993, pp. 291-305.
15. T. Madhyastha, D.A. Reed, Intelligent, adaptive file system policy selection, in: Proc. Frontiers, 1996.
16. E.L. Miller, R.H. Katz, Input/output behavior of supercomputer applications, in: Proc. Supercomputing, 1991, pp. 567-576.
17. S.A. Moyer, V.S. Sunderam, PIOUS a scalable parallel I/O system for distributed computing environments, in: Proc. Scalable High-Performance Computing Conf., 1994, pp. 71-78.
18. N. Nieuwejaar, D. Kotz, The galley parallel file system, in: Proc. 10th ACM Int. Conf. on Supercomputing, 1994, pp. 374-381.
19. N. Nieuwejaar, D. Kotz, A. Purakayastha, C.S. Ellis, M. Best, File-Access characteristics of parallel scientific workloads, Tech. Rep. PCS-TR95-263, Department of Computer Science, Dartmouth College, 1995; IEEE TPDS 7 (10) (1996) 1075-1089.
20. B. Nitzberg, Performance of the iPSC/860 Concurrent File System, Tech. Rep. RND-92-020, NAS Systems Division, NASA Ames, 1992.
21. B.K. Pasquale, G.C. Polyzos, Dynamic I/O characterization of I/O intensive scientific applications, in: Proc. Supercomputing, 1994, pp. 660-669.
22. J.T. Poole, Scalable I/O Initiative, California Institute of Technology, Available at http://www.ccsf.caltech.edu/SIO, 1996.
23. A. Purakayastha, C.S. Ellis, D. Kotz, N. Nieuwejaar, M. Best, Characterizing parallel file-access patterns on a large-scale multiprocessor, in: Proc. 9th Int. Parallel Processing Symp., 1995, pp. 165-172.
24. D.A. Reed, R.A. Aydt, R.J. Noe, P.C. Roth, K.A. Shields, B.W. Schwartz, L.F. Tavera, Scalable performance analysis: The Pablo performance analysis environment, in: A. Skjellum (Ed.), Proc. Scalable Parallel Libraries Conf., IEEE Computer Soc. Press, Silver Spring, 1993, pp. 104-113.
25. D. A. Reed, C.L. Elford, T. Madhyastha, W.H. Scullin, R.A. Aydt, E. Smirni, I/O, performance analysis, and performance data immersion, in: Proc. MASCOTS, 1996, pp. 1-12.
26. K.E. Seamons, Y. Chen, P. Jones, J. Jozwiak, M. Winslett, Server-directed collective I/O in Panda, in: Proc. Supercomputing, 1995.
27. E. Smirni, R.A. Aydt, A.A. Chien, D.A. Reed, I/O requirements of scientific applications: An evolutionary view, in: Proc. High Performance Distributed Computing, 1996, pp. 49-59.
28. The MPI-IO Committee, MPI-IO A parallel file I/O interface for MPI, April 1996, Version 0.5.
29. S. Toledo, F.G. Gustavson, The design and implementation of SOLAR, A portable library for scalable out-of-core linear algebra computations, in: Fourth Workshop on Input/Output in Parallel and Distributed Systems, Philadelphia, 1996, pp. 28-40.
30. Y.-S.M. Wu, S.A. Cuccaro, P.G. Hipes, A. Kuppermann, Quantum chemical reaction dynamics on a highly parallel supercomputer, Theoret. Chimica Acta 79 (1991) 225-239.