An efficient, nonintrusive, Log-Based I/O mechanism for scientific simulations on clusters

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn , Issue , 2005, Pages

  Mitra, Soumyadeb ^a   Sinha, Rishi Rakesh ^a   Winslett, Marianne ^a   Jiao, Xiangmin ^b  

^a UIUC

^b UIUC

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATIONS.; CLUSTER COMPUTING; FREE SPACES; I/O PERFORMANCE; INTERNATIONAL CONFERENCES; MICROBENCHMARKS; NETWORK RESOURCES; NON-INTRUSIVE; REAL-WORLD; REMOTE STORAGE; SCIENTIFIC SIMULATIONS; SIMULATION CODES;

CODES (STANDARDS); CODES (SYMBOLS); COMPUTERS; DISKS (MACHINE COMPONENTS); DISKS (STRUCTURAL COMPONENTS); LIBRARIES; SUPERCOMPUTERS;

CHLORINE COMPOUNDS;

EID: 50149108019     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2005.347041     Document Type: Conference Paper

References (18)

1. Apple Xserve RAID, www.apple.com/xserve/raid/.
2. IBM DS8000, www-1.ibm.com/servers/storage/disk/ds8000/index.html.
3. Lustre filesystem, www.lustre.org.
4. G. Agrawal, A. Acharya, and J. Saltz. An interprocedural framework for placement of asynchronous I/O operations. In Proceedings of the 10th ACM International Conference on Supercomputing, pages 358-365, Philadelphia, PA, May 1996. ACM Press.
5. G. T. Almes and E. D. Lazowska. The behavior of ethernet-like computer communications networks. In Proceedings of the 7th ACM Symposium on Operating Systems Principles (SOSP), pages 66-81, 1979.
6. Andr B. Bondi. Characteristics of scalability and their impact on performance. In Proceedings of the second international workshop on Software and performance, pages 195-203, 2000.
7. Bradley Broom, Rob Fowler, and Ken Kennedy. KelpIO: A telescope-ready domain-specific I/O library for irregul ar block-structured applications. In Proceedings of the 2001 IEEE International Symposium on Cluster Computing and the Grid, Brisbane, Australia, 2001.
8. P. Cams, W. Ligon III, R. Ross, and R. Thakur. PVFS: A Parallel File System For Linux Clusters. In Proceedings of the 4th Annual Linux Showcase and Conference, 2000.
9. Dell Report www.dell.com/downloads/global/power/ps4q04-20040145-Jancic. pdf. Maximizing NFS Scalability.
10. W. Dick and M. Heath. Whole system simulation of solid propellant rockets. In Proceedings of the 38th AIAA/ASME/SAE/ASEE Joint Propulsion Conference and Exhibit, Indianapolis, IN, July 2002.
11. Phillip Dickens and Rajeev Thakur. Improving collective I/O performance using threads. In Proceedings of the Joint International Parallel Processing Symposium and IEEE Symposium on Parallel and Distributed Processing, pages 38-45, April 1999.
12. Hal L Stern and Brian L. Wong. NFS performance and Network Loading. In LISA VI, Long Beach CA, 1992.
13. http://hdf.ncsa.uiuc.edu/UG41r3_html/. HDF 4.1r3 User's Guide.
14. X. Ma, J. Jiao, M. Campbell, and M. Winslett. Flexible and efficient parallel i/o for large-scale multi-component simulations. In Proceedings of The 4th Workshop on Parallel and Distributed Scientific and Engineering Computing with Applications, in conjunction with the 2003 International Parallel and Distributed Processing Symposium, April 2003.
15. X. Ma, M. Winslett, J. Lee, and S. Yu. Improving MPI-IO Output Performance with Active Buffering Plus Threads. In Proceedings of the International Parallel and Distributed Processing Symposium, 2003.
16. F. Schmuck and R. Haskin. GPFS: a shared-disk file system for large computing clusters. In Proceedings of the First Conference on File and Storage Technologies, Monterey, CA, January 2002.
17. Rajeev Thakur, William Gropp, and Ewing Lusk. Data sieving and collective I/O in ROMIO. In Proceedings of the Seventh Symposium on the Frontiers of Massively Parallel Computation, pages 182-189, February 1999.
18. Rajeev Thakur, William Gropp, and Ewing Lusk. On Implementing MPI-IO Portably and with High Performance. In Proc. of the Sixth Workshop on I/O in Parallel and Distributed Systems, pages 23-32, May 1999.