Bridging HPC and grid file I/O with IOFSL

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7134 LNCS, Issue PART 2, 2012, Pages 215-225

  Cope, Jason ^a   Iskra, Kamil ^a   Kimpe, Dries ^a   Ross, Robert ^a  

^a ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION DATA; DATA ACCESS; GRID COMPUTING ENVIRONMENT; GRID CONTEXT; HETEROGENEOUS COMPUTING; HIGH-PERFORMANCE COMPUTING; I/O INTERFACES; MULTIPLE APPLICATIONS; RESEARCH COMMUNITIES; STORAGE SYSTEMS; WELL-ESTABLISHED TECHNIQUES;

COMPUTER SOFTWARE SELECTION AND EVALUATION; DATA STORAGE EQUIPMENT; INFORMATION MANAGEMENT; OPTIMIZATION; RESEARCH; WIDE AREA NETWORKS;

GRID COMPUTING;

EID: 84857467763     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-28145-7_22     Document Type: Conference Paper

References (22)

1. Ali, N., Carns, P., Iskra, K., Kimpe, D., Lang, S., Latham, R., Ross, R., Ward, L., Sadayappan, P.: Scalable I/O forwarding framework for high-performance computing systems. In: IEEE Int'l Conference on Cluster Computing (Cluster 2009) (September 2009)
2. Allen, G., Dramlitsch, T., Foster, I., Karonis, N., Ripeanu, M., Seidel, E., Toonen, B.: Supporting efficient execution in heterogeneous distributed computing environments with cactus and globus. In: Proceedings of SC 2001, November 10-16 (2001)
3. Baer, T., Wyckoff, P.: A parallel I/O mechanism for distributed systems. In: IEE Cluster 2004, pp. 63-69. IEEE (2004) (Pubitemid 40822357)
4. Carns, P.H., Ligon III, W.B., Ross, R.B., Thakur, R.: PVFS: A parallel file system for Linux clusters. In: Proceedings of the 4th Annual Linux Showcase and Conference, pp. 317-327 (2000)
5. Cluster File Systems, Inc.: Lustre: A scalable high-performance file system. Tech. rep., Cluster File Systems (November 2002), http://www.lustre.org/ docs/whitepaper.pdf
6. Grinberg, L., Karniadakis, G.: A scalable domain decomposition method for ultra-parallel arterial flow simulations. Communications in Computational Physics 4(5), 1151-1169 (2008)
7. Iskra, K., Romein, J.W., Yoshii, K., Beckman, P.: ZOID: I/O-forwarding infrastructure for petascale architectures. In: ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, Salt Lake City, UT, pp. 153-162 (2008)
8. Karonis, N., Toonen, B., Foster, I.: MPICH-G2: A Grid-enabled implementation of the Message Passing Interface. Journal of Parallel and Distributed Computing 63(5), 551-563 (2003)
9. Kelly, S., Brightwell, R.: Software architecture of the light weight kernel, Catamount. In: Proceedings of the 2005 Cray User Group Annual Technical Conference (2005)
10. Kosar, T., Balman, M.: A new paradigm: Data-aware scheduling in grid computing. Future Generation Computer Systems 25(4), 406-413 (2009)
11. Li, J., Liao, W., Choudhary, A., Ross, R., Thakur, R., Gropp, W., Latham, R., Siegel, A., Gallagher, B., Zingale, M.: Parallel netCDF: A high-performance scientific I/O interface. In: ACM/IEEE Conference on Supercomputing, Phoenix, AZ (November 2003)
12. Nagle, D., Serenyi, D., Matthews, A.: The Panasas ActiveScale storage cluster- delivering scalable high bandwidth storage. In: ACM/IEEE Conference on Supercomputing (November 2004)
13. Nowoczynski, P., Stone, N., Yanovich, J., Sommerfield, J.: Zest: Checkpoint storage system for large supercomputers. In: 3rd Petascale Data Storage Workshop, IEEE Supercomputing, pp. 1-5 (November 2008)
14. Ohta, K., Kimpe, D., Cope, J., Iskra, K., Ross, R., Ishikawa, Y.: Optimization Techniques at the I/O Forwarding Layer. In: IEEE Int'l Conference on Cluster Computing (Cluster 2010) (September 2010)
15. Schmuck, F., Haskin, R.: GPFS: A shared-disk file system for large computing clusters. In: USENIX Conference on File and Storage Technologies (2002)
16. Tatebe, O., Morita, Y., Matsuoka, S., Soda, N., Sekiguchi, S.: Grid datafarm architecture for petascale data intensive computing. In: CCGrid 2002, p. 102. IEEE Computer Society (2002)
17. Tatebe, O., Soda, N., Morita, Y., Matsuoka, S., Sekiguchi, S.: Gfarm v2: A Grid file system that supports high-performance distributed and parallel data computing. In: Proceedings of the Computing in High Energy and Nuclear Physics Conference, CHEP 2004 (2004)
18. Thain, D., Moretti, C., Hemmes, J.: Chirp: A practical global filesystem for cluster and Grid computing. Journal of Grid Computing 7(1), 51-72 (2009)
19. Thain, D., Tannenbaum, T., Livny, M.: Distributed computing in practice: The Condor experience. Concurrency and Computation Practice and Experience 17(2-4), 323-356 (2005)
20. Wilde, M., Ioan Raicu, I., Espinosa, A., Zhang, Z., Clifford, B., Hategan, M., Kenny, S., Iskra, K., Beckman, P., Foster, I.: Extreme-scale scripting: Opportunities for large task-parallel applications on petascale computers. Journal of Physics: Conference Series 180(1) (2009)
21. Yu, H., Sahoo, R.K., Howson, C., Almasi, G., Castanos, J.G., Gupta, M., Moreira, J.E., Parker, J.J., Engelsiepen, T.E., Ross, R., Thakur, R., Latham, R., Gropp, W.D.: High performance file I/O for the Blue Gene/L supercomputer. In: International Symposium on High-Performance Computer Architecture (February 2006)
22. Zheng, F., Abbasi, M., Docan, C., Lofstead, J., Liu, Q., Klasky, S., Prashar, M., Podhorszki, N., Schwan, K., Wolf, M.: Predata - preparatory data analytics on peta-scale machines. In: Proceedings of 24th IEEE International Parallel and Distributed Processing Symposium (2010)