Cooperative client-side file caching for MPI applications

International Journal of High Performance Computing Applications

Volumn 21, Issue 2, 2007, Pages 144-154

  Liao, Wei Keng ^a   Coloma, Kenin ^a   Choudhary, Alok ^a   Ward, Lee ^b  

^a Northwestern University   (United States)

^b SANDIA NATIONAL LABORATORIES   (United States)

Author keywords

Cache coherence; Client side file caching; I O thread; MPI I O; Parallel I O

Indexed keywords

COMPUTER SOFTWARE PORTABILITY; COMPUTER SUPPORTED COOPERATIVE WORK; CONCURRENCY CONTROL; DIGITAL LIBRARIES; FILE ORGANIZATION; INPUT OUTPUT PROGRAMS; PARALLEL PROGRAMMING;

CACHE COHERENCE; CLIENT-SIDE FILE CACHING; SHARED FILES;

CLIENT SERVER COMPUTER SYSTEMS;

EID: 34247639437     PISSN: 10943420     EISSN: 17412846     Source Type: Journal    
DOI: 10.1177/1094342007077857     Document Type: Article

References (26)

1. Bernstein, P., Hadzilacos, V., and Goodman, N. (1987). Concurrency control and recovery in database systems, Addison-Wesley, Longman, Reading, MA.
2. Carns, P., Ligon, W., Ross, R., and Thakur, R. (2000). PVFS: A parallel file system for Linux clusters, in Proceedings of the Fourth Annual Linux Showcase and Conference, Atlanta, GA, pp. 317-327.
3. Coloma, K., Choudhary, A., Liao, W.-K., Ward, L., and Tide-man, S. (2005). DAChe: Direct access cache system for parallel I/O, in Proceedings of the International Supercomputer Conference, Heidelberg, Germany.
4. Corts, T., Girona, S., and Labarta, J. (1996). PACA: A cooperative file system cache for parallel machines, in Proceedings of the 2nd International Euro-Par Conference, Lyon, France, pp. 477-486.
5. Dahlin, M., Wang, R., Anderson, T., and Patterson, D. (1994). Cooperative caching: Using remote client memory to improve file system performance, in Proceedings of the First Symposium on Operating System Design and Implementation, Monterey, CA, pp. 267-280.
6. del Rosario, J., Brodawekar, R., and Choudhary, A. (1993). Improved parallel input/output via a two-phase run-time access strategy, in Proceedings of the Workshop on Input/Output in Parallel Computer Systems at IPPS'93, New-port Beach, CA, pp. 56-70.
7. Fineberg, S., Wong, P., Nitzberg, B., and Kuszmaul, C. (1996). PMPIO - A portable implementation of MPI-IO, in Proceedings of the 6th Symposium on the Frontiers of Massively Parallel Computation, Washington, DC, pp. 188-195.
8. Fryxell, B., Olson, K., Ricker, P., Timmes, F.X., Zingale, M., Lamb, D.Q., MacNeice, P., Rosner, R., and Tufo, H. (2000). FLASH: An adaptive mesh hydrodynamics code for modeling astrophysical thermonuclear flashes, The Astrophysical Journal Supplement Series, 131 (1): 273 - 334.
9. HDF Group (2005). Hierarchical data format, Version 5 (http://hdf.ncsa.uiuc.edu/HDF5), National Center for Supercomputing Applications.
10. Huber, J., Elford, C., Reed, D., Chien, A., and Blumenthal, D. (1995). PPFS: A high performance portable file system, in Proceedings of the Ninth ACM International Conference on Supercomputing, Barcelona, Spain, pp. 385-394.
11. Ieee (1996). 1996 (ISO/IEC) [IEEE/ANSI Std 1003.1, 1996 Edition] Information technology-Portable operating system interface (POSIX®) -Part 1: System application: Program interface (API) [C Language], Ppub-IEEE-STD: Adr: pub-IEEE-STD.
12. Ieee (2001). IEEE Std 1003.1-2001 Standard for Information Technology-Portable operating system interface (POSIX) system interfaces, Issue 6, pub-IEEE-STD:aDr: pub-IEEE-STD. Revision of IEEE Std 1003.1-1996 and IEEE Std 1003.2-1992, Open Group Technical Standard Base Specifications, Issue 6.
13. Isaila, F., Malpohl, G., Olaru, V., Szeder, G., and Tichy, W. (2004). Integrating collective I/O and cooperative caching into the "Clusterfile" parallel file system, in Proceedings of the Eighteenth Annual International Conference on Supercomputing, Sain-Malo, France, pp. 58-67.
14. Cluster File Systems (2003). Whitepaper:LUstre: A Scalable, High-Performance File System, Cluster File Systems, Inc.
15. Ma, X., Winslett, M., Lee, J., and Yu, S. (2003). Improving Mpi - IO output performance with active buffering plus threads, in Proceedings of the International Parallel and Distributed Processing Symposium, Nice, France.
16. MPI Forum (1995). MPI: A message passing interface standard, Version 1.1 (http://www.mpi-forum.org/docs/docs.html).
17. Mpi Forum (1997). MPI-2: Extensions to the message passing interface (http://www.mpi-forum.org/docs/docs.html).
18. Nagle, D., Serenyi, D., and Matthews, A. (2004). The Panasas ActiveScale storage cluster - Delivering scalable high bandwidth storage, in Proceedings of the ACM/IEEE Conference on Supercomputing, Pittsburgh, PA, pp. 53.
19. Prost, J., Treumann, R., Hedges, R., Jia, B., and Koniges, A. (2001). MPI-IO/GPFS, an optimized implementation of MPI-IO on top of GPFS, in Proceedings of the ACM/IEEE Conference on Supercomputing, Denver, Colorado, pp. 17.
20. Prost, J., Treumann, R., Hedges, R., Koniges, A., and White, A. (2000). Towards a high-performance implementation of MPI-IO on top of GPFS, in Proceedings of the Sixth International Euro-Par Conference on Parallel Processing, Munich, Germany, pp. 1253-1262.
21. Schmuck, F. and Haskin, R. (2002). GPFS: A shared-disk file system for large computing clusters, in Proceedings of the First Conference on File and Storage Technologies, Monterey, CA, pp. 231-244.
22. Tanenbaum, A. and van Steen, M. (2002). Distributed systems - principles and paradigms, Prentice Hall, Upper Saddle River, NJ.
23. Thakur, R., Gropp, W., and Lusk, E. (1999). On implementing MPI-IO portably and with high performance, in Proceedings of the Sixth Workshop on Input/Output in Parallel and Distributed Systems, Atlanta, GA, pp. 23-32.
24. Voelker, G., Anderson, E., Kimbrel, T., Feeley, M., Chase, J., Karlin, A., and Levy, H. (1998). Implementing cooperative prefetching and caching in a globally-managed memory system, in Proceedings of the Joint International Conference on Measurement and Modeling of Computer Systems, Madison, WI, pp. 33-43.
25. Wong, P. and der Wijngaart, R. (2003). NAS parallel benchmarks I/O Version 2.4, Technical Report NAS-03-002, NASA Ames Research Center, Moffet Field, CA.
26. Zingale, M. (2001). FLASH I/O benchmark routine - parallel HDF 5 (http://flash.uchicago.edu/~zingale/flash_benchmark_io).