Collective caching: Application-aware client-side file caching

Proceedings of the IEEE International Symposium on High Performance Distributed Computing

Volumn , Issue , 2005, Pages 81-90

  Liao, Wei Keng ^a   Coloma, Kenin ^a   Choudhary, Alok ^a   Ward, Lee ^b   Russell, Eric ^b   Tideman, Sonja ^b  

^a NORTHWESTERN UNIVERSITY   (United States)

^b SANDIA NATIONAL LABORATORIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CACHING SUB-SYSTEMS; CLIENT-SIDE FILE CACHING; COLLECTIVE CACHING; I/O OPTIMIZATION;

BENCHMARKING; BUFFER STORAGE; CLIENT SERVER COMPUTER SYSTEMS; COMPUTER SOFTWARE PORTABILITY; FILE ORGANIZATION; INTERFACES (COMPUTER); PARALLEL PROCESSING SYSTEMS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 27544434358     PISSN: 10828907     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. P. Bernstein, V. Hadzilacos, and N. Goodman. Concurrency Control and Recovery in Database Systems. Addison-Wesley, 1987.
2. P. Cams, W. Ligon, R. Ross, and R. Thakur. PVFS: A Parallel File System for Linux Clusters. In the Third Annual Linux Showcase and Conference, pages 317-327, Oct. 2000.
3. Computational Plant, Sandia National Laboratories. ENFS - Extended NFS. http://www.cs.sandia.gov/cplant/doc/io /ENFS_User_Doc.html.
4. T. Corts, S. Girona, and J. Labarta. PACA: A Cooperative File System Cache for Parallel Machines. In the 2nd International Euro-Par Conference, pages 477-486, Aug. 1996.
5. M. Dahlin, R. Wang, and T. A. adn D. Patterson. Cooperative Caching: Using Remote Client Memory to Improve File System Performance. In the First Symposium on Operating System Design and Implementation, Nov. 1994.
6. J. del Rosario, R. Brodawekar, and A. Choudhary. Improved Parallel I/O via a Two-Phase Run-time Access Strategy. In the Workshop on I/O in Parallel Computer Systems at IPPS '93, pages 56-70, Apr. 1993.
7. B. Fryxell, K. Olson, P. Ricker, F. X. Timmes, M. Zingale, D. Q. Lamb, P. MacNeice, R. Rosner, and H. Tufo. FLASH: An Adaptive Mesh Hydrodynamics Code for Modelling Astrophysical Thermonuclear Flashes. Astrophysical Journal Suppliment, pages 131-273, 2000.
8. J. Huber, C. Elford, D. Reed, A. Chien, and D. Blumenthal. PPFS: A High Performance Portable File System. In the 9th ACM International Conference on Supercomputing, 1995.
9. IEEE/ANSI Std. 1003.1. Portable Operating System Interface (POSIX)-Part 1: System Application Program Interface (API) [C Language], 1996.
10. F. Isaila, G. Malpohl, V. Olaru, G. Szeder, and W. Tichy. Integrating Collective I/O and Cooperative Caching into the "Clusterfile" Parallel File System. In the 18th annual international conference on Supercomputing, pages 58-67, June 2004.
11. D. Kotz. Disk-directed I/O for MIMD Multiprocessors. ACM Transactions on Computer Systems, 15(1):4l-74, Feb. 1997.
12. W. Liao, A. Choudhary, K. Coloma, G. Thiruvathukal, W. Lee, E. Russell, and N. Pundit. Scalable Implementations of MPI Atomicity for Concurrent Overlapping I/O. In the International Conference on Parallel Processing, Oct. 2003.
13. Lustre: A Scalable, High-Performance File System. Whitepaper. Cluster File Systems, Inc., 2003.
14. Message Passing Interface Forum. MPI: A Message Passing Interface Standard, Version 1.1, June 1995. http:// www.mpi-forum.org/docs/docs.html.
15. Message Passing Interface Forum. MPI-2: Extensions to the Message Passing Interface, July 1997. http://www.mpiforum.org/docs/docs.html.
16. D. Nagle, D. Serenyi, and A. Matthews. The Panasas ActiveScale Storage Cluster - Delivering Scalable High Bandwidth Storage. In the ACM/IEEE Supercomputing Conference, Nov. 2004.
17. J. Prost, R. Treumann, R. Hedges, B. Jia, and A. Koniges. MPI-IO/GPFS, an Optimized Implementation of MPI-IO on top of GPFS. In Supercomputing, Nov. 2001.
18. J. Prost, R. Treumann, R. Hedges, A. Koniges, and A. White. Towards a High-Performance Implementation of MPI-IO on top of GPFS. In the Sixth International Euro-Par Conference on Parallel Processing, Aug. 2000.
19. F. Schmuck and R. Haskin. GPFS: A Shared-Disk File System for Large Computing Clusters. In the Conference on File and Storage Technologies (FAST'02), pages 231-244, Jan. 2002.
20. S. Shepler, C. Beame, R. Callaghan, M. Eisler, D. Noveck, D. Robinson, and R. Thurlow. NFS version 4 Protocol. RFC 3010, Dec. 2000.
21. A. Tanenbaum and M. van Steen. Distributed Systems - Principles and Paradigms. Prentice Hall, 2002.
22. R. Thakur, W. Gropp, and E. Lusk. Users Guide for ROMIO: A High-Performance, Portable MPI-IO Implementation. Technical Report ANL/MCS-TM-234, Mathematics and Computer Science Division, Argonne National Laboratory, Oct. 1997.
23. G. Voelker, E. Anderson, T. Kimbrel, M. Feeley, J. Chase, A. Karlin, and H. Levy. Implementing Cooperative Prefetching and Caching in a Globally-managed Memory System. In the Joint International Conference on Measurement and Modeling of Computing Systems, pages 33-43, 1998.
24. P. Wong and R. der Wijngaart. NAS Parallel Benchmarks I/O Version 2.4. Technical Report NAS-03-002, NASA Ames Research Center, Moffet Field, CA, Jan. 2003.
25. M. Zingale. FLASH I/O Benchmark Routine - Parallel HDF 5. http://flash.uchicago.edu/~zingale/flash_benchmark_io.