PVFS over InfiniBand: Design and performance evaluation

Proceedings of the International Conference on Parallel Processing

Volumn 2003-January, Issue , 2003, Pages 125-132

  Wu, J ^a   Wyckoff, P ^b   Panda, Dhabaleswar ^a  

^a OHIO STATE UNIVERSITY   (United States)

^b OHIO SUPERCOMPUTER CENTER   (United States)

Author keywords

Bandwidth; File systems; Hardware; Information science; Memory management; Parallel processing; Scalability; Software standards; Supercomputers; TCPIP

Indexed keywords

BANDWIDTH; COMPUTER HARDWARE; DESIGN; FILE ORGANIZATION; INFORMATION MANAGEMENT; INFORMATION SCIENCE; QUEUEING NETWORKS; SCALABILITY; SUPERCOMPUTERS; TRANSMISSION CONTROL PROTOCOL;

FILE SYSTEMS; MEMORY MANAGEMENT; PARALLEL PROCESSING; SOFTWARE STANDARDS; TCPIP;

PARALLEL PROCESSING SYSTEMS;

EID: 84944753375     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2003.1240573     Document Type: Conference Paper

References (22)

1. D. Anderson, J. Chase, S. Gadde, A. Gallatin, K. Yocum, and M. Feeley. Cheating the I/O Bottleneck: Network Storage with Trapeze/Myrinet. In Proceedings of the Usenix Technical Conference. New Orleans, LA., 1998.
2. M. Bancroft, N. Bear, J. Finlayson, R. Hill, , R. Isicoff, and H. Thompson. Functionality and Performance Evaluation of File Systems for Storage Area Networks (SAN). In the Eighth NASA Goddard Conference on Mass Storage Systems and Technologies, 2000.
3. P. Carns. Design and Analysis of a Network Transfer Layer for Parallel File Systems. Master thesis. http://parlweb.parl.clemson.edu/techreports/.
4. P. H. Carns, W. B. Ligon III, R. B. Ross, and R. Thakur. PVFS: A Parallel File System for Linux Clusters. In Proceedings of the 4th Annual Linux Showcase and Conference, pages 317-327, Atlanta, GA, 2000. USENIX Association.
5. A. Ching, A. Choudhary, W. keng Liao, R. Ross, and W. Gropp. Noncontiguous I/O through PVFS. In Proc. of the IEEE Int. Conf. on Cluster Computing, 2002.
6. DAFS Collaborative. Direct Access File System Protocol, V1.0, August 2001.
7. H. Tezuka and F. O'Carroll and A. Hori and Y. Ishikawa. Pindown Cache: A Virtual Memory Management Technique for Zero-copy Communication. In 12th Int. Parallel Processing Symposium, March 1998.
8. http://www.textuality.com/bonnie/. Bonnie: A File System Benchmark.
9. InfiniBand Trade Association. InfiniBand Architecture Specification, Release 1.0, October 24, 2000.
10. J. Liu, M. Banikazemi, B. Abali, and D. K. Panda. A Portable Client/Server Communication Middleware over SANs: Design and Performance Evaluation with InfiniBand. In SAN-02 Workshop (in conjunction with HPCA), Feb. 2003.
11. C. Lever and P. Honeyman. Linux NFS Client Write Performance. In Proceedings of the Usenix Technical Conference, FREENIX track, Monterey, June 2001.
12. K. Magoutis, S. Addetia, A. Fedorova, M. Seltzer, J. Chase, A. Gallatin, R. Kisley, R. Wickremesinghe, and E. Gabber. Structure and performance of the direct access file system. In Proc. of USENIX 2002 Annual Technical Conference, Monterey, CA, pages 1-14, June 2002.
13. Mellanox Technologies. Mellanox InfiniBand InfiniHost Adapters, July 2002.
14. Mellanox Technologies. Mellanox IB-Verbs API (VAPI), Rev. 0.95, March 2003.
15. V. S. Pai, P. Druschel, and W. Zwaenepoel. IO-Lite: A Unified I/O Buffering and Caching System. ACM Transactions on Computer Systems, 18(1):37-66, 2000.
16. R. B. Ross. Parallel I/O Benchmarking Consortium. http://www-unix.mcs.anl.gov/ rross/pio-benchmark/html/.
17. F. Schmuck and R. Haskin. GPFS: A Shared-Disk File System for Large Computing Clusters. In First USENIX Conference on File and Storage Technologies.
18. Storage Networking Industry Association. Shared Storage Model. www.snia.org/tech-activities/shared-storage-model.
19. M. Welsh, A. Basu, and T. von Eicken. Incorporating Memory Management into User-Level Network Interfaces. In Proc. Hot Interconnects V, August 1997.
20. J. Wu, P. Wyckoff, and D. K. Panda. PVFS over InfiniBand: Design and Performance Evaluation. Technical Report, OSU-CISRC-04/03-TR (http://nowlab.cis.ohio-state.edu/projects/mpi-iba/index.html), April 2003.
21. R. Zahir. Lustre Storage Networking Transport Layer. http://www.lustre.org/docs.html.
22. Y. Zhou, A. Bilas, S. Jagannathan, C. Dubnicki, J. F. Philbin, and K. Li. Experiences with VI communication for database storage. In ISCA, 2002.