Using server-to-server communication in parallel file systems to simplify consistency and improve performance

2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2008

Volumn , Issue , 2008, Pages

  Carns, Philip H ^a   Settlemyer, Bradley W ^b   Ligon III, Walter B ^b  

^a ARGONNE NATIONAL LABORATORY   (United States)

^b AMRL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COLLECTIVE COMMUNICATIONS; CONSISTENCY CHECKING; CONSISTENCY CHECKS; I/O BANDWIDTH; I/O BOTTLENECK; PARALLEL COMPUTING; PARALLEL FILE SYSTEM; SERVER COMMUNICATIONS; STORAGE NODES; STORAGE SERVERS;

COMMUNICATION; COMPUTER SCIENCE; METADATA; PARALLEL ARCHITECTURES; SCALABILITY;

SERVERS;

EID: 70350757787     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2008.5214724     Document Type: Conference Paper

References (13)

1. U.S. Department of Energy, "The office of science data-management challenge," March-May 2004.
2. A. Devulapalli and P. Wyckoff, "File creation strategies in a distributed metadata file system," Parallel and Distributed Processing Symposium, 2007. IPDPS 2007. IEEE International, pp. 1-10, 26-30 March 2007.
3. P. J. Braam, "Scalable locking and recovery for network file systems," in Petascale Data Storage Workshop SC07, 2007.
4. F. Schmuck and R. Haskin, "GPFS: A shared-disk file system for large computing clusters," in Proc. of the First Conference on File and Storage Technologies (FAST), Jan. 2002, pp. 231-244. [Online]. Available: citeseer.ist.psu.edu/schmuck02gpfs.html
5. S. A. Weil, K. T. Pollack, S. A. Brandt, and E. L. Miller, "Dynamic metadata management for petabyte-scale file systems," in SC '04: Proceedings of the 2004 ACM/IEEE conference on Supercomputing. Washington, DC, USA: IEEE Computer Society, 2004, p. 4.
6. S. A. Weil, S. A. Brandt, E. L. Miller, D. D. E. Long, and C. Maltzahn, "Ceph: a scalable, high-performance distributed file system," in OSDI '06: Proceedings of the 7th symposium on Operating systems design and implementation. Berkeley, CA, USA: USENIX Association, 2006, pp. 307-320.
7. B. W. Settlemyer and W. B. Ligon III, "A technique for lock-less mirroring in parallel file systems," in Workshop On Resiliency in High-Performance Computing at 8th IEEE International Symposium on Cluster Computing and the Grid, 2008.
8. A. Grama, A. Gupta, G. Karypis, and V. Kumar, Introduction to Parallel Computing, Second Edition. Pearson Addison Wesley, 1994, pp. 157-170.
9. A. Varga, "The OMNeT++ discrete event simulation system," in Proceedings of the European Simulation Multiconference, 2001.
10. Myricom, Inc., "Myrinet GM 1.6.4 Performance," http://www.myri.com/scs/performance/Myrinet-2000/GM/gm-1.6.4-perf.html, April 2003.
11. K. Shemyak and K. Vehmanen, "Scalability of TCP servers, handling persistent connections," ICN '07. Sixth International Conference on Networking, 2007, pp. 89-89, 22-28 April 2007.
12. P. H. Carns, "Achieving scalability in parallel file systems," Ph.D. dissertation, Clemson University, Clemson, SC, May 2005.
13. F. Petrini, D. Kerbyson, and S. Pakin, "The case of the missing supercomputer performance: Achieving optimal performance on the 8,192 processors of ASCI Q," Supercomputing, 2003 ACM/IEEE Conference, pp. 55-55, 15-21 Nov. 2003.