A distributed file system for a wide-area high performance computing infrastructure

3rd USENIX Workshop on Real, Large Distributed Systems, WORLDS 2006

Volumn , Issue , 2006, Pages

  Walker, Edward ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DISTRIBUTED DATABASE SYSTEMS; FILE ORGANIZATION; WIDE AREA NETWORKS;

COMPUTATIONAL SCIENCE; COMPUTER NODES; DESIGN GOAL; DISCONNECTED OPERATIONS; DISTRIBUTED FILE SYSTEMS; FILE SYSTEMS; HIGH PERFORMANCE COMPUTING; TRANSPARENT ACCESS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 70349135977     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. NSF TeraGrid, http://www.teragrid.org
2. NSF Cyberinfrastructure User Survey 2005, http://www.cipartnership.org/survey/report2005.html
3. P. Andrews, P. Kovatch and C. Jordan, “Massive High-Performance Global File Systems for Grid Computing”, in Proc of the ACM/IEEE Conference on High Performance Networking and Computing (SC05), November 12-18, Seattle, WA, USA, 2005.
4. OpenAFS, http://www.openafs.org
5. B. Pawlowski, S. Shepler, C. Beame, B. Callagham, M. Eisler, D. Noveck, D. Robinson, and R. Thurlow, “The NFS Version 4 Protocol”, in Proc. of the 2nd Intl. System Admin. And Networking Conference (SANE2000), 2000
6. F. Schmuck, and R. Haskin, “GPFS: A Shared-Disk File System for Large Computing Clusters”, in Proc. of the 1st USENIX Conference on File and Storage Technologies, Monterey, CA, 2002
7. IBM Research, General Parallel File System (GPFS), http://www.almaden.ibm.com/StorageSystems/file_systems/GPFS/
8. P. Schwan, “Lustre: Building a File System for 1,000-node Clusters”, in Proc. of Ottawa Linux Symposium, 2003.
9. IBRIX, http://www.ibrix.com
10. National LambdaRail, http://www.nlr.net
11. Abilene, http://abilene.internet2.edu
12. NLR Weather Map, http://weathermap.grnoc.iu.edu/nlrmaps/layer3.html
13. Plan 9 from Bell Labs. http://cm.bell-labs.com/plan9/
14. J. H. Howard, M. L. Kazar, S. G. Menees, D. A. Nichols, M. Satyanarayanan, R. N. Sidebotham, and M. J. West, “Scale and Performance in a Distributed File System”, ACM Trans. on Computer Systems, 6(1), Feb 1988, pp. 51-81.
15. M. L. Kazar, et. al., “Decorum File System Architectural Overview”, in Proc. of the 1990 USENIX Technical Conf., CA, June 1990, pp. 151-164.
16. M. Satyanarayanan, “Coda: A Highly Available File System for Distributed Workstation Environment”, IEEE Trans. on Computers, 39(4), 1990, pp. 447-459.
17. M. N. Nelson, et. al., “Caching in the Sprite Network File System”, ACM Trans. on Computer Systems, 6(1), Feb 1988, pp. 134-154.
18. T. Anderson, M. Dahlin, J. Neefe, D. Patterson, D. Roselli, and R. Wang, “Serverless Network File Systems”, ACM Trans. on Computer Systems, 14(1), Feb. 1996, pp. 41-79.
19. M. G. Baker, J. H. Hartman, M. D. Kupfer, K. W. Shirrif, and J. K. Ousterhout, “Measurements of a Distributed File System”, in Proc. of the 13th ACM Symp. on Operating Systems Principles, 1991.
20. J. Ousterhout, H. Da Costa, D. Harrison, J. Kunze, M. Kupfer, and J. Thomson, “A Trace-Driven Analysis of the 4.2BSD File System”, in Proc. of the 10th ACM Symp. on Operating System Principles, 1985.
21. M. Spasojevic, and M. Satyanarayanan, “An Empirical Study of a Wide-Area Distributed File System”, ACM Trans. on Computer Systems, 14(2), 1996, pp. 200-222.
22. H. C. Rao and L. L. Peterson, “Accessing Files in an Internet: The Jade File System”, IEEE Trans. on Software Engineering, 19.(6), June 1993
23. F. Wang, Q. Xin, B. Hong, S. A. Brandt, E. L. Miller, D. D. E. Long, and T. T. McLarty, “File System Workload Analysis for Large Scale Scientific Computing Applications”, in Proc. 21st IEEE Conf. on Mass Storage Systems and Technologies, MD, 2004, pp. 129-152.
24. TeraGrid Director Presentation (slide 27): http://www.tacc.utexas.edu/~ewalker/director.ppt
25. A. Adamson, D. Hildebrand, P. Honeyman, S. McKee, and J. Zhang, “Extending NFSv4 for Petascale Data Management”, in Proc. of Workshop on Next-Generation Distributed Data Management, Paris, June 2006.
26. J. J. Kistler, and M. Satyanarayanan, “Disconnected Operation in the Coda File System”, ACM Trans. On Computer Systems, 10(1), 1992.
27. G. J. Popek and B. J. Walker, eds., The LOCUS Distributed System Architecture, MIT Press, Cambridge MA, 1985.
28. D. K. Gifford, R. M. Needham, and M. D. Schroeder, “The Cedar File System”, Comm. of the ACM, 31(3), 1988, pp. 288-298.
29. IOzone filesystem benchmark, http://www.iozone.org
30. M. Satyanarayanan, “Scalable, Secure and Highly Available File Access in a Distributed Workstation Environment”, IEEE Computer, 23(5), May 1990, pp. 9-22.
31. D. Mazieres, “A Toolkit for User-Level File Systems”, in Proc. of the 2001 USENIX Technical conf., Boston, MA, June 2001.
32. M. Kaminsky, E. Peterson, D. B. Giffin, K. Fu, D. Mazieres, and F. Kaashoek, “Rex: Secure, Extensible Remote Execution”, in Proc. of 2004 USENIX Technical Conf., 2004.
33. S. Annapureddy, M. J. Freedman, D. Mazieres, “Shark: Scaling File Servers via Cooperative Caching”, in Proc. of 2nd USENIX/ACM Symp. on Networked System Design and Implementation, 2005.
34. G. Hunt and D. Brubacher, “Detours: Binary Interception of Win32 Functions”, in Proc. of the 3rd USENIX Windows NT Symposium, Seattle, WA 1999, pp. 135-143.
35. M. Szeredi, FUSE, http://sourceforge.net/projects/fuse