File creation strategies in a distributed metadata file system

Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM

Volumn , Issue , 2007, Pages

  Devulapalli, Ananth ^a   Wyckoff, Pete ^b  

^a Ohio Supercomputer Center (Springfield)   (United States)

^b OHIO SUPERCOMPUTER CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; DISTRIBUTED COMPUTER SYSTEMS; SERVERS;

DISTRIBUTE LOAD; DISTRIBUTED FILE SYSTEM;

METADATA;

EID: 34548805408     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2007.370295     Document Type: Conference Paper

References (24)

1. P. Braam, M. Callahan, and P. Schwan. The InterMezzo filesystem. In O'Reilly Perl Conference 3.0, 1999.
2. P. H. Cams, W. B. Ligon III, R. B. Ross, and R. Thakur. PVFS: A parallel file system for Linux clusters. In Proceedings of the 4th Annual Linux Showcase and Conference, pages 317-327, 2000.
3. Cluster File Systems, Inc. Lustre: a scalable high-performance file system, Nov. 2002. http://www.lustre.org/docs/whitepaper.pdf.
4. G. Goodson, B. Welch, B. Halevy, D. Black, and A. Adamson. NFSv4 pNFS extensions. Technical Report draft-ietf-nfsv4-pnfs-00.txt, IETF, Oct. 2005.
5. G. Grider, L. Ward, G. Gibson, R. Ross, R. Haskin, and B. Welch. POSIX I/O extensions workshop, 2005.
6. IEEE Standard 1003.1. Portable Operating System Interface (POSIX). IEEE Computer Society, 1996.
7. J. J. Kistler and M. Satyanarayanan. Disconnected operation in the Coda file system. ACM Transactions on Computer Systems, 10(1):3-25, Feb. 1992.
8. R. Latham, N. Miller, R. Ross, and P. Carns. A next-generation parallel file system for Linux clusters. LinuxWorld, 2(1), Jan. 2004.
9. R. Latham, R. Ross, and R. Thakur. The impact of file systems on MPI-IO scalability. In Proceedings of EuroPVM/MPI, Budapest, Hungary, 2004.
10. D. E. Lenoski and W.-D. Weber. Scalable shared-memory multiprocessing. Morgan Kaufmann, San Francisco, 1995.
11. J. H. Morris, M. Satyanarayanan, M. H. Conner, J. H. Howard, D. S. Rosenthal, and F. D. Smith. Andrew: a distributed personal computing environment. Communications of the ACM, 29(3):184-201, 1986.
12. D. Nagle, D. Serenyi, and A. Matthews. The Panasas ActiveScale storage cluster - delivering scalable high bandwidth storage. In Proceedings of the ACM/IEEE SC2004 Conference (SC'04), Pittsburgh, PA, Nov. 2004.
13. B. Pawlowski, C. Juszczak, P. Staubach, C. Smith, D. Lebel, and D. Hitz. NFS version 3: Design and implementation. In USENIX Summer Techinical Conference, pages 137-152, 1994.
14. R. Recio, P. Culley, D. Garcia, J. Hilland, and B. Metzler. An RDMA protocol specification, http://www.ietf.org/internet-drafts/draft-ietf-rddp- rdmap-04.txt, Apr. 2005.
15. RedHat. Red Hat Global File System (GFS). http://www.redhat.com/en_us/ USA/home/solutions/gfs/.
16. D. Roselli, J. Lorch, and T. Anderson. A comparison of file system workloads. In Proceedings of the 2000 USENIX Annual Technical Conference, pages 41-54, June 2000.
17. M. Satyanarayanan, J. J. Kistler, P. Kumar, M. E. Okasaki, E. H. Siegel, and D. C. Steere. Coda: A highly available file system for a distributed workstation environment. IEEE Transactions on Computers, 39(4):447-459, 1990.
18. F. Schmuck and R. Haskin. GPFS: A shared-disk file system for large computing clusters. In First USENIX Conference on File and Storage Technologies (FAST'02), pages 231-244, Monterey, CA, Jan. 2002.
19. S. Shepler, B. Callaghan, D. Robinson, et al. Network file system (NFS) version 4 protocol. IETF RFC 3530, Apr. 2003.
20. E. Smirni, R. A. Aydt, A. A. Chien, and D. A. Reed. I/O requirements of scientific applications: an evolutionary view. In Proceedings of High-Performance Distributed Comptuing (HPDC96), pages 49-59, Washington, DC, Aug. 1996.
21. R. Thakur, W. Gropp, and E. Lusk. On implementing MPI-IO portably and with high performance. In Proceedings of the Sixth Workshop on I/O in Parallel and Distributed Systems (IOPADS'99), pages 23-32, Atlanta, GA, May 1999.
22. C. A. Thekkath, T. Mann, and E. K. Lee. Frangipani: a scalable distributed file system. In Proceedings of SOSP '97, pages 224-237, St. Malo, France, Dec. 1997.
23. TOP500.Org. Top 500 supercomputer sites. http://www.top500.org/stats, 2006.
24. S. A. Weil, K. T. Pollack, S. A. Brandt, and E. L. Miller. Dynamic metadata management for petabyte-scale file systems. In Proceedings of SC'04, Pittsburgh, PA, Nov. 2004.