The Galley parallel file system

Parallel Computing

Volumn 23, Issue 4-5, 1997, Pages 447-476

  Nieuwejaar, Nils ^a   Kotz, David ^a  

^a Dartmouth Department of Computer Science_Dartmouth College   (United States)

Author keywords

IBM SP 2; Multiprocessor file system; Parallel I O; Performance evaluation; Scientific computing

Indexed keywords

BANDWIDTH; DATA STRUCTURES; DATA TRANSFER; INPUT OUTPUT PROGRAMS; INTERFACES (COMPUTER); MAGNETIC DISK STORAGE; NATURAL SCIENCES COMPUTING; OPTIMIZATION; PARALLEL PROCESSING SYSTEMS;

GALLEY PARALLEL FILE SYSTEMS;

DISTRIBUTED DATABASE SYSTEMS;

EID: 0031167104     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/s0167-8191(97)00009-4     Document Type: Article

References (32)

1. J.W. Arendt, Parallel genome sequence comparison using a concurrent file system, Technical Report UIUCDCS-R-91-1674, University of Illinois at Urbana-Champaign, 1991.
2. S. Johnson Baylor, C.B. Benveniste, Y. Hsu, Performance evaluation of a parallel I/O architecture, in: Proceedings of the 9th ACM International Conference on Supercomputing, Barcelona, July 1995, pp. 404-413.
3. M.L. Best, A. Greenberg, C. Stanfill, L.W. Tucker, CMMD I/O: A parallel Unix I/O, in: Proceedings of the Seventh International Parallel Processing Symposium, 1993, pp. 489-495.
4. P.F. Corbett, D.G. Feitelson, Design and implementation of the Vesta parallel file system, in: Proceedings of the Scalable High-Performance Computing Conference, 1994, pp. 63-70.
5. P.F. Corbett, D.G. Feitelson, J.-P. Prost, G.S. Almasi, S. Johnson Baylor, A.S. Bolmarcich, Y. Hsu, J. Satran, M. Snir, R. Colao, B. Herr, J. Kavaky, T.R. Morgan, A. Zlotek, Parallel file systems for the IBM SP computers, IBM Syst. J. 34 (2) (1995) 222-248.
6. T.H. Cormen, A. Colvin, ViC * : A preprocessor for virtual-memory C *, Technical Report PCS-TR94-243, Dept. of Computer Science, Dartmouth College, November 1994.
7. T.H. Cormen, M. Hirschl, Early experiences in evaluating the Parallel Disk Model with the ViC * implementation, Technical Report PCS-TR96-293, Dartmouth College Department of Computer Science, August 1996, to appear in Parallel Computing.
8. T.H. Cormen, D. Kotz, Integrating theory and practice in parallel file systems, in: Proceedings of the 1993 DAGS/PC Symposium, Hanover, NH, June 1993, pages 64-74, Dartmouth Institute for Advanced Graduate Studies, Revised as Dartmouth PCS-TR93-188 on 9/20/94.
9. Hewlett Packard, HP97556/58/60 5.25-inch SCSI Disk Drives Technical Reference Manual, 2nd ed.,June 1991, HP Part number 5960-0115.
10. J. Huber, C.L. Elford, D.A. Reed, A.A. Chien, D.S. Blumenthal, PPFS: A high performance portable parallel file system, in: Proceedings of the 9th ACM International Conference on Supercomputing, Barcelona, July 1995, pp. 385-394.
11. IBM, AIX Version 3.2 General Programming Concepts, 12th ed., October 1994.
12. D. Kotz, N. Nieuwejaar, Dynamic file-access characteristics of a production parallel scientific workload, in: Proceedings of Supercomputing '94, November 1994, pp. 640-649.
13. D. Kotz, S. Bac Toh, S. Radhakrishnan, A detailed simulation model of the HP 97560 disk drive, Technical Report PCS-TR94-220, Dept. of Computer Science, Dartmouth College, July 1994.
14. T.T. Kwan, D.A. Reed, Performance of the CM-5 scalable file system, in: Proceedings of the 8th ACM International Conference on Supercomputing, July 1994, pp. 156-165.
15. S.J. LoVerso, M. Isman, A. Nanopoulos, W. Nesheim, E.D. Milne, R. Wheeler, sfs: A parallel file system for the CM-5, in: Proceedings of the 1993 Summer USENIX Conference, 1993, pp. 291-305.
16. E.L. Miller, R.H. Katz, Input/output behavior of supercomputer applications, in: Proceedings of Supercomputing '91, November 1991, pp. 567-576.
17. J.A. Moore, P. Hatcher, M.J. Quinn, Efficient data-parallel files via automatic mode detection, in: Fourth Workshop on Input/Output in Parallel and Distributed Systems, Philadelphia, May 1996, pp. 1-14.
18. N. Nieuwejaar, D. Kotz, Low-level interfaces for high-level parallel I/O, in: R. Jain, J. Werth, J.C. Browne (Eds.), Input/Output in Parallel and Distributed Computer Systems, Kluwer Academic Publishers, 1996, ch. 9, pp. 205-223.
19. N. Nieuwejaar, D. Kotz, Performance of the Galley parallel file system, in: Fourth Workshop on Input/Output in Parallel and Distributed Systems, pp. 83-94, May 1996.
20. N. Nieuwejaar, D. Kotz, A. Purakayastha, C. Schlatter Ellis, M. Best, File-access characteristics of parallel scientific workloads, IEEE Transactions on Parallel and Distributed Systems, 1996, to appear.
21. N.A. Nieuwejaar, Galley: A New Parallel File System For Scientic Applications, Ph.D. thesis, Dartmouth College, 1996.
22. B. Nitzberg, Performance of the iPSC/860 Concurrent File System, Technical Report RND-92-020, NAS Systems Division, NASA Ames, December 1992.
23. P. Pierce, A concurrent file system for a highly parallel mass storage system, in: Fourth Conference on Hypercube Concurrent Computers and Applications, 1989, pp. 155-160.
24. T.W. Pratt, J.C. French, P.M. Dickens, S.A. Janet, Jr., A comparison of the architecture and performance of two parallel file systems, in: Fourth Conference on Hypercube Concurrent Computers and Applications, 1989, pp. 161-166.
25. A. Purakayastha, C. Schlatter Ellis, D. Kotz, N. Nieuwejaar, M. Best, Characterizing parallel file-access patterns on a large-scale multiprocessor, in: Proceedings of the 9th International Parallel Processing Symposium, April 1995, pp. 165-172.
26. C. Ruemmler, J. Wilkes, An introduction to disk drive modeling, IEEE Comput. 27 (3) (1994) 17-28.
27. K.E. Seamons, Y. Chen, P. Jones, J. Jozwiak, M. Winslett, Server-directed collective I/O in Panda, in: Proceedings of Supercomputing '95, December 1995.
28. K.E. Seamons, M. Winslett, A data management approach for handling large compressed arrays in high performance computing, in: Proceedings of the Seventh Symposium on the Frontiers of Massively Parallel Computation, February 1995, pp. 119-128.
29. M. Seltzer, P. Chen, J. Ousterhout, Disk scheduling revisited, in: Proceedings of the 1990 Winter USENIX Conference, 1990, pp. 313-324.
30. J.T. Thomas, The Panda array I/O library on the Galley parallel file system, Technical Report PCS-TR96-288, Dept. of Computer Science, Dartmouth College, June 1996, Senior Honors Thesis.
31. S. Toledo, F.G. Gustavson, The design and implementation of SOLAR, a portable library for scalable out-of-core linear algebra computations, in: Fourth Workshop on Input/Output in Parallel and Distributed Systems, Philadelphia, May 1996, pp. 28-40.
32. S.R. Wheat, A.B. Maccabe, R. Riesen, D.W. van Dresser, T. Mack Stallcup, PUMA: An operating system for massively parallel systems, in: Proceedings of the Twenty-Seventh Annual Hawaii International Conference on System Sciences, 1994, pp. 56-65.