DPFS: A distributed parallel file system

Proceedings of the International Conference on Parallel Processing

Volumn 2001-January, Issue , 2001, Pages 533-541

  Shen, Xiaohui ^a   Choudhary, A ^a  

^a Northwestern University   (United States)

Author keywords

Computational modeling; Computer simulation; Distributed computing; Distributed power generation; Ear; File systems; Large scale systems; Multidimensional systems; Parallel processing; Spatial databases

Indexed keywords

COMPUTER SIMULATION; DIGITAL STORAGE; DISTRIBUTED DATABASE SYSTEMS; DISTRIBUTED POWER GENERATION; FILE ORGANIZATION; LARGE SCALE SYSTEMS; NETWORK MANAGEMENT; PARALLEL PROCESSING SYSTEMS; USER INTERFACES; VIRTUAL STORAGE;

COMPUTATIONAL MODEL; EAR; FILE SYSTEMS; MULTIDIMENSIONAL SYSTEMS; PARALLEL PROCESSING; SPATIAL DATABASE;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 77958121589     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2001.952101     Document Type: Conference Paper

References (25)

1. Coda file system. In http://www.coda.cs.cmu.edu.
2. T. Anderson, M. Dahlin, J. Neefe, D. Patterson, D. Roselli, and R. Wang. Serverless network file systems. In Proc. of the Fifteenth ACM Symposium on Operating Systems Principles, pages 109-126, 1995.
3. C. Baru, R. Frost, J. Lopez, R. Marciano, R. Moore, A. Rajasekar, and M. Wan. Meta-data design for a massive data analysis system. In Proc. CASCON'96 Conference, 1996.
4. C. Baru, R. Moore, A. Rajasekar, and M. Wan. The sdsc storage resource broker. In Proc. CASCON'98 Conference, Dec 1998, Toronto, Canada, 1998.
5. R. Bordawekar, S. Landherr, D. Capps, and M. Davis. Experimental evaluation of the hewlett-packard exemplar file system. In ACM SIGMETRICS Performance Evaluation Review, pages 25(3):21-28, 1997.
6. P. Carns, W. Ligon, R. Ross, and R. Thakur. Pvfs: A parallel file system for linux clusters. In Proc. of the 4th Annual Linux Showcase and Conference, Atlanta, October 2000, pages 317-327, 2000.
7. A. Choudhary, R. Bordawekar, M. Harry, R. Krishnaiyer, R. Ponnusamy, T. Singh, and R. Thakur. Passion: parallel and scalable software for input-output. In NPAC Technical Report SCCS-636, 1994.
8. A. Choudhary, M. Kandemir, H. Nagesh, J. No, X. Shen, V. Taylor, S. More, and R. Thakur. Data management for large-scale scientific computations in high-performance distributed systems. In Proc. of the 8th IEEE International Symposium on High Performance Distributed Computing, Redondo Beach, California, 1999.
9. P. Corbett and D. Feitelson. The vesta parallel file system. ACM Transactions on Computer Systems, 14(3):225-264, August 1996.
10. P. Corbett, D. Feitelson, J.-P. Prost, G. Almasi, S. J. Baylor, A. Bolmarcich, Y. Hsu, J. Satran, M. Snir, R. Colao, B. Herr, J. Kavaky, T. Morgan, and A. Zlotek. Parallel file systems for the ibm sp computers. IBM Systems Journal, 34(2):222-248, Janury 1995.
11. W. Hoschek, J. Jaen-Martinez, A. Samar, H. Stockinger, and K. Stockinger. Data management in an international data grid project.
12. D. Kotz. Multiprocessor file system interfaces. In Proc. the Second International Conference on Parallel and Distributed Information Systems, pages 194-201, 1993.
13. W. Liao, X. Shen, and A. Choudhary. Meta-data management system for high-performance large-scale scientific data access. In Proceedings of the 7th International Conference on High Performance Computing, December, 2000.
14. Mcat. In http://www.npaci.edu/DICE/SRB/mcat.html.
15. N. Nieuwejaar and D. Kotz. The galley parallel file system. In Proceedings of the 10th ACM International Conference on Supercomputing, Philadelphia, PA, May 1996, pages 374-381, 1996.
16. B. Rullman. Paragon parallel file system. In External Product Specification, Intel Supercomputer Systems Division.
17. K. Seamons, Y. Chen, P. Jones, J. Jozwiak, and M. Winslett. Server-directed collective i/o in panda. In Proceedings of Supercomputing '95, San Diego, CA, December, 1995.
18. X. Shen, W. Liao, A. Choudhary, G. Memik, M. Kandemir, S. More, G. Thiruvathukal, and A. Singh. A novel application development environment for large-scale scientific computations. In International Conference on Supercomputing, May 8-11, 2000, Santa Fe, New Mexico, 2000.
19. H. Stern. Managing NFS and NIS. O'Reilly and Associates, 1991.
20. W. Stevens. UNIX Network Programming, Networking APIs: Sockets and XTI, Volume 1, Second Edition. Prentice Hall PTR, Prentice-Hall, Inc., Upper Saddle River, NJ 07458, 1998.
21. M. Stonebraker and L. A. Rowe. The design of postgres. In Proc. the ACM SIGMOD 86 International Conference on Management of Data, pages 340-355, 1986.
22. R. Thakur, R. Bordawekar, A. Choudhary, R. Ponnusamy, and T. Singh. Passion runtime library for parallel i/o. In Proc. of the Intel Supercomputer User's Group Conference, 1995.
23. R. Thakur, W. Gropp, and E. Lusk. A case for using mpi's derived datatypes to improve i/o performance. In Proc. of SC'98: High Performance Networking and Computing, 1998.
24. R. Thakur, W. Gropp, and E. Lusk. On implementing MPI-IO portably and with high performance. Preprint ANL/MCS-P732-1098, Mathematics and Computer Science Division, Argonne National Laboratory, 1998.
25. R. Thakur, W. Gropp, and E. Lusk. Data sieving and collective i/o in romio. In Proc. the 7th Symposium on the Frontiers of Massively Parallel Computation, 1999.