A global and parallel file system for grids

Future Generation Computer Systems

Volumn 23, Issue 1, 2007, Pages 116-122

  García Carballeira, Félix ^a   Carretero, Jesús ^a   Calderón, Alejandro ^a   García, J Daniel ^a   Sanchez, Luis M ^a  

^a UNIVERSIDAD CARLOS III DE MADRID   (Spain)

Author keywords

Data declustering; Data grids; GridFTP; High performance I O; Parallel I O; RNS

Indexed keywords

ADMINISTRATIVE DATA PROCESSING; DATA STORAGE EQUIPMENT; DATABASE SYSTEMS; FILE EDITORS; INPUT OUTPUT PROGRAMS; PARALLEL PROCESSING SYSTEMS;

DATA GRIDS; DATA MANAGEMENT; GRID FILE SYSTEM; GRID FORUM;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 33748440737     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2006.06.004     Document Type: Article

References (24)

1. B. Allock, J. Bester, J. Bresnahn, A. Chervenak, I. Foster, C. Keseelman, S. Meder, V. Nefedova, D. Quesnel, S. Tuecke, Secure, efficient data transport and replica management for high performance data-intensive computing, in: Proceedings of the Eighteenth IEEE Symposium on Mass Storage Systems and Technologies-volume 00, April 17-20, 2001, pp. 13-28
2. Bell H., Cameron D.G., Capozza L., Millar A.P., Stockinger K., and Zini F. OptorSim - A Grid simulator for studying dynamic data replication strategies. International Journal of High Performance Computing Applications 17 4 (2003)
3. A. Calderon, F. Garcia, J. Carretero, J.M. Perez, J. Fernandez, An implementation of MPI-IO on Expand: A parallel file system based on NFS servers, in: 9th PVM/MPI European Users Group, Johannes Kepler University Linz, Austria, September 29-October 2, 2002, pp. 306-313
4. P.H. Carns, W.B. Ligon III, R.B. Ross, R. Takhur, PVFS: A parallel file system for linux clusters, Tech. Rep. ANL/MCS-P804-0400, 2000
5. Carretero J., Perez F., de Miguel P., Garcia F., and Alonso L. Performance increase mechanisms for parallel and distributed file systems. Parallel Computing: Special Issue on Parallel I /O Systems no. 3 (1997), Elsevier 525-542
6. Corbett P., Johnson S., and Feitelson D. Overview of the Vesta parallel file system. ACM Computer Architecture News 21 5 (1993) 7-15
7. FLASH I /O benchmark routine - Parallel HDF 5. http://flash.uchicago.edu/~zingale/flash_benchmark_io/
8. In: Foster I., and Kesselman C. (Eds). The Grid: Blueprint for a New Computing Infrastructure (1999), Morgan Kaufmann
9. S. Ghemawat, H. Gobioff, S. Leung, The Google file system, in: Proceedings of the 19th ACM Symposium on Operating Systems Principle, 2003
10. The Globus Toolkit. http://www.globus.org
11. Global Grid Forum, The GGF file system architecture workbook, http://www.globalgridfoum.net, 2002
12. Garcia F., Calderon A., Carretero J., Perez J.M., and Fernandez J. The design of the Expand parallel file system. International Journal of High Performance Computing Applications 17 1 (2003) 21-37
13. Cluster File Systems, Inc. Lustre: A scalable, high-performance file system. http://www.lustre.org
14. N. Nieuwejaar, D. Kotz, The Galley parallel file system, in: Proceedings of the 10th ACM International Conference on Supercomputing, May 1996
15. Olfield R., and Kotz D. Armada: A parallel file system for computational Grids. International symposium on cluster computing and the grid. Brisbane, Australia, May 2001 (2001), IEEE Computer Society Press 194-201
16. Perez M.S., Carretero J., Garcia F., Peña J.M., and Robles V. MAPFS: A flexible multiagent parallel file systems for clusters. Future Generation Computer Systems 22 (2006) 620-632
17. K. Ranganathan, I. Foster, Identifying dynamic replication strategies for high performance data grids, in: Proceedings of International Workshop on Grid Computing, Denver, November 2002, pp. 75-86
18. Pereira M., Tatebe O., Luan L., Anderson T., and Xu J. Resource Namespace Service specification, November (2005). http://www.global.http://www.globalgridforum.net
19. Tosun A.S., and Ferhatosmanoglu H. Optimal parallel I /O using replication. Proceedings of International Workshop on Parallel Processing, ICPP (2002), Vancouver, Canada 506-513
20. F. Schmuck, R. Haskin, GPFS: A shared-disk file system for large computing clusters, in: Proceedings of the Conference on File and Storage Technologies, FAST'02, 28-30 January 2002, Monterey, CA, pp. 231-244
21. W. Gropp, R. Takhur, E. Lusk, An abstract-device interface for implementing portable parallel-I /O interfaces, In: Proceedings of the 6th Symposium on the Frontiers of Massively Parallel Computation, October 1996, pp. 180-187
22. Tang M., Lee B.-S., Tang X., and Ueo C. The impact of data replication on job scheduling performance in the Data Grid. Future Generation Computer Systems 22 (2006) 254-268
23. O. Tatebe, Worldwide fast file replication on Grid datafarm, in: Proceedings of the 2003 Computing in High Energy and Nuclear Physics, CHEP03, March 2003
24. O. Tatebe, N. Soda, Y. Morita, S. Matsuoka, S. Sekiguchi, Gfarm v2: A Grid file system that supports high-performance distributed and parallel data computing, in: Proceedings of the 2004 Computing in High Energy and Nuclear Physics, CHEP04, Switzerland, September 2004