Managing very-large distributed datasets

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5331 LNCS, Issue PART 1, 2008, Pages 775-792

  Branco, Miguel ^a   Zaluska, Ed ^a   De Roure, David ^a   Salgado, Pedro ^a   Garonne, Vincent ^a   Lassnig, Mario ^a   Rocha, Ricardo ^a  

^a NONE

Author keywords

Data Grids; Data Management; Datasets; Distributed Systems; Grid Computing

Indexed keywords

CLIENT SERVER COMPUTER SYSTEMS; COLLIDING BEAM ACCELERATORS; COMPUTER SOFTWARE; DIRECTION OF ARRIVAL; FAULT TOLERANCE; GRID COMPUTING; MANAGEMENT INFORMATION SYSTEMS; MIDDLEWARE; QUALITY ASSURANCE; RADIO DIRECTION FINDING SYSTEMS; RELIABILITY;

AGGREGATE THROUGHPUTS; COMPLEX MANAGEMENTS; COMPUTING SITES; DATA DISTRIBUTIONS; DATA GRIDS; DATA MANAGEMENT; DATA MANAGEMENTS; DATASETS; DISTRIBUTED FILE SYSTEMS; DISTRIBUTED SYSTEMS; INTERNAL ORGANIZATIONS; LARGE DATA SETS; LARGE HADRON COLLIDER; PEER-TO-PEER SYSTEMS; PETABYTES; RESEARCH CENTERS; SCALABILITY PROPERTIES; STORAGE SYSTEMS;

FAULT TOLERANT COMPUTER SYSTEMS;

EID: 58049131764     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-88871-0_54     Document Type: Conference Paper

References (25)

1. The ATLAS Collaboration (1999), http://atlasexperiment.org/
2. Chervenak, A., et al.: The Data Grid: Towards an architecture for the distributed management and analysis of large scientific datasets. J, Network and Comp. App. 23, 187-200 (2001)
3. Bell, W.H., et al.: Simulation of dynamic grid replication strategies in OptorSim. In: Parashar, M. (ed.) GRID 2002. LNGS, vol. 2536, pp. 46-57. Springer, Heidelberg (2002)
4. Risson, J., et al.: Survey of research towards robust peer-to-peer networks: search methods. Computer Networks 50(17) (2006)
5. Foster, 1., et al.: A security architecture for computational grids. In: CCS 1998: Proc. of the 5th ACM conference on Computer and communications security, pp. 83-92. ACM Press, NY (1998)
6. International Standard Generation and registration of Universally Unique Identifiers (UUIDs) and their use as ASN. 1 Object Identifier components (ITU-T Rec. X. 667 - ISO/TEC 9834-8)
7. Allcock, W., et al.: GridFTP protocol specification, Technical report, GGF GridFTP WG (2002)
8. Shoshani, A., et al.: Storage resource managers: Middleware components for grid storage. In: Proc. of Nineteenth IEEE Symposium on Mass Storage Systems (2002)
9. Howard, J.H., et al.: Scale and performance in a, distributed file system. ACM Trans. Comput. Syst. 6(1), 51-81 (1988)
10. Sandberg, R., et al.: Design and implementation of the Sun Network Filesystem. In: Proc. of the Summer 1985 USEN1X Conference, Portland, OR, USA, pp. 119-130 (1985)
11. Ghemawat, S., et al.: The Google File System. In: 19th ACM Symp. on Op. Sys. Princ, NY (2003)
12. Fielding, R.: Architectural Styles and the Design of Network-based Software Architectures, Ph.D. Thesis, University of California (2000)
13. Rocha, R., et al.: Monitoring the ATLAS Distributed Data Management System. In: Proc. of Computing in High Energy and Nuclear Physics (CHEP) (2007)
14. Cohen, E., et al.: Replication Strategies in Unstructured Peer-to-Peer Networks. In: Proc. of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications, USA (2002)
15. Satyanarayanan, M., et al.: Coda: a highly available file system for a distributed workstation environment. IEEE Trans. on Comp. 39(4) (1990)
16. Schmuck, F., et al.: GPFS: A Shared-Disk File System for Large Computing Clusters. In: Proc. of the 1st USEN1X Conference on File and Storage Technologies (2002)
17. Andrews, P., et al: Massive High-Performance Global File Systems for Grid Computing. In: IEEE Conference on High Perf. Net. and Comp. (2005)
18. Bester, J., et al.: GASS: a data movement and access service for wide area computing systems. In: Proc. of the 6th workshop on I/O in parallel and dist. systems (1999)
19. Lamehamedi, H., et al.: Data replication strategies in grid environments. In: Algorithms and Architectures for Parallel Processing (2002)
20. Samar, A., et al.: Grid Data Management Pilot (GDMP): A Tool for Wide Area Replication. In: 1ASTED International Conference on Applied Informatics (2001)
21. Schwan, P.: Lustre: Building a file system for 1000-node clusters. In: Proc. of the 2003 Linux Symposium (2003)
22. Chervenak, A., et al.: Giggle: a framework for constructing scalable replica location services. In: SC 2002, Baltimore, USA (2002)
23. Liv, Q., et al.: Search and Replication in Unstructured Peer-to-Peer Networks. In: Proc. of the 16th international conference on Supercomputing, NY, USA (2002)
24. Kunszt, P., et al.: Data storage, access and catalogs in gLite. Local to Global Data Interoperability - Challenges and Technologies, pp. 166-170 (2005)
25. Bam, C., et al.: The SDSC storage resource broker. In: Proc. of the 1998 conference of the Centre for Advanced Studies on Collaborative research, p. 5 (1998)