Data placement in widely distributed environments

Advances in Parallel Computing

Volumn 14, Issue C, 2005, Pages 105-128

  Kosar, T ^a   Son, S ^a   Kola, G ^a   Livny, M ^a  

^a University of Wisconsin Madison   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77957157561     PISSN: 09275452     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0927-5452(05)80008-5     Document Type: Article

References (37)

1. CMS, The Compact Muon Solenoid Project. http://cmsinfo.cern.ch/
2. PPDG, PPDG Deliverables to CMS
3. http://www.ppdg.net/archives/ppdg/2001/doc00017.doc
4. Feng W. High Performance Transport Protocols (2003), Los Alamos National Laboratory
5. Maddurri R., Allcock B., and Reliable File Transfer Service (2003). http://www.unix.mcs.anl.gov/madduri/main.html
6. Koranda S., and Moe B. Lightweight Data Replicator. http://www.lscgroup.phys.uwm.edu/lscdatagrid/LDR/overview.html 2003
7. Foster I., and Kesselmann C. Globus: A Toolkit-Based Grid Architecture. The Grid: Blueprints for a New Computing Infrastructure (1999), Morgan Kaufmann 259-278
8. Allcock B., Bester J., Bresnahan J., Chervenak A., Foster I., Kesselman C., Meder S., Nefedova V., Quesnel D., and ke S.T. Secure, efficient data transport and replica management for high-pe rformance data-intensive computing. IEEE Mass Storage Confererence, San Diego, CA (2001)
9. Shishani A., Sim A., and Gu J. Storage Resource Managers: Middleware Components for Grid storage. Nineteenth IEEE Symposium on Mass Storage Systems (2002)
10. SDSC, High Performance Storage System. http://www.sdsc.edu/hpss/
11. Bird I., Hess B., and Kowalski A. Building the mass storage system at Jefferson Lab. Proceedings of 18th IEEE Symposium on Mass Storage Systems. San Diego, California (2001)
12. FNAL. Enstore mass storage system. http://www.fnal.gov/docs/products/enstore/
13. Baru C., Moore R., Rajasekar A., and Wan M. The SDSC Storage Resource Broker. Proceedings of CASCON. Toronto, Canada (1998)
14. Thain D., and Livny M. The ethernet approach to grid computing. Proceedings of the Twelfth IEEE Symposium on High Performance Distributed Computing. Seattle, Washington (2003)
15. Morita Y., Sato H., Watase Y., Tatebe O., Sekiguchi S., Matsuoka S., Soda N., and Dell'Acqua A. Building a high performance parallel file system using grid datafarm and root i/o. Proceedings of the 2003 Computing in High Energy and Nuclear Physics (CHEP03). La Jolla, CA (2003)
16. Kubiatowicz J., Bindel D., Chen Y., Czerwinski S., Eaton P., Geels D., Gummadi R., Rhea S., Weatherspoon H., Weimer W., Wells C., and Zhao B. Oceanstore: An architecture for global-scale persistent storage. Proceedings of the Ninth international Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2000) (2000)
17. Bent J., Thain D., and Arpaci-Dusseau A. R. Arpaci-Dusseau, Explicit control in a batchaware distributed file system. Proceedings of the First USENIX/ACM Conference on Networked Systems Design and Implementation (2004)
18. Kosar T., and Livny M. Stork: Making Data Placement a First Class Citizen in the Grid. Proceedings of the 24th Int. Conference on Distributed Computing Systems. Tokyo, Japan (2004)
19. 18. T. Kosar, M. Livny, A framework for reliable and efficient data placement in distributed computing system s, Journal of Parallel and Distributed Computing.
20. 19. E. Deelman, J. Blythe, Y. Gil, C. Kesselman, Pegasus: Planning for execution in grids, in: GriPhyN technical report, 2002.
21. Foster I., Vockler J., Wilde M., and Zhao Y. Climera: A virtual data system for representing, querying, and automating data derivation. 14th International Conference on Scientific and Statistical Database Management (SSDBM 2002). Edinburgh, Scotland (2002)
22. Thain D., Tannenbaum T., and Livny M. Condor and the Grid. Grid Computing: Marking the Global Infrastructure a Reality., Fran Berman and Geoffrey Fox and Tony Hey, (2002), John Wiley and Sons Inc.
23. Chervenak L., Palavalli N., Bharathi S., Kesselman C., and Schwartzhopf R. Performance and scalability of a Replica Location Service. Proceedings of the International Symposium on High Performance Distributed Computing Conference (HPDC-13). Honolulu, Hawaii (2004)
24. 23. C. Dovrolis, P. Ramanathan, D. Moore, What do packet dispersion techniques measure?, in: INFOCOMM, 2001.
25. NLANR/DAST. Iperf: The TCP/UDP bandwidth measurement tool. http://dast.nlanr.net/Projects/Iperf/(2003).
26. Litzkow M.J., Livny M., and Mutka M.W. Condor-A Hunter of Idle Workstations. Proceedings of the 8th International Conference of Distributed Computing Systems (1988) 104-111
27. Frey J., Tannenbaum T., Foster I., and Tuecke S. Condor-G: A Computation Management Agent for Multi-Institutional Grids. Proceedings of the Tenth IEEE Symposium on High Performance Distributed Computing. San Francisco, California (2001)
28. Postel J. FTP: File Transfer Protocol Specification, RFC-765 (1980)
29. Allcock W., Foster I., and Madduri R. Reliable data transport: A critical sercice of the grid. Bulding Service Based Grids Workshop. Global Grid Forum 11 (2004)
30. Kola G., and Livny M. Diskrouter: A flexible infranstructure for high performance large scale data transfers. Tech. Rep. CS-TR-2003-1484 (2003), University of Wisconsin
31. Butler M., Pennington R., and Terstriep J.A. Mass Storage at NCSA: SGI DMF and HP UniTree. Proceedings of 40th Cray User Group Conference (1998)
32. Condor. NeST: Network Storage. http://www.cs.wics.edu/condor/nest(2003)
33. Raman R., Livny M., and Solomon M. Matchmaking: Distributed resource management for high throughput computing. Proceedings of the Seventh IEEE International Symposium on High Performance Distributed Computing (HPDC7). Chicago, Illinois (1998)
34. Thain D., Basney J., Son S., and Livny M. The kangaroo approach to data movement on the grid. Proceedings of the Tenth IEEE Symposium on High Performance Distributed Computing. San Francisco, California (2001)
35. 34. G. Kola, T. Kosar, M. Livny, Run-time adaptation of grid data-placement jobs, Parallel and Distributed Compting Practices
36. Son S., and Livny M. Recovering internet symmetry in distributed computing. Proceeding of the 3rd International Symposium on Cluster Conmputing and the Grid. Tokyo, Japan (2003)
37. Son S., Allcock B., and Livny M. Codo: Firewall traversal by cooperative on-demand pening. Proceedings of the Fourteenth IEEE Symposium on High Performance Distributed Computing. Research Triangle Park, NC (2005)