Eliminating replica selection - Using multiple replicas to accelerate data transfer on grids

Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS

Volumn 10, Issue , 2004, Pages 359-366

  Feng, Jun ^a   Humphrey, Marty ^a  

^a University of Virginia   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA SET REPLICATION; DISTRIBUTED PARALLEL STORAGE SYSTEM (DPSS); REPLICA LOCATION SERVICE (RLS); STORAGE RESOURCE BROKER (SRB);

ALGORITHMS; DATA COMMUNICATION SYSTEMS; DATA STORAGE EQUIPMENT; HTTP; INFORMATION SERVICES; NETWORK PROTOCOLS; ROUTERS; TUNING; WIDE AREA NETWORKS;

DATA TRANSFER;

EID: 4544322650     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. European union datagrid project. In http://eu-datagrid.web.cern.ch/eu-datagrid/.
2. Myproxy online credential repository. In http://grid.ncsa.uiuc.edu/myproxy/.
3. National partnership for advanced computational infrastructure (npaci) grid. In http://npacigrid.npaci.edu/.
4. Replica optimization service. In http://edg-wp2.web.cern.ch/edg-wp2/optimization/ros.html.
5. SDSC SRB Project. In http://www.npaci.edu/DICE/SRB.
6. The Net100 Project. In http://www.net100.org.
7. B. Allcock, J. Bester, J. Bresnahan, A. L. Chervenak, I. Foster, C. Kesselman, S. Meder, V. Nefedova, D. Quesnel, and S. Tuecke. Secure, efficient data transport and replica management for high performance data-intensive computing. In IEEE Mass Storage Conference, 2001.
8. B. Allcock, J. Bester, J. Bresnahan, A. L. Chervenak, I. Foster, C. Kesselman, S. Meder, V. Nefedova, D. Quesnel, and S. Tuecke. Data management and transfer in high performance computational grid environments. In Parallel Computing Journal, Vol.28, May 2002.
9. W. Allock and R. Madduri. Lessons learned producing an ogsi compliant reliable file transfer service. In Global Grid Forum Workshop on Designing and Implementing Grid Services (held in conjunction with GGF9), October 2003.
10. A. Chervenak, E. Deelman, I. Foster, A. lamnitchi, C. Kesselman, P. Kunszt, M. Ripeanu, H. Stockinger, and K. Stockinger. Giggle: A framework for constructing scalable replica location services. In Proceedings of Supercomputing 2002(SC2002), November 2002.
11. B. Cohen. Incentives Build Robustness in BitTorrent. In http://bitconjurer.org/BitTorrent/bittorrentecon.pdf.
12. T. Dunigan, M. Mathis, and B. Tierney. A tcp tuning daemon. In Proceedings of Super Computing, 2002.
13. M. Fisk and W.-C. Feng. Dynamic right-sizing in tcp. In ICCCN, 2001.
14. I. Foster and C. Kesselman. Globus: A metacomputing infrastructure toolkit. In International Journal of Super Computer Applications, pages 115-128, 1997.
15. M. L. George Kola, Tevfik Kosar. Run-time adaptation of grid data-placement jobs. In Proceedings of Int. Workshop on Adaptive Grid Middleware (AGridM2003), November 2003.
16. T. J. Hacker, B. D. Athey, and B. Noble. The end-to-end performance effects of parallel tcp sockets on a lossy wide area network. In Proceedings of the 16th International Parallel and Distributed Processing Symposium, 2002.
17. J. H. Hartman and J. K. Ousterhout. The zebra striped network file system. In High Performance Mass Storage and Parallel I/O: Technologies and Applications, pages 309-329, New York, 2001. IEEE Computer Society Press and Wiley.
18. E. Jeannot and B. Knutssson. Adaptive online data compression. In Proceedings of the Eleventh IEEE International Symposium on High Performance Distributed Computing (HPDC), 379-388.
19. B. Knutsson and M. Björkman. Adaptive end-to-end compression for variable-bandwidth communication. In Computer Networks, pages 767-779, 1999.
20. E. Nallipogu, F. Özgüner, and M. Lauria. Improving the throughput of remote storage access through pipelining. In Proceedings of Grid Computing 2002.
21. R. Raman, M. Livny, and M. Solomon. Matchmaking: Distributed resource management for high throughput computing. In Proceedings of 7th IEEE Symp. on High Performance Distributed Computing, pages 104-111, 1998.
22. H. Sivakumar, S. Bailey, and R. L. Grossman. Psockets: The case for application-level network striping for data intensive applications using high speed wide area networks, November 2002.
23. S. Thulasidasan, W.-C. Feng, and M. Gardner. Optimizing gridftp through dynamic right-sizing. In Proceedings of the 12th IEEE High Performance Distributed Computing (HPDC-12), June 2003.
24. B. Tierney, J. Lee, and B. Crowley. A network-aware distributed storage cache for data intensive environments. In Proceedings of IEEE High Performance Distributed Computing Conference (HPDC-8), August 1999.
25. B. L. Tierney. Tcp tuning guide for distributed application on wide area networks. In http://www-dibc.lbl.gov/tcp-wan-perf.pdf.
26. S. Vazhkudai and J. Schopf. Using disk throughput data in predictions of end-to-end grid transfers. In Proceedings of the 3rd International Workshop on Grid Computing (GRID 2002), November 2002.
27. S. Vazhkudai and J. Schopf. Using regression techniques to predict large data transfers. In The International Journal of High Performance Computing Applications(IJHPCA), special issue on Grid Computing: Infrastructure and Applications, August 2003.
28. S. Vazhkudai, J. M. Schopf, and I. Foster. Predicting the performance of wide area data transfers. In Proceedings of the 16th International Parallel and Distributed Processing Symposium (IPDPS 2002), April 2002.
29. S. Vazhkudai and S. Tuecke. Replica selection in the globus data grid. In Proceedings of the First IEEE/ACM International Conference on Cluster Computing and the Grid(CCGrid2001), May 2001.
30. R. Wolski. Dynamically forecasting network performance using the network weather service. In Journal of Cluster Computing, January 1998.