Algorithms for high performance, wide-area distributed file downloads

Parallel Processing Letters

Volumn 13, Issue 2, 2003, Pages 207-223

  Plank, James S ^a   Atchley, Scott ^a   Ding, Ying ^a   Beck, Micah ^a  

^a University of Tennessee Knoxville   (United States)

Author keywords

Adaptive downloads; Peer to peer storage; Replicated storage; Scalable storage; Wide area storage

Indexed keywords

ALGORITHMS; BUFFER STORAGE; ENCODING (SYMBOLS); FILE ORGANIZATION; PERFORMANCE; REDUNDANCY;

ADAPTIVE DOWNLOADS; REPLICATED STORAGE; SCALABLE STORAGE; WIDE-AREA STORAGE;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 0141459059     PISSN: 01296264     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129626403001240     Document Type: Article

References (26)

1. B. Allcock, J. Bester, J. Bresnahan, A. L. Chervenak, I. Foster, C. Kesselman, S. Meder, V. Nefedova, D. Quesnal, and S. Tuecke. Data management and transfer in high performance computational grid environments. Parallel Computing Journal, 28(5):749-771, May 2002.
2. M. Allman, S. Dawkins, D. Glover, J. Griner, D. Tran, T. Henderson, J. Heidemann, J. Touch, H. Druse, S. Ostermann, K. Scott, and J. Semke. Ongoing TCP research related to satellites. IETF RFC 2760 (http://www.ietf.org/rfc/rfc2760.txt), February 2000.
3. J. W. Byers, M. Luby, and M. Mitzenmacher. Accessing multiple mirror sites in parallel: Using tornado codes to speed up downloads. In IEEE INFOCOM, pages 275-283, New York, NY, March 1999.
4. M. Beck, T. Moore, and J. S. Plank. Exposed vs. encapsulated approaches to grid service architecture. In 2nd International Workshop on Grid Computing, Denver, November 2001. http://www.gridcomputing.org.grid2001.
5. M. Beck, T. Moore, and J. S. Plank. An end-to-end approach to globally scalable network storage. In ACM SIGCOMM '02, Pittsburgh, August 2002.
6. I. Clarke, T. W. Hong, S. G. Miller, O. Sandberg, and B. Wiley. Protecting free expression online with Freenet. IEEE Internet Computing, 6(1):40-49, 2002.
7. L. Cottrell. Achieving high performance throughput in production networks. Presentation at the ESnet Site Coordinating Committee Meeting, Argonne National Labs, http://www.slac.stanford.edu/grp/scs/net/talk/thru-escc-oct01.html, October 2001.
8. I. Clarke, O. Sandberg, B. Wiley, and T. W. Hong. Freenet: A distributed anonymous information storage and retrieval system. In International Workshop on Design Issues in Anonymity and Unobservability, LNCS 2002, Berkeley, CA, July 2000. Springer.
9. F. Dabek, M. F. Kaashoek, D. Karger, R. Morris, and I. Stoica. Wide-area cooperative storage with CFS. In 18th ACM Symposium on Operating Systems Principles (SOSP '01), Banff, Canada, October 2001.
10. T. Dunigan, M. Mathis, and B. Tierney. A TCP tuning daemon. In SC02: High Performance Networking and Computing Conference, Baltimore, 2002.
11. L. Eggert, J. Heidemann, and J. Touch. Effects of Ensemble-TCP. ACM Computer Communication Review, 30(1):15-19, January 2000.
12. G. Ferrache. Documentation from the IN2P3 Computing Center, Lyon, France, August http://doc.in2p3.fr/bbftp/doc.2.2.1.html, August 2002.
13. S. Floyd. Congestion control principles. IETF RFC 2914 (http://www.ietf.org/rfc/rfc2914.txt), September 2000.
14. J. H. Hartman, I. Murdock, and T. Spalink. The Swarm scalable storage system. In 19th International Conference on Distributed Computing Systems (ICDCS), June 1999.
15. J. H. Hartman and J. K. Ousterhout. The zebra striped network file system. Operating Systems Review - 14th ACM Symposium on Operating System Principles, 27(5):29-43, December 1993.
16. M. Luby, M. Mitzenmacher, A. Shokrollahi, D. Spielman, and V. Stemann. Practical loss-resilient codes. In 29th Annual ACM Symposium on Theory of Computing, pages 150-159, 1997.
17. A. Muthitacharoen, R. Morris, T. M. Gil, and B. Chen. Ivy: A read/write peer-to-peer file system. In 5th Symposium on Operating Systems Design and Implementation (OSDI), 2002.
18. J. S. Plank, A. Bassi, M. Beck, T. Moore, D. M. Swany, and R Wolski. Managing data storage in the network. IEEE Internet Computing, 5(5):50-58, September/October 2001.
19. J. S. Plank. A tutorial on Reed-Solomon coding for fault-tolerance in RAID-like systems. Software - Practice & Experience, 27(9):995-1012, September 1997.
20. L. Rizzo. Effective erasure codes for reliable computer communication protocols. ACM SIGCOMM Computer Communication Review, 27(2):24-36, 1997.
21. D. P. Reed, J. H. Saltzer, and D. D. Clark. Comment on active networking and end-to-end arguments. IEEE Network, 12(3):69-71, 1998.
22. S. Rhea, C. Wells, P. Eaton, D. Geels, B. Zhao, H. Weatherspoon, and J. Kubiatowicz. Maintenance-free global data storage. IEEE Internet Computing, 5(5):40-49, 2001.
23. J. H. Saltzer, D. P. Reed, and D. D. Clark. End-to-end arguments in system design. ACM Transactions on Computer Systems, 2(4):277-288, November 1984.
24. J. Touch. Protocol parallelization. In G. Neufeld and M. Ito, editors, Protocols for High Speed Networks IV, pages 349-360. Chapman and Hall, London, 1995.
25. H. Weatherspoon and J. Kubiatowicz. Erasure coding vs. replication: A quantitative comparison. In First International Workshop on Peer-to-Peer Systems (IPTPS), March 2002.
26. R. Wolski, N. Spring, and J. Hayes. The Network Weather Service: A distributed resource performance forecasting service for metacomputing. Future Generation Computer Systems, 15(5-6):757-768, 1999.