A peer-to-peer infrastructure for distributing large scientific data sets over wide area high-performance networks: Experimental studies using wide area layer 2 services

GridNets 2007 - Proceedings of the 1st International Conference on Networks for Grid Applications

Volumn , Issue , 2007, Pages

  Gu, Yunhong ^a   Grossman, Robert L ^a   Mambretti, Joe ^b  

^a UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Distributed data storage; High performance networks

Indexed keywords

DATA TRANSFER; DIGITAL STORAGE; DISTRIBUTED COMPUTER SYSTEMS; LARGE DATASET; PEER TO PEER NETWORKS;

COMMUNICATIONS SERVICES; DISTRIBUTED COMPUTING ENVIRONMENT; DISTRIBUTED DATA STORAGES; DISTRIBUTED ENVIRONMENTS; EXPERIMENTAL TESTBED; HIGH PERFORMANCE NETWORKS; INNOVATIVE TECHNIQUES; PEER-TO-PEER INFRASTRUCTURE;

WIDE AREA NETWORKS;

EID: 84897116514     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.4108/gridnets.2007.2166     Document Type: Conference Paper

References (15)

1. Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah A. Wallach, Mike Burrows, Tushar Chandra, Andrew Fikes, and Robert E. Gruber, Bigtable: A Distributed Storage System for Structured Data, OSDI'06: Seventh Symposium on Operating System Design and Implementation, Seattle, WA, November, 2006.
2. Condor. http://www.cs.wisc.edu/condor/, retrieved on Jan 19, 2007.
3. Jeffrey Dean and Sanjay Ghemawat, MapReduce: Simplified Data Processing on Large Clusters, OSDI'04: Sixth Symposium on Operating System Design and Implementation, San Francisco, CA, December, 2004.
4. Yunhong Gu and Robert Grossman, UDT: UDP-based data transfer for high-speed networks, Computer Networks (Elsevier). Volume 51, Issue 7. May 2007.
5. Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung, "The Google File System", pub. 19th ACM Symposium on Operating Systems Principles, Lake George, NY, October, 2003.
6. Globus Toolkit. http://www.globus.org/toolkit/, retrieved on Jan 19, 2007.
7. Global Ring Network for Advanced Applications Development, http://www.gloriad.org, retrieved in May 2007.
8. Franco Travostino, Joe Mambretti, Gigi Karmous-Edwards, eds, "Grid Networks: Enabling Grids with Advanced Communication Technology", Wiley, 2006
9. Micah Beck, Terry Moore, James S. Plank. An End-to-End Approach to Globally Scalable Network Storage, ACM SIGCOMM 2002, Pittsburgh, PA, USA, August, 2002.
10. Joe Mambretti, Tomonori Aoyama "Report of the Interagency Optical Networking Testbed Workshop 3", Networking and Information Technology Research and Development's Large Scale Network Coordinating Group, May 2007.
11. Kubiatowicz J, Bindel D, Chen Y, Czerwinski S, Eaton P, Geels D, Gummadi R, Rhea S, Weatherspoon H, Weimer W, Wells C, Zhao B. 2000. OceanStore: An architecture for global-scale persistent store. In: Proceedings of ASPLOS'2000; 2000; November; Cambridge, MA; Pages 190-201.
12. Rowstron A, Druschel P. 2001. Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility. In: Proceedings of ACM SOSP'01; 2001; October; Banff, Canada; Pages 188-201.
13. Transporting SDSS data using Sector and UDT, http://sdss.ncdm.uic.edu, retrieved in May 2007.
14. Stoica I, Morris R, Karger D, Kaashoek M. F, Balakrishnan H. 2001. Chord: A scalable peer-to-peer lookup service for Internet applications. In: Proceedings of ACM SIGCOMM'01; 2001; August; San Diego, CA; Pages 149-160.
15. Teraflow Network, http://www.teraflownetworktestbed.net, retrieved in May 2007.