Distributing the sloan digital sky survey using UDT and sector

e-Science 2006 - Second IEEE International Conference on e-Science and Grid Computing

Volumn , Issue , 2006, Pages

  Gu, Yunhong ^a   Grossman, Robert L ^a   Szalay, Alex ^b   Thakar, Ani ^b  

^a UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^b JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA STORAGE EQUIPMENT; DATA STRUCTURES; INFORMATION MANAGEMENT;

DIGITAL SKY SURVEYS; HIGH PERFORMANCE NETWORKS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 38449118156     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/E-SCIENCE.2006.261140     Document Type: Conference Paper

References (29)

1. Thomas E. Anderson, Michael D. Dahlin, Jeanna M. Neefe, David A. Patterson, Drew S. Roselli, and Randolph Y. Wang. Serverless network file systems. In Proceedings of the 15th Symposium on Operating Systems Principles, pages 109-126, Copper Mountain Resort, Colorado, December 1995. ACM.
2. Beck, M., Moore, T., and Plank, J.S. An end-to-end approach to globally scalable network storage. Proc. of ACM SIGCOMM '02, Pittsburgh, August 2002.
3. P. H. Cams, W. B. Ligon III, R. B. Ross, and R. Thakur, "PVFS: A Parallel File System For Linux Clusters", Proceedings of the 4th Annual Linux Showcase and Conference, Atlanta, GA, October 2000, pp. 317-327.
4. A. Chervenak, R. Schuler, C. Kesselman, S. Koranda, B. Moe, Wide Area Data Replication for Scientific Collaborations, Proceedings of 6th IEEE/ACM International Workshop on Grid Computing (Grid2005), November 2005.
5. A. Chervenak, I. Foster, C. Kesselman, C. Salisbury, and S. Tuecke, The Data Grid: Towards an architecture for the distributed management and analysis of large scientific datasets, Network Storage Symposium (NetStore '99), October 1999.
6. Corbett, P. F. and Feitelson, D. G. 1996. The Vesta parallel file system. ACM Transactions on Computer Systems 14, 3 (August), 225-264.
7. Frank Dabek, M. Frans Kaashoek, David Karger, Robert Morris, and Ion Stoica. Wide-area cooperative storage with CFS. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP '01).
8. I. Foster, C. Kesselman, G. Tsudik, S. Tuecke. A Security Architecture for Computational Grids. Proc. 5th ACM Conference on Computer and Communications Security Conference, pp. 83-92, 1998.
9. Robert Grossman, and Marco Mazzucco, DataSpace - A Web Infrastructure for the Exploratory Analysis and Mining of Data, IEEE Computing in Science and Engineering, July/August, 2002, pages 44-51.
10. Ian Foster and Robert L. Grossman, Data Integration in a Bandwidth Rich World, Communications ACM, Volume 46, Issue 11, November, 2003, pages 50-57.
11. Robert L. Grossman, Yunhong Gu, Xinwei Hong, Antony Antony, Johan Blom, Freek Dijkstra, and Cees de Laat, Teraflows over Gigabit WANs with UDT, Journal of Future Computer Systems, Elsevier Press, Volume 21, Number 4, 2005, pages 501-513.
12. Yunhong Gu, Xinwei Hong, and Robert Grossman, Experiences in Design and Implementation of a High Performance Transport Protocol, ACM/IEEE International Conference for High Performance Computing and Communications (SC '04), page 22.
13. Yunhong Gu and Robert Grossman, Supporting Configurable Congestion Control in Data Transport Services, ACM/IEEE International Conference for High Performance Computing and Communications (SC '05).
14. Yunhong Gu and Robert L. Grossman, The Design and Implementation of the Sector Peer-to-Peer Storage System, in preparation.
15. J. Howard, M. Kazar, S. Menees, D. Nichols, M. Satyanarayanan, R. Sidebotham, and M. West. Scale and Performance in a Distributed File System. ACM Transactions on Computer Systems, 6(1):51-81, February 1988.
16. Kazar, M. L., Leverett, B. W., Anderson, O. T., Apostolides, V., Bottos, B. A., Chutani, S., Everhart, C. F., Mason, W A., Tu, S. and Zayas, E. R., "DEcorum File System Architectural Overview", Proceedings of the Summer 1990 USENIX Conference, Anaheim, CA, June 11-15 1990, 151-164.
17. C. Kommareddy, N. Shankar, and B. Bhattacharjee. "Finding Close Friends on the Internet", IEEE ICNP, November 2001.
18. Kubiatowicz J, Bindel D, Chen Y, Czerwinski S, Eaton P, Geels D, Gummadi R, Rhea S, Weatherspoon H, Weimer W, Wells C, Zhao B. 2000. OceanStore: An architecture for globalscale persistent store. In: Proceedings of ASPLOS'2000; 2000; November; Cambridge, MA; Pages 190-201.
19. Particle Physics Data Grid, retrieved from www.ppdg.org on June 10, 2006.
20. Sylvia Ratnasamy, Paul Francis, Mark Handley, Richard Karp, and Scott Shenker. A scalable contentaddressable network. In Proc. ACM SIGCOMM 2001, August 2001.
21. P. Rodriguez, A. Kirpal, and E. W Biersack. Parallel-access for mirror sites in the Internet. In Proc. of IEEE Infocom 2000, volume 2, pages 864-873, Tel Aviv, Israel, Mar. 2000.
22. Rowstron A, Druschel P. 2001. Storage management and caching in PAST, a largescale, persistent peer-to-peer storage utility. In: Proceedings of ACM SOSP'01; 2001; October; Banff, Canada; Pages 188-201.
23. Rowstron A, Druschel P. 2001. Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems. In: Proceedings of IFIP/ACM Middleware; 2001; Heidelberg, Germany.
24. Adelman-McCarthy et al. 2006. The Fourth Data Release of the Sloan Digital Sky Survey, In: The Astrophysical Journal Supplement, vol. 162, issue 1, pp. 38-47.
25. StarLight, retrieved from www.startap.net on June 4, 2006.
26. Stoica I, Morris R, Karger D, Kaashoek M. F, Balakrishnan H. 2001. Chord: A scalable peer-to-peer lookup service for Internet applications. In: Proceedings of ACM SIGCOMM'01; August; San Diego, CA; Pages 149-160.
27. C. A. Thekkath, T. Mann, and E. K. Lee. Frangipani; A Scalable Distributed File System. In Proceedings of the 16th ACM Symposium on Operating Systems Principles, Oct. 1997.
28. UDP-Based Data Transport Protocol, retrieved from udt.sf.net on June 10, 2006.
29. Zhao B. Y., Kubiatowicz J. D., Joseph A. D. 2001. Tapestry: An infrastructure for fault-resilient wide-area location and routing. Technical Report UCB//CSD-01-1141, U.C. Berkely; 2001; April.