An overview of the Open Science Data Cloud

HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

Volumn , Issue , 2010, Pages 377-384

  Grossman, Robert L ^a,b   Gu, Yunhong ^a   Mambretti, Joe ^c   Sabala, Michal ^a   Szalay, Alex ^d   White, Kevin ^b  

^a UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

^c NORTHWESTERN UNIVERSITY   (United States)

^d JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

Cloud computing; Data clouds; Management and analysis of scientific data

Indexed keywords

CLOUD COMPUTING; CURRENT STATUS; DATA CLOUDS; DATA SETS; ITS ARCHITECTURE; OPEN SCIENCE; RESEARCH AREAS;

CLOUDS; COMPUTER SYSTEMS;

DATA HANDLING;

EID: 78649986661     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1851476.1851533     Document Type: Conference Paper

References (33)

1. Amazon. Amazon Elastic Compute Cloud (amazon ec2). aws.amazon.com/ec2, 2008.
2. Amazon. Amazon Web Services Developer Connection. Retrieved from http://aws.amazon.com,2009.
3. Amazon. Amazon Web Services. Retrieved from http://aws.amazon.com, 2010.
4. M. Armbrust, A. Fox, R. Grifith, A. D. Joseph, R. H. Katz, A. Konwinski, G. Lee, D. A. Patterson, A. Rabkin, I. Stoica, and M. Zaharia. Above the Clouds: A Berkeley View of Cloud Computing. Electrical Engineering and Computer Sciences, University of California at Berkeley, Technical Report No. UCB/EECS-2009-28.
5. M. P. Atkinson, J. I. van Hemert, L. Han, A. Hume, and C. S. Liew. A distributed architecture for data mining and integration. In DADC '09: Proceedings of the second international workshop on Data-aware distributed computing, pages 11-20, New York, NY, USA, 2009. ACM.
6. G. Bell, T. Hey, and A. Szalay. Beyond the data deluge. Science, 323(5919):1297-1298, 2009.
7. K. D. Bollacker. Avoiding a digital dark age. American Scientist, 98:106-110, 2010.
8. D. Borthaku. The Hadoop distributed file system: Architecture and design. retrieved from lucene.apache.org/hadoop, 2007.
9. S. E. Celniker, L. A. L. Dillon, M. B. Gerstein, K. C. Gunsalus, S. Henikofi, G. H. Karpen, M. Kellis, E. C. Lai, J. D. Lieb, D. M. MacAlpine, G. Micklem, F. Piano, M. Snyder, L. Stein, K. P. White, R. H. Waterston, and modENCODE Consortium. Unlocking the secrets of the genome. Nature, 459(7249):927-930, June 2009.
10. A. Chien, T. Faber, A. Falk, J. Bannister, R. Grossman, and J. Leigh. Transport protocols for high performance: Whither tcp? Communications of the ACM, 46(11):42-49, 2003.
11. S. collaboration. Sloan Digitial Sky Survey. http://www.sdss.org, 2009.
12. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In OSDI'04: Sixth Symposium on Operating System Design and Implementation, 2004.
13. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. Communications of the ACM, 51(1):107-113, 2008.
14. Eucalyptus Systems. Eucalyptus - elastic utility computing architecture linking your programs to useful systems. http://www.eucalyptus.com/, 2009.
15. I. Foster, Y. Zhao, I. Raicu, and S. Lu. Cloud computing and grid computing 360-degree compared. In IEEE Grid Computing Environments (GCE08), pages 1-10, 2008.
16. S. Ghemawat, H. Gobiofi, and S.-T. Leung. The Google file system. In SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles, pages 29-43, New York, NY, USA, 2003. ACM.
17. R. Grossman, Y. Gu, M. Sabala, C. Bennett, J. Seidman, and J. Mambratti. The open cloud testbed: A wide area testbed for cloud computing utilizing high performance network services. In GridNets 2009. Springer-Verlag, 2009.
18. R. L. Grossman and Y. Gu. Data mining using high performance clouds: Experimental studies using Sector and Sphere. In Proceedings of The 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2008). ACM, 2008.
19. Y. Gu and R. L. Grossman. UDT: UDP-based data transfer for high-speed wide area networks. Computer Networks, 51(7):1777-1799, 2007.
20. Y. Gu and R. L. Grossman. Sector and sphere: Towards simplified storage and processing of large scale distributed data. Philosophical Transactions of the Royal Society A, also arxiv:0809.1181, 2009.
21. Hadoop Project. Welcome to Apache Hadoop. retrieved from http://hadoop.apache.org, 2010.
22. Internet Archive. About the Internet Archive, 2010.
23. Large Hadron Collider. Worldwide lhc computing grid. http://lcg.web.cern. ch/lcg/.
24. P. Mell and T. Grance. The nist definition of cloud computing, version 15. http://csrc.nist.gov/groups/SNS/cloud-computing/,October 15, 2009.
25. C. Miceli, M. Miceli, S. Jha, H. Kaiser, and A. Merzky. Programming abstractions for data intensive computing on clouds and grids. In 9th IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2009), pages 478-483, 2009.
26. Open Cloud Consortium. http://www.opencloudconsortium.org, 2010.
27. Open Science Grid. A national, distributed computing grid for data-intensive research. http://www.opensciencegrid.org, 2010.
28. Y. Simmhan, R. Barga, C. van Ingen, M. Nieto-Santisteban, L. Dobos, N. Li, M. Shipway, A. S. Szalay, S. Werner, and J. Heasley. Graywulf: Scalable software architecture for data intensive computing. Hawaii International Conference on System Sciences, 0:1-10, 2009.
29. StarLight. StarLight: The optical StarTap. http://www.startap.net/ starlight, 2010.
30. M. Stonebraker, J. Becla, D. Dewitt, K. Lim, D. Maier, O. Ratzesberger, and S. Zdonik. Requirements for science data bases and scidb. In Conference on Innovative Data Systems Research (CIDR). http://database.cs.brown.edu/projects/ scidb/, 2009.
31. A. S. Szalay, G. Bell, J. Vandenberg, A. Wonders, R. Burns, D. Fay, J. Heasley, T. Hey, M. Nieto-Santisteban, A. Thakar, C. van Ingen, and R. Wilton. Graywulf: Scalable clustered architecture for data intensive computing. Hawaii International Conference on System Sciences, 0:1-10, 2009.
32. A. Thusoo, J. S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, H. Liu, P. Wyckofi, and R. Murthy. Hive: a warehousing solution over a map-reduce framework. Proceedings of VLDB, 2(2):1626-1629, 2009.
33. R. Wolski, C. Grzegorczyk, and D. N. et. al. Eucalyptus. retrieved from http://eucalyptus.cs.ucsb.edu/, 2008.