Amazon S3 for science grids: A viable solution?

International Symposium on High Performance Distributed Computing, HPDC 2008 - Proceedings of the 2008 International Workshop on Data-aware Distributed Computing 2008, DADC'08

Volumn , Issue , 2008, Pages 55-64

  Palankar, Mayur ^a   Lamnitchi, Adriana ^a   Ripeanu, Matei ^b   Garfinkel, Simson ^c  

^a UNIVERSITY OF SOUTH FLORIDA   (United States)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^c HARVARD UNIVERSITY   (United States)

Author keywords

Utility computing, performance evaluation, amazon simple storage service

Indexed keywords

TECHNICAL PRESENTATIONS;

CHARGING MODELS; HIGHLY AVAILABLE; INTENSIVE SCIENCES; SCIENCE PROJECTS; STORAGE COSTS; STORAGE SERVICES; UTILITY COMPUTING, PERFORMANCE EVALUATION, AMAZON SIMPLE STORAGE SERVICE; UTILITY PERFORMANCES; VIABLE SOLUTIONS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 57349143695     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1383519.1383526     Document Type: Conference Paper

References (24)

1. The DZero Experiment. http://www-d0.fnal.gov
2. The Large Hadron Collider. http://lcg.web.cem.ch/LCG
3. The Stanford Linear Collider. http://www2.slac.stanford.edu/vvc/ experiments/slc.html
4. The Compact Muon Solenoid at CERN. http://cmsinfo.cern.ch
5. Amazon Web Services. http:/s3.amazonaws.com
6. PlanetLab Consortium, http://planet-lab.org
7. Garfinkel, S. 2007. Commodity Grid Computing with Amazon's S3 and EC2, Login, USENIX, February 2007.
8. Kirkpatrick, M. 2006. Amazon releases early info on S3 storage use, http://www.techcrunch.com/tag/s3, July 2006.
9. Bezos, J. keynote talk at Web 2.0 Expo, April 2007.
10. Krawczyk, H., Bellare, M., and Canetti, R. 1997. HMAC: Keyed-Hashing for Message Authentication, IETF - Network Working Group, 1997.
11. W3C, Soap Version 1.2, June 2003, http://www.w3.org/TR/soap/
12. Fielding, R. T. 2000. Architectural Styles and the Design of Network-Based Software Architectures, PhD Dissertation, University of California, Irvine, 2000.
13. BitTorrent. http://www.bittorrent.com
14. Doraimani, S. 2007. Filecules: A New Granularity for Resource Management in Grids, Masters Thesis, University of South Florida, April 2007.
15. Iamnitchi, A., Doraimani, S., and Garzoglio, G. 2006. Filecules in High-Energy Physics: Characteristics and Impact on Resource Management, 15th IEEE International Symposium on High Performance Distributed Computing (HPDC), June 2006.
16. T. Oreily. REST vs. SOAP at Amazon. http://www.oreillynet.eom/pub/wlg/ 3005?wlg=yes
17. Paxson, V. 1996. End-to-end routing behavior in the Internet, Proceedings of the ACM SIGCOMM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications, vol 26.4, ACM SiGCOMM Computer Communication Review, pages 25-38, ACM Press, New York, August 1996.
18. Garfinkel, S. 2007. An Evaluation of Amazon's Grid Computing Services: EC2, S3 and SQS, Technical Report TR-08-07, School for Engineering and Applied Sciences, Harvard University, MA. July 2007.
19. TeraGrid. http://www.teragrid.org
20. Odlyzko, A. M. 2000. The Internet and other networks: Utilization rates and their implications, Information Economics & Policy, vol. 12, 2000.
21. Odlyzko, A. M. 1999. The current state and likely evolution of the Internet, in Proceedings of Globecom'99, pp. 1869-1875, IEEE, 1999.
22. Western Canada Research Grid, http://www.westgrid.ca
23. Ripeanu, M. and Iamnitchi, A. 2007. S4: A Simple Storage Service for Sciences, 16th IEEE International Symposium on High Performance Distributed Computing (HPDC), Monterey Bay, CA, June 2007.
24. Palankar, M., Onibokun, A., Iamnitchi, A., and Ripeanu, M. 2007. Amazon S3 for Science Grids: a Viable Solution?, poster, 4th USENIX Symposium on Networked Systems Design & Implementation (NSDI'07), April 2007.