On the performance variability of production cloud services

Proceedings - 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2011

Volumn , Issue , 2011, Pages 104-113

  Iosup, Alexandru ^a   Yigitbasi, Nezih ^a   Epema, Dick ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

analysis; cloud; performance; performance variability; production cloud services; traces

Indexed keywords

AMAZON WEB SERVICES; ANALYSIS; CLOUD PROVIDERS; CLOUD SERVICES; COMPUTING HARDWARE; ECONOMY OF SCALE; JOB EXECUTION; LARGE-SCALE APPLICATIONS; LONG TERM PERFORMANCE; PERFORMANCE; PERFORMANCE VARIABILITY; PHYSICAL RESOURCES; PRODUCTION ENVIRONMENTS; SCIENTIFIC COMMUNITY; SOCIAL GAMING; SOCIAL NETWORKS; STATE MANAGEMENT; TIME-SHARING; TRACE-BASED SIMULATION; TRACES; VIRTUAL GOODS; VIRTUALIZATIONS;

CLOUDS; CLUSTER COMPUTING; COMPUTER SIMULATION; DISTRIBUTED DATABASE SYSTEMS; ECONOMIC ANALYSIS; GRID COMPUTING; INTERNET; NETWORK MANAGEMENT; SOCIAL SCIENCES COMPUTING; USER INTERFACES; WEB SERVICES;

CLOUD COMPUTING;

EID: 79961146455     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2011.22     Document Type: Conference Paper

References (30)

1. R. H. Arpaci-Dusseau, A. C. Arpaci-Dusseau, A. Vahdat, L. T. Liu, T. E. Anderson, and D. A. Patterson, "The interaction of parallel and sequential workloads on a network of workstations," in SIGMETRICS, 1995, pp. 267-278.
2. A. Iosup, O. O. Sonmez, S. Anoep, and D. H. J. Epema, "The performance of bags-of-tasks in large-scale distributed systems," in HPDC. ACM, 2008, pp. 97-108.
3. Y. Zhang, M. S. Squillante, A. Sivasubramaniam, and R. K. Sahoo, "Performance implications of failures in large-scale cluster scheduling," in JSSPP, 2004, pp. 233-252.
4. D. Hilley, "Cloud computing: A taxonomy of platform and infrastructure-level offerings," Georgia Institute of Technology, Tech. Rep. GIT-CERCS-09-13, Dec 2008. [Online]. Available: www.cercs.gatech.edu/tech- reports/tr2009/git-cercs-09-13.pdf
5. J. Maguire, J. Vance, and C. Harvey, "85 cloud computing vendors shaping the emerging cloud," Aug 2009, iTManagement Tech.Rep.
6. M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. H. Katz, A. Konwinski, G. Lee, D. A. Patterson, A. Rabkin, I. Stoica, and M. Zaharia, "Above the clouds: A Berkeley view of cloud computing," EECS Department, University of California, Berkeley, Tech. Rep. UCB/EECS-2009-28, Feb 2009. [Online]. Available: www.eecs.berkeley.edu/Pubs/TechRpts/2009/EECS-2009-28.html
7. E. Deelman, G. Singh, M. Livny, J. B. Berriman, and J. Good, "The cost of doing science on the cloud: the Montage example," in SC. IEEE/ACM, 2008, p. 50.
8. M. R. Palankar, A. Iamnitchi, M. Ripeanu, and S. Garfinkel, "Amazon S3 for science grids: a viable solution?" in DADC '08: Proceedings of the 2008 international workshop on Data-aware distributed computing. ACM, 2008, pp. 55-64.
9. E. Walker, "Benchmarking Amazon EC2 for HP Scientific Computing," Login, vol. 33, no. 5, pp. 18-23, Nov 2008.
10. D. Nurmi, R. Wolski, C. Grzegorczyk, G. Obertelli, S. Soman, L. Youseff, and D. Zagorodnov, "The Eucalyptus open-source cloud-computing system," in CCGRID, 2009, pp. 124-131.
11. S. Ostermann, A. Iosup, M. N. Yigitbasi, R. Prodan, T. Fahringer, and D. Epema, "An early performance analysis of cloud computing services for scientific computing," in CloudComp, ser. LNICST, vol. 34, 2009, pp. 115-31.
12. RightScale, "Amazon usage estimates," Aug 2009, [Online] Available: blog.rightscale.com/2009/10/05/amazon-usage-estimates.
13. G. Rosen, "Cloud usage analysis series," Aug 2009, [Online] Available: www.jackofallclouds.com/category/analysis.
14. The Cloud Status Team, "Report on cloud performance and availability status," Jan. 2010, [Online] Available: www.cloudstatus.com.
15. A. Iosup, S. Ostermann, N. Yigitbasi, R. Prodan, T. Fahringer, and D. Epema, "Performance analysis of cloud computing services for manytasks scientific computing," IEEE Trans. on Parallel and Distrib. Sys., 2010, (accepted Sep 2010, in print).
16. D. G. Feitelson, L. Rudolph, U. Schwiegelshohn, K. C. Sevcik, and P. Wong, "Theory and practice in parallel job scheduling," in JSSPP, ser. LNCS, vol. 1291. Springer-Verlag, 1997, pp. 1-34.
17. A. Iosup, H. Li, M. Jan, S. Anoep, C. Dumitrescu, L. Wolters, and D. Epema, "The Grid Workloads Archive," FGCS, vol. 24, no. 7, pp. 672-686, 2008.
18. The Parallel Workloads Archive Team, "The parallel workloads archive logs," Jan. 2010, [Online] Available: www.cs.huji.ac.il/labs/parallel/ workload/logs.html.
19. K. T. Chen, P. Huang, and C. L. Lei, "Effect of network quality on player departure behavior in online games," IEEE TPDS, vol. 20, no. 5, pp. 593-606, 2009.
20. M. Claypool and K. T. Claypool, "Latency and player actions in online games," CACM, vol. 49, no. 11, pp. 40-45, 2006.
21. V. Nae, A. Iosup, S. Podlipnig, R. Prodan, D. H. J. Epema, and T. Fahringer, "Efficient management of data center resources for massively multiplayer online games," in SC, 2008, p. 10.
22. Y. El-Khamra, H. Kim, S. Jha, and M. Parashar, "Exploring the performance fluctuations of hpc workloads on clouds," in CloudCom. IEEE, 2010.
23. N. Yigitbasi, A. Iosup, D. H. J. Epema, and S. Ostermann, "C-meter: A framework for performance analysis of computing clouds," in CCGRID, 2009, pp. 472-477.
24. J. Dejun, G. Pierre, and C.-H. Chi, "EC2 performance analysis for resource provisioning of service-oriented applications," in Proceedings of the 3rd Workshop on Non-Functional Properties and SLA Management in Service-Oriented Computing, Nov. 2009.
25. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. L. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the art of virtualization," in SOSP. ACM, 2003, pp. 164-177.
26. B. Clark, T. Deshane, E. Dow, S. Evanchik, M. Finlayson, J. Herne, and J. N. Matthews, "Xen and the art of repeated research," in USENIX ATC, 2004, pp. 135-144.
27. A. Menon, J. R. Santos, Y. Turner, G. J. Janakiraman, and W. Zwaenepoel, "Diagnosing performance overheads in the Xen virtual machine environment," in VEE. ACM, 2005, pp. 13-23.
28. J. Matthews, T. Garfinkel, C. Hoff, and J. Wheeler, "Virtual machine contracts for datacenter and cloud computing environments," in Workshop on Automated control for datacenters and clouds (ACDC). ACM, 2009, pp. 25-30.
29. W. Yu and J. S. Vetter, "Xen-based HPC: A parallel I/O perspective," in CCGrid. IEEE, 2008, pp. 154-161.
30. L. Cherkasova and R. Gardner, "Measuring CPU overhead for I/O processing in the Xen virtual machine monitor," in USENIX ATC, 2005, pp. 387-390.