What are you paying for? Performance benchmarking for Infrastructure-as-a- Service offerings

Proceedings - 2011 IEEE 4th International Conference on Cloud Computing, CLOUD 2011

Volumn , Issue , 2011, Pages 484-491

  Lenk, Alexander ^a   Menzel, Michael ^a   Lipsky, Johannes ^a   Tai, Stefan ^a   Offermann, Philipp ^b  

^a FZI RESEARCH CENTER FOR INFORMATION TECHNOLOGY   (Germany)

^b DEUTSCHE TELEKOM LABORATORIES   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

AMAZON EC2; HARDWARE PERFORMANCE; MEASURING METHOD; PERFORMANCE BENCHMARKING; PERFORMANCE INDICATORS; PERFORMANCE SPECIFICATIONS; REMOTE DATA CENTERS; RUNNING-IN; SERVICE OFFERING; TYPE OF SERVICES; VIRTUAL MACHINES;

BENCHMARKING; COMPUTER SIMULATION;

CLOUD COMPUTING;

EID: 80053136386     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLOUD.2011.80     Document Type: Conference Paper

References (19)

1. A. Lenk, M. Klems, J. Nimis, S. Tai, and T. Sandholm, "What's inside the cloud? an architectural map of the cloud landscape," in CLOUD '09: Proceedings of the 2009 ICSE Workshop on Software Engineering Challenges of Cloud Computing. Washington, DC, USA: IEEE Computer Society, 2009, pp. 23-31.
2. The Bitsource, "Rackspace Cloud Servers versus Amazon EC2: Performance Analysis," January 2010. [Online]. Available: http://www.thebitsource.com/featured-posts/rackspace-cloud-servers-versus- amazon-ec2-performance-analysis/
3. E. Walker, "Benchmarking amazon EC2 for high-performance scientific computing," USENIX Login, vol. 33, no. 5, pp. 18-23, 2008.
4. K. Jackson, L. Ramakrishnan, K. Muriki, S. Canon, S. Cholia, J. Shalf, H. Wasserman, and N. Wright, "Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud," in 2nd IEEE International Conference on Cloud Computing Technology and Science. IEEE, 2010, pp. 159-168.
5. J. Schad, J. Dittrich, and J.-A. Quiané-Ruiz, "Runtime measurements in the cloud: observing, analyzing, and reducing variance," Proc. VLDB Endow., vol. 3, pp. 460-471, September 2010. [Online]. Available: http://portal.acm.org/citation.cfm?id=1920841.1920902
6. C. Binnig, D. Kossmann, T. Kraska, and S. Loesing, "How is the weather tomorrow?: towards a benchmark for the cloud," in Proceedings of the Second International Workshop on Testing Database Systems, ser. DBTest '09. New York, NY, USA: ACM, 2009, pp. 9:1-9:6. [Online]. Available: http://doi.acm.org/10.1145/1594156.1594168
7. Transaction Processing Performance Council (TPC), "TPC-W Benchmark," Last Seen: 2011-01-20. [Online]. Available: http://www.tpc.org/tpcw/
8. D. Menascé, "TPC-W: A benchmark for e-commerce," IEEE Internet Computing, vol. 6, no. 3, pp. 83-87, 2002. (Pubitemid 34669567)
9. W. Sobel, S. Subramanyam, A. Sucharitakul, J. Nguyen, H. Wong, S. Patil, A. Fox, and D. Patterson, "Cloudstone: Multi-platform, multi-language benchmark and measurement tools for web 2.0," in Proc. of CCA. Citeseer, 2008.
10. CloudHarmony.com, "Cloudharmony," Last Seen: 2011-02-10. [Online]. Available: http://cloudharmony.com/
11. V. Makhija, B. Herndon, P. Smith, L. Roderick, E. Zamost, and J. Anderson, "VMmark: A scalable benchmark for virtualized systems," VMware Inc, CA, Tech. Rep. VMware-TR-2006-002, September, 2006.
12. J. Casazza, M. Greenfield, and K. Shi, "Redefining server performance characterization for virtualization benchmarking," Intel Technology Journal, vol. 10, no. 3, pp. 243-251, 2006.
13. Y. Mei, L. Liu, X. Pu, and S. Sivathanu, "Performance Measurements and Analysis of Network I/O Applications in Virtualized Cloud," in Cloud Computing (CLOUD), 2010 IEEE 3rd International Conference on, 2010, pp. 59-66, i/o trhoughput for VMs on same physical host.
14. Object Management Group, "BPMN 2.0 Specification," Last Seen: 2011-01-20. [Online]. Available: http://www.omg.org/spec/BPMN/2.0/
15. Phoronix Media, "[phoronix] linux hardware reviews, benchmarking, and gaming," Last Seen: 2011-01-20. [Online]. Available: http://www.phoronix-test-suite.com/
16. Amazon Web Services LLC, "Amazon elastic compute cloud (amazon ec2)," Last Seen: 2011-01-20. [Online]. Available: http://aws.amazon.com/ ec2/
17. Flexiant Ltd, "Flexiscale public cloud," Last Seen: 2011-01-20. [Online]. Available: http://www.flexiant.com/products/flexiscale/
18. Rackspace, US Inc., "Cloud computing, cloud hosting & online storage by rackspace hosting. mosso is now the rackspace cloud." Last Seen: 2011-01-20. [Online]. Available: http://www.rackspacecloud.com/
19. PassMark Software, "Passmark software - pc benchmark and test software," Last Seen: 2011-02-04. [Online]. Available: http://www.passmark. com/