Demystifying cloud benchmarking

ISPASS 2016 - International Symposium on Performance Analysis of Systems and Software

Volumn , Issue , 2016, Pages 122-132

  Palit, Tapti ^a   Shen, Yongming ^a   Ferdman, Michael ^a  

^a Stony Brook University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX NETWORKS; DESIGN; VIDEO STREAMING;

CONSTRUCTION PROCESS; DESIGN DECISIONS; HARDWARE AND SOFTWARE; OBJECT CACHING; ON-LINE SERVICE; PAPER DOCUMENTS; RESEARCH COMMUNITIES; SYSTEM LEVELS;

BENCHMARKING;

EID: 84978716288     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISPASS.2016.7482080     Document Type: Conference Paper

References (34)

1. M. Ferdman, A. Adileh, O. Kocberber, S. Volos, M. Alisafaee, D. Jevdjic, C. Kaynak, A. D. Popescu, A. Ailamaki, and B. Falsafi, "Clearing the clouds: a study of emerging scale-out workloads on modern hardware," in Proceedings of the seventeenth international conference on Architectural Support for Programming Languages and Operating Systems, ser. ASPLOS '12. New York, NY, USA: ACM, 2012, pp. 37-48. [Online]. Available: http://doi.acm.org/10.1145/2150976.2150982
2. "Googlecloudplatform-perfkitbenchmarker." [Online]. Available: https: //github.com/GoogleCloudPlatform/PerfKitBenchmarker
3. "The zettabyte era: Trends and analysis." [Online]. Available: http://www.cisco.com/c/en/us/solutions/collateral/service-provider/ visual-networking-index-vni/VNI Hyperconnectivity WP.html
4. "Php: Hypertext preprocessor." [Online]. Available: http://php.net
5. "Memcached-a distributed memory object caching system." [Online]. Available: http://memcached.org/
6. "Docker-build, ship, and run any app, anywhere." [Online]. Available: https://www.docker.com
7. "A network address translator (nat) traversal mechanism for media controlled by real-time streaming protocol (rtsp)." [Online]. Available: https://tools.ietf.org/html/draft-ietf-mmusic-rtsp-nat-22
8. A. C. Begen, T. Akgul, and M. Baugher, "Watching video over the web: Part 1: Streaming protocols," Internet Computing, IEEE, vol. 15, no. 2, pp. 54-63, 2011.
9. "Nginx-high performance load balancer, web server, and reverse proxy." [Online]. Available: https://www.nginx.com/
10. "Olio-a web 2.0 toolkit." [Online]. Available: http://incubator.apache. org/projects/olio.html
11. "Faban-helping measure performance." [Online]. Available: http: //faban.org
12. R. Nishtala, H. Fugal, S. Grimm, M. Kwiatkowski, H. Lee, H. C. Li, R. McElroy, M. Paleczny, D. Peek, P. Saab et al., "Scaling memcache at facebook." in nsdi, vol. 13, 2013, pp. 385-398.
13. K. Lim, D. Meisner, A. G. Saidi, P. Ranganathan, and T. F. Wenisch, "Thin servers with smart pipes: designing soc accelerators for memcached," ACM SIGARCH Computer Architecture News, vol. 41, no. 3, pp. 36-47, 2013.
14. B. Atikoglu, Y. Xu, E. Frachtenberg, S. Jiang, and M. Paleczny, "Workload analysis of a large-scale key-value store," in ACM SIGMETRICS Performance Evaluation Review, vol. 40, no. 1. ACM, 2012, pp. 53-64.
15. "Elgg-open source social networking engine." [Online]. Available: https://elgg.org
16. J. Summers, T. Brecht, D. Eager, and B. Wong, "Methodologies for generating http streaming video workloads to evaluate web server performance," in Proceedings of the 5th Annual International Systems and Storage Conference. ACM, 2012, p. 2.
17. D. Mosberger and T. Jin, "httperf-a tool for measuring web server performance," vol. 26, no. 3. ACM, 1998, pp. 31-37.
18. P. Gill, M. Arlitt, Z. Li, and A. Mahanti, "Youtube traffic characterization: a view from the edge," in Proceedings of the 7th ACM SIGCOMM conference on Internet measurement. ACM, 2007, pp. 15-28.
19. "Why netflix chose nginx as the heart of its cdn." [Online]. Available: https://www.nginx.com/blog/why-netflix-chose-nginx-as-theheart-of-its-cdn
20. L. Gammo, T. Brecht, A. Shukla, and D. Pariag, "Comparing and evaluating epoll, select, and poll event mechanisms," in Linux Symposium, vol. 1, 2004.
21. M. Carbone and L. Rizzo, "Dummynet revisited," ACM SIGCOMM Computer Communication Review, vol. 40, no. 2, pp. 12-20, 2010.
22. "Recommended upload encoding settings." [Online]. Available: https: //support.google.com/youtube/answer/1722171
23. "Akamai's state of the internet: Q1 2015 report." [Online]. Available: https://www.stateoftheinternet.com/resources-connectivity-2015-q1-state-of-the-internet-report.html
24. T. o'Reilly, What is web 2.0. " O'Reilly Media, Inc.", 2009.
25. "Powered by elgg." [Online]. Available: https://elgg.org/powering.php
26. "Alexa statistics for facebook." [Online]. Available: http://www.alexa. com/siteinfo/facebook.com
27. "Scaling in the linux networking stack." [Online]. Available: https: //www.kernel.org/doc/Documentation/networking/scaling.txt
28. "Introduction to intel ethernet flow director and memcached performance," 2014. [Online]. Available: http://www.intel.com/content/dam/www/public/us/en/documents/ white-papers/intel-ethernet-flow-director.pdf
29. "Dockerhub." [Online]. Available: https://hub.docker.com/
30. E. Cecchet, V. Udayabhanu, T. Wood, and P. Shenoy, "Benchlab: an open testbed for realistic benchmarking of web applications," in Proceedings of the 2nd USENIX conference on Web application development. USENIX Association, 2011.
31. P. Pegus, E. Cecchet, and P. Shenoy, "Video benchlab: an open platform for realistic benchmarking of streaming media workloads," in Proc. ACM Multimedia Systems Conference (MMSys), Portland, OR, 2015.
32. "Standard performance evaluation corporation." [Online]. Available: http://www.spec.org/web2009
33. "Mutilate: high-performance memcached load generator." [Online]. Available: https://github.com/leverich/mutilate
34. "Memaslap-an open source c/c++ client library and tools for the memcached server." [Online]. Available: http://libmemcached.org/ libMemcached.html