A self-scalable load injection service

Software - Practice and Experience

Volumn 45, Issue 5, 2015, Pages 613-632

  Tchana, Alain ^a   De Palma, Noel ^a   Dillenseger, Bruno ^b   Etchevers, Xavier ^b  

^a UNIV GRENOBLE ALPES   (France)

^b ORANGE LABS   (France)

Author keywords

benchmarking as a service; cloud; resource allocation

Indexed keywords

APPLICATION PROGRAMS; CLOUDS; PLATFORM AS A SERVICE (PAAS); RESOURCE ALLOCATION; SOFTWARE TESTING;

BENCHMARKING PLATFORMS; CLASSICAL SOLUTIONS; CLOUD COMPUTING PLATFORMS; HARDWARE RESOURCES; LOAD PROFILES; ON DEMANDS; ON-LINE CALIBRATION; PAY-PER-USE MODEL;

BENCHMARKING;

EID: 84926422176     PISSN: 00380644     EISSN: 1097024X     Source Type: Journal    
DOI: 10.1002/spe.2236     Document Type: Article

References (40)

1. Zhang J, Cheung SC,. Automated test case generation for the stress testing of multimedia systems. Software-Practice & Experience 2002; 32 (15): 1411-1435.
2. Bayan MS, Cangussu JW,. Automatic stress and load testing for embedded systems. In Proceeding of the Annual International Computer Software and Applications Conference, Chicago, Illinois, USA, 2006; 229-233.
3. Mi N, Casale G, Cherkasova L, Smirni E,. Injecting realistic burstiness to a traditional client-server benchmark. In Proceedings of the International Conference on Autonomic Computing, Barcelona, Spain, 2009; 149-158.
4. Barna C, Litoiu M, Ghanbari H,. Autonomic load-testing framework. In Proceedings of the International Conference on Autonomic Computing, Karlsruhe, Germany, 2011; 910-100.
5. Blake R, Breese JS,. Automatic Bottleneck Detection. Technical Report from Microsoft Research, number MSR-TR-95-10, 1995.
6. Chung I-H, Cong G, Klepacki D, Sbaraglia S, Seelam S, Wen HF,. A framework for automated performance bottleneck detection. In Proceedings of the IEEE International Symposium on Parallel and Distributed Processing, Miami, Florida USA, 2008; 1-7.
7. Koehler S, Stitt G, George AD,. Platform-aware bottleneck detection for reconfigurable computing applications. ACM Transactions on Reconfigurable Technology and Systems 2011; 4 (3): 1-30.
8. Amza C, Ch A, Cox AL, Elnikety S, Gil R, Rajamani K, Cecchet E, Marguerite J,. Specification and implementation of dynamic web site benchmarks. In Proceedings of the In 5th IEEE Workshop on Workload Characterization, Austin, TX, USA, 2002; 3-13.
9. JORAM: Java (TM) Open Reliable Asynchronous Messaging. Available at: http://joram.ow2.org/ [last accessed November 2013].
10. Jain RK,. The art of computer systems performance analysis: Techniques for experimental design, measurement, simulation, and modelling. ACM SIGMETRICS Performance Evaluation Review 1991; 19 (2): 5-11.
11. Kant K, Tewari V, Iyer RK,. Geist: A web traffic generation tool. In Proceedings of the International Conference on Modelling Techniques and Tools for Computer Performance Evaluation, London, UK, 2002; 227-232.
12. Harbaoui A, Salmi N, Dillenseger B, Vincent J-M,. Introducing queuing network-based performance awareness in autonomic systems. In Proceedings of the Sixth International Conference on Autonomic and Autonomous Systems, Cancun, Mexico, 2010; 7-12.
13. The CLIF Project. Available at: http://clif.ow2.org [last accessed November 2013].
14. Dillenseger B,. CLIF, a framework based on fractal for flexible, distributed load testing. In Annals of Telecommunications, Vol. 64. Springer: Paris. Numbers 1-2, Issue 1, 2009; 101-120.
15. Bruneton E, Coupaye T, Leclercq M, Quema V, Stefani JB,. An open component model and its support in java. In Proceedings of the International ACM SIGSOFT Symposium on Component-Based Software Engineering, Edinburgh, UK, 2004; 7-22.
16. Bolze R, Cappello F, Caron E, Daydé M, Desprez F, Jeannot E, Jégou Y, Lanteri S, Leduc J, Melab N, Mornet G, Namyst R, Primet P, Quetier B, Richard O, Talbi EG, Touche I,. Grid'5000: a large scale and highly reconfigurable experimental grid testbed. International Journal of High Performance Computing Applications 2006; 20 (4): 481-494.
17. Openstack Web Site. Available at: http://openstack.org/ [last accessed November 2013].
18. StackOps Web Site. Available at: http://www.stackops.com [last accessed November 2013].
19. Jamal MH, Qadeer A, Mahmood W, Waheed A, Ding JJ,. Virtual machine scalability on multi-core processors based servers for cloud computing workloads. In Proceedings of the IEEE International Conference on Networking, Architecture, and Storage, Zhang Jia Jie, Hunan, China, 2009; 90-97.
20. Jayasinghe D, Malkowski S, Wang Q, Li J, Xiong P, Pu C,. Variations in performance and scalability when migrating n-tier applications to different clouds. In Proceedings of the IEEE International Conference on Cloud Computing, Washington, DC, USA, 2011; 73-80.
21. Dutta S, Gera S, Verma A, Viswanathan B,. SmartScale: automatic application scaling in enterprise clouds. In Proceedings of the IEEE International Conference on Cloud Computing, Honolulu, Hawaii, USA, 2012; 221-228.
22. Vaquero LM, Rodero L, Buyya R,. Dynamically scaling applications in the cloud. ACM SIGCOMM Computer Communication Review 2011; 41 (1): 45-52. ISSN 0146-4833.
23. Marshall P, Keahey K, Freeman T,. Elastic site: using clouds to elastically extend site resources. In Proceedings of the IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, Melbourne, Australia, USA, 2010; 43-52.
24. The Apache Software Foundation. Apache JMeter. Available at: http://jmeter.apache.org/ [last accessed November 2013].
25. Curnow HJ, Wichmann BA,. A synthetic benchmark. Computer Journal 1976; 19 (1): 43-49.
26. Transaction Processing Performance Council (TCP). Avalable at: http://www.tpc.org/ [last accessed November 2013].
27. Standard Performance Evaluation Corporation (SPEC). Avalable at: http://www.spec.org/ [last accessed November 2013].
28. Dependability Benchmarking Project (IST-2000-25425). Avalable at: http://webhost.laas.fr/TSF/DBench/ [last accessed November 2013].
29. Tchana A, Temate S, Broto L, Hagimont D,. Autonomic resource allocation in a J2EE cluster. 3rd International Conference on Utility and Cloud Computing, Chennai, India, 2010.
30. Amazon Web Services. Amazon EC2 Auto-Scaling Functions. Available at: http://aws.amazon.com/fr/autoscaling/ [last accessed November 2013].
31. Righscale Web Site. Available at: http://www.rightscale.com [last accessed November 2013].
32. Rolls D, Joslin C, Scholz SB,. Unibench: a tool for automated and collaborative benchmarking. In Proceedings of the The 18th IEEE International Conference on Program Comprehension, Braga, Portugal, 2010; 50-51.
33. Almeida R, Vieira M,. Benchmarking the resilience of self-adaptive software systems: perspectives and challenges. In Proceedings of the 6th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, Waikiki, Honolulu, HI, USA, 2011; 190-195.
34. Manley S, Courage M, Seltzer M, A self-scaling and self-configuring benchmark for web servers. In Proceedings of SIGMETRICS, Madison, Wisconsin, USA, HI, USA, 1998; 270-271.
35. El-Refaey MA, Rizkaa MA,. CloudGauge: a dynamic cloud and virtualization benchmarking suite. In Proceedings of the 2010 19th IEEE International Workshops on Enabling Technologies: Infrastructures for Collaborative Enterprises, Larissa, Greece, 2010; 66-75.
36. Jin H, Cao W, Yuan P, Xie X,. VSCBenchmark: benchmark for dynamic server performance of virtualization technology. In Proceedings of the 1st International Forum on Next-Generation Multicore/Manycore Technologies, Cairo, Egypt, 2008; 1-8.
37. Makhija V, Herndon B, Smith P, Roderick L, Zamost E, Anderson J,. VMmark: a scalable benchmark for virtualized systems. Technical Report VMware-TR-2006-002, Palo Alto, CA, USA, September 2006. Available at: http://www.vmware.com/pdf/vmmark-intro.pdf [last accessed November 2013].
38. BlazeMeter. Dependability Benchmarking Project. Available at: http://blazemeter.com/ [last accessed November 2013].
39. Neotys. NeoLoad: Load Test All Web and Mobile Applications. Available at: http://www.neotys.fr/ [last accessed November 2013].
40. Jayasinghe D, Swint GS, Malkowski S, Li J, Park J, Pu C,. Expertus: a generator approach to automate performance testing in IaaS clouds. In Proceedings of the IEEE International Conference on Cloud Computing, Honolulu, HI, USA, June, 2012; 115-122.