The mosaic benchmarking framework: Development and execution of custom cloud benchmarks

Scalable Computing

Volumn 14, Issue 1, 2013, Pages 33-45

  Aversano, Giuseppe ^a   Rak, Massimiliano ^b   Villano, Umberto ^a  

^a UNIVERSITY OF SANNIO   (Italy)

^b SECOND UNIVERSITY OF NAPLES   (Italy)

Author keywords

Benchmark; Cloud computing; Cloud performance; mOSAIC; Platform as a service.

Indexed keywords

BENCHMARK; BENCHMARK APPLICATIONS; CLOUD ENVIRONMENTS; CLOUD PERFORMANCE; FRAMEWORK ARCHITECTURE; MOSAIC; NATURAL CONSEQUENCES; VIRTUAL MACHINES;

CLOUD COMPUTING; ELASTICITY; PLATFORM AS A SERVICE (PAAS);

BENCHMARKING;

EID: 84877662825     PISSN: 18951767     EISSN: None     Source Type: Journal    
DOI: 10.12694/scpe.v14i1.825     Document Type: Article

References (28)

1. Cloudharmony available at. http://cloudharmony.com/.
2. Cloudsleuth available at. https://cloudsleuth.net/.
3. Linpack available at. http://www.netlib.org/linpack/.
4. Nas parallel benchmark available at. http://www.nas.nasa.gov/publications/npb.html.
5. Skampi available at. http://liinwww.ira.uka.de/~skampi/.
6. Spec soa subcommittee. http://www.spec.org/soa/.
7. Spec virtualization benchmark 2010. http://www.spec.org/virt_sc2010/.
8. Standard performance evaluation corporation. http://www.spec.org/.
9. Top 500 supercomputing sites available at. http://www.top500.org/.
10. Tpc, transaction processing performance council available at. http://www.tpc.org/.
11. R. Aversa, B. Di Martino, M. Rak, S. Venticinque, and U. Villano, Performance Prediction for HPC on Clouds, John Wiley & Sons, Inc., 2011, pp. 437-456.
12. J. Dejun, G. Pierre, and C.-H. Chi, EC2 performance analysis for resource provisioning of service-oriented applications, in Proceedings of the 3rd Workshop on Non-Functional Properties and SLA Management in Service-Oriented Computing, Nov. 2009.
13. J. Dejun, G. Pierre, and C.-H. Chi, Resource provisioning of web applications in heterogeneous clouds, in Proceedings of the 2nd USENIX conference on Web application development, WebApps'11, Berkeley, CA, USA, 2011, USENIX Association, pp. 5-5.
14. C. Evangelinos and C. N. Hill, Cloud Computing for parallel Scientific HPC Applications: Feasibility of Running Coupled Atmosphere-Ocean Climate Models on Amazon's EC2, Cloud Computing and Its Applications, Oct. 2008.
15. A. J. Ferrer, F. Hernández, J. Tordsson, E. Elmroth, A. Ali-Eldin, C. Zsigri, R. Sirvent, J. Guitart, R. M. Badia, K. Djemame, W. Ziegler, T. Dimitrakos, S. K. Nair, G. Kousiouris, K. Konstanteli, T. Varvarigou, B. Hudzia, A. Kipp, S. Wesner, M. Corrales, N. Forgó, T. Sharif, and C. Sheridan, Optimis: A holistic approach to cloud service provisioning, 2012-01-01 2012.
16. D. Kossmann, T. Kraska, and S. Loesing, An evaluation of alternative architectures for transaction processing in the cloud, in Proceedings of the 2010 ACM SIGMOD International Conference on Management of data, SIGMOD '10, New York, NY, USA, 2010, ACM, pp. 579-590.
17. A. Li, X. Yang, S. Kandula, and M. Zhang, Cloudcmp: comparing public cloud providers, in Proceedings of the 10th ACM SIGCOMM conference on Internet measurement, IMC '10, New York, NY, USA, 2010, ACM, pp. 1-14.
18. E. Mancini, M. Rak, and U. Villano, Perfcloud: GRID services for performance-oriented development of cloud computing applications, in 18th IEEE International Workshops on Enabling Technologies: Infrastructures for Collaborative Enter- prises, WETICE 2009, Groningen, The Netherlands, 29 June - 1 July 2009, Proceedings, S. Reddy, ed., IEEE Computer Society, 2009, pp. 201-206.
19. C. Morin, Open computing infrastructures for elastic services: contrail approach, in Proceedings of the 5th international workshop on Virtualization technologies in distributed computing, VTDC '11, New York, NY, USA, 2011, ACM, pp. 1-2.
20. D. Petcu, C. Craciun, M. Neagul, I. Lazcanotegui, and M. Rak, Building an interoperability api for sky computing, in 2011 International Conference on High Performance Computing & Simulation, HPCS 2012, Istanbul, Turkey, July 4-8, 2011, W. W. Smari and J. P. McIntire, eds., IEEE, 2011, pp. 405-411.
21. D. Petcu, C. Craciun, and M. Rak, Towards a cross platform cloud api - components for cloud federation., in CLOSER 2012 - Proceedings of the 2nd International Conference on Cloud Computing and Services Science, Porto, Portugal, 18 - 21 April, 2012, F. Leymann, I. Ivanov, M. van Sinderen, and B. Shishkov, eds., SciTePress, 2011, pp. 166-169.
22. D. Petcu, C. Crǎciun, M. Neagul, S. Panica, B. Di Martino, S. Venticinque, M. Rak, and R. Aversa, Architecturing a sky computing platform, in Proceedings of the 2010 international conference on Towards a service-based internet, ServiceWave'10, Berlin, Heidelberg, 2011, Springer-Verlag, pp. 1-13.
23. G. Pierre, I. El Helw, C. Stratan, A. Oprescu, T. Kielmann, T. Schütt, J. Stender, M. Artač, and A. Černivec, Conpaas: an integrated runtime environment for elastic cloud applications, in Proceedings of the Workshop on Posters and Demos Track, PDT '11, New York, NY, USA, 2011, ACM, pp. 5:1-5:2.
24. M. Rak and G. Aversano, Benchmarks in the cloud: The mosaic benchmarking framework, in Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), 2012 14th International Symposium on, 2012, pp. 415-422.
25. M. Rak, A. Cuomo, and U. Villano, A service for virtual cluster performance evaluation, in Proceedings of the 2010 19th IEEE International Workshops on Enabling Technologies: Infrastructures for Collaborative Enterprises, WETICE '10, Washington, DC, USA, 2010, IEEE Computer Society, pp. 249-251.
26. W. Sobel, S. Subramanyam, A. Sucharitakul, J. Nguyen, H. Wong, A. Klepchukov, S. Patil, O. Fox, and D. Patterson, Cloudstone: Multi-platform, multi-language benchmark and measurement tools for web 2.0, 2008.
27. E. Walker, Benchmarking Amazon EC2 for high-performance scientific computing, LOGIN, 33 (2008), pp. 18-23.
28. N. Yigitbasi, A. Iosup, D. Epema, and S. Ostermann, C-meter: A framework for performance analysis of computing clouds, in Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID '09, Washington, DC, USA, 2009, IEEE Computer Society, pp. 472-477.