Modeling performances of concurrent big data applications

Software - Practice and Experience

Volumn 45, Issue 8, 2015, Pages 1127-1144

  Castiglione, Aniello ^a   Gribaudo, Marco ^b   Iacono, Mauro ^c   Palmieri, Francesco ^c  

^a UNIVERSITY OF SALERNO   (Italy)

^b POLITECNICO DI MILANO   (Italy)

^c SECOND UNIVERSITY OF NAPLES   (Italy)

Author keywords

big data applications; capacity planning; cloud architecture; Markovian agents; mean field analysis; performance evaluation

Indexed keywords

ABSTRACTING; DECISION MAKING; DIGITAL STORAGE;

BIG DATA APPLICATIONS; CAPACITY PLANNING; CLOUD ARCHITECTURES; MARKOVIAN AGENTS; MEAN FIELD ANALYSIS; PERFORMANCE EVALUATION;

BIG DATA;

EID: 84936847416     PISSN: 00380644     EISSN: 1097024X     Source Type: Journal    
DOI: 10.1002/spe.2269     Document Type: Article

References (34)

1. Amazon Inc. Amazon Elastic Compute Cloud (Amazon EC2), 2008. Available from: http://aws.amazon.com/ec2/ [last accessed 14 January 2014].
2. Rackspace, US Inc. The Rackspace Cloud, 2010. Available from: http://www.rackspace.com/cloud/ [last accessed 14 January 2014].
3. Palmieri F, Pardi S,. Towards a federated metropolitan area grid environment: the SCoPE network-aware infrastructure. Future Generation Computer Systems 2010; 26 (8): 1241-1256.
4. Esposito C, Ficco M, Palmieri F, Castiglione A,. Interconnecting federated clouds by using publish-subscribe service. Cluster Computing 2013; 16 (4): 887-903. DOI: 10.1007/s10586-013-0261-z.
5. Wang L, Khan SU, Chen D, Kołodziej J, Ranjan R, Xu C, Zomaya A,. Energy-aware parallel task scheduling in a cluster. Future Generation Computer Systems 2013; 29 (7): 1661-1670.
6. Gribaudo M, Cerotti D, Bobbio A,. Analysis of on-off policies in sensor networks using interacting markovian agents. Sixth Annual IEEE International Conference on Pervasive Computing and Communications, 2008, PerCom 2008, Hong Kong, HK, 2008; 300-305, DOI: 10.1109/PERCOM.2008.100.
7. Gribaudo M,. Analysis of large populations of interacting objects with mean field and markovian agents. In Computer Performance Engineering, Vol. 5652, Bradley J, (ed.), Lecture Notes in Computer Science. Springer: Berlin Heidelberg, 2009; 218-219, DOI: 10.1007/978-3-642-02924-0-18.
8. Kurtz TG,. Strong approximation theorems for density dependent Markov chains. Stochastic Processes and their Applications 1978; 6: 223-240.
9. Bobbio A, Gribaudo M, Telek M,. Analysis of large scale interacting systems by mean field method. 5th International Conference on Quantitative Evaluation of Systems-QEST2008, St. Malo, 2008; 215-224.
10. Press WH, Teukolsky SA, Vetterling WT, Flannery BP,. Numerical Recipes in C (2nd ed.): The Art of Scientific Computing. Cambridge University Press: New York, NY, USA, 1992.
11. Bodík P, Griffith R, Sutton C, Fox A, Jordan M, Patterson D,. Statistical machine learning makes automatic control practical for internet datacenters. In Proceedings of the 2009 Conference on Hot Topics in Cloud Computing, HotCloud'09. USENIX Association: Berkeley, CA, USA, 2009; 12-16.
12. Anderson E, Ganger GR, Wylie JJ, Krevat E, Shiran T, Tucek J,. Applying performance models to understand data-intensive computing efficiency, 2010. Parallel Data Laboratory, Carnegie Mellon University Pittsburg, PA, USA.
13. Herodotou H,. Hadoop Performance Models. Technical Report, Computer Science Department. Duke University, 2011.
14. Herodotou H, Lim H, Luo G, Borisov N, Dong L, Cetin FB, Babu S,. Starfish: a self-tuning system for big data analytics. CIDR, vol. 11, Asilomar, CA, USA, 2011; 261-272.
15. Armstrong B, Eigenmann R,. Performance forecasting: towards a methodology for characterizing large computational applications. 1998 International Conference on Parallel Processing, 1998. Proceedings, Minneapolis, MN, USA, IEEE, 1998; 518-525.
16. Armstrong B, Eigenmann R,. Performance forecasting: characterization of applications on current and future architectures. Technical Report ECE-HPCLab-97202, Purdue University, School of Electrical and Computer Engineering, High-Performance Computing Lab, 1997.
17. Schopf JM, Berman F,. Performance prediction in production environments. Parallel Processing Symposium, 1998. IPPS/SPDP 1998. Proceedings of the First MERGED International... and Symposium on Parallel and Distributed Processing 1998, Orlando, FL, USA, IEEE, 1998; 647-653.
18. Kerbyson DJ, Alme HJ, Hoisie A, Petrini F, Wasserman HJ, Gittings M,. Predictive performance and scalability modeling of a large-scale application. Proceedings of the 2001 ACM/IEEE Conference on Supercomputing (CDROM), Denver, CO, USA, ACM, 2001; 37-37.
19. Dinda PA, O'Hallaron DR,. An evaluation of linear models for host load prediction. The Eighth International Symposium on High Performance Distributed Computing, 1999. Proceedings, Redondo Beach, CA, USA, IEEE, 1999; 87-96.
20. Duan S, Thummala V, Babu S,. Tuning database configuration parameters with ituned. Proceedings of the VLDB Endowment 2009; 2 (1): 1246-1257.
21. Zheng W, Bianchini R, Janakiraman GJ, Santos JR, Turner Y,. JustRunIt: experiment-based management of virtualized data centers. In Proceedings of the 2009 Conference on USENIX Annual Technical Conference, USENIX'09, USENIX Association, Berkeley, CA, USA, 2009; 18-18.
22. Wang G, Butt AR, Pandey P, Gupta K,. A simulation approach to evaluating design decisions in MapReduce setups. IEEE International Symposium on Modeling, Analysis & Simulation of Computer and Telecommunication Systems, 2009. MASCOTS'09, London, UK, IEEE, 2009; 1-11.
23. Cardona K, Secretan J, Georgiopoulos M, Anagnostopoulos G,. A grid based system for data mining using MapReduce. Technical Report TR-2007-02, AMALTHEA, 2007.
24. Teng F, Yu L, Magouls F,. SimMapReduce: a simulator for modeling mapreduce framework. 2011 5th FTRA International Conference on Multimedia and Ubiquitous Engineering (MUE), Loutraki, Greece, 2011; 277-282.
25. Hammoud S, Li M, Liu Y, Alham NK, Liu Z,. MRSim: a discrete event based MapReduce simulator. 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), Yantai, Shandong, China, IEEE, 2010; 2993-2997.
26. Liu Y, Li M, Alham NK, Hammoud S,. HSim: a mapreduce simulator in enabling cloud computing. Future Generation Computer Systems 2013; 29 (1): 300-308.
27. Herodotou H, Babu S,. Profiling, what-if analysis, and cost-based optimization of MapReduce programs. Proceedings of the VLDB Endowment 2011; 4 (11): 1111-1122.
28. Boulon J, Konwinski A, Qi R, Rabkin A, Yang E, Yang M,. Chukwa: A large-scale monitoring system. In Proceedings of CCA, vol. 8, Chicago, IL, USA, 2008; 1-5.
29. Fonseca R, Porter G, Katz RH, Shenker S, Stoica I,. X-trace: a pervasive network tracing framework. In Proceedings of the 4th USENIX Conference on Networked Systems Design & Implementation, NSDI'07. USENIX Association: Berkeley, CA, USA, 2007; 20-20.
30. Barbierato E, Gribaudo M, Iacono M,. A performance modeling language for big data architecture. 27th European Conference on Modelling and simulation (ECMS 2013). IEEE Soc. German Chapter, Aalesund, Norway, 2013; 511-517, DOI: 10.7148/2013-0511.
31. Barbierato E, Gribaudo M, Iacono M,. Modeling apache hive based applications in big data architectures. 7th International Conference on Performance Evaluation Methodologies and Tools, VALUETOOLS 2013, Torino, Italy, 2013; 1-9, DOI: 10.7148/2013-0511.
32. Barbierato E, Gribaudo M, Iacono M,. Performance evaluation of nosql big-data applications using multi-formalism models. Future Generation Computer Systems 2013; to appear. DOI: 10.1016/j.future.2013.12.036.
33. Benaim M, Le Boudec JY,. A class of mean field interaction models for computer and communication systems. Performance Evaluation 2008; 65 (11): 823-838.
34. Castiglione A, Gribaudo M, Iacono M, Palmieri F,. Exploiting mean field analysis to model performances of big data architectures. Future Generation Computer Systems 2013; In press (0). DOI: 10.1016/j.future.2013.07.016.