Exploiting mean field analysis to model performances of big data architectures

Future Generation Computer Systems

Volumn 37, Issue , 2014, Pages 203-211

  Castiglione, Aniello ^a   Gribaudo, Marco ^b   Iacono, Mauro ^c   Palmieri, Francesco ^c  

^a UNIVERSITY OF SALERNO   (Italy)

^b POLITECNICO DI MILANO   (Italy)

^c SECOND UNIVERSITY OF NAPLES   (Italy)

Author keywords

Big data; Map reduce architectures; Mean field analysis; Multi formalism modeling; Performance evaluation

Indexed keywords

ARCHITECTURE; DIGITAL STORAGE;

APPROXIMATE INFERENCE; DATA PROCESSING SYSTEMS; MAP-REDUCE; MEAN FIELD ANALYSIS; MULTI-FORMALISM MODELS; NUMBER OF COMPONENTS; PERFORMANCE EVALUATION; RELIABLE PERFORMANCE;

BIG DATA;

EID: 84903362732     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2013.07.016     Document Type: Article

References (29)

1. M.-C. Lee, F.-Y. Leu, and Y. Ping Chen Pfrf: an adaptive data replication algorithm based on star-topology data grids Future Generation Computer Systems 28 7 2012 1045 1057 10.1016/j.future.2011.08.015
2. M. Benaim, and J.-Y.L. Boudec A class of mean field interaction models for computer and communication systems Performance Evaluation 65 11-12 2008 823 838
3. A. Bobbio, M. Gribaudo, M. Telek, Analysis of large scale interacting systems by mean field method, in: 5th International Conference on Quantitative Evaluation of Systems - QEST2008, St. Malo, 2008, pp. 215-224.
4. V. Vittorini, M. Iacono, N. Mazzocca, and G. Franceschinis The OsMoSys approach to multi-formalism modeling of systems Software and Systems Modeling 3 1 2004 68 81
5. M. Iacono, E. Barbierato, and M. Gribaudo The SIMTHESys multiformalism modeling framework Computers and Mathematics with Applications 64 12 2012 3828 3839 10.1016/j.camwa.2012.03.009
6. Y. Liu, M. Li, N.K. Alham, and S. Hammoud Hsim: a mapreduce simulator in enabling cloud computing Future Generation Computer Systems 29 1 2013 300 308 10.1016/j.future.2011.05.007
7. S. Hammoud, M. Li, Y. Liu, N.K. Alham, and Z. Liu MRSim: a discrete event based MapReduce simulator 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), Vol. 6 2010 IEEE 2993 2997
8. F. Teng, L. Yu, and F. Magoulès SimMapReduce: a simulator for modeling MapReduce framework 2011 5th FTRA International Conference on Multimedia and Ubiquitous Engineering (MUE) 2011 IEEE 277 282
9. H. Herodotou, H. Lim, G. Luo, N. Borisov, L. Dong, F.B. Cetin, S. Babu, Starfish: a self-tuning system for big data analytics, in: Proc. of the Fifth CIDR Conf, 2011, pp. 261-272.
10. G. Ananthanarayanan, S. Kandula, A. Greenberg, I. Stoica, Y. Lu, B. Saha, and E. Harris Reining in the outliers in map-reduce clusters using mantri Proceedings of the 9th USENIX Conference on Operating Systems Design and Implementation 2010 USENIX Association 1 16
11. J. Boulon, A. Konwinski, R. Qi, A. Rabkin, E. Yang, M. Yang, Chukwa, a large-scale monitoring system, in: Proceedings of CCA, Vol. 8, 2008, pp. 1-5.
12. J. Tan, X. Pan, E. Marinelli, S. Kavulya, R. Gandhi, and P. Narasimhan Kahuna: problem diagnosis for mapreduce-based cloud computing environments 2010 IEEE Network Operations and Management Symposium (NOMS) 2010 IEEE 112 119
13. G.F. Creţu-Ciocârlie, M. Budiu, and M. Goldszmidt Hunting for problems with Artemis Proceedings of the First USENIX Conference on Analysis of System Logs 2008 USENIX Association 1 8
14. S. Kavulya, J. Tan, R. Gandhi, P. Narasimhan, An analysis of traces from a production mapreduce cluster, in: 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, CCGrid, 2010, pp. 94-103. http://dx.doi.org/10.1109/CCGRID.2010.112.
15. J. Hellerstein, Google cluster data, 2010. URL: http://googleresearch. blogspot.com/2010/01/google-cluster-data.html.
16. J. Wilkes, More google cluster data, 2011. URL: http://googleresearch. blogspot.com/2011/11/more-google-cluster-data.html.
17. A. Sivasubramaniam, A. Singla, U. Ramachandran, and H. Venkateswaran On characterizing bandwidth requirements of parallel applications SIGMETRICS Performance Evaluation Review 23 1 1995 198 207 ACM
18. E. Papaefstathiou, D.J. Kerbyson, and G.R. Nudd A Layered Approach to Parallel Software Performance Prediction: A Case Study, Tech. Rep., Department of Computer Science, University of Warwick, Coventry, UK, Technical Report CS-RR-262 1994
19. B. Armstrong, and R. Eigenmann Performance Forecasting: Characterization of Applications on Current and Future Architectures, Purdue Univ. School of ECE, High-Performance Computing Lab, Technical Report ECE-HPCLab-97202 1997
20. B. Armstrong, and R. Eigenmann Performance forecasting: towards a methodology for characterizing large computational applications Proceedings. 1998 International Conference on Parallel Processing, 1998 1998 IEEE 518 525
21. J.M. Schopf, and F. Berman Performance prediction in production environments Parallel Processing Symposium, 1998. IPPS/SPDP 1998. Proceedings of the First Merged International and Symposium on Parallel and Distributed Processing 1998 1998 IEEE 647 653
22. L. Carrington, A. Snavely, X. Gao, N. Wolter, A performance prediction framework for scientific applications, Computational Science - ICCS 2003, 2003, pp. 701-701.
23. D.J. Kerbyson, H.J. Alme, A. Hoisie, F. Petrini, H.J. Wasserman, and M. Gittings Predictive performance and scalability modeling of a large-scale application Proceedings of the 2001 ACM/IEEE Conference on Supercomputing 2001 ACM pp. 37-37
24. P.A. Dinda, and D.R. O'Hallaron An evaluation of linear models for host load prediction Proceedings. The Eighth International Symposium on High Performance Distributed Computing, 1999 1999 IEEE 87 96
25. D. Andresen, T. Yang, O.H. Ibarra, and Ö Eǧecioǧlu Adaptive partitioning and scheduling for enhancing WWW application performance Journal of Parallel and Distributed Computing 49 1 1998 57 85 (Pubitemid 128343511)
26. M. Benaim, and J.-Y. Le Boudec A class of mean field interaction models for computer and communication systems Performance Evaluation 65 11 2008 823 838
27. T. Kurtz Strong approximation theorems for density dependent Markov chains Stochastic Processes and their Applications 6 1978 223 240
28. F. Cordero, D. Manini, and M. Gribaudo Modeling biological pathways: an object-oriented like methodology based on mean field analysis The Third International Conference on Advanced Engineering Computing and Applications in Sciences (ADVCOM) 2009 IEEE Computer Society Press 193 211
29. W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery Numerical Recipes in C: The Art of Scientific Computing second ed. 1992 Cambridge University Press New York, NY, USA