Modeling and Simulation in Performance Optimization of Big Data Processing Frameworks

IEEE Cloud Computing

Volumn 1, Issue 4, 2014, Pages 14-19

  Ranjan, Rajiv ^a  

^a CSIRO   (Australia)

Author keywords

benchmarks; big data; cloud; processing framework; simulation

Indexed keywords

BENCHMARKING; BIG DATA; CLOUDS; INFORMATION MANAGEMENT; LARGE DATASET;

BIG DATA APPLICATIONS; COMPLEX DATASETS; MANAGEMENT APPLICATIONS; MODEL AND SIMULATION; PERFORMANCE OPTIMIZATIONS; RESOURCE CONFIGURATIONS; SCHEDULING POLICIES; SIMULATION;

DATA HANDLING;

EID: 84925071433     PISSN: None     EISSN: 23256095     Source Type: Trade Journal    
DOI: 10.1109/MCC.2014.84     Document Type: Review

References (35)

1. J. Heinzelman and K. Baptista, "Effective Disaster Response Needs Integrated Messaging," SciDevNet, 16 Nov. 2012; www.scidev.net/en/new-technologies/icts/opinions/effective-disaster-response-needs-integrated-messaging.html.
2. X. Wu et al., "Data Mining with Big Data," IEEE Trans. Knowledge and Data Eng., vol. 26, no. 1, 2014, pp. 97-107.
3. Z. Deng et al., "Parallel Processing of Dynamic Continuous Queries over Streaming Data Flows," IEEE Trans. Parallel and Distributed Systems, preprint, doi:10.1109/TPDS.2014.2311811.
4. W. Fan and A. Bifet, "Mining Big Data: Current Status, and Forecast to the Future," SIGKDD Explorations Newsletter, vol. 14, no. 2, 2013, pp. 1-5.
5. R. Ranjan, "Streaming Big Data Processing in Datacenter Clouds," IEEE Cloud Computing, vol.1, no.1, 2014, pp. 78-83.
6. L. Wang et al., eds., Cloud Computing: Methodology, System, and Applications, CRC Press, Taylor & Francis, 2011.
7. F. Chang et al., "Bigtable: A Distributed Storage System for Structured Data," ACM Trans. Computer Systems, vol. 26, no. 2, 2008, article 4.
8. Y. Low et al., "Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud," Proc. VLDB Endowment, vol. 5, no. 8, 2012, pp. 716-727.
9. th Biennial Conf. Innovative Data Systems Research (CIDR 13), 2013.
10. th Ann. Symp. Cloud Computing (SOCC 13), 2013, article 5.
11. th ACM European Conf. Computer Systems (EuroSys 13), 2013, pp. 351-364.
12. th USENIX Conf. Networked Systems Design and Implementation (NSDI 11), 2011, pp. 295-308.
13. th Int'l Conf. Very Large Data Bases (VLDB 14), 2014, pp. 1665-1668.
14. th Int'l Conf. Very Large Data Bases (VLDB 14), 2014.
15. A. Simitsis et al., "Optimizing Analytic Data Flows for Multiple Execution Engines," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD 12), 2012, pp. 829-840.
16. R. Buyya and M. Murshed, "Grid-Sim: A Toolkit for the Modeling and Simulation of Distributed Resource Management and Scheduling for Grid Computing," J. Concurrency and Computation: Practice and Experience, vol. 14, nos. 13-15, 2002, pp. 1175-1220.
17. H.J. Song et al., "The MicroGrid: A Scientific Tool for Modeling Computational Grids," Proc. ACM/IEEE Conf. Supercomputing (SC 00), 2000, article 53.
18. th IEEE Int'l Symp. Cluster Computing and the Grid (CCGrid 05), vol. 2, 2005, pp. 1151-1158.
19. st Int'l Symp. Cluster Computing and the Grid (CCGRID 01), 2001, pp. 430-437.
20. rd Int'l Workshop Grid Computing (GRID 02), 2002, pp. 46-57.
21. th Int'l Conf. Software Eng. and Middleware (SEM 04), 2004, pp. 123-136.
22. R. Ranjan, A. Harwood, and R. Buyya, "Coordinated Load Management in Peer-to-Peer Coupled Federated Grid Systems," J. Supercomputing, vol. 61, no. 2, 2012, pp. 292-316.
23. K. Stamos et al., "CDNsim: A Simulation Tool for Content Distribution Networks," ACM Trans. Modelling and Computer Simulation, vol. 20, no. 2, 2010, article 10.
24. D. Kliazovich et al., "GreenCloud: A Packet-Level Simulator of Energy-Aware Cloud Computing Data Centers," Proc. Global Telecomm. Conf. (GLOBECOM 10), 2010, pp. 1-5.
25. S.H. Lim et al., "MDCSim: A Multi-Tier Data Center Simulation, Platform," Proc. IEEE Int'l Conf. Cluster Computing and Workshops, 2009, pp. 1-9.
26. th Int'l Conf. Autonomic and Trusted Computing (UIC-ATC 12), 2012, pp. 900-905.
27. R.N. Calheiros et al., "CloudSim: A Toolkit for the Modeling and Simulation of Cloud Resource Management and Application Provisioning Techniques," J. Software: Practice and Experience, vol. 41, no. 1, 2011, pp. 23-50.
28. A. Medina et al., "BRITE: An Approach to Universal Topology Generation," Proc. Int'l Workshop on Modeling, Analysis and Simulation of Computer and Telecomm. Systems (MASCOTS 01), 2001, pp. 346-353.
29. J. Jung and H Kim, "MR-CloudSim: Designing and Implementing MapReduce Computing Model on CloudSim," Proc. Int'l Conf. ICT Convergence (ICTC 12), 2012, pp. 504-509.
30. th Int'l Workshop Maintenance and Evolution of Service-Oriented and Cloud-Based Systems (MESOCA 12), 2012, pp. 37-46.
31. S. Frey, W. Hasselbring, and B. Schnoor, "Automatic Conformance Checking for Migrating Software Systems to Cloud Infrastructures and Platforms," J. Software Maintenance and Evolution: Research and Practice, vol. 25, no. 10, 2012, pp. 1089-1115.
32. th IEEE Int'l Symp. High-Performance Computer Architecture (HPCA 14), 2014, pp. 488-499.
33. A. Ghazal, "BigBench: Towards an Industry Standard Benchmark for Big Data Analytics," Proc. 2013 ACM SIGMOD Int'l Conf. Management of Data (SIGMOD 13), 2013, pp. 1197-1208.
34. th Int'l Conf. Data Eng. Workshops (ICDEW 10), 2010, pp. 41-51.
35. M. Ferdman et al., "Clearing the Clouds: A Study of Emerging Scale-out Workloads on Modern Hardware," SIGARCH Computer Architecture News, vol. 40, no. 1, 2012, pp. 37-48.