System resource utilization analysis and prediction for cloud based applications under bursty workloads

Information Sciences

Volumn 279, Issue , 2014, Pages 338-357

  Yin, Jianwei ^a   Lu, Xingjian ^a   Chen, Hanwei ^a   Zhao, Xinkui ^a   Xiong, Neal N ^b,c  

^a ZHEJIANG UNIVERSITY   (China)

^b JIANGXI UNIVERSITY OF FINANCE AND ECONOMICS   (China)

^c School of Computer Science Colorado Technical University ^*  (United States)

Author keywords

Burstiness; Fined grained prediction; Index of dispersion for count; Workload generation

Indexed keywords

DISPERSIONS; EXPERIMENTS; MARKOV PROCESSES; PROBABILITY DENSITY FUNCTION; VIRTUAL REALITY;

BURSTINESS; CLOUD-BASED APPLICATIONS; INDEX OF DISPERSION FOR COUNTS; MARKOVIAN ARRIVAL PROCESS; PERFORMANCE OPTIMIZATIONS; SYSTEM RESOURCE UTILIZATION; WORKLOAD CHARACTERISTICS; WORKLOAD GENERATION;

FORECASTING;

EID: 84901828848     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2014.03.123     Document Type: Article

References (41)

1. A. Ali-Eldin, M. Kihl, J. Tordsson, E. Elmroth, Efficient provisioning of bursty scientific workloads on the cloud using adaptive elasticity control, in: Proceedings of the 3rd Workshop on Scientific Cloud Computing Date, ACM, 2012, pp. 31-40.
2. P. Barford, and M. Crovella Generating representative web workloads for network and server performance evaluation SIGMETRICS Perform. Eval. Rev. 26 1998 151 160
3. I. Boutsis, V. Kalogeraki, Radar: adaptive rate allocation in distributed stream processing systems under bursty workloads, in: IEEE 31st Symposium on Reliable Distributed Systems (SRDS), IEEE, 2012, pp. 285-290.
4. G. Casale, N. Mi, L. Cherkasova, and E. Smirni How to parameterize models with bursty workloads ACM SIGMETRICS Perform. Eval. Rev. 36 2008 38 44
5. G. Casale, N. Mi, and E. Smirni Model-driven system capacity planning under workload burstiness IEEE Trans. Comput. 59 2010 66 80
6. M.E. Crovella, and A. Bestavros Self-similarity in world wide web traffic: evidence and possible causes IEEE/ACM Trans. Netw. 5 1997 835 846
7. R.P. Doyle, J.S. Chase, O.M. Asad, W. Jin, A. Vahdat, Model-based resource provisioning in a web service utility, in: USENIX Symposium on Internet Technologies and Systems, vol. 4, 2003, pp. 5-5.
8. J. Duggan, Y. Chi, H. Hacigumus, S. Zhu, U. Cetintemel, Packing light: portable workload performance prediction for the cloud, in: IEEE 29th International Conference on Data Engineering Workshops (ICDEW), IEEE, 2013, pp. 258-265.
9. A.E. Eckberg, Approximations for bursty (and smoothed) arrival queueing delays based on generalized peakedness, in: Proceedings of the 11th International Teletraffic Congress, 1985, pp. 331-335.
10. A. Erramilli, O. Narayan, and W. Willinger Experimental queueing analysis with long-range dependent packet traffic IEEE/ACM Trans. Netw. (TON) 4 1996 209 223
11. A. Ganapathi, H. Kuno, U. Dayal, J.L. Wiener, A. Fox, M. Jordan, D. Patterson, Predicting multiple metrics for queries: better decisions enabled by machine learning, in: IEEE 25th International Conference on Data Engineering, ICDE'09, IEEE, 2009, pp. 592-603.
12. G.R. Ganger, and Y.N. Patt Using system-level models to evaluate i/o subsystem designs IEEE Trans. Comput. 47 1998 667 678
13. K. Gilly, C. Juiz, N. Thomas, and R. Puigjaner Adaptive admission control algorithm in a QoS-aware web system Inf. Sci. 199 2012 58 77
14. R. Gusella Characterizing the variability of arrival processes with indices of dispersion IEEE J. Sel. Areas Commun. 9 1990 203 211
15. R. Hashemian, D. Krishnamurthy, and M. Arlitt Web workload generation challenges-an empirical investigation Softw.: Pract. Exper. 42 2012 629 647
16. C.H. Hsu, K.D. Slagter, S.C. Chen, and Y.C. Chung Optimizing energy consumption with task consolidation in clouds Inf. Sci. 258 2014 452 462
17. K. Kant, V. Tewari, R. Iyer, Geist: Generator of e-commerce and internet server traffic, in: Proc. of Int. Symposium on Performance Analysis of Systems and Software, 2001.
18. W.I. Kao, R.K. Iyer, A user-oriented synthetic workload generator, in: Proceedings of the 12th International Conference on Distributed Computing Systems, IEEE, 1992, pp. 270-277.
19. H. Khazaei, J. Misic, and V.B. Misic Performance analysis of cloud computing centers using m/g/m/m+ r queuing systems IEEE Trans. Parall. Distrib. Syst. 23 2012 936 943
20. D. Krishnamurthy, J.A. Rolia, and S. Majumdar A synthetic workload generation technique for stress testing session-based systems IEEE Trans. Softw. Eng. 32 2006 868 882
21. G. Lee, Resource Allocation and Scheduling in Heterogeneous Cloud Environments, Ph.D. Thesis, University of California, Berkeley, 2012.
22. W.E. Leland, M.S. Taqqu, W. Willinger, and D.V. Wilson On the self-similar nature of ethernet traffic (extended version) IEEE/ACM Trans. Netw. 2 1994 1 15
23. H. Li, and M. Muskulus Analysis and modeling of job arrivals in a production grid SIGMETRICS Perform. Eval. Rev. 34 2007 59 70
24. N. Mi, G. Casale, L. Cherkasova, and E. Smirni Injecting realistic burstiness to a traditional client-server benchmark Proceedings of the 6th International Conference on Autonomic Computing 2009 ACM New York, NY, USA 149 158
25. N. Mi, Q. Zhang, A. Riska, E. Smirni, and E. Riedel Performance impacts of autocorrelated flows in multi-tiered systems Perform. Eval. 64 2007 1082 1101
26. K. Morton, M. Balazinska, D. Grossman, ParaTimer: a progress indicator for MapReduce DAGs, in: Proceedings of the 2010 ACM SIGMOD International Conference on Management of data, ACM, 2010, pp. 507-518.
27. D. Mosberger, and T. Jin httperf: a tool for measuring web server performance SIGMETRICS Perform. Eval. Rev. 26 1998 31 37
28. J. Napper, P. Bientinesi, Can cloud computing reach the top500?, in: Proceedings of the Combined Workshops on UnConventional high Performance Computing Workshop Plus Memory Access Workshop, ACM, 2009, pp. 17-20.
29. A. Riska, E. Riedel, Disk drive level workload characterization, in: Proceedings of the Annual Conference on USENIX '06 Annual Technical Conference, USENIX Association, Berkeley, CA, USA, 2006, pp. 9-9.
30. I. Shafer, K. Ren, V.N. Boddeti, Y. Abe, G.R. Ganger, C. Faloutsos, Rainmon: an integrated approach to mining bursty timeseries monitoring data, in: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, 2012, pp. 1158-1166.
31. K. Shen, M. Zhong, C. Li, I/o system performance debugging using model-driven anomaly characterization, in: FAST, vol. 5, 2005, pp. 23-23.
32. W. Sobel, S. Subramanyam, A. Sucharitakul, J. Nguyen, H. Wong, A. Klepchukov, S. Patil, A. Fox, D. Patterson, Cloudstone: Multi-platform, multi-language benchmark and measurement tools for web 2.0, in: Proc. of CCA, 2008.
33. J. Tai, J. Zhang, J. Li, W. Meleis, N. Mi, Ara: Adaptive resource allocation for cloud computing environments under bursty workloads, in: 30th IEEE International Performance Computing and Communications Conference (IPCCC), 2011, pp. 1-8.
34. C.A. Thekkath, J. Wilkes, and E.D. Lazowska Techniques for file system simulation Softw.: Pract. Exper. 24 1994 981 999
35. M. Uysal, G.A. Alvarez, A. Merchant, A modular, analytical throughput model for modern disk arrays, in: Proceedings Ninth International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, IEEE, 2001, pp. 183-192.
36. A. Verma, L. Cherkasova, and R.H. Campbell SLO-driven right-sizing and resource provisioning of MapReduce jobs Proc. LADIS 11 2011
37. A. Verma, G. Dasgupta, T.K. Nayak, P. De, R. Kothari, Server workload analysis for power minimization using consolidation, in: Proceedings of the 2009 Conference on USENIX Annual Technical Conference, USENIX Association, 2009, pp. 28-28.
38. M. Wang, A. Ailamaki, and C. Faloutsos Capturing the spatio-temporal behavior of real traffic data Perform. Eval. 49 2002 147 163
39. Y. Wu, G. Min, K. Li, and B. Javadi Modeling and analysis of communication networks in multicluster systems under spatio-temporal bursty traffic IEEE Trans. Parall. Distrib. Syst. 23 2012 902 912
40. W. Xiong, H. Hu, N. Xiong, L.T. Yang, W.C. Peng, X. Wang, and Y. Qu Anomaly secure detection methods by analyzing dynamic characteristics of the network traffic in cloud communications Inf. Sci. 2013
41. A. Youssef, D. Krishnamurthy, Cloud service level planning under burstiness, in: International Symposium on Performance Evaluation of Computer and Telecommunication Systems (SPECTS), 2013, IEEE, pp. 107-114.