Straggler Root-Cause and Impact Analysis for Massive-scale Virtualized Cloud Datacenters

IEEE Transactions on Services Computing

Volumn 12, Issue 1, 2019, Pages 91-104

  Garraghan, Peter ^a   Ouyang, Xue ^b   Yang, Renyu ^c   McKee, David ^b   Xu, Jie ^b  

^a LANCASTER UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF LEEDS   (United Kingdom)

^c BEIHANG UNIVERSITY   (China)

Author keywords

cloud; datacenter; distributed systems; root cause analysis; Straggler

Indexed keywords

CLOUDS; COMPUTER APPLICATIONS;

DATACENTER; DISTRIBUTED SYSTEMS; EMERGENT PHENOMENON; EMPIRICAL ANALYSIS; IN-DEPTH KNOWLEDGE; LARGE SCALE PRODUCTIONS; ROOT CAUSE ANALYSIS; STRAGGLER;

BATCH DATA PROCESSING;

EID: 85052535325     PISSN: None     EISSN: 19391374     Source Type: Journal    
DOI: 10.1109/TSC.2016.2611578     Document Type: Article

References (36)

1. J. Dean and S. Ghemawat, "MapReduce: Simplified data processing on large clusters," Commun. ACM, vol. 51, no. 1, pp. 107-113, 2008.
2. M. Isard, M. Mihai, Y. Yu, A. Birrell, and D. Fetterly, "Dryad: Distributed data-parallel programs from sequential building blocks," ACM SIGOPS Operating Syst. Rev., vol. 41, no. 3, pp. 59-72, 2007.
3. M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, and I. Stoica. "Spark: Cluster computing with working sets," USENIX Conf. Hot Top. Cloud Comput., vol. 10, pp. 10-10, 2010.
4. M. Zaharia, A. Konwinski, A. D. Joseph, R. H. Katz, and I. Stoica, "Improving MapReduce performance in heterogeneous environments," in Proc. 8th USENIX Conf. Operating Syst. Des. Implementation, 2008, p. 29-42.
5. M. García-Valls, T. Cucinotta, and C. Lu, "Challenges in real-time virtualization and predictable cloud computing," J. Syst. Archit., no. 9, pp. 726-740, 2014.
6. J. Dean and L. A. Barroso, "The tail at scale," Commun. ACM, vol. 56, no. 2, pp. 74-80, 2013.
7. S. Huang, T. Huang, S. Lyu, C. Shieh, and Y. Chou, "Improving speculative execution performancewith coworker for cloud computing," in Proc. IEEE Int. Conf. Parallel Distrib. Syst., 2011, pp. 1004-1009.
8. G. Ananthanarayanan, A. Ghodsi, S. Shenker, and I. Stoica, "Effective straggler mitigation: Attack of the clones," in Proc. 10th USENIX Conf. Netw. Syst. Des. Implementation, 2013, vol. 13, pp. 185-198.
9. G. Ananthanarayanan, et al., "Reining in the outliers in mapreduce clusters using Mantri," in Proc. 9th USENIX Symp. Operating Syst. Des. Implementation, 2010, vol. 10, no. 1, Art. no. 24.
10. Q. Chen, C. Liu, and Z. Xiao, "Improving mapreduce performance using smart speculative execution strategy," IEEE Trans. Comput., vol. 63, no. 4, pp. 954-967, Apr. 2014.
11. I. S. Moreno, P. Garraghan, P. Townend, and J. Xu. "An approach for characterizing workloads in google cloud to derive realistic resource utilization models," in Proc. IEEE Int. Symp. Serv.-Oriented Syst. Eng., 2013, pp. 49-60.
12. E. Bortnikov, A. Frank, E. Hillel, and S. Rao, "Predicting execution bottlenecks in map-reduce clusters," in Proc. USENIX Conf. Hot Top. Cloud Comput., 2012, pp. 18-18.
13. K. Wang, B. Tan, J. Shi, and B. Yang, "Automatic task slots assignment in hadoop mapreduce," in Proc. ACM Workshop Archit. Syst. Big Data, 2011, pp. 24-29.
14. Q. Chen, D. Zhang, M. Guo, Q. Deng, and S. Guo, "SAMR: A selfadaptive mapreduce scheduling algorithm in heterogeneous environment," in Proc. IEEE Int. Conf. Comput. Inf. Technol., 2010, pp. 2736-2743.
15. N. Yadwadkar, G. Ananthanarayanan, and R. Katz, "Wrangler: Predictable and faster jobs using fewer resources," in Proc. ACM Symp. Cloud Comput., 2014, pp. 1-14.
16. J. Li, N. K. Sharma, D. Ports, and S. Gribble, "Tales of the tail: Hardware, OS, and application-level sources of tail latency," in Proc. ACM Symp. Cloud Comput., 2014, pp. 1-14.
17. Y. Kwon, M. Balazinska, B. Howe, and J. Rolia, "A study of skew in mapreduce applications," Open Cirrus Summit, 2011.
18. Y. Kwon, M. Balazinska, B. Howe, and J. Rolia, "Skewtune: Mitigating skew in mapreduce applications," in Proc. ACM SIGMOD Int. Conf. Manage. Data, 2012, pp. 25-36.
19. J. Rosen and B. Zhao, "Fine-grained micro-tasks for MapReduce skew-handling," White Paper, Univ. Berkeley, 2012.
20. J. Lin, "The curse of Zipf and limits to parallelization: A look at the stragglers problem in mapreduce," in Proc. Workshop Large-Scale Distrib. Syst. Inf. Retrieval, 2009, vol. 1, pp. 57-62.
21. P. Patel, A. H. Ranabahu, and A. P. Sheth, "Service level agreement in cloud computing," in Proc. Cloud Workshops OOPSLA, 2009.
22. P. Garraghan, X. Ouyang, P. Townend, and J. Xu. "Timely long tail identification through agent based monitoring and analytics," in Proc. Int. Symp. Real-Time Distrib. Comput., 2015, pp. 19-26.
23. C. Lin, W. Guo, and C. Lin, "Self-learning MapReduce scheduler in multi-job environment," in Proc. IEEE Int. Conf. Cloud Comput. Big Data, 2013, pp. 610-612.
24. N. J. Yadwadkar and W. Choi, "Proactive straggler avoidance using machine learning," White paper, Univ. Berkeley, Berkeley, CA, USA, 2012.
25. Google, "Google cluster dataV2," (2011). [Online]. Available: http://code.google.com/p/googleclusterdata/wiki/ClusterData2011-1
26. C. Reiss, J. Wilkes, and J. L. Hellerstein, "Google cluster-usage traces: format+ schema," Google Inc., Tech. Rep., 2011.
27. Tsar tools, (2012). [Online]. Available: https://github.com/alibaba/tsar/
28. Nagios, (2009). [Online]. Available: https://www.nagios.org/
29. I. S. Moreno, P. Garraghan, P. Townend, J. Xu, "Analysis, modeling and simulation of workload patterns in a large-scale utility cloud," IEEE Trans. Cloud Comput., vol. 2, no. 2, pp. 208-221, Apr.-Jun. 2014.
30. A. Thusoo, et al., "Hive: A warehousing solution over a mapreduce framework," in Proc. VLDB Endowment, 2009, pp. 1626-1629.
31. A. Avizienis, J. C. Laprie, B. Randell, and C. Landwehr, "Basic concepts and taxonomy of dependable and secure computing," IEEE Trans. Dependable Secure Comput., vol. 1, no. 1, pp. 11-33, Jan. 2004.
32. Z. Zheng, T. Zhou, M. Lyu, and I. King, "FTCloud: A component ranking framework for fault-tolerant cloud applications," in Proc. IEEE 21st Int. Symp. Softw. Rel. Eng., 2010, pp. 398-407.
33. Y. Dai, B. Yang, J. Dongorra, and G. Zhang, "Cloud service reliability: Modelling and analysis," in Proc. IEEE Pacific Rim Int. Symp. Dependable Comput., 2009, pp. 1-17.
34. X. Ouyang, P. Garraghan, D. Mckee, P. Townend, and J. Xu, "Straggler detection in parallel computing systems through dynamic threshold calculation," in Proc. IEEE Int. Conf. Adv. Inf. Netw. Appl., 2016, pp. 414-421.
35. Y. Zhang, C. G. Guo, D. Li, R. Chu, H. Wu, and Y. Xiong, "CubicRing: Enabling one-hop failure detection and recovery for distributed in-memory storage systems," in Proc. USENIX Symp. Netw. Syst. Des. Implementation, pp. 529-542, 2015.
36. P. Garraghan, D. Mckee, X. Ouyang, D. Webster, and J. Xu, "SEED: A scalable approach for cyber-physical system simulation," IEEE Trans. Serv. Comput., vol. 9, no. 2, pp. 118-123, Mar./Apr. 2016.