An analysis of failure-related energy waste in a large-scale cloud environment

IEEE Transactions on Emerging Topics in Computing

Volumn 2, Issue 2, 2014, Pages 166-180

  Garraghan, Peter ^a   Moreno, Ismael Solis ^a   Townend, Paul ^a   Xu, Jie ^a  

^a UNIVERSITY OF LEEDS   (United Kingdom)

Author keywords

Cloud computing; dependability; energy efficiency; failure analysis

Indexed keywords

CLOUD COMPUTING; ENERGY EFFICIENCY; ENERGY UTILIZATION; FAILURE ANALYSIS; GREEN COMPUTING; LARGE SCALE SYSTEMS; POWER MANAGEMENT;

CLOUD ENVIRONMENTS; COMPREHENSIVE ANALYSIS; DEPENDABILITY; ENERGY WASTES; ENVIRONMENTAL CHARACTERISTIC; FAILURE EVENTS; PRIORITY TASKS; TASK FAILURES;

FAILURE (MECHANICAL);

EID: 84930247783     PISSN: None     EISSN: 21686750     Source Type: Journal    
DOI: 10.1109/TETC.2014.2304500     Document Type: Article

References (38)

1. P. Mell and T. Grance, "NIST definition of Cloud computing," Nat. Inst. Stand. Technol., 2009.
2. A. L. Freitas, N. Parlavantzas, and J. Pazat, "Cost reduction through SLAdriven self-management," in Proc. 9th IEEE Eur. Conf. Web Services, Sep. 2011, pp. 117-124.
3. U. Hoelzle and L. A. Barroso, The Datacenter as a Computer: An Intro-duction to the Design of Warehouse-Scale Machines, 1st ed. San Rafael, CA, USA: Morgan and Claypool, 2009.
4. M. Pedram, "Energy-efficient datacenters," IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst., vol. 31, no. 10, pp. 1465-1484, Oct. 2012.
5. A. Gainaru, F. Cappello, M. Snir, and W. Kramer, "Fault prediction under the microscope: A closer look into HPC systems," in Proc. IEEE Intl. Conf. High Perform. Comput., Netw., Storage Anal., Nov. 2012, pp. 1-11.
6. T. Nguyen and W. Shi, "Improving resource efficiency in data centers using reputation-based resource selection," in Proc. IEEE Intl. Green Comput. Conf., Aug. 2010, pp. 389-396.
7. M. vor dem Berge, W. Christmann, E. Volk, S. Wesner, A. Oleksiak, T. Piontek, et al., "CoolEmAll-Models and tools for optimization of data center energy-efficiency," in Proc. Intl. Conf. Sustain. Internet ICT Sustainabil., Oct. 2012, pp. 1-5.
8. X. Fan, W. Weber, and L. A. Barroso, "Power provisioning for a warehouse-sized computer," ACM SIGARCH Comput. Archit. News, vol. 35, no. 2, pp. 13-23, Jul. 2007.
9. A. Beloglazov, J. Abawajy, and R. Buyya, "Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing," Future Generat. Comput. Syst., vol. 28, no. 5, pp. 755-768, May 2012.
10. J. S. Chase, D. C. Anderson, P. N. Thakar, A. M. Vahdat, and R. P. Doyle, "Managing energy and server resources in hosting centers," ACM SIGOPS Oper. Syst. Rev., vol. 35, no. 5, pp. 103-116, Dec. 2001.
11. T. Ropars, A. Guermouche, B. Uçar, E. Meneses, L. V. Kalé, and F. Cappello, "On the use of cluster-based partial message logging to improve fault tolerance for MPI HPC applications," in Proc. 17th Int. Conf. Parallel Process., 2011, pp. 567-578.
12. L. Yudan, R. Nassar, C. B. Leangsuksun, N. Naksinehaboon, M. Paun, and S. L. Scott, "An optimal checkpoint/restart model for a large scale high performance computing system," in Proc. IEEE IPDPS, Apr. 2008, pp. 1-9.
13. J.-A. Quiane-Ruiz, C. Pinkel, J. Schad, and J. Dittrich, "RAFTing MapReduce: Fast recovery on the RAFT," in Proc. IEEE 27th ICDE, Apr. 2011, pp. 589-600.
14. R. K. Sahoo, M. S. Squillante, A. Sivasubramaniam, and Y. Zhang, "Failure data analysis of a large-scale heterogeneous server environment," in Proc. IEEE Int. Conf. Depend. Syst. Netw., Jul. 2004, pp. 772-781.
15. B. Schroeder and G. A. Gibson, "A large-scale study of failures in highperformance computing systems," IEEE Trans. Depend. Secure Comput., vol. 7, no. 4, pp. 337-351, Oct. 2010.
16. M. Kalyanakrishnam, Z. Kalbarczyk, and R. Iyer, "Failure data analysis of a LAN of Windows NT based computers," in Proc. 18th IEEE Symp. Rel. Distrib. Syst., Oct. 1999, pp. 178-187.
17. D. Oppenheimer, A. Ganapathi, and D. A. Patterson, "Why do internet services fail, and what can be done about it?" in Proc. 4th USENIX Symp. Internet Technol. Syst., USENIX Assoc., vol. 4. 2003, pp. 1-15.
18. Y. Liang, Y. Zhang, M. Jette, A. Sivasubramaniam, and R. Sahoo, "Blue-Gene/L failure analysis and prediction models," in Proc. IEEE Int. Conf. DSN, Jun. 2006, pp. 425-434.
19. L. Hui, D. Groep, L. Wolters, and J. Templon, "Job failure analysis and its implications in a large-scale production grid," in Proc. 2nd IEEE Int. Conf. Sci. Grid Comput., Dec. 2006, p. 27.
20. Google. Mountain View, CA, USA, (2011). Google Cluster Data V2 [Online]. Available: http://code.google.com/p/googleclusterdata/wiki/ClusterData2011
21. C. Reiss, J. Wilkes, and J. Helleirstein, Google Cluster-Usage Traces: Format C Schema. Mountain View, CA, USA: Google Inc., 2011.
22. J. Dean and S. Ghemawat, "MapReduce: Simplified data processing on large clusters," Commun. ACM, vol. 51, no. 1, pp. 107-113, Jan. 2008.
23. A. Thusoo, J. S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, et al., "Hive: A warehousing solution over a map-reduce framework," in Proc. VLDB Endowment, vol. 2. 2009, pp. 1626-1629.
24. C. Reiss, A. Tumanov, G. R. Ganger, R. H. Katz, and M. A. Kozuch, "Heterogeneity and dynamicity of clouds at scale: Google trace analysis," in Proc. 3rd ACM Symp. Cloud Comput., 2012, pp. 1-7.
25. J. N. Gray, "A census of Tandem system availability between 1985 and 1990," IEEE Trans. Rel., vol. 39, no. 4, pp. 409-418, Oct. 1990.
26. D. Powell, Delta-4: A Generic Architecture for Dependable Distributed Computing. New York, NY, USA: Springer-Verlag, 1991.
27. Standard Performance Evaluation Corporation. Austin, TX, USA. (2012). SPECpower-ssj2008 Results [Online]. Available: http://www.spec.org/power-ssj2008/results/
28. R. Buyya, A. Beloglazov, and J. Abawajy, "Energy-efficient management of data center resources for cloud computing: A vision, architectural elements, and open challenges," in Proc. Int. Conf. PDPTA, Jul. 2010, pp. 1-12.
29. D. Tsirogiannis, S. Harizopoulos, and M. A. Shah, "Analyzing the energy efficiency of a database server," in Proc. ACM SIGMOD Int. Conf. Manag. Data, 2010, pp. 231-242.
30. S. Rivoire, P. Ranganathan, and C. Kozyrakis, "A comparison of high-level full-system power models," in Proc. Conf. Power Aware Comput. Syst., 2008, pp. 1-3.
31. D. Tang, R. K. Iyer, and S. S. Subramani, "Failure analysis and modeling of a VAXcluster system," in Proc. 20th Int. Symp. FTCS, Jun. 1990, pp. 244-251.
32. M. M. Diouri, O. Gluck, L. Lefevre, and F. Cappello, "Energy considerations in checkpointing and fault tolerance protocols," in Proc. IEEE/IFIP 42nd DSNW, Jun. 2012, pp. 1-6.
33. E. Meneses, O. Sarood, and L. V. Kale, "Assessing energy efficiency of fault tolerance protocols for HPC systems," in Proc. IEEE Int. Symp. Comput. Archit. High Perform. Comput., 2012, pp. 35-42.
34. S. Kavulya, J. Tan, R. Gandhi, and P. Narasimhan, "An analysis of traces from a production MapReduce cluster," in Proc. 10th IEEE/ACMInt. Conf. Cluster, Cloud Grid Comput., May 2010, pp. 94-103.
35. S. Fu, "Failure-aware resource management for high-availability computing clusters with distributed virtual machines," J. Parallel Distrib. Comput., vol. 70, no. 4, pp. 384-393, Apr. 2010.
36. B. Javadi, J. Abawajy, and R. Buyya, "Failure-aware resource provisioning for hybrid Cloud infrastructure," J. Parallel Distrib. Comput., vol. 72, no. 10, pp. 1318-1331, Oct. 2012.
37. I. S. Moreno, P. Garraghan, P. Townend, and J. Xu, "An approach for characterizing workloads in Google Cloud to derive realistic resource utilization models," in Proc. IEEE 7th Int. Symp. SOSE, Mar. 2013, pp. 49-60.
38. X. Lu, H. Wang, J. Wang, J. Xu, and D. Li, "Internet-based virtual computing environment: Beyond the data center as a computer," J. Future Generat. Comput. Syst., vol. 29, no. 1, pp. 309-322, Jan. 2013.