The case for limping-hardware tolerant clouds

5th USENIX Workshop on Hot Topics in Cloud Computing, HotCloud 2013

Volumn , Issue , 2013, Pages

  Do, Thanh ^a   Gunawi, Haryadi S ^b  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLOUD COMPUTING;

HARDWARE FAILURES; LARGE-SCALE DISTRIBUTED SYSTEM; PERFORMANCE VARIABILITY; SCALE MANAGEMENT; SOFTWARE BUG;

PROGRAM DEBUGGING;

EID: 85084163151     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (42)

1. http://forum.hddguru.com/search.php?keywords=weak-head.
2. Emulab Network Emulation Testbed. http://www.emulab.net.
3. Cassandra-1358: Clogged RRS/RMS stages.
4. Cassandra-3853: Lower impact of slow nodes.
5. Cassandra-488: Tcp Manager only has one connection.
6. Hadoop-1984: Some reducer stuck at copy phase.
7. Hadoop-4584: Slow generation of blockReport.
8. HBase-4863: Make server thread pool bounded.
9. HDFS-1203: Sleep before reentering after exception.
10. HDFS-3032: Lease renewer tries forever.
11. HDFS-599: Prioritize heartbeats over client requests.
12. ZooKeeper-880: Send Worker grows without bounds.
13. High Disk Latency. http://communities.vmware. com, 2011.
14. Personal Communication from Dhruba Borthakur of Facebook, 2011.
15. Personal Communication from Andrew Baptist of Cleversafe, 2013.
16. Personal Communication from Kevin Harms of Argonne National Laboratory, 2013.
17. Personal Communication from Mike Kasick of CMU, 2013.
18. Ganesh Ananthanarayanan, Srikanth Kandula, Albert Greenberg, Ion Stoica, Yi Lu, Bikas Saha, and Edward Harris. Reining in the Outliers in Map-Reduce Clusters using Mantri. In Proceedings of the 9th Symposium on Operating Systems Design and Implementation (OSDI), 2010.
19. Remzi H. Arpaci-Dusseau and Andrea C. Arpaci-Dusseau. Fail-Stutter Fault Tolerance. In The Eighth Workshop on Hot Topics in Operating Systems (HotOS VIII), 2001.
20. Mona Attariyan, Michael Chow, and Jason Flinn. X-ray: Automating Root-Cause Diagnosis of Performance Anomalies in Production Software. In Proceedings of the 10th Symposium on Operating Systems Design and Implementation (OSDI), 2012.
21. Shekhar Borkar. Designing Reliable Systems from Unreliable Components: The Challenges of Transistor Variability and Degradation. IEEE Micro, 2005.
22. Jeffrey Dean and Sanjay Ghemawat. Mapreduce: Simplified data processing on large clusters. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI), 2004.
23. Erik Eckel. 10 tips for troubleshooting slowdowns in small business networks. http://www.techrepublic. com, 2007.
24. Michael Feldman. Startup Takes Aim at Performance-Killing Vibration in Datacenter. http://www.hpcwire.com, 2010.
25. Ajay Gulati, Irfan Ahmad, and Carl A. Waldspurger. PARDA: Proportional Allocation of Resources for Distributed Storage Access. In Proceedings of the 7th USENIX Symposium on File and Storage Technologies (FAST), 2009.
26. Ajay Gulati, Ganesha Shanmuganathan, Irfan Ahmad, Carl A. Waldspurger, and Mustafa Uysal. Pesto: Online Storage Performance Management in Virtualized Datacenters. In Proceedings of the 2nd ACM Symposium on Cloud Computing (SoCC), 2011.
27. Sangjin Han, Scott Marshall, Byung-Gon Chun, and Sylvia Ratnasamy. MegaPipe: A New Programming Interface for Scalable Network I/O. In Proceedings of the 10th Symposium on Operating Systems Design and Implementation (OSDI), 2012.
28. Robin Harris. Bad, bad, bad vibrations. http://www.zdnet.com, 2010.
29. Guoliang Jin, Linhai Song, Xiaoming Shi, Joel Scherpelz, and Shan Lu. Understanding and Detecting Real-World Performance Bugs. In Proceedings of the ACM SIGPLAN 2012 Conference on Programming Language Design and Implementation (PLDI), 2012.
30. Michael P. Kasick, Jiaqi Tan, Rajeev Gandhi, and Priya Narasimhan. Black-Box Problem Diagnosis in Parallel File Systems. In Proceedings of the 8th USENIX Symposium on File and Storage Technologies (FAST), 2010.
31. David A. Koufaty, Dheeraj Reddy, and Scott Hahn. Bias scheudling in heterogeneous multi-core architectures. In Proceedings of the 2010 EuroSys Conference (EuroSys), 2010.
32. Jiang Lin, Hongzhong Zheng, Zhichun Zhu, Eugene Gorbatov, Howard David, and Zhao Zhang. Software Thermal Management of DRAM Memory for Multicore Systems. In Proceedings of the 2008 ACM International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS), 2008.
33. Eduardo Pinheiro, Wolf-Dietrich Weber, and Luiz Andre Barroso. Failure Trends in a Large Disk Drive Population. In Proceedings of the 5th USENIX Symposium on File and Storage Technologies (FAST), 2007.
34. Raja R. Sambasivan, Alice X. Zheng, Michael De Rosa, Elie Krevat, Spencer Whitman, Michael Stroucken, William Wang, Lianghong Xu, and Gregory R. Ganger. Diagnosing Performance Changes by Comparing Request Flows. In Proceedings of the 8th Symposium on Networked Systems Design and Implementation (NSDI), 2011.
35. Anand Lal Shimpi. Intel Discovers Bug in 6-Series Chipset: Our Analysis. http://www.anandtech.com, 2011.
36. David Shue, Michael J. Freedman, and Anees Shaikh. Performance Isolation and Fairness for Multi-Tenant Cloud Storage. In Proceedings of the 10th Symposium on Operating Systems Design and Implementation (OSDI), 2012.
37. Brian Van Straalen and Phil Collela. Resiliency and codesign. In DOE Exascale Research Conference, 2012. http://tinyurl.com/9wmq4cz.
38. Kashi Vishwanath and Nachi Nagappan. Characterizing Cloud Computing Hardware Reliability. In Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC), 2010.
39. Andrew Wang, Shivaram Venkataraman, Sara Alspaugh, Randy Katz, and Ion Stoica. Cake: Enabling High-level SLOs on Shared Storage Systems. In Proceedings of the 3rd ACM Symposium on Cloud Computing (SoCC), 2012.
40. Haitao Wu, Zhenqian Feng, Chuanxiong Guo, and Yongguang Zhang. ICTCP: Incast Congestion Control for TCP. In The 6th International Conference on emerging Networking EXperiments and Technologies (CoNEXT), 2010.
41. Matei Zaharia, Andy Konwinski, Anthony D. Joseph, Randy Katz, and Ion Stoica. Improving MapReduce Performance in Heterogeneous Environments. In Proceedings of the 8th Symposium on Operating Systems Design and Implementation (OSDI), 2008.
42. Tao Zou, Guozhang Wang, Marcos Vaz Salles, David Bindel, Alan Demers, Johannes Gehrke, and Walker White. Making Time-stepped Applications Tick in the Cloud. In Proceedings of the 2nd ACM Symposium on Cloud Computing (SoCC), 2011.