Limplock: Understanding the impact of limpware on scale-out cloud systems

Proceedings of the 4th Annual Symposium on Cloud Computing, SoCC 2013

Volumn , Issue , 2013, Pages

  Do, Thanh ^b   Hao, Mingzhe ^a   Leesatapornwongsa, Tanakorn ^a   Patanaanake, Tiratat ^a   Gunawi, Haryadi S ^a  

^a UNIVERSITY OF CHICAGO   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER PROGRAMMING; COMPUTER SCIENCE;

CASSANDRAS; CLOUD SYSTEMS; DATA INTENSIVE; DISTRIBUTED OPERATIONS; LARGE SCALE PRODUCTIONS; PERFORMANCE FAILURE; SCALE OUTS; SYSTEM LEVELS;

CLOUD COMPUTING;

EID: 84893221722     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2523616.2523627     Document Type: Conference Paper

References (54)

1. Emulab Testbed. http://www.emulab.net.
2. HBase User Mailing List. http://tinyurl.com/kwdsrwx.
3. SWIM: Statistical Workload Injector for MapReduce. https://github.com/ SWIMProjectUCB/SWIM/wiki.
4. Tcp Manager only ever has one connection. http://tinyurl.com/n2vy5qw.
5. UCARE LigHTS project: Limpware Tolerant Systems. http://ucare.cs. uchicago.edu/projects/lights.
6. Weak Head. http://tinyurl.com/m26gx37.
7. Message 1800544: High Latency. http://tinyurl.com/bdwkqsp, 2011.
8. Personal Comm. from Dhruba Borthakur of Facebook, 2011.
9. Personal Comm. from Andrew Baptist of Cleversafe, 2013.
10. Personal Comm. from Kevin Harms of ANL, 2013.
11. Personal Comm. from Mike Kasick of CMU, 2013.
12. Ganesh Ananthanarayanan, Ali Ghodsi, Scott Shenker, and Ion Stoica. Effective straggler mitigation: attack of the clones. In Proceedings of the 10th Symposium on Networked Systems Design and Implementation (NSDI), 2013.
13. Ganesh Ananthanarayanan, Srikanth Kandula, Albert Greenberg, Ion Stoica, Yi Lu, Bikas Saha, and Edward Harris. Reining in the Outliers in Map-Reduce Clusters using Mantri. In Proceedings of the 9th Symposium on Operating Systems Design and Implementation (OSDI), 2010.
14. Remzi H. Arpaci-Dusseau. Run-Time Adaptation in River. ACM Transactions on Computer Systems (TOCS), 21(1): 36-86, February 2003.
15. Mona Attariyan, Michael Chow, and Jason Flinn. X-ray: Automating Root-Cause Diagnosis of Performance Anomalies in Production Software. In Proceedings of the 10th Symposium on Operating Systems Design and Implementation (OSDI), 2012.
16. Lakshmi N. Bairavasundaram, Garth R. Goodson, Shankar Pasupathy, and Jiri Schindler. An Analysis of Latent Sector Errors in Disk Drives. In Proceedings of the 2007 ACM Conference on Measurement and Modeling of Computer Systems (SIGMET-RICS), 2007.
17. Yanpei Chen, Archana Ganapathi, Rean Griffith, and Randy H. Katz. The Case for Evaluating MapReduce Performance Using Workload Suites. In Proceedings of the IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS), 2011.
18. Ludmila Cherkasova, Kivanc Ozonat, Ningfang Mi, Julie Symons, and Evgenia Smirni. Anomaly? Application Change? Or Workload Change? Towards Automated Detection of Application Performance Anomaly and Change. In Proceedings of the International Conference on Dependable Systems and Networks (DSN), 2008.
19. Ira Cohen, Moises Goldszmidt, Terence Kelly, Julie Symons, and Jeffrey S. Chase. Correlating instrumentation data to system states: a building block for automated diagnosis and control. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI), 2004.
20. Brian Cooper, Adam Silberstein, Erwin Tam, Raghu Ramakrishnan, and Russell Sears. Benchmarking Cloud Serving Systems with YCSB. In Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC), 2010.
21. Jeffrey Dean and Luiz Andre Barroso. Tail at Scale. Communications of the ACM, 2013.
22. Jeffrey Dean and Sanjay Ghemawat. Mapreduce: Simplified data processing on large clusters. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI), 2004.
23. Thanh Do and Haryadi S. Gunawi. Impact of Limpware on HDFS: A Probabilistic Estimation. Technical Report TR-2013-08, Department of Computer Science, University of Chicago, 2013.
24. Thanh Do and Haryadi S. Gunawi. The Case for Limping-Hardware Tolerant Clouds. In 5th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud), 2013.
25. Erik Eckel. 10 tips for troubleshooting slowdowns in small business networks. http://www.techrepublic.com, 2007.
26. Michael Feldman. Startup Takes Aim at Performance-Killing Vibration in Datacenter. http://www.hpcwire.com, 2010.
27. Daniel Ford, Franis Labelle, Florentina I. Popovici, Murray Stokely, Van-Anh Truong, Luiz Barroso, Carrie Grimes, and Sean Quinlna. Availability in Globally Distributed Storage Systems. In Proceedings of the 9th Symposium on Operating Systems Design and Implementation (OSDI), 2010.
28. Phillipa Gill, Navendu Jain, and Nachiappan Nagappan. Understanding network failures in data centers: measurement, analysis, and implications. In Proceedings of SIGCOMM, 2011.
29. Ajay Gulati, Irfan Ahmad, and Carl A. Waldspurger. PARDA: Proportional Allocation of Resources for Distributed Storage Access. In Proceedings of the 7th USENIX Symposium on File and Storage Technologies (FAST), 2009.
30. Ajay Gulati, Ganesha Shanmuganathan, Irfan Ahmad, Carl A. Waldspurger, and Mustafa Uysal. Pesto: Online Storage Performance Management in Virtualized Datacenters. In Proceedings of the 2nd ACM Symposium on Cloud Computing (SoCC), 2011.
31. Sangjin Han, Scott Marshall, Byung-Gon Chun, and Sylvia Ratnasamy. MegaPipe: A New Programming Interface for Scalable Network I/O. In Proceedings of the 10th Symposium on Operating Systems Design and Implementation (OSDI), 2012.
32. Robin Harris. Bad, bad, bad vibrations. http://tinyurl.com/2c7ea6t, 2010.
33. Guoliang Jin, Linhai Song, Xiaoming Shi, Joel Scherpelz, and Shan Lu. Understanding and Detecting Real-World Performance Bugs. In Proceedings of the ACM SIGPLAN 2012 Conference on Programming Language Design and Implementation (PLDI), 2012.
34. Michael P. Kasick, Jiaqi Tan, Rajeev Gandhi, and Priya Narasimhan. Black-Box Problem Diagnosis in Parallel File Systems. In Proceedings of the 8th USENIX Symposium on File and Storage Technologies (FAST), 2010.
35. Emre Kiciman and Benjamin Livshits. Ajaxscope: A platform for remotely monitoring the client-side behavior of web 2.0 applications. In Proceedings of the 21st ACM Symposium on Operating Systems Principles (SOSP), 2007.
36. Diego Ongaro, Stephen M. Rumble, Ryan Stutsman, John Ousterhout, and Mendel Rosenblum. Fast Crash Recovery in RAMCloud. In Proceedings of the 23rd ACM Symposium on Operating Systems Principles (SOSP), 2011.
37. Swapnil Patil, Milo Polte, Kai Ren, Wittawat Tantisiriroj, Lin Xiao, Julio Lopez, Garth Gibson, Adam Fuchs, and Billie Rinaldi. YCSB++: Benchmarking and Performance Debugging Advanced Features in Scalable Table Stores. In Proceedings of the 2nd ACM Symposium on Cloud Computing (SoCC), 2011.
38. Raja R. Sambasivan, Alice X. Zheng, Michael De Rosa, Elie Krevat, Spencer Whitman, Michael Stroucken, William Wang, Lianghong Xu, and Gregory R. Ganger. Diagnosing Performance Changes by Comparing Request Flows. In Proceedings of the 8th Symposium on Networked Systems Design and Implementation (NSDI), 2011.
39. Bianca Schroeder and Garth Gibson. Disk failures in the real world: What does an MTTF of 1,000,000 hours mean to you? In Proceedings of the 5th USENIX Symposium on File and Storage Technologies (FAST), 2007.
40. Bianca Schroeder, Eduardo Pinheiro, and Wolf-Dietrich Weber. DRAM errors in the wild: A Large-Scale Field Study. In Proceedings of the 2009 ACM International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS), 2009.
41. Anand Lal Shimpi. Intel Discovers Bug in 6-Series Chipset: Our Analysis. http://tinyurl.com/45twb2l, 2011.
42. David Shue, Michael J. Freedman, and Anees Shaikh. Performance Isolation and Fairness for Multi-Tenant Cloud Storage. In Proceedings of the 10th Symposium on Operating Systems Design and Implementation (OSDI), 2012.
43. Utah Emulab Testbed. Disk controller problems on boss. http://www.emulab.net/news.php3, 2013.
44. Avishay Traeger, Ivan Deras, and Erez Zadok. DARC: dynamic analysis of root causes of latency distributions. In Proceedings of the 2008 ACM International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS), 2008.
45. Kashi Vishwanath and Nachi Nagappan. Characterizing Cloud Computing Hardware Reliability. In Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC), 2010.
46. Matthew Wachs, Michael Abd-El-Malek, Eno Thereska, and Gregory R. Ganger. Argon: performance insulation for shared storage servers. In Proceedings of the 5th USENIX Symposium on File and Storage Technologies (FAST), 2007.
47. Andrew Wang, Shivaram Venkataraman, Sara Alspaugh, Randy Katz, and Ion Stoica. Cake: Enabling High-level SLOs on Shared Storage Systems. In Proceedings of the 3rd ACM Symposium on Cloud Computing (SoCC), 2012.
48. Helen J. Wang, John C. Platt, Yu Chen, Ruyun Zhang, and Yimin Wang. Automatic Misconfiguration Troubleshooting with PeerPressure. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI), 2004.
49. Matt Welsh, David Culler, and Eric Brewer. SEDA: An Architecture for Well-Conditioned, Scalable Internet Services. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP), 2001.
50. Haitao Wu, Zhenqian Feng, Chuanxiong Guo, and Yongguang Zhang. ICTCP: Incast Congestion Control for TCP. In The 6th International Conference on emerging Networking EXperiments and Technologies (CoNEXT), 2010.
51. Wei Xu, Ling Huang, Armando Fox, David Patterson, and Michael Jordan. Detecting Large-Scale System Problems by Mining Console Logs. In Proceedings of the 22nd ACM Symposium on Operating Systems Principles (SOSP), 2009.
52. Matei Zaharia, Andy Konwinski, Anthony D. Joseph, Randy Katz, and Ion Stoica. Improving MapReduce Performance in Heterogeneous Environments. In Proceedings of the 8th Symposium on Operating Systems Design and Implementation (OSDI), 2008.
53. Xiao Zhang, Eric Tune, Robert Hagmann, Rohit Jnagal, Vrigo Gokhale, and John Wilkes. CPI2: CPU Performance Isolation for Shared Compute Clusters. In Proceedings of the 2013 EuroSys Conference (EuroSys), 2013.
54. Tao Zou, Guozhang Wang, Marcos Vaz Salles, David Bindel, Alan Demers, Johannes Gehrke, and Walker White. Making Time-stepped Applications Tick in the Cloud. In Proceedings of the 2nd ACM Symposium on Cloud Computing (SoCC), 2011.