Reducing file system tail latencies with chopper

Proceedings of the 13th USENIX Conference on File and Storage Technologies, FAST 2015

Volumn , Issue , 2015, Pages 119-133

  He, Jun ^a   Nguyen, Duy ^b   Arpaci Dusseau, Andrea C ^a   Arpaci Dusseau, Remzi H ^a  

^a University of Wisconsin Madison   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER OPERATING SYSTEMS; DIGITAL STORAGE; FILE ORGANIZATION; FIRE FIGHTING EQUIPMENT; SAMPLING; SENSITIVITY ANALYSIS;

BLOCK ALLOCATION; DESIGN PROBLEMS; INTERNAL DESIGN; LATIN HYPERCUBE SAMPLING; LAYOUT QUALITY; PERFORMANCE PROBLEMS; SEARCH SPACES; STATISTICAL METHODOLOGIES;

CHOPPERS (CIRCUITS);

EID: 85018503656     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (51)

1. Btrfs Issues. https://btrfs.wiki.kernel.org/index.php/Gotchas.
2. NASA Archival Storage System. http://www.nas.nasa.gov/hecc/resources/ storage_systems.html.
3. Red Hat Enterprise Linux 7 Press Release. http://www.redhat.com/en/about/pressreleases/red-hat-unveils-rhel-7.
4. Ubuntu. http://www.ubuntu.com.
5. Nitin Agrawal, William J. Bolosky, John R. Douceur, and Jacob R. Lorch. A Five-Year Study of File-System Metadata. In Proceedings of the 5th USENIX Symposium on File and Storage Technologies (FAST’07), San Jose, California, February 2007.
6. Mohammad Alizadeh, Abdul Kabbani, Tom Edsall, Balaji Prabhakar, Amin Vahdat, and Masato Yasuda. Less Is More: Trading a Little Bandwidth for Ultra-Low Latency in the Data Center. In Presented as part of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI 12), pages 253–266, San Jose, CA, 2012. USENIX.
7. KV Aneesh Kumar, Mingming Cao, Jose R Santos, and Andreas Dilger. Ext4 block and inode allocator improvements. In Proceedings of the Linux Symposium, volume 1, pages 263–274, 2008.
8. Remzi H. Arpaci-Dusseau and Andrea C. Arpaci-Dusseau. Operating Systems: Three Easy Pieces. Arpaci-Dusseau Books, 0.8 edition, 2014.
9. Mary Baker, John Hartman, Martin Kupfer, Ken Shirriff, and John Ousterhout. Measurements of a Distributed File System. In Proceedings of the 13th ACM Symposium on Operating Systems Principles (SOSP’91), pages 198–212, Pacific Grove, California, October 1991.
10. Al Bessey, Ken Block, Ben Chelf, Andy Chou, Bryan Fulton, Seth Hallem, Charles Henri-Gros, Asya Kamsky, Scott McPeak, and Dawson Engler. A Few Billion Lines of Code Later: Using Static Analysis to Find Bugs in the Real World. Communications of the ACM, February 2010.
11. Luc Bouganim, Björn Thór Jónsson, Philippe Bonnet, et al. uFLIP: Understanding flash IO patterns. In 4th Biennial Conference on Innovative Data Systems Research (CIDR), pages 1–12, 2009.
12. Rob Carnell. lhs package manual. http://cran.r-project.org/web/packages/ lhs/lhs.pdf.
13. Feng Chen, David A. Koufaty, and Xiaodong Zhang. Understanding Intrinsic Characteristics and System Implications of Flash Memory Based Solid State Drives. In Proceedings of the Eleventh International Joint Conference on Measurement and Modeling of Computer Systems, SIGMETRICS’09, pages 181–192, New York, NY, USA, 2009. ACM.
14. Peter M. Chen and David A. Patterson. A New Approach to I/O Performance Evaluation–Self-Scaling I/O Benchmarks, Predicted I/O Performance. In Proceedings of the 1993 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems (SIGMETRICS’93), pages 1–12, Santa Clara, California, May 1993.
15. Vijay Chidambaram, Thanumalayan Sankaranarayana Pillai, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau. Optimistic Crash Consistency. In Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles, SOSP’13, pages 228–243, 2013.
16. Edmund M. Clarke, Orna Grumberg, and Doron Peled. Model checking. MIT press, 1999.
17. Jeffrey Dean and Luiz André Barroso. The tail at scale. Communications of the ACM, 56(2):74–80, 2013.
18. Nykamp DQ. Mean path length definition. http://mathinsight.org/network_ mean_path_length_definition.
19. Dawson Engler and Madanlal Musuvathi. Static Analysis versus Software Model Checking for Bug Finding. In 5th International Conference Verification, Model Checking and Abstract Interpretation (VMCAI’04), Venice, Italy, January 2004.
20. Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung. The Google File System. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP’03), pages 29–43, Bolton Landing, New York, October 2003.
21. Garth Gibson, Gary Grider, Andree Jacobson, and Wyatt Lloyd. PRObE: A Thousand-Node Experimental Cluster for Computer Systems Research. USENIX;login:, 38(3), June 2013.
22. Brendan Gregg. Systems Performance: Enterprise and the Cloud, page 20. 2013.
23. Tyler Harter, Chris Dragga, Michael Vaughn, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau. A file is not a file: understanding the I/O behavior of Apple desktop applications. In Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles, pages 71–83. ACM, 2011.
24. Jon C. Helton and Freddie J. Davis. Latin hypercube sampling and the propagation of uncertainty in analyses of complex systems. Reliability Engineering & System Safety, 81(1):23–69, 2003.
25. Ronald L. Iman, Jon C. Helton, and James E. Campbell. An approach to sensitivity analysis of computer models. Part I - Introduction, Input, Variable Selection and Preliminary Variable Assessment. Journal of Quality Technology, 13:174–183, 1981.
26. Keren Jin and Ethan L. Miller. The Effectiveness of Deduplication on Virtual Machine Disk Images. In Proceedings of SYSTOR 2009: The Israeli Experimental Systems Conference, SYSTOR’09, pages 7:1–7:12, 2009.
27. Charles Killian, Karthik Nagaraj, Salman Pervez, Ryan Braud, James W. Anderson, and Ranjit Jhala. Finding Latent Performance Bugs in Systems Implementations. In Proceedings of the Eighteenth ACM SIGSOFT International Symposium on Foundations of Software Engineering, FSE’10, pages 17–26, New York, NY, USA, 2010. ACM.
28. Avantika Mathur, Mingming Cao, Suparna Bhattacharya, Alex Tomas Andreas Dilge and, and Laurent Vivier. The New Ext4 filesystem: Current Status and Future Plans. In Ottawa Linux Symposium (OLS ’07), Ottawa, Canada, July 2007.
29. Michael D. McKay, Richard J. Beckman, and William J. Conover. Comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics, 21(2):239–245, 1979.
30. Changwoo Min, Kangnyeon Kim, Hyunjin Cho, Sang-Won Lee, and Young Ik Eom. SFS: random write considered harmful in solid state drives. In Proceedings of the 10th USENIX conference on File and Storage Technologies. USENIX Association, 2012.
31. V. N. Nair, D. A. James, W. K. Ehrlich, and J. Zevallos. A statistical assessment of some software testing strategies and application of experimental design techniques. Statistica Sinica, 8(1):165–184, 1998.
32. Peter Norvig. Teach Yourself Programming in Ten Years. http://norvig.com/21-days. html.
33. Ryan Paul. Google upgrading to Ext4. arstechnica.com/information-technology/2010/01/googleupgrading-to-ext4-hires-formerlinux-foundation-cto/.
34. Zachary N. J. Peterson. Data Placement for Copy-on-write Using Virtual Contiguity. Master’s thesis, U.C. Santa Cruz, 2002.
35. Drew Roselli, Jacob R. Lorch, and Thomas E. Anderson. A Comparison of File System Workloads. In Proceedings of the USENIX Annual Technical Conference (USENIX’00), pages 41–54, San Diego, California, June 2000.
36. Chris Ruemmler and John Wilkes. An Introduction to Disk Drive Modeling. IEEE Computer, 27(3):17–28, March 1994.
37. Jerome Sacks, William J Welch, Toby J Mitchell, and Henry P Wynn. Design and analysis of computer experiments. Statistical science, pages 409–423, 1989.
38. Andrea Saltelli, Marco Ratto, Terry Andres, Francesca Campolongo, Jessica Cariboni, Debora Gatelli, Michaela Saisana, and Stefano Tarantola. Global sensitivity analysis: the primer. John Wiley & Sons, 2008.
39. Andrea Saltelli, Stefano Tarantola, Francesca Campolongo, and Marco Ratto. Sensitivity analysis in practice: a guide to assessing scientific models. John Wiley & Sons, 2004.
40. Thomas J Santner, Brian J Williams, and William Notz. The design and analysis of computer experiments. Springer, 2003.
41. SGI. XFS Filesystem Structure. http://oss.sgi.com/projects/xfs/papers/ xfs_filesystem_structure.pdf.
42. Keith A. Smith and Margo I. Seltzer. File System Aging – Increasing the Relevance of File System Benchmarks. In Proceedings of the 1997 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, SIGMETRICS’97, pages 203–213, New York, NY, USA, 1997. ACM.
43. IM Sobol. Quasi-Monte Carlo methods. Progress in Nuclear Energy, 24(1):55–61, 1990.
44. Diane Tang and Margo Seltzer. Lies, damned lies, and file system benchmarks. VINO: The 1994 Fall Harvest, 1994.
45. Vasily Tarasov, Saumitra Bhanage, Erez Zadok, and Margo Seltzer. Benchmarking File System Benchmarking: It *IS* Rocket Science. In Proceedings of the 13th USENIX Conference on Hot Topics in Operating Systems, HotOS’13, pages 9–9, Berkeley, CA, USA, 2011. USENIX Association.
46. Avishay Traeger, Erez Zadok, Nikolai Joukov, and Charles P. Wright. A Nine Year Study of File System and Storage Benchmarking. ACM Transactions on Storage (TOS), 4(2), May 2008.
47. Sage A. Weil, Scott A. Brandt, Ethan L. Miller, Darrell D. E. Long, and Carlos Maltzahn. Ceph: A Scalable, High-Performance Distributed File System. In Proceedings of the 7th Symposium on Operating Systems Design and Implementation (OSDI’06), Seattle, Washington, November 2006.
48. CF Jeff Wu and Michael S Hamada. Experiments: planning, analysis, and optimization, volume 552. John Wiley & Sons, 2011.
49. Yunjing Xu, Zachary Musgrave, Brian Noble, and Michael Bailey. Bobtail: Avoiding Long Tails in the Cloud. In NSDI, pages 329–341, 2013.
50. Junfeng Yang, Paul Twohey, Dawson Engler, and Madanlal Musuvathi. Using Model Checking to Find Serious File System Errors. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI’04), San Francisco, California, December 2004.
51. David Zats, Tathagata Das, Prashanth Mohan, Dhruba Borthakur, and Randy Katz. DeTail: Reducing the Flow Completion Time Tail in Datacenter Networks. SIGCOMM Comput. Commun. Rev., 42(4):139–150, August 2012.