Accurate and efficient replaying of file system traces

FAST 2005 - 4th USENIX Conference on File and Storage Technologies

Volumn , Issue , 2005, Pages 337-350

  Joukov, Nikolai ^a   Wong, Timothy ^a   Zadok, Erez ^a  

^a STONY BROOK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FILE ORGANIZATION;

DEBUGGING SYSTEMS; DIFFERENT SPEED; FORENSIC ANALYSIS; MULTIPLE KERNELS; NETWORK FILE SYSTEM; NETWORK PACKETS; REPRODUCIBILITIES; STRESS TESTING;

PROGRAM DEBUGGING;

EID: 84889665727     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (42)

1. E. Anderson, M. Kallahalla, M. Uysal, and R. Swaminathan. Buttress: A Toolkit for Flexible and High Fidelity I/O Benchmarking. In Proceedings of the Third USENIX Conference on File and Storage Technologies (FAST 2004), pages 45–58, San Francisco, CA, March/April 2004.
2. A. Aranya, C. P. Wright, and E. Zadok. Tracefs: A File System to Trace Them All. In Proceedings of the Third USENIX Conference on File and Storage Technologies (FAST 2004), pages 129–143, San Francisco, CA, March/April 2004.
3. L. Belady. A Study of Replacement Algorithms for Virtual Storage Computers. IBM Systems Journal, 5(2):78–101, 1966.
4. M. Blaze. NFS Tracing by Passive Network Monitoring. In Proceedings of the USENIX Winter Conference, San Francisco, CA, January 1992.
5. P. Cao, E. Felten, A. Karlin, and K. Li. A Study of Integrated Prefetching and Caching Strategies. In Proceedings of the 1995 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, pages 188–197, Ottawa, Canada, May 1995.
6. P. M. Chen and D. A. Patterson. A New Approach to I/O Performance Evaluation - Self-Scaling I/O Benchmarks, Predicted I/O Performance. In Proceedings of the 1993 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, pages 1–12, Seattle, WA, May 1993.
7. F. Cornelis, M. Ronsse, and K. Bosschere. Tornado: A novel input replay tool. In Proceedings of the 2003 International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA‘03), volume 4, pages 1598–1604, Las Vegas, Nevada, June 2003.
8. D. Ellard and M. Seltzer. New NFS Tracing Tools and Techniques for System Analysis. In Proceedings of the Annual USENIX Conference on Large Installation Systems Administration, San Diego, CA, October 2003.
9. W. Feng, A. Goel, A. Bezzaz, W. Feng, and J. Walpole. Tcpivo: a high-performance packet replay engine. In Proceedings of the ACM SIGCOMM workshop on Models, methods and tools for reproducible network research, pages 57–64, Karlsruhe, Germany, 2003.
10. A. Goel, L. Abeni, J. Snow, C. Krasic, and J. Walpole. Supporting Time-Sensitive Applications on General-Purpose Operating Systems. In Proceedings of the Fifth Symposium on Operating System Design and Implementation (OSDI’02), pages 165–180, Boston, MA, December 2002.
11. LBNL Network Research Group. The TCP-Dump/Libpcap site. www.tcpdump.org, February 2003.
12. J. S. Heidemann and G. J. Popek. Performance of cache coherence in stackable filing. In Proceedings of Fifteenth ACM Symposium on Operating Systems Principles (SOSP’95), pages 3–6, Copper Mountain Resort, CO, December 1995.
13. D. Hitz, J. Lau, and M. Malcolm. File System Design for an NFS File Server Appliance. In Proceedings of the USENIX Winter Technical Conference, pages 235–245, San Francisco, CA, January 1994.
14. J. H. Howard, M. L. Kazar, S. G. Menees, D. A. Nichols, M. Satyanarayanan, R. N. Sidebotham, and M J. West. Scale and performance in a distributed file system. ACM Transactions on Computer Systems, 6(1):51–81, February 1988.
15. N. Joukov, A. Rai, and E. Zadok. Increasing distributed storage survivability with a stackable raid-like file system. In Proceedings of the 2005 IEEE/ACM Workshop on Cluster Security, in conjunction with the Fifth IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2005), Cardiff, UK, May 2005 (Won best paper award).
16. J. Katcher. PostMark: A New Filesystem Benchmark. Technical Report TR3022, Network Appliance, 1997. www.netapp.com/tech_library/3022.html.
17. T. Kimbrel and A. Karlin. Near-optimal Parallel Prefetching and Caching. In Proceedings of the 37th IEEE Symposium on Foundations of Computer Science, pages 540–549, October 1996.
18. T. Kimbrel, A. Tomkins, R. Patterson, B. Bershad, P. Cao, E. Felten, G. Gibson, A. Karlin, and K. Li. A Trace-Driven Comparison of Algorithms for Parallel Prefetching and Caching. In Proceedings of the Second Symposium on Operating Systems Design and Implementation (OSDI 1996), pages 19–34, Seattle, WA, October 1996.
19. L. Mummert and M. Satyanarayanan. Long term distributed file reference tracing: Implementation and experience. Technical Report CMU-CS-94-213, Carnegie Mellon University, Pittsburgh, PA, 1994.
20. K. Muniswamy-Reddy, C. P. Wright, A. Himmer, and E. Zadok. A Versatile and User-Oriented Versioning File System. In Proceedings of the Third USENIX Conference on File and Storage Technologies (FAST 2004), pages 115–128, San Francisco, CA, March/April 2004.
21. J. Ousterhout. Why Threads are a Bad Idea (for most purposes). In Invited Talk at the 1996 USENIX Technical Conference, January 1996. home.pacbell.net/ouster/ threads.ppt.
22. J. Ousterhout, H. Costa, D. Harrison, J. Kunze, M. Kupfer, and J. Thompson. A Trace-Driven Analysis of the UNIX 4.2 BSD File System. In Proceedings of the Tenth ACM Symposium on Operating System Principles, pages 15–24, Orcas Island, WA, December 1985
23. R. Patterson, G. Gibson, E. Ginting, D. Stodolsky, and J. Zelenka. Informed Prefetching and Caching. In Proceedings of the 15th ACM Symposium on Operating System Principles (SOSP’95), pages 79–95, Copper Mountain Resort, CO, December 1995.
24. D. Peek and J. Flinn. Drive-Thru: Fast, Accurate Evaluation of Storage Power Management. In Proceedings of the Annual USENIX Technical Conference, pages 251–264, Anaheim, CA, April 2005.
25. J. S. Pendry, N. Williams, and E. Zadok. Am-utils User Manual, 6.1b3 edition, July 2003. www.am-utils.org.
26. Z. Peterson and R. Burns. Ext3cow: a time-shifting file system for regulatory compliance. Trans. Storage, 1(2):190–212, 2005.
27. V. Prabhakaran, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dussea. Analysis and Evolution of Journaling File Systems. In Proceedings of the Annual USENIX Technical Conference, Anaheim, CA, May 2005.
28. A. Purohit, J. Spadavecchia, C. Wright, and E. Zadok. Improving Application Performance Through System Call Composition. Technical Report FSL-02-01, Computer Science Department, Stony Brook University, June 2003. www.fsl.cs.sunysb.edu/docs/cosy-perf/.
29. D. Roselli, J. R. Lorch, and T. E. Anderson. A Comparison of File System Workloads. In Proc. of the Annual USENIX Technical Conference, pages 41–54, San Diego, CA, June 2000.
30. C. Ruemmler and J. Wilkes. UNIX Disk Access Patterns. In Proceedings of the Winter USENIX Technical Conference, pages 405–420, San Diego, CA, January 1993.
31. K. A. Smith and M. I. Seltzer. File System Aging - Increasing the Relevance of File System Benchmarks. In Proceedings of the 1997 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, pages 203–213, Seattle, WA, June 1997.
32. Craig A. N. Soules, Garth R. Goodson, John D. Strunk, and Gregory R. Ganger. Metadata Efficiency in Versioning File Systems. In Proceedings of the Second USENIX Conference on File and Storage Technologies (FAST’03), pages 43–58, San Francisco, CA, March 2003.
33. tcpreplay developers. tcpreplay(8), February 2004. tcpreplay.sourceforge.net.
34. A. Tomkins, R. Patterson, and G. Gibson. Informed Multi-Process Prefetching and Caching. In Proceedings of the 1997 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, pages 100–114, Seattle, WA, June 1997.
35. Transaction Processing Performance Council. Transaction Processing Performance Council. www.tpc.org, 2005.
36. M. Uysal, A. Merchant, and G. A. Alvarez. Using MEMS-Based Storage in Disk Arrays. In Proceedings of the Second USENIX Conference on File and Storage Technologies (FAST’03), pages 89–101, San Francisco, CA, March 2003.
37. W. Vogels. File System Usage in Windows NT 4.0. In Proceedings of the 17th ACM Symposium on Operating Systems Principles, pages 93–109, Charleston, SC, December 1999
38. W. Akkerman. strace software home page. www.liacs.nl/∼wichert/strace/, 2002.
39. C. P. Wright, J. Dave, P. Gupta, H. Krishnan, E. Zadok, and M. N. Zubair. Versatility and Unix Semantics in a Fan-Out Unification File System. Technical Report FSL-04-01b, Computer Science Department, Stony Brook University, October 2004. www.fsl.cs.sunysb.edu/docs/unionfs-tr/unionfs.pdf.
40. E. Zadok and J. Nieh. FiST: A Language for Stackable File Systems. In Proc. of the Annual USENIX Technical Conference, pages 55–70, San Diego, CA, June 2000.
41. C. Zhang, X. Yu, A. Krishnamurthy, and R. Y. Wang. Configuring and Scheduling an Eager-Writing Disk Array for a Transaction Processing Workload. In Proceedings of the First USENIX Conference on File and Storage Technologies (FAST 2002), pages 289–304, Monterey, CA, January 2002.
42. N. Zhu, J. Chen, T. Chiueh, and D. Ellard. Scalable and Accurate Trace Replay for File Server Evaluation. Technical Report TR-153, Computer Science Department, Stony Brook University, December 2004. www.ecsl.cs.sunysb.edu/tr/TR153.pdf.