Capture, conversion, and analysis of an intense NFS workload

Proceedings of the 7th USENIX Conference on File and Storage Technologies, FAST 2009

Volumn , Issue , 2009, Pages 139-152

  Anderson, Eric ^a  

^a HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATABASE COMMUNITY; OPEN SOURCES; SPACE EFFICIENT; TRACE COLLECTION; TRACE DATA;

DIGITAL STORAGE;

EID: 85077321992     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. Eric Anderson and Martin Arlitt. Full Packet Capture and Offline Analysis on 1 and 10 Gb/s Networks. Technical Report 156, HP Labs, 2006. http://www.hpl.hp.com/techreports/2006/HPL-2006-156.html, accessed January 2009.
2. Eric Anderson, Martin Arlitt, Charles B. Morrey III, and Alistair Veitch. DataSeries: An Efficient, Flexible Data Format for Structured Serial Data. Operating Systems Review, 43(1):70–75, 2009.
3. Eric Anderson, Mahesh Kallahalla, Mustafa Uysal, and Ram Swaminathan. Buttress: A Toolkit for Flexible and High Fidelity I/O Benchmarking. In Proceedings of the 3rd USENIX Conference on File and Storage Technologies (FAST 2004), pages 45–58, 2004.
4. Animation traces: http://apotheca.hpl.hp.com/pub/datasets/animation-bear/, accessed January 2009.
5. Mihir Bellare, Ran Canetti, and Hugo Krawczyk. Keying hash functions for message authentication. In Advances in Cryptology – Crypto 96, pages 1–15, 1996. http://www.cs.ucsd.edu/~mihir/papers/kmd5.pdf, accessed January 2009.
6. Brent Callaghan, Brian Pawlowski, and Peter Staubach. NFS Version 3 Protocol Specification, RFC 1813, June 1995. http://www.ietf.org/rfc/rfc1813.txt, accessed January 2009.
7. Edgar F. Codd. A Relational Model of Data for Large Shared Data Banks. In Communications of the ACM, volume 13, pages 377–387, 1970.
8. Loris Degioanni, Fulvio Risso, and Gianluca Varenni. PCAP Next Generation Dump File Format, March 2004. http://www.winpcap.org/ntar/draft/PCAP-DumpFileFormat.html, accessed January 2009.
9. DataSeries open source software: http://tesla.hpl.hp.com/opensource/, accessed January 2009.
10. http://tesla.hpl.hp.com/opensource/ DataSeries-tr-snapshot.pdf, accessed January 2009.
11. Daniel Ellard, Jonathan Ledlie, Pia Malkani, and Margo Seltzer. http://iotta.snia.org/traces/list/NFS, accessed January 2009.
12. Daniel Ellard, Jonathan Ledlie, Pia Malkani, and Margo Seltzer. Passive NFS tracing of email and research workloads. In Proceedings of the 2nd USENIX Conference on File and Storage Technologies (FAST 2003), pages 203–216, 2003.
13. Daniel Ellard and Margo Seltzer. New NFS Tracing Tools and Techniques for System Analysis. In Proceedings of the 17th Large Installation System Administration Conference (LISA’03), pages 73–85, 2003.
14. http://www.endace.com/dag-network-monitoring-cards.html, accessed January 2009.
15. http://goog-sparsehash.sourceforge.net/, accessed January 2009.
16. Jim Gray, Surajit Chaudhuri, Adam Bosworth, Andrew Layman, Don Reichart, Murali Venkatrao, Frank Pellow, and Hamid Pirahesh. Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals. In Data Mining and Knowledge Discovery, volume 1, pages 29–53, 1997. ftp://ftp.research.microsoft.com/pub/tr/tr-97-32.doc, accessed January 2009.
17. Steven D. Gribble, Gurmeet Singh Manku, Drew Roselli, Eric A. Brewer, Timothy J. Gibson, and Ethan L. Miller. Self-similarity in file systems. SIGMETRICS Performance Evaluation Review, 26(1):141–150, 1998.
18. Atsuo Kawaguchi, Shingo Nishioka, and Hiroshi Motoda. A flash-memory based file system. In Proceedings of the Winter 1995 USENIX Technical Conference, pages 155–164, 1995.
19. Will E. Leland, Murad S. Taqqu, Walter Willinger, and Daniel V. Wilson. On the Self-Similar Nature of Ethernet Traffic (Extended Version). IEEE/ACM Transactions on Networking, 2:1–15, 1994.
20. Andrew W. Leung, Shankar Pasupathy, Garth Goodson, and Ethan L. Miller. Measurement and Analysis of Large-Scale Network File System Workloads. In Proceedings of the 2008 USENIX Annual Technical Conference, pages 213–226, June 2008.
21. lzf compression library: http://www.goof.com/ pcg/marc/liblzf.html, accessed January 2009.
22. Gurmeet Singh Manku, Sridhar Rajagopalan, and Bruce G. Lindsay. Approximate medians and other quantiles in one pass and with limited memory. In Special Interest Group on Management of Data (SIGMOD), pages 426–435, 1998.
23. Microsoft. System call traces: http://iotta.snia.org/traces/list/SystemCall, accessed January 2009.
24. Sape J. Mullender and Andrew S. Tanenbaum. Immediate Files. Software – Practice and Experience, 14(4):365–368, April 1984. http://dare.ubvu.vu.nl/bitstream/1871/2604/1/11033.pdf, accessed January 2009.
25. Bill Nowicki. NFS: Network File System Protocol Specification, RFC 1094, March 1989. http://www.ietf.org/rfc/rfc1094.txt, accessed January 2009.
26. John K. Ousterhout, Hervé Da Costa, David Harrison, John A. Kunze, Mike Kupfer, and James G. Thompson. A trace-driven analysis of the UNIX 4.2 BSD file system. Operating Systems Review, 19(5):15–24, 1985.
27. Ruoming Pang, Mark Allman, Vern Paxson, and Jason Lee. The devil and packet trace anonymization. SIGCOMM Computer Communication Review, 36(1):29–38, January 2006.
28. Brian Pawlowski, Chet Juszczak, Peter Staubach, Carl Smith, Diane Lebel, and David Hitz. NFS version 3 design and implementation. In Proceedings of the Summer 1994 USENIX Technical Conference, pages 137–152, 1994.
29. Steven W. Schlosser and Gregory R. Ganger. MEMS-based Storage Devices and Standard Disk Interfaces: A Square Peg in a Round Hole? In Proceedings of the 3rd USENIX Conference on File and Storage Technologies (FAST 2004), pages 87–100, 2004.
30. http://www.tcpdump.org/, accessed January 2009.
31. http://www.wireshark.org/, accessed January 2009.
32. Ningning Zhu, Jiawu Chen, and Tzi-Cker Chiueh. TBBT: Scalable and Accurate Trace Replay for File Server Evaluation. In Proceedings of the 4th USENIX Conference on File and Storage Technologies (FAST 2005), pages 323–336, 2005.