Characteristics of I/O traffic in personal computer and server workloads

IBM Systems Journal

Volumn 42, Issue 2, 2003, Pages 347-372

  Hsu, W W ^a   Smith, A J ^b  

^a IBM ALMADEN RESEARCH CENTER   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CACHE MEMORY; INTERNET; MANAGEMENT INFORMATION SYSTEMS; PERSONAL COMPUTERS; SERVERS; STORAGE ALLOCATION (COMPUTER); TELECOMMUNICATION TRAFFIC;

INPUT-OUTPUT TRAFFIC; PERSONAL COMPUTER WORKLOADS; SERVER WORKLOADS;

DATA STORAGE EQUIPMENT;

EID: 0043199887     PISSN: 00188670     EISSN: None     Source Type: Journal    
DOI: 10.1147/sj.422.0347     Document Type: Article

References (38)

1. J.L. Hennessy and D.A. Patterson, Computer Architecture: A Quantitative Approach, Second Edition, Morgan Kaufman Publishers, Inc., San Francisco, CA (1996).
2. E. Grochowski, "IBM Magnetic Hard Disk Drive Technology," Hitachi Global Storage Technologies, http://www.hgst.com/hdd/technolo/grochows/grocho01.htm.
3. W. W. Hsu, A. J. Smith, and H. C. Young, "Projecting the Performance of Decision Support Workloads on Systems with Smart Storage (SmartSTOR)," Proceedings of IEEE International Conference on Parallel and Distributed Systems (ICPADS), Iwate, Japan, July 2000, IEEE, New York (2000), pp. 417-425.
4. W. W. Hsu, A. J. Smith, and H. C. Young, "The Automatic Improvement of Locality in Storage Systems," Technical Report, Computer Science Division, University of California, Berkeley (2003, in preparation). Available as Chapter 4 of Reference 38.
5. W. W. Hsu and A. J. Smith, "The Real Effect of I/O Optimizations and Disk Improvements," Technical Report, Computer Science Division, University of California, Berkeley (2003, in preparation). Available as Chapter 3 of Reference 38.
6. W. W. Hsu and A. J. Smith, "Characteristics of I/O Traffic in Personal Computer and Server Workloads," Technical Report CSD-02-1179, Computer Science Division, University of California, Berkeley (April 2002). Available at http://sunsite.berkeley.edu/TechRepPages/CSD-02-1179.
7. M. G. Baker, J. H. Hartman, M. D. Kupfer, K. W. Shirriff, and J. K. Ousterhout, "Measurements of a Distributed File System," Proceedings of ACM Symposium on Operating Systems Principles (SOSP), Pacific Grove, CA, October 1991, ACM, New York (1991), pp. 198-212.
8. W. Vogels, "File System Usage in Windows NT 4.0," Proceedings of ACM Symposium on Operating Systems Principles (SOSP), ACM, New York (1999), pp. 93-109.
9. D. Roselli, J. R. Lorch, and T. E. Anderson, "A Comparison of File System Workloads," Proceedings of USENIX Annual Technical Conference, San Diego, CA, June 2000, USENIX Association, Berkeley, CA (2000), pp. 41-54.
10. W. W. Hsu, A. J. Smith, and H. C. Young, "Characteristics of Production Database Workloads and the TPC Benchmarks," IBM Systems Journal 40, No. 3, 781-802 (2001).
11. W. W. Hsu, A. J. Smith, and H. C. Young, "I/O Reference Behavior of Production Database Workloads and the TPC Benchmarks - An Analysis at the Logical Level," ACM Transactions on Database Systems 26, 96-143 (March 2001).
12. A. J. Smith, "Disk Cache - Miss Ratio Analysis and Design Considerations," ACM Transactions on Computer Systems 3, 161-203 (August 1985).
13. P. Biswas, K. K. Ramakrishnan, and D. Towsley, "Trace Driven Analysis of Write Caching Policies for Disks," Proceedings of ACM Conference on Measurement and Modeling of Computer Systems (SIGMETRICS), Santa Clara, CA, May 1993, ACM, New York (1993), pp. 13-23.
14. R. Karedla, J. S. Love, and B. G. Wherry, "Caching Strategies to Improve Disk System Performance," Computer 27, 38-46 (March 1994).
15. C. Ruemmler and J. Wilkes, "UNIX Disk Access Patterns," Proceedings of USENIX Winter Conference, San Diego, CA, January 1993, USENIX Association, Berkeley, CA (1993), pp. 405-420.
16. J. R. Heath and S. A. R. Houser. "Analysis of Disk Workloads in Network File Server Environments," Proceedings of Computer Measurement Group (CMG) Conference, Nashville, TN, December 1995, Computer Measurement Group (1995), pp. 313-322.
17. J. R. Lorch and A. J. Smith, "The VTrace Tool: Building a System Tracer for Windows NT and Windows 2000," MSDN Magazine 15, 86-102 (October 2000).
18. IBM Corporation, AIX Versions 3.2 and 4 Performance Tuning Guide, 5th Edition (1996).
19. M. Rosenblum, E. Bugnion, S. A. Herrod, E. Witchel, and A. Gupta, "The Impact of Architectural Trends on Operating System Performance," Proceedings of 15th ACM Symposium on Operating Systems Principles (SOSP), Copper Mountain, CO, December 1995, ACM, New York (1995), pp. 285-298.
20. G. M. Amdahl, "Storage and I/O Parameters and Systems Potential," Proceedings of IEEE International Computer Group Conference (Memories, Terminals, and Peripherals), Washington, DC, June 1970, IEEE, New York (1970), pp. 371-372.
21. D. Bhandarkar and J. Ding, "Performance Characterization of the Pentium Pro Processor," Proceedings of International Symposium on High-Performance Computer Architecture (HPCA), San Antonio, TX, February 1997, IEEE, New York (1997), pp. 288-297.
22. A. Ailamaki, D.J. DeWitt, M. D. Hill, and D. A. Wood, "DBMSs on a Modern Processor: Where Does Time Go," Proceedings of International Conference on Very Large Data Bases (VLDB), Edinburgh, Scotland, September 1999, Morgan Kaufman Publishers, San Francisco, CA (1999), pp. 266-277.
23. K. Keeton, D. A. Patterson, Y. Q. He, R. C. Raphael, and W. E. Baker, "Performance Characterization of a Quad Pentium Pro SMP Using OLTP Workloads," Proceedings of ACM International Symposium on Computer Architecture (ISCA), Barcelona, Spain, June 1998, ACM, New York (1988), pp. 15-26.
24. B. McNutt, "MVS DASD Survey: Results and Trends," Proceedings of Computer Measurement Group (CMG) Conference, Nashville, TN, December 1995, Computer Measurement Group (1995), pp. 658-667.
25. J. B. Major, "Processor, I/O Path, and DASD Configuration Capacity," IBM Systems Journal 20, No. 1, 63-85 (1981).
26. Y. Chen, W. W. Hsu, and H. C. Young "Logging RAID - An Approach to Fast, Reliable, and Low-Cost Disk Arrays," Proceedings of European Conference on Parallel Computing (EuroPar), Munich, Germany, August 2000, Springer, New York (2000), pp. 1302-1312.
27. B. B. Mandelbrot, The Fractal Geometry of Nature, W. H. Freeman, New York, (1982).
28. S. D. Gribble, G. S. Manku, D. Roselli, E. A. Brewer, T. J. Gibson, and E. L. Miller, "Self-Similarity in File Systems," Proceedings of ACM Conference on Measurement and Modeling of Computer Systems (SIGMETRICS), Madison, WI, June 1998, ACM, New York (1998), pp. 141-150.
29. M. E. Gómez and V. Santonja, "Analysis of Self-Similarity in I/O Workload Using Structural Modeling," Proceedings of Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), College Park, MD, October 1999, IEEE, New York (1999), pp. 234-242.
30. W. E. Leland, M. S. Taqqu, W. Willinger, and D. V. Wilson, "On the Self-Similar Nature of Ethernet Traffic (Extended Version)," IEEE/ACM Transactions on Networking 2, 1-15 (February 1994).
31. W. Willinger, M. S. Taqqu, R. Sherman, and D. V. Wilson, "Self-Similarity Through High-Variability: Statistical Analysis of Ethernet LAN Traffic at the Source Level," IEEE/ACM Transactions on Networking 5, 71-86 (February 1997).
32. R. Golding, P. Bosch, C. Staelin, T. Sullivan, and J. Wilkes, "Idleness Is Not Sloth," Proceedings of USENIX Technical Conference, New Orleans, LA, January 1995, USENIX Association, Berkeley, CA (1995), pp. 201-212.
33. J. Ousterhout and F. Douglis, "Beating the I/O Bottleneck: A Case for Log-Structured File Systems," Operating Systems Review 23, 11-28 (January 1989).
34. M. Russinovich, "Inside the Cache Manager," Windows & .NET Magazine, October 1998, http://www.winnetmag.com/.
35. K. K. Ramakrishnan, P. Biswas, and R. Karedla, "Analysis of File I/O Traces in Commercial Computing Environments," Proceedings of ACM Conference on Measurement and Modeling of Computer Systems (SIGMETRICS), Newport, RI, June 1992, ACM, New York (1992), pp. 78-90.
36. M. D. Dahlin, Serverless Network File Systems, Ph.D. thesis, University of California, Berkeley, CA (December 1995).
37. P. J. Denning, "The Working Set Model for Program Behaviour," Communications of the ACM 11, No. 5, 323-333 (May 1968).
38. W. W. Hsu, Dynamic Locality Improvement Techniques for Increasing Effective Storage Performance, Ph.D. thesis, University of California, Berkeley, CA (December 2002). Available as Technical Report CSD-03,1223, Computer Science Division University of California, Berkeley (January 2003).