Towards higher disk head utilization: Extracting free bandwidth from busy disk drives

Proceedings of the 4th Conference on Symposium on Operating System Design and Implementation, OSDI 2000

Volumn , Issue , 2000, Pages

  Lumb, Christopher R ^a   Schindler, Jiri ^a   Ganger, Gregory R ^a   Nagle, David F ^a   Riedel, Erik ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b HEWLETT PACKARD LABORATORIES   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CLEANING; DATA MINING; DIGITAL STORAGE; SCHEDULING; SYSTEMS ANALYSIS;

CONCRETE APPLICATIONS; DISK PERFORMANCE; FILE SYSTEMS; FULL DISKS; MEDIA BANDWIDTH; NEW APPROACHES; SIMULATION STUDIES; TRANSACTION PROCESSING SYSTEMS;

BANDWIDTH;

EID: 84961719575     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (69)

1. A. Acharya, M. Uysal, and J. Saltz. Active disks: programming model, algorithms and evaluation. Architectural Support for Programming Languages and Operating Systems (San Jose, California), pages 81-91. ACM, 3-7 October 1998.
2. R. Agrawal and J. Schäfer. Parallel Mining of Association Rules. IEEE Transactions on Knowledge and Data Engineering, 8(6), December 1996.
3. S. Akyiirek and K. Salem. Adaptive block rearrangement. ACM Transactions on Computer Systems, 13(2):89-121, May 1995.
4. M. Baker, S. Asami, E. Deprit, J. Ousterhout, and M. Seltzer. Non-volatile memory for fast, reliable file systems. Architectural Support for Programming Languages and Operating Systems (Boston, MA, 12-15 October 1992).
5. Published as Computer Architecture News, 20(special issue):10-22, October 1992.
6. Paul R. Barham. A Fresh Approach to File System Quality of Service. IEEE 7th International Workshop on Network and Operating Systems Support for Digital Audio and Video, 1997.
7. P. Biswas, K. K. Ramakrishnan, and D. Towsley. Trace driven analysis of write caching policies for disks. ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, pages 13-23, May 1993.
8. T. Blackwell, J. Harris, and M. Seltzer. Heuristic cleaning algorithms in log-structured file systems. Annual USENIX Technical Conference (New Orleans), pages 277-288. Usenix Association, 16-20 January 1995.
9. John Bruno, Jose Brustoloni, Eran Gabber, Banu Ozden, and Abraham Siblerschatz. Disk Scheduling with Quality of Service Guarantees. IEEE International Conference on Multimedia Computing and Systems, 1999.
10. P. Cao, E. W. Feiten, A. R. Karlin, and K. Li. Implementation and performance of integrated application-controlled file caching, prefetching, and disk scheduling. ACM Transactions on Computer Systems, 14(4):311-343, November 1996.
11. S. C. Carson and S. Setia. Analysis of the periodic update write policy for disk cache. IEEE Transactions on Software Engineering, 18(1):44-54, January 1992.
12. V. Gate and T. Gross. Combining the concepts of compression and caching for a two-level filesystem. Fourth International Conference on Architectural Support for Programming Languages and Operating Systems (Santa Clara, CA 8-11 April 1991), pages 200-211. ACM, 1991.
13. S. Chaudhuri and U. Dayal. An overview of data warehousing and OLAP technology. SIGMOD Record, 26(1):55, 1997.
14. S. Chaudhuri, R. Motwani, and V. Narasayya. Random Sampling for Histogram Construction: How much is enough? SIGMOD Record, 27(2):436-447, 1998.
15. Ann Chervenak, Vivekenand Vellanki, and Zachary Kurmas. Protecting file systems: A survey of backup techniques. Joint NASA and IEEE Mass Storage Conference, March 1998.
16. W. de Jonge, M. F. Kaashoek, and W. C. Hsieh. The Logical Disk: a new approach to improving file systems. ACM Symposium on Operating System Principles (Asheville, NC), pages 15-28, 5-8 December 1993.
17. P. J. Denning. Effects of scheduling on file memory operations. AFIPS Spring Joint Computer Conference (Atlantic City, New Jersey, 18-20 April 1967), pages 9-21, April 1967.
18. Database of validated disk parameters for DiskSim. http://www.ece.cmu.edu/ganger/disksim/diskspecs.html.
19. R. M. English and A. A. Stepanov. Loge: a self-organizing storage device. Winter USENIX Technical Conference (San Francisco, CA), pages 237-251. Usenix, 20-24 January 1992.
20. Ussama Fayyad. Taming the Giants and the Monsters: Mining Large Databases for Nuggets of Knowledge. Databases Programming and Design, March 1998.
21. G. R. Ganger, B. L. Worthington, and Y. N. Patt. The DiskSim Simulation Environment Version 1. 0 Reference Manual, CSE-TR-358-98. Department of Computer Science and Engineering, University of Michigan, February 1998.
22. Gregory R. Ganger and Yale N. Patt. Using System-Level Models to Evaluate I/O Subsystem Designs. IEEE Transactions Vol. 47 No. 6, June 1998.
23. G. A. Gibson, D. F. Nagle, K. Amiri, J. Butler, F. W. Chang, H. Gobioff, C. Hardin, E. Riedel, D. Rochberg, and J. Zelenka. A cost-effective, high-bandwidth storage architecture. Architectural Support for Programming Languages and Operating Systems (San Jose, CA, 3-7 October 1998).
24. Published as SIGPLAN Notices, 33(11):92-103, November 1998.
25. R. Golding, P. Bosch, C. Staelin, T. Sullivan, and J. Wilkes. Idleness is not sloth. Winter USENIX Technical Conference (New Orleans, LA), pages 201-212. Usenix Association, Berkeley, CA, 16-20 January 1995.
26. J. Gray and G. Graefe. Storage metrics. Microsoft Research, Draft of March 1997.
27. J. Griffioen and R. Appleton. Reducing file system latency using a predictive approach. Summer USENIX Technical Conference (Boston, June 1994), pages 197-207. USENIX, June 1994.
28. Sudipto Guha, Rajeev Rastogi, and Kyuseok Shim. CURE: An Efficient Clustering Algorithm for Large Databases. SIGMOD Record, 27(2):73, 1998.
29. R. B. Hagmann. Low latency logging. CSL-91-1. Xerox Palo Alto Research Center, CA, February 1991.
30. N. C. Hutchinson, S. Manley, M. Federwisch, G. Harris, D. Hitz, S. Kleiman, and S. O'Malley. Logical vs. physical file system backup. Symposium on Operating Systems Design and Implementation (New Orleans, LA, 22-25 February 1999), pages 239-249. ACM, February 1999.
31. E. H. H. II and R. Finkel. An ASCII database for fast queries of relatively stable data. Computing Systems, 4(2):127-155. Usenix Association, Spring 1991.
32. D. M. Jacobson and J. Wilkes. Disk scheduling algorithms based on rotational position. HPL-CSP-91-7. Hewlett-Packard Laboratories, Palo Alto, CA, 24 February 1991, revised 1 March 1991.
33. J. Katcher. PostMark: a new file system benchmark. TR3022. Network Appliance, October 1997.
34. K. Keeton, D. A. Patterson, and J. M. Hellerstein. A case for intelligent disks (IDISKs). SIGMOD Record, 27(3):42-52, September 1998.
35. G. H. Kim and E. H. Spafford. The design and implementation of Tripwire: a file system integrity checker. Conference on Computer and Communications Security (Fairfax, Virginia), pages 18-29, 2-4 November 1994.
36. F. Korn, A. Labrinidis, Y. Kotidis, and C. Faloutsos. Ratio Rules: A New Paradigm for Fast, Quantifiable Data Mining. VLDB, August 1998.
37. D. Kotz. Disk-directed I/O for MIMD multiprocessors. Symposium on Operating Systems Design and Implementation (Monterey, CA), pages 61-74. Usenix Association, 14-17 November 1994.
38. T. M. Kroeger and D. D. E. Long. The case for efficient file access pattern modeling. Hot Topics in Operating Systems (Rio Rico, Arizona), pages 14-19, 29-30 March 1999.
39. J. N. Matthews, D. Roselli, A. M. Costello, R. Y. Wang, and T. E. Anderson. Improving the performance of log-structured file systems with adaptive methods. ACM Symposium on Operating System Principles (Saint-Malo, France, 5-8 October 1997).
40. Published as Operating Systems Review, 31(5):238-252. ACM, 1997.
41. M. K. McKusick, W. N. Joy, S. J. Leffler, and R. S. Fabry. A fast file system for UNIX. ACM Transactions on Computer-Systems, 2(3):181-197, August 1984.
42. B. McNutt. Background data movement in a log-structured disk subsystem. IBM Journal of Research and Development, 38(1):47-58, 1994.
43. J. Menon, J. Roche, and J. Kasson. Floating parity and data disk arrays. Journal of Parallel and Distributed Computing, 17(1-2):129-139, January-February 1993.
44. A. Molano, K. Juvva, and R. Rajkumar. Real-time filesys-tems. Guaranteeing timing constraints for disk accesses in RT-Mach. Proceedings Real-Time Systems Symposium (San Francisco, CA, 2-5 December 1997), pages 155-165. Institute of Electrical and Electronics Engineers Comp. Soc, 1997.
45. S. W. Ng. Improving disk performance via latency reduction. IEEE Transactions on Computers, 40(1):22-30, January 1991.
46. F. Olken and D. Rotem. Simple random sampling from relational databases. VLDB, pages 160-169, 1986.
47. R. H. Patterson, G. A. Gibson, E. Ginting, D. Stodolsky, and J. Zelenka. Informed prefetching and caching. ACM Symposium on Operating System Principles (Copper Mountain Resort, CO).
48. Published as Operating Systems Review, 29(5):79-95, 3-6 December 1995.
49. E. Riedel, C. Faloutsos, G. R. Ganger, and D. F. Nagle. Data mining on an OLTP system (nearly) for free. ACM SIGMOD Conference 2000 (Dallas, TX), pages 13-21, 14-19 May 2000.
50. E. Riedel, G. Gibson, and C. Faloutsos. Active storage for large-scale data mining and multimedia applications. International Conference on Very Large Databases (New York, NY, 24-27 August, 1998).
51. Published as Proceedings VLDB. pages 62-73. Morgan Kaufmann Publishers Inc., 1998.
52. M. Rosenblum and J. K. Ousterhout. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems, 10(1):26-52, February 1992.
53. C. Ruemmler and J. Wilkes. Disk Shufßmg. HPL-91-156. Hewlett-Packard Laboratories, Palo Alto, CA, October 1991.
54. P. H. Seaman, R. A. Lind, and T. L. Wilson. On teleprocessing system design, part IV: an analysis of auxiliary-storage activity. IBM Systems Journal, 5(3):158-170, 1966.
55. M. Seltzer, P. Chen, and J. Ousterhout. Disk scheduling revisited. Winter USENIX Technical Conference (Washington, DC), pages 313-323, 22-26 January 1990.
56. M. Seltzer, K. A. Smith, H. Balakrishnan, J. Chang, S. McMains, and V. Padmanabhan. File system logging versus clustering: a performance comparison. Annual USENIX Technical Conference (New Orleans), pages 249-264. Usenix Association, 16-20 January 1995.
57. Margo Seltzer. LFS and FFS Supplementary Information, 1995. http://www.eecs.harvard.edu/margo/usenix. 195.
58. P. J. Shenoy and H. M. Vin. Cello: a disk scheduling framework for next generation operating systems. ACM SIG-METRICS Conference on Measurement and Modeling of Computer Systems (Madison, WI).
59. Published as Performance Evaluation Review, 26(1):44-55, June 1998.
60. Elizabeth Shriver, Christopher Small, and Keith A. Smith. Why Does File System Prefetching Work? USENIX Technical Conference (Monterey, California, June 6-11 1999), pages 71-83. USENIX, 1999.
61. D. C. Steere. Exploiting the non-determinism and asyn-chrony of set iterators to reduce aggregate file I/O latency. ACM Symposium on Operating System Principles (Saint-Malo, France, 5-8 October 1997).
62. Published as Operating Systems Review, 31(5):252-263. ACM, 1997.
63. P. Vongsathorn and S. D. Carson. A system for adaptive disk rearrangement. Software Practice and Experience, 20(3):225-242, March 1990.
64. R. Y. Wang, D. A. Patterson, and T. E. Anderson. Virtual log based file systems for a programmable disk. Symposium on Operating Systems Design and Implementation (New Orleans, LA, 22-25 February 1999), pages 29-43. ACM, Winter 1998.
65. J. Widom. Research Problems in Data Warehousing. Conference on Information and Knowledge Management, November 1995.
66. J. Wilkes, R. Golding, C. Staelin, and T. Sullivan. The HP AutoRAID hierarchical storage system. ACM Transactions on Computer Systems, 14(1):108-136, February 1996.
67. B. L. Worthington, G. R. Ganger, and Y. N. Patt. Scheduling for modern disk drives and non-random workloads. CSE-TR-194-94. Department of Computer Science and Engineering, University of Michigan, March 1994.
68. Xiang Yu, Benjamin Gum, Yuqun Chen, Randolph Y. Wang, Kai Li, Arvind Krishnamurthy, and Thomas E. Anderson. Trading Capacity for Performance in a Disk Array. Symposium on Operating Systems Design and Implementation, October 2000.
69. T. Zhang, R. Ramakrishnan, and M. Livny. BIRCH: A New Data Clustering Algorithm and Its Applications. Data Mining and Knowledge Discovery, 2(1), 1997.