C-Miner: Mining block correlations in storage systems

Proceedings of the 3rd USENIX Conference on File and Storage Technologies, FAST 2004

Volumn , Issue , 2004, Pages

  Li, Zhenmin ^a   Chen, Zhifeng ^a   Srinivasan, Sudarshan M ^a   Zhou, Yuanyuan ^a  

^a University of Illinois at Urbana Champaign   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA MINING; MINERS; SEMANTICS;

DATA LAYOUTS; DISK SCHEDULING; FILE SYSTEMS; FREQUENT SEQUENCES; PRE-FETCHING SCHEME; SEMANTIC PATTERN; SPACE REQUIREMENTS; STORAGE SYSTEMS;

DIGITAL STORAGE;

EID: 85084164115     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (69)

1. R. Agrawal and R. Srikant. Mining sequential patterns. In Eleventh International Conference on Data Engineering, 1995.
2. E. Anderson, M. Hobbs, K. Keeton, S. Spence, M. Uysal, and A. Veitch. Hippodrome: running circles around storage administration. In Proceedings of the First USENIX Conference on File and Storage Technologies, 2002.
3. G. H. Anthes. Storage virtualization: The next step. Computerworld, January 28, 2002.
4. I. Ari, A. Amer, E. Miller, S. Brandt, and D. Long. Who is more adaptive? ACME: adaptive caching using multiple experts. In Workshop on Distributed Data and Structures (WDAS), 2002.
5. A. C. Arpaci-Dusseau and R. H. Arpaci-Dusseau. Information and control in gray-box systems. In Proceedings of the eighteenth ACM symposium on Operating systems principles, 2001.
6. J. Ayres, J. E. Gehrke, T. Yiu, and J. Flannick. Sequential pattern mining using bitmaps. In Proc. 2002 ACM SIGKDD Int. Conf. Knowledge Discovery in Databases (KDD’02), pages 429–435, Edmonton, Canada, July 2002.
7. L. A. Barroso, K. Gharachorloo, and E. Bugnion. Memory system characterization of commercial workloads. In Proceedings of the 25th annual international symposium on Computer architecture, pages 3–14. IEEE Press, 1998.
8. A. D. Brown, T. C. Mowry, and O. Krieger. Compiler-based I/O prefetching for out-of-core applications. ACM Transactions on Computer Systems, 19(2):111–170, 2001.
9. P. Cao, E. Felten, and K. Li. Application-controlled file caching policies. In USENIX Summer 1994 Technical Conference, pages 171–182, June 1994.
10. P. Cao, E. W. Felten, A. Karlin, and K. Li. A study of integrated prefetching and caching strategies. In Proceedings of ACM SIGMETRICS, May 1995.
11. E. V. Carrera, E. Pinheiro, and R. Bianchini. Conserving disk energy in network servers. In Proceedings of the 17th International Conference on Supercomputing, June 2003.
12. F. W. Chang and G. A. Gibson. Automatic I/O hint generation through speculative execution. In Operating Systems Design and Implementation, pages 1–14, 1999.
13. Z. Chen, Y. Zhou, and K. Li. Eviction-based cache placement for storage caches. In USENIX Annual Technical Conference, General Track, pages 269–281, San Antonio, Texas, USA, June 9-14 2003.
14. J. Choi, S. H. Noh, S. L. Min, and Y. Cho. Towards application/file-level characterization of block references: a case for fine-grained buffer management. In Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, 2000.
15. H. Chou and D. DeWitt. An evaluation of buffer management strategies for relational database systems. In Proceedings of the 19th International Conference on Very Large Data Bases, pages 127–141, Dublin, Ireland, 1993.
16. C. Clifton and G. Gengo. Developing custom intrusion detection filters using data mining. In 2000 Military Communications International Symposium (MILCOM2000), Los Angeles, California, Oct. 2000.
17. K. M. Curewitz, P. Krishnan, and J. S. Vitter. Practical prefetching via data compression. In Proc. 1993 ACM-SIGMOD Conference on Management of Data, pages 257–266, May 1993.
18. P. R. Eaton, D. Geels, and G. Mori. Clump: Improving file system performance through adaptive optimizations.
19. EMC Corporation. Symmetrix 3000 and 5000 Enterprise Storage Systems product description guide., 1999.
20. G. Ganger. Systemoriented evaluation of I/O subsystem performance. Technical Report CSE-TR-243-95, University of Michigan, June 1995.
21. C. A. Gerlhof and A. Kemper. A multi-threaded architecture for prefetching in object bases. In M. Jarke, J. A. B. Jr., and K. G. Jeffery, editors, Advances in Database Technology - EDBT’94. 4th International Conference on Extending Database Technology, Cambridge, United Kingdom, March 28-31, 1994, Proceedings, volume 779 of Lecture Notes in Computer Science, pages 351–364. Springer, 1994.
22. C. A. Gerlhof and A. Kemper. Prefetch support relations in object bases. In M. P. Atkinson, D. Maier, and V. Benzaken, editors, Persistent Object Systems, Proceedings of the Sixth International Workshop on Persistent Object Systems, Tarascon, Provence, France, 5-9 September 1994, Workshops in Computing, pages 115–126. Springer and British Computer Society, 1994.
23. G. A. Gibson, D. F. Nagle, K. Amiri, J. Butler, F. W. Chang, H. Gobioff, C. Hardin, E. Riedel, D. Rochberg, and J. Zelenka. A cost-effective, high-bandwidth storage architecture. In the 8th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), 1998.
24. J. Griffioen and R. Appleton. Reducing file system latency using a predictive approach. In In Proceedings of the 1994 Summer USENIX Conference, 1994.
25. J. Griffioen and R. Appleton. Performance measurements of automatic prefetching. In In Proceedings of the International Conference on Parallel and Distributed Computing Systems, 1995.
26. J. Han. How can data mining help bio-data analysis? In Proc. 2002 Workshop on Data Mining in Bioinformatics (BIOKDD’02), pages 1–4, Edmonton, Canada, July 2002.
27. J. Han and M. Kamber. Data Mining: Concepts and Techniques. Morgan Kaufmann Publishers, 2001.
28. IBM hard disk drive - Ultrastar 36Z15.
29. IBM. Storage Tank, a distributed storage system. IBM White Paper, http://www.almaden.ibm.com/StorageSystems/file_systems/storage_tank/papers.shtml.
30. K. Keeton and J. Wilkes. Automating data dependability. Proceedings of the 10th ACM-SIGOPS European Workshop, 2002.
31. J. Kim, J. Choi, J. Kim, S. Noh, S. Min, Y. Cho, and C. Kim. A low-overhead high-performance unified buffer management scheme that exploits sequential and looping references. In Proceedings of the 4th Symposium on Operating Systems Design and Implementation (OSDI), pages 119–134, San Diego, CA, Oct. 2000.
32. T. Kimbrel, A. Tomkins, R. H. Patterson, B. Bershad, P. Cao, E. Felten, G. Gibson, A. R. Karlin, and K. Li. A trace-driven comparison of algorithms for parallel prefetching and caching. In Proceedings of the 1996 Symposium on Operating Systems Design and Implementation, pages 19–34. USENIX Association, 1996.
33. T. M. Kroeger and D. D. E. Long. Predicting file-system actions from prior events. In 1996 USENIX Annual Technical Conference, pages 319–328, 1996.
34. G. Kuenning. Design of the SEER predictive caching scheme. In Workshop on Mobile Computing Systems and Applications, 1994.
35. G. H. Kuenning and G. J. Popek. Automated hoarding for mobile computers. In Proceedings of the 15th Symposium on Operating Systems Principles, pages 264–275, St. Malo, France, Oct. 1997. ACM.
36. E. K. Lee and C. A. Thekkath. Petal: distributed virtual disks. In Proceedings of the seventh international conference on Architectural support for programming languages and operating systems, pages 84–92. ACM Press, 1996.
37. W. Lee and S. Stolfo. Data mining approaches for intrusion detection. In Proceedings of the 7th USENIX Security Symposium, San Antonio, TX, 1998.
38. H. Lei and D. Duchamp. An analytical approach to file prefetching. In 1997 USENIX Annual Technical Conference, Anaheim, California, USA, 1997.
39. S. T. Leutenegger and D. Dias. A modeling study of the TPC-C benchmark. SIGMOD Record, 22(2):22–31, June 1993.
40. T. M. M. Wang, N. Chan, S. Papadimitriou, and C. Faloutsos. Data mining meets performance evaluation: Fast algorithms for modeling bursty traffic. 18th Internal Conference on Data Engineering, 2002.
41. T. M. Madhyastha, G. A. Gibson, and C. Faloutsos. Informed prefetching of collective input/output requests. Proceedings of SC99.
42. N. Megiddo and D. S. Modha. Arc: A self-tuning, low overhead replacement cache. In Proc. 2nd USENIX Conference on File and Storage Technologies (FAST 03), San Franciso, CA, 2003.
43. T. C. Mowry, A. K. Demke, and O. Krieger. Automatic compiler-inserted I/O prefetching for out-of-core applications. In Proceedings of the 1996 Symposium on Operating Systems Design and Implementation, pages 3–17. USENIX Association, Oct. 1996.
44. M. Palmer and S. B. Zdonik. Fido: A cache that learns to fetch. In G. M. Lohman, A. Sernadas, and R. Camps, editors, 17th International Conference on Very Large Data Bases, September 3-6, 1991, Barcelona, Catalonia, Spain, Proceedings, pages 255–264. Morgan Kaufmann, 1991.
45. R. H. Patterson, G. A. Gibson, E. Ginting, D. Stodolsky, and J. Zelenka. Informed prefetching and caching. In the 15th ACM Symposium on Operating System Principles, 1995.
46. J. Pei, J. Han, B. Mortazavi-Asl, H. Pinto, Q. Chen, U. Dayal, and M.C. Hsu. PrefixSpan: Mining sequential patterns efficiently by prefix-projected pattern growth. In Proc. 2001 Int. Conf. Data Engineering (ICDE’01), pages 215–224, Heidelberg, Germany, April 2001.
47. J. E. Pitkow and P. Pirolli. Mining longest repeating subsequences to predict world wide web surfing. In USENIX Symposium on Internet Technologies and Systems, 1999.
48. C. Ruemmler and J. Wilkes. A trace-driven analysis of disk working set sizes. Technical Report HPL–OSR–93–23, Hewlett-Packard Laboratories, Palo Alto, CA, USA, Apr. 5 1993.
49. C. Ruemmler and J. Wilkes. UNIX disk access patterns. In Proceedings of the Winter 1993 USENIX Conference, 1993.
50. B. Salmon, E. Thereska, C. A. Soules, and G. R. Ganger. A two-tiered software architecture for automated tuning of disk layouts. In First Workshop on Algorithms and Architectures for Self-Managing Systems, June 2003.
51. S. Schechter, M. Krishnan, and M. D. Smith. Using path profiles to predict http requests. In Seventh Intl World Wide Web Conference, Apr 1998.
52. J. Schindler, J. Griffin, C. Lumb, and G. Ganger. Track-aligned extents: matching access patterns to disk drive characteristics. In Proceedings of the First USENIX Conference on File and Storage Technologies, 2002.
53. A. Seifert and M. H. Scholl. A multi-version cache replacement and prefetching policy for hybrid data delivery environments. In 28th International Conference on Very Large Data Bases (VLDB), 2002.
54. M. Sivathanu, V. Prabhakaran, F. Popovici, T. E. Denehy, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Semantically-Smart Disk Systems. In Proceedings of the Second USENIX Conference on File and Storage Technologies, 2003.
55. A. J. Smith. Sequentiality and prefetching in database systems. ACM Transactions on Database Systems, 3(3):223–247, Sept. 1978.
56. B. J. Smith. A pipelined, shared resource MIMD computer. In Proceedings of International Conference on Parallel Proc essing, pages 6–8, 1978.
57. V. Soloviev. Prefetching in segmented disk cache for multi-disk systems. In Proceedings of the fourth workshop on I/O in parallel and distributed systems, pages 69–82. ACM Press, 1996.
58. Storage Performance Council. SPC I/O traces. http://www.storageperformance.org/.
59. C. D. Tait, H. Lei, S. Acharya, and H. Chang. Intelligent file hoarding for mobile computers. In Mobile Computing and Networking, pages 119–125, 1995.
60. A. Tomkins, R. H. Patterson, and G. Gibson. Informed multi-process prefetching and caching. In Proceedings of the 1997 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, pages 100–114. ACM Press, 1997.
61. V. Vellanki and A. Chervenak. A cost-benefit scheme for high performance predictive prefetching. In Proceedings of SC99: High Performance Networking and Computing, Portland, OR, 1999. ACM Press and IEEE Computer Society Press.
62. J. S. Vitter and P. Krishnan. Optimal prefetching via data compression. In Proceedings of the 32nd Annual IEEE Symposium on Foundations of Computer Science, Oct 1991.
63. H. Wedekind and G. Zoerntlein. Prefetching in realtime database applications. In Proceedings of the 1986 ACM SIGMOD international conference on Management of data, pages 215–226. ACM Press, 1986.
64. J. Wilkes, R. Golding, C. Staelin, and T. Sullivan. The HP AutoRAID hierarchical storage system. Proc. of the 15th Symp. on Operating Systems Principles, 1995.
65. T. Wong and J. Wilkes. My cache or yours? making storage more exclusive. In USENIX, 2002.
66. X. Yan, J. Han, and R. Afshar. CloSpan: Mining closed sequential patterns in large datasets. In Proc. 2003 SIAM Int. Conf. Data Mining (SDM’03), San Fransisco, CA, May 2003.
67. M. Zaki. SPADE: An efficient algorithm for mining frequent sequences. Machine Learning, 40:31–60, 2001.
68. Y. Zhang, J. Zhang, A. Sivasubramaniam, C. Liu, and H. Franke. Decision-support workload characteristics on clustered database server from the OS perspective. In Proceedings of the International Conference on Distributed Conputing Systems(ICDCS), May 2003.
69. Y. Zhou, J. F. Philbin, and K. Li. The multi-queue replacement algorithm for second level buffer caches. In Proceedings of the Usenix Technical Conference, June 2001.