A new approach to dynamic self-tuning of database buffers

ACM Transactions on Storage

Volumn 4, Issue 1, 2008, Pages

  Tran, Dinh Nguyen ^a   Huynh, Phung Chinh ^b   Tay, Y C ^c   Tung, Anthony K H ^c  

^a NEW YORK UNIVERSITY   (United States)

^b MICROSOFT   (United States)

^c NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Autonomic computing; Buffer allocation; Miss probability

Indexed keywords

BLACK BOXES; BUFFER ALLOCATION; CACHE MISSES; CACHING DATA; DATA-SETS; DIFFERENTIATED SERVICE (DIFFSERV); DIRECT IMPACT; EMPIRICAL EQUATIONS; GRADIENT DESCENT (GD); LARGE SYSTEMS; MANUAL TUNING; NEW APPROACHES; POSTGRESQL; SELF TUNING (ST); SMALL COMPANIES; TUNING KNOBS;

COMPUTER NETWORKS; DYNAMICAL SYSTEMS; GRADIENT METHODS; INDUSTRY; KNOBS; MULTITASKING; NUMERICAL METHODS; PROBABILITY; TUNING;

DATABASE SYSTEMS;

EID: 44849092214     PISSN: 15533077     EISSN: 15533093     Source Type: Journal    
DOI: 10.1145/1353452.1353455     Document Type: Article

References (36)

1. AUTOADMIN. 2006. AutoAdmin: Self-Tuning and self-administering datdbases. http://research. microsoft.com/dmx/autoadmin.
2. AUTONOMIC COMPUTING. 2006. Autonomic computing homepage. http://www.research.ibm.com/ autonomic.
3. BANSAL, S.AND MODHA,D.S. 2004. Car: Clock with adaptive replacement. In Proceedings of the 3rd USENIX Conference on File and Storage Technologies (FAST). USENIX Association, Berkeley, CA, 187-200.
4. BELADY, L. A. 1996. A study of replacement algorithms for virtual storage computer. IBM Syst. J. 5, 2, 78-101.
5. BENOIT, D. G. 2005. Automatic diagnosis of performance problems in database management systems. In Proceedings of the 2nd International Conference on Automatic Computing (ICAC). IEEE Computer Society, Washington, DC, 326-327.
6. BROWN, K. P., CAREY, M. J., AND LIVNY, M. 1996. Goal-Oriented buffer management revisited. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM Press, New York, 353-364.
7. CAI, L. AND LU, Y.-H. 2005. Joint power management of memory and disk. In Proceedings of the Conference on Design, Automation and Test in Europe (DATE). IEEE Computer Society, Washington, DC, 86-91.
8. CHUNG, J.-Y., FERGUSON, D., WANG, G., NIKOLAOU, C., AND TENG, J. 1995. Goal-Oriented dynamic buffer pool management for data base systems. In Proceedings of IEEE International Conference on Engineering of Complex Computer Systems (ICECCS), Fort Lauderdale, FL. IEEE Computer Society, 191-198.
9. DAGEVILLE, B. AND ZAIT, M. 2002. SQL memory management in Oracle9i. In Proceedings of the International Conference on Very Large Databases (VLDB), Hong Kong, China. Morgan Kaufmann, 962-973.
10. DAN, A. AND TOWSLEY, D. 1990. An approximate analysis of the LRU and FIFO buffer replacement schemes. In Proceedings of the ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems. ACM Press, New York, 143-152.
11. DAN, A., YU, P. S., AND CHUNG, J. Y. 1995. Characterization of database access pattern for analytic prediction of buffer hit probability. The VLDB J. 4, 1, 127-154.
12. DIAS, K., RAMACHER, M., SHAFT, U., VENKATARAMANI, V., AND WOOD, G. 2005. Automatic performance diagnosis and tuning in Oracle. In Proceedings of the Conference on Innovative Data Systems Research (CIDR), Asilomar, CA. 84-94.
13. FLOYD, S., HANDLEY, M., PADHYE, J., AND WIDMER, J. 2000. Equation-Based congestion control for unicast applications. In Proceedings of the ACM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM). ACM Press, New York, 43-56.
14. HSU, W. W., SMITH, A. J., AND YOUNG, H. C. 2001. I/O reference behavior of production database workloads and the TPC benchmarks - An analysis at the logical level. ACM Trans. Database Syst. 26, 1, 96-143.
15. JAIN, R. 1991. The Art of Computer Systems Performance Analysis. John Wiley, New York.
16. KO, B.-J., LEE, K.-W., AMIRI, K., AND CALO, S. 2003. Scalable service differentiation in a shared storage cache. In Proceedings of the 23rd International Conference on Distributed Computing Systems (ICDCS). IEEE Computer Society, Washington, DC, 184-193.
17. LEFURGY, C., RAJAMANI, K., RAWSON, F., FELTER, W., KAISTLER, M., AND KELLER, T. W. 2003. Energy management for commercial servers. Comput. 36, 12, 39-48.
18. LIGHTSTONE, S. S., LOHMAN, G., AND ZILIO, D. 2002. Toward autonomic computing with DB2 universal database. SIGMOD Rec. 31, 3, 55-61.
19. LLANOS, D. R. 2006. TPCC-UVa: An open-source TPC-C implementation for global performance measurement of computer systems. SIGMOD Rec. 35, 4, 6-15.
20. LU, Y., ABDELZAHER, T., LU, C.,AND TAO,G. 2002. Anadaptivecontrol framework for QoS guarantees and its application to differentiated caching services. In Proceedings of the IEEE International Workshop on Quality of Service (IWQoS), Miami Beach, FL. IEEE, 23-32.
21. MATTSON, R. L., GECSEI, J., SLUTZ, D. R., AND TRAIGER, I. L. 1970. Evaluation techniques for storage hierarchies. IBM Syst. J. 9, 2, 78-117.
22. NARAYANAN, D., THERESKA, E., AND AILAMAKI, A. 2005. Continuous resource monitoring for self-predicting DBMS. In Proceedings of the 13th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems(MASCOTS). IEEE Computer Society, Washington, DC, 239-248.
23. NG, R., FALOUTSOS, C., AND SELLIS, T. 1995. Flexible and adaptable buffer management techniques for database management systems. IEEE Trans. Comput. 44, 4, 546-560.
24. O'NEIL, E. J., O'NEIL, P. E., AND WEIKUM, G. 1999. An optimality proof of the LRU-K page replacement algorithm. J. ACM 46, 1, 92-112.
25. PADHYE, J., FIROIU, V., TOWSLEY, D. F., AND KUROSE, J. F. 2000. Modeling TCP Reno performance: A simple model and its empirical validation. IEEE/ACM Trans. Netw. 8, 2, 133-145.
26. STORM, A. J., GARCIA-ARELLANO, C., LIGHTSTONE, S. S., DIAO, Y., AND SURENDRA, M. 2006. Adaptive self-tuning memory in DB2. In Proceedings of the 32nd International Conference on Very Large Data Bases (VLDB). VLDB Endowment, 1081-1092.
27. SUH, G. E., RUDOLPH, L., AND DEVADAS, S. 2004. Dynamic partitioning of shared cache memory. J. Supercomput. 28, 1, 7-26.
28. TAY, Y. C. AND ZOU,M. 2006. A page fault equation for modeling the effectof memory size. Perform. Eval. 63, 2, 99-130.
29. THIÉBAUT, D., STONE, H. S., AND WOLF, J. L. 1992. Improving disk cache hit-ratios through cache partitioning. IEEE Trans. Comput. 41, 6, 665-676.
30. TIAN, W., MARTIN, P., AND POWLEY, W. 2003. Techniques for automatically sizing multiple buffer pools in DB2. In Proceedings of the Conference of the Centre for Advanced Studies on Collaborative Research (CASCON). IBM Press, 294-302.
31. TPC-C BENCHMARK. 2006. TPC-C V5 homepage. http://www.tpc.org/ tpcc/.
32. TSUEI, T.-F., PACKER, A. N., AND KO, K.-T. 1997. Database buffer size investigation for OLTP workloads. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM Press, New York, 112-122.
33. WALDSPURGER, C. A. 2002. Memory resource management in VMware ESX server. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI). ACM Press, New York, 181-194.
34. XI, Y., MARTIN, P., AND POWLEY, W. 2001. An analytical model for buffer hit rate prediction. In Proceedings of the Conference of the Centre for Advanced Studies on Collaborative Research (CASCON). IBM Press, 18.
35. YU, P. S. AND CORNELL, D. W. 1991. Optimal buffer allocation in a multi-query environment. In Proceedings of the 7th International Conference on Data Engineering. IEEE Computer Society, Washington, DC, 622-631.
36. ZHOU, P., PANDEY, V., SUNDARESAN, J., RAGHURAMAN, A., ZHOU, Y., AND KUMAR, S. 2004. Dynamic tracking of page miss ratio curve for memory management. In Proceedings of the 11th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). ACM Press, New York, 177-188.