Increasing buffer-locality for multiple index based scans through intelligent placement and index scan speed control

33rd International Conference on Very Large Data Bases, VLDB 2007 - Conference Proceedings

Volumn , Issue , 2007, Pages 1298-1309

  Lang, Christian A ^a   Bhattacharjee, Bishwaranjan ^a   Malkemus, Tim ^a   Wong, Kwai ^b  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b IBM TORONTO LAB   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; DECISION SUPPORT SYSTEMS; MANAGEMENT INFORMATION SYSTEMS; QUERY LANGUAGES;

BUFFER CONTENTS; BUFFER REUSE; CLUSTERING SCHEME; DATABASE ENGINE; MULTIPLE INDEX; RUNTIME BEHAVIORS; SCAN OPERATIONS; TPC-H WORKLOAD;

DATABASE SYSTEMS;

EID: 85011052266     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. Padmanabhan, S., Bhattacharjee, B., Malkemus, T., Cranston L., Huras, M., "Multi-Dimensional Clustering: A New Data Layout Scheme in DB2", Proceedings of SIGMOD 2003.
2. Bhattacharjee, B., Padmanabhan, S., Malkemus, T., Lai, T., Cranston, L., Huras, M., "Efficient Query Processing for Multi-Dimensionally Clustering Tables in DB2", Proceedings of VLDB 2003
3. Teradata Corporation, "Introduction to Teradata RDBMS V2R5.0", December 2002
4. Kyte, T., "Expert Oracle", Apress, 2005
5. Winter Corporation, "Peak Workload, DW 2005", http://www.wintercorp.com
6. E. Grochowski; R.D. Halem, "Technological impact of magnetic hard disk drives on storage systems" IBM System Journal, Vol 42, No 2, 2003
7. R. Bhashyam. Technology challenges in a data warehouse. In Proc. Int. Conf. on Very Large Data Bases, pages 1225-1226, 2004.
8. Lang, C., Bhattacharjee, B., Malkemus, T., Padmanabhan, S., Wang, K., "Increasing Buffer Locality for Multiple Relational Table Scans through Grouping and Throttling", Proceedings of the ICDE 2007
9. http://www-306.ibm.com/software/data/db2
10. E. J. O'Neil, P. E. O'Neil, and G. Weikum. The LRU-K page replacement algorithm for database disk buffering. In Proc. ACM SIGMOD Int. Conf. on Management of Data, pages 297-306, 1993.
11. T. Johnson and D. Shasha. 2Q: A low overhead high performance buffer management replacement algorithm. In Proc. Int. Conf. on Very Large Data Bases, pages 439-450, 1994.
12. J. Robinson and M. Devarakonda. Data cache management using frequency-based replacement. In Proc. ACM SIGMETRICS Conf., pages 134-142, 1990.
13. D. Lee, J. Choi, J.-H. Kim, S. H. Noh, S. L. Min, Y. Cho, and C. S. Kim. LRFU: A spectrum of policies that subsumes the least recently used and least frequently used policies. IEEE Trans. Computers, 50(12): 1352-1360, 2001.
14. N. Megiddo and D. Modha. Outperforming LRU with an adaptive replacement cache, 2004.
15. P. M. Fernandez. Red brick warehouse: a read-mostly RDBMS for open SMP platforms. In Proc. ACM SIGMOD Int. Conf. on Management of Data, page 492, 1994.
16. T. Walter. Explaining cache - NCR CTO Todd Walter answers your trickiest questions on Teradata's caching functionality. (http://www.teradata.com/t/page/116344/)
17. R. Bhashyam, "TPC-D - The Challenges, Issues and Results", NCR Corporation, SIGMOD Record 25(4) 1996: 89-93
18. www.microsoft.com, "SQL Server 2005 Books Online"
19. S. Harizopoulos, V. Shkapenyuk, and A. Ailamaki. QPipe: A simultaneously pipelined relational query engine. In Proc. ACM SIGMOD Int. Conf. on Management of Data, pages 383-394, 2005.
20. P. Roy, S. Seshadri, S. Sudarshan, and S. Bhobe. Efficient and extensible algorithms for multi query optimization. In Proc. ACM SIGMOD Int. Conf. on Management of Data, pages 249-260, 2000.
21. J. Shim, P. Scheuermann, and R. Vingralek. Dynamic caching of query results for decision support systems. In Proc. Int. Conf. on Scientific and Statistical Database Management, pages 254-263, 1999.
22. M. Zukowski; P.A. Boncz; M.L. Kersten, "Cooperative Scans", CWI Report 2004, INS-E0411, ISSN 1386-3681
23. G M. Sacco and M. Schkolnick. A mechanism for managing the buffer pool in a relational database system using the hot set model. In Proc. Int. Conf. on Very Large Data Bases, pages 257-262, 1982.
24. H. Chou and D. DeWitt. An evaluation of buffer management strategies for relational database systems. In Proc. Int. Conf. on Very Large Data Bases, pages 127-141, 1985.
25. http://www.tpc.org/tpch