Data mining-based materialized view and index selection in data warehouses

Journal of Intelligent Information Systems

Volumn 33, Issue 1, 2009, Pages 65-93

  Aouiche, Kamel ^a   Darmont, Jérôme ^a  

^a UNIVERSITÉ DE LYON   (France)

Author keywords

Cost models; Data mining; Data warehouses; Indexes; Materialized views; Performance optimization

Indexed keywords

COST MODELS; DATA ACCESS; DATA MINING PROCESS; INDEX SELECTION; INDEXES; MAINTENANCE OVERHEAD; MATERIALIZED VIEW; MATERIALIZED VIEWS; PERFORMANCE OPTIMIZATION; PHYSICAL STRUCTURES; STORAGE SPACES;

DATA MINING; DATA STRUCTURES; MINING;

DATA WAREHOUSES;

EID: 68149164770     PISSN: 09259902     EISSN: 15737675     Source Type: Journal    
DOI: 10.1007/s10844-009-0080-0     Document Type: Article

References (66)

1. Agrawal, R., & Srikant, R. (1994). Fast algorithms for mining association rules. In 20th international conference on very large data bases (VLDB 1994) (pp. 487-499).
2. Agrawal, S., Chaudhuri, S., Kollár, L., Marathe, A., Narasayya, V., & Syamala, M. (2004). Database tuning advisor for Microsoft SQL server 2005. In 30th international conference on very large data bases (VLDB 2004) (pp. 1110-1121). Toronto, Canada.
3. Agrawal, S., Chaudhuri, S., & Narasayya, V. R. (2000). Automated selection of materialized views and indexes in SQL databases. In 26th international conference on very large data bases (VLDB 2000) (pp. 496-505). Cairo, Egypt.
4. Agrawal, S., Chaudhuri, S., & Narasayya, V. (2001). Materialized view and index selection tool for Microsoft SQL server 2000. In ACM SIGMOD international conference on management of data (SIGMOD 2001) (p. 608). Santa Barbara, USA.
5. Aouiche, K., Darmont, J., Boussaïd, O., & Bentayeb, F. (2005). Automatic selection of bitmap join indexes in data warehouses. In 7th international conference on data warehousing and knowledge discovery (DaWaK 2005), LNCS (Vol. 3589, pp. 64-73). Copenhagen, Denmark. (Pubitemid 41450388)
6. Aouiche, K., Darmont, J., & Gruenwald, L. (2003). Frequent itemsets mining for database auto-administration. In 7th international database engineering and application symposium (IDEAS 2003) (pp. 98-103). Hong Kong, China.
7. Aouiche, K., Jouve, P., & Darmont, J. (2006). Clustering-based materialized view selection in data warehouses. In 10th East-European conference on advances in databases and information systems (ADBIS 2006), LNCS (Vol. 4152, pp. 81-95). Thessaloniki, Greece. (Pubitemid 44576926)
8. Baralis, E., Paraboschi, S., & Teniente, E. (1997). Materialized views selection in a multidimensional database. In 23rd international conference on very large data bases (VLDB 1997) (pp. 156-165). Athens, Greece.
9. Baril, X., & Bellahsene, Z. (2003). Selection of materialized views: A cost-based approach. In 15th international conference on advanced information systems engineering (CAiSE 2003) (pp. 665-680). Klagenfurt, Austria.
10. Bellatreche, L., Boukhalfa, K., & Mohania, M. (2005). An evolutionary approach to schema partitioning selection in a data warehouse environment. In 7th international conference on data warehousing and knowledge discovery (DaWaK 2005), LNCS (Vol. 3589, pp. 115-125). Copenhagen, Denmark. (Pubitemid 41450393)
11. Bellatreche, L., Karlapalem, K., & Schneider, M. (2000). On efficient storage space distribution among materialized views and indices in data warehousing environments. In 9th international conference on information and knowledge management (CIKM 2000) (pp. 397-404). McLean, USA.
12. Bruno, N., & Chaudhuri, S. (2006). Physical design refinement: The "merge-reduce" approach. In 10th international conference on extending database technology (EDBT 2006), LNCS (Vol. 3896, pp. 386-404). Munich, Germany.
13. A. F. Cardenas 1975 Analysis and performance of inverted data base structures Communication of the ACM 18 5 253 263
14. Chan, G. K. Y., Li, Q., & Feng, L. (1999). Design and selection of materialized views in a data warehousing environment: A case study. In 2nd ACM international workshop on data warehousing and OLAP (DOLAP 1999) (pp. 42-47). Kansas City, USA.
15. S. Chaudhuri M. Datar V. Narasayya 2004 Index selection for databases: A hardness study and a principled heuristic solution IEEE Transactions on Knowledge and Data Engineering 16 11 1313 1323 (Pubitemid 40242322)
16. Chaudhuri, S., Gupta, A., & Narasayya, V. (2002). Compressing SQL workloads. In 2002 ACM SIGMOD international conference on management of data (SIGMOD 2002) (pp. 488-499). Madison, Wisconsin. (Pubitemid 34985572)
17. Chaudhuri, S., & Narasayya, V. (1997). An efficient cost-driven index selection tool for Microsoft SQL server. In 23rd international conference on very large data bases (VLDB 1994) (pp. 146-155). Santiago de Chile, Chile.
18. S. Chaudhuri R. Motwani 1999 On sampling and relational operators IEEE Data Engineering Bulletin 22 4 41 46
19. Choenni, S., Blanken, H. M., & Chang, T. (1993a). Index selection in relational databases. In 5th international conference on computing and information (ICCI 1993) (pp. 491-496). Ontario, Canada.
20. S. Choenni H. M. Blanken T. Chang 1993 On the selection of secondary indices in relational databases Data Knowledge Engineering 11 3 207 238
21. D. Comer 1978 The difficulty of optimum index selection ACM Transactions on Database Systems 3 4 440 445
22. Y. A. Feldman J. Reouven 2003 A knowledge-based approach for index selection in relational databases Expert System with Applications 25 1 15 37
23. S. J. Finkelstein M. Schkolnick P. Tiberio 1988 Physical database design for relational databases ACM Transactions on Database Systems 13 1 91 128 (Pubitemid 18579845)
24. Frank, M. R., Omiecinski, E., & Navathe, S. B. (1992). Adaptive and automated index selection in RDBMS. In 3rd international conference on extending database technology (EDBT 1992), LNCS (Vol. 580, pp. 277-292). Vienna, Austria.
25. Goldstein, J., & Åke Larson, P. (2001). Optimizing queries using materialized views: A practical, scalable solution. In ACM SIGMOD international conference on management of data (SIGMOD 2001) (pp. 331-342). Santa Barbara, USA.
26. Golfarelli, M., Rizzi, S., & Saltarelli, E. (2002). Index selection for data warehousing. In 4th international workshop on design and management of data warehouses (DMDW 2002) (pp. 33-42). Toronto, Canada.
27. Golfarelli, M., & Rizzi, S. (1998). A methodological framework for data warehouse design. In 1st ACM international workshop on data warehousing and OLAP (DOLAP 1998) (pp. 3-9). New York, USA.
28. T. I. Gundem 1999 Near optimal multiple choice index selection for relational databases Computers & Mathematics with Applications 37 2 111 120
29. Gupta, H. (1999). Selection and maintenance of views in a data warehouse. PhD thesis, Stanford University.
30. Gupta, H., Harinarayan, V., Rajaraman, A., & Ullman, J. D. (1997). Index selection for OLAP. In 13th international conference on data engineering (ICDE 1997) (pp. 208-219). Birmingham, UK.
31. H. Gupta I. S. Mumick 2005 Selection of views to materialize in a data warehouse IEEE Transactions on Knowledge and Data Engineering 17 1 24 43 (Pubitemid 40536469)
32. Harinarayan, V., Rajaraman, A., & Ullman, J. D. (1996). Implementing data cubes efficiently. In ACM SIGMOD international conference on management of data (SIGMOD 1996) (pp. 205-216). Montreal, Canada. (Pubitemid 126440769)
33. M. Y. L. Ip L. V. Saxton V. V. Raghavan 1983 On the selection of an optimal set of indexes IEEE Transactions on Software Engineering 9 2 135 143
34. A. K. Jain M. N. Murty P. J. Flynn 1999 Data clustering: A review ACM Computing Surveys 31 3 264 323
35. Jouve, P., & Nicoloyannis, N. (2003a). KEROUAC: An algorithm for clustering categorical data sets with practical advantages. In international workshop on data mining for actionable knowledge (DMAK/PAKDD 2003). Seoul, Korea.
36. Jouve, P., & Nicoloyannis, N. (2003b). A new method for combining partitions, applications for distributed clustering. In international workshop on paralell and distributed machine learning and data mining (ECML/PKDD 2003) (pp. 35-46). Cavtat-Dubrovnik, Croatia.
37. Kotidis, Y., & Roussopoulos, N. (1999). Dynamat: A dynamic view management system for data warehouses. In ACM SIGMOD international conference on management of data (SIGMOD 1999) (pp. 371-382). Philadelphia, USA. (Pubitemid 129597350)
38. Kratica, J., Ljubić, I., & Tošić, D. (2003). A genetic algorithm for the index selection problem. In Applications of evolutionary computing, EvoWorkshops 2003: EvoBIO, EvoCOP, EvoIASP, EvoMUSART, EvoROB, EvoSTIM. LNCS (Vol. 2611, pp. 281-291).
39. Kyu-Young, W. (1987). Index selection in relational databases. In Foundation of data organization (pp. 497-500). New York: Plenum.
40. Labio, W., Quass, D., & Adelberg, B. (1997). Physical database design for data warehouses. In 13th international conference on data engineering (ICDE 1997) (pp. 277-288). Birmingham, UK.
41. Leung, C., Khan, Q., & Hoque, T. (2005). CanTree: A tree structure for efficient incremental mining of frequent patterns. In 5th IEEE international conference on data mining (ICDM 2005) (pp. 274-281). Houston, USA. (Pubitemid 47385703)
42. Mahboubi, H., Aouiche, K., & Darmont, J. (2006). Materialized view selection by query clustering in XML data warehouses. In 4th international multiconference on computer science and information technology (CSIT 2006) (Vol. 2, pp. 68-77). Amman, Jordan.
43. Nadeau, T. P., & Teorey, T. J. (2001). A pareto model for OLAP view size estimation. In 4th conference of the centre for advanced studies on collaborative research (CASCON 2001) (p. 13). Toronto, Canada.
44. Nadeau, T. P., & Teorey, T. J. (2002). Achieving scalability in OLAP materialized view selection. In 5th ACM international workshop on data warehousing and OLAP (DOLAP 2002) (pp. 28-34). McLean, USA.
45. P. O'Neil G. Graefe 1995 Multi-table joins through bitmapped join indices SIGMOD Record 24 3 8 11
46. O'Neil, P., & Quass, D. (1997). Improved query performance with variant indexes. In ACM SIGMOD international conference on management of data (SIGMOD 1997) (pp. 38-49). Tucson, USA. (Pubitemid 127456772)
47. Pasquier, N., Bastide, Y., Taouil, R., & Lakhal, L. (1999). Discovering frequent closed itemsets for association rules. In 7th international conference on database theory (ICDT 1999), LNCS (Vol. 1540, pp. 398-416). Jerusalem, Israel.
48. Rizzi, S., & Saltarelli, E. (2003). View materialization vs. indexing: Balancing space constraints in data warehouse design. In 15th international conference on advanced information systems engineering (CAiSE 2003) (pp. 502-519). Klagenfurt, Austria.
49. S. Sarawagi 1997 Indexing OLAP data Data Engineering Bulletin 20 1 36 43
50. B. Shah K. Ramachandran V. Raghavan 2006 A hybrid approach for data warehouse view selection International Journal of Data Warehousing and Mining 2 2 1 37
51. Shukla, A., Deshpande, P., & Naughton, J. F. (2000). Materialized view selection for multi-cube data models. In 7th international conference on extending database technology (EDBT 2000) (pp. 269-284). Konstanz, Germany.
52. Shukla, A., Deshpande, P. M., Naughton, J. F., & Ramasamy, K. (1996). Storage estimation for multidimensional aggregates in the presence of hierarchies. In 22nd international conference on very large data bases (VLDB 1996) (pp. 522-531). Bombay, India.
53. Sismanis, Y., Deligiannakis, A., Roussopoulos, N., & Kotidis, Y. (2002). Dwarf: Shrinking the petacube. In ACM SIGMOD international conference on management of data (SIGMOD 2002) (pp. 464-475). Madison, USA. (Pubitemid 34985570)
54. J. R. Smith C.-S. Li A. Jhingran 2004 A wavelet framework for adapting data cube views for OLAP IEEE Transactions on Knowledge and Data Engineering 16 5 552 565
55. TPC (2005). TPC benchark H standard specification revision 2.3.0. Transaction Processing Performance Council.
56. TPC (2007). TPC benchmark DS standard specification, draft Version 52. Transaction Processing Performance Council.
57. Uchiyama, H., Runapongsa, K., & Teorey, T. J. (1999). A progressive view materialization algorithm. In 2nd ACM international workshop on data warehousing and OLAP (DOLAP 1999) (pp. 36-41). Kansas City, USA.
58. Valentin, G., Zuliani, M., Zilio, D., Lohman, G., & Skelley, A. (2000). DB2 advisor: An optimizer smart enough to recommend its own indexes. In 16th international conference on data engineering, (ICDE 2000) (pp. 101-110). California, USA.
59. Valluri, S. R., Vadapalli, S., & Karlapalem, K. (2002). View relevance driven materialized view selection in data warehousing environment. In 13th Australasian database technologies (ADC 2002) (pp. 187-196). Melbourne, Australia.
60. Whang, K. (1985). Index selection in relational databases. In international conference on foundations of data organization (FODO 1985) (pp. 487-500). Kyoto, Japan.
61. Wu, M. (1999). Query optimization for selections using bitmaps. In ACM SIGMOD international conference on management of data (SIGMOD 1999) (pp. 227-238). Philadelphia, USA. (Pubitemid 129597338)
62. Wu, M., & Buchmann, A. (1998). Encoded bitmap indexing for data warehouses. In 14th international conference on data engineering (ICDE 1998) (pp. 220-230). Orlando, USA.
63. Yao, Q., Huang, J., & An, A. (2005). Machine learning approach to identify database sessions using unlabeled data. In 7th international conference on data warehousing and knowledge discovery (DaWaK 2005), LNCS (Vol. 3589, pp. 254-255). Copenhagen, Denmark.
64. S. B. Yao 1977 Approximating block accesses in database organizations Communications of the ACM 20 4 260 261
65. Zaman, M., Surabattula, J., & Gruenwald, L. (2004). An auto-indexing technique for databases based on clustering. In 15th international workshop on database and expert systems applications (DEXA Workshops 2004) (pp. 776-780). Zaragoza, Spain.
66. Zilio, D., Rao, J., Lightstone, S., Lohman, G., Storm, A., Garcia-Arellano, C., et al. (2004). DB2 design advisor: Integrated automatic physical database design. In 30th international conference on very large data bases (VLDB 2004) (pp. 1087-1097). Toronto, Canada.