Fragmenting very large XML data warehouses via K-means clustering algorithm

International Journal of Business Intelligence and Data Mining

Volumn 4, Issue 3-4, 2009, Pages 301-328

  Cuzzocrea, Alfredo ^a   Darmont, Jérôme ^b   Mahboubi, Hadj ^b  

^a UNIVERSITY OF CALABRIA   (Italy)

^b UNIVERSITÉ DE LYON   (France)

Author keywords

Clustering; Horizontal fragmentation; K means; XML data warehousing

Indexed keywords

EID: 71049165094     PISSN: 17438187     EISSN: 17438195     Source Type: Journal    
DOI: 10.1504/IJBIDM.2009.029076     Document Type: Article

References (62)

1. Agrawal, S., Chaudhuri, S. and Narasayya, V.R. (2000) 'Automated selection of materialized views and indexes in SQL databases', Proceedings of the 26th International Conference on Very Large Data Bases, Cairo, Egypt, pp.496-505.
2. Agrawal, R., Gehrke, J., Gunopulos, D. and Raghavan, P. (1998) 'Automatic subspace clustering of high dimensional data for data mining application', Proceedings of 1998 ACM-SIGMOD International Conference on Management of Data, Seattle, WA, USA, pp.94-105.
3. Agrawal, R. and Srikant, R. (1994) 'Fast algorithms for mining association rules in large databases', Proceedings of the 20th International Conference on Very Large Data Bases, Santiago de Chile, Chile, pp.487-499.
4. Andrade, A., Ruberg, G., Baião, F.A., Braganholo, V.P. and Mattoso, M. (2006) 'Efficiently processing XML queries over fragmented repositories with partiX', Proceedings of EDBT 2006 Workshops - Current Trends in Database Technology, LNCS, Munich, Germany, Vol. 4254, pp.150-163.
5. Aouiche, K., Jouve, P-E. and Darmont, J. (2006) 'Clustering-based materialized view selection in data warehouses', Proceedings of the 10th East-European Conference on Advances in Databases and Information Systems, LNCS, Thessaloniki, Greece, Vol. 4152, pp.81-95.
6. Azefack, S., Aouiche, K. and Darmont, J. (2007) 'Dynamic index selection in data warehouses', Proceedings of the 4th International Conference on Innovations in Information Technology (Innovations 07), Dubai, United Arab Emirates, pp.1-5.
7. Bellatreche, L. and Boukhalfa, K. (2005) 'An evolutionary approach to schema partitioning selection in a data warehouse', Proceedings of the 7th International Conference on Data Warehousing and Knowledge Discovery, LNCS, Copenhagen, Denmark, Vol. 3589, pp.115-125.
8. Bellatreche, L., Boukhalfa, K. and Richard, P. (2008) 'Horizontal partitioning in data warehouse: Hardness study, selection algorithms and validation on ORACLE10G', Proceedings of the 10th International Conference on Data Warehousing and Knowledge Discovery, LNCS, Turin, Italy, Vol. 5182, pp.87-96.
9. Beyer, K.S., Chamberlin, D.D., Colby, L.S., Ozcan, F., Pirahesh, H. and Xu, J. (2005) 'Extending XQuery for analytics', Proceedings of the 2005 SIGMOD International Conference on Management of Data, Baltimore, MD, Maryland, pp.503-514.
10. Boag, S., Chamberlin, D., Fernádez, M.F., Florescu, D., Robie, J. and Siméon, J. (2007) XQuery 1.0: An XML Query Language - W3C Recommendation, http://www.w3.org/TR/xquery/
11. Bonifati, A. and Cuzzocrea, A. (2007) 'Efficient fragmentation of large XML documents', Proceedings of the 18th International Conference on Database and Expert Systems Applications, LNCS, Regensburg, Germany, Vol. 4653, pp.539-550.
12. Bonifati, A., Cuzzocrea, A., Matrangolo, U. and Jain, M. (2004) 'XPath lookup queries in P2P networks', Proceedings of the 6th International Workshop on Web Information and Data Management, Washington DC, USA, pp.48-55.
13. Bonifati, A., Cuzzocrea, A. and Zinno, B. (2006) 'Fragmenting XML documents via structural constraints', Proceedings of the 10th East European Conference on Advances in Databases and Information Systems, Thessaloniki, Greece, pp.17-29.
14. Bose, S. and Fegaras, L. (2005) 'XFrag: A query processing framework for fragmented XML data', Proceedings of the 8th International Workshop on Web and Databases, Baltimore, MD, Maryland, pp.97-102.
15. Boukraa, D., Ben Messaoud, R. and Boussaïd, O. (2006) 'Physical design of XML data warehouse', Proceedings of the 2006 Decision-Support Systems Workshop, 9th Maghrebian Conference on Information Technologies, Agadir, Morocco, Paper 6.
16. Boussaïd, O., Ben Messaoud, R., Choquet, R. and Anthoard, S. (2006) 'X-warehousing: An XML-based approach for warehousing complex data', Proceedings of the 10th East-European Conference on Advances in Databases and Information Systems, LNCS, Thessaloniki, Greece, Vol. 4152, pp.39-54.
17. Carmichael, J.W., George, J.A. and Julius, R.S. (1968) 'Finding natural clusters', Journal of Systematic Zoology, Wiley-Blackwell, Hoboken, NJ, USA, Vol. 17, pp.144-150.
18. Ceri, S. and Pelagatti, G., Eds. (1984) Distributed Databases: Principles and Systems, McGraw-Hill, New York, NY, USA.
19. Clark, J. and DeRose, S. (1999) XML Path Language (XPath) Version 1.0 - W3C Recommendation, http://www.w3.org/TR/xpath
20. Codd, E.F., Codd, S.B. and Salley, C.T. (1993) Providing OLAP to User-Analysts: An IT Mandate, http://dev.hyperion.com/ resource_library/white_papers/providing_olap_to_user_analysts.pdf
21. Costa, C.L. and Furtado, P. (2006) 'Data warehouses in grids with high QoS', Proceedings of the 10th International Conference on Data Warehousing and Knowledge Discovery, LNCS, Krakow, Poland, Vol. 4081, pp.207-217.
22. Darabant, A.S. and Campan, A. (2004) 'Semi-supervised learning techniques: K-means clustering in OODB fragmentation', Proceedings of the 2nd International Conference on Computational Cybernetics, Vienna, Austria, pp.333-338.
23. Darmont, J., Boussaïd, O., Ralaivao, J.C. and Aouiche, K. (2005) 'An architecture framework for complex data warehouses', Proceedings of the 7th International Conference on Enterprise Information Systems, Setúbal, Portugal, pp.370-373.
24. Datta, A., Ramamritham, K. and Thomas, H.M. (1999) 'Curio: A novel solution for efficient storage and indexing in data warehouses', Proceedings of the 25th International Conference on very Large Data Bases, Edinburgh, UK, pp.730-733.
25. Fiolet, V. and Toursel, T. (2005) 'Progressive clustering for database distribution on a grid', Proceedings of the 4th International Symposium on Parallel and Distributed Computing, Lille, France, pp.282-289.
26. Fomichev, A., Grinev, M. and Kuznetsov, S. (2006) 'Sedna: A native XML DBMS', Proceedings of the 32nd International Conference on Current Trends in Theory and Practice of Computer Science, Merín, Czech Republic, pp.272-281.
27. Gertz, M. and Bremer, J-M. (2003) Distributed XML Repositories: Top-Down Design and Transparent Query Processing, TR CSE-2003-20, Departement of Computer Science, University of California, Davis, CA, USA.
28. Golfarelli, M., Maio, D. and Rizzi, S. (1998) 'The dimensional fact model: A conceptual model for data warehouses', International Journal of Cooperative Information Systems, Vol. 7, Nos. 2-3, pp.215-247.
29. Golfarelli, M., Maio, D. and Rizzi, S. (1999) 'Vertical fragmentation of views in relational data warehouses', Proceedings of the 7th Italian Symposium on Advanced Database Systems, Como, Italy, pp.19-33.
30. Golfarelli, M. and Rizzi, S. (2001) 'Data warehouse design from XML sources', Proceedings of the 4th International Workshop on Data Warehousing and OLAP, Atlanta, GA, USA, pp.40-47.
31. Gorla, N. and Betty, P.W.Y. (2008) 'Vertical fragmentation in databases using data-mining techniques', International Journal of Data Warehousing and Mining, Idea Group, Hershey, PA, USA, Vol. 4, No. 3, pp.35-53.
32. Gray, J., Chaudhuri, S., Bosworth, A., Layman, A., Reichart, D., Venkatrao, M., Pellow, F. and Pirahesh, H. (1997) 'Data cube: A relational aggregation operator generalizing group-by, cross-tab, and sub totals', Data Mining and Knowledge Discovery, Springer, Berlin, Germany, Vol. 1, No. 1, pp.29-53.
33. Holmes, G., Donkin, A. and Witten, I.H. (1994) 'Weka: A machine learning workbench', Proceedings of the 2nd Australia and New Zealand Conference on Intelligent Information Systems, Brisbane, Australia, pp.357-361.
34. Jagadish, H.V., Al-Khalifa, S., Chapman, A., Lakshmanan, L.V.S., Nierman, A., Paparizos, S., Patel, J.M., Srivastava, D., Wiwatwattana, N., Wu, Y. and Yu, C. (2002) 'TIMBER: A native XML database', VLDB Journal, Springer, Berlin, Germany, Vol. 11, No. 4, pp.274-291.
35. Kalnis, P., Ng, W.S., Ooi, B.C., Papadias, D. and Tan, K.L. (2002) 'An adaptive peer-to-peer network for distributed caching of OLAP results', Proceedings of the 2002 ACM SIGMOD International Conference on Management of Data, Madison, Wisconsin, USA, pp.25-36.
36. Kimball, R. and Ross, M. (2002) The Data Warehouse Toolkit: The Complete Guide to Dimensional Modeling, 2nd ed., Wiley, Hoboken, NJ, USA.
37. Koreichi, A. and Le Cun, B. (1997) On Data Fragmentation and Allocation in Distributed Object Oriented Databases, TR 1997-11, PRiSM Laboratory, Versailles University, France, pp.1-17.
38. Ma, H. and Schewe, K-D. (2003) 'Fragmentation of XML documents', Proceedings of the 18th Brazilian Symposium on Databases, Amazonas, Brasil, pp.200-204.
39. Ma, H., Schewe, K-D., Hartmann, S. and Kirchberg, M. (2003) 'Distribution design for XML documents', Proceedings of the 3rd International Conference on Electronic Commerce Engineering, Hangzhou, China, pp.1007-1012.
40. MacQueen, J.B. (1967) 'Some methods for classification and analysis of multivariate observations', Proceedings of 5th Berkeley Symposium on Mathematical Statistics and Probability, Berkeley, CA, USA, pp.281-297.
41. Mahboubi, H. (2008) XWeB Query-Workload, http://eric.univ-lyon2.fr/~hmahboubi/Workload/workload.xq
42. Mahboubi, H. and Darmont, J. (2006) 'Benchmarking XML data warehouses', Proceedings of the 2006 Decision-Support Systems Workshop, 9th Maghrebian Conference on Information Technologies, Agadir, Morocoo, Paper 5.
43. Mahboubi, H. and Darmont, J. (2009) 'Enhancing XML data warehouse query performance by fragmentation', Proceedings of the 24th Annual ACM Symposium on Applied Computing, Hawaii, HI, USA, pp.1555-1562.
44. Mahboubi, H., Marouane, H. and Darmont, J. (2008) 'XML warehousing and OLAP', in Wang, J. (Ed.): Encyclopedia of Data Warehousing and Mining 2nd ed., Idea Group, Hershey, PA, USA, pp.2109-2116.
45. Marouane, H., Mahboubi, H. and Darmont, J. (2008) 'Expressing OLAP operators with the TAX XML algebra', Proceedings of the 3rd International Workshop on Database Technologies for Handling XML Information on the Web, Nantes, France, pp.61-66.
46. Meier, V. (2002) 'eXist: An open source native XML database', in Chaudhri, A., Jeckle, M., Rahm, E. and Unland, R. (Eds.): Web, Web-Services, and Database Systems, NODe 2002 Web and Database-Related Workshops, LNCS, Springer, Erfurt, Germany, Vol. 2593, pp.169-183.
47. Munneke, D., Wahlstrom, K. and Mohania, M.K. (1999) 'Fragmentation of multidimensional databases', Proceedings of the 10th Australasian Database Conference, Auckland, New Zealand, pp.153-164.
48. Navathe, S., Ceri, S., Wiederhold, G. and Dou, J. (1984) 'Vertical partitioning algorithms for database design', Transactions on Database Systems, ACM, New York, NY, Vol. 9, No. 4, pp.680-710.
49. Navathe, S.B., Karlapalem, K. and Minyoung, R. (1995) 'A mixed fragmentation methodology for initial distributed database design', Journal of Computer and Software Engineering, Vol. 3, No. 4, pp.395-426.
50. Navathe, S. and Ra, N. (1989) 'Vertical partitionning for database design: A graphical algorithm', Proceedings of the 1989 SIGMOD International Conference on Management of Data, Portland, OR, USA, pp.440-450.
51. Noaman, A.Y. and Barker, K. (1999) 'A horizontal fragmentation algorithm for the fact relation in a distributed data warehouse', Proceedings of the 8th International Conference on Information and Knowledge Management, Kansas City, MO, USA, pp.154-161.
52. Paparizos, P., Wu, Y., Lakshmanan, L.V.S. and Jagadish, H.V. (2004) 'Tree logical classes for efficient evaluation of XQuery', Proceedings of the 2004 SIGMOD International Conference on Management of Data, Paris, France, pp.71-82.
53. Park, B.K., Han, H. and Song, I.Y. (2005) 'XML-OLAP: A multidimensional analysis framework for XML warehouses', Proceedings of the 7th International Conference on Data Warehousing and Knowledge Discovery, LNCS, Copenhagen, Denmark, Vol. 3589, pp.32-42.
54. Pernul, G., Karlapalem, K. and Navathe, B. (1991) 'Relational database organization based on views and fragments', Proceedings of 2nd International Conference Database and Expert Systems Applications, Berlin, Germany, pp.380-386.
55. Pham, D.T., Dimov, S.S. and Nguyen, C.D. (2004) 'An incremental K means algorithm', Journal of Mechanical Engineering Science, Vol. 218, No. 7, pp.783-795.
56. Pokorný, J. (2002) 'XML data warehouse: Modelling and querying', Proceedings of the 5th Baltic Conference on Databases and Information Systems, Shanghai, China, pp.267-280.
57. Rusu, L.I., Rahayu, J.W. and Taniar, D. (2005) 'A methodology for building XML data warehouses', International Journal of Data Warehousing and Mining, Vol. 1, No. 23, pp.67-92.
58. Wehrle, W., Miquel, M. and Tchounikine, A. (2005) 'A model for distributing and querying a data warehouse on a computing grid', Proceedings of the 11th International Conference on Parallel and Distributed Systems, Fuduoka, Japan, pp.203-209.
59. Wiwatwattana, N., Jagadish, H.V., Lakshmanan, L.V.S. and Srivastava, D. (2007) 'X.3: A cube operator for XML OLAP', Proceedings of the 23rd International Conference on Data Engineering, Istanbul, Turkey, pp.916-925.
60. Wu, M-C. and Buchmann, A.P. (1997) 'Research issues in data warehousing', Proceedings of the 7th German Conference on Database Systems in Office, Engineering, and Scientific Applications, Ulm, Germany, pp.61-82.
61. Zhang, Y. and Orlowska, M.E. (1994) 'On fragmentation approaches for distributed database design', Information Sciences, Vol. 1, No. 3, pp.117-132.
62. Zhang, J., Wang, W., Han, L. and Zhang, S. (2005) 'X-warehouse: Building query pattern-driven data', Proceedings of the 14th International Conference on World Wide Web, Chiba, Japan, pp.896-897.