State-space optimization of ETL workflows

IEEE Transactions on Knowledge and Data Engineering

Volumn 17, Issue 10, 2005, Pages 1404-1419

  Simitsis, Alkis ^a   Vassiliadis, Panos ^b   Sellis, Timos ^a  

^a NATIONAL TECHNICAL UNIVERSITY OF ATHENS   (Greece)

^b UNIVERSITY OF IOANNINA   (Greece)

Author keywords

Data warehouse and repository; Database integration; Database management; Heterogeneous databases; Workflow management

Indexed keywords

CUSTOMIZATION; EXTRACTION-TRANSFORMATION-LOADING (ETL) TOOLS; LOGICAL OPTIMIZATION;

ALGORITHMS; COMPUTER SOFTWARE; DATA WAREHOUSES; FORMAL LOGIC; MATHEMATICAL TRANSFORMATIONS; OPTIMIZATION;

STATE SPACE METHODS;

EID: 27644520380     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2005.169     Document Type: Article

References (27)

1. D.J. Abadi et al. "Aurora: A New Model and Architecture for Data Stream Management," The Very Large Data Bases J., vol. 12, no. 2, pp. 120-139, 2003.
2. J. Adzic and V. Fiore, "Data Warehouse Population Platform," Proc. Fifth Int'l Workshop Design and Management of Data Warehouses, 2003.
3. S. Alagic and P.A. Bernstein, "A Model Theory for Generic Schema Management," Proc. Eighth Int'l Workshop Database Programming Languages, pp. 228-246, 2001.
4. S. Babu and J. Widom, "Continuous Queries over Data Streams," SIGMOD Record, vol. 30, no. 3, pp. 109-120, 2001.
5. V. Borkar, K. Deshmuk, and S. Sarawagi, "Automatically Extracting Structure from Free Text Addresses," Bull. Technical Committee on Data Eng., vol. 23, no. 4, pp. 27-32, 2000.
6. J. Chen, S. Chen, and E.A. Rundensteiner, "A Transactional Model for Data Warehouse Maintenance," Proc. 21st Int'l Conf. Concept Modelling, pp. 247-262, 2002.
7. Y. Cui and J. Widom, "Lineage Tracing for General Data Warehouse Transformations," The Very Large Data Bases J., vol. 12, pp. 41-58, 2003.
8. R. Elmasri and S.B. Navathe, Fundamentals of Database Systems. Addison-Wesley Pubs, 2000.
9. Gartner, "ETL Magic Quadrant Update: Market Pressure Increases," http://www.gartner.com/reprints/informatica/112769.html, 2002.
10. H. Galhardas, D. Florescu, D. Shasha, and E. Simon, "Ajax: An Extensible Data Cleaning Tool," Proc. ACM Int'l Conf. Management of Data, p. 590, 2000.
11. G. Graefe, "Query Evaluation Techniques for Large Databases," ACM Computing Surveys, vol. 5, no. 2, pp. 73-170, 1993.
12. IBM, "IBM Data Warehouse Manager," http://www-3.ibm.com/ software/data/db2/datawarehouse, 2004.
13. Informatica, "PowerCenter," http://www.informatica.com/ products/data+integration/power-center/default.htm, 2004.
14. M. Jarke and J. Koch, "Query Optimization in Database Systems," ACM Computing Surveys, vol. 16, no. 2, pp. 111-152, 1984.
15. D. Lomet and J. Gehrke, "Special Issue on Data Stream Processing," Bull. Technical Committee on Data Eng., vol. 26, no. 1, 2003.
16. W. Labio, J.L. Wiener, H. Garcia-Molina, and V. Gorelik, "Efficient Resumption of Interrupted Warehouse Loads," Proc. ACM Int'l Conf. Management of Data, pp. 46-57, 2000.
17. Microsoft, "Data Transformation Services," www.microsoft.com, 2004.
18. R.J. Miller, Y.E. Ioannidis, and R. Ramakrishnan, "Schema Equivalence in Heterogeneous Systems: Bridging Theory and Practice," Information Systems, vol. 19, no. 1, pp. 3-31, 1994.
19. Oracle Corp., "Oracle9i Warehouse Builder User's Guide, Release 9.0.2," http://otn.oracle.com/products/warehouse/content.html, Nov. 2001.
20. M. Tamer Ozsu and P. Valduriez, Principles of Distributed Database Systems. Prentice Hall, 1991.
21. E. Rahm and H. Do, "Data Cleaning: Problems and Current Approaches," Bull. Technical Committee on Data Eng., vol. 23, no. 4, pp. 3-13, 2000.
22. V. Raman and J. Hellerstein, "Potter's Wheel: An Interactive Data Cleaning System," Proc. 27th Intl. Conf. Very Large Data Bases, pp. 381-390, 2001.
23. D. Theodoratos and T.K. Sellis, "Data Warehouse Configuration," Proc. 23rd Int'l Conf. Very Large Data Bases, pp. 126-135, 1997.
24. P. Vassiliadis, A. Simitsis, and S. Skiadopoulos, "Modeling ETL Activities as Graphs," Proc. Fourth Int'l Workshop Design and Management of Data Warehouses, pp. 52-61, 2002.
25. Y. Velegrakis, R.J. Miller, and L. Popa, "Mapping Adaptation under Evolving Schemas," Proc. 29th Int'l Conf. Very Large Data Bases, pp. 584-595, 2003.
26. P. Vassiliadis, A. Simitsis, P. Georgantas, and M. Terrovitis, "A Framework for the Design of ETL Scenarios," Proc. 15th Conf. Advanced Information System Eng., pp. 520-535, 2003.
27. A. Simitsis, P. Vassiliadis, and T. Sellis, "Optimizing ETL Processes in Data Warehouses," Proc. 21st IEEE Int'l Conf. Data Eng., pp. 564-575, 2005.