Towards generating ETL processes for incremental loading

ACM International Conference Proceeding Series

Volumn 299, Issue , 2008, Pages 101-110

  Jörg, Thomas ^a   Deßloch, Stefan ^a  

^a Rheinland Pfälzische Technische Universität Kaiserslautern Landau   (Germany)

Author keywords

data integration; data warehousing; extract; information integration; load (ETL); transform

Indexed keywords

CHANGE PROPAGATION; COMPLEX TASK; DATA CAPTURE; DATA INTEGRATION; DATA WAREHOUSING; ETL PROCESS; HETEROGENEOUS SOURCES; INFORMATION INTEGRATION; INTEGRATED DATA; SCHEMA MAPPINGS; SOURCE DATA;

DATA FLOW ANALYSIS; DATA HANDLING; INFORMATION RETRIEVAL; METADATA; WAVELET TRANSFORMS;

DATA WAREHOUSES;

EID: 77954435652     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1451940.1451956     Document Type: Conference Paper

References (29)

1. IBM DB2 Data Warehouse Enterprise Edition. www.ibm.com/software/data/db2/ dwe/.
2. IBM WebSphere DataStage. http://www-306.ibm.com/software/data/ integration/datastage/.
3. Informatica PowerCenter. http://www.informatica.com/products-services/ powercenter/.
4. Oracle Database Change Data Capture. http://www.oracle.com/database.
5. Oracle Warehouse Builder. http://www.oracle.com/technology/products/ warehouse/index.html.
6. WebSphere Replication Server (SQL replication). http://www-306.ibm.com/ software/data/integration/replication-server/.
7. D. Agrawal, A. E. Abbadi, A. K. Singh, and T. Yurek. Efficient View Maintenance at Data Warehouses. In J. Peckham, editor, SIGMOD 1997, Proceedings ACM SIGMOD International Conference on Management of Data, May 13-15, 1997, Tucson, Arizona, USA, pages 417-427. ACM Press, 1997.
8. J. A. Blakeley, N. Coburn, and P.-Å. Larson. Updating Derived Relations: Detecting Irrelevant and Autonomously Computable Updates. ACM Trans. Database Syst., 14(3):369-400, 1989.
9. M. Bokun and C. Taglienti. Incremental Data Warehouse Updates. DM Review Magazine, May 1998.
10. E. F. Codd. A Relational Model of Data for Large Shared Data Banks. Commun. ACM, 13(6):377-387, 1970.
11. S. Dessloch, M. A. Hernández, R. Wisnesky, A. Radwan, and J. Zhou. Orchid: Integrating Schema Mapping and ETL. In ICDE, pages 1307-1316, 2008.
12. T. Griffin and L. Libkin. Incremental Maintenance of Views with Duplicates. In SIGMOD Conference, pages 328-339, 1995.
13. A. Gupta, H. V. Jagadish, and I. S. Mumick. Data Integration using Self-Maintainable Views. In EDBT, pages 140-144, 1996.
14. H. Gupta and I. S. Mumick. Incremental Maintenance of Aggregate and Outerjoin Expressions. Inf. Syst., 31(6):435-464, 2006.
15. R. Kimball and J. Caserta. The Data Warehouse ETL Toolkit: Practical Techniques for Extracting, Cleaning, Conforming, and Delivering Data. John Wiley & Sons, Inc., 2004.
16. R. Kimball and M. Ross. The Data Warehouse Toolkit: The Complete Guide to Dimensional Modeling. John Wiley & Sons, Inc., New York, NY, USA, 2002.
17. W. Labio and H. Garcia-Molina. Comparing Very Large Database Snapshots. Technical Report STAN-CS-TN-95-27, Computer Science Department, Stanford University, June 1995.
18. W. Labio and H. Garcia-Molina. Efficient Snapshot Differential Algorithms for Data Warehousing. In VLDB, pages 63-74, 1996.
19. U. Leser and F. Naumann. Informationsintegration. dpunkt.verlag, 2007.
20. M. K. Mohania, S. Konomi, and Y. Kambayashi. Incremental Maintenance of Materialized Views. In DEXA, pages 551-560, 1997.
21. T. Palpanas, R. Sidle, R. Cochrane, and H. Pirahesh. Incremental Maintenance for Non-Distributive Aggregate Functions. In VLDB, pages 802-813, 2002.
22. X. Qian and G. Wiederhold. Incremental Recomputation of Active Relational Expressions. IEEE Trans. Knowl. Data Eng., 3(3):337-341, 1991.
23. D. Quass. Maintenance Expressions for Views with Aggregation. In VIEWS, pages 110-118, 1996.
24. A. Simitsis. Modeling and managing ETL processes. In VLDB PhD Workshop, 2003.
25. A. Simitsis. Mapping conceptual to logical models for etl processes. In DOLAP, pages 67-76, 2005.
26. A. Simitsis, P. Vassiliadis, and T. K. Sellis. Optimizing ETL Processes in Data Warehouses. In ICDE, pages 564-575, 2005.
27. A. Simitsis, P. Vassiliadis, M. Terrovitis, and S. Skiadopoulos. Graph-Based Modeling of ETL Activities with Multi-level Transformations and Updates. In DaWaK, pages 43-52, 2005.
28. T. Urpí and A. Olivé. A Method for Change Computation in Deductive Databases. In VLDB, pages 225-237, 1992.
29. P. Vassiliadis, A. Simitsis, and S. Skiadopoulos. Conceptual modeling for ETL processes. In DOLAP, pages 14-21, 2002.