Efficient similarity-based operations for data integration

Data and Knowledge Engineering

Volumn 48, Issue 3, 2004, Pages 361-387

  Schallehn, Eike ^a   Sattler, Kai Uwe ^a   Saake, Gunter ^a  

^a OTTO VON GUERICKE UNIVERSITY   (Germany)

Author keywords

Data cleaning; Data integration; Duplicate detection; Similarity join; Similarity based operations

Indexed keywords

DATA MINING; DATABASE SYSTEMS; DECISION MAKING; INFORMATION TECHNOLOGY; INTERNET; LINEAR ALGEBRA; MATHEMATICAL TRANSFORMATIONS; WAREHOUSES;

DATA CLEANING; DATA INTEGRATION; DUPLICATE DETECTION; SIMILARITY JOIN; SIMILARITY-BASED OPERATIONS;

KNOWLEDGE ENGINEERING;

EID: 1142288181     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2003.08.004     Document Type: Article

References (31)

1. D. Calvanese, G. de Giacomo, M. Lenzerini, D. Nardi, R. Rosati, A principled approach to data integration and reconciliation in data warehousing. in: Proceedings of the International Workshop on Design and Management of Data Warehouses (DMDW'99), Heidelberg, Germany, 1999.
2. Cohen W. Integration of heterogeneous databases without common domains using queries based on textual similarity. Haas L.M., Tiwary A. SIGMOD 1998, Proceedings ACM SIGMOD International Conference on Management of Data. 1998;201-212 ACM Press, Seattle, Washington, USA.
3. Dey D., Sarkar S. A probabilistic relational model and algebra. ACM Transactions on Database Systems. 21(3):1996;339-369.
4. O. Dunemann, I. Geist, R. Jesse, K.-U. Sattler, A. Stephanik, A database-supported workbench for information fusion: infuse, in: C.S. Jensen, K.G. Jeffery, J. Pokorný, S. Saltenis, E. Bertino, K. Böhm, M. Jarke (Eds.), Advances in Database Technology - EDBT 2002, 8th International Conference on Extending Database Technology, Prague, Czech Republic, 25-27 March, Proceedings, volume 2287 of Lecture Notes in Computer Science, Springer, 2002, pp. 756-758.
5. Elmasri R., Navathe S.B. Fundamentals of Database Systems. second ed. 1994;Benjamin/Cummings, Redwood City, CA.
6. N. Fuhr, Probabilistic datalog - a logic for powerful retrieval methods, in: Proceedings of the Eighteenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Retrieval Logic, 1995, pp. 282-290.
7. H. Galhardas, D. Florescu, D. Shasha, E. Simon, AJAX: an extensible data cleaning tool, in: W. Chen, J. Naughton, P.A. Bernstein (Eds.), Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, vol. 29(2), Dallas, Texas, 2000, p. 590.
8. C.L. Giles, K.D. Bollacker, S. Lawrence, Citeseer: an automatic citation indexing system, in: DL'98: Proceedings of the 3rd ACM International Conference on Digital Libraries, 1998, pp. 89-98.
9. Graefe G. Query evaluation techniques for large databases. ACM Computing Surveys. 25(2):1993;73-170.
10. L. Gravano, P. Ipeirotis, N. Koudas, D. Srivastava, Text joins for data cleansing and integration in an rdbms, 2003.
11. Gravano L., Ipeirotis P.G., Jagadish H.V., Koudas N., Muthukrishnan S., Srivastava D. Approximate string joins in a database (almost) for free. Proceedings of the 27th International Conference on Very Large Data Bases(VLDB'01. 2001;491-500 Morgan Kaufmann, Orlando.
12. Hellerstein J.M., Stonebraker M., Caccia R. Independent, open enterprise data integration. IEEE Data Engineering Bulletin. 22(1):1999;43-49.
13. M.A. Hernández, S.J. Stolfo, The merge/purge problem for large databases, in: M.J. Carey, D.A. Schneider (Eds.), Proceedings of the 1995 ACM SIGMOD International Conference on Management of Data, San Jose, California, 1995, pp. 127-138.
14. J.A. Hylton, Identifying and merging related bibliographic records, Technical Report MIT/LCS/TR-678, Massachusetts Institute of Technology, 1996.
15. K.P. Jantke, Nonstandard concepts of similarity in case-based reasoning, in: H.-H. Bock, W. Lenski, M.M. Richter (Eds.), Information Systems and Data Analysis: Prospects - Foundations - Applications, Proceedings of the 17th Annual Conference of the GfKl, University of Kaiserslautern, 1993, Kaiserslautern, 1994, Springer, Berlin, pp. 28-43.
16. Kent W. The breakdown of the information model in multi-database systems. SIGMOD Record. 20(4):1991;10-15.
17. W.-S. Li, Knowledge gathering and matching in heterogeneous databases, in: AAAI Spring Symposium on Information Gathering, 1995.
18. Lim E.-P., Srivastava J., Prabhakar S., Richardson J. Entity identification in database integration. International Conference on Data Engineering. 1993;294-301 IEEE Computer Society Press, Los Alamitos, CA, USA.
19. Luján-Mora S., Palomar M. Reducing inconsistency in integrating data from different sources. Adiba M., Collet C., Desai B.P. Proceedings of the International Database Engineering and Applications Symposium (IDEAS 2001). 2001;219-228 IEEE Computer Society, Grenoble, France.
20. Monge A.E., Elkan C.P. The field matching problem: algorithms and applications. Simoudis E., Han J.W., Fayyad U. Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD-96). 1996;267 AAAI Press, London.
21. A.E. Monge, C.P. Elkan, An efficient domain-independent algorithm for detecting approximately duplicate database records, in: Proceedings of the Workshop on Research Issues on Data Mining and Knowledge Discovery (DMKD'97), 1997.
22. Navarro G. A guided tour to approximate string matching. ACM Computing Surveys. 33(1):2001;31-88.
23. M.M. Richter, Classification and learning of similarity measures. SEKI Report SR-92-18, Fachbereich Informatik, Universität Kaiserslautern, 1992.
24. Santini S., Jain R. Similarity measures. IEEE Transactions on Pattern Analysis and Machine Intelligence. 21(9):1999;871-883.
25. Schallehn E., Sattler K., Saake G. Advanced grouping and aggregation for data integration. Proceedings of the 10th International Conference on Information and Knowledge Management. 2001;547-549 CIKM'01, Atlanta, GA.
26. Shang H., Merrett T.H. Tries for approximate string matching. IEEE Transactions on Knowledge and Data Engineering. 8(4):1996;540-547.
27. Shim K., Srikant R., Agrawal R. High-dimensional similarity joins. Proceedings of the 13th International Conference on Data Engineering (ICDE'97). 1997;301-313 IEEE, Washington, Brussels, Tokyo.
28. F. Tseng, A. Chen, W. Yang, A probabilistic approach to query processing in heterogeneous database systems, in: Proceedings of the 2nd International Workshop on Research Issues on Data Engineering: Transaction and Query Processing, 1992, pp. 176-183.
29. Wang H., Zaniolo C. Using sql to build new aggregates and extenders for object-relational systems. El Abbadi A., Brodie M.L., Chakravarthy S., Dayal U., Kamel N., Schlageter G., Whang K.-Y. Proceedings of the 26th International Conference on Very Large Data Bases (VLDB'00). 2000;166-175 Morgan Kaufmann, Cairo, Egypt.
30. Yan T.W., Garcia-Molina H. Duplicate removal in information dissemination. Proceedings of the 21st International Conference on Very Large Data Bases (VLDB'95). 1995;66-77 Morgan Kaufmann Publishers, Inc. San Francisco, CA, USA.
31. G. Zhou, R. Hull, R. King, J. Franchitti, Using object matching and materialization to integrate heterogeneous databases, In Proc. of 3rd Intl. Conf. on Cooperative Information Systems (CoopIS-95), Vienna, Austria, 1995.