Detecting duplicate objects in XML documents

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2004, Pages 10-19

  Weis, Melanie ^a   Naumann, Felix ^a  

^a HUMBOLDT UNIVERSITY   (Germany)

Author keywords

data cleansing; duplicate detection; similarity; XML

Indexed keywords

DATA CLEANSING; DATA QUALITY; DATA REPRESENTATIONS; DUPLICATE DETECTION; EDIT DISTANCE; ELEMENT COMPARISON; FILTER FUNCTION; FILTERING METHOD; NESTED XML DOCUMENTS; REAL-WORLD OBJECTS; SIMILARITY FUNCTIONS; SIMILARITY MEASURE; STRING SIMILARITY; TOPDOWN; TRANSITIVE CLOSURE; XML TREES;

INFORMATION ANALYSIS; INFORMATION SYSTEMS; MARKUP LANGUAGES; TREES (MATHEMATICS);

XML;

EID: 77954010643     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1012453.1012456     Document Type: Conference Paper

References (27)

1. Internet movie database: http://www.imdb.com/.
2. Mondial database: http://www.dbis.informatik.unigoettingen.de/mondial.
3. ANANTHAKRISHNA, R., CHAUDHURI, S., AND GANTI, V. Eliminating fuzzy duplicates in data warehouses. In Proceedings of the 28th International Conference on Very Large Databases (VLDB-2002) (Hong Kong, China, 2002).
4. BAEZA-YATES, R. A., AND RIBEIRO-NETO, B. A. Modern information retrieval. ACM Press / Addison-Wesley (1999).
5. BARTOLINI, I., CIACCIA, P., AND PATELLA, M. String matching with metric trees using an approximate distance. In Proceedings of the 9th International Symposium on String Precessing and Information Retrieval (SPIRE-2002) (Belo Horizonte, Brazil, 2002), pp. 271-283.
6. BILENKO, M., AND MOONEY, R. J. Adaptive duplicate detection using learnable string similarity measures. In Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2003) (Washington, DC, 2003).
7. BILENKO, M., AND MOONEY, R. J. Employing trainable string similarity metrics for information integration. In Proceedings of the IJCAI-2003 Workshop on Information Integration on the Web (Acapulco, Mexico, Aug. 2003), pp. 67-72.
8. GALHARDAS, H., FLORESCU, D., SHASHA, D., SIMON, E., AND SAITA, C. Declarative data cleaning: Language, model, and algorithms. In Proceedings of the 27th International Conference on Very Large Databases (VLDB-2001) (Rome, Italy, 2001), pp. 371-380.
9. GRAVANO, L., IPEIROTIS, P., JAGADISH, H., KOUDAS, N., MUTHUKRISHNAN, S., AND SRIVASTAVA, D. Approximate string joins in a database (almost) for free. In Proceedings of the 27th International Conference on Very Large Databases (VLDB-2001) (Roma, Italy, 2001), pp. 491-500.
10. HERNÁNDEZ, M. A., AND STOLFO, S. J. The merge/purge problem for large databases. In Proceedings of the 1995 ACM SIGMOD International Conference on Management of Data (SIGMOD-95) (San Jose, CA, May 1995), pp. 127-138.
11. HYLTON, J. A. Identifying and merging related bibliographic records. Master's thesis, Department of Electrical Engineering and Computer Science, MIT, 1996.
12. JARO, M. A. Probabilistic linkage of large public health data files. Statistics in Medicine 14, 5-7, 491-498.
13. JIN, L., LI, C., AND MEHROTRA, S. Efficient similarity string joins in large data sets. Tech. Rep. TR-DB-02-04, UCI ICS, 2002.
14. JIN, L., LI, C., AND MEHROTRA, S. Efficient record linkage in large data sets. In Procceedings of the 8th International Conference on Database Systems for Advanced Applications (DASFAA-03) (Kyoto, Japan, 2003), pp. 137-.
15. KAILING, K., KRIEGEL, H.-P., SCHNAUER, S., AND SEIDEL, T. Efficient similarity search for hierarchical data in large databases. In Proceedings of the 9th International Conference on Extending Database Technology (EDBT-2004) (Heraclion, Crete, 2004), pp. 676-693.
16. LIM, E.-P., SRIVASTAVA, J., PRABHAKAR, S., AND RICHARDSON, J. Entity identification in database integration. In Proceedings of the 9th International Conference on Data Engineering (ICDE-93) (Vienna, Austria, April 1993), pp. 294-301.
17. MONGE, A. E., AND ELKAN, C. P. The field matching problem: Algorithms and applications. In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining (KDD-96) (Portland, OR, August 1996), pp. 267-270.
18. MONGE, A. E., AND ELKAN, C. P. An efficient domain-independent algorithm for detecting approximately duplicate database records. In Proceedings of the SIGMOD 1997 Workshop on Research Issues on Data Mining and Knowledge Discovery (Tuscon, AZ, May 1997), pp. 23-29.
19. NAVARRO, G. A guided tour to approximate string matching. ACM Computing Surveys, Volume 33, pages 31-88 (2003).
20. QUASS, D., AND STARKEY, P. Record linkage for genealogical databases. In Proceedings of the KDD-2003 Workshop on Data Cleaning, Record Linkage, and Object Consolidation (Washington, DC, 2003), pp. 40-42.
21. RAHM, E., AND DO, H. H. Data cleaning: Problems and current approaches. IEEE Data Engineering Bulletin, Volume 23, pages 3-13 (2000).
22. RAMAN, V., AND HELLERSTEIN, J. M. Potter's wheel: An interactive data cleaning system. In Proceedings of 27th International Conference on Very Large Databases (VLDB-2001) (Rome, Italy, 2001), pp. 381-390.
23. SARAWAGI, S., AND BHAMIDIPATY, A. Interactive deduplication using active learning. In Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2002) (Edmonton, Alberta, 2002).
24. SCHLIEDER, T. Schema-driven evaluation of approximate tree-pattern queries. In Proceedings of the 8th International Conference on Extending Database Technology (EDBT-2002) (Prague, Czech Republic, 2002), pp. 514-532.
25. WINKLER, W. E. Advanced methods for record linkage. Tech. rep., Statistical Research Division, U.S. Census Bureau, Washington, DC, 1994.
26. WINKLER, W. E. Data cleaning methods. In Proceedings of the KDD-2003 Workshop on Data Cleaning, Record Linkage, and Object Consolidation (Washington, DC, 2003), pp. 1-6.
27. YAN, T. W., AND GARCIA-MOLINA, H. Duplicate removal in information dissemination. In Proceedings of 21th International Conference on Very Large Data Bases (VLDB-95) (Zurich, Switzerland, 1995), pp. 66-77.