A generalization of blocking and windowing algorithms for duplicate detection

Proceedings - 2011 International Conference on Data and Knowledge Engineering, ICDKE 2011

Volumn , Issue , 2011, Pages 18-24

  Draisbach, Uwe ^a   Naumann, Felix ^a  

^a UNIVERSITY OF POTSDAM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BLOCKING METHOD; DATA SETS; DISJOINT SUBSETS; DUPLICATE DETECTION; NEIGHBORHOOD METHODS; REAL-WORLD ENTITIES; WINDOWING ALGORITHMS;

DATA PROCESSING; KNOWLEDGE ENGINEERING;

ALGORITHMS;

EID: 80455149936     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDKE.2011.6053920     Document Type: Conference Paper

References (16)

1. Rohit Ananthakrishna, Surajit Chaudhuri, and Venkatesh Ganti. Eliminating fuzzy duplicates in data warehouses. In Proceedings of the International Conference on Very Large Databases (VLDB), 2002.
2. Rohan Baxter, Peter Christen, and Tim Churches. A comparison of fast blocking methods for record linkage. In SIGKDD Workshop on Data Cleaning, Record Linkage and Object Consolidation, 2003.
3. Mikhail Bilenko, Beena Kamath, and Raymond J. Mooney. Adaptive blocking: Learning to scale up record linkage. In Industrial Conference on Data Mining (ICDM), 2006.
4. Peter Christen. Towards parameter-free blocking for scalable record linkage. Technical Report TR-CS-07-03, The Australian National University, August 2007.
5. Peter Christen and Karl Goiser. Quality and complexity measures for data linkage and deduplication. In Quality Measures in Data Mining, volume 43 of Studies in Computational Intelligence. Springer, 2007.
6. Uwe Draisbach and Felix Naumann. A comparison and generalization of blocking and windowing algorithms for duplicate detection. In Proceedings of the International Workshop on Quality in Databases (QDB), 2009.
7. Uwe Draisbach and Felix Naumann. DuDe: The duplicate detection toolkit. In Proceedings of the International Workshop on Quality in Databases (QDB), 2010.
8. Ahmed K. Elmagarmid, Panagiotis G. Ipeirotis, and Vassilios S. Verykios. Duplicate record detection: A survey. IEEE Transactions on Knowledge and Data Engineering (TKDE), 19, 2007.
9. Mauricio A. Hernández and Salvatore J. Stolfo. The merge/purge problem for large databases. In Proceedings of the ACM International Conference on Management of Data (SIGMOD), 1995.
10. Mauricio A. Hernández and Salvatore J. Stolfo. Real-world data is dirty: Data cleansing and the merge/purge problem. Data Mining and Knowledge Discovery, 2(1), 1998.
11. David Menestrina, Steven Euijong Whang, and Hector Garcia-Molina. Evaluating entity resolution results. In Proceedings of the International Conference on Very Large Databases (VLDB), 2010.
12. Alvaro E. Monge and Charles Elkan. An efficient domain-independent algorithm for detecting approximately duplicate database records. In Proceedings of the Workshop on Research Issues on Data Mining and Knowledge Discovery, 1997.
13. Felix Naumann and Melanie Herschel. An Introduction to Duplicate Detection (Synthesis Lectures on Data Management). Morgan and Claypool Publishers, 2010.
14. Sven Puhlmann, Melanie Weis, and Felix Naumann. XML duplicate detection using sorted neighborhoods. In Proceedings of the International Conference on Extending Database Technology (EDBT), 2006.
15. Steven Euijong Whang, David Menestrina, Georgia Koutrika, Martin Theobald, and Hector Garcia-Molina. Entity resolution with iterative blocking. In Proceedings of the ACM International Conference on Management of Data (SIGMOD), 2009.
16. Su Yan, Dongwon Lee, Min-Yen Kan, and Lee C. Giles. Adaptive sorted neighborhood methods for efficient record linkage. In Proceedings of the 7th ACM/IEEE-CS joint conference on Digital libraries, 2007.